2024-04-24T22:46:59.036 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T22:46:59.036 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163 --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair} -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/orig.config.yaml 2024-04-24T22:46:59.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T22:46:59.189 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672163' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - bad backtrace on directory inode - error reading table object - Metadata damage detected - slow requests are blocked - Behind on trimming - error reading sessionmap sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFT98fVbGixssoDrgBzjgC4YQ1stQ3V5DH3Bky0Od9sqvdIgX0fSIjhufT6cHD+dtxbTnaxhfdm8NFCp/QN7f0= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGo0ZlUOhcL3PjUomP2SDuBoC0WP4Vavue8Sm518pEo8rKf/GwAK3pwz4MYFyKRmD7UPMuxz6tf77lsQ6pqbH+8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_journal_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T22:46:59.189 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-24T22:46:59.190 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-24T22:46:59.190 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T22:46:59.191 INFO:teuthology.task.internal:Checking packages... 2024-04-24T22:46:59.216 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-24T22:46:59.217 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T22:46:59.217 INFO:teuthology.packaging:ref: None 2024-04-24T22:46:59.217 INFO:teuthology.packaging:tag: None 2024-04-24T22:46:59.217 INFO:teuthology.packaging:branch: squid 2024-04-24T22:46:59.217 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:46:59.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-24T22:46:59.434 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-24T22:46:59.435 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T22:46:59.441 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T22:46:59.441 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T22:46:59.459 INFO:teuthology.task.internal:Saving configuration 2024-04-24T22:46:59.477 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T22:46:59.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T22:46:59.506 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 22:41:35.517193', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFT98fVbGixssoDrgBzjgC4YQ1stQ3V5DH3Bky0Od9sqvdIgX0fSIjhufT6cHD+dtxbTnaxhfdm8NFCp/QN7f0='} 2024-04-24T22:46:59.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 22:41:35.515850', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGo0ZlUOhcL3PjUomP2SDuBoC0WP4Vavue8Sm518pEo8rKf/GwAK3pwz4MYFyKRmD7UPMuxz6tf77lsQ6pqbH+8='} 2024-04-24T22:46:59.529 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T22:46:59.535 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-24T22:46:59.535 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-24T22:46:59.535 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T22:46:59.607 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ce51ac0d0>, signals=[15]) 2024-04-24T22:46:59.607 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T22:46:59.614 INFO:teuthology.task.internal:Opening connections... 2024-04-24T22:46:59.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:46:59.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:46:59.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:46:59.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:46:59.766 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T22:46:59.772 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-04-24T22:46:59.791 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-04-24T22:46:59.791 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-04-24T22:46:59.848 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-04-24T22:46:59.848 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T22:46:59.849 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T22:46:59.850 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-04-24T22:46:59.876 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-04-24T22:46:59.895 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-04-24T22:46:59.895 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-04-24T22:46:59.951 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-04-24T22:46:59.951 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T22:46:59.952 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T22:46:59.953 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-04-24T22:46:59.975 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T22:46:59.984 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T22:46:59.989 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T22:46:59.989 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-04-24T22:46:59.992 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-04-24T22:47:00.008 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T22:47:00.013 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T22:47:00.014 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-04-24T22:47:00.049 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-04-24T22:47:00.268 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T22:47:00.320 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T22:47:00.336 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-24T22:47:00.336 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-24T22:47:00.336 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-24T22:47:00.337 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T22:47:00.337 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T22:47:00.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:47:00.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-24T22:47:00.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:47:00.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-24T22:47:00.536 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:00.537 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T22:47:00.537 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-24T22:47:00.554 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-437.el9.x86_64 2024-04-24T22:47:00.554 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:00.554 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T22:47:00.555 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum upgrade -y linux-firmware 2024-04-24T22:47:00.591 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:00.591 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-24T22:47:00.591 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-04-24T22:47:00.608 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-437.el9.x86_64 2024-04-24T22:47:00.608 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:00.608 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-24T22:47:00.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum upgrade -y linux-firmware 2024-04-24T22:47:03.800 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.0 MB 00:01 2024-04-24T22:47:04.262 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:01 2024-04-24T22:47:06.952 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 19 MB 00:02 2024-04-24T22:47:07.712 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 19 MB 00:02 2024-04-24T22:47:13.143 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.2 MB 00:02 2024-04-24T22:47:13.895 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.2 MB 00:02 2024-04-24T22:47:14.977 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-04-24T22:47:15.388 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-24T22:47:16.506 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-24T22:47:18.322 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-04-24T22:47:21.612 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-24T22:47:23.424 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-24T22:47:23.584 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-24T22:47:23.585 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-24T22:47:23.585 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-24T22:47:23.678 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-24T22:47:23.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:23.830 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-24T22:47:23.830 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-24T22:47:23.833 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi203.front.sepia.ceph.com to complete... 2024-04-24T22:47:25.447 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-04-24T22:47:25.448 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-04-24T22:47:25.448 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-04-24T22:47:25.553 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-24T22:47:25.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-24T22:47:25.775 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-24T22:47:25.775 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-24T22:47:25.778 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2024-04-24T22:47:37.574 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24 22:47:37 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-24T22:47:37.575 INFO:teuthology.orchestra.run.smithi203.stderr:FINISHED --2024-04-24 22:47:37-- 2024-04-24T22:47:37.575 INFO:teuthology.orchestra.run.smithi203.stderr:Total wall clock time: 14s 2024-04-24T22:47:37.575 INFO:teuthology.orchestra.run.smithi203.stderr:Downloaded: 1 files, 341M in 13s (25.5 MB/s) 2024-04-24T22:47:37.578 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-24T22:47:37.578 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-24T22:47:39.691 INFO:teuthology.orchestra.run.smithi203.stdout:Verifying... ######################################## 2024-04-24T22:47:39.799 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing... ######################################## 2024-04-24T22:47:39.903 INFO:teuthology.orchestra.run.smithi203.stdout:Updating / installing... 2024-04-24T22:47:47.852 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-24T22:47:52.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24 22:47:52 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-24T22:47:52.455 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2024-04-24 22:47:52-- 2024-04-24T22:47:52.455 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 27s 2024-04-24T22:47:52.455 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 341M in 26s (13.0 MB/s) 2024-04-24T22:47:52.458 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-24T22:47:52.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-24T22:47:54.595 INFO:teuthology.orchestra.run.smithi146.stdout:Verifying... ######################################## 2024-04-24T22:47:54.745 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing... ######################################## 2024-04-24T22:47:54.859 INFO:teuthology.orchestra.run.smithi146.stdout:Updating / installing... 2024-04-24T22:48:02.845 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-24T22:48:28.084 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-24T22:48:28.084 DEBUG:teuthology.orchestra.run.smithi203:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-24T22:48:28.165 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.165 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.165 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.165 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T22:48:28.166 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-24T22:48:28.167 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T22:48:28.168 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T22:48:28.169 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T22:48:28.170 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T22:48:28.171 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T22:48:28.172 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T22:48:28.173 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T22:48:28.174 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T22:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-24T22:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-24T22:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T22:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T22:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-24T22:48:28.180 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T22:48:28.181 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-24T22:48:28.182 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T22:48:28.183 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T22:48:28.184 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T22:48:28.185 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T22:48:28.186 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T22:48:28.187 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T22:48:28.188 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T22:48:28.189 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T22:48:28.190 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T22:48:28.191 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T22:48:28.192 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T22:48:28.193 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T22:48:28.194 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T22:48:28.195 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T22:48:28.196 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T22:48:28.197 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T22:48:28.198 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T22:48:28.199 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T22:48:28.200 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T22:48:28.201 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T22:48:28.202 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-24T22:48:28.203 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T22:48:28.204 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T22:48:28.205 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T22:48:28.206 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T22:48:28.207 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T22:48:28.208 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T22:48:28.209 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T22:48:28.210 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T22:48:28.211 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T22:48:28.212 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-24T22:48:28.213 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-24T22:48:28.214 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T22:48:28.215 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-24T22:48:28.216 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-24T22:48:28.217 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T22:48:28.218 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-24T22:48:28.219 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T22:48:28.220 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-24T22:48:28.221 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T22:48:28.222 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T22:48:28.223 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T22:48:28.224 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T22:48:28.225 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-24T22:48:28.226 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T22:48:28.227 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T22:48:28.228 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T22:48:28.229 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T22:48:28.230 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-24T22:48:28.231 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T22:48:28.232 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T22:48:28.233 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T22:48:28.234 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-24T22:48:28.235 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T22:48:28.236 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T22:48:28.237 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-24T22:48:28.238 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T22:48:28.239 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T22:48:28.240 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T22:48:28.241 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T22:48:28.242 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-24T22:48:28.243 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T22:48:28.244 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T22:48:28.245 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T22:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-24T22:48:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-24T22:48:28.248 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T22:48:28.249 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T22:48:28.250 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T22:48:28.251 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T22:48:28.252 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T22:48:28.253 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T22:48:28.254 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T22:48:28.255 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T22:48:28.257 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T22:48:28.257 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T22:48:28.258 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T22:48:28.259 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-24T22:48:28.260 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T22:48:28.261 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T22:48:28.262 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T22:48:28.263 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T22:48:28.264 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-24T22:48:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T22:48:28.266 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T22:48:28.267 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-24T22:48:28.268 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T22:48:28.269 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T22:48:28.270 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T22:48:28.271 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T22:48:28.272 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T22:48:28.273 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T22:48:28.274 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-24T22:48:28.275 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-24T22:48:28.276 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-24T22:48:28.277 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T22:48:28.278 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T22:48:28.279 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T22:48:28.280 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T22:48:28.281 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T22:48:28.282 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-24T22:48:28.283 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T22:48:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T22:48:28.285 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T22:48:28.286 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T22:48:28.287 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T22:48:28.288 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T22:48:28.289 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T22:48:28.290 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-24T22:48:28.291 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-24T22:48:28.292 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T22:48:28.293 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T22:48:28.294 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T22:48:28.295 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T22:48:28.296 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T22:48:28.297 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T22:48:28.298 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T22:48:28.299 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T22:48:28.300 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T22:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T22:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T22:48:28.303 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T22:48:28.304 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T22:48:28.305 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T22:48:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T22:48:28.307 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T22:48:28.308 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T22:48:28.309 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T22:48:28.310 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T22:48:28.311 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T22:48:28.315 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.315 DEBUG:teuthology.orchestra.run.smithi203:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-24T22:48:28.338 INFO:teuthology.orchestra.run.smithi203.stdout:postinstall scriptlet (using /bin/sh): 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:for file in vmlinuz System.map config; do 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: fi 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:done 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.340 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-04-24T22:48:28.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-04-24T22:48:28.422 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 68.el9 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8264254 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-24T22:48:28.423 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:48:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-04-24T22:48:28.425 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-24T22:48:28.425 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:28.425 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-24T22:48:29.069 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-04-24T22:48:30.453 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-24T22:48:30.490 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-04-24T22:48:30.492 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-24T22:48:30.508 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.0sWluNuKJD 2024-04-24T22:48:30.508 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0sWluNuKJD 2024-04-24T22:48:30.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.0sWluNuKJD 2024-04-24T22:48:30.712 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.0sWluNuKJD is 6KB 2024-04-24T22:48:30.760 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.0sWluNuKJD 2024-04-24T22:48:30.775 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-04-24T22:48:30.835 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-24T22:48:30.835 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-24T22:48:30.836 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-24T22:48:30.836 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-24T22:48:30.837 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:30.985 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-04-24T22:48:39.525 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-24T22:48:39.525 DEBUG:teuthology.orchestra.run.smithi146:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-24T22:48:39.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-24T22:48:39.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-24T22:48:39.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-24T22:48:39.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-24T22:48:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-24T22:48:39.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-24T22:48:39.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-24T22:48:39.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-24T22:48:39.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-24T22:48:39.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-24T22:48:39.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-24T22:48:39.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-24T22:48:39.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-24T22:48:39.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-24T22:48:39.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-24T22:48:39.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-24T22:48:39.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-24T22:48:39.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-24T22:48:39.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-24T22:48:39.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-24T22:48:39.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-24T22:48:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-24T22:48:39.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-24T22:48:39.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-24T22:48:39.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-24T22:48:39.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-24T22:48:39.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-24T22:48:39.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-24T22:48:39.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-24T22:48:39.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-24T22:48:39.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-24T22:48:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-24T22:48:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-24T22:48:39.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-24T22:48:39.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-24T22:48:39.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-24T22:48:39.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-24T22:48:39.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-24T22:48:39.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-24T22:48:39.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-24T22:48:39.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-24T22:48:39.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-24T22:48:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-24T22:48:39.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-24T22:48:39.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-24T22:48:39.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-24T22:48:39.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-24T22:48:39.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-24T22:48:39.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-24T22:48:39.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-24T22:48:39.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-24T22:48:39.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-24T22:48:39.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-24T22:48:39.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-24T22:48:39.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-24T22:48:39.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-24T22:48:39.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-24T22:48:39.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-24T22:48:39.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-24T22:48:39.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-24T22:48:39.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-24T22:48:39.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-24T22:48:39.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-24T22:48:39.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-24T22:48:39.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-24T22:48:39.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-24T22:48:39.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-24T22:48:39.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-24T22:48:39.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-24T22:48:39.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-24T22:48:39.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-24T22:48:39.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-24T22:48:39.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-24T22:48:39.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-24T22:48:39.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-24T22:48:39.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-24T22:48:39.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-24T22:48:39.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-24T22:48:39.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-24T22:48:39.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-24T22:48:39.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-24T22:48:39.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-24T22:48:39.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-24T22:48:39.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-24T22:48:39.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-24T22:48:39.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-24T22:48:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-24T22:48:39.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-24T22:48:39.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-24T22:48:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-24T22:48:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-24T22:48:39.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-24T22:48:39.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-24T22:48:39.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-24T22:48:39.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-24T22:48:39.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-24T22:48:39.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-24T22:48:39.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-24T22:48:39.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-24T22:48:39.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-24T22:48:39.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-24T22:48:39.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-24T22:48:39.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-24T22:48:39.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-24T22:48:39.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-24T22:48:39.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-24T22:48:39.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-24T22:48:39.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-24T22:48:39.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-24T22:48:39.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-24T22:48:39.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-24T22:48:39.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-24T22:48:39.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-24T22:48:39.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-24T22:48:39.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-24T22:48:39.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-24T22:48:39.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-24T22:48:39.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-24T22:48:39.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-24T22:48:39.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-24T22:48:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-24T22:48:39.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-24T22:48:39.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-24T22:48:39.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-24T22:48:39.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-24T22:48:39.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-24T22:48:39.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-24T22:48:39.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-24T22:48:39.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-24T22:48:39.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-24T22:48:39.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-24T22:48:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-24T22:48:39.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T22:48:39.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T22:48:39.748 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.748 DEBUG:teuthology.orchestra.run.smithi146:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-24T22:48:39.770 INFO:teuthology.orchestra.run.smithi146.stdout:postinstall scriptlet (using /bin/sh): 2024-04-24T22:48:39.770 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:for file in vmlinuz System.map config; do 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: fi 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-04-24T22:48:39.771 INFO:teuthology.orchestra.run.smithi146.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-04-24T22:48:39.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-04-24T22:48:39.848 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-04-24T22:48:39.848 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 68.el9 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8264254 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-24T22:48:39.849 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:48:39.850 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-04-24T22:48:39.851 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-24T22:48:39.851 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:39.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-24T22:48:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-04-24T22:48:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-24T22:48:41.797 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-04-24T22:48:41.798 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-04-24T22:48:41.813 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.0zNKwmGPzx 2024-04-24T22:48:41.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0zNKwmGPzx 2024-04-24T22:48:41.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.0zNKwmGPzx 2024-04-24T22:48:42.016 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.0zNKwmGPzx is 6KB 2024-04-24T22:48:42.064 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.0zNKwmGPzx 2024-04-24T22:48:42.078 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-04-24T22:48:42.149 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-24T22:48:42.149 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-24T22:48:42.149 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-24T22:48:42.149 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-24T22:48:42.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-24T22:48:42.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-04-24T22:49:01.006 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-24T22:49:01.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:49:01.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:49:12.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-24T22:49:12.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:49:12.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:49:35.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-24T22:49:44.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:49:44.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:49:46.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-04-24T22:49:55.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:49:55.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:50:02.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-24T22:50:14.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:50:14.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:50:17.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-24T22:50:32.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:50:32.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:50:33.382 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-24T22:50:33.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:50:33.995 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T22:50:33.995 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-24T22:50:34.032 INFO:teuthology.orchestra.run.smithi203.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T22:50:34.032 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T22:50:34.032 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T22:50:34.033 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-24T22:50:35.033 DEBUG:teuthology.parallel:result is None 2024-04-24T22:50:55.797 DEBUG:teuthology.orchestra.remote:timed out 2024-04-24T22:51:07.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:51:07.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:51:08.181 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-04-24T22:51:08.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:51:08.767 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-24T22:51:08.767 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-04-24T22:51:08.819 INFO:teuthology.orchestra.run.smithi146.stdout:6.9.0-rc3-g806ec36b2112 2024-04-24T22:51:08.819 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-24T22:51:08.820 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T22:51:08.820 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-24T22:51:09.821 DEBUG:teuthology.parallel:result is None 2024-04-24T22:51:09.822 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T22:51:09.838 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T22:51:09.839 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T22:51:09.847 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T22:51:09.907 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T22:51:09.915 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T22:51:09.921 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T22:51:09.922 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T22:51:09.926 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T22:51:09.996 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T22:51:10.003 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T22:51:10.004 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T22:51:10.011 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T22:51:10.124 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:51:10.169 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:51:10.177 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:51:10.239 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:51:10.244 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T22:51:10.252 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T22:51:10.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T22:51:10.260 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T22:51:10.343 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T22:51:10.352 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T22:51:10.353 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T22:51:10.360 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T22:51:10.411 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:51:10.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:51:10.591 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:51:10.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:51:10.764 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:51:10.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T22:51:10.846 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:51:10.934 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:51:11.032 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:51:11.114 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:51:11.191 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:51:11.191 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T22:51:11.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-04-24T22:51:11.274 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-04-24T22:51:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T22:51:11.442 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T22:51:11.908 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T22:51:11.916 INFO:teuthology.task.internal:Starting timer... 2024-04-24T22:51:11.917 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T22:51:11.929 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T22:51:11.937 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T22:51:11.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-04-24T22:51:12.045 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-04-24T22:51:12.050 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-04-24T22:51:12.172 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-04-24T22:51:12.177 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T22:51:12.178 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-04-24T22:51:12.236 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-04-24T22:51:12.236 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-04-24T22:51:12.292 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-04-24T22:51:12.292 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-04-24T22:51:12.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T22:51:12.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:51:12.364 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T22:51:12.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:51:12.440 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T22:51:12.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-04-24T22:51:12.513 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-04-24T22:51:12.586 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T22:51:12.596 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T22:51:12.616 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T22:51:12.618 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T22:56:21.516 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-04-24T22:56:21.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:56:21.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:56:21.629 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-04-24T22:56:21.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-24T22:56:21.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:56:21.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:56:21.900 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-24T22:56:22.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-24T22:56:22.051 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T22:56:22.062 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T22:56:22.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T22:56:22.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T22:56:22.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T22:56:22.071 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T22:56:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T22:56:22.161 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T22:56:22.201 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T22:56:22.203 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T22:56:22.276 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-04-24T22:56:22.277 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-04-24T22:56:22.305 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-04-24T22:56:22.308 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-04-24T22:56:22.348 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T22:56:22.350 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T22:56:22.390 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T22:56:22.393 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T22:56:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-04-24T22:56:22.541 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.544 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.549 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T22:56:22.551 INFO:teuthology.run_tasks:Running task install... 2024-04-24T22:56:22.561 DEBUG:teuthology.task.install:project ceph 2024-04-24T22:56:22.561 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-24T22:56:22.561 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-24T22:56:22.561 INFO:teuthology.task.install:Using flavor: default 2024-04-24T22:56:22.567 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T22:56:22.568 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-24T22:56:22.568 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-24T22:56:22.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:56:22.571 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-24T22:56:22.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:56:22.718 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-24T22:56:22.718 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-24T22:56:22.730 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-24T22:56:22.730 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-24T22:56:22.832 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T22:56:22.833 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:56:22.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T22:56:22.901 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T22:56:22.901 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:56:22.901 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T22:56:22.924 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-24T22:56:22.924 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T22:56:22.990 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-24T22:56:22.990 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T22:56:23.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T22:56:23.116 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T22:56:23.167 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T22:56:23.220 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T22:56:23.245 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-04-24T22:56:23.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-04-24T22:56:23.299 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-04-24T22:56:23.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-04-24T22:56:23.562 INFO:teuthology.orchestra.run.smithi146.stdout:48 files removed 2024-04-24T22:56:23.600 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-24T22:56:23.622 INFO:teuthology.orchestra.run.smithi203.stdout:48 files removed 2024-04-24T22:56:23.661 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-24T22:56:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 197 kB/s | 83 kB 00:00 2024-04-24T22:56:24.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 168 kB/s | 83 kB 00:00 2024-04-24T22:56:25.071 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 25 kB/s | 11 kB 00:00 2024-04-24T22:56:25.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-04-24T22:56:25.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-24T22:56:25.563 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-24T22:56:26.316 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-24T22:56:26.678 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.0 MB 00:01 2024-04-24T22:56:28.443 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-24T22:56:28.871 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-24T22:56:33.185 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.2 MB 00:00 2024-04-24T22:56:33.421 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-24T22:56:34.835 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-24T22:56:35.047 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-24T22:56:37.274 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-24T22:56:43.183 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-24T22:56:45.584 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T22:56:45.586 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T22:56:45.606 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-24T22:56:45.607 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-24T22:56:45.609 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-24T22:56:45.610 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-24T22:56:45.613 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-24T22:56:45.616 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-24T22:56:45.617 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-24T22:56:45.688 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-24T22:56:45.701 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-04-24T22:56:45.701 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-24T22:56:45.701 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-04-24T22:56:45.701 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-24T22:56:45.701 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-24T22:56:45.702 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-24T22:56:45.703 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T22:56:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-24T22:56:45.705 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T22:56:45.706 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T22:56:45.707 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T22:56:45.708 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T22:56:45.709 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T22:56:45.710 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T22:56:45.711 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T22:56:45.712 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T22:56:45.713 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout:Install 148 Packages 2024-04-24T22:56:45.714 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 4 Packages 2024-04-24T22:56:45.715 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:56:45.715 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 220 M 2024-04-24T22:56:45.715 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-24T22:56:46.909 INFO:teuthology.orchestra.run.smithi203.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-24T22:56:47.434 INFO:teuthology.orchestra.run.smithi203.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.7 MB/s | 890 kB 00:00 2024-04-24T22:56:47.535 INFO:teuthology.orchestra.run.smithi203.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.4 MB/s | 145 kB 00:00 2024-04-24T22:56:47.760 INFO:teuthology.orchestra.run.smithi203.stdout:(4/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 4.7 MB/s | 5.4 MB 00:01 2024-04-24T22:56:48.002 INFO:teuthology.orchestra.run.smithi203.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 6.2 MB/s | 1.5 MB 00:00 2024-04-24T22:56:48.311 INFO:teuthology.orchestra.run.smithi203.stdout:(6/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 12 MB/s | 21 MB 00:01 2024-04-24T22:56:48.403 INFO:teuthology.orchestra.run.smithi203.stdout:(7/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 2.7 MB/s | 2.4 MB 00:00 2024-04-24T22:56:48.570 INFO:teuthology.orchestra.run.smithi203.stdout:(8/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 8.3 MB/s | 4.7 MB 00:00 2024-04-24T22:56:48.695 INFO:teuthology.orchestra.run.smithi203.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 202 kB/s | 25 kB 00:00 2024-04-24T22:56:49.439 INFO:teuthology.orchestra.run.smithi203.stdout:(10/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 15 MB/s | 17 MB 00:01 2024-04-24T22:56:49.506 INFO:teuthology.orchestra.run.smithi203.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 3.3 MB/s | 222 kB 00:00 2024-04-24T22:56:49.564 INFO:teuthology.orchestra.run.smithi203.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 472 kB/s | 27 kB 00:00 2024-04-24T22:56:49.639 INFO:teuthology.orchestra.run.smithi203.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 429 kB/s | 32 kB 00:00 2024-04-24T22:56:49.798 INFO:teuthology.orchestra.run.smithi203.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 745 kB 00:00 2024-04-24T22:56:49.890 INFO:teuthology.orchestra.run.smithi203.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.8 MB/s | 163 kB 00:00 2024-04-24T22:56:49.957 INFO:teuthology.orchestra.run.smithi203.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.9 MB/s | 127 kB 00:00 2024-04-24T22:56:50.141 INFO:teuthology.orchestra.run.smithi203.stdout:(17/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 5.9 MB/s | 10 MB 00:01 2024-04-24T22:56:50.196 INFO:teuthology.orchestra.run.smithi203.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 2.1 MB/s | 501 kB 00:00 2024-04-24T22:56:50.283 INFO:teuthology.orchestra.run.smithi203.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 497 kB/s | 45 kB 00:00 2024-04-24T22:56:50.367 INFO:teuthology.orchestra.run.smithi203.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.6 MB/s | 133 kB 00:00 2024-04-24T22:56:50.442 INFO:teuthology.orchestra.run.smithi203.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 2.1 MB/s | 162 kB 00:00 2024-04-24T22:56:50.526 INFO:teuthology.orchestra.run.smithi203.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 3.8 MB/s | 321 kB 00:00 2024-04-24T22:56:50.585 INFO:teuthology.orchestra.run.smithi203.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 5.1 MB/s | 299 kB 00:00 2024-04-24T22:56:50.718 INFO:teuthology.orchestra.run.smithi203.stdout:(24/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 9.2 MB/s | 5.3 MB 00:00 2024-04-24T22:56:50.743 INFO:teuthology.orchestra.run.smithi203.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 632 kB/s | 99 kB 00:00 2024-04-24T22:56:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-24T22:56:50.919 INFO:teuthology.orchestra.run.smithi203.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.4 MB/s | 171 kB 00:00 2024-04-24T22:56:51.019 INFO:teuthology.orchestra.run.smithi203.stdout:(28/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 11 MB/s | 3.1 MB 00:00 2024-04-24T22:56:51.069 INFO:teuthology.orchestra.run.smithi203.stdout:(29/152): ceph-grafana-dashboards-19.0.0-2445.g 213 kB/s | 32 kB 00:00 2024-04-24T22:56:51.103 INFO:teuthology.orchestra.run.smithi203.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.7 MB/s | 141 kB 00:00 2024-04-24T22:56:51.495 INFO:teuthology.orchestra.run.smithi203.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 8.3 MB/s | 3.5 MB 00:00 2024-04-24T22:56:51.595 INFO:teuthology.orchestra.run.smithi203.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 2.4 MB/s | 249 kB 00:00 2024-04-24T22:56:51.679 INFO:teuthology.orchestra.run.smithi203.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 601 kB/s | 49 kB 00:00 2024-04-24T22:56:51.842 INFO:teuthology.orchestra.run.smithi203.stdout:(34/152): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-04-24T22:56:51.872 INFO:teuthology.orchestra.run.smithi203.stdout:(35/152): ceph-prometheus-alerts-19.0.0-2445.gd 80 kB/s | 15 kB 00:00 2024-04-24T22:56:51.914 INFO:teuthology.orchestra.run.smithi203.stdout:(36/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 3.7 MB/s | 264 kB 00:00 2024-04-24T22:56:51.972 INFO:teuthology.orchestra.run.smithi203.stdout:(37/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 7.5 MB/s | 762 kB 00:00 2024-04-24T22:56:51.998 INFO:teuthology.orchestra.run.smithi203.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 220 kB/s | 18 kB 00:00 2024-04-24T22:56:52.148 INFO:teuthology.orchestra.run.smithi203.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 461 kB/s | 80 kB 00:00 2024-04-24T22:56:52.253 INFO:teuthology.orchestra.run.smithi203.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-04-24T22:56:52.290 INFO:teuthology.orchestra.run.smithi203.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-04-24T22:56:52.324 INFO:teuthology.orchestra.run.smithi203.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 253 kB 00:00 2024-04-24T22:56:52.374 INFO:teuthology.orchestra.run.smithi203.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-24T22:56:52.443 INFO:teuthology.orchestra.run.smithi203.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-24T22:56:52.474 INFO:teuthology.orchestra.run.smithi203.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-04-24T22:56:52.508 INFO:teuthology.orchestra.run.smithi203.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-24T22:56:52.542 INFO:teuthology.orchestra.run.smithi203.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-24T22:56:52.592 INFO:teuthology.orchestra.run.smithi203.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 8.2 MB/s | 689 kB 00:00 2024-04-24T22:56:52.668 INFO:teuthology.orchestra.run.smithi203.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-24T22:56:52.701 INFO:teuthology.orchestra.run.smithi203.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-04-24T22:56:52.727 INFO:teuthology.orchestra.run.smithi203.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-24T22:56:52.769 INFO:teuthology.orchestra.run.smithi203.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-24T22:56:52.794 INFO:teuthology.orchestra.run.smithi203.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 503 kB/s | 33 kB 00:00 2024-04-24T22:56:52.844 INFO:teuthology.orchestra.run.smithi203.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 371 kB/s | 18 kB 00:00 2024-04-24T22:56:52.895 INFO:teuthology.orchestra.run.smithi203.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 227 kB/s | 11 kB 00:00 2024-04-24T22:56:52.953 INFO:teuthology.orchestra.run.smithi203.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-24T22:56:53.062 INFO:teuthology.orchestra.run.smithi203.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-04-24T22:56:53.096 INFO:teuthology.orchestra.run.smithi203.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 320 kB/s | 45 kB 00:00 2024-04-24T22:56:53.646 INFO:teuthology.orchestra.run.smithi203.stdout:(59/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 9.8 MB/s | 48 MB 00:04 2024-04-24T22:56:53.680 INFO:teuthology.orchestra.run.smithi203.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-04-24T22:56:53.730 INFO:teuthology.orchestra.run.smithi203.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 919 kB/s | 582 kB 00:00 2024-04-24T22:56:53.755 INFO:teuthology.orchestra.run.smithi203.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 235 kB/s | 25 kB 00:00 2024-04-24T22:56:53.781 INFO:teuthology.orchestra.run.smithi203.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-04-24T22:56:53.814 INFO:teuthology.orchestra.run.smithi203.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-04-24T22:56:53.848 INFO:teuthology.orchestra.run.smithi203.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-24T22:56:53.874 INFO:teuthology.orchestra.run.smithi203.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 385 kB/s | 35 kB 00:00 2024-04-24T22:56:54.040 INFO:teuthology.orchestra.run.smithi203.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-04-24T22:56:54.141 INFO:teuthology.orchestra.run.smithi203.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-24T22:56:54.191 INFO:teuthology.orchestra.run.smithi203.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-04-24T22:56:54.207 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-24T22:56:54.216 INFO:teuthology.orchestra.run.smithi203.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-24T22:56:54.300 INFO:teuthology.orchestra.run.smithi203.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-24T22:56:54.384 INFO:teuthology.orchestra.run.smithi203.stdout:(72/152): postgresql-13.14-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-04-24T22:56:54.409 INFO:teuthology.orchestra.run.smithi203.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 811 kB/s | 87 kB 00:00 2024-04-24T22:56:54.542 INFO:teuthology.orchestra.run.smithi203.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-04-24T22:56:54.576 INFO:teuthology.orchestra.run.smithi203.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-24T22:56:54.610 INFO:teuthology.orchestra.run.smithi203.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-04-24T22:56:54.626 INFO:teuthology.orchestra.run.smithi203.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-04-24T22:56:54.643 INFO:teuthology.orchestra.run.smithi203.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 586 kB/s | 19 kB 00:00 2024-04-24T22:56:54.677 INFO:teuthology.orchestra.run.smithi203.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-24T22:56:54.694 INFO:teuthology.orchestra.run.smithi203.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 701 kB/s | 35 kB 00:00 2024-04-24T22:56:54.753 INFO:teuthology.orchestra.run.smithi203.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-24T22:56:54.803 INFO:teuthology.orchestra.run.smithi203.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-24T22:56:54.853 INFO:teuthology.orchestra.run.smithi203.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-24T22:56:54.979 INFO:teuthology.orchestra.run.smithi203.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-04-24T22:56:55.004 INFO:teuthology.orchestra.run.smithi203.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 282 kB/s | 42 kB 00:00 2024-04-24T22:56:55.038 INFO:teuthology.orchestra.run.smithi203.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-24T22:56:55.072 INFO:teuthology.orchestra.run.smithi203.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-24T22:56:55.140 INFO:teuthology.orchestra.run.smithi203.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-04-24T22:56:55.172 INFO:teuthology.orchestra.run.smithi203.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 512 kB/s | 51 kB 00:00 2024-04-24T22:56:55.198 INFO:teuthology.orchestra.run.smithi203.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 950 kB/s | 54 kB 00:00 2024-04-24T22:56:55.256 INFO:teuthology.orchestra.run.smithi203.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 724 kB/s | 42 kB 00:00 2024-04-24T22:56:55.398 INFO:teuthology.orchestra.run.smithi203.stdout:(92/152): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-04-24T22:56:55.423 INFO:teuthology.orchestra.run.smithi203.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 266 kB/s | 44 kB 00:00 2024-04-24T22:56:55.482 INFO:teuthology.orchestra.run.smithi203.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 629 kB/s | 36 kB 00:00 2024-04-24T22:56:55.549 INFO:teuthology.orchestra.run.smithi203.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-24T22:56:55.574 INFO:teuthology.orchestra.run.smithi203.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 520 kB/s | 47 kB 00:00 2024-04-24T22:56:55.616 INFO:teuthology.orchestra.run.smithi203.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-24T22:56:55.641 INFO:teuthology.orchestra.run.smithi203.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 874 kB/s | 58 kB 00:00 2024-04-24T22:56:55.684 INFO:teuthology.orchestra.run.smithi203.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-24T22:56:55.709 INFO:teuthology.orchestra.run.smithi203.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 960 kB/s | 64 kB 00:00 2024-04-24T22:56:55.768 INFO:teuthology.orchestra.run.smithi203.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-04-24T22:56:55.884 INFO:teuthology.orchestra.run.smithi203.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 128 kB/s | 22 kB 00:00 2024-04-24T22:56:56.143 INFO:teuthology.orchestra.run.smithi203.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-24T22:56:56.652 INFO:teuthology.orchestra.run.smithi203.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 716 kB/s | 548 kB 00:00 2024-04-24T22:56:56.685 INFO:teuthology.orchestra.run.smithi203.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 640 kB/s | 309 kB 00:00 2024-04-24T22:56:56.745 INFO:teuthology.orchestra.run.smithi203.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 213 kB/s | 19 kB 00:00 2024-04-24T22:56:56.803 INFO:teuthology.orchestra.run.smithi203.stdout:(107/152): protobuf-compiler-3.14.0-13.el9.x86_ 835 kB/s | 863 kB 00:01 2024-04-24T22:56:56.828 INFO:teuthology.orchestra.run.smithi203.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 313 kB/s | 26 kB 00:00 2024-04-24T22:56:56.953 INFO:teuthology.orchestra.run.smithi203.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 542 kB/s | 67 kB 00:00 2024-04-24T22:56:57.118 INFO:teuthology.orchestra.run.smithi203.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-24T22:56:57.154 INFO:teuthology.orchestra.run.smithi203.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 756 kB/s | 151 kB 00:00 2024-04-24T22:56:57.179 INFO:teuthology.orchestra.run.smithi203.stdout:(112/152): liboath-2.6.7-2.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2024-04-24T22:56:57.229 INFO:teuthology.orchestra.run.smithi203.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.4 MB/s | 838 kB 00:00 2024-04-24T22:56:57.272 INFO:teuthology.orchestra.run.smithi203.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-04-24T22:56:57.305 INFO:teuthology.orchestra.run.smithi203.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 431 kB/s | 32 kB 00:00 2024-04-24T22:56:57.331 INFO:teuthology.orchestra.run.smithi203.stdout:(116/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 289 kB/s | 43 kB 00:00 2024-04-24T22:56:57.356 INFO:teuthology.orchestra.run.smithi203.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-04-24T22:56:57.390 INFO:teuthology.orchestra.run.smithi203.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-24T22:56:57.424 INFO:teuthology.orchestra.run.smithi203.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-24T22:56:57.466 INFO:teuthology.orchestra.run.smithi203.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 470 kB/s | 35 kB 00:00 2024-04-24T22:56:57.533 INFO:teuthology.orchestra.run.smithi203.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-04-24T22:56:57.566 INFO:teuthology.orchestra.run.smithi203.stdout:(122/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.4 MB/s | 303 kB 00:00 2024-04-24T22:56:57.616 INFO:teuthology.orchestra.run.smithi203.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-24T22:56:57.642 INFO:teuthology.orchestra.run.smithi203.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2024-04-24T22:56:57.717 INFO:teuthology.orchestra.run.smithi203.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-04-24T22:56:57.742 INFO:teuthology.orchestra.run.smithi203.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-04-24T22:56:57.784 INFO:teuthology.orchestra.run.smithi203.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 164 kB/s | 23 kB 00:00 2024-04-24T22:56:57.809 INFO:teuthology.orchestra.run.smithi203.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-04-24T22:56:57.860 INFO:teuthology.orchestra.run.smithi203.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-04-24T22:56:57.917 INFO:teuthology.orchestra.run.smithi203.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 433 kB/s | 46 kB 00:00 2024-04-24T22:56:57.952 INFO:teuthology.orchestra.run.smithi203.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 866 kB/s | 79 kB 00:00 2024-04-24T22:56:58.011 INFO:teuthology.orchestra.run.smithi203.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-04-24T22:56:58.036 INFO:teuthology.orchestra.run.smithi203.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 491 kB/s | 58 kB 00:00 2024-04-24T22:56:58.070 INFO:teuthology.orchestra.run.smithi203.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-24T22:56:58.111 INFO:teuthology.orchestra.run.smithi203.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 221 kB/s | 16 kB 00:00 2024-04-24T22:56:58.137 INFO:teuthology.orchestra.run.smithi203.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 906 kB/s | 90 kB 00:00 2024-04-24T22:56:58.162 INFO:teuthology.orchestra.run.smithi203.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-04-24T22:56:58.187 INFO:teuthology.orchestra.run.smithi203.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-04-24T22:56:58.221 INFO:teuthology.orchestra.run.smithi203.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-24T22:56:58.255 INFO:teuthology.orchestra.run.smithi203.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2024-04-24T22:56:58.306 INFO:teuthology.orchestra.run.smithi203.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2024-04-24T22:56:58.339 INFO:teuthology.orchestra.run.smithi203.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 436 kB/s | 51 kB 00:00 2024-04-24T22:56:58.372 INFO:teuthology.orchestra.run.smithi203.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-24T22:56:58.398 INFO:teuthology.orchestra.run.smithi203.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2024-04-24T22:56:58.440 INFO:teuthology.orchestra.run.smithi203.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-04-24T22:56:58.465 INFO:teuthology.orchestra.run.smithi203.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-24T22:56:58.499 INFO:teuthology.orchestra.run.smithi203.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-24T22:56:58.607 INFO:teuthology.orchestra.run.smithi203.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-24T22:56:58.833 INFO:teuthology.orchestra.run.smithi203.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 1.3 MB 00:00 2024-04-24T22:56:58.991 INFO:teuthology.orchestra.run.smithi203.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-24T22:56:59.113 INFO:teuthology.orchestra.run.smithi203.stdout:(151/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 5.1 MB/s | 3.1 MB 00:00 2024-04-24T22:56:59.200 INFO:teuthology.orchestra.run.smithi203.stdout:(152/152): librados2-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 3.4 MB 00:00 2024-04-24T22:56:59.212 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-24T22:56:59.212 INFO:teuthology.orchestra.run.smithi203.stdout:Total 16 MB/s | 220 MB 00:13 2024-04-24T22:57:00.176 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-24T22:57:02.065 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-24T22:57:02.311 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-24T22:57:02.312 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-24T22:57:02.535 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T22:57:02.536 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-24T22:57:02.556 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-24T22:57:02.557 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-24T22:57:02.559 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-24T22:57:02.560 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-24T22:57:02.562 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-24T22:57:02.567 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-24T22:57:02.567 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-24T22:57:02.637 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-24T22:57:02.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-24T22:57:02.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-24T22:57:02.659 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-24T22:57:02.660 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-24T22:57:02.661 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T22:57:02.662 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-24T22:57:02.663 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T22:57:02.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T22:57:02.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T22:57:02.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T22:57:02.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T22:57:02.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-04-24T22:57:02.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 4 Packages 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:57:02.670 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 220 M 2024-04-24T22:57:02.671 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-04-24T22:57:03.636 INFO:teuthology.orchestra.run.smithi146.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-24T22:57:04.120 INFO:teuthology.orchestra.run.smithi146.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.8 MB/s | 890 kB 00:00 2024-04-24T22:57:04.401 INFO:teuthology.orchestra.run.smithi146.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 518 kB/s | 145 kB 00:00 2024-04-24T22:57:05.294 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-24T22:57:05.295 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-24T22:57:05.345 INFO:teuthology.orchestra.run.smithi146.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 2.5 MB/s | 2.4 MB 00:00 2024-04-24T22:57:05.654 INFO:teuthology.orchestra.run.smithi146.stdout:(5/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 2.3 MB/s | 5.4 MB 00:02 2024-04-24T22:57:06.262 INFO:teuthology.orchestra.run.smithi146.stdout:(6/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-24T22:57:07.474 INFO:teuthology.orchestra.run.smithi146.stdout:(7/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 5.1 MB/s | 21 MB 00:04 2024-04-24T22:57:08.038 INFO:teuthology.orchestra.run.smithi146.stdout:(8/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 2.0 MB/s | 4.7 MB 00:02 2024-04-24T22:57:08.563 INFO:teuthology.orchestra.run.smithi146.stdout:(9/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 9.4 MB/s | 10 MB 00:01 2024-04-24T22:57:08.580 INFO:teuthology.orchestra.run.smithi146.stdout:(10/152): ceph-selinux-19.0.0-2445.gd2c45d97.el 46 kB/s | 25 kB 00:00 2024-04-24T22:57:08.847 INFO:teuthology.orchestra.run.smithi146.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 835 kB/s | 222 kB 00:00 2024-04-24T22:57:08.947 INFO:teuthology.orchestra.run.smithi146.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 273 kB/s | 27 kB 00:00 2024-04-24T22:57:09.056 INFO:teuthology.orchestra.run.smithi146.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 295 kB/s | 32 kB 00:00 2024-04-24T22:57:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 772 kB/s | 745 kB 00:00 2024-04-24T22:57:10.331 INFO:teuthology.orchestra.run.smithi146.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 532 kB/s | 163 kB 00:00 2024-04-24T22:57:10.590 INFO:teuthology.orchestra.run.smithi146.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 492 kB/s | 127 kB 00:00 2024-04-24T22:57:11.098 INFO:teuthology.orchestra.run.smithi146.stdout:(17/152): libradosstriper1-19.0.0-2445.gd2c45d9 987 kB/s | 501 kB 00:00 2024-04-24T22:57:11.873 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-24T22:57:11.982 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-24T22:57:12.054 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-24T22:57:12.345 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-24T22:57:12.428 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-24T22:57:12.501 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-24T22:57:12.654 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-24T22:57:12.940 INFO:teuthology.orchestra.run.smithi146.stdout:(18/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 2.5 MB/s | 17 MB 00:06 2024-04-24T22:57:12.998 INFO:teuthology.orchestra.run.smithi146.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 789 kB/s | 45 kB 00:00 2024-04-24T22:57:13.103 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-24T22:57:13.157 INFO:teuthology.orchestra.run.smithi146.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 844 kB/s | 133 kB 00:00 2024-04-24T22:57:13.215 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:57:13.420 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:57:13.449 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:57:13.576 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:57:13.623 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T22:57:13.691 INFO:teuthology.orchestra.run.smithi146.stdout:(21/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 9.4 MB/s | 48 MB 00:05 2024-04-24T22:57:13.724 INFO:teuthology.orchestra.run.smithi146.stdout:(22/152): python3-cephfs-19.0.0-2445.gd2c45d97. 286 kB/s | 162 kB 00:00 2024-04-24T22:57:13.766 INFO:teuthology.orchestra.run.smithi146.stdout:(23/152): python3-rados-19.0.0-2445.gd2c45d97.e 4.2 MB/s | 321 kB 00:00 2024-04-24T22:57:13.816 INFO:teuthology.orchestra.run.smithi146.stdout:(24/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 3.2 MB/s | 299 kB 00:00 2024-04-24T22:57:13.841 INFO:teuthology.orchestra.run.smithi146.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.3 MB/s | 99 kB 00:00 2024-04-24T22:57:13.867 INFO:teuthology.orchestra.run.smithi146.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-24T22:57:13.984 INFO:teuthology.orchestra.run.smithi146.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.4 MB/s | 171 kB 00:00 2024-04-24T22:57:14.022 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-24T22:57:14.051 INFO:teuthology.orchestra.run.smithi146.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 482 kB/s | 32 kB 00:00 2024-04-24T22:57:14.105 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-24T22:57:14.126 INFO:teuthology.orchestra.run.smithi146.stdout:(29/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.9 MB/s | 141 kB 00:00 2024-04-24T22:57:14.129 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:57:14.201 INFO:teuthology.orchestra.run.smithi146.stdout:(30/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 8.6 MB/s | 3.1 MB 00:00 2024-04-24T22:57:14.288 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:57:14.322 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T22:57:14.411 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T22:57:14.473 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T22:57:14.549 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T22:57:14.869 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T22:57:14.933 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T22:57:15.132 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-24T22:57:15.264 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-24T22:57:15.310 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-24T22:57:15.326 INFO:teuthology.orchestra.run.smithi146.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-04-24T22:57:15.366 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-24T22:57:15.419 INFO:teuthology.orchestra.run.smithi146.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 2.7 MB/s | 249 kB 00:00 2024-04-24T22:57:15.474 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-24T22:57:15.529 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-24T22:57:15.586 INFO:teuthology.orchestra.run.smithi146.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 297 kB/s | 49 kB 00:00 2024-04-24T22:57:15.592 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-24T22:57:15.669 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-24T22:57:15.686 INFO:teuthology.orchestra.run.smithi146.stdout:(34/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 2.3 MB/s | 3.5 MB 00:01 2024-04-24T22:57:15.709 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-24T22:57:15.711 INFO:teuthology.orchestra.run.smithi146.stdout:(35/152): ceph-prometheus-alerts-19.0.0-2445.gd 123 kB/s | 15 kB 00:00 2024-04-24T22:57:15.831 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-24T22:57:15.861 INFO:teuthology.orchestra.run.smithi146.stdout:(36/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 1.5 MB/s | 264 kB 00:00 2024-04-24T22:57:15.903 INFO:teuthology.orchestra.run.smithi146.stdout:(37/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 3.9 MB/s | 762 kB 00:00 2024-04-24T22:57:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-24T22:57:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-24T22:57:15.953 INFO:teuthology.orchestra.run.smithi146.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 200 kB/s | 18 kB 00:00 2024-04-24T22:57:16.010 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-24T22:57:16.126 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-24T22:57:16.171 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-24T22:57:16.225 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-24T22:57:16.262 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-24T22:57:16.279 INFO:teuthology.orchestra.run.smithi146.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 214 kB/s | 80 kB 00:00 2024-04-24T22:57:16.380 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-24T22:57:16.468 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-24T22:57:16.487 INFO:teuthology.orchestra.run.smithi146.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-24T22:57:16.577 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-24T22:57:16.757 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-24T22:57:16.779 INFO:teuthology.orchestra.run.smithi146.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 392 kB/s | 195 kB 00:00 2024-04-24T22:57:16.854 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-24T22:57:16.971 INFO:teuthology.orchestra.run.smithi146.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 528 kB/s | 253 kB 00:00 2024-04-24T22:57:17.330 INFO:teuthology.orchestra.run.smithi146.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-04-24T22:57:17.363 INFO:teuthology.orchestra.run.smithi146.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 273 kB/s | 106 kB 00:00 2024-04-24T22:57:17.570 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-24T22:57:17.672 INFO:teuthology.orchestra.run.smithi146.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 397 kB/s | 135 kB 00:00 2024-04-24T22:57:17.718 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-24T22:57:17.761 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-24T22:57:17.799 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-24T22:57:17.814 INFO:teuthology.orchestra.run.smithi146.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 278 kB/s | 125 kB 00:00 2024-04-24T22:57:17.838 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-24T22:57:17.897 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-24T22:57:18.014 INFO:teuthology.orchestra.run.smithi146.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-04-24T22:57:18.048 INFO:teuthology.orchestra.run.smithi146.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 573 kB/s | 215 kB 00:00 2024-04-24T22:57:18.098 INFO:teuthology.orchestra.run.smithi146.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-24T22:57:18.148 INFO:teuthology.orchestra.run.smithi146.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 437 kB/s | 21 kB 00:00 2024-04-24T22:57:18.203 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-24T22:57:18.206 INFO:teuthology.orchestra.run.smithi146.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-04-24T22:57:18.232 INFO:teuthology.orchestra.run.smithi146.stdout:(52/152): boost-program-options-1.75.0-8.el9.x8 583 kB/s | 107 kB 00:00 2024-04-24T22:57:18.257 INFO:teuthology.orchestra.run.smithi146.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-04-24T22:57:18.265 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-24T22:57:18.308 INFO:teuthology.orchestra.run.smithi146.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 370 kB/s | 18 kB 00:00 2024-04-24T22:57:18.343 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-24T22:57:18.408 INFO:teuthology.orchestra.run.smithi146.stdout:(55/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 744 kB/s | 5.3 MB 00:07 2024-04-24T22:57:18.433 INFO:teuthology.orchestra.run.smithi146.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-04-24T22:57:18.467 INFO:teuthology.orchestra.run.smithi146.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-24T22:57:18.486 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-24T22:57:18.531 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-24T22:57:18.542 INFO:teuthology.orchestra.run.smithi146.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-04-24T22:57:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-24T22:57:18.567 INFO:teuthology.orchestra.run.smithi146.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 341 kB/s | 45 kB 00:00 2024-04-24T22:57:18.632 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-24T22:57:18.651 INFO:teuthology.orchestra.run.smithi146.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-04-24T22:57:18.676 INFO:teuthology.orchestra.run.smithi146.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 236 kB/s | 25 kB 00:00 2024-04-24T22:57:18.679 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-24T22:57:18.735 INFO:teuthology.orchestra.run.smithi146.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 572 kB/s | 47 kB 00:00 2024-04-24T22:57:18.740 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-24T22:57:18.777 INFO:teuthology.orchestra.run.smithi146.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-04-24T22:57:18.798 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-24T22:57:18.810 INFO:teuthology.orchestra.run.smithi146.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-24T22:57:18.836 INFO:teuthology.orchestra.run.smithi146.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 35 kB 00:00 2024-04-24T22:57:18.861 INFO:teuthology.orchestra.run.smithi146.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-24T22:57:19.003 INFO:teuthology.orchestra.run.smithi146.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-24T22:57:19.037 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-24T22:57:19.094 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-24T22:57:19.103 INFO:teuthology.orchestra.run.smithi146.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-04-24T22:57:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-24T22:57:19.188 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-24T22:57:19.195 INFO:teuthology.orchestra.run.smithi146.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-24T22:57:19.229 INFO:teuthology.orchestra.run.smithi146.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-04-24T22:57:19.279 INFO:teuthology.orchestra.run.smithi146.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 3.2 MB/s | 911 kB 00:00 2024-04-24T22:57:19.338 INFO:teuthology.orchestra.run.smithi146.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.4 MB/s | 1.0 MB 00:00 2024-04-24T22:57:19.344 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-24T22:57:19.355 INFO:teuthology.orchestra.run.smithi146.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-04-24T22:57:19.381 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-24T22:57:19.427 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-24T22:57:19.430 INFO:teuthology.orchestra.run.smithi146.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-24T22:57:19.462 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-24T22:57:19.495 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-24T22:57:19.496 INFO:teuthology.orchestra.run.smithi146.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-04-24T22:57:19.597 INFO:teuthology.orchestra.run.smithi146.stdout:(76/152): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-04-24T22:57:19.614 INFO:teuthology.orchestra.run.smithi146.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-04-24T22:57:19.639 INFO:teuthology.orchestra.run.smithi146.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 468 kB/s | 19 kB 00:00 2024-04-24T22:57:19.673 INFO:teuthology.orchestra.run.smithi146.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-24T22:57:19.681 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-24T22:57:19.698 INFO:teuthology.orchestra.run.smithi146.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 600 kB/s | 35 kB 00:00 2024-04-24T22:57:19.815 INFO:teuthology.orchestra.run.smithi146.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-24T22:57:19.848 INFO:teuthology.orchestra.run.smithi146.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-04-24T22:57:19.867 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-24T22:57:19.901 INFO:teuthology.orchestra.run.smithi146.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-24T22:57:19.912 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-24T22:57:19.932 INFO:teuthology.orchestra.run.smithi146.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 931 kB/s | 77 kB 00:00 2024-04-24T22:57:19.959 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-24T22:57:19.991 INFO:teuthology.orchestra.run.smithi146.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 463 kB/s | 42 kB 00:00 2024-04-24T22:57:20.025 INFO:teuthology.orchestra.run.smithi146.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-04-24T22:57:20.032 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-24T22:57:20.104 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-24T22:57:20.125 INFO:teuthology.orchestra.run.smithi146.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-04-24T22:57:20.158 INFO:teuthology.orchestra.run.smithi146.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 955 kB/s | 159 kB 00:00 2024-04-24T22:57:20.169 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-24T22:57:20.192 INFO:teuthology.orchestra.run.smithi146.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-04-24T22:57:20.216 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-24T22:57:20.217 INFO:teuthology.orchestra.run.smithi146.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 559 kB/s | 51 kB 00:00 2024-04-24T22:57:20.243 INFO:teuthology.orchestra.run.smithi146.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 645 kB/s | 54 kB 00:00 2024-04-24T22:57:20.263 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-24T22:57:20.309 INFO:teuthology.orchestra.run.smithi146.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 457 kB/s | 42 kB 00:00 2024-04-24T22:57:20.312 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-24T22:57:20.335 INFO:teuthology.orchestra.run.smithi146.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-04-24T22:57:20.385 INFO:teuthology.orchestra.run.smithi146.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-24T22:57:20.388 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-24T22:57:20.411 INFO:teuthology.orchestra.run.smithi146.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 481 kB/s | 36 kB 00:00 2024-04-24T22:57:20.433 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-24T22:57:20.461 INFO:teuthology.orchestra.run.smithi146.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 636 kB/s | 47 kB 00:00 2024-04-24T22:57:20.503 INFO:teuthology.orchestra.run.smithi146.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-04-24T22:57:20.553 INFO:teuthology.orchestra.run.smithi146.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 634 kB/s | 58 kB 00:00 2024-04-24T22:57:20.576 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-24T22:57:20.586 INFO:teuthology.orchestra.run.smithi146.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-24T22:57:20.620 INFO:teuthology.orchestra.run.smithi146.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 961 kB/s | 64 kB 00:00 2024-04-24T22:57:20.653 INFO:teuthology.orchestra.run.smithi146.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-04-24T22:57:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-24T22:57:20.700 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-24T22:57:20.712 INFO:teuthology.orchestra.run.smithi146.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 245 kB/s | 22 kB 00:00 2024-04-24T22:57:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-24T22:57:20.829 INFO:teuthology.orchestra.run.smithi146.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-04-24T22:57:20.928 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-24T22:57:20.998 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-24T22:57:21.147 INFO:teuthology.orchestra.run.smithi146.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-24T22:57:21.413 INFO:teuthology.orchestra.run.smithi146.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-24T22:57:21.580 INFO:teuthology.orchestra.run.smithi146.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 632 kB/s | 548 kB 00:00 2024-04-24T22:57:21.664 INFO:teuthology.orchestra.run.smithi146.stdout:(107/152): gperftools-libs-2.9.1-2.el9.x86_64.r 371 kB/s | 309 kB 00:00 2024-04-24T22:57:21.856 INFO:teuthology.orchestra.run.smithi146.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 95 kB/s | 26 kB 00:00 2024-04-24T22:57:21.981 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-24T22:57:22.023 INFO:teuthology.orchestra.run.smithi146.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-04-24T22:57:22.039 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-24T22:57:22.072 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-24T22:57:22.200 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-24T22:57:22.206 INFO:teuthology.orchestra.run.smithi146.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-24T22:57:22.267 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-24T22:57:22.383 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-24T22:57:22.390 INFO:teuthology.orchestra.run.smithi146.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-04-24T22:57:22.449 INFO:teuthology.orchestra.run.smithi146.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-24T22:57:22.449 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-24T22:57:22.689 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-24T22:57:22.745 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-24T22:57:22.799 INFO:teuthology.orchestra.run.smithi146.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 124 kB/s | 43 kB 00:00 2024-04-24T22:57:22.873 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-24T22:57:22.916 INFO:teuthology.orchestra.run.smithi146.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-24T22:57:23.000 INFO:teuthology.orchestra.run.smithi146.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 901 kB/s | 548 kB 00:00 2024-04-24T22:57:23.069 INFO:teuthology.orchestra.run.smithi146.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2024-04-24T22:57:23.192 INFO:teuthology.orchestra.run.smithi146.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 54 kB/s | 15 kB 00:00 2024-04-24T22:57:23.500 INFO:teuthology.orchestra.run.smithi146.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 344 kB/s | 172 kB 00:00 2024-04-24T22:57:23.592 INFO:teuthology.orchestra.run.smithi146.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 683 kB/s | 358 kB 00:00 2024-04-24T22:57:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 587 kB/s | 303 kB 00:00 2024-04-24T22:57:23.731 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-24T22:57:23.787 INFO:teuthology.orchestra.run.smithi146.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 124 kB/s | 35 kB 00:00 2024-04-24T22:57:23.879 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-24T22:57:24.101 INFO:teuthology.orchestra.run.smithi146.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 405 kB/s | 206 kB 00:00 2024-04-24T22:57:24.218 INFO:teuthology.orchestra.run.smithi146.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 334 kB/s | 144 kB 00:00 2024-04-24T22:57:24.285 INFO:teuthology.orchestra.run.smithi146.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-24T22:57:24.486 INFO:teuthology.orchestra.run.smithi146.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-24T22:57:24.552 INFO:teuthology.orchestra.run.smithi146.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-24T22:57:24.619 INFO:teuthology.orchestra.run.smithi146.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.2 MB/s | 2.0 MB 00:00 2024-04-24T22:57:24.811 INFO:teuthology.orchestra.run.smithi146.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 60 kB/s | 19 kB 00:00 2024-04-24T22:57:24.836 INFO:teuthology.orchestra.run.smithi146.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 69 kB/s | 20 kB 00:00 2024-04-24T22:57:25.162 INFO:teuthology.orchestra.run.smithi146.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-04-24T22:57:25.262 INFO:teuthology.orchestra.run.smithi146.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 186 kB/s | 79 kB 00:00 2024-04-24T22:57:25.304 INFO:teuthology.orchestra.run.smithi146.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-24T22:57:25.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-24T22:57:25.546 INFO:teuthology.orchestra.run.smithi146.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 151 kB/s | 58 kB 00:00 2024-04-24T22:57:25.571 INFO:teuthology.orchestra.run.smithi146.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 62 kB/s | 16 kB 00:00 2024-04-24T22:57:25.638 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-24T22:57:25.688 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-24T22:57:25.733 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-24T22:57:25.780 INFO:teuthology.orchestra.run.smithi146.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 527 kB/s | 272 kB 00:00 2024-04-24T22:57:25.838 INFO:teuthology.orchestra.run.smithi146.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-24T22:57:25.922 INFO:teuthology.orchestra.run.smithi146.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 240 kB/s | 90 kB 00:00 2024-04-24T22:57:26.047 INFO:teuthology.orchestra.run.smithi146.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-24T22:57:26.119 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-24T22:57:26.167 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T22:57:26.264 INFO:teuthology.orchestra.run.smithi146.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 173 kB/s | 59 kB 00:00 2024-04-24T22:57:26.298 INFO:teuthology.orchestra.run.smithi146.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 411 kB/s | 188 kB 00:00 2024-04-24T22:57:26.314 INFO:teuthology.orchestra.run.smithi146.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 134 kB/s | 36 kB 00:00 2024-04-24T22:57:26.322 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T22:57:26.358 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-24T22:57:26.416 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-24T22:57:26.607 INFO:teuthology.orchestra.run.smithi146.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-24T22:57:26.657 INFO:teuthology.orchestra.run.smithi146.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 263 kB/s | 90 kB 00:00 2024-04-24T22:57:26.799 INFO:teuthology.orchestra.run.smithi146.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2024-04-24T22:57:26.924 INFO:teuthology.orchestra.run.smithi146.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-24T22:57:26.949 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-24T22:57:26.988 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T22:57:27.113 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T22:57:27.140 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-24T22:57:27.216 INFO:teuthology.orchestra.run.smithi146.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 702 kB/s | 427 kB 00:00 2024-04-24T22:57:27.308 INFO:teuthology.orchestra.run.smithi146.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 377 kB/s | 192 kB 00:00 2024-04-24T22:57:27.625 INFO:teuthology.orchestra.run.smithi146.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-04-24T22:57:28.050 INFO:teuthology.orchestra.run.smithi146.stdout:(149/152): librados2-19.0.0-2445.gd2c45d97.el9. 4.1 MB/s | 3.4 MB 00:00 2024-04-24T22:57:28.209 INFO:teuthology.orchestra.run.smithi146.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 2.3 MB/s | 1.3 MB 00:00 2024-04-24T22:57:28.768 INFO:teuthology.orchestra.run.smithi146.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-04-24T22:57:29.151 INFO:teuthology.orchestra.run.smithi146.stdout:(152/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 1.7 MB/s | 3.1 MB 00:01 2024-04-24T22:57:29.157 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-04-24T22:57:29.158 INFO:teuthology.orchestra.run.smithi146.stdout:Total 8.3 MB/s | 220 MB 00:26 2024-04-24T22:57:29.816 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:29.862 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:30.514 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:30.557 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T22:57:30.729 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T22:57:30.729 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T22:57:30.730 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T22:57:30.730 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:30.775 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T22:57:31.958 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-04-24T22:57:32.200 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-04-24T22:57:32.200 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-04-24T22:57:34.822 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-04-24T22:57:34.822 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-04-24T22:57:41.155 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-04-24T22:57:41.291 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-24T22:57:41.378 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-24T22:57:41.509 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-24T22:57:41.570 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-24T22:57:41.609 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-24T22:57:41.734 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-24T22:57:42.196 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-24T22:57:42.321 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:57:42.507 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:57:42.541 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:57:42.672 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:57:42.724 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T22:57:43.060 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-24T22:57:43.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-24T22:57:43.153 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:57:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:57:43.337 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T22:57:43.425 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-24T22:57:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T22:57:43.524 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-04-24T22:57:43.809 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-04-24T22:57:43.810 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-04-24T22:57:43.810 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:43.818 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T22:57:43.872 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-24T22:57:44.052 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T22:57:44.059 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-24T22:57:44.096 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T22:57:44.097 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:44.097 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T22:57:44.097 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:44.185 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-24T22:57:44.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-24T22:57:44.269 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-24T22:57:44.361 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-24T22:57:44.408 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-24T22:57:44.478 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-24T22:57:44.522 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-24T22:57:44.561 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-24T22:57:44.679 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-24T22:57:44.748 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-24T22:57:44.788 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-24T22:57:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-24T22:57:44.955 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-24T22:57:44.994 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-24T22:57:45.046 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-24T22:57:45.084 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-24T22:57:45.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-24T22:57:45.271 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-24T22:57:45.370 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-24T22:57:45.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-24T22:57:45.614 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-24T22:57:45.704 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T22:57:45.782 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T22:57:45.782 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:45.782 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T22:57:45.782 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T22:57:45.783 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T22:57:45.783 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:46.074 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T22:57:46.145 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T22:57:46.145 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:46.145 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T22:57:46.146 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T22:57:46.146 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T22:57:46.146 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:46.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-24T22:57:46.395 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-24T22:57:46.440 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-24T22:57:46.485 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-24T22:57:46.525 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-24T22:57:46.585 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-24T22:57:46.647 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T22:57:46.718 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T22:57:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T22:57:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T22:57:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T22:57:46.719 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:46.808 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-24T22:57:46.866 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-24T22:57:46.873 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-24T22:57:46.932 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-24T22:57:46.948 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-24T22:57:47.023 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-24T22:57:47.027 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-24T22:57:47.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-24T22:57:47.114 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-24T22:57:47.180 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-24T22:57:47.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-24T22:57:47.282 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-24T22:57:47.284 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-24T22:57:47.341 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-24T22:57:47.343 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-24T22:57:47.431 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-24T22:57:47.539 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-24T22:57:47.540 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T22:57:47.596 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-24T22:57:47.633 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-24T22:57:47.690 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-24T22:57:47.710 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T22:57:47.770 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-24T22:57:47.818 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-24T22:57:47.827 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-24T22:57:47.851 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-24T22:57:47.866 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-24T22:57:47.912 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-24T22:57:47.947 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-24T22:57:47.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-24T22:57:48.172 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-24T22:57:48.353 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-24T22:57:48.414 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-24T22:57:48.443 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T22:57:48.480 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-24T22:57:48.488 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T22:57:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-24T22:57:48.544 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-24T22:57:48.604 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-24T22:57:48.655 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-24T22:57:48.660 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-24T22:57:48.690 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T22:57:48.708 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-24T22:57:48.767 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-24T22:57:48.821 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-24T22:57:48.897 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-24T22:57:48.942 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-24T22:57:49.083 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-24T22:57:49.149 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-24T22:57:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-24T22:57:49.262 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-24T22:57:49.408 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-24T22:57:49.504 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-24T22:57:49.969 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T22:57:50.026 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T22:57:50.469 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-24T22:57:50.520 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-24T22:57:50.554 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-24T22:57:50.674 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-24T22:57:50.740 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-24T22:57:50.845 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-24T22:57:50.888 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-24T22:57:51.125 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-24T22:57:51.129 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T22:57:51.160 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-24T22:57:51.184 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T22:57:51.277 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-24T22:57:51.335 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T22:57:51.516 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-24T22:57:51.572 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T22:57:51.656 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T22:57:51.657 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:51.657 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T22:57:51.657 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T22:57:51.657 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T22:57:51.657 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:51.720 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T22:57:51.759 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T22:57:51.894 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-24T22:57:51.974 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-24T22:57:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-24T22:57:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-24T22:57:53.026 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-24T22:57:53.064 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:57:53.138 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:53.191 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T22:57:53.278 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T22:57:53.278 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:53.278 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T22:57:53.278 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:53.349 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:57:53.445 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:53.800 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T22:57:53.880 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T22:57:53.880 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:57:53.880 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T22:57:53.880 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T22:57:53.881 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T22:57:53.881 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:57:53.886 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-24T22:57:53.991 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-24T22:57:54.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-24T22:57:54.086 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-24T22:57:54.476 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-24T22:57:54.512 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T22:57:54.654 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-24T22:57:54.685 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-24T22:57:54.742 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-24T22:57:55.281 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-24T22:57:55.314 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T22:57:55.406 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-24T22:57:55.433 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-24T22:57:58.169 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:58.858 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-24T22:57:58.860 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-24T22:57:58.909 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T22:57:58.912 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-24T22:57:58.995 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-24T22:57:59.069 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-24T22:57:59.098 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-24T22:57:59.098 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T22:57:59.098 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T22:57:59.099 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:57:59.107 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-24T22:57:59.143 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T22:57:59.429 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-24T22:57:59.479 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-24T22:57:59.507 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-24T22:58:00.415 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:00.465 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:00.516 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:01.827 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-24T22:58:01.948 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-24T22:58:02.031 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-24T22:58:02.268 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-24T22:58:02.318 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-24T22:58:02.318 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T22:58:02.441 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T22:58:02.496 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T22:58:02.496 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T22:58:02.651 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T22:58:02.784 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:03.074 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:03.074 INFO:teuthology.orchestra.run.smithi203.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-24T22:58:03.074 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:09.029 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-24T22:58:09.029 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-24T22:58:09.029 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-24T22:58:09.030 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-24T22:58:09.031 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-24T22:58:09.043 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-24T22:58:09.044 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-24T22:58:09.045 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-24T22:58:09.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-24T22:58:09.047 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-24T22:58:09.048 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-24T22:58:09.049 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-24T22:58:09.050 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-24T22:58:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T22:58:09.052 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:11.552 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.553 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.554 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.554 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.554 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.554 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.554 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.555 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-24T22:58:11.557 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T22:58:11.558 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T22:58:11.559 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.14-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T22:58:11.560 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T22:58:11.561 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T22:58:11.562 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T22:58:11.563 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T22:58:11.564 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T22:58:11.565 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.566 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:11.567 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-24T22:58:12.131 DEBUG:teuthology.parallel:result is None 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-04-24T22:58:12.221 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:12.446 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T22:58:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-24T22:58:12.494 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:12.494 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T22:58:12.494 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:14.174 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T22:58:14.253 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-24T22:58:14.253 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:14.253 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T22:58:14.253 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:14.254 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:14.254 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:14.507 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T22:58:14.574 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-24T22:58:14.575 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:14.575 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T22:58:14.575 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:14.575 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:14.575 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:15.067 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T22:58:15.135 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-24T22:58:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T22:58:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:15.136 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:15.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:15.267 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-24T22:58:15.327 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-24T22:58:15.403 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-24T22:58:15.636 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-24T22:58:15.696 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-24T22:58:15.781 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-24T22:58:15.890 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T22:58:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T22:58:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-24T22:58:16.161 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-24T22:58:16.202 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-24T22:58:16.847 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T22:58:16.889 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-24T22:58:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-24T22:58:17.058 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-24T22:58:17.090 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T22:58:18.346 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-24T22:58:18.392 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T22:58:19.504 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-24T22:58:19.534 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T22:58:19.682 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-24T22:58:19.858 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-24T22:58:19.894 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T22:58:19.970 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-24T22:58:19.971 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:19.971 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T22:58:19.971 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:19.971 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:19.971 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:20.028 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T22:58:20.065 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-24T22:58:20.179 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-24T22:58:20.241 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-24T22:58:21.215 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-24T22:58:21.247 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T22:58:21.322 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-24T22:58:21.322 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:21.322 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T22:58:21.322 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:21.323 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:21.323 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:21.381 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T22:58:21.467 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-24T22:58:21.468 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:21.468 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T22:58:21.468 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:21.540 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:21.636 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:22.032 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T22:58:22.110 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-24T22:58:22.111 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T22:58:22.111 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T22:58:22.111 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T22:58:22.111 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T22:58:22.111 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:27.071 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-24T22:58:27.115 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-24T22:58:27.183 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-24T22:58:27.230 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-24T22:58:27.270 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-24T22:58:27.586 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-24T22:58:27.634 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-24T22:58:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-24T22:58:28.535 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:28.577 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:28.623 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-24T22:58:29.968 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-24T22:58:30.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-24T22:58:30.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-24T22:58:30.305 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-24T22:58:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-24T22:58:30.356 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T22:58:30.482 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-24T22:58:30.522 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T22:58:30.522 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T22:58:30.661 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-24T22:58:30.793 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:31.085 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:31.085 INFO:teuthology.orchestra.run.smithi146.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-24T22:58:31.085 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:36.489 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-24T22:58:36.489 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-24T22:58:36.489 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-24T22:58:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-24T22:58:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-24T22:58:36.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-24T22:58:36.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-24T22:58:36.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-24T22:58:36.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-24T22:58:36.506 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-24T22:58:36.507 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-24T22:58:36.508 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-24T22:58:36.509 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-24T22:58:36.510 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-24T22:58:36.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-24T22:58:36.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-24T22:58:36.513 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-04-24T22:58:38.865 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.866 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.867 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.868 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-24T22:58:38.869 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.14-1.el9.x86_64 2024-04-24T22:58:38.870 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T22:58:38.871 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T22:58:38.872 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T22:58:38.873 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-24T22:58:38.874 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T22:58:38.875 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.876 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T22:58:38.877 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-24T22:58:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:38.878 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-04-24T22:58:39.512 DEBUG:teuthology.parallel:result is None 2024-04-24T22:58:39.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:58:39.739 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T22:58:39.792 INFO:teuthology.orchestra.run.smithi146.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-24T22:58:39.793 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-24T22:58:39.793 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-24T22:58:39.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:58:39.941 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T22:58:40.015 INFO:teuthology.orchestra.run.smithi203.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-24T22:58:40.016 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-24T22:58:40.016 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-24T22:58:40.018 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T22:58:40.018 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:40.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T22:58:40.088 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:40.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T22:58:40.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T22:58:40.181 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:40.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T22:58:40.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T22:58:40.345 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:40.345 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T22:58:40.434 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T22:58:40.561 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T22:58:40.562 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:40.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T22:58:40.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T22:58:40.735 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:40.735 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T22:58:40.823 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T22:58:40.949 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T22:58:40.950 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:40.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T22:58:41.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T22:58:41.126 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:41.126 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T22:58:41.213 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T22:58:41.292 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T22:58:41.392 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T22:58:41.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-04-24T22:58:41.398 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-04-24T22:58:41.487 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T22:58:41.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T22:58:41.492 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T22:58:41.577 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T22:58:41.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T22:58:41.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T22:58:41.674 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-24T22:58:41.674 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-24T22:58:41.674 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-24T22:58:41.675 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:41.675 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T22:58:41.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T22:58:41.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-24T22:58:41.953 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:41.953 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T22:58:42.012 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T22:58:42.253 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-24T22:58:42.345 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T22:58:42.345 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T22:58:42.345 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672163', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFT98fVbGixssoDrgBzjgC4YQ1stQ3V5DH3Bky0Od9sqvdIgX0fSIjhufT6cHD+dtxbTnaxhfdm8NFCp/QN7f0=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGo0ZlUOhcL3PjUomP2SDuBoC0WP4Vavue8Sm518pEo8rKf/GwAK3pwz4MYFyKRmD7UPMuxz6tf77lsQ6pqbH+8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_journal_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T22:58:42.346 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T22:58:42.351 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T22:58:42.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T22:58:42.434 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T22:58:42.523 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:42.523 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T22:58:42.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T22:58:42.562 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-04-24T22:58:42.642 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-24 22:58:31.535650211 +0000 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 22:55:53.013628954 +0000 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 22:55:53.013628954 +0000 2024-04-24T22:58:42.643 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 22:55:53.013628954 +0000 2024-04-24T22:58:42.643 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T22:58:42.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-24T22:58:42.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-24T22:58:42.743 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000372137 s, 1.4 MB/s 2024-04-24T22:58:42.745 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T22:58:42.786 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-04-24T22:58:42.868 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-24 22:58:31.536650195 +0000 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 22:55:53.637619640 +0000 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 22:55:53.637619640 +0000 2024-04-24T22:58:42.869 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 22:55:53.637619640 +0000 2024-04-24T22:58:42.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T22:58:42.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-24T22:58:42.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-24T22:58:42.972 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000307998 s, 1.7 MB/s 2024-04-24T22:58:42.974 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T22:58:43.015 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-04-24T22:58:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T22:58:43.098 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-24 22:58:31.537650180 +0000 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 22:55:54.261610327 +0000 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 22:55:54.261610327 +0000 2024-04-24T22:58:43.099 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 22:55:54.261610327 +0000 2024-04-24T22:58:43.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T22:58:43.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-24T22:58:43.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-24T22:58:43.202 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00029734 s, 1.7 MB/s 2024-04-24T22:58:43.205 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T22:58:43.246 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-04-24T22:58:43.328 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T22:58:43.328 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:43.328 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-24 22:58:31.538650165 +0000 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 22:55:54.846601595 +0000 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 22:55:54.846601595 +0000 2024-04-24T22:58:43.329 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 22:55:54.846601595 +0000 2024-04-24T22:58:43.329 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T22:58:43.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-24T22:58:43.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-24T22:58:43.432 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000287474 s, 1.8 MB/s 2024-04-24T22:58:43.435 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T22:58:43.475 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:43.475 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:43.476 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T22:58:43.533 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T22:58:43.533 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-24 22:58:03.583849464 +0000 2024-04-24T22:58:43.585 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-24 22:55:53.011098785 +0000 2024-04-24T22:58:43.586 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-24 22:55:53.011098785 +0000 2024-04-24T22:58:43.586 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-24 22:55:53.011098785 +0000 2024-04-24T22:58:43.586 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T22:58:43.660 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-24T22:58:43.660 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-24T22:58:43.660 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000365487 s, 1.4 MB/s 2024-04-24T22:58:43.663 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T22:58:43.717 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-24 22:58:03.584849439 +0000 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-24 22:55:53.620084196 +0000 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-24 22:55:53.620084196 +0000 2024-04-24T22:58:43.765 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-24 22:55:53.620084196 +0000 2024-04-24T22:58:43.766 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T22:58:43.841 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-24T22:58:43.841 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-24T22:58:43.841 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000325993 s, 1.6 MB/s 2024-04-24T22:58:43.845 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T22:58:43.898 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-24 22:58:03.585849414 +0000 2024-04-24T22:58:43.949 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-24 22:55:54.234069488 +0000 2024-04-24T22:58:43.950 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-24 22:55:54.234069488 +0000 2024-04-24T22:58:43.950 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-24 22:55:54.234069488 +0000 2024-04-24T22:58:43.950 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T22:58:44.027 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-24T22:58:44.027 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-24T22:58:44.027 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000339997 s, 1.5 MB/s 2024-04-24T22:58:44.031 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T22:58:44.085 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T22:58:44.136 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-24 22:58:03.586849388 +0000 2024-04-24T22:58:44.136 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-24 22:55:54.870054264 +0000 2024-04-24T22:58:44.136 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-24 22:55:54.870054264 +0000 2024-04-24T22:58:44.136 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-24 22:55:54.870054264 +0000 2024-04-24T22:58:44.136 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T22:58:44.214 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-24T22:58:44.214 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-24T22:58:44.214 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000359203 s, 1.4 MB/s 2024-04-24T22:58:44.218 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T22:58:44.272 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:44.273 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T22:58:44.273 INFO:tasks.ceph:Generating config... 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] debug client = 20 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] pid file = 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-24T22:58:44.274 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-24T22:58:44.274 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T22:58:44.275 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T22:58:44.276 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T22:58:44.276 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T22:58:44.276 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-24T22:58:44.276 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T22:58:44.276 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T22:58:44.277 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T22:58:44.277 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-24T22:58:44.277 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T22:58:44.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T22:58:44.376 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T22:58:44.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T22:58:44.472 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:58:44.531 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.203'), ('mon.c', '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]')] 2024-04-24T22:58:44.531 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-24T22:58:44.532 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:44.532 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T22:58:44.570 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.203 --addv c '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:44.700 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:44.700 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 6a930041-393c-45a0-b3d3-8568bdacde7e 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:setting min_mon_release = quincy 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 6a930041-393c-45a0-b3d3-8568bdacde7e 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2024-04-24T22:58:44.700122+0000 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:created 2024-04-24T22:58:44.700122+0000 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 17 (quincy) 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] mon.c 2024-04-24T22:58:44.701 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T22:58:44.704 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T22:58:44.742 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6a930041-393c-45a0-b3d3-8568bdacde7e... 2024-04-24T22:58:44.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T22:58:44.786 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T22:58:44.888 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.889 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-04-24T22:58:44.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 6a930041-393c-45a0-b3d3-8568bdacde7e 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-04-24T22:58:44.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2024-04-24T22:58:44.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:58:44.895 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:58:44.896 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:58:44.897 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-04-24T22:58:44.898 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-04-24T22:58:44.899 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-04-24T22:58:44.928 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.929 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-04-24T22:58:44.930 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-04-24T22:58:44.931 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.146,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on skipped message = False 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = 6a930041-393c-45a0-b3d3-8568bdacde7e 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.932 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-04-24T22:58:44.933 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.934 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 20 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 20 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 10 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-04-24T22:58:44.935 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-04-24T22:58:44.936 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T22:58:44.937 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: mon down mkfs grace = 300 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: mon op complaint time = 120 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T22:58:44.938 INFO:teuthology.orchestra.run.smithi203.stdout: client mount timeout = 600 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = "" 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout:[mds] 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds = 20 2024-04-24T22:58:44.939 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds balancer = 20 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug frag = True 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug scatterstat = True 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: mds op complaint time = 180 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: mds verify scatter = True 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-04-24T22:58:44.940 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-04-24T22:58:44.962 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T22:58:44.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T22:58:45.065 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T22:58:45.065 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:45.065 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T22:58:45.104 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:45.104 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T22:58:45.184 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:58:45.184 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:45.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T22:58:45.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:58:45.315 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:58:45.315 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:45.399 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:58:45.399 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:45.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T22:58:45.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:58:45.518 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:58:45.518 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:45.617 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T22:58:45.617 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T22:58:45.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T22:58:45.739 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T22:58:45.746 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T22:58:45.906 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T22:58:45.915 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T22:58:45.916 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T22:58:46.045 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T22:58:46.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-24T22:58:46.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T22:58:46.240 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T22:58:46.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-24T22:58:46.308 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T22:58:46.460 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T22:58:46.469 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-24T22:58:46.554 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-24T22:58:46.708 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-24T22:58:46.717 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-24T22:58:46.801 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T22:58:46.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T22:58:46.915 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T22:58:46.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-24T22:58:47.072 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-24T22:58:47.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-24T22:58:47.220 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-24T22:58:47.262 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-24T22:58:47.377 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-24T22:58:47.426 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T22:58:47.426 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T22:58:47.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T22:58:47.508 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:47.508 INFO:tasks.ceph:role: osd.0 2024-04-24T22:58:47.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:58:47.508 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T22:58:47.591 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:58:47.591 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:58:47.592 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:58:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-04-24T22:58:48.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-04-24T22:58:48.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T22:58:48.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T22:58:48.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T22:58:48.321 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:48.321 INFO:tasks.ceph:role: osd.1 2024-04-24T22:58:48.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:58:48.321 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T22:58:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:58:48.396 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:58:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:58:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-04-24T22:58:48.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-04-24T22:58:48.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T22:58:48.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T22:58:48.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T22:58:48.981 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:48.981 INFO:tasks.ceph:role: osd.2 2024-04-24T22:58:48.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:58:48.982 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T22:58:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:58:49.050 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:58:49.050 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:58:49.050 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:58:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:58:49.051 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:58:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:58:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:58:49.051 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:58:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:58:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-04-24T22:58:49.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-04-24T22:58:49.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T22:58:49.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T22:58:49.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T22:58:49.695 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:58:49.695 INFO:tasks.ceph:role: osd.3 2024-04-24T22:58:49.695 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T22:58:49.695 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T22:58:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:58:49.766 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:58:49.766 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:58:49.766 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:58:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:58:49.767 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:58:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:58:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:58:49.767 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:58:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:58:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-04-24T22:58:50.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-04-24T22:58:50.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T22:58:50.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T22:58:50.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:50.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.561+0000 7efdf0b2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T22:58:50.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.562+0000 7efdf0b2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T22:58:50.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.562+0000 7efdf0b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:58:50.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.562+0000 7efdf0b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:58:50.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.562+0000 7efdf0b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:58:50.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:50.566+0000 7efdf0b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T22:58:53.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T22:58:53.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:53.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.751+0000 7fb664557640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T22:58:53.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.752+0000 7fb664557640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T22:58:53.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.752+0000 7fb664557640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:58:53.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.752+0000 7fb664557640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:58:53.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.752+0000 7fb664557640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:58:53.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:53.754+0000 7fb664557640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T22:58:56.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T22:58:56.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:58:56.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.948+0000 7fbe94bad640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T22:58:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.949+0000 7fbe94bad640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T22:58:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.949+0000 7fbe94bad640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:58:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.949+0000 7fbe94bad640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:58:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.949+0000 7fbe94bad640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:58:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:58:56.951+0000 7fbe94bad640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T22:58:59.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T22:59:00.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.149+0000 7f2e48e1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T22:59:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.150+0000 7f2e48e1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T22:59:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.150+0000 7f2e48e1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.150+0000 7f2e48e1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.150+0000 7f2e48e1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:00.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:00.152+0000 7f2e48e1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T22:59:03.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T22:59:03.444 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:03.532 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:03.533 INFO:tasks.ceph:role: osd.4 2024-04-24T22:59:03.533 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:59:03.533 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T22:59:03.622 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:03.623 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:04.039 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-24T22:59:04.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-24T22:59:04.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:04.187 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:04.279 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:04.362 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:04.362 INFO:tasks.ceph:role: osd.5 2024-04-24T22:59:04.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:59:04.363 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T22:59:04.443 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:04.444 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:04.444 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:04.444 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:59:04.444 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:04.444 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:04.445 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:04.445 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:59:04.445 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:04.445 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:04.798 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-24T22:59:04.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-24T22:59:04.803 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:04.910 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:04.981 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:05.042 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:05.042 INFO:tasks.ceph:role: osd.6 2024-04-24T22:59:05.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:59:05.042 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T22:59:05.108 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:05.109 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:05.512 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-24T22:59:05.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-24T22:59:05.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:05.649 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:05.720 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:05.788 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:05.788 INFO:tasks.ceph:role: osd.7 2024-04-24T22:59:05.788 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T22:59:05.788 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T22:59:05.864 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:05.864 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:05.864 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:05.864 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T22:59:05.864 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:05.865 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:05.865 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:05.865 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T22:59:05.865 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:05.865 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:06.269 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-24T22:59:06.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-24T22:59:06.276 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:06.441 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:06.535 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:06.683 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.681+0000 7f2c34daf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T22:59:06.684 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.682+0000 7f2c34daf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T22:59:06.684 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.682+0000 7f2c34daf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:06.684 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.682+0000 7f2c34daf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:06.684 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.682+0000 7f2c34daf640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:06.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:06.686+0000 7f2c34daf640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T22:59:09.695 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:09.781 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:09.914 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.913+0000 7f2cdee1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T22:59:09.914 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.913+0000 7f2cdee1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T22:59:09.914 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.913+0000 7f2cdee1e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:09.915 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.913+0000 7f2cdee1e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:09.915 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.913+0000 7f2cdee1e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:09.916 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:09.916+0000 7f2cdee1e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T22:59:12.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:12.355 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:13.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:13.233 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:13.362 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.361+0000 7f57b21dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T22:59:13.363 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.362+0000 7f57b21dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T22:59:13.363 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.362+0000 7f57b21dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:13.363 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.362+0000 7f57b21dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:13.363 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.362+0000 7f57b21dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:13.365 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:13.364+0000 7f57b21dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T22:59:16.562 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:16.648 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:16.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.773+0000 7f8264e0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T22:59:16.775 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.774+0000 7f8264e0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T22:59:16.775 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.774+0000 7f8264e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:16.775 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.774+0000 7f8264e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:16.775 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.774+0000 7f8264e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:16.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:16.777+0000 7f8264e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T22:59:19.745 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:19.829 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T22:59:19.829 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:19.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T22:59:19.918 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:19.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-24T22:59:20.000 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:20.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-24T22:59:20.074 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:20.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T22:59:20.201 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:20.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T22:59:20.287 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:20.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T22:59:20.371 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:20.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T22:59:20.456 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.456 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T22:59:20.540 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.540 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-24T22:59:20.620 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.620 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-24T22:59:20.751 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.751 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T22:59:20.830 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T22:59:20.910 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.910 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T22:59:20.990 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:20.991 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T22:59:21.120 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:21.120 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T22:59:21.176 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:21.176 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-24T22:59:21.231 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:21.231 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-24T22:59:21.288 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:21.288 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-24T22:59:21.340 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T22:59:21.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T22:59:21.348 DEBUG:teuthology.orchestra.run.smithi203:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T22:59:21.424 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg== 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ== 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg== 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA== 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2024-04-24T22:59:21.425 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ== 2024-04-24T22:59:21.426 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g== 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2024-04-24T22:59:21.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg== 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.y] 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg== 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ== 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg== 2024-04-24T22:59:21.428 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.0] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.1] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.2] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.3] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.x] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ== 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-04-24T22:59:21.429 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.4] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.5] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.6] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.7] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[client.2] 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw== 2024-04-24T22:59:21.430 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-04-24T22:59:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g== 2024-04-24T22:59:21.431 INFO:teuthology.orchestra.run.smithi203.stdout:[client.3] 2024-04-24T22:59:21.431 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg== 2024-04-24T22:59:21.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:21.482 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:21.621 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:21.626 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:21.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:21.760 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:21.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:21.900 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.039 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.173 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.177 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.316 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:22.449 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:22.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:22.585 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:22.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:22.720 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:22.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.864 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:22.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.000 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.137 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.274 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:23.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.414 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.559 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.698 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.836 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:23.975 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T22:59:23.976 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T22:59:24.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:24.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T22:59:24.259 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T22:59:24.349 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:24.499 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T22:59:24.569 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T22:59:24.652 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:24.798 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T22:59:24.870 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:24.878 DEBUG:teuthology.orchestra.run.smithi203:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:24.928 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T22:59:24.928 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T22:59:24.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T22:59:24.935 INFO:tasks.ceph.mon.a:Started 2024-04-24T22:59:24.935 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T22:59:24.935 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T22:59:24.940 INFO:tasks.ceph.mon.b:Started 2024-04-24T22:59:24.940 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T22:59:24.940 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T22:59:24.946 INFO:tasks.ceph.mon.c:Started 2024-04-24T22:59:24.947 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T22:59:24.947 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T22:59:24.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T22:59:24.954 INFO:tasks.ceph.mgr.y:Started 2024-04-24T22:59:24.954 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T22:59:24.954 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T22:59:24.959 INFO:tasks.ceph.mgr.x:Started 2024-04-24T22:59:24.959 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T22:59:24.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T22:59:25.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.127+0000 7f7c0a400640 1 Processor -- start 2024-04-24T22:59:25.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.127+0000 7f7c0a400640 1 -- start start 2024-04-24T22:59:25.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.128+0000 7f7c0a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:25.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.128+0000 7f7c0a400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:25.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.128+0000 7f7c0a400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c040d2ee0 con 0x7f7c04161a00 2024-04-24T22:59:25.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.128+0000 7f7c0a400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7c040cfa70 con 0x7f7c040d0bd0 2024-04-24T22:59:25.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.128+0000 7f7c0a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7c040cfcc0 con 0x7f7c04161620 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46990/0 (socket says 172.21.15.146:46990) 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 learned_addr learned my addr 172.21.15.146:0/1625873799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:25.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.129+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.330+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.330+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.331+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.732+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.733+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.733+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.733+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:25.733+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.534+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.534+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:26.535+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 msgr2=0x7f7c040cea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04161620 0x7f7c040cea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 msgr2=0x7f7c040b43c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.146:3300/0 conn(0x7f7c040d0bd0 0x7f7c040b43c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 -- 172.21.15.146:0/1625873799 >> v1:172.21.15.203:6789/0 conn(0x7f7c04161a00 legacy=0x7f7c040d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 -- 172.21.15.146:0/1625873799 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c040b38e0 con 0x7f7be40061a0 2024-04-24T22:59:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c02000640 1 -- 172.21.15.146:0/1625873799 --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7c040cfa70 con 0x7f7be40036d0 2024-04-24T22:59:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.129+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.130+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.130+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.130+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.130+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.331+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.332+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.332+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.332+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.332+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.733+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.733+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.733+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.733+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:28.733+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:29.535+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:29.536+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:29.536+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:29.536+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:29.536+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:30.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.392+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3988488346 0 0) 0x7f7c040b38e0 con 0x7f7be40061a0 2024-04-24T22:59:30.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.392+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bec003520 con 0x7f7be40061a0 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2363706579 0 0) 0x7f7bec003520 con 0x7f7be40061a0 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 msgr2=0x7f7be4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 --2- 172.21.15.146:0/1625873799 >> v2:172.21.15.203:3300/0 conn(0x7f7be40036d0 0x7f7be4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be400afa0 con 0x7f7be40061a0 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7bf00016f0 con 0x7f7be40061a0 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.393+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 >> v1:172.21.15.146:6789/0 conn(0x7f7be40061a0 legacy=0x7f7be4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c09a00640 1 -- 172.21.15.146:0/1625873799 reap_dead start 2024-04-24T22:59:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 0x7f7bec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bec004800 0x7f7bec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec0053c0 0x7f7bec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c040cfa70 con 0x7f7bec003a00 2024-04-24T22:59:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec00c280 con 0x7f7bec004800 2024-04-24T22:59:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec00c480 con 0x7f7bec0053c0 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 0x7f7bec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.394+0000 7f7c03e00640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bec004800 0x7f7bec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09a00640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec0053c0 0x7f7bec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec0053c0 msgr2=0x7f7bec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec0053c0 0x7f7bec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bec004800 msgr2=0x7f7bec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bec004800 0x7f7bec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.395+0000 7f7c09000640 1 -- 172.21.15.146:0/1625873799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec003520 con 0x7f7bec003a00 2024-04-24T22:59:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.398+0000 7f7c09000640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 0x7f7bec003e00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8019cc0 tx=0x7f7bec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef71441b2c9b488c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.398+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8032070 con 0x7f7bec003a00 2024-04-24T22:59:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.399+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf802cd00 con 0x7f7bec003a00 2024-04-24T22:59:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.399+0000 7f7c03400640 1 -- 172.21.15.146:0/1625873799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8019940 con 0x7f7bec003a00 2024-04-24T22:59:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 -- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 msgr2=0x7f7bec003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 0x7f7bec003e00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8019cc0 tx=0x7f7bec005830 comp rx=0 tx=0).stop 2024-04-24T22:59:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 -- 172.21.15.146:0/1625873799 shutdown_connections 2024-04-24T22:59:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec0053c0 0x7f7bec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bec004800 0x7f7bec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 --2- 172.21.15.146:0/1625873799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec003a00 0x7f7bec003e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 -- 172.21.15.146:0/1625873799 >> 172.21.15.146:0/1625873799 conn(0x7f7c040d3d90 msgr2=0x7f7c040d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 -- 172.21.15.146:0/1625873799 shutdown_connections 2024-04-24T22:59:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.400+0000 7f7c0a400640 1 -- 172.21.15.146:0/1625873799 wait complete. 2024-04-24T22:59:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.403+0000 7f7c0a400640 1 Processor -- start 2024-04-24T22:59:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.403+0000 7f7c0a400640 1 -- start start 2024-04-24T22:59:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 0x7f7c040a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 0x7f7c040b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c040b35d0 con 0x7f7bec0053c0 2024-04-24T22:59:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c040b3ea0 con 0x7f7c040b6970 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c0a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7c040d48b0 con 0x7f7bec004800 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60246/0 (socket says 172.21.15.146:60246) 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c03e00640 1 -- 172.21.15.146:0/2594645062 learned_addr learned my addr 172.21.15.146:0/2594645062 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c09000640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 0x7f7c040a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.405+0000 7f7c09a00640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 0x7f7c040b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 -- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 msgr2=0x7f7c040a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 0x7f7c040a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 -- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 msgr2=0x7f7c040b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 0x7f7c040b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 -- 172.21.15.146:0/2594645062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c040a1350 con 0x7f7bec0053c0 2024-04-24T22:59:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c09000640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 0x7f7c040a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c09a00640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 0x7f7c040b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c03e00640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007fd0 tx=0x7f7bf000fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00052e0 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf0018070 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000d910 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.406+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c040a1630 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.407+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0409dd00 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.407+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7bf000dab0 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.407+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7bf001d460 con 0x7f7bec0053c0 2024-04-24T22:59:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.408+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0404f500 con 0x7f7bec0053c0 2024-04-24T22:59:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.412+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7bf00035f0 con 0x7f7bec0053c0 2024-04-24T22:59:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.485+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7c040cfc20 con 0x7f7bec0053c0 2024-04-24T22:59:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.489+0000 7f7c00c00640 1 -- 172.21.15.146:0/2594645062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7bf00037d0 con 0x7f7bec0053c0 2024-04-24T22:59:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2024-04-24T22:59:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 msgr2=0x7f7c040a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007fd0 tx=0x7f7bf000fc70 comp rx=0 tx=0).stop 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 shutdown_connections 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c040b6970 0x7f7c040b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bec0053c0 0x7f7c040a0cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 --2- 172.21.15.146:0/2594645062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7bec004800 0x7f7c040a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 >> 172.21.15.146:0/2594645062 conn(0x7f7c040d3d90 msgr2=0x7f7c040cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.490+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 shutdown_connections 2024-04-24T22:59:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:30.491+0000 7f7c0a400640 1 -- 172.21.15.146:0/2594645062 wait complete. 2024-04-24T22:59:30.511 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T22:59:30.511 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T22:59:30.511 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:30.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T22:59:30.568 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:30.566+0000 7f5b73ddc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T22:59:30.591 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:30.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T22:59:30.673 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:30.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T22:59:30.757 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T22:59:30.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T22:59:30.784 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:30.781+0000 7f5b73ddc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:30.842 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:30.842 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T22:59:30.852 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:30.850+0000 7f5b73ddc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T22:59:30.924 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:30.924 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T22:59:31.043 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:31.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T22:59:31.160 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T22:59:31.160 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T22:59:31.195 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:31.193+0000 7f5b73ddc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T22:59:31.233 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new f7bfdd19-10ad-47af-b27b-8ac9a3422e61 0 2024-04-24T22:59:31.257 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:31.255+0000 7f5b73ddc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T22:59:31.262 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:31.260+0000 7f5b0aa16040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T22:59:31.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.445+0000 7fd453e00640 1 Processor -- start 2024-04-24T22:59:31.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.445+0000 7fd453e00640 1 -- start start 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 0x7fd4540d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd4540b4df0 0x7fd4540d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4540b4bd0 con 0x7fd4540b4160 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540cfcd0 con 0x7fd4540b4df0 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540d4bb0 con 0x7fd4540d0ac0 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 0x7fd4540d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fd4540b4160 0x7fd4540d03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:50326/0 (socket says 172.21.15.203:50326) 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452a00640 1 -- 172.21.15.203:0/3314010562 learned_addr learned my addr 172.21.15.203:0/3314010562 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-24T22:59:31.449 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd453400640 1 --2- 172.21.15.203:0/3314010562 >> v2:172.21.15.203:3300/0 conn(0x7fd4540b4df0 0x7fd4540d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.450 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452000640 1 -- 172.21.15.203:0/3314010562 >> v2:172.21.15.203:3300/0 conn(0x7fd4540b4df0 msgr2=0x7fd4540d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:31.450 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452000640 1 --2- 172.21.15.203:0/3314010562 >> v2:172.21.15.203:3300/0 conn(0x7fd4540b4df0 0x7fd4540d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.450 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452000640 1 -- 172.21.15.203:0/3314010562 >> v1:172.21.15.203:6789/0 conn(0x7fd4540b4160 legacy=0x7fd4540d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.450 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd452000640 1 -- 172.21.15.203:0/3314010562 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540d48d0 con 0x7fd4540d0ac0 2024-04-24T22:59:31.450 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.447+0000 7fd451600640 1 -- 172.21.15.203:0/3314010562 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173300138 0 0) 0x7fd4540b4bd0 con 0x7fd4540b4160 2024-04-24T22:59:31.451 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.448+0000 7fd452000640 1 --2- 172.21.15.203:0/3314010562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 0x7fd4540d1a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097a0 tx=0x7fd44002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85990e7270a5192e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd451600640 1 -- 172.21.15.203:0/3314010562 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440037070 con 0x7fd4540d0ac0 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd451600640 1 -- 172.21.15.203:0/3314010562 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44002adb0 con 0x7fd4540d0ac0 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd451600640 1 -- 172.21.15.203:0/3314010562 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440032660 con 0x7fd4540d0ac0 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 -- 172.21.15.203:0/3314010562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 msgr2=0x7fd4540d1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 --2- 172.21.15.203:0/3314010562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 0x7fd4540d1a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097a0 tx=0x7fd44002a060 comp rx=0 tx=0).stop 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 -- 172.21.15.203:0/3314010562 shutdown_connections 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 --2- 172.21.15.203:0/3314010562 >> v2:172.21.15.203:3300/0 conn(0x7fd4540b4df0 0x7fd4540d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 --2- 172.21.15.203:0/3314010562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540d0ac0 0x7fd4540d1a60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 -- 172.21.15.203:0/3314010562 >> 172.21.15.203:0/3314010562 conn(0x7fd4540d3c80 msgr2=0x7fd4540d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 -- 172.21.15.203:0/3314010562 shutdown_connections 2024-04-24T22:59:31.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.449+0000 7fd453e00640 1 -- 172.21.15.203:0/3314010562 wait complete. 2024-04-24T22:59:31.453 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.451+0000 7fd453e00640 1 Processor -- start 2024-04-24T22:59:31.453 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.451+0000 7fd453e00640 1 -- start start 2024-04-24T22:59:31.454 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.454 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 0x7fd45415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.454 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4540d0ac0 0x7fd4541530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540b48a0 con 0x7fd4540d0ac0 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540cf7b0 con 0x7fd4540b4160 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd453e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540b4540 con 0x7fd4540b4df0 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd452a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd452a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53308/0 (socket says 172.21.15.203:53308) 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd452a00640 1 -- 172.21.15.203:0/586668126 learned_addr learned my addr 172.21.15.203:0/586668126 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:31.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.452+0000 7fd452000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 0x7fd45415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd453400640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4540d0ac0 0x7fd4541530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 -- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 msgr2=0x7fd4540b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 -- 172.21.15.203:0/586668126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4540d0ac0 msgr2=0x7fd4541530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4540d0ac0 0x7fd4541530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 -- 172.21.15.203:0/586668126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd454153630 con 0x7fd4540b4df0 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452a00640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd452000640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 0x7fd45415c8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd440031000 tx=0x7fd4400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.453+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440041070 con 0x7fd4540b4df0 2024-04-24T22:59:31.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440032e20 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440037040 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4540b7f50 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540b8510 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd440044070 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.454+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd440046a00 con 0x7fd4540b4df0 2024-04-24T22:59:31.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.455+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd45404f500 con 0x7fd4540b4df0 2024-04-24T22:59:31.459 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:31.457+0000 7f5b0aa16040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:31.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.458+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd440046c50 con 0x7fd4540b4df0 2024-04-24T22:59:31.525 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:31.523+0000 7f5b0aa16040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T22:59:31.538 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.536+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f7bfdd19-10ad-47af-b27b-8ac9a3422e61", "id": 0} v 0) -- 0x7fd4540ce8f0 con 0x7fd4540b4df0 2024-04-24T22:59:31.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.545+0000 7fd44aa00640 1 -- 172.21.15.203:0/586668126 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7bfdd19-10ad-47af-b27b-8ac9a3422e61", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd44003c8b0 con 0x7fd4540b4df0 2024-04-24T22:59:31.548 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-04-24T22:59:31.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 msgr2=0x7fd45415c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 0x7fd45415c8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd440031000 tx=0x7fd4400046c0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 shutdown_connections 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4540d0ac0 0x7fd4541530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4540b4df0 0x7fd45415c8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 --2- 172.21.15.203:0/586668126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4540b4160 0x7fd4540b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.546+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 >> 172.21.15.203:0/586668126 conn(0x7fd4540d3c80 msgr2=0x7fd4540d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:31.550 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.547+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 shutdown_connections 2024-04-24T22:59:31.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.547+0000 7fd453e00640 1 -- 172.21.15.203:0/586668126 wait complete. 2024-04-24T22:59:31.564 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 238828a7-6d52-413e-9bee-f2a9a1094639 1 2024-04-24T22:59:31.746 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.744+0000 7f767ca00640 1 Processor -- start 2024-04-24T22:59:31.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.744+0000 7f767ca00640 1 -- start start 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f767ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f767ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f76780afd20 0x7f76780cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f767ca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76780d02b0 con 0x7f767815e3a0 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f767ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f76780ceba0 con 0x7f76780afd20 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f767ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f76780d0080 con 0x7f767806b140 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f7677400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f7677e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f76780afd20 0x7f76780cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f7677400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56800/0 (socket says 172.21.15.203:56800) 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f7677400640 1 -- 172.21.15.203:0/43606963 learned_addr learned my addr 172.21.15.203:0/43606963 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.746+0000 7f7677e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f76780afd20 0x7f76780cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53312/0 (socket says 172.21.15.203:53312) 2024-04-24T22:59:31.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.747+0000 7f7677e00640 1 -- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 msgr2=0x7f7678072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:31.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.747+0000 7f7677e00640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.747+0000 7f7677e00640 1 -- 172.21.15.203:0/43606963 >> v1:172.21.15.203:6789/0 conn(0x7f767815e3a0 legacy=0x7f767806b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.747+0000 7f7677e00640 1 -- 172.21.15.203:0/43606963 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76780d0550 con 0x7f76780afd20 2024-04-24T22:59:31.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.747+0000 7f7677400640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:31.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.748+0000 7f7677e00640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76780afd20 0x7f76780cdfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458bd78629b72cab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:31.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f7676a00640 1 -- 172.21.15.203:0/43606963 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670007740 con 0x7f76780afd20 2024-04-24T22:59:31.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f7676a00640 1 -- 172.21.15.203:0/43606963 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76700078e0 con 0x7f76780afd20 2024-04-24T22:59:31.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f7676a00640 1 -- 172.21.15.203:0/43606963 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670007cb0 con 0x7f76780afd20 2024-04-24T22:59:31.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 -- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76780afd20 msgr2=0x7f76780cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76780afd20 0x7f76780cdfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767002a660 comp rx=0 tx=0).stop 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 -- 172.21.15.203:0/43606963 shutdown_connections 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76780afd20 0x7f76780cdfb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 --2- 172.21.15.203:0/43606963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f767806b140 0x7f7678072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 -- 172.21.15.203:0/43606963 >> 172.21.15.203:0/43606963 conn(0x7f76780cd490 msgr2=0x7f76780cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 -- 172.21.15.203:0/43606963 shutdown_connections 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.749+0000 7f767ca00640 1 -- 172.21.15.203:0/43606963 wait complete. 2024-04-24T22:59:31.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.751+0000 7f767ca00640 1 Processor -- start 2024-04-24T22:59:31.754 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.751+0000 7f767ca00640 1 -- start start 2024-04-24T22:59:31.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76780afd20 0x7f767814b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f767815e3a0 0x7f767815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:31.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7678071eb0 con 0x7f767815e3a0 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f76780718f0 con 0x7f767806b140 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f767ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f76780cb060 con 0x7f76780afd20 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f7677400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f7677400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53322/0 (socket says 172.21.15.203:53322) 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f7677400640 1 -- 172.21.15.203:0/3279452338 learned_addr learned my addr 172.21.15.203:0/3279452338 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.752+0000 7f766fe00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76780afd20 0x7f767814b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 -- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76780afd20 msgr2=0x7f767814b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76780afd20 0x7f767814b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677e00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f767815e3a0 0x7f767815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 -- 172.21.15.203:0/3279452338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f767815e3a0 msgr2=0x7f767815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f767815e3a0 0x7f767815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 -- 172.21.15.203:0/3279452338 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76781616c0 con 0x7f767806b140 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f7677400640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f766800e9d0 tx=0x7f766800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.753+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7668017070 con 0x7f767806b140 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766800ca60 con 0x7f767806b140 2024-04-24T22:59:31.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766800ce10 con 0x7f767806b140 2024-04-24T22:59:31.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767815b3e0 con 0x7f767806b140 2024-04-24T22:59:31.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767815b9a0 con 0x7f767806b140 2024-04-24T22:59:31.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f766801a070 con 0x7f767806b140 2024-04-24T22:59:31.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.754+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f766801c890 con 0x7f767806b140 2024-04-24T22:59:31.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.755+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767804f500 con 0x7f767806b140 2024-04-24T22:59:31.761 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.758+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f766801ca90 con 0x7f767806b140 2024-04-24T22:59:31.838 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:31.836+0000 7f5b0aa16040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T22:59:31.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.837+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "238828a7-6d52-413e-9bee-f2a9a1094639", "id": 1} v 0) -- 0x7f767806e490 con 0x7f767806b140 2024-04-24T22:59:31.847 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.845+0000 7f766f400640 1 -- 172.21.15.203:0/3279452338 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "238828a7-6d52-413e-9bee-f2a9a1094639", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f766801cd40 con 0x7f767806b140 2024-04-24T22:59:31.848 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.846+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 msgr2=0x7f7678148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.846+0000 7f767ca00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f766800e9d0 tx=0x7f766800ee90 comp rx=0 tx=0).stop 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 shutdown_connections 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f767815e3a0 0x7f767815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76780afd20 0x7f767814b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 --2- 172.21.15.203:0/3279452338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f767806b140 0x7f7678148de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 >> 172.21.15.203:0/3279452338 conn(0x7f76780cd490 msgr2=0x7f767806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 shutdown_connections 2024-04-24T22:59:31.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:31.847+0000 7f767ca00640 1 -- 172.21.15.203:0/3279452338 wait complete. 2024-04-24T22:59:31.866 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 4a942edf-7466-4679-860b-618c48d5e5a8 2 2024-04-24T22:59:31.894 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:31.891+0000 7f5b0aa16040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T22:59:32.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.040+0000 7f00f3e00640 1 Processor -- start 2024-04-24T22:59:32.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.040+0000 7f00f3e00640 1 -- start start 2024-04-24T22:59:32.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.041+0000 7f00f3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 0x7f00f40cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f00f40d22c0 0x7f00f40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f00f40d2c50 con 0x7f00f40d48e0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f00f415e4d0 con 0x7f00f40d22c0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f00f40cede0 con 0x7f00f415e0f0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56824/0 (socket says 172.21.15.203:56824) 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 -- 172.21.15.203:0/1173549481 learned_addr learned my addr 172.21.15.203:0/1173549481 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f3400640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.203:3300/0 conn(0x7f00f40d22c0 0x7f00f40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2000640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 0x7f00f40cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 -- 172.21.15.203:0/1173549481 >> v2:172.21.15.203:3300/0 conn(0x7f00f40d22c0 msgr2=0x7f00f40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.203:3300/0 conn(0x7f00f40d22c0 0x7f00f40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 -- 172.21.15.203:0/1173549481 >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 msgr2=0x7f00f40cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 0x7f00f40cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2a00640 1 -- 172.21.15.203:0/1173549481 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f40cf0c0 con 0x7f00f415e0f0 2024-04-24T22:59:32.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.042+0000 7f00f2000640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 0x7f00f40cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.043+0000 7f00f2a00640 1 --2- 172.21.15.203:0/1173549481 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00f408e1b0 tx=0x7f00e402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd39fc2d5ed0fcf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.044+0000 7f00f1600640 1 -- 172.21.15.203:0/1173549481 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4036070 con 0x7f00f415e0f0 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.044+0000 7f00f1600640 1 -- 172.21.15.203:0/1173549481 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e4031600 con 0x7f00f415e0f0 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.044+0000 7f00f1600640 1 -- 172.21.15.203:0/1173549481 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e40319d0 con 0x7f00f415e0f0 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 -- 172.21.15.203:0/1173549481 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 msgr2=0x7f00f40d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1173549481 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00f408e1b0 tx=0x7f00e402a6f0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 -- 172.21.15.203:0/1173549481 shutdown_connections 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.146:3300/0 conn(0x7f00f40d48e0 0x7f00f40cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1173549481 >> v2:172.21.15.203:3300/0 conn(0x7f00f40d22c0 0x7f00f40d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1173549481 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f415e0f0 0x7f00f40d0f70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 -- 172.21.15.203:0/1173549481 >> 172.21.15.203:0/1173549481 conn(0x7f00f40d3ce0 msgr2=0x7f00f40d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 -- 172.21.15.203:0/1173549481 shutdown_connections 2024-04-24T22:59:32.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.045+0000 7f00f3e00640 1 -- 172.21.15.203:0/1173549481 wait complete. 2024-04-24T22:59:32.050 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.048+0000 7f00f3e00640 1 Processor -- start 2024-04-24T22:59:32.050 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.048+0000 7f00f3e00640 1 -- start start 2024-04-24T22:59:32.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f40d22c0 0x7f00f4157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00f415e0f0 0x7f00f40b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40cead0 con 0x7f00f40d22c0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40cf680 con 0x7f00f415e0f0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.049+0000 7f00f3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f00f40d14b0 con 0x7f00f40d48e0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f3400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00f415e0f0 0x7f00f40b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56834/0 (socket says 172.21.15.203:56834) 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 -- 172.21.15.203:0/1918391166 learned_addr learned my addr 172.21.15.203:0/1918391166 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2a00640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f40d22c0 0x7f00f4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 -- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00f415e0f0 msgr2=0x7f00f40b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00f415e0f0 0x7f00f40b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 -- 172.21.15.203:0/1918391166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f40d22c0 msgr2=0x7f00f4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f40d22c0 0x7f00f4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 -- 172.21.15.203:0/1918391166 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f40c8e30 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.050+0000 7f00f2000640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c7f0 tx=0x7f00e000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0004220 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00043c0 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0005bb0 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f40c9110 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f40c96d0 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00e00063c0 con 0x7f00f40d48e0 2024-04-24T22:59:32.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.051+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f00e0007a40 con 0x7f00f40d48e0 2024-04-24T22:59:32.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.052+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f404f500 con 0x7f00f40d48e0 2024-04-24T22:59:32.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.054+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f00e001e020 con 0x7f00f40d48e0 2024-04-24T22:59:32.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.133+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4a942edf-7466-4679-860b-618c48d5e5a8", "id": 2} v 0) -- 0x7f00f40d20a0 con 0x7f00f40d48e0 2024-04-24T22:59:32.143 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.141+0000 7f00eaa00640 1 -- 172.21.15.203:0/1918391166 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a942edf-7466-4679-860b-618c48d5e5a8", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f00e0015030 con 0x7f00f40d48e0 2024-04-24T22:59:32.143 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-04-24T22:59:32.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 msgr2=0x7f00f40c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c7f0 tx=0x7f00e000ccb0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 shutdown_connections 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00f415e0f0 0x7f00f40b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00f40d48e0 0x7f00f40c9ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 --2- 172.21.15.203:0/1918391166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f40d22c0 0x7f00f4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 >> 172.21.15.203:0/1918391166 conn(0x7f00f40d3ce0 msgr2=0x7f00f40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 shutdown_connections 2024-04-24T22:59:32.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.142+0000 7f00f3e00640 1 -- 172.21.15.203:0/1918391166 wait complete. 2024-04-24T22:59:32.161 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 78236845-93e8-4d5f-8e17-88f4809d9dbf 3 2024-04-24T22:59:32.212 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.210+0000 7f5b73ddc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T22:59:32.322 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.320+0000 7f5b73ddc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:32.341 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.339+0000 7f0a3d200640 1 Processor -- start 2024-04-24T22:59:32.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.339+0000 7f0a3d200640 1 -- start start 2024-04-24T22:59:32.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a3d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.343 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a3d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 0x7f0a3806b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a3d200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3806ba60 con 0x7f0a3806fef0 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a3d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0a380ccf70 con 0x7f0a3815d1d0 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a3d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3815c6f0 con 0x7f0a3806b140 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a37400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a2fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 0x7f0a3806b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a37400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56850/0 (socket says 172.21.15.203:56850) 2024-04-24T22:59:32.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.341+0000 7f0a37400640 1 -- 172.21.15.203:0/4273234651 learned_addr learned my addr 172.21.15.203:0/4273234651 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.342+0000 7f0a37400640 1 -- 172.21.15.203:0/4273234651 >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 msgr2=0x7f0a3806b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.342+0000 7f0a37400640 1 --2- 172.21.15.203:0/4273234651 >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 0x7f0a3806b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.342+0000 7f0a37400640 1 -- 172.21.15.203:0/4273234651 >> v1:172.21.15.146:6789/0 conn(0x7f0a3806fef0 legacy=0x7f0a3815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.342+0000 7f0a37400640 1 -- 172.21.15.203:0/4273234651 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3815c9d0 con 0x7f0a3806b140 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.342+0000 7f0a2fe00640 1 --2- 172.21.15.203:0/4273234651 >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 0x7f0a3806b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:32.345 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.343+0000 7f0a37400640 1 --2- 172.21.15.203:0/4273234651 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009870 tx=0x7f0a2802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbbf95e9ef1b7520 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.343+0000 7f0a36a00640 1 -- 172.21.15.203:0/4273234651 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037070 con 0x7f0a3806b140 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.343+0000 7f0a36a00640 1 -- 172.21.15.203:0/4273234651 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28032440 con 0x7f0a3806b140 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.343+0000 7f0a36a00640 1 -- 172.21.15.203:0/4273234651 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28032810 con 0x7f0a3806b140 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 -- 172.21.15.203:0/4273234651 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 msgr2=0x7f0a380cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 --2- 172.21.15.203:0/4273234651 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009870 tx=0x7f0a2802a200 comp rx=0 tx=0).stop 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 -- 172.21.15.203:0/4273234651 shutdown_connections 2024-04-24T22:59:32.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 --2- 172.21.15.203:0/4273234651 >> v2:172.21.15.203:3300/0 conn(0x7f0a3815d1d0 0x7f0a3806b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 --2- 172.21.15.203:0/4273234651 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380cc940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 -- 172.21.15.203:0/4273234651 >> 172.21.15.203:0/4273234651 conn(0x7f0a380d0a10 msgr2=0x7f0a380d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 -- 172.21.15.203:0/4273234651 shutdown_connections 2024-04-24T22:59:32.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.344+0000 7f0a3d200640 1 -- 172.21.15.203:0/4273234651 wait complete. 2024-04-24T22:59:32.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.346+0000 7f0a3d200640 1 Processor -- start 2024-04-24T22:59:32.348 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.346+0000 7f0a3d200640 1 -- start start 2024-04-24T22:59:32.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3815d1d0 0x7f0a380c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380b00a0 con 0x7f0a3815d1d0 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380d1730 con 0x7f0a3806fef0 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a3d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380b0220 con 0x7f0a3806b140 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a37400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53352/0 (socket says 172.21.15.203:53352) 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 -- 172.21.15.203:0/416934418 learned_addr learned my addr 172.21.15.203:0/416934418 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a37e00640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3815d1d0 0x7f0a380c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 -- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 msgr2=0x7f0a380c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 -- 172.21.15.203:0/416934418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3815d1d0 msgr2=0x7f0a380c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3815d1d0 0x7f0a380c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a2fe00640 1 -- 172.21.15.203:0/416934418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380c7fc0 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.347+0000 7f0a37400640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2fe00640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000e960 tx=0x7f0a2000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20017070 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2000ca00 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a381f43d0 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000cdd0 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a380c5ab0 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a2001a070 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.348+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0a20009400 con 0x7f0a3806fef0 2024-04-24T22:59:32.352 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.349+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3804f500 con 0x7f0a3806fef0 2024-04-24T22:59:32.353 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.352+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0a20013470 con 0x7f0a3806fef0 2024-04-24T22:59:32.377 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.376+0000 7f5b73ddc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T22:59:32.435 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.433+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "78236845-93e8-4d5f-8e17-88f4809d9dbf", "id": 3} v 0) -- 0x7f0a380c4320 con 0x7f0a3806fef0 2024-04-24T22:59:32.441 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.439+0000 7f0a2f400640 1 -- 172.21.15.203:0/416934418 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78236845-93e8-4d5f-8e17-88f4809d9dbf", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0a200136d0 con 0x7f0a3806fef0 2024-04-24T22:59:32.442 INFO:teuthology.orchestra.run.smithi203.stdout:3 2024-04-24T22:59:32.443 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 msgr2=0x7f0a380ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.443 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000e960 tx=0x7f0a2000ee20 comp rx=0 tx=0).stop 2024-04-24T22:59:32.443 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 shutdown_connections 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3815d1d0 0x7f0a380c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a3806fef0 0x7f0a380ae740 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 --2- 172.21.15.203:0/416934418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a3806b140 0x7f0a380c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 >> 172.21.15.203:0/416934418 conn(0x7f0a380d0a10 msgr2=0x7f0a3815de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 shutdown_connections 2024-04-24T22:59:32.444 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.441+0000 7f0a3d200640 1 -- 172.21.15.203:0/416934418 wait complete. 2024-04-24T22:59:32.459 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new f9ff459d-61ed-4c46-9db2-7dc0eb39d077 4 2024-04-24T22:59:32.582 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.580+0000 7f5b73ddc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T22:59:32.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.643+0000 7f4011a00640 1 Processor -- start 2024-04-24T22:59:32.645 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.643+0000 7f4011a00640 1 -- start start 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4011a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f400c15e0f0 0x7f400c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4011a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 0x7f400c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4011a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f400c15e4d0 con 0x7f400c0d22c0 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4011a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f400c0cede0 con 0x7f400c15e0f0 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4011a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f400c0cf0c0 con 0x7f400c0d48e0 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.644+0000 7f4003400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 0x7f400c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4011000640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f400c0d22c0 0x7f400c0b30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:50350/0 (socket says 172.21.15.203:50350) 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4011000640 1 -- 172.21.15.203:0/2776497577 learned_addr learned my addr 172.21.15.203:0/2776497577 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-24T22:59:32.647 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f400be00640 1 --2- 172.21.15.203:0/2776497577 >> v2:172.21.15.146:3300/0 conn(0x7f400c15e0f0 0x7f400c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.648 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4003400640 1 -- 172.21.15.203:0/2776497577 >> v2:172.21.15.146:3300/0 conn(0x7f400c15e0f0 msgr2=0x7f400c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.648 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4003400640 1 --2- 172.21.15.203:0/2776497577 >> v2:172.21.15.146:3300/0 conn(0x7f400c15e0f0 0x7f400c0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.648 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4003400640 1 -- 172.21.15.203:0/2776497577 >> v1:172.21.15.203:6789/0 conn(0x7f400c0d22c0 legacy=0x7f400c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.648 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f400b400640 1 -- 172.21.15.203:0/2776497577 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995816994 0 0) 0x7f400c15e4d0 con 0x7f400c0d22c0 2024-04-24T22:59:32.648 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.645+0000 7f4003400640 1 -- 172.21.15.203:0/2776497577 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c0cf3a0 con 0x7f400c0d48e0 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.646+0000 7f4003400640 1 --2- 172.21.15.203:0/2776497577 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 0x7f400c0cfba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009790 tx=0x7f3ff402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339a2492cb4683b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.646+0000 7f400b400640 1 -- 172.21.15.203:0/2776497577 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4037070 con 0x7f400c0d48e0 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.646+0000 7f400b400640 1 -- 172.21.15.203:0/2776497577 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff4032440 con 0x7f400c0d48e0 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.646+0000 7f400b400640 1 -- 172.21.15.203:0/2776497577 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4032810 con 0x7f400c0d48e0 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 -- 172.21.15.203:0/2776497577 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 msgr2=0x7f400c0cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 --2- 172.21.15.203:0/2776497577 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 0x7f400c0cfba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009790 tx=0x7f3ff402a180 comp rx=0 tx=0).stop 2024-04-24T22:59:32.649 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 -- 172.21.15.203:0/2776497577 shutdown_connections 2024-04-24T22:59:32.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 --2- 172.21.15.203:0/2776497577 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d48e0 0x7f400c0cfba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 --2- 172.21.15.203:0/2776497577 >> v2:172.21.15.146:3300/0 conn(0x7f400c15e0f0 0x7f400c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 -- 172.21.15.203:0/2776497577 >> 172.21.15.203:0/2776497577 conn(0x7f400c0d3ce0 msgr2=0x7f400c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 -- 172.21.15.203:0/2776497577 shutdown_connections 2024-04-24T22:59:32.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.647+0000 7f4011a00640 1 -- 172.21.15.203:0/2776497577 wait complete. 2024-04-24T22:59:32.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.649+0000 7f4011a00640 1 Processor -- start 2024-04-24T22:59:32.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.649+0000 7f4011a00640 1 -- start start 2024-04-24T22:59:32.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 0x7f400c0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f400c15e0f0 0x7f400c0b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f400c0d14b0 con 0x7f400c0d48e0 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f400c0cead0 con 0x7f400c15e0f0 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f400c0d00e0 con 0x7f400c0d22c0 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56880/0 (socket says 172.21.15.203:56880) 2024-04-24T22:59:32.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 -- 172.21.15.203:0/2572624216 learned_addr learned my addr 172.21.15.203:0/2572624216 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4011000640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f400c15e0f0 0x7f400c0b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4003400640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 0x7f400c0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 -- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f400c15e0f0 msgr2=0x7f400c0b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f400c15e0f0 0x7f400c0b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 -- 172.21.15.203:0/2572624216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 msgr2=0x7f400c0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 0x7f400c0cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f400be00640 1 -- 172.21.15.203:0/2572624216 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c0c8380 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.650+0000 7f4003400640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 0x7f400c0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f400be00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007f20 tx=0x7f3ffc00e570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc014620 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc019070 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400c0b90e0 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc014a00 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c0b96a0 con 0x7f400c0d22c0 2024-04-24T22:59:32.655 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ffc014ba0 con 0x7f400c0d22c0 2024-04-24T22:59:32.656 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.652+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3ffc01e970 con 0x7f400c0d22c0 2024-04-24T22:59:32.656 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.651+0000 7f5b73ddc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T22:59:32.656 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.652+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400c04f500 con 0x7f400c0d22c0 2024-04-24T22:59:32.658 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.656+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3ffc01e460 con 0x7f400c0d22c0 2024-04-24T22:59:32.719 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.717+0000 7f5b73ddc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T22:59:32.738 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.735+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f9ff459d-61ed-4c46-9db2-7dc0eb39d077", "id": 4} v 0) -- 0x7f400c0d20a0 con 0x7f400c0d22c0 2024-04-24T22:59:32.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.742+0000 7f4008c00640 1 -- 172.21.15.203:0/2572624216 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9ff459d-61ed-4c46-9db2-7dc0eb39d077", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3ffc01e640 con 0x7f400c0d22c0 2024-04-24T22:59:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:4 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 msgr2=0x7f400c159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007f20 tx=0x7f3ffc00e570 comp rx=0 tx=0).stop 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 shutdown_connections 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f400c15e0f0 0x7f400c0b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0d48e0 0x7f400c0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 --2- 172.21.15.203:0/2572624216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f400c0d22c0 0x7f400c159fb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 >> 172.21.15.203:0/2572624216 conn(0x7f400c0d3ce0 msgr2=0x7f400c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 shutdown_connections 2024-04-24T22:59:32.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.744+0000 7f4011a00640 1 -- 172.21.15.203:0/2572624216 wait complete. 2024-04-24T22:59:32.762 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 3ac8d24a-a4bf-48ba-a6ae-38e487d56c98 5 2024-04-24T22:59:32.858 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:32.855+0000 7f5b73ddc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:32.888 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:32.886+0000 7f5b0aa16040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T22:59:32.938 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.936+0000 7efc6ea00640 1 Processor -- start 2024-04-24T22:59:32.938 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.936+0000 7efc6ea00640 1 -- start start 2024-04-24T22:59:32.940 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc680b4160 0x7efc680d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.940 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.940 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6ea00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc680b4bd0 con 0x7efc680c77d0 2024-04-24T22:59:32.940 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6ea00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7efc680cfcd0 con 0x7efc680b4160 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efc680d4bb0 con 0x7efc680b4df0 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56888/0 (socket says 172.21.15.203:56888) 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.938+0000 7efc6cc00640 1 -- 172.21.15.203:0/242903036 learned_addr learned my addr 172.21.15.203:0/242903036 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.939+0000 7efc6d600640 1 --2- 172.21.15.203:0/242903036 >> v2:172.21.15.146:3300/0 conn(0x7efc680b4160 0x7efc680d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.939+0000 7efc6cc00640 1 -- 172.21.15.203:0/242903036 >> v2:172.21.15.146:3300/0 conn(0x7efc680b4160 msgr2=0x7efc680d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.939+0000 7efc6cc00640 1 --2- 172.21.15.203:0/242903036 >> v2:172.21.15.146:3300/0 conn(0x7efc680b4160 0x7efc680d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.941 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.939+0000 7efc6cc00640 1 -- 172.21.15.203:0/242903036 >> v1:172.21.15.146:6789/0 conn(0x7efc680c77d0 legacy=0x7efc680c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:32.942 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.939+0000 7efc6cc00640 1 -- 172.21.15.203:0/242903036 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc680d48d0 con 0x7efc680b4df0 2024-04-24T22:59:32.942 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.940+0000 7efc6cc00640 1 --2- 172.21.15.203:0/242903036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efc54009870 tx=0x7efc5402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb7a0822e39aaf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.942 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.940+0000 7efc67e00640 1 -- 172.21.15.203:0/242903036 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54037070 con 0x7efc680b4df0 2024-04-24T22:59:32.942 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.940+0000 7efc67e00640 1 -- 172.21.15.203:0/242903036 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5402ae10 con 0x7efc680b4df0 2024-04-24T22:59:32.942 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.940+0000 7efc67e00640 1 -- 172.21.15.203:0/242903036 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54032660 con 0x7efc680b4df0 2024-04-24T22:59:32.943 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 -- 172.21.15.203:0/242903036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 msgr2=0x7efc680d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.943 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 --2- 172.21.15.203:0/242903036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efc54009870 tx=0x7efc5402a100 comp rx=0 tx=0).stop 2024-04-24T22:59:32.943 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 -- 172.21.15.203:0/242903036 shutdown_connections 2024-04-24T22:59:32.943 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 --2- 172.21.15.203:0/242903036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680b4df0 0x7efc680d08f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.944 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 --2- 172.21.15.203:0/242903036 >> v2:172.21.15.146:3300/0 conn(0x7efc680b4160 0x7efc680d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.944 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 -- 172.21.15.203:0/242903036 >> 172.21.15.203:0/242903036 conn(0x7efc680d3c80 msgr2=0x7efc680d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:32.944 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 -- 172.21.15.203:0/242903036 shutdown_connections 2024-04-24T22:59:32.944 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.941+0000 7efc6ea00640 1 -- 172.21.15.203:0/242903036 wait complete. 2024-04-24T22:59:32.946 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.944+0000 7efc6ea00640 1 Processor -- start 2024-04-24T22:59:32.946 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.944+0000 7efc6ea00640 1 -- start start 2024-04-24T22:59:32.949 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.945+0000 7efc6ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc680b4160 0x7efc680ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.949 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 0x7efc680b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.949 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 0x7efc68150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efc680b48a0 con 0x7efc680b4160 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efc680cf7b0 con 0x7efc680b4df0 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efc680b4540 con 0x7efc680c77d0 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 0x7efc680b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 0x7efc68150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 0x7efc680b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53370/0 (socket says 172.21.15.203:53370) 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6cc00640 1 -- 172.21.15.203:0/4248761740 learned_addr learned my addr 172.21.15.203:0/4248761740 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6d600640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc680b4160 0x7efc680ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 -- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 msgr2=0x7efc680b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 0x7efc680b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 -- 172.21.15.203:0/4248761740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc680b4160 msgr2=0x7efc680ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:32.950 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc680b4160 0x7efc680ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.946+0000 7efc6e000640 1 -- 172.21.15.203:0/4248761740 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc680b72a0 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc6e000640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 0x7efc68150ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc6000be30 tx=0x7efc6000bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60019070 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60014440 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc680b7580 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60014830 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc680b8040 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc6001c070 con 0x7efc680c77d0 2024-04-24T22:59:32.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.947+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7efc60004690 con 0x7efc680c77d0 2024-04-24T22:59:32.952 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.948+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6804f500 con 0x7efc680c77d0 2024-04-24T22:59:32.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:32.951+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efc60003970 con 0x7efc680c77d0 2024-04-24T22:59:33.001 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:32.999+0000 7f5b0aa16040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:33.031 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.029+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ac8d24a-a4bf-48ba-a6ae-38e487d56c98", "id": 5} v 0) -- 0x7efc680c8d40 con 0x7efc680c77d0 2024-04-24T22:59:33.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.037+0000 7efc65600640 1 -- 172.21.15.203:0/4248761740 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ac8d24a-a4bf-48ba-a6ae-38e487d56c98", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7efc60003c20 con 0x7efc680c77d0 2024-04-24T22:59:33.039 INFO:teuthology.orchestra.run.smithi203.stdout:5 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 msgr2=0x7efc68150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 0x7efc68150ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc6000be30 tx=0x7efc6000bf20 comp rx=0 tx=0).stop 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 shutdown_connections 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efc680c77d0 0x7efc68150ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc680b4df0 0x7efc680b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 --2- 172.21.15.203:0/4248761740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc680b4160 0x7efc680ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.038+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 >> 172.21.15.203:0/4248761740 conn(0x7efc680d3c80 msgr2=0x7efc6806bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.039+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 shutdown_connections 2024-04-24T22:59:33.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.039+0000 7efc6ea00640 1 -- 172.21.15.203:0/4248761740 wait complete. 2024-04-24T22:59:33.051 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:33.049+0000 7f5b0aa16040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T22:59:33.058 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new d82169d1-4d53-4a51-bcc6-8fafa822b739 6 2024-04-24T22:59:33.241 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:33.239+0000 7f5b0aa16040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T22:59:33.244 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.242+0000 7f62a3e00640 1 Processor -- start 2024-04-24T22:59:33.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.243+0000 7f62a3e00640 1 -- start start 2024-04-24T22:59:33.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f62a40b4160 0x7f62a40d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62a40b4df0 0x7f62a40d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f62a40cfcd0 con 0x7f62a40b4df0 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f62a40b4bd0 con 0x7f62a40b4160 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f62a40d4bb0 con 0x7f62a40c77d0 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a2a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f62a40b4160 0x7f62a40d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f62a40b4160 0x7f62a40d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53382/0 (socket says 172.21.15.203:53382) 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 -- 172.21.15.203:0/2028242148 learned_addr learned my addr 172.21.15.203:0/2028242148 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.244+0000 7f62a3400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2000640 1 --2- 172.21.15.203:0/2028242148 >> v2:172.21.15.146:3300/0 conn(0x7f62a40b4df0 0x7f62a40d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 -- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 msgr2=0x7f62a40c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a40c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 -- 172.21.15.203:0/2028242148 >> v2:172.21.15.146:3300/0 conn(0x7f62a40b4df0 msgr2=0x7f62a40d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 --2- 172.21.15.203:0/2028242148 >> v2:172.21.15.146:3300/0 conn(0x7f62a40b4df0 0x7f62a40d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a2a00640 1 -- 172.21.15.203:0/2028242148 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40d48d0 con 0x7f62a40b4160 2024-04-24T22:59:33.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.245+0000 7f62a3400640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.246+0000 7f62a2a00640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a40d03b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62a408c530 tx=0x7f629402a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a62cd7eefb822e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.246+0000 7f62a1600640 1 -- 172.21.15.203:0/2028242148 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294037070 con 0x7f62a40b4160 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.246+0000 7f62a1600640 1 -- 172.21.15.203:0/2028242148 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629402ae00 con 0x7f62a40b4160 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.246+0000 7f62a1600640 1 -- 172.21.15.203:0/2028242148 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294032660 con 0x7f62a40b4160 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 -- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 msgr2=0x7f62a40d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a40d03b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62a408c530 tx=0x7f629402a0b0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 -- 172.21.15.203:0/2028242148 shutdown_connections 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 --2- 172.21.15.203:0/2028242148 >> v2:172.21.15.146:3300/0 conn(0x7f62a40b4df0 0x7f62a40d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 --2- 172.21.15.203:0/2028242148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a40d03b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 -- 172.21.15.203:0/2028242148 >> 172.21.15.203:0/2028242148 conn(0x7f62a40d3c80 msgr2=0x7f62a40d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 -- 172.21.15.203:0/2028242148 shutdown_connections 2024-04-24T22:59:33.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.247+0000 7f62a3e00640 1 -- 172.21.15.203:0/2028242148 wait complete. 2024-04-24T22:59:33.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.250+0000 7f62a3e00640 1 Processor -- start 2024-04-24T22:59:33.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.250+0000 7f62a3e00640 1 -- start start 2024-04-24T22:59:33.255 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.255 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a40b4df0 0x7f62a40b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a415d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40b48a0 con 0x7f62a40b4df0 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40cf7b0 con 0x7f62a40b4160 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f62a40b4540 con 0x7f62a40c77d0 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53392/0 (socket says 172.21.15.203:53392) 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 -- 172.21.15.203:0/896419220 learned_addr learned my addr 172.21.15.203:0/896419220 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3400640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2000640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a40b4df0 0x7f62a40b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 -- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 msgr2=0x7f62a415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 -- 172.21.15.203:0/896419220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a40b4df0 msgr2=0x7f62a40b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a40b4df0 0x7f62a40b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.256 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a2a00640 1 -- 172.21.15.203:0/896419220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40b72a0 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.252+0000 7f62a3400640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f62a2a00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f629402a0f0 tx=0x7f62940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294041070 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629403c460 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294037040 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a414cf60 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.253+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a414d520 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.254+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f629403a070 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.254+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f629402ae00 con 0x7f62a40b4160 2024-04-24T22:59:33.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.254+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a404f500 con 0x7f62a40b4160 2024-04-24T22:59:33.258 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.257+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f629403c850 con 0x7f62a40b4160 2024-04-24T22:59:33.298 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:33.296+0000 7f5b0aa16040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T22:59:33.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.336+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d82169d1-4d53-4a51-bcc6-8fafa822b739", "id": 6} v 0) -- 0x7f62a408dd50 con 0x7f62a40b4160 2024-04-24T22:59:33.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.344+0000 7f629aa00640 1 -- 172.21.15.203:0/896419220 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d82169d1-4d53-4a51-bcc6-8fafa822b739", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f629403ca30 con 0x7f62a40b4160 2024-04-24T22:59:33.347 INFO:teuthology.orchestra.run.smithi203.stdout:6 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 msgr2=0x7f62a4149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f629402a0f0 tx=0x7f62940046c0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 shutdown_connections 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62a40c77d0 0x7f62a415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a40b4df0 0x7f62a40b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.350 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 --2- 172.21.15.203:0/896419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62a40b4160 0x7f62a4149170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 >> 172.21.15.203:0/896419220 conn(0x7f62a40d3c80 msgr2=0x7f62a40ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 shutdown_connections 2024-04-24T22:59:33.351 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.346+0000 7f62a3e00640 1 -- 172.21.15.203:0/896419220 wait complete. 2024-04-24T22:59:33.352 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:33.350+0000 7f5b73ddc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T22:59:33.360 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:33.358+0000 7f5b0aa16040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T22:59:33.368 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new ff36822a-47f2-4e33-85ed-9c36c6db612b 7 2024-04-24T22:59:33.488 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:33.486+0000 7f5b0aa16040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:33.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.545+0000 7f22d3200640 1 Processor -- start 2024-04-24T22:59:33.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.545+0000 7f22d3200640 1 -- start start 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22cc0affc0 0x7f22cc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc0cdfb0 con 0x7f22cc15aec0 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc15b2a0 con 0x7f22cc072000 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc0cec40 con 0x7f22cc0affc0 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d1400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f22cc072000 0x7f22cc06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:50354/0 (socket says 172.21.15.203:50354) 2024-04-24T22:59:33.549 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d1400640 1 -- 172.21.15.203:0/2741343354 learned_addr learned my addr 172.21.15.203:0/2741343354 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-24T22:59:33.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.547+0000 7f22d2800640 1 --2- 172.21.15.203:0/2741343354 >> v2:172.21.15.146:3300/0 conn(0x7f22cc0affc0 0x7f22cc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464763046 0 0) 0x7f22cc15b2a0 con 0x7f22cc072000 2024-04-24T22:59:33.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b4003520 con 0x7f22cc072000 2024-04-24T22:59:33.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205926888 0 0) 0x7f22b4003520 con 0x7f22cc072000 2024-04-24T22:59:33.551 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 >> v2:172.21.15.146:3300/0 conn(0x7f22cc0affc0 msgr2=0x7f22cc06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 --2- 172.21.15.203:0/2741343354 >> v2:172.21.15.146:3300/0 conn(0x7f22cc0affc0 0x7f22cc06e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 >> v1:172.21.15.146:6789/0 conn(0x7f22cc15aec0 legacy=0x7f22cc0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc0ce270 con 0x7f22cc072000 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f22bc001670 con 0x7f22cc072000 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 >> v1:172.21.15.203:6789/0 conn(0x7f22cc072000 legacy=0x7f22cc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b40039b0 0x7f22b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 0x7f22b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b40051c0 0x7f22b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0cec40 con 0x7f22b40051c0 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22b400c060 con 0x7f22b40039b0 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f22b400c260 con 0x7f22b4004800 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d1400640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 0x7f22b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.548+0000 7f22d1e00640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b40039b0 0x7f22b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d2800640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b40051c0 0x7f22b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1400640 1 -- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b40039b0 msgr2=0x7f22b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1400640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b40039b0 0x7f22b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1400640 1 -- 172.21.15.203:0/2741343354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b40051c0 msgr2=0x7f22b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1400640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b40051c0 0x7f22b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1400640 1 -- 172.21.15.203:0/2741343354 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b4003520 con 0x7f22b4004800 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d2800640 1 -- 172.21.15.203:0/2741343354 reap_dead start 2024-04-24T22:59:33.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.549+0000 7f22d1e00640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b40039b0 0x7f22b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.550+0000 7f22d1400640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 0x7f22b4004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c210 tx=0x7f22b4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7526d9d73eb5ff35 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.550+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc007d30 con 0x7f22b4004800 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.550+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22bc005ad0 con 0x7f22b4004800 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.550+0000 7f22d0a00640 1 -- 172.21.15.203:0/2741343354 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc007070 con 0x7f22b4004800 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 -- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 msgr2=0x7f22b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 0x7f22b4004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c210 tx=0x7f22b4005830 comp rx=0 tx=0).stop 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 -- 172.21.15.203:0/2741343354 shutdown_connections 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 --2- 172.21.15.203:0/2741343354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22b4004800 0x7f22b4004c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 -- 172.21.15.203:0/2741343354 >> 172.21.15.203:0/2741343354 conn(0x7f22cc0cd490 msgr2=0x7f22cc0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 -- 172.21.15.203:0/2741343354 shutdown_connections 2024-04-24T22:59:33.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.551+0000 7f22d3200640 1 -- 172.21.15.203:0/2741343354 wait complete. 2024-04-24T22:59:33.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.553+0000 7f22d3200640 1 Processor -- start 2024-04-24T22:59:33.556 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.553+0000 7f22d3200640 1 -- start start 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 0x7f22cc1f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 0x7f22cc1eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0afa70 con 0x7f22cc06bce0 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0ccab0 con 0x7f22b4004800 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc0afbf0 con 0x7f22cc0cfee0 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 0x7f22cc1f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d1e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 0x7f22cc1f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:56938/0 (socket says 172.21.15.203:56938) 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d1e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:53416/0 (socket says 172.21.15.203:53416) 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d1400640 1 -- 172.21.15.203:0/2483989776 learned_addr learned my addr 172.21.15.203:0/2483989776 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.554+0000 7f22d2800640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 0x7f22cc1eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 -- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 msgr2=0x7f22cc1f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 0x7f22cc1f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 -- 172.21.15.203:0/2483989776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 msgr2=0x7f22cc1eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 0x7f22cc1eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 -- 172.21.15.203:0/2483989776 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc1f3ae0 con 0x7f22b4004800 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d2800640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 0x7f22cc1eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d1e00640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22c000f770 tx=0x7f22c000fc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c001a070 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c000fe80 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0001370 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc0c7c80 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc0c8240 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.555+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22c001d070 con 0x7f22b4004800 2024-04-24T22:59:33.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.556+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f22c0006be0 con 0x7f22b4004800 2024-04-24T22:59:33.561 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.557+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22cc04f500 con 0x7f22b4004800 2024-04-24T22:59:33.561 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.559+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f22c0024020 con 0x7f22b4004800 2024-04-24T22:59:33.640 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.638+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff36822a-47f2-4e33-85ed-9c36c6db612b", "id": 7} v 0) -- 0x7f22cc15a6c0 con 0x7f22b4004800 2024-04-24T22:59:33.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.649+0000 7f22c6000640 1 -- 172.21.15.203:0/2483989776 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff36822a-47f2-4e33-85ed-9c36c6db612b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f22cc1f3ae0 con 0x7f22b4004800 2024-04-24T22:59:33.651 INFO:teuthology.orchestra.run.smithi203.stdout:7 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 msgr2=0x7f22cc1449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22c000f770 tx=0x7f22c000fc30 comp rx=0 tx=0).stop 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 shutdown_connections 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22cc06bce0 0x7f22cc1eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22cc0cfee0 0x7f22cc1f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 --2- 172.21.15.203:0/2483989776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22b4004800 0x7f22cc1449e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 >> 172.21.15.203:0/2483989776 conn(0x7f22cc0cd490 msgr2=0x7f22cc0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 shutdown_connections 2024-04-24T22:59:33.654 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T22:59:33.650+0000 7f22d3200640 1 -- 172.21.15.203:0/2483989776 wait complete. 2024-04-24T22:59:33.666 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:33.664+0000 7f5b73ddc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T22:59:33.669 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T22:59:33.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T22:59:33.677 INFO:tasks.ceph.osd.0:Started 2024-04-24T22:59:33.677 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T22:59:33.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T22:59:33.684 INFO:tasks.ceph.osd.1:Started 2024-04-24T22:59:33.684 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T22:59:33.685 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T22:59:33.692 INFO:tasks.ceph.osd.2:Started 2024-04-24T22:59:33.692 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T22:59:33.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T22:59:33.698 INFO:tasks.ceph.osd.3:Started 2024-04-24T22:59:33.699 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T22:59:33.699 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T22:59:33.707 INFO:tasks.ceph.osd.4:Started 2024-04-24T22:59:33.707 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T22:59:33.707 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T22:59:33.714 INFO:tasks.ceph.osd.5:Started 2024-04-24T22:59:33.714 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T22:59:33.715 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T22:59:33.721 INFO:tasks.ceph.osd.6:Started 2024-04-24T22:59:33.721 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T22:59:33.721 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T22:59:33.726 INFO:tasks.ceph.osd.7:Started 2024-04-24T22:59:33.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:33.732 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:33.730+0000 7f5b73ddc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T22:59:33.919 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:33.917+0000 7f5b73ddc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T22:59:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.931+0000 7f3ce1000640 1 Processor -- start 2024-04-24T22:59:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.931+0000 7f3ce1000640 1 -- start start 2024-04-24T22:59:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.932+0000 7f3ce1000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 0x7f3cdc071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.932+0000 7f3ce1000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc158970 con 0x7f3cdc0715f0 2024-04-24T22:59:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.932+0000 7f3ce1000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc070c10 con 0x7f3cdc158590 2024-04-24T22:59:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.932+0000 7f3ce1000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc070ef0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.932+0000 7f3cd9400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3cdc0715f0 0x7f3cdc0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39542/0 (socket says 172.21.15.146:39542) 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cd9400640 1 -- 172.21.15.146:0/594417792 learned_addr learned my addr 172.21.15.146:0/594417792 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cda800640 1 --2- 172.21.15.146:0/594417792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 0x7f3cdc071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87423973 0 0) 0x7f3cdc158970 con 0x7f3cdc0715f0 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cc0003520 con 0x7f3cdc0715f0 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793040990 0 0) 0x7f3cdc070c10 con 0x7f3cdc158590 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cdc158970 con 0x7f3cdc158590 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cda800640 1 -- 172.21.15.146:0/594417792 >> v1:172.21.15.203:6789/0 conn(0x7f3cdc158590 legacy=0x7f3cdc162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cda800640 1 -- 172.21.15.146:0/594417792 >> v1:172.21.15.146:6789/0 conn(0x7f3cdc0715f0 legacy=0x7f3cdc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.933+0000 7f3cda800640 1 -- 172.21.15.146:0/594417792 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc0711d0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.934+0000 7f3cda800640 1 --2- 172.21.15.146:0/594417792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 0x7f3cdc071a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009dc0 tx=0x7f3cd402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04e59e84eab5cde server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.934+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4007740 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd40078e0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3cd8a00640 1 -- 172.21.15.146:0/594417792 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4007cb0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 -- 172.21.15.146:0/594417792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 msgr2=0x7f3cdc071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 --2- 172.21.15.146:0/594417792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 0x7f3cdc071a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009dc0 tx=0x7f3cd402a760 comp rx=0 tx=0).stop 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 -- 172.21.15.146:0/594417792 shutdown_connections 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 --2- 172.21.15.146:0/594417792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0d03a0 0x7f3cdc071a70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 -- 172.21.15.146:0/594417792 >> 172.21.15.146:0/594417792 conn(0x7f3cdc06b320 msgr2=0x7f3cdc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 -- 172.21.15.146:0/594417792 shutdown_connections 2024-04-24T22:59:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.935+0000 7f3ce1000640 1 -- 172.21.15.146:0/594417792 wait complete. 2024-04-24T22:59:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.937+0000 7f3ce1000640 1 Processor -- start 2024-04-24T22:59:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.937+0000 7f3ce1000640 1 -- start start 2024-04-24T22:59:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0715f0 0x7f3cdc0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cdc158590 0x7f3cdc15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc15e4e0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc161f30 con 0x7f3cdc158590 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3ce1000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc15e660 con 0x7f3cdc0715f0 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3cd9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3cd9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60294/0 (socket says 172.21.15.146:60294) 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3cd9400640 1 -- 172.21.15.146:0/1045856596 learned_addr learned my addr 172.21.15.146:0/1045856596 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3cd9e00640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0715f0 0x7f3cdc0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.938+0000 7f3cda800640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cdc158590 0x7f3cdc15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 -- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0715f0 msgr2=0x7f3cdc0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0715f0 0x7f3cdc0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 -- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cdc158590 msgr2=0x7f3cdc15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cdc158590 0x7f3cdc15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 -- 172.21.15.146:0/1045856596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc0b0160 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd9400640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c500 tx=0x7f3cc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8017070 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8005ce0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80072f0 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.939+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc0b0440 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.940+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc0b0a00 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.940+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3cc801a070 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.940+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3cc8007490 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.941+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc068190 con 0x7f3cdc0d03a0 2024-04-24T22:59:33.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:33.946+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3cc8012400 con 0x7f3cdc0d03a0 2024-04-24T22:59:34.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.010+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cdc06de70 con 0x7f3cdc0d03a0 2024-04-24T22:59:34.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.011+0000 7f3cd2000640 1 -- 172.21.15.146:0/1045856596 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3cc80125e0 con 0x7f3cdc0d03a0 2024-04-24T22:59:34.013 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:59:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":10,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:33.641836+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:34.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 msgr2=0x7f3cdc1f3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:34.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c500 tx=0x7f3cc800c9c0 comp rx=0 tx=0).stop 2024-04-24T22:59:34.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 shutdown_connections 2024-04-24T22:59:34.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cdc158590 0x7f3cdc15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:34.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc0d03a0 0x7f3cdc1f3920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:34.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 --2- 172.21.15.146:0/1045856596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cdc0715f0 0x7f3cdc0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:34.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 >> 172.21.15.146:0/1045856596 conn(0x7f3cdc06b320 msgr2=0x7f3cdc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:34.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 shutdown_connections 2024-04-24T22:59:34.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:34.013+0000 7f3ce1000640 1 -- 172.21.15.146:0/1045856596 wait complete. 2024-04-24T22:59:34.018 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.016+0000 7f5b0aa16040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T22:59:34.031 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T22:59:34.031 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T22:59:34.257 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.255+0000 7f5b73ddc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T22:59:34.314 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.312+0000 7f5b73ddc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T22:59:34.316 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.314+0000 7f5b0aa16040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T22:59:34.378 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.376+0000 7f5b0aa16040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T22:59:34.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-04-24T22:59:34.377+0000 7fe4dbd40640 -1 Falling back to public interface 2024-04-24T22:59:34.394 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-24T22:59:34.392+0000 7fc1772e3640 -1 Falling back to public interface 2024-04-24T22:59:34.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-04-24T22:59:34.392+0000 7efdc1a1e640 -1 Falling back to public interface 2024-04-24T22:59:34.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-04-24T22:59:34.393+0000 7f8147029640 -1 Falling back to public interface 2024-04-24T22:59:34.395 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-04-24T22:59:34.394+0000 7f0ac0e13640 -1 Falling back to public interface 2024-04-24T22:59:34.397 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-24T22:59:34.395+0000 7f44aae0d640 -1 Falling back to public interface 2024-04-24T22:59:34.399 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-24T22:59:34.398+0000 7f3fda9c4640 -1 Falling back to public interface 2024-04-24T22:59:34.425 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-24T22:59:34.424+0000 7f678361c640 -1 Falling back to public interface 2024-04-24T22:59:34.505 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.503+0000 7f5b73ddc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T22:59:34.518 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.516+0000 7f5b0aa16040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T22:59:34.672 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.670+0000 7f5b73ddc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T22:59:34.734 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.732+0000 7f5b73ddc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T22:59:34.816 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.814+0000 7f5b73ddc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:34.837 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:34.854 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.852+0000 7f5b0aa16040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T22:59:34.869 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:34.867+0000 7f5b73ddc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T22:59:34.913 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:34.911+0000 7f5b0aa16040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T22:59:34.996 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.994+0000 7f3cd3e00640 1 Processor -- start 2024-04-24T22:59:34.996 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.994+0000 7f3cd3e00640 1 -- start start 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc072cc0 0x7f3ccc0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3ccc070150 0x7f3ccc0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd3e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ccc06e6e0 con 0x7f3ccc0afa60 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd3e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3ccc0705e0 con 0x7f3ccc070150 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc15e610 con 0x7f3ccc072cc0 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f3ccc0afa60 0x7f3ccc0afe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:56854/0 (socket says 172.21.15.146:56854) 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1400640 1 -- 172.21.15.146:0/4171411135 learned_addr learned my addr 172.21.15.146:0/4171411135 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1e00640 1 --2- 172.21.15.146:0/4171411135 >> v2:172.21.15.203:3300/0 conn(0x7f3ccc070150 0x7f3ccc0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:34.999 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd0a00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc072cc0 0x7f3ccc0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:35.000 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3ccbe00640 1 -- 172.21.15.146:0/4171411135 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239057166 0 0) 0x7f3ccc06e6e0 con 0x7f3ccc0afa60 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3ccbe00640 1 -- 172.21.15.146:0/4171411135 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cb4003520 con 0x7f3ccc0afa60 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1e00640 1 -- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc072cc0 msgr2=0x7f3ccc0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1e00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc072cc0 0x7f3ccc0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.997+0000 7f3cd1e00640 1 -- 172.21.15.146:0/4171411135 >> v1:172.21.15.203:6789/0 conn(0x7f3ccc0afa60 legacy=0x7f3ccc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.998+0000 7f3cd1e00640 1 -- 172.21.15.146:0/4171411135 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc06e9c0 con 0x7f3ccc070150 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3cd1e00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc0b4780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009dc0 tx=0x7f3cc402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e023b0410d85edd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3ccbe00640 1 -- 172.21.15.146:0/4171411135 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4007740 con 0x7f3ccc070150 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3ccbe00640 1 -- 172.21.15.146:0/4171411135 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40078e0 con 0x7f3ccc070150 2024-04-24T22:59:35.001 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3ccbe00640 1 -- 172.21.15.146:0/4171411135 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4007cb0 con 0x7f3ccc070150 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3cd3e00640 1 -- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 msgr2=0x7f3ccc0b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:34.999+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc0b4780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009dc0 tx=0x7f3cc402a710 comp rx=0 tx=0).stop 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 -- 172.21.15.146:0/4171411135 shutdown_connections 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc0b4780 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/4171411135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc072cc0 0x7f3ccc0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 -- 172.21.15.146:0/4171411135 >> 172.21.15.146:0/4171411135 conn(0x7f3ccc0d0b60 msgr2=0x7f3ccc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:35.002 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 -- 172.21.15.146:0/4171411135 shutdown_connections 2024-04-24T22:59:35.003 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.000+0000 7f3cd3e00640 1 -- 172.21.15.146:0/4171411135 wait complete. 2024-04-24T22:59:35.003 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.001+0000 7f3cd3e00640 1 Processor -- start 2024-04-24T22:59:35.003 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.001+0000 7f3cd3e00640 1 -- start start 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc0afa60 0x7f3ccc15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc06e450 con 0x7f3ccc072cc0 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc06e170 con 0x7f3ccc070150 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.002+0000 7f3cd3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc0b4cc0 con 0x7f3ccc0afa60 2024-04-24T22:59:35.005 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60302/0 (socket says 172.21.15.146:60302) 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc0afa60 0x7f3ccc15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 -- 172.21.15.146:0/865024195 learned_addr learned my addr 172.21.15.146:0/865024195 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 -- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc0afa60 msgr2=0x7f3ccc15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc0afa60 0x7f3ccc15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 -- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 msgr2=0x7f3ccc1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.003+0000 7f3cd0a00640 1 -- 172.21.15.146:0/865024195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc156a20 con 0x7f3ccc072cc0 2024-04-24T22:59:35.006 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cd0a00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800e9b0 tx=0x7f3cb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:35.007 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8017070 con 0x7f3ccc072cc0 2024-04-24T22:59:35.007 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb800c9a0 con 0x7f3ccc072cc0 2024-04-24T22:59:35.007 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc156d00 con 0x7f3ccc072cc0 2024-04-24T22:59:35.007 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800cd90 con 0x7f3ccc072cc0 2024-04-24T22:59:35.007 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc1575a0 con 0x7f3ccc072cc0 2024-04-24T22:59:35.008 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3cb801a070 con 0x7f3ccc072cc0 2024-04-24T22:59:35.008 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.004+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3cb801cc60 con 0x7f3ccc072cc0 2024-04-24T22:59:35.008 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.005+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc068ac0 con 0x7f3ccc072cc0 2024-04-24T22:59:35.011 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.009+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3cb801c590 con 0x7f3ccc072cc0 2024-04-24T22:59:35.078 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.077+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ccc073f70 con 0x7f3ccc072cc0 2024-04-24T22:59:35.079 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.078+0000 7f3cc9600640 1 -- 172.21.15.146:0/865024195 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3cb801c770 con 0x7f3ccc072cc0 2024-04-24T22:59:35.080 INFO:teuthology.misc.health.smithi146.stdout: 2024-04-24T22:59:35.080 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:33.641836+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 msgr2=0x7f3ccc15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800e9b0 tx=0x7f3cb800ee70 comp rx=0 tx=0).stop 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 shutdown_connections 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3ccc0afa60 0x7f3ccc15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc072cc0 0x7f3ccc15b7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 --2- 172.21.15.146:0/865024195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ccc070150 0x7f3ccc1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 >> 172.21.15.146:0/865024195 conn(0x7f3ccc0d0b60 msgr2=0x7f3ccc0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 shutdown_connections 2024-04-24T22:59:35.081 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:35.079+0000 7f3cd3e00640 1 -- 172.21.15.146:0/865024195 wait complete. 2024-04-24T22:59:35.094 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T22:59:35.106 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:35.104+0000 7f5b0aa16040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T22:59:35.277 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:35.275+0000 7f5b0aa16040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T22:59:35.336 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:35.334+0000 7f5b0aa16040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T22:59:35.418 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:35.416+0000 7f5b0aa16040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:35.420 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:35.418+0000 7f5b73ddc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T22:59:35.472 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:35.470+0000 7f5b0aa16040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T22:59:35.558 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:35.554+0000 7f5b73ddc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T22:59:36.025 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:36.023+0000 7f5b0aa16040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T22:59:36.159 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-04-24T22:59:36.157+0000 7f5b0aa16040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T22:59:36.601 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:36.599+0000 7f5b14e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T22:59:36.603 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-24T22:59:36.601+0000 7f5b14e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T22:59:37.537 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-24T22:59:37.535+0000 7fc1772e3640 -1 osd.5 0 log_to_monitors true 2024-04-24T22:59:37.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-04-24T22:59:37.707+0000 7f8147029640 -1 osd.2 0 log_to_monitors true 2024-04-24T22:59:37.794 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-24T22:59:37.792+0000 7f3fda9c4640 -1 osd.4 0 log_to_monitors true 2024-04-24T22:59:37.983 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-24T22:59:37.981+0000 7f44aae0d640 -1 osd.6 0 log_to_monitors true 2024-04-24T22:59:38.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-04-24T22:59:38.020+0000 7fe4dbd40640 -1 osd.1 0 log_to_monitors true 2024-04-24T22:59:38.033 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-04-24T22:59:38.031+0000 7f0ac0e13640 -1 osd.0 0 log_to_monitors true 2024-04-24T22:59:38.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-04-24T22:59:38.034+0000 7efdc1a1e640 -1 osd.3 0 log_to_monitors true 2024-04-24T22:59:38.066 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-24T22:59:38.064+0000 7f678361c640 -1 osd.7 0 log_to_monitors true 2024-04-24T22:59:39.666 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-24T22:59:39.663+0000 7fc172c00640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T22:59:39.744 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-24T22:59:39.742+0000 7fc168200640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:41.479 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-24T22:59:41.477+0000 7f3fd6200640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T22:59:41.488 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-24T22:59:41.486+0000 7f3fcb800640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:41.513 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-24T22:59:41.511+0000 7f677de00640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T22:59:41.519 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-24T22:59:41.517+0000 7f6773e00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:41.529 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-24T22:59:41.527+0000 7f44a5800640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T22:59:41.546 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-24T22:59:41.544+0000 7f449b800640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:41.901 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:41.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-04-24T22:59:41.946+0000 7fe4d6c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T22:59:41.972 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-04-24T22:59:41.970+0000 7fe4ccc00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:42.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-04-24T22:59:42.030+0000 7f8142800640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T22:59:42.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-04-24T22:59:42.037+0000 7f8137e00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:42.065 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-04-24T22:59:42.063+0000 7efdbc400640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T22:59:42.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-04-24T22:59:42.068+0000 7efdb2400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:42.075 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-04-24T22:59:42.074+0000 7f0abb600640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T22:59:42.097 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-04-24T22:59:42.095+0000 7f0ab1600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T22:59:42.111 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.109+0000 7f6194200640 1 Processor -- start 2024-04-24T22:59:42.111 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.109+0000 7f6194200640 1 -- start start 2024-04-24T22:59:42.114 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.110+0000 7f6194200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f618c06c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6194200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c0b3500 con 0x7f618c06d210 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6194200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c0cc4d0 con 0x7f618c0b3120 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6194200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0cc280 con 0x7f618c0b13d0 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6190e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f618c06d210 0x7f618c0cfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59658/0 (socket says 172.21.15.146:59658) 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6190e00640 1 -- 172.21.15.146:0/1001994131 learned_addr learned my addr 172.21.15.146:0/1001994131 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959294981 0 0) 0x7f618c0b3500 con 0x7f618c06d210 2024-04-24T22:59:42.115 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6174003520 con 0x7f618c06d210 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f6192200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f618c06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3993579783 0 0) 0x7f6174003520 con 0x7f618c06d210 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 msgr2=0x7f618c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f618c06c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 >> v1:172.21.15.203:6789/0 conn(0x7f618c0b3120 legacy=0x7f618c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0cc7b0 con 0x7f618c06d210 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.111+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6178001670 con 0x7f618c06d210 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 >> v1:172.21.15.146:6789/0 conn(0x7f618c06d210 legacy=0x7f618c0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61740039e0 0x7f6174003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f6174004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f61740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.116 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0cc280 con 0x7f6174004d40 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f617400bb80 con 0x7f61740039e0 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f617400bd80 con 0x7f618c0b13d0 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f61740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6190e00640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f6174004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6191800640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61740039e0 0x7f6174003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 -- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 msgr2=0x7f6174004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0b13d0 0x7f6174004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 -- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61740039e0 msgr2=0x7f6174003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61740039e0 0x7f6174003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6192200640 1 -- 172.21.15.146:0/1001994131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6174003520 con 0x7f6174004d40 2024-04-24T22:59:42.117 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.112+0000 7f6191800640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61740039e0 0x7f6174003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.113+0000 7f6192200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f61740051c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f618400ba10 tx=0x7f6174005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d26e3b753fc7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.113+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184030070 con 0x7f6174004d40 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618402adb0 con 0x7f6174004d40 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f618be00640 1 -- 172.21.15.146:0/1001994131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618400b610 con 0x7f6174004d40 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 -- 172.21.15.146:0/1001994131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 msgr2=0x7f61740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 --2- 172.21.15.146:0/1001994131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f61740051c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f618400ba10 tx=0x7f6174005830 comp rx=0 tx=0).stop 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6192200640 1 -- 172.21.15.146:0/1001994131 reap_dead start 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 -- 172.21.15.146:0/1001994131 shutdown_connections 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 -- 172.21.15.146:0/1001994131 >> 172.21.15.146:0/1001994131 conn(0x7f618c0d1c30 msgr2=0x7f618c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 -- 172.21.15.146:0/1001994131 shutdown_connections 2024-04-24T22:59:42.121 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.114+0000 7f6194200640 1 -- 172.21.15.146:0/1001994131 wait complete. 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.116+0000 7f6194200640 1 Processor -- start 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.116+0000 7f6194200640 1 -- start start 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 0x7f618c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0c6770 0x7f618c06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0d11a0 con 0x7f6174004d40 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0ccd70 con 0x7f618c0c9d40 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6194200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0d2750 con 0x7f618c0c6770 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54718/0 (socket says 172.21.15.146:54718) 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 -- 172.21.15.146:0/1317079263 learned_addr learned my addr 172.21.15.146:0/1317079263 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6190e00640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 0x7f618c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.122 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6192200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0c6770 0x7f618c06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 -- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0c6770 msgr2=0x7f618c06ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0c6770 0x7f618c06ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 -- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 msgr2=0x7f618c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 0x7f618c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6191800640 1 -- 172.21.15.146:0/1317079263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0c77d0 con 0x7f6174004d40 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.117+0000 7f6190e00640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 0x7f618c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6191800640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f618000dae0 tx=0x7f6180002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180003da0 con 0x7f6174004d40 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180017070 con 0x7f6174004d40 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000b950 con 0x7f6174004d40 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c0ca1a0 con 0x7f6174004d40 2024-04-24T22:59:42.123 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.118+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c0c7210 con 0x7f6174004d40 2024-04-24T22:59:42.124 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.119+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c068ac0 con 0x7f6174004d40 2024-04-24T22:59:42.124 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.120+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f618000baf0 con 0x7f6174004d40 2024-04-24T22:59:42.125 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.121+0000 7f6189600640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 0x7f616c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:42.125 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.121+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f618008a330 con 0x7f6174004d40 2024-04-24T22:59:42.125 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.121+0000 7f6190e00640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 0x7f616c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:42.125 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.122+0000 7f6190e00640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 0x7f616c06e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f618c1f7260 tx=0x7f6178009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:42.128 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.126+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f61800599a0 con 0x7f6174004d40 2024-04-24T22:59:42.310 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.308+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f618c0b3500 con 0x7f6174004d40 2024-04-24T22:59:42.311 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.310+0000 7f6189600640 1 -- 172.21.15.146:0/1317079263 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7567 (secure 0 0 0) 0x7f61800592a0 con 0x7f6174004d40 2024-04-24T22:59:42.312 INFO:teuthology.misc.health.smithi146.stdout: 2024-04-24T22:59:42.312 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":14,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:40.749160+0000","last_up_change":"2024-04-24T22:59:40.749160+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:42.314 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 msgr2=0x7f616c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 0x7f616c06e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f618c1f7260 tx=0x7f6178009040 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 msgr2=0x7f618c0b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f618000dae0 tx=0x7f6180002070 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 shutdown_connections 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616c06bda0 0x7f616c06e260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618c0c6770 0x7f618c06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f618c0c9d40 0x7f618c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 --2- 172.21.15.146:0/1317079263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174004d40 0x7f618c0b6fe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 >> 172.21.15.146:0/1317079263 conn(0x7f618c0d1c30 msgr2=0x7f618c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 shutdown_connections 2024-04-24T22:59:42.315 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:42.312+0000 7f6194200640 1 -- 172.21.15.146:0/1317079263 wait complete. 2024-04-24T22:59:42.328 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-24T22:59:42.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:42.515 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:49.135 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:49.323 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.321+0000 7fbe11e00640 1 Processor -- start 2024-04-24T22:59:49.324 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.321+0000 7fbe11e00640 1 -- start start 2024-04-24T22:59:49.325 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe11e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.325 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe11e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c15e750 0x7fbe0c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.325 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe11e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c0afc50 con 0x7fbe0c062050 2024-04-24T22:59:49.325 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe11e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c155620 con 0x7fbe0c15e750 2024-04-24T22:59:49.325 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe11e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c0ad890 con 0x7fbe0c155240 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe0b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c15e750 0x7fbe0c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe03e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe0c062050 0x7fbe0c161cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50852/0 (socket says 172.21.15.146:50852) 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe03e00640 1 -- 172.21.15.146:0/1953053115 learned_addr learned my addr 172.21.15.146:0/1953053115 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.323+0000 7fbe0b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c15e750 0x7fbe0c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35132/0 (socket says 172.21.15.146:35132) 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0aa00640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0b400640 1 -- 172.21.15.146:0/1953053115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 msgr2=0x7fbe0c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0b400640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.326 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0b400640 1 -- 172.21.15.146:0/1953053115 >> v1:172.21.15.146:6789/0 conn(0x7fbe0c062050 legacy=0x7fbe0c161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.327 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0b400640 1 -- 172.21.15.146:0/1953053115 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c0adb70 con 0x7fbe0c15e750 2024-04-24T22:59:49.327 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.324+0000 7fbe0a000640 1 -- 172.21.15.146:0/1953053115 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167433729 0 0) 0x7fbe0c0afc50 con 0x7fbe0c062050 2024-04-24T22:59:49.328 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.325+0000 7fbe0b400640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c06f470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009d90 tx=0x7fbe0402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3948146271799c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.328 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.325+0000 7fbe0a000640 1 -- 172.21.15.146:0/1953053115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04007740 con 0x7fbe0c15e750 2024-04-24T22:59:49.328 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.325+0000 7fbe0a000640 1 -- 172.21.15.146:0/1953053115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe040078e0 con 0x7fbe0c15e750 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.325+0000 7fbe0a000640 1 -- 172.21.15.146:0/1953053115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04007cb0 con 0x7fbe0c15e750 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 -- 172.21.15.146:0/1953053115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 msgr2=0x7fbe0c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c06f470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009d90 tx=0x7fbe0402a660 comp rx=0 tx=0).stop 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 -- 172.21.15.146:0/1953053115 shutdown_connections 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c06f470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 --2- 172.21.15.146:0/1953053115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 -- 172.21.15.146:0/1953053115 >> 172.21.15.146:0/1953053115 conn(0x7fbe0c072400 msgr2=0x7fbe0c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 -- 172.21.15.146:0/1953053115 shutdown_connections 2024-04-24T22:59:49.329 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.326+0000 7fbe11e00640 1 -- 172.21.15.146:0/1953053115 wait complete. 2024-04-24T22:59:49.330 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.328+0000 7fbe11e00640 1 Processor -- start 2024-04-24T22:59:49.330 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.328+0000 7fbe11e00640 1 -- start start 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 0x7fbe0c14e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c0ae410 con 0x7fbe0c15e750 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c0ae130 con 0x7fbe0c062050 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe11e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c0ae6f0 con 0x7fbe0c155240 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35144/0 (socket says 172.21.15.146:35144) 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe0b400640 1 -- 172.21.15.146:0/4202136559 learned_addr learned my addr 172.21.15.146:0/4202136559 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe0aa00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 0x7fbe0c14e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.329+0000 7fbe03e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 -- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 msgr2=0x7fbe0c0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.336 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 -- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 msgr2=0x7fbe0c14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 0x7fbe0c14e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 -- 172.21.15.146:0/4202136559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c0b42f0 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0aa00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 0x7fbe0c14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe0b400640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe0402ac50 tx=0x7fbe04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04040070 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04031bc0 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c0b45d0 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04045460 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.330+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c0b4b90 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.331+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c068ac0 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.333+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe04039040 con 0x7fbe0c15e750 2024-04-24T22:59:49.337 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.333+0000 7fbe03400640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 0x7fbde806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.338 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.334+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fbe040ac420 con 0x7fbe0c15e750 2024-04-24T22:59:49.338 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.334+0000 7fbe0aa00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 0x7fbde806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.338 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.335+0000 7fbe0aa00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 0x7fbde806e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006fd0 tx=0x7fbdfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.341 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.339+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbe0407b240 con 0x7fbe0c15e750 2024-04-24T22:59:49.545 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.543+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe0c06fba0 con 0x7fbe0c15e750 2024-04-24T22:59:49.546 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.544+0000 7fbe03400640 1 -- 172.21.15.146:0/4202136559 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7fbe0407ab40 con 0x7fbe0c15e750 2024-04-24T22:59:49.547 INFO:teuthology.misc.health.smithi146.stdout: 2024-04-24T22:59:49.547 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":19,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:46.515290+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:49.549 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 msgr2=0x7fbde806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 0x7fbde806e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006fd0 tx=0x7fbdfc008040 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 msgr2=0x7fbe0c1605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe0402ac50 tx=0x7fbe04004a40 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 shutdown_connections 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c15e750 0x7fbe0c1605e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbde806be60 0x7fbde806e320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe0c155240 0x7fbe0c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.547+0000 7fbe11e00640 1 --2- 172.21.15.146:0/4202136559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe0c062050 0x7fbe0c14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.548+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 >> 172.21.15.146:0/4202136559 conn(0x7fbe0c072400 msgr2=0x7fbe0c0b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.548+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 shutdown_connections 2024-04-24T22:59:49.550 INFO:teuthology.misc.health.smithi146.stderr:2024-04-24T22:59:49.548+0000 7fbe11e00640 1 -- 172.21.15.146:0/4202136559 wait complete. 2024-04-24T22:59:49.564 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T22:59:49.565 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T22:59:49.565 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T22:59:49.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T22:59:49.570 INFO:tasks.ceph.mds.a:Started 2024-04-24T22:59:49.570 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T22:59:49.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T22:59:49.575 INFO:tasks.ceph.mds.c:Started 2024-04-24T22:59:49.575 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T22:59:49.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T22:59:49.583 INFO:tasks.ceph.mds.b:Started 2024-04-24T22:59:49.583 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T22:59:49.583 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T22:59:49.590 INFO:tasks.ceph.mds.d:Started 2024-04-24T22:59:49.591 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-24T22:59:49.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:49.718 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T22:59:49.719 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T22:59:49.741 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T22:59:49.742 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T22:59:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.769+0000 7fee14000640 1 Processor -- start 2024-04-24T22:59:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.770+0000 7fee14000640 1 -- start start 2024-04-24T22:59:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee14000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee0c0b44f0 0x7fee0c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee14000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee0c0b0a40 0x7fee0c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee14000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0aec70 con 0x7fee0c15e250 2024-04-24T22:59:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee14000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c0d10a0 con 0x7fee0c0b0a40 2024-04-24T22:59:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee14000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c0aef50 con 0x7fee0c0b44f0 2024-04-24T22:59:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee12000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee0c0b0a40 0x7fee0c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee12000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee0c0b0a40 0x7fee0c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35184/0 (socket says 172.21.15.146:35184) 2024-04-24T22:59:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee12000640 1 -- 172.21.15.146:0/3206231450 learned_addr learned my addr 172.21.15.146:0/3206231450 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee10c00640 1 --2- 172.21.15.146:0/3206231450 >> v2:172.21.15.203:3300/0 conn(0x7fee0c0b44f0 0x7fee0c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee12000640 1 -- 172.21.15.146:0/3206231450 >> v2:172.21.15.203:3300/0 conn(0x7fee0c0b44f0 msgr2=0x7fee0c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.771+0000 7fee12000640 1 --2- 172.21.15.146:0/3206231450 >> v2:172.21.15.203:3300/0 conn(0x7fee0c0b44f0 0x7fee0c06c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.772+0000 7fee12000640 1 -- 172.21.15.146:0/3206231450 >> v1:172.21.15.203:6789/0 conn(0x7fee0c15e250 legacy=0x7fee0c0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.772+0000 7fee12000640 1 -- 172.21.15.146:0/3206231450 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0af230 con 0x7fee0c0b0a40 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee12000640 1 --2- 172.21.15.146:0/3206231450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c0b0a40 0x7fee0c06cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee0c071aa0 tx=0x7fee0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b106646b713ecc59 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee0be00640 1 -- 172.21.15.146:0/3206231450 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04036070 con 0x7fee0c0b0a40 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee0be00640 1 -- 172.21.15.146:0/3206231450 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04031600 con 0x7fee0c0b0a40 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee0be00640 1 -- 172.21.15.146:0/3206231450 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee040319d0 con 0x7fee0c0b0a40 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 -- 172.21.15.146:0/3206231450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c0b0a40 msgr2=0x7fee0c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 --2- 172.21.15.146:0/3206231450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c0b0a40 0x7fee0c06cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee0c071aa0 tx=0x7fee0402a730 comp rx=0 tx=0).stop 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 -- 172.21.15.146:0/3206231450 shutdown_connections 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 --2- 172.21.15.146:0/3206231450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c0b0a40 0x7fee0c06cd30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 --2- 172.21.15.146:0/3206231450 >> v2:172.21.15.203:3300/0 conn(0x7fee0c0b44f0 0x7fee0c06c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.773+0000 7fee14000640 1 -- 172.21.15.146:0/3206231450 >> 172.21.15.146:0/3206231450 conn(0x7fee0c0b3860 msgr2=0x7fee0c0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.774+0000 7fee14000640 1 -- 172.21.15.146:0/3206231450 shutdown_connections 2024-04-24T22:59:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.774+0000 7fee14000640 1 -- 172.21.15.146:0/3206231450 wait complete. 2024-04-24T22:59:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.775+0000 7fee14000640 1 Processor -- start 2024-04-24T22:59:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.775+0000 7fee14000640 1 -- start start 2024-04-24T22:59:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0b0a40 0x7fee0c14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b44f0 0x7fee0c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c167da0 con 0x7fee0c15e250 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c167c20 con 0x7fee0c0b44f0 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.776+0000 7fee14000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c167f20 con 0x7fee0c0b0a40 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35188/0 (socket says 172.21.15.146:35188) 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 -- 172.21.15.146:0/2265550365 learned_addr learned my addr 172.21.15.146:0/2265550365 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee11600640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0b0a40 0x7fee0c14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee10c00640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b44f0 0x7fee0c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 -- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0b0a40 msgr2=0x7fee0c14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0b0a40 0x7fee0c14cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 -- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b44f0 msgr2=0x7fee0c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b44f0 0x7fee0c15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 -- 172.21.15.146:0/2265550365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0c7b10 con 0x7fee0c15e250 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.777+0000 7fee12000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee04009f40 tx=0x7fee04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.778+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0403f020 con 0x7fee0c15e250 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.778+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04037040 con 0x7fee0c15e250 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.778+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c0c7df0 con 0x7fee0c15e250 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.778+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04036070 con 0x7fee0c15e250 2024-04-24T22:59:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.778+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c0c83b0 con 0x7fee0c15e250 2024-04-24T22:59:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.779+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c068190 con 0x7fee0c15e250 2024-04-24T22:59:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.780+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee04042020 con 0x7fee0c15e250 2024-04-24T22:59:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.781+0000 7fee09600640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 0x7fedec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.781+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fee040aafc0 con 0x7fee0c15e250 2024-04-24T22:59:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.781+0000 7fee11600640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 0x7fedec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.782+0000 7fee11600640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 0x7fedec06e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee000016e0 tx=0x7fee00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.786+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fee04049020 con 0x7fee0c15e250 2024-04-24T22:59:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.985+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee0c0704b0 con 0x7fee0c15e250 2024-04-24T22:59:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.987+0000 7fee09600640 1 -- 172.21.15.146:0/2265550365 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7fee04079700 con 0x7fee0c15e250 2024-04-24T22:59:49.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:59:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:46.515290+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.989+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 msgr2=0x7fedec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.989+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 0x7fedec06e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee000016e0 tx=0x7fee00009040 comp rx=0 tx=0).stop 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.989+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 msgr2=0x7fee0c0c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.989+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee04009f40 tx=0x7fee04004a40 comp rx=0 tx=0).stop 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 shutdown_connections 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c15e250 0x7fee0c0c5820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b44f0 0x7fee0c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fedec06be30 0x7fedec06e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 --2- 172.21.15.146:0/2265550365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0b0a40 0x7fee0c14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 >> 172.21.15.146:0/2265550365 conn(0x7fee0c0b3860 msgr2=0x7fee0c0b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:49.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 shutdown_connections 2024-04-24T22:59:49.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:49.990+0000 7fee14000640 1 -- 172.21.15.146:0/2265550365 wait complete. 2024-04-24T22:59:50.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T22:59:50.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T22:59:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.199+0000 7f174ca00640 1 Processor -- start 2024-04-24T22:59:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.199+0000 7f174ca00640 1 -- start start 2024-04-24T22:59:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f174ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f174815e060 0x7f17480d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f174ca00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17480d05f0 0x7f17480d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f174ca00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17480d2510 con 0x7f17480cea40 2024-04-24T22:59:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f174ca00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f17480d0f90 con 0x7f17480d05f0 2024-04-24T22:59:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f174ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f17480b0950 con 0x7f174815e060 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f173fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17480d05f0 0x7f17480d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f1747200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f17480cea40 0x7f17480ceed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50870/0 (socket says 172.21.15.146:50870) 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.201+0000 7f1747200640 1 -- 172.21.15.146:0/2350426281 learned_addr learned my addr 172.21.15.146:0/2350426281 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.202+0000 7f1746800640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f174815e060 0x7f17480d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.202+0000 7f173fe00640 1 -- 172.21.15.146:0/2350426281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f174815e060 msgr2=0x7f17480d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.202+0000 7f173fe00640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f174815e060 0x7f17480d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.202+0000 7f173fe00640 1 -- 172.21.15.146:0/2350426281 >> v1:172.21.15.146:6789/0 conn(0x7f17480cea40 legacy=0x7f17480ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.202+0000 7f173fe00640 1 -- 172.21.15.146:0/2350426281 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17480d27f0 con 0x7f17480d05f0 2024-04-24T22:59:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.203+0000 7f173fe00640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480d0a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17300097a0 tx=0x7f173002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a17ba4e2f38489 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.203+0000 7f1745e00640 1 -- 172.21.15.146:0/2350426281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730037070 con 0x7f17480d05f0 2024-04-24T22:59:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.203+0000 7f1745e00640 1 -- 172.21.15.146:0/2350426281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173002ae50 con 0x7f17480d05f0 2024-04-24T22:59:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.203+0000 7f1745e00640 1 -- 172.21.15.146:0/2350426281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730032660 con 0x7f17480d05f0 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 -- 172.21.15.146:0/2350426281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 msgr2=0x7f17480d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480d0a50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17300097a0 tx=0x7f173002a100 comp rx=0 tx=0).stop 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 -- 172.21.15.146:0/2350426281 shutdown_connections 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480d0a50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 --2- 172.21.15.146:0/2350426281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f174815e060 0x7f17480d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 -- 172.21.15.146:0/2350426281 >> 172.21.15.146:0/2350426281 conn(0x7f17480d3c50 msgr2=0x7f17480d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 -- 172.21.15.146:0/2350426281 shutdown_connections 2024-04-24T22:59:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.204+0000 7f174ca00640 1 -- 172.21.15.146:0/2350426281 wait complete. 2024-04-24T22:59:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.206+0000 7f174ca00640 1 Processor -- start 2024-04-24T22:59:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.206+0000 7f174ca00640 1 -- start start 2024-04-24T22:59:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17480cea40 0x7f174815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174815e060 0x7f1748159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17480d2db0 con 0x7f17480d05f0 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17480d21a0 con 0x7f174815e060 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f174ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f17480d49a0 con 0x7f17480cea40 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35214/0 (socket says 172.21.15.146:35214) 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 -- 172.21.15.146:0/1754594583 learned_addr learned my addr 172.21.15.146:0/1754594583 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f1746800640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17480cea40 0x7f174815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f1747200640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174815e060 0x7f1748159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 -- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17480cea40 msgr2=0x7f174815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17480cea40 0x7f174815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 -- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174815e060 msgr2=0x7f1748159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174815e060 0x7f1748159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.207+0000 7f173fe00640 1 -- 172.21.15.146:0/1754594583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17480b4220 con 0x7f17480d05f0 2024-04-24T22:59:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f173fe00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1730035040 tx=0x7f17300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730041070 con 0x7f17480d05f0 2024-04-24T22:59:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173003c670 con 0x7f17480d05f0 2024-04-24T22:59:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17480b0f30 con 0x7f17480d05f0 2024-04-24T22:59:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730037040 con 0x7f17480d05f0 2024-04-24T22:59:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.208+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17480b14f0 con 0x7f17480d05f0 2024-04-24T22:59:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.209+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174804f500 con 0x7f17480d05f0 2024-04-24T22:59:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.210+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f173003a070 con 0x7f17480d05f0 2024-04-24T22:59:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.211+0000 7f173ea00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 0x7f172406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.211+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f17300aae50 con 0x7f17480d05f0 2024-04-24T22:59:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.212+0000 7f1746800640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 0x7f172406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.213+0000 7f1746800640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 0x7f172406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1738006fd0 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.216+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1730079c60 con 0x7f17480d05f0 2024-04-24T22:59:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.412+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17480b8460 con 0x7f17480d05f0 2024-04-24T22:59:50.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.413+0000 7f173ea00640 1 -- 172.21.15.146:0/1754594583 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f1730079560 con 0x7f17480d05f0 2024-04-24T22:59:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 msgr2=0x7f172406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 0x7f172406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1738006fd0 tx=0x7f1738008040 comp rx=0 tx=0).stop 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 msgr2=0x7f17480b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1730035040 tx=0x7f17300046c0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 shutdown_connections 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174815e060 0x7f1748159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480d05f0 0x7f17480b3ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f172406be30 0x7f172406e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 --2- 172.21.15.146:0/1754594583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17480cea40 0x7f174815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 >> 172.21.15.146:0/1754594583 conn(0x7f17480d3c50 msgr2=0x7f17480b8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 shutdown_connections 2024-04-24T22:59:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.416+0000 7f174ca00640 1 -- 172.21.15.146:0/1754594583 wait complete. 2024-04-24T22:59:50.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T22:59:50.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.639+0000 7f27dca00640 1 Processor -- start 2024-04-24T22:59:50.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.639+0000 7f27dca00640 1 -- start start 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27dca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27d806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27dca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f27d80d0240 0x7f27d80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27dca00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d80ccb10 con 0x7f27d8071dd0 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27dca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f27d8072230 con 0x7f27d80d0240 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27dca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27d80aede0 con 0x7f27d815a980 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27cea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f27d8071dd0 0x7f27d80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50876/0 (socket says 172.21.15.146:50876) 2024-04-24T22:59:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.641+0000 7f27cea00640 1 -- 172.21.15.146:0/384752901 learned_addr learned my addr 172.21.15.146:0/384752901 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d7e00640 1 --2- 172.21.15.146:0/384752901 >> v2:172.21.15.203:3300/0 conn(0x7f27d80d0240 0x7f27d80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d7400640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27d806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395411663 0 0) 0x7f27c0001110 con 0x7f27d8071dd0 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27bc003520 con 0x7f27d8071dd0 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327920035 0 0) 0x7f27bc003520 con 0x7f27d8071dd0 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 msgr2=0x7f27d806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27d806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 >> v2:172.21.15.203:3300/0 conn(0x7f27d80d0240 msgr2=0x7f27d80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 --2- 172.21.15.146:0/384752901 >> v2:172.21.15.203:3300/0 conn(0x7f27d80d0240 0x7f27d80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d806ddc0 con 0x7f27d8071dd0 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f27c0001840 con 0x7f27d8071dd0 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 >> v1:172.21.15.146:6789/0 conn(0x7f27d8071dd0 legacy=0x7f27d80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc0039b0 0x7f27bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc004d40 0x7f27bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27d8072230 con 0x7f27bc004d40 2024-04-24T22:59:50.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.642+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27d80aede0 con 0x7f27bc0039b0 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc00b9f0 con 0x7f27d815a980 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc004d40 0x7f27bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27cea00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7400640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc0039b0 0x7f27bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 -- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 msgr2=0x7f27bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d815a980 0x7f27bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 -- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc0039b0 msgr2=0x7f27bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc0039b0 0x7f27bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7e00640 1 -- 172.21.15.146:0/384752901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc003520 con 0x7f27bc004d40 2024-04-24T22:59:50.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.643+0000 7f27d7400640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc0039b0 0x7f27bc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.644+0000 7f27d7e00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc004d40 0x7f27bc0051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009f90 tx=0x7f27bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877cc7c4844da2d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.644+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0009c10 con 0x7f27bc004d40 2024-04-24T22:59:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.644+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0036070 con 0x7f27bc004d40 2024-04-24T22:59:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.644+0000 7f27d6a00640 1 -- 172.21.15.146:0/384752901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0031880 con 0x7f27bc004d40 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 -- 172.21.15.146:0/384752901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc004d40 msgr2=0x7f27bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 --2- 172.21.15.146:0/384752901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc004d40 0x7f27bc0051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009f90 tx=0x7f27bc005830 comp rx=0 tx=0).stop 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27d7e00640 1 -- 172.21.15.146:0/384752901 reap_dead start 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 -- 172.21.15.146:0/384752901 shutdown_connections 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 -- 172.21.15.146:0/384752901 >> 172.21.15.146:0/384752901 conn(0x7f27d806b320 msgr2=0x7f27d806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 -- 172.21.15.146:0/384752901 shutdown_connections 2024-04-24T22:59:50.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.645+0000 7f27dca00640 1 -- 172.21.15.146:0/384752901 wait complete. 2024-04-24T22:59:50.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.647+0000 7f27dca00640 1 Processor -- start 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.647+0000 7f27dca00640 1 -- start start 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 0x7f27d81539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 0x7f27d80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27d806e660 con 0x7f27d80cbd80 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27d806e380 con 0x7f27bc004d40 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27dca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27d815ad60 con 0x7f27d8153f00 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35240/0 (socket says 172.21.15.146:35240) 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.648+0000 7f27d7e00640 1 -- 172.21.15.146:0/3195996099 learned_addr learned my addr 172.21.15.146:0/3195996099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27cea00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 0x7f27d80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7400640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 0x7f27d81539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 -- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 msgr2=0x7f27d80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 0x7f27d80cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 -- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 msgr2=0x7f27d81539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 0x7f27d81539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 -- 172.21.15.146:0/3195996099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d8154410 con 0x7f27d80cbd80 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27cea00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 0x7f27d80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:50.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7400640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 0x7f27d81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27d7e00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27d0033040 tx=0x7f27d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0009c10 con 0x7f27d80cbd80 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0031d50 con 0x7f27d80cbd80 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.649+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d81546f0 con 0x7f27d80cbd80 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.650+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0045670 con 0x7f27d80cbd80 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.650+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d813b760 con 0x7f27d80cbd80 2024-04-24T22:59:50.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.651+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d804f500 con 0x7f27d80cbd80 2024-04-24T22:59:50.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.652+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27d0005d10 con 0x7f27d80cbd80 2024-04-24T22:59:50.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.653+0000 7f27cfe00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 0x7f27b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:50.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.653+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f27d00abf80 con 0x7f27d80cbd80 2024-04-24T22:59:50.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.654+0000 7f27d7400640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 0x7f27b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.655+0000 7f27d7400640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 0x7f27b406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009aa0 tx=0x7f27c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:50.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.658+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f27d007ac70 con 0x7f27d80cbd80 2024-04-24T22:59:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.894+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27d80b0f20 con 0x7f27d80cbd80 2024-04-24T22:59:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.895+0000 7f27cfe00640 1 -- 172.21.15.146:0/3195996099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f27d007a570 con 0x7f27d80cbd80 2024-04-24T22:59:50.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:59:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-24T22:59:50.897 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 3 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.897+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 msgr2=0x7f27b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.897+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 0x7f27b406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009aa0 tx=0x7f27c8008040 comp rx=0 tx=0).stop 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.897+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 msgr2=0x7f27d815b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.897+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27d0033040 tx=0x7f27d0009750 comp rx=0 tx=0).stop 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 shutdown_connections 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d80cbd80 0x7f27d815b050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27b406be30 0x7f27b406e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27d8153f00 0x7f27d80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 --2- 172.21.15.146:0/3195996099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27bc004d40 0x7f27d81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:50.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 >> 172.21.15.146:0/3195996099 conn(0x7f27d806b320 msgr2=0x7f27d80adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:50.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 shutdown_connections 2024-04-24T22:59:50.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:50.898+0000 7f27dca00640 1 -- 172.21.15.146:0/3195996099 wait complete. 2024-04-24T22:59:50.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.113+0000 7fe887200640 1 Processor -- start 2024-04-24T22:59:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.113+0000 7fe887200640 1 -- start start 2024-04-24T22:59:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.114+0000 7fe887200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8881561c0 0x7fe8880cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.114+0000 7fe887200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe8880d0240 0x7fe88815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.114+0000 7fe887200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe888070f90 con 0x7fe8880709d0 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.114+0000 7fe887200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe8880b4310 con 0x7fe8881561c0 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.114+0000 7fe887200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe8881565a0 con 0x7fe8880d0240 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8881561c0 0x7fe8880cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8880709d0 0x7fe8880cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50882/0 (socket says 172.21.15.146:50882) 2024-04-24T22:59:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885400640 1 -- 172.21.15.146:0/1830313653 learned_addr learned my addr 172.21.15.146:0/1830313653 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe886800640 1 --2- 172.21.15.146:0/1830313653 >> v2:172.21.15.203:3300/0 conn(0x7fe8880d0240 0x7fe88815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885e00640 1 -- 172.21.15.146:0/1830313653 >> v2:172.21.15.203:3300/0 conn(0x7fe8880d0240 msgr2=0x7fe88815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885e00640 1 --2- 172.21.15.146:0/1830313653 >> v2:172.21.15.203:3300/0 conn(0x7fe8880d0240 0x7fe88815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885e00640 1 -- 172.21.15.146:0/1830313653 >> v1:172.21.15.146:6789/0 conn(0x7fe8880709d0 legacy=0x7fe8880cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe885e00640 1 -- 172.21.15.146:0/1830313653 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888071270 con 0x7fe8881561c0 2024-04-24T22:59:51.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.115+0000 7fe884a00640 1 -- 172.21.15.146:0/1830313653 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147780314 0 0) 0x7fe888070f90 con 0x7fe8880709d0 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.116+0000 7fe885e00640 1 --2- 172.21.15.146:0/1830313653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe8880cdbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe888159c30 tx=0x7fe87802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc21c0be2769149 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe884a00640 1 -- 172.21.15.146:0/1830313653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878037070 con 0x7fe8881561c0 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe884a00640 1 -- 172.21.15.146:0/1830313653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87802add0 con 0x7fe8881561c0 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe884a00640 1 -- 172.21.15.146:0/1830313653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878032660 con 0x7fe8881561c0 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 -- 172.21.15.146:0/1830313653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 msgr2=0x7fe8880cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 --2- 172.21.15.146:0/1830313653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe8880cdbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe888159c30 tx=0x7fe87802a080 comp rx=0 tx=0).stop 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 -- 172.21.15.146:0/1830313653 shutdown_connections 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 --2- 172.21.15.146:0/1830313653 >> v2:172.21.15.203:3300/0 conn(0x7fe8880d0240 0x7fe88815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 --2- 172.21.15.146:0/1830313653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe8880cdbf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 -- 172.21.15.146:0/1830313653 >> 172.21.15.146:0/1830313653 conn(0x7fe88806b320 msgr2=0x7fe88806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 -- 172.21.15.146:0/1830313653 shutdown_connections 2024-04-24T22:59:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.117+0000 7fe887200640 1 -- 172.21.15.146:0/1830313653 wait complete. 2024-04-24T22:59:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.119+0000 7fe887200640 1 Processor -- start 2024-04-24T22:59:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.119+0000 7fe887200640 1 -- start start 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8880709d0 0x7fe88814d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8880d0240 0x7fe888157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880b2c20 con 0x7fe8881561c0 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe888071830 con 0x7fe8880d0240 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe887200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880b2da0 con 0x7fe8880709d0 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe886800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe886800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35254/0 (socket says 172.21.15.146:35254) 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.120+0000 7fe886800640 1 -- 172.21.15.146:0/1535465067 learned_addr learned my addr 172.21.15.146:0/1535465067 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe885400640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8880d0240 0x7fe888157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 -- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8880709d0 msgr2=0x7fe88814d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe885e00640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8880709d0 0x7fe88814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8880709d0 0x7fe88814d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 -- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8880d0240 msgr2=0x7fe888157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8880d0240 0x7fe888157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 -- 172.21.15.146:0/1535465067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8881f6580 con 0x7fe8881561c0 2024-04-24T22:59:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe886800640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe880007e70 tx=0x7fe88000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880014420 con 0x7fe8881561c0 2024-04-24T22:59:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880019070 con 0x7fe8881561c0 2024-04-24T22:59:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.121+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880014820 con 0x7fe8881561c0 2024-04-24T22:59:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.122+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881f5a00 con 0x7fe8881561c0 2024-04-24T22:59:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.122+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8881f5fc0 con 0x7fe8881561c0 2024-04-24T22:59:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.123+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88804f500 con 0x7fe8881561c0 2024-04-24T22:59:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.124+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8800149c0 con 0x7fe8881561c0 2024-04-24T22:59:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.125+0000 7fe87e000640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 0x7fe86406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.125+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe88008b3a0 con 0x7fe8881561c0 2024-04-24T22:59:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.125+0000 7fe885e00640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 0x7fe86406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.126+0000 7fe885e00640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 0x7fe86406e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe878034000 tx=0x7fe87802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.129+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe88005a0a0 con 0x7fe8881561c0 2024-04-24T22:59:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.326+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe88815f030 con 0x7fe8881561c0 2024-04-24T22:59:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.328+0000 7fe87e000640 1 -- 172.21.15.146:0/1535465067 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7fe8800599a0 con 0x7fe8881561c0 2024-04-24T22:59:51.330 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:59:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:46.515290+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 msgr2=0x7fe86406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 0x7fe86406e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe878034000 tx=0x7fe87802e000 comp rx=0 tx=0).stop 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 msgr2=0x7fe888145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe880007e70 tx=0x7fe88000e4b0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 shutdown_connections 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8881561c0 0x7fe888145740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8880d0240 0x7fe888157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe86406be30 0x7fe86406e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 --2- 172.21.15.146:0/1535465067 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8880709d0 0x7fe88814d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 >> 172.21.15.146:0/1535465067 conn(0x7fe88806b320 msgr2=0x7fe8880cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 shutdown_connections 2024-04-24T22:59:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.331+0000 7fe887200640 1 -- 172.21.15.146:0/1535465067 wait complete. 2024-04-24T22:59:51.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T22:59:51.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T22:59:51.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.547+0000 7fec7c600640 1 Processor -- start 2024-04-24T22:59:51.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.547+0000 7fec7c600640 1 -- start start 2024-04-24T22:59:51.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7c600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec7413ef30 0x7fec74141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7c600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fec740ce770 0x7fec74071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7c600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec740ced40 con 0x7fec74141ab0 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7c600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fec741423d0 con 0x7fec7413ef30 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7c600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fec74070f80 con 0x7fec740ce770 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec79c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec7413ef30 0x7fec74141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec79c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec7413ef30 0x7fec74141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35270/0 (socket says 172.21.15.146:35270) 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec79c00640 1 -- 172.21.15.146:0/1745073431 learned_addr learned my addr 172.21.15.146:0/1745073431 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec7a600640 1 --2- 172.21.15.146:0/1745073431 >> v2:172.21.15.203:3300/0 conn(0x7fec740ce770 0x7fec74071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec79c00640 1 -- 172.21.15.146:0/1745073431 >> v2:172.21.15.203:3300/0 conn(0x7fec740ce770 msgr2=0x7fec74071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.549+0000 7fec79c00640 1 --2- 172.21.15.146:0/1745073431 >> v2:172.21.15.203:3300/0 conn(0x7fec740ce770 0x7fec74071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.550+0000 7fec79c00640 1 -- 172.21.15.146:0/1745073431 >> v1:172.21.15.203:6789/0 conn(0x7fec74141ab0 legacy=0x7fec740ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.550+0000 7fec79c00640 1 -- 172.21.15.146:0/1745073431 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec740cf020 con 0x7fec7413ef30 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.551+0000 7fec79c00640 1 --2- 172.21.15.146:0/1745073431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec7413ef30 0x7fec74141570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec74160aa0 tx=0x7fec6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4773b8b55ef95335 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.551+0000 7fec73e00640 1 -- 172.21.15.146:0/1745073431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68037070 con 0x7fec7413ef30 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.551+0000 7fec73e00640 1 -- 172.21.15.146:0/1745073431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec68032440 con 0x7fec7413ef30 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.551+0000 7fec73e00640 1 -- 172.21.15.146:0/1745073431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68032810 con 0x7fec7413ef30 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 -- 172.21.15.146:0/1745073431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec7413ef30 msgr2=0x7fec74141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 --2- 172.21.15.146:0/1745073431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec7413ef30 0x7fec74141570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec74160aa0 tx=0x7fec6802a230 comp rx=0 tx=0).stop 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 -- 172.21.15.146:0/1745073431 shutdown_connections 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 --2- 172.21.15.146:0/1745073431 >> v2:172.21.15.203:3300/0 conn(0x7fec740ce770 0x7fec74071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 --2- 172.21.15.146:0/1745073431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec7413ef30 0x7fec74141570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 -- 172.21.15.146:0/1745073431 >> 172.21.15.146:0/1745073431 conn(0x7fec740b17b0 msgr2=0x7fec740b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 -- 172.21.15.146:0/1745073431 shutdown_connections 2024-04-24T22:59:51.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.552+0000 7fec7c600640 1 -- 172.21.15.146:0/1745073431 wait complete. 2024-04-24T22:59:51.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.553+0000 7fec7c600640 1 Processor -- start 2024-04-24T22:59:51.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.554+0000 7fec7c600640 1 -- start start 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.554+0000 7fec7c600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 0x7fec74144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.554+0000 7fec7c600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 0x7fec7413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.554+0000 7fec7c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec74071950 con 0x7fec74141ab0 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7c600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec74070c10 con 0x7fec740ce770 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7c600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fec74071ad0 con 0x7fec7413ef30 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35284/0 (socket says 172.21.15.146:35284) 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 -- 172.21.15.146:0/2265178847 learned_addr learned my addr 172.21.15.146:0/2265178847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec79c00640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 0x7fec74144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec79200640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 0x7fec7413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 -- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 msgr2=0x7fec7413de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 0x7fec7413de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 -- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 msgr2=0x7fec74144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 0x7fec74144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec7a600640 1 -- 172.21.15.146:0/2265178847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec74143e50 con 0x7fec74141ab0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec79c00640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 0x7fec74144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.555+0000 7fec79200640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 0x7fec7413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec7a600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007e40 tx=0x7fec6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c014620 con 0x7fec74141ab0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6c019070 con 0x7fec74141ab0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c014a20 con 0x7fec74141ab0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec74144130 con 0x7fec74141ab0 2024-04-24T22:59:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.556+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec741446f0 con 0x7fec74141ab0 2024-04-24T22:59:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.557+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7404f5a0 con 0x7fec74141ab0 2024-04-24T22:59:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.558+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec6c014bc0 con 0x7fec74141ab0 2024-04-24T22:59:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.559+0000 7fec71600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 0x7fec5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.559+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fec6c08b4f0 con 0x7fec74141ab0 2024-04-24T22:59:51.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.559+0000 7fec79c00640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 0x7fec5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.560+0000 7fec79c00640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 0x7fec5406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec68034000 tx=0x7fec6802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.563+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fec6c05a150 con 0x7fec74141ab0 2024-04-24T22:59:51.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.763+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec74072d30 con 0x7fec74141ab0 2024-04-24T22:59:51.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.764+0000 7fec71600640 1 -- 172.21.15.146:0/2265178847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7fec6c059a50 con 0x7fec74141ab0 2024-04-24T22:59:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T22:59:51.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 msgr2=0x7fec5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 0x7fec5406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec68034000 tx=0x7fec6802e000 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 msgr2=0x7fec74140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007e40 tx=0x7fec6c00e4b0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 shutdown_connections 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec74141ab0 0x7fec74140360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fec5406be30 0x7fec5406e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec7413ef30 0x7fec7413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 --2- 172.21.15.146:0/2265178847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec740ce770 0x7fec74144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 >> 172.21.15.146:0/2265178847 conn(0x7fec740b17b0 msgr2=0x7fec7406d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 shutdown_connections 2024-04-24T22:59:51.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.767+0000 7fec7c600640 1 -- 172.21.15.146:0/2265178847 wait complete. 2024-04-24T22:59:51.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.990+0000 7f1ad0c00640 1 Processor -- start 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.990+0000 7f1ad0c00640 1 -- start start 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.991+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1acc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ad0c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc0cdf70 con 0x7f1acc06cbc0 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ad0c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc145a20 con 0x7f1acc145640 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ad0c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc06d140 con 0x7f1acc0b2a20 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1aca800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1acc06cbc0 0x7f1acc0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50884/0 (socket says 172.21.15.146:50884) 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1aca800640 1 -- 172.21.15.146:0/3229867017 learned_addr learned my addr 172.21.15.146:0/3229867017 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ac9400640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1acc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026668512 0 0) 0x7f1acc0cdf70 con 0x7f1acc06cbc0 2024-04-24T22:59:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.992+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab0003520 con 0x7f1acc06cbc0 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4081370320 0 0) 0x7f1ab0003520 con 0x7f1acc06cbc0 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 msgr2=0x7f1acc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1acc0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 >> v1:172.21.15.203:6789/0 conn(0x7f1acc145640 legacy=0x7f1acc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc06d420 con 0x7f1acc06cbc0 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1ac40019f0 con 0x7f1acc06cbc0 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 >> v1:172.21.15.146:6789/0 conn(0x7f1acc06cbc0 legacy=0x7f1acc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1ab00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab0003f60 0x7f1ab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ab0004d40 0x7f1ab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc06d140 con 0x7f1ab0004d40 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab000baa0 con 0x7f1ab0003f60 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab000bca0 con 0x7f1acc0b2a20 2024-04-24T22:59:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1aca800640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ab0004d40 0x7f1ab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.993+0000 7f1ac9e00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1ab00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1aca800640 1 -- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 msgr2=0x7f1ab00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1aca800640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1acc0b2a20 0x7f1ab00039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1aca800640 1 -- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab0003f60 msgr2=0x7f1ab0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1ac9400640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab0003f60 0x7f1ab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1aca800640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ab0003f60 0x7f1ab0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.994+0000 7f1aca800640 1 -- 172.21.15.146:0/3229867017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab0003520 con 0x7f1ab0004d40 2024-04-24T22:59:51.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1aca800640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ab0004d40 0x7f1ab00051c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400a860 tx=0x7f1ab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1423d1ada6a6baf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400a480 con 0x7f1ab0004d40 2024-04-24T22:59:51.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac402f070 con 0x7f1ab0004d40 2024-04-24T22:59:51.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ac8a00640 1 -- 172.21.15.146:0/3229867017 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac402bd40 con 0x7f1ab0004d40 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3229867017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ab0004d40 msgr2=0x7f1ab00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3229867017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ab0004d40 0x7f1ab00051c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400a860 tx=0x7f1ab0005830 comp rx=0 tx=0).stop 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1aca800640 1 -- 172.21.15.146:0/3229867017 reap_dead start 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3229867017 shutdown_connections 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3229867017 >> 172.21.15.146:0/3229867017 conn(0x7f1acc06b320 msgr2=0x7f1acc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.995+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3229867017 shutdown_connections 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.996+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3229867017 wait complete. 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.997+0000 7f1ad0c00640 1 Processor -- start 2024-04-24T22:59:52.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.997+0000 7f1ad0c00640 1 -- start start 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ab0004d40 0x7f1acc0724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1acc0c6130 0x7f1acc0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc0ceb60 con 0x7f1acc0729e0 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc06d9e0 con 0x7f1acc0c6130 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ad0c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc0cece0 con 0x7f1ab0004d40 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ac9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ac9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35292/0 (socket says 172.21.15.146:35292) 2024-04-24T22:59:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.998+0000 7f1ac9400640 1 -- 172.21.15.146:0/3207833621 learned_addr learned my addr 172.21.15.146:0/3207833621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 -- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ab0004d40 msgr2=0x7f1acc0724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ab0004d40 0x7f1acc0724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 -- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1acc0c6130 msgr2=0x7f1acc0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1acc0c6130 0x7f1acc0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 -- 172.21.15.146:0/3207833621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc1f8400 con 0x7f1acc0729e0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac9400640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8010860 tx=0x7f1ab8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab800f040 con 0x7f1acc0729e0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab800eae0 con 0x7f1acc0729e0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab801c400 con 0x7f1acc0729e0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:51.999+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc1f75a0 con 0x7f1acc0729e0 2024-04-24T22:59:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.000+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc1f7b60 con 0x7f1acc0729e0 2024-04-24T22:59:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.001+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1acc068190 con 0x7f1acc0729e0 2024-04-24T22:59:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.001+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ab801c5a0 con 0x7f1acc0729e0 2024-04-24T22:59:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.002+0000 7f1ac2000640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 0x7f1aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.002+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f1ab808b1b0 con 0x7f1acc0729e0 2024-04-24T22:59:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.003+0000 7f1ac9e00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 0x7f1aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.004+0000 7f1ac9e00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 0x7f1aac06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1abc001640 tx=0x7f1abc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.006+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1ab8018030 con 0x7f1acc0729e0 2024-04-24T22:59:52.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.208+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1acc074940 con 0x7f1acc0729e0 2024-04-24T22:59:52.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.209+0000 7f1ac2000640 1 -- 172.21.15.146:0/3207833621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f1ab80597c0 con 0x7f1acc0729e0 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T22:59:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.211+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 msgr2=0x7f1aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.211+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 0x7f1aac06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1abc001640 tx=0x7f1abc009040 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.211+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 msgr2=0x7f1acc0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.211+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8010860 tx=0x7f1ab8010d20 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 shutdown_connections 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1acc0c6130 0x7f1acc0714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc0729e0 0x7f1acc0c5bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1aac06be30 0x7f1aac06e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 --2- 172.21.15.146:0/3207833621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ab0004d40 0x7f1acc0724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 >> 172.21.15.146:0/3207833621 conn(0x7f1acc06b320 msgr2=0x7f1acc15bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 shutdown_connections 2024-04-24T22:59:52.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.212+0000 7f1ad0c00640 1 -- 172.21.15.146:0/3207833621 wait complete. 2024-04-24T22:59:52.231 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T22:59:52.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T22:59:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.436+0000 7f6cfe200640 1 Processor -- start 2024-04-24T22:59:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.436+0000 7f6cfe200640 1 -- start start 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfe200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6cf8071f10 0x7f6cf80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfe200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf806dfe0 con 0x7f6cf806e230 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfe200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf8160420 con 0x7f6cf806db30 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfe200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf815d2a0 con 0x7f6cf8071f10 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfd800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6cf806e230 0x7f6cf80cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50886/0 (socket says 172.21.15.146:50886) 2024-04-24T22:59:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfd800640 1 -- 172.21.15.146:0/3113092664 learned_addr learned my addr 172.21.15.146:0/3113092664 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.438+0000 7f6cfce00640 1 --2- 172.21.15.146:0/3113092664 >> v2:172.21.15.203:3300/0 conn(0x7f6cf8071f10 0x7f6cf80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148232561 0 0) 0x7f6cf806dfe0 con 0x7f6cf806e230 2024-04-24T22:59:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce0003520 con 0x7f6cf806e230 2024-04-24T22:59:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280459656 0 0) 0x7f6ce0003520 con 0x7f6cf806e230 2024-04-24T22:59:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 >> v2:172.21.15.203:3300/0 conn(0x7f6cf8071f10 msgr2=0x7f6cf80cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 --2- 172.21.15.146:0/3113092664 >> v2:172.21.15.203:3300/0 conn(0x7f6cf8071f10 0x7f6cf80cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 >> v1:172.21.15.203:6789/0 conn(0x7f6cf806db30 legacy=0x7f6cf815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf815c390 con 0x7f6cf806e230 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6cf00019f0 con 0x7f6cf806e230 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 >> v1:172.21.15.146:6789/0 conn(0x7f6cf806e230 legacy=0x7f6cf80cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 0x7f6ce0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0004800 0x7f6ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ce0005210 0x7f6ce000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf815d2a0 con 0x7f6ce0003a70 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce000c140 con 0x7f6ce0004800 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.439+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce000c340 con 0x7f6ce0005210 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 0x7f6ce0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfd800640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ce0005210 0x7f6ce000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cf7e00640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0004800 0x7f6ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 -- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ce0005210 msgr2=0x7f6ce000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ce0005210 0x7f6ce000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 -- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0004800 msgr2=0x7f6ce0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0004800 0x7f6ce0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfce00640 1 -- 172.21.15.146:0/3113092664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce0003520 con 0x7f6ce0003a70 2024-04-24T22:59:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.440+0000 7f6cfd800640 1 -- 172.21.15.146:0/3113092664 reap_dead start 2024-04-24T22:59:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.442+0000 7f6cfce00640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 0x7f6ce0003e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009ac0 tx=0x7f6ce0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7645e420f3f2961a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.442+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec036070 con 0x7f6ce0003a70 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.442+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec031400 con 0x7f6ce0003a70 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.442+0000 7f6cf7400640 1 -- 172.21.15.146:0/3113092664 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec009690 con 0x7f6ce0003a70 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 -- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 msgr2=0x7f6ce0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 0x7f6ce0003e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009ac0 tx=0x7f6ce0005830 comp rx=0 tx=0).stop 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 -- 172.21.15.146:0/3113092664 shutdown_connections 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 --2- 172.21.15.146:0/3113092664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce0003a70 0x7f6ce0003e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 -- 172.21.15.146:0/3113092664 >> 172.21.15.146:0/3113092664 conn(0x7f6cf80b1460 msgr2=0x7f6cf80b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 -- 172.21.15.146:0/3113092664 shutdown_connections 2024-04-24T22:59:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.443+0000 7f6cfe200640 1 -- 172.21.15.146:0/3113092664 wait complete. 2024-04-24T22:59:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.445+0000 7f6cfe200640 1 Processor -- start 2024-04-24T22:59:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.445+0000 7f6cfe200640 1 -- start start 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0003a70 0x7f6cf8148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6cf80ad8c0 0x7f6cf80add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf815c700 con 0x7f6cf8159f40 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80722f0 con 0x7f6ce0003a70 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfe200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf8159ce0 con 0x7f6cf80ad8c0 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35308/0 (socket says 172.21.15.146:35308) 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.446+0000 7f6cfd800640 1 -- 172.21.15.146:0/2395468755 learned_addr learned my addr 172.21.15.146:0/2395468755 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfce00640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0003a70 0x7f6cf8148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cf7e00640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6cf80ad8c0 0x7f6cf80add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 -- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6cf80ad8c0 msgr2=0x7f6cf80add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6cf80ad8c0 0x7f6cf80add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 -- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0003a70 msgr2=0x7f6cf8148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0003a70 0x7f6cf8148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 -- 172.21.15.146:0/2395468755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf815ac90 con 0x7f6cf8159f40 2024-04-24T22:59:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfd800640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80cc9b0 tx=0x7f6cf0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000ea80 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0018070 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000ee60 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.447+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf815af70 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.448+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf815b530 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.449+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf804f500 con 0x7f6cf8159f40 2024-04-24T22:59:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.450+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cf001d460 con 0x7f6cf8159f40 2024-04-24T22:59:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.450+0000 7f6cf4c00640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 0x7f6cd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.451+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6cf008ad60 con 0x7f6cf8159f40 2024-04-24T22:59:52.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.451+0000 7f6cfce00640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 0x7f6cd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.452+0000 7f6cfce00640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 0x7f6cd806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cec033000 tx=0x7f6cec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.455+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6cf0059a50 con 0x7f6cf8159f40 2024-04-24T22:59:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.658+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6cf80724a0 con 0x7f6cf8159f40 2024-04-24T22:59:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.755+0000 7f6cf4c00640 1 -- 172.21.15.146:0/2395468755 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f6cf0059350 con 0x7f6cf8159f40 2024-04-24T22:59:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T22:59:52.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 msgr2=0x7f6cd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 0x7f6cd806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cec033000 tx=0x7f6cec008030 comp rx=0 tx=0).stop 2024-04-24T22:59:52.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 msgr2=0x7f6cf815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80cc9b0 tx=0x7f6cf0007bc0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 shutdown_connections 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf8159f40 0x7f6cf815a3c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6cd806be60 0x7f6cd806e320 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cec033000 tx=0x7f6cec008030 comp rx=0 tx=0).stop 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6cf80ad8c0 0x7f6cf80add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 --2- 172.21.15.146:0/2395468755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ce0003a70 0x7f6cf8148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.759+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 >> 172.21.15.146:0/2395468755 conn(0x7f6cf80b1460 msgr2=0x7f6cf80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.760+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 shutdown_connections 2024-04-24T22:59:52.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.761+0000 7f6cfe200640 1 -- 172.21.15.146:0/2395468755 wait complete. 2024-04-24T22:59:52.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-24T22:59:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.977+0000 7ff50b400640 1 Processor -- start 2024-04-24T22:59:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.977+0000 7ff50b400640 1 -- start start 2024-04-24T22:59:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.978+0000 7ff50b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.978+0000 7ff50b400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.978+0000 7ff50b400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5040ced40 con 0x7ff5040ce5a0 2024-04-24T22:59:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.978+0000 7ff50b400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff5041423d0 con 0x7ff504141ab0 2024-04-24T22:59:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.978+0000 7ff50b400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff504070f80 con 0x7ff50413ef30 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.979+0000 7ff508a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.979+0000 7ff4fbe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.979+0000 7ff4fbe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:39298/0 (socket says 172.21.15.146:39298) 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.979+0000 7ff508a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:47156/0 (socket says 172.21.15.146:47156) 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.979+0000 7ff4fbe00640 1 -- 172.21.15.146:0/1975208092 learned_addr learned my addr 172.21.15.146:0/1975208092 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.980+0000 7ff508a00640 1 -- 172.21.15.146:0/1975208092 >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 msgr2=0x7ff5040ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.980+0000 7ff508a00640 1 --2- 172.21.15.146:0/1975208092 >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.980+0000 7ff508a00640 1 -- 172.21.15.146:0/1975208092 >> v1:172.21.15.203:6789/0 conn(0x7ff5040ce5a0 legacy=0x7ff50415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.980+0000 7ff508a00640 1 -- 172.21.15.146:0/1975208092 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5040cf020 con 0x7ff50413ef30 2024-04-24T22:59:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.980+0000 7ff4fbe00640 1 --2- 172.21.15.146:0/1975208092 >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.982+0000 7ff508a00640 1 --2- 172.21.15.146:0/1975208092 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40097a0 tx=0x7ff4f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c3be6109031241 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.982+0000 7ff503e00640 1 -- 172.21.15.146:0/1975208092 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4037070 con 0x7ff50413ef30 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff503e00640 1 -- 172.21.15.146:0/1975208092 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f4032440 con 0x7ff50413ef30 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff503e00640 1 -- 172.21.15.146:0/1975208092 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4032810 con 0x7ff50413ef30 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 -- 172.21.15.146:0/1975208092 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 msgr2=0x7ff504141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 --2- 172.21.15.146:0/1975208092 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40097a0 tx=0x7ff4f402a180 comp rx=0 tx=0).stop 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 -- 172.21.15.146:0/1975208092 shutdown_connections 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 --2- 172.21.15.146:0/1975208092 >> v2:172.21.15.203:3300/0 conn(0x7ff504141ab0 0x7ff5040ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 --2- 172.21.15.146:0/1975208092 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff50413ef30 0x7ff504141570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 -- 172.21.15.146:0/1975208092 >> 172.21.15.146:0/1975208092 conn(0x7ff5040b17b0 msgr2=0x7ff5040b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 -- 172.21.15.146:0/1975208092 shutdown_connections 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.983+0000 7ff50b400640 1 -- 172.21.15.146:0/1975208092 wait complete. 2024-04-24T22:59:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.985+0000 7ff50b400640 1 Processor -- start 2024-04-24T22:59:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.986+0000 7ff50b400640 1 -- start start 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5040ce5a0 0x7ff5041538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff50413ef30 0x7ff504131d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040cea30 con 0x7ff504141ab0 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff504070c10 con 0x7ff50413ef30 2024-04-24T22:59:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff50b400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff504072420 con 0x7ff5040ce5a0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff509400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff509400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35320/0 (socket says 172.21.15.146:35320) 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff509400640 1 -- 172.21.15.146:0/481605205 learned_addr learned my addr 172.21.15.146:0/481605205 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff508a00640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5040ce5a0 0x7ff5041538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.987+0000 7ff4fbe00640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff50413ef30 0x7ff504131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 -- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5040ce5a0 msgr2=0x7ff5041538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5040ce5a0 0x7ff5041538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 -- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff50413ef30 msgr2=0x7ff504131d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff50413ef30 0x7ff504131d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 -- 172.21.15.146:0/481605205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50413a900 con 0x7ff504141ab0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff509400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7d0 tx=0x7ff4fc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc003b70 con 0x7ff504141ab0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc003d30 con 0x7ff504141ab0 2024-04-24T22:59:52.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50413a620 con 0x7ff504141ab0 2024-04-24T22:59:52.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00aa90 con 0x7ff504141ab0 2024-04-24T22:59:52.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.988+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff504154cc0 con 0x7ff504141ab0 2024-04-24T22:59:52.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.990+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50404f5a0 con 0x7ff504141ab0 2024-04-24T22:59:52.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.991+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4fc00ac30 con 0x7ff504141ab0 2024-04-24T22:59:52.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.992+0000 7ff501600640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 0x7ff4e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.992+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7ff4fc08acd0 con 0x7ff504141ab0 2024-04-24T22:59:52.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.993+0000 7ff508a00640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 0x7ff4e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.994+0000 7ff508a00640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 0x7ff4e006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4034000 tx=0x7ff4f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:52.997+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4fc0597c0 con 0x7ff504141ab0 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.198+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ff50413e640 con 0x7ff504141ab0 2024-04-24T22:59:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.761+0000 7ff501600640 1 -- 172.21.15.146:0/481605205 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7ff4fc0590c0 con 0x7ff504141ab0 2024-04-24T22:59:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T22:59:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 msgr2=0x7ff4e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 0x7ff4e006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4034000 tx=0x7ff4f402e000 comp rx=0 tx=0).stop 2024-04-24T22:59:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 msgr2=0x7ff50406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7d0 tx=0x7ff4fc00cc90 comp rx=0 tx=0).stop 2024-04-24T22:59:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 shutdown_connections 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff504141ab0 0x7ff50406d9e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff50413ef30 0x7ff504131d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff4e006be60 0x7ff4e006e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 --2- 172.21.15.146:0/481605205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5040ce5a0 0x7ff5041538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 >> 172.21.15.146:0/481605205 conn(0x7ff5040b17b0 msgr2=0x7ff50413f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.765+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 shutdown_connections 2024-04-24T22:59:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.766+0000 7ff50b400640 1 -- 172.21.15.146:0/481605205 wait complete. 2024-04-24T22:59:53.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T22:59:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.977+0000 7f02ce000640 1 Processor -- start 2024-04-24T22:59:53.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.978+0000 7f02ce000640 1 -- start start 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02ce000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f02c813ef30 0x7f02c8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02ce000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c80ced40 con 0x7f02c80ce770 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02ce000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c80cf020 con 0x7f02c8141ab0 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02ce000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f02c81423d0 con 0x7f02c813ef30 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02c7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f02c80ce770 0x7f02c8071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50890/0 (socket says 172.21.15.146:50890) 2024-04-24T22:59:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.979+0000 7f02c7e00640 1 -- 172.21.15.146:0/605400238 learned_addr learned my addr 172.21.15.146:0/605400238 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:53.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c7400640 1 --2- 172.21.15.146:0/605400238 >> v2:172.21.15.203:3300/0 conn(0x7f02c813ef30 0x7f02c8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288751060 0 0) 0x7f02c80ced40 con 0x7f02c80ce770 2024-04-24T22:59:53.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02ac003520 con 0x7f02c80ce770 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1773366468 0 0) 0x7f02ac003520 con 0x7f02c80ce770 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 >> v2:172.21.15.203:3300/0 conn(0x7f02c813ef30 msgr2=0x7f02c8141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 --2- 172.21.15.146:0/605400238 >> v2:172.21.15.203:3300/0 conn(0x7f02c813ef30 0x7f02c8141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 >> v1:172.21.15.203:6789/0 conn(0x7f02c8141ab0 legacy=0x7f02c80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c80cf300 con 0x7f02c80ce770 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f02c00019f0 con 0x7f02c80ce770 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 >> v1:172.21.15.146:6789/0 conn(0x7f02c80ce770 legacy=0x7f02c8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02ac003a00 0x7f02ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 0x7f02ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.980+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac00c090 con 0x7f02ac004800 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac00c240 con 0x7f02ac0051c0 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac00c440 con 0x7f02ac003a00 2024-04-24T22:59:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 0x7f02ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02c7400640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02ac003a00 0x7f02ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 -- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02ac003a00 msgr2=0x7f02ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02ac003a00 0x7f02ac003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 -- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac0051c0 msgr2=0x7f02ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac0051c0 0x7f02ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02bea00640 1 -- 172.21.15.146:0/605400238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac003520 con 0x7f02ac004800 2024-04-24T22:59:53.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.981+0000 7f02c7e00640 1 -- 172.21.15.146:0/605400238 reap_dead start 2024-04-24T22:59:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.982+0000 7f02bea00640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 0x7f02ac004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02b0001750 tx=0x7f02ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff06aae2a1636659 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.982+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0001370 con 0x7f02ac004800 2024-04-24T22:59:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b00052d0 con 0x7f02ac004800 2024-04-24T22:59:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02c6a00640 1 -- 172.21.15.146:0/605400238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b002abe0 con 0x7f02ac004800 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 -- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 msgr2=0x7f02ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 0x7f02ac004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02b0001750 tx=0x7f02ac005830 comp rx=0 tx=0).stop 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 -- 172.21.15.146:0/605400238 shutdown_connections 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 --2- 172.21.15.146:0/605400238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02ac004800 0x7f02ac004c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 -- 172.21.15.146:0/605400238 >> 172.21.15.146:0/605400238 conn(0x7f02c80b17b0 msgr2=0x7f02c80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 -- 172.21.15.146:0/605400238 shutdown_connections 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.983+0000 7f02ce000640 1 -- 172.21.15.146:0/605400238 wait complete. 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.985+0000 7f02ce000640 1 Processor -- start 2024-04-24T22:59:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.985+0000 7f02ce000640 1 -- start start 2024-04-24T22:59:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac004800 0x7f02c813ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02c813c4f0 0x7f02c80b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8141570 con 0x7f02c81526e0 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8070f80 con 0x7f02ac004800 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.986+0000 7f02ce000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02c81416f0 con 0x7f02c813c4f0 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35338/0 (socket says 172.21.15.146:35338) 2024-04-24T22:59:53.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 -- 172.21.15.146:0/2341813521 learned_addr learned my addr 172.21.15.146:0/2341813521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02c7e00640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02c813c4f0 0x7f02c80b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02c7400640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac004800 0x7f02c813ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 -- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02c813c4f0 msgr2=0x7f02c80b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02c813c4f0 0x7f02c80b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 -- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac004800 msgr2=0x7f02c813ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac004800 0x7f02c813ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.987+0000 7f02bea00640 1 -- 172.21.15.146:0/2341813521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c8145160 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02bea00640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02b002a590 tx=0x7f02b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b003f020 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b0005480 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0037040 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c8152b60 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.988+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c813b730 con 0x7f02c81526e0 2024-04-24T22:59:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.989+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c80ced40 con 0x7f02c81526e0 2024-04-24T22:59:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.990+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02b0042020 con 0x7f02c81526e0 2024-04-24T22:59:53.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.991+0000 7f02bfe00640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.991+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f02b00aa9b0 con 0x7f02c81526e0 2024-04-24T22:59:53.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.992+0000 7f02c7400640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.993+0000 7f02c7400640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 0x7f02a406e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02c8068840 tx=0x7f02b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:53.996+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f02c80ced40 con 0x7f02c81526e0 2024-04-24T22:59:54.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.237+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f02c8068a80 con 0x7f02c81526e0 2024-04-24T22:59:54.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.811+0000 7f02bfe00640 1 -- 172.21.15.146:0/2341813521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f02b0049030 con 0x7f02c81526e0 2024-04-24T22:59:54.818 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 2 and data pool 3 2024-04-24T22:59:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.820+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 msgr2=0x7f02a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.820+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 0x7f02a406e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02c8068840 tx=0x7f02b8008040 comp rx=0 tx=0).stop 2024-04-24T22:59:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.820+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 msgr2=0x7f02c8144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.820+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02b002a590 tx=0x7f02b0001120 comp rx=0 tx=0).stop 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 shutdown_connections 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02c813c4f0 0x7f02c80b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c81526e0 0x7f02c8144c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 --2- 172.21.15.146:0/2341813521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac004800 0x7f02c813ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.823+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 >> 172.21.15.146:0/2341813521 conn(0x7f02c80b17b0 msgr2=0x7f02c815ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.827+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 shutdown_connections 2024-04-24T22:59:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:54.828+0000 7f02ce000640 1 -- 172.21.15.146:0/2341813521 wait complete. 2024-04-24T22:59:54.862 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-24T22:59:54.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-24T22:59:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.041+0000 7f016a800640 1 Processor -- start 2024-04-24T22:59:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.041+0000 7f016a800640 1 -- start start 2024-04-24T22:59:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.041+0000 7f016a800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0164145510 0x7f01640728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f016a800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f016406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f016a800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01640cf040 con 0x7f016406d0c0 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f016a800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f01640cf320 con 0x7f0164145510 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f016a800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0164070c70 con 0x7f01640ceaf0 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0163e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f016406d0c0 0x7f016415f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50892/0 (socket says 172.21.15.146:50892) 2024-04-24T22:59:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0163e00640 1 -- 172.21.15.146:0/2673445136 learned_addr learned my addr 172.21.15.146:0/2673445136 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0163400640 1 --2- 172.21.15.146:0/2673445136 >> v2:172.21.15.203:3300/0 conn(0x7f0164145510 0x7f01640728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607996911 0 0) 0x7f01640cf040 con 0x7f016406d0c0 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0148003520 con 0x7f016406d0c0 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.042+0000 7f0162a00640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f016406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435991048 0 0) 0x7f0148003520 con 0x7f016406d0c0 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 msgr2=0x7f016406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f016406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 >> v2:172.21.15.203:3300/0 conn(0x7f0164145510 msgr2=0x7f01640728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 --2- 172.21.15.146:0/2673445136 >> v2:172.21.15.203:3300/0 conn(0x7f0164145510 0x7f01640728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0164070f50 con 0x7f016406d0c0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f015c0019f0 con 0x7f016406d0c0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 >> v1:172.21.15.146:6789/0 conn(0x7f016406d0c0 legacy=0x7f016415f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01480039b0 0x7f0148003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0148004800 0x7f0148004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f01480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01640cf320 con 0x7f01480039b0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0164070c70 con 0x7f0148004800 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f014800ba40 con 0x7f01640ceaf0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.043+0000 7f0163400640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01480039b0 0x7f0148003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0162a00640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0148004800 0x7f0148004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163e00640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f01480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163400640 1 -- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 msgr2=0x7f01480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163400640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01640ceaf0 0x7f01480051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163400640 1 -- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0148004800 msgr2=0x7f0148004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163400640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0148004800 0x7f0148004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.044+0000 7f0163400640 1 -- 172.21.15.146:0/2673445136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0148003520 con 0x7f01480039b0 2024-04-24T22:59:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f0163400640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01480039b0 0x7f0148003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0154009ac0 tx=0x7f0148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed2c1c602172629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154036070 con 0x7f01480039b0 2024-04-24T22:59:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0154031400 con 0x7f01480039b0 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f0162000640 1 -- 172.21.15.146:0/2673445136 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154009690 con 0x7f01480039b0 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f016a800640 1 -- 172.21.15.146:0/2673445136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01480039b0 msgr2=0x7f0148003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f016a800640 1 --2- 172.21.15.146:0/2673445136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01480039b0 0x7f0148003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0154009ac0 tx=0x7f0148005830 comp rx=0 tx=0).stop 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.045+0000 7f0163e00640 1 -- 172.21.15.146:0/2673445136 reap_dead start 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.046+0000 7f016a800640 1 -- 172.21.15.146:0/2673445136 shutdown_connections 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.046+0000 7f016a800640 1 -- 172.21.15.146:0/2673445136 >> 172.21.15.146:0/2673445136 conn(0x7f01640b16b0 msgr2=0x7f01640b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.046+0000 7f016a800640 1 -- 172.21.15.146:0/2673445136 shutdown_connections 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.046+0000 7f016a800640 1 -- 172.21.15.146:0/2673445136 wait complete. 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.047+0000 7f016a800640 1 Processor -- start 2024-04-24T22:59:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.048+0000 7f016a800640 1 -- start start 2024-04-24T22:59:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.048+0000 7f016a800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 0x7f016415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f016a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f016a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 0x7f01640b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f016a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01641458f0 con 0x7f016415c4f0 2024-04-24T22:59:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f016a800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0164072e10 con 0x7f0164132aa0 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f016a800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0164145a70 con 0x7f01480039b0 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35354/0 (socket says 172.21.15.146:35354) 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 -- 172.21.15.146:0/2192537225 learned_addr learned my addr 172.21.15.146:0/2192537225 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0163e00640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 0x7f01640b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0163400640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 0x7f016415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 -- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 msgr2=0x7f016415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 0x7f016415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 -- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 msgr2=0x7f01640b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 0x7f01640b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0162a00640 1 -- 172.21.15.146:0/2192537225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01641f5c70 con 0x7f016415c4f0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0163e00640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 0x7f01640b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.049+0000 7f0163400640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 0x7f016415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f0162a00640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0150010890 tx=0x7f0150010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015000f040 con 0x7f016415c4f0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015000eb00 con 0x7f016415c4f0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015001c400 con 0x7f016415c4f0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0164131fc0 con 0x7f016415c4f0 2024-04-24T22:59:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.050+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641f4f40 con 0x7f016415c4f0 2024-04-24T22:59:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.051+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0164068190 con 0x7f016415c4f0 2024-04-24T22:59:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.052+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f015001c5a0 con 0x7f016415c4f0 2024-04-24T22:59:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.053+0000 7f015b400640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 0x7f014406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.054+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f015008b3b0 con 0x7f016415c4f0 2024-04-24T22:59:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.054+0000 7f0163400640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 0x7f014406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.055+0000 7f0163400640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 0x7f014406e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0154009ac0 tx=0x7f0154008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.059+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0150018030 con 0x7f016415c4f0 2024-04-24T22:59:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.256+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f016406e9d0 con 0x7f016415c4f0 2024-04-24T22:59:55.745 INFO:tasks.ceph.mds.b.smithi203.stderr:2024-04-24T22:59:55.744+0000 7f43ea200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T22:59:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.815+0000 7f015b400640 1 -- 172.21.15.146:0/2192537225 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f0150059d60 con 0x7f016415c4f0 2024-04-24T22:59:55.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 msgr2=0x7f014406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 0x7f014406e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0154009ac0 tx=0x7f0154008030 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 msgr2=0x7f01640b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0150010890 tx=0x7f0150010d50 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 shutdown_connections 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0164132aa0 0x7f01640b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016415c4f0 0x7f01640b06d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f014406be60 0x7f014406e320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 --2- 172.21.15.146:0/2192537225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01480039b0 0x7f016415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 >> 172.21.15.146:0/2192537225 conn(0x7f01640b16b0 msgr2=0x7f016415dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.819+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 shutdown_connections 2024-04-24T22:59:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:55.820+0000 7f016a800640 1 -- 172.21.15.146:0/2192537225 wait complete. 2024-04-24T22:59:55.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T22:59:56.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.047+0000 7fd2e7400640 1 Processor -- start 2024-04-24T22:59:56.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.047+0000 7fd2e7400640 1 -- start start 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.048+0000 7fd2e7400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd2e00d2550 0x7fd2e00d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.048+0000 7fd2e7400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e00cf7a0 con 0x7fd2e01619c0 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.048+0000 7fd2e7400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e00b5760 con 0x7fd2e00b7530 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.048+0000 7fd2e7400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e00d2f00 con 0x7fd2e00d2550 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.049+0000 7fd2e4a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2e01619c0 0x7fd2e00b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50908/0 (socket says 172.21.15.146:50908) 2024-04-24T22:59:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.049+0000 7fd2e4a00640 1 -- 172.21.15.146:0/3313071330 learned_addr learned my addr 172.21.15.146:0/3313071330 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.049+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698334392 0 0) 0x7fd2e00cf7a0 con 0x7fd2e01619c0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.049+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c8003520 con 0x7fd2e01619c0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.049+0000 7fd2dfe00640 1 --2- 172.21.15.146:0/3313071330 >> v2:172.21.15.203:3300/0 conn(0x7fd2e00d2550 0x7fd2e00d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 423977224 0 0) 0x7fd2c8003520 con 0x7fd2e01619c0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 >> v2:172.21.15.203:3300/0 conn(0x7fd2e00d2550 msgr2=0x7fd2e00d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 --2- 172.21.15.146:0/3313071330 >> v2:172.21.15.203:3300/0 conn(0x7fd2e00d2550 0x7fd2e00d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 >> v1:172.21.15.203:6789/0 conn(0x7fd2e00b7530 legacy=0x7fd2e00b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e00cfa40 con 0x7fd2e01619c0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fd2d4001690 con 0x7fd2e01619c0 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 >> v1:172.21.15.146:6789/0 conn(0x7fd2e01619c0 legacy=0x7fd2e00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80039b0 0x7fd2c8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c8004800 0x7fd2c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 0x7fd2c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00d2f00 con 0x7fd2c80052e0 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c800c230 con 0x7fd2c8004800 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c800c430 con 0x7fd2c80039b0 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.050+0000 7fd2e5400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 0x7fd2c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 -- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80039b0 msgr2=0x7fd2c8003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80039b0 0x7fd2c8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 -- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c8004800 msgr2=0x7fd2c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2c8004800 0x7fd2c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 -- 172.21.15.146:0/3313071330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c8003520 con 0x7fd2c80052e0 2024-04-24T22:59:56.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.051+0000 7fd2e5400640 1 -- 172.21.15.146:0/3313071330 reap_dead start 2024-04-24T22:59:56.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.052+0000 7fd2e5400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 0x7fd2c800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001d20 tx=0x7fd2c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a64cf51173cb9ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:56.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.052+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8001920 con 0x7fd2c80052e0 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.052+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d802e070 con 0x7fd2c80052e0 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.052+0000 7fd2df400640 1 -- 172.21.15.146:0/3313071330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003970 con 0x7fd2c80052e0 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 -- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 msgr2=0x7fd2c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 0x7fd2c800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001d20 tx=0x7fd2c8005830 comp rx=0 tx=0).stop 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 -- 172.21.15.146:0/3313071330 shutdown_connections 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 --2- 172.21.15.146:0/3313071330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2c80052e0 0x7fd2c800b9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 -- 172.21.15.146:0/3313071330 >> 172.21.15.146:0/3313071330 conn(0x7fd2e00d3f70 msgr2=0x7fd2e00d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 -- 172.21.15.146:0/3313071330 shutdown_connections 2024-04-24T22:59:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.053+0000 7fd2e7400640 1 -- 172.21.15.146:0/3313071330 wait complete. 2024-04-24T22:59:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.054+0000 7fd2e7400640 1 Processor -- start 2024-04-24T22:59:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.055+0000 7fd2e7400640 1 -- start start 2024-04-24T22:59:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.055+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80052e0 0x7fd2e01e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.055+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e01f7350 0x7fd2e01f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e7400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00b7010 con 0x7fd2e00b7910 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e7400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00b6dc0 con 0x7fd2e01f7350 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e7400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e00d1f70 con 0x7fd2c80052e0 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35374/0 (socket says 172.21.15.146:35374) 2024-04-24T22:59:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 -- 172.21.15.146:0/945653863 learned_addr learned my addr 172.21.15.146:0/945653863 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 -- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80052e0 msgr2=0x7fd2e01e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e4a00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80052e0 0x7fd2e01e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80052e0 0x7fd2e01e7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2e5400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e01f7350 0x7fd2e01f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 -- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e01f7350 msgr2=0x7fd2e01f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e01f7350 0x7fd2e01f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.056+0000 7fd2dfe00640 1 -- 172.21.15.146:0/945653863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e00b8640 con 0x7fd2e00b7910 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2dfe00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00d800 tx=0x7fd2cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc018020 con 0x7fd2e00b7910 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00b6c0 con 0x7fd2e00b7910 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00ba90 con 0x7fd2e00b7910 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e00b8920 con 0x7fd2e00b7910 2024-04-24T22:59:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.057+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01f54f0 con 0x7fd2e00b7910 2024-04-24T22:59:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.058+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e0161da0 con 0x7fd2e00b7910 2024-04-24T22:59:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.059+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2cc01b020 con 0x7fd2e00b7910 2024-04-24T22:59:56.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.060+0000 7fd2dcc00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 0x7fd2c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:56.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.060+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fd2cc08b280 con 0x7fd2e00b7910 2024-04-24T22:59:56.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.061+0000 7fd2e4a00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 0x7fd2c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.062+0000 7fd2e4a00640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 0x7fd2c006e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4001eb0 tx=0x7fd2d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:56.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.066+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd2e0161da0 con 0x7fd2e00b7910 2024-04-24T22:59:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:56.251+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd2e00d2330 con 0x7fd2e00b7910 2024-04-24T22:59:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.127+0000 7fd2dcc00640 1 -- 172.21.15.146:0/945653863 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fd2cc022030 con 0x7fd2e00b7910 2024-04-24T22:59:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' created 2024-04-24T22:59:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.132+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 msgr2=0x7fd2c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.132+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 0x7fd2c006e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4001eb0 tx=0x7fd2d4009040 comp rx=0 tx=0).stop 2024-04-24T22:59:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.132+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 msgr2=0x7fd2e00b7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.132+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00d800 tx=0x7fd2cc00dcc0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 shutdown_connections 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e01f7350 0x7fd2e01f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e00b7910 0x7fd2e00b7d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2c006be60 0x7fd2c006e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 --2- 172.21.15.146:0/945653863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2c80052e0 0x7fd2e01e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.133+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 >> 172.21.15.146:0/945653863 conn(0x7fd2e00d3f70 msgr2=0x7fd2e015d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.134+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 shutdown_connections 2024-04-24T22:59:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.134+0000 7fd2e7400640 1 -- 172.21.15.146:0/945653863 wait complete. 2024-04-24T22:59:58.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-24T22:59:58.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.343+0000 7fbb02e00640 1 Processor -- start 2024-04-24T22:59:58.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.343+0000 7fbb02e00640 1 -- start start 2024-04-24T22:59:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.344+0000 7fbb02e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbafc1616f0 0x7fbafc161b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbb02e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbafc0ae160 0x7fbafc0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbb02e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbafc071c10 con 0x7fbafc072620 2024-04-24T22:59:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbb02e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc071ef0 con 0x7fbafc1616f0 2024-04-24T22:59:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbb02e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc0721d0 con 0x7fbafc0ae160 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbafc1616f0 0x7fbafc161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbafc1616f0 0x7fbafc161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49338/0 (socket says 172.21.15.146:49338) 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 -- 172.21.15.146:0/2425315222 learned_addr learned my addr 172.21.15.146:0/2425315222 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbaf3400640 1 --1- 172.21.15.146:0/2425315222 >> v1:172.21.15.146:6789/0 conn(0x7fbafc072620 0x7fbafc1620d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37894/0 (socket says 172.21.15.146:37894) 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbb00e00640 1 --2- 172.21.15.146:0/2425315222 >> v2:172.21.15.203:3300/0 conn(0x7fbafc0ae160 0x7fbafc0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 -- 172.21.15.146:0/2425315222 >> v2:172.21.15.203:3300/0 conn(0x7fbafc0ae160 msgr2=0x7fbafc0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 --2- 172.21.15.146:0/2425315222 >> v2:172.21.15.203:3300/0 conn(0x7fbafc0ae160 0x7fbafc0ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 -- 172.21.15.146:0/2425315222 >> v1:172.21.15.146:6789/0 conn(0x7fbafc072620 legacy=0x7fbafc1620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.345+0000 7fbafbe00640 1 -- 172.21.15.146:0/2425315222 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc0ad960 con 0x7fbafc1616f0 2024-04-24T22:59:58.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.346+0000 7fbafbe00640 1 --2- 172.21.15.146:0/2425315222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc161b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06f700 tx=0x7fbaec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c0c24d2527e1e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:58.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbafb400640 1 -- 172.21.15.146:0/2425315222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec037070 con 0x7fbafc1616f0 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbafb400640 1 -- 172.21.15.146:0/2425315222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec032440 con 0x7fbafc1616f0 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbafb400640 1 -- 172.21.15.146:0/2425315222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec032810 con 0x7fbafc1616f0 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbb02e00640 1 -- 172.21.15.146:0/2425315222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 msgr2=0x7fbafc161b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbb02e00640 1 --2- 172.21.15.146:0/2425315222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc161b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06f700 tx=0x7fbaec02a270 comp rx=0 tx=0).stop 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.347+0000 7fbb02e00640 1 -- 172.21.15.146:0/2425315222 shutdown_connections 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.348+0000 7fbb02e00640 1 --2- 172.21.15.146:0/2425315222 >> v2:172.21.15.203:3300/0 conn(0x7fbafc0ae160 0x7fbafc0ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.348+0000 7fbb02e00640 1 --2- 172.21.15.146:0/2425315222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc161b90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.348+0000 7fbb02e00640 1 -- 172.21.15.146:0/2425315222 >> 172.21.15.146:0/2425315222 conn(0x7fbafc0b16b0 msgr2=0x7fbafc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.348+0000 7fbb02e00640 1 -- 172.21.15.146:0/2425315222 shutdown_connections 2024-04-24T22:59:58.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.348+0000 7fbb02e00640 1 -- 172.21.15.146:0/2425315222 wait complete. 2024-04-24T22:59:58.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.349+0000 7fbb02e00640 1 Processor -- start 2024-04-24T22:59:58.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.349+0000 7fbb02e00640 1 -- start start 2024-04-24T22:59:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbafc072620 0x7fbafc14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbafc0ae160 0x7fbafc159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc06cdf0 con 0x7fbafc1616f0 2024-04-24T22:59:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc0718c0 con 0x7fbafc0ae160 2024-04-24T22:59:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.350+0000 7fbb02e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc1627e0 con 0x7fbafc072620 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49354/0 (socket says 172.21.15.146:49354) 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 -- 172.21.15.146:0/3171860349 learned_addr learned my addr 172.21.15.146:0/3171860349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbafbe00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbafc072620 0x7fbafc14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbaf3400640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbafc0ae160 0x7fbafc159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 -- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbafc072620 msgr2=0x7fbafc14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbafc072620 0x7fbafc14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 -- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbafc0ae160 msgr2=0x7fbafc159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbafc0ae160 0x7fbafc159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 -- 172.21.15.146:0/3171860349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc15cb70 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.351+0000 7fbb00e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007e40 tx=0x7fbaf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.352+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4014620 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.352+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4019070 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.352+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4014a20 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.352+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc15ce50 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.352+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc0cc010 con 0x7fbafc1616f0 2024-04-24T22:59:58.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.353+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc068190 con 0x7fbafc1616f0 2024-04-24T22:59:58.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.354+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaf4014bc0 con 0x7fbafc1616f0 2024-04-24T22:59:58.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.355+0000 7fbaf8c00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 0x7fbad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:58.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.355+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fbaf408bb30 con 0x7fbafc1616f0 2024-04-24T22:59:58.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.356+0000 7fbafbe00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 0x7fbad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.357+0000 7fbafbe00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 0x7fbad806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaec034000 tx=0x7fbaec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.360+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbaf405a120 con 0x7fbafc1616f0 2024-04-24T22:59:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:58.557+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fbafc156400 con 0x7fbafc1616f0 2024-04-24T22:59:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.132+0000 7fbaf8c00640 1 -- 172.21.15.146:0/3171860349 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fbaf4059a20 con 0x7fbafc1616f0 2024-04-24T22:59:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 4 allow_ec_overwrites to true 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.135+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 msgr2=0x7fbad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.135+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 0x7fbad806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaec034000 tx=0x7fbaec02e000 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 msgr2=0x7fbafc159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007e40 tx=0x7fbaf400e4b0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 shutdown_connections 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc1616f0 0x7fbafc159f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbafc0ae160 0x7fbafc159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbad806be30 0x7fbad806e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 --2- 172.21.15.146:0/3171860349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbafc072620 0x7fbafc14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.136+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 >> 172.21.15.146:0/3171860349 conn(0x7fbafc0b16b0 msgr2=0x7fbafc1579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.137+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 shutdown_connections 2024-04-24T22:59:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.137+0000 7fbb02e00640 1 -- 172.21.15.146:0/3171860349 wait complete. 2024-04-24T22:59:59.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-24T22:59:59.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.357+0000 7f6d31a00640 1 Processor -- start 2024-04-24T22:59:59.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.357+0000 7f6d31a00640 1 -- start start 2024-04-24T22:59:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 0x7f6d2c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d2c071520 0x7f6d2c0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d2c06e620 0x7f6d2c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2c15e3f0 con 0x7f6d2c06e620 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2c06cd20 con 0x7f6d2c071520 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d31a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c15f440 con 0x7f6d2c15e010 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.358+0000 7f6d2b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d2c06e620 0x7f6d2c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d2c06e620 0x7f6d2c06eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49366/0 (socket says 172.21.15.146:49366) 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 -- 172.21.15.146:0/4147358356 learned_addr learned my addr 172.21.15.146:0/4147358356 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2aa00640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 0x7f6d2c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d23e00640 1 --2- 172.21.15.146:0/4147358356 >> v2:172.21.15.203:3300/0 conn(0x7f6d2c071520 0x7f6d2c0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 -- 172.21.15.146:0/4147358356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 msgr2=0x7f6d2c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 0x7f6d2c06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 -- 172.21.15.146:0/4147358356 >> v2:172.21.15.203:3300/0 conn(0x7f6d2c071520 msgr2=0x7f6d2c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 --2- 172.21.15.146:0/4147358356 >> v2:172.21.15.203:3300/0 conn(0x7f6d2c071520 0x7f6d2c0719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2b400640 1 -- 172.21.15.146:0/4147358356 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c071fe0 con 0x7f6d2c06e620 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.359+0000 7f6d2aa00640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 0x7f6d2c06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.360+0000 7f6d2b400640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c06e620 0x7f6d2c06eab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06c3a0 tx=0x7f6d2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26259969c45fff6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.360+0000 7f6d2a000640 1 -- 172.21.15.146:0/4147358356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24036070 con 0x7f6d2c06e620 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.360+0000 7f6d2a000640 1 -- 172.21.15.146:0/4147358356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24031600 con 0x7f6d2c06e620 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.360+0000 7f6d2a000640 1 -- 172.21.15.146:0/4147358356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240319d0 con 0x7f6d2c06e620 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 -- 172.21.15.146:0/4147358356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c06e620 msgr2=0x7f6d2c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c06e620 0x7f6d2c06eab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06c3a0 tx=0x7f6d2402a6a0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 -- 172.21.15.146:0/4147358356 shutdown_connections 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c06e620 0x7f6d2c06eab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 --2- 172.21.15.146:0/4147358356 >> v2:172.21.15.203:3300/0 conn(0x7f6d2c071520 0x7f6d2c0719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 --2- 172.21.15.146:0/4147358356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c15e010 0x7f6d2c06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 -- 172.21.15.146:0/4147358356 >> 172.21.15.146:0/4147358356 conn(0x7f6d2c0b17b0 msgr2=0x7f6d2c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 -- 172.21.15.146:0/4147358356 shutdown_connections 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.361+0000 7f6d31a00640 1 -- 172.21.15.146:0/4147358356 wait complete. 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.363+0000 7f6d31a00640 1 Processor -- start 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.363+0000 7f6d31a00640 1 -- start start 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c06e620 0x7f6d2c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d2c15e010 0x7f6d2c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c06d580 con 0x7f6d2c071520 2024-04-24T22:59:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c06d2a0 con 0x7f6d2c15e010 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d31a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c06d860 con 0x7f6d2c06e620 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d23e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d23e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49376/0 (socket says 172.21.15.146:49376) 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.364+0000 7f6d23e00640 1 -- 172.21.15.146:0/3766596476 learned_addr learned my addr 172.21.15.146:0/3766596476 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d2aa00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c06e620 0x7f6d2c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 -- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c06e620 msgr2=0x7f6d2c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c06e620 0x7f6d2c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 -- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d2c15e010 msgr2=0x7f6d2c14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d2b400640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d2c15e010 0x7f6d2c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d2c15e010 0x7f6d2c14c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 -- 172.21.15.146:0/3766596476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c0c5d00 con 0x7f6d2c071520 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d23e00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400d800 tx=0x7f6d1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14018030 con 0x7f6d2c071520 2024-04-24T22:59:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d140096a0 con 0x7f6d2c071520 2024-04-24T22:59:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c14ccd0 con 0x7f6d2c071520 2024-04-24T22:59:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.365+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14009870 con 0x7f6d2c071520 2024-04-24T22:59:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.366+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c158690 con 0x7f6d2c071520 2024-04-24T22:59:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.367+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2c04f5a0 con 0x7f6d2c071520 2024-04-24T22:59:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.368+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d1401b070 con 0x7f6d2c071520 2024-04-24T22:59:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.368+0000 7f6d22a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 0x7f6d0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.369+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f6d1408b470 con 0x7f6d2c071520 2024-04-24T22:59:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.369+0000 7f6d2aa00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 0x7f6d0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.370+0000 7f6d2aa00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 0x7f6d0806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c1572a0 tx=0x7f6d1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.373+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6d2c14ccd0 con 0x7f6d2c071520 2024-04-24T22:59:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T22:59:59.601+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6d2c159c40 con 0x7f6d2c071520 2024-04-24T23:00:00.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.163+0000 7f6d22a00640 1 -- 172.21.15.146:0/3766596476 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f6d2c0c5d00 con 0x7f6d2c071520 2024-04-24T23:00:00.164 INFO:teuthology.orchestra.run.smithi146.stderr:added data pool 4 to fsmap 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.166+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 msgr2=0x7f6d0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.166+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 0x7f6d0806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c1572a0 tx=0x7f6d1c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.166+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 msgr2=0x7f6d2c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.166+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400d800 tx=0x7f6d1400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 shutdown_connections 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d2c15e010 0x7f6d2c14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c071520 0x7f6d2c0c57c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d0806be30 0x7f6d0806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 --2- 172.21.15.146:0/3766596476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d2c06e620 0x7f6d2c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 >> 172.21.15.146:0/3766596476 conn(0x7f6d2c0b17b0 msgr2=0x7f6d2c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 shutdown_connections 2024-04-24T23:00:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.167+0000 7f6d31a00640 1 -- 172.21.15.146:0/3766596476 wait complete. 2024-04-24T23:00:00.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:00.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.390+0000 7f28ce800640 1 Processor -- start 2024-04-24T23:00:00.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.390+0000 7f28ce800640 1 -- start start 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28ce800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28c80d0240 0x7f28c806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28ce800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28ce800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c80ccb10 con 0x7f28c815a980 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28ce800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f28c8072240 con 0x7f28c80d0240 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28ce800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28c80aede0 con 0x7f28c8071dd0 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28cd400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f28c815a980 0x7f28c80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37900/0 (socket says 172.21.15.146:37900) 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28cd400640 1 -- 172.21.15.146:0/4079329184 learned_addr learned my addr 172.21.15.146:0/4079329184 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:00.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.392+0000 7f28cca00640 1 --2- 172.21.15.146:0/4079329184 >> v2:172.21.15.146:3300/0 conn(0x7f28c80d0240 0x7f28c806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28cde00640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28c7e00640 1 -- 172.21.15.146:0/4079329184 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494766590 0 0) 0x7f28bc001490 con 0x7f28c815a980 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28c7e00640 1 -- 172.21.15.146:0/4079329184 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b0003520 con 0x7f28c815a980 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28cca00640 1 -- 172.21.15.146:0/4079329184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 msgr2=0x7f28c80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28cca00640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28cca00640 1 -- 172.21.15.146:0/4079329184 >> v1:172.21.15.146:6789/0 conn(0x7f28c815a980 legacy=0x7f28c80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.393+0000 7f28cca00640 1 -- 172.21.15.146:0/4079329184 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c806ddc0 con 0x7f28c80d0240 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.394+0000 7f28cca00640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c80d0240 0x7f28c806d770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097d0 tx=0x7f28b402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b406d4f38916037 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.394+0000 7f28c7e00640 1 -- 172.21.15.146:0/4079329184 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4037070 con 0x7f28c80d0240 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.394+0000 7f28c7e00640 1 -- 172.21.15.146:0/4079329184 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b402ae40 con 0x7f28c80d0240 2024-04-24T23:00:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.394+0000 7f28c7e00640 1 -- 172.21.15.146:0/4079329184 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4032660 con 0x7f28c80d0240 2024-04-24T23:00:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 -- 172.21.15.146:0/4079329184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c80d0240 msgr2=0x7f28c806d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c80d0240 0x7f28c806d770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28b40097d0 tx=0x7f28b402a130 comp rx=0 tx=0).stop 2024-04-24T23:00:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 -- 172.21.15.146:0/4079329184 shutdown_connections 2024-04-24T23:00:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c80ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 --2- 172.21.15.146:0/4079329184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c80d0240 0x7f28c806d770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 -- 172.21.15.146:0/4079329184 >> 172.21.15.146:0/4079329184 conn(0x7f28c806b320 msgr2=0x7f28c806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 -- 172.21.15.146:0/4079329184 shutdown_connections 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.395+0000 7f28ce800640 1 -- 172.21.15.146:0/4079329184 wait complete. 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.396+0000 7f28ce800640 1 Processor -- start 2024-04-24T23:00:00.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.396+0000 7f28ce800640 1 -- start start 2024-04-24T23:00:00.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 0x7f28c80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28c806e660 con 0x7f28c815a980 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28c806e380 con 0x7f28c80d0240 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.397+0000 7f28ce800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28c815ad60 con 0x7f28c8071dd0 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49400/0 (socket says 172.21.15.146:49400) 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 -- 172.21.15.146:0/2323238337 learned_addr learned my addr 172.21.15.146:0/2323238337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cca00640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 0x7f28c80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cd400640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 -- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 msgr2=0x7f28c814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 -- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 msgr2=0x7f28c80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 0x7f28c80c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 -- 172.21.15.146:0/2323238337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c80c4f40 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cca00640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 0x7f28c80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.398+0000 7f28cde00640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d5d0 tx=0x7f28c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.399+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00125f0 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.399+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c0019070 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.399+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00129f0 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.399+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c80c5220 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.399+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c80c57e0 con 0x7f28c815a980 2024-04-24T23:00:00.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.400+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c804f500 con 0x7f28c815a980 2024-04-24T23:00:00.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.401+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28c0012b90 con 0x7f28c815a980 2024-04-24T23:00:00.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.402+0000 7f28c5600640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 0x7f28a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.402+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f28c008b540 con 0x7f28c815a980 2024-04-24T23:00:00.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.402+0000 7f28cd400640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 0x7f28a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.403+0000 7f28cd400640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 0x7f28a806e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28bc001630 tx=0x7f28bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.406+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f28c0059bc0 con 0x7f28c815a980 2024-04-24T23:00:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.625+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28c80ced00 con 0x7f28c815a980 2024-04-24T23:00:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.626+0000 7f28c5600640 1 -- 172.21.15.146:0/2323238337 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7f28c00594c0 con 0x7f28c815a980 2024-04-24T23:00:00.627 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:00.627 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T22:59:59.603376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:00.627 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-04-24T23:00:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 msgr2=0x7f28a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 0x7f28a806e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28bc001630 tx=0x7f28bc009040 comp rx=0 tx=0).stop 2024-04-24T23:00:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 msgr2=0x7f28c8149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d5d0 tx=0x7f28c000da90 comp rx=0 tx=0).stop 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 shutdown_connections 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28c815a980 0x7f28c8149280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28c80d0240 0x7f28c80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f28a806be60 0x7f28a806e320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 --2- 172.21.15.146:0/2323238337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28c8071dd0 0x7f28c814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 >> 172.21.15.146:0/2323238337 conn(0x7f28c806b320 msgr2=0x7f28c80b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.628+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 shutdown_connections 2024-04-24T23:00:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.629+0000 7f28ce800640 1 -- 172.21.15.146:0/2323238337 wait complete. 2024-04-24T23:00:00.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.844+0000 7fcc5ae00640 1 Processor -- start 2024-04-24T23:00:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.844+0000 7fcc5ae00640 1 -- start start 2024-04-24T23:00:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc5ae00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc54161580 0x7fcc5406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc5ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc5ae00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc54071550 con 0x7fcc540ad8c0 2024-04-24T23:00:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc5ae00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc54071300 con 0x7fcc54161580 2024-04-24T23:00:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc5ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc54072160 con 0x7fcc5406eab0 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc59000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc59a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc54161580 0x7fcc5406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc59000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:47088/0 (socket says 172.21.15.146:47088) 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.846+0000 7fcc59000640 1 -- 172.21.15.146:0/2495889452 learned_addr learned my addr 172.21.15.146:0/2495889452 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.847+0000 7fcc59000640 1 -- 172.21.15.146:0/2495889452 >> v2:172.21.15.203:3300/0 conn(0x7fcc54161580 msgr2=0x7fcc5406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.847+0000 7fcc59000640 1 --2- 172.21.15.146:0/2495889452 >> v2:172.21.15.203:3300/0 conn(0x7fcc54161580 0x7fcc5406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.847+0000 7fcc59000640 1 -- 172.21.15.146:0/2495889452 >> v1:172.21.15.203:6789/0 conn(0x7fcc540ad8c0 legacy=0x7fcc540b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.847+0000 7fcc59000640 1 -- 172.21.15.146:0/2495889452 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc54071830 con 0x7fcc5406eab0 2024-04-24T23:00:00.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.849+0000 7fcc59000640 1 --2- 172.21.15.146:0/2495889452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009870 tx=0x7fcc4002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa14fd3707a8298e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.849+0000 7fcc53e00640 1 -- 172.21.15.146:0/2495889452 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40037070 con 0x7fcc5406eab0 2024-04-24T23:00:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc53e00640 1 -- 172.21.15.146:0/2495889452 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40032440 con 0x7fcc5406eab0 2024-04-24T23:00:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc53e00640 1 -- 172.21.15.146:0/2495889452 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40032810 con 0x7fcc5406eab0 2024-04-24T23:00:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 -- 172.21.15.146:0/2495889452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 msgr2=0x7fcc5406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/2495889452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009870 tx=0x7fcc4002a250 comp rx=0 tx=0).stop 2024-04-24T23:00:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 -- 172.21.15.146:0/2495889452 shutdown_connections 2024-04-24T23:00:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/2495889452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc5406ef10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/2495889452 >> v2:172.21.15.203:3300/0 conn(0x7fcc54161580 0x7fcc5406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 -- 172.21.15.146:0/2495889452 >> 172.21.15.146:0/2495889452 conn(0x7fcc540b1740 msgr2=0x7fcc540b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 -- 172.21.15.146:0/2495889452 shutdown_connections 2024-04-24T23:00:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.850+0000 7fcc5ae00640 1 -- 172.21.15.146:0/2495889452 wait complete. 2024-04-24T23:00:00.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.852+0000 7fcc5ae00640 1 Processor -- start 2024-04-24T23:00:00.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.853+0000 7fcc5ae00640 1 -- start start 2024-04-24T23:00:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc54152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54161580 0x7fcc5413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540add20 con 0x7fcc540ad8c0 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54071df0 con 0x7fcc54161580 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc5ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc540adea0 con 0x7fcc5406eab0 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc59000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc59000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49408/0 (socket says 172.21.15.146:49408) 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.854+0000 7fcc59000640 1 -- 172.21.15.146:0/590190695 learned_addr learned my addr 172.21.15.146:0/590190695 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 -- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 msgr2=0x7fcc54152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59a00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc54152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc5a400640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54161580 0x7fcc5413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc54152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 -- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54161580 msgr2=0x7fcc5413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54161580 0x7fcc5413cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 -- 172.21.15.146:0/590190695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5415a600 con 0x7fcc540ad8c0 2024-04-24T23:00:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc59000640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000c00 tx=0x7fcc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40037040 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40042070 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40030880 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5415a8e0 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.855+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5415aea0 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.857+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5404f500 con 0x7fcc540ad8c0 2024-04-24T23:00:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.857+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc40030a20 con 0x7fcc540ad8c0 2024-04-24T23:00:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.858+0000 7fcc51600640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 0x7fcc3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.858+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcc400aba80 con 0x7fcc540ad8c0 2024-04-24T23:00:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.859+0000 7fcc59a00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 0x7fcc3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:00.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.860+0000 7fcc59a00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 0x7fcc3406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009970 tx=0x7fcc48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:00.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:00.863+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc4007a050 con 0x7fcc540ad8c0 2024-04-24T23:00:01.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.067+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc540aec70 con 0x7fcc540ad8c0 2024-04-24T23:00:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.069+0000 7fcc51600640 1 -- 172.21.15.146:0/590190695 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7fcc40079950 con 0x7fcc540ad8c0 2024-04-24T23:00:01.071 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:01.071 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 msgr2=0x7fcc3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 0x7fcc3406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009970 tx=0x7fcc48008040 comp rx=0 tx=0).stop 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 msgr2=0x7fcc54159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000c00 tx=0x7fcc400046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 shutdown_connections 2024-04-24T23:00:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54161580 0x7fcc5413cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc540ad8c0 0x7fcc54159e70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc3406be60 0x7fcc3406e320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 --2- 172.21.15.146:0/590190695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc5406eab0 0x7fcc54152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 >> 172.21.15.146:0/590190695 conn(0x7fcc540b1740 msgr2=0x7fcc540b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 shutdown_connections 2024-04-24T23:00:01.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.072+0000 7fcc5ae00640 1 -- 172.21.15.146:0/590190695 wait complete. 2024-04-24T23:00:01.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:01.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.294+0000 7fcebbe00640 1 Processor -- start 2024-04-24T23:00:01.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.294+0000 7fcebbe00640 1 -- start start 2024-04-24T23:00:01.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fcebbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcebc0d0240 0x7fcebc168970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fcebbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc15e1b0 con 0x7fcebc072920 2024-04-24T23:00:01.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fcebbe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc0713b0 con 0x7fcebc15ddd0 2024-04-24T23:00:01.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fcebbe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcebc071690 con 0x7fcebc0d0240 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fceb2000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcebc072920 0x7fcebc0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37910/0 (socket says 172.21.15.146:37910) 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fceb2000640 1 -- 172.21.15.146:0/1365092179 learned_addr learned my addr 172.21.15.146:0/1365092179 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.296+0000 7fcebb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcebc0d0240 0x7fcebc168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.297+0000 7fcebb400640 1 -- 172.21.15.146:0/1365092179 >> v1:172.21.15.203:6789/0 conn(0x7fcebc15ddd0 legacy=0x7fcebc070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.297+0000 7fcebb400640 1 -- 172.21.15.146:0/1365092179 >> v1:172.21.15.146:6789/0 conn(0x7fcebc072920 legacy=0x7fcebc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.297+0000 7fceba000640 1 -- 172.21.15.146:0/1365092179 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523729141 0 0) 0x7fcebc15e1b0 con 0x7fcebc072920 2024-04-24T23:00:01.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.297+0000 7fcebb400640 1 -- 172.21.15.146:0/1365092179 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc071970 con 0x7fcebc0d0240 2024-04-24T23:00:01.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.298+0000 7fcebb400640 1 --2- 172.21.15.146:0/1365092179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc0d0240 0x7fcebc168970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009d90 tx=0x7fceb402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea886b259a717db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.298+0000 7fceba000640 1 -- 172.21.15.146:0/1365092179 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007740 con 0x7fcebc0d0240 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.298+0000 7fceba000640 1 -- 172.21.15.146:0/1365092179 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb40078e0 con 0x7fcebc0d0240 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.298+0000 7fceba000640 1 -- 172.21.15.146:0/1365092179 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007cb0 con 0x7fcebc0d0240 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 -- 172.21.15.146:0/1365092179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc0d0240 msgr2=0x7fcebc168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 --2- 172.21.15.146:0/1365092179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc0d0240 0x7fcebc168970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009d90 tx=0x7fceb402a6f0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 -- 172.21.15.146:0/1365092179 shutdown_connections 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 --2- 172.21.15.146:0/1365092179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc0d0240 0x7fcebc168970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 -- 172.21.15.146:0/1365092179 >> 172.21.15.146:0/1365092179 conn(0x7fcebc06b320 msgr2=0x7fcebc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 -- 172.21.15.146:0/1365092179 shutdown_connections 2024-04-24T23:00:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.299+0000 7fcebbe00640 1 -- 172.21.15.146:0/1365092179 wait complete. 2024-04-24T23:00:01.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.301+0000 7fcebbe00640 1 Processor -- start 2024-04-24T23:00:01.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.301+0000 7fcebbe00640 1 -- start start 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0d0240 0x7fcebc157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15ddd0 0x7fcebc159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0b3d90 con 0x7fcebc072920 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0b3c10 con 0x7fcebc15ddd0 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0b3f10 con 0x7fcebc0d0240 2024-04-24T23:00:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49426/0 (socket says 172.21.15.146:49426) 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 -- 172.21.15.146:0/489635572 learned_addr learned my addr 172.21.15.146:0/489635572 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 -- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0d0240 msgr2=0x7fcebc157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0d0240 0x7fcebc157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 -- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15ddd0 msgr2=0x7fcebc159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15ddd0 0x7fcebc159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.302+0000 7fcebaa00640 1 -- 172.21.15.146:0/489635572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc1478d0 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fcebaa00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c400 tx=0x7fceac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0052d0 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac003830 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc1f7690 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.303+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc1f7c50 con 0x7fcebc072920 2024-04-24T23:00:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.304+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcebc04f500 con 0x7fcebc072920 2024-04-24T23:00:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.305+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fceac01a070 con 0x7fcebc072920 2024-04-24T23:00:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.306+0000 7fceb3e00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.306+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fceac08a4b0 con 0x7fcebc072920 2024-04-24T23:00:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.306+0000 7fceb2000640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.307+0000 7fceb2000640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 0x7fce9806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.310+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcebc1478d0 con 0x7fcebc072920 2024-04-24T23:00:01.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.496+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcebc15c3d0 con 0x7fcebc072920 2024-04-24T23:00:01.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.499+0000 7fceb3e00640 1 -- 172.21.15.146:0/489635572 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7fceac058bb0 con 0x7fcebc072920 2024-04-24T23:00:01.501 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 msgr2=0x7fce9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 0x7fce9806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4007930 comp rx=0 tx=0).stop 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 msgr2=0x7fcebc147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c400 tx=0x7fceac00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 shutdown_connections 2024-04-24T23:00:01.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15ddd0 0x7fcebc159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce9806be30 0x7fce9806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0d0240 0x7fcebc157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 --2- 172.21.15.146:0/489635572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcebc072920 0x7fcebc147390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 >> 172.21.15.146:0/489635572 conn(0x7fcebc06b320 msgr2=0x7fcebc1586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 shutdown_connections 2024-04-24T23:00:01.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.502+0000 7fcebbe00640 1 -- 172.21.15.146:0/489635572 wait complete. 2024-04-24T23:00:01.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:01.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.724+0000 7f6efb000640 1 Processor -- start 2024-04-24T23:00:01.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.724+0000 7f6efb000640 1 -- start start 2024-04-24T23:00:01.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.725+0000 7f6efb000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 0x7f6ef40b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40b2dc0 0x7f6ef415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efb000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efb000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef40d4bc0 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efb000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef40cf5b0 con 0x7f6ef40d06e0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40d48e0 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49436/0 (socket says 172.21.15.146:49436) 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 -- 172.21.15.146:0/2296147564 learned_addr learned my addr 172.21.15.146:0/2296147564 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6ef9c00640 1 --2- 172.21.15.146:0/2296147564 >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 0x7f6ef40b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 -- 172.21.15.146:0/2296147564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40b2dc0 msgr2=0x7f6ef415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6ef9200640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40b2dc0 0x7f6ef415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40b2dc0 0x7f6ef415dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 -- 172.21.15.146:0/2296147564 >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 msgr2=0x7f6ef40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 --2- 172.21.15.146:0/2296147564 >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 0x7f6ef40b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6efa600640 1 -- 172.21.15.146:0/2296147564 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef40cf850 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.726+0000 7f6ef9c00640 1 --2- 172.21.15.146:0/2296147564 >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 0x7f6ef40b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.727+0000 7f6efa600640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40b6860 tx=0x7f6eec02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8e03b86cf7ef8e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6ef3e00640 1 -- 172.21.15.146:0/2296147564 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec036070 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6ef3e00640 1 -- 172.21.15.146:0/2296147564 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec031600 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6ef3e00640 1 -- 172.21.15.146:0/2296147564 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0319d0 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 -- 172.21.15.146:0/2296147564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40d0ac0 msgr2=0x7f6ef415e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40b6860 tx=0x7f6eec02a570 comp rx=0 tx=0).stop 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 -- 172.21.15.146:0/2296147564 shutdown_connections 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef415e3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 --2- 172.21.15.146:0/2296147564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40b2dc0 0x7f6ef415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 --2- 172.21.15.146:0/2296147564 >> v2:172.21.15.203:3300/0 conn(0x7f6ef40d06e0 0x7f6ef40b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.728+0000 7f6efb000640 1 -- 172.21.15.146:0/2296147564 >> 172.21.15.146:0/2296147564 conn(0x7f6ef40d3d20 msgr2=0x7f6ef40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:01.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.729+0000 7f6efb000640 1 -- 172.21.15.146:0/2296147564 shutdown_connections 2024-04-24T23:00:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.729+0000 7f6efb000640 1 -- 172.21.15.146:0/2296147564 wait complete. 2024-04-24T23:00:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.730+0000 7f6efb000640 1 Processor -- start 2024-04-24T23:00:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.730+0000 7f6efb000640 1 -- start start 2024-04-24T23:00:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40d06e0 0x7f6ef40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef40cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40d2e40 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40d2cc0 con 0x7f6ef40d0ac0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6efb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40d1c20 con 0x7f6ef40d06e0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.731+0000 7f6ef9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49450/0 (socket says 172.21.15.146:49450) 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 -- 172.21.15.146:0/1367398859 learned_addr learned my addr 172.21.15.146:0/1367398859 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 -- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40d06e0 msgr2=0x7f6ef40ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40d06e0 0x7f6ef40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 -- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ef40d0ac0 msgr2=0x7f6ef40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef40cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 -- 172.21.15.146:0/1367398859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef40c7980 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef9c00640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800c7f0 tx=0x7f6ee800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8015070 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8007a30 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8007e00 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.732+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef40c7c60 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.733+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef40c8220 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.734+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef40c8650 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.734+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ee8018070 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.736+0000 7f6ef1600640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 0x7f6ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.736+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6ee808b1c0 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.736+0000 7f6ef9200640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 0x7f6ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:01.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.737+0000 7f6ef9200640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 0x7f6ed406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006b10 tx=0x7f6ee0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.740+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6ee8059820 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.961+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef404f500 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.962+0000 7f6ef1600640 1 -- 172.21.15.146:0/1367398859 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7f6ee8059120 con 0x7f6ef40b2dc0 2024-04-24T23:00:01.964 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:01.964 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T22:59:59.603376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-04-24T23:00:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 msgr2=0x7f6ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 0x7f6ed406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006b10 tx=0x7f6ee0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 msgr2=0x7f6ef415c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800c7f0 tx=0x7f6ee800cbf0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 shutdown_connections 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ef40d0ac0 0x7f6ef40cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ed406be30 0x7f6ed406e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ef40d06e0 0x7f6ef40ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 --2- 172.21.15.146:0/1367398859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef40b2dc0 0x7f6ef415c2d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 >> 172.21.15.146:0/1367398859 conn(0x7f6ef40d3d20 msgr2=0x7f6ef40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 shutdown_connections 2024-04-24T23:00:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:01.965+0000 7f6efb000640 1 -- 172.21.15.146:0/1367398859 wait complete. 2024-04-24T23:00:01.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.174+0000 7fa40be00640 1 Processor -- start 2024-04-24T23:00:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.174+0000 7fa40be00640 1 -- start start 2024-04-24T23:00:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa40c15a980 0x7fa40c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c071dd0 0x7fa40c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 0x7fa40c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa40c072230 con 0x7fa40c15a980 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa40c0aede0 con 0x7fa40c0d0070 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa40c0ccb10 con 0x7fa40c071dd0 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa40c15a980 0x7fa40c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa40c15a980 0x7fa40c06d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49460/0 (socket says 172.21.15.146:49460) 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 -- 172.21.15.146:0/2322678493 learned_addr learned my addr 172.21.15.146:0/2322678493 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40a000640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c071dd0 0x7fa40c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 -- 172.21.15.146:0/2322678493 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c071dd0 msgr2=0x7fa40c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c071dd0 0x7fa40c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40aa00640 1 -- 172.21.15.146:0/2322678493 >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 msgr2=0x7fa40c0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.176+0000 7fa40b400640 1 --2- 172.21.15.146:0/2322678493 >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 0x7fa40c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.177+0000 7fa40aa00640 1 --2- 172.21.15.146:0/2322678493 >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 0x7fa40c0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.177+0000 7fa40aa00640 1 -- 172.21.15.146:0/2322678493 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c06ddc0 con 0x7fa40c15a980 2024-04-24T23:00:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.177+0000 7fa40b400640 1 --2- 172.21.15.146:0/2322678493 >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 0x7fa40c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.178+0000 7fa40aa00640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c06d770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0cc8c0 tx=0x7fa3fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b421e7e46b79bb83 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.178+0000 7fa409600640 1 -- 172.21.15.146:0/2322678493 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc037070 con 0x7fa40c15a980 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.178+0000 7fa409600640 1 -- 172.21.15.146:0/2322678493 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3fc032440 con 0x7fa40c15a980 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.178+0000 7fa409600640 1 -- 172.21.15.146:0/2322678493 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc032810 con 0x7fa40c15a980 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 -- 172.21.15.146:0/2322678493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 msgr2=0x7fa40c06d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c06d770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0cc8c0 tx=0x7fa3fc02a140 comp rx=0 tx=0).stop 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 -- 172.21.15.146:0/2322678493 shutdown_connections 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 --2- 172.21.15.146:0/2322678493 >> v2:172.21.15.203:3300/0 conn(0x7fa40c0d0070 0x7fa40c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c071dd0 0x7fa40c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 --2- 172.21.15.146:0/2322678493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c06d770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 -- 172.21.15.146:0/2322678493 >> 172.21.15.146:0/2322678493 conn(0x7fa40c06b320 msgr2=0x7fa40c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:02.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 -- 172.21.15.146:0/2322678493 shutdown_connections 2024-04-24T23:00:02.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.179+0000 7fa40be00640 1 -- 172.21.15.146:0/2322678493 wait complete. 2024-04-24T23:00:02.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.181+0000 7fa40be00640 1 Processor -- start 2024-04-24T23:00:02.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.181+0000 7fa40be00640 1 -- start start 2024-04-24T23:00:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa40c071dd0 0x7fa40c14c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c0d0070 0x7fa40c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c06e660 con 0x7fa40c15a980 2024-04-24T23:00:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c06e380 con 0x7fa40c071dd0 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa40c15ad60 con 0x7fa40c0d0070 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49474/0 (socket says 172.21.15.146:49474) 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 -- 172.21.15.146:0/3323292335 learned_addr learned my addr 172.21.15.146:0/3323292335 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40a000640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c0d0070 0x7fa40c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40aa00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa40c071dd0 0x7fa40c14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 -- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c0d0070 msgr2=0x7fa40c0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c0d0070 0x7fa40c0b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 -- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa40c071dd0 msgr2=0x7fa40c14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa40c071dd0 0x7fa40c14c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.182+0000 7fa40b400640 1 -- 172.21.15.146:0/3323292335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c15bee0 con 0x7fa40c15a980 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa40b400640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cf20 tx=0x7fa40400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40401a070 con 0x7fa40c15a980 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40400d840 con 0x7fa40c15a980 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40400dc30 con 0x7fa40c15a980 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c15c1c0 con 0x7fa40c15a980 2024-04-24T23:00:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.183+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c15c780 con 0x7fa40c15a980 2024-04-24T23:00:02.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.184+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40c04f500 con 0x7fa40c15a980 2024-04-24T23:00:02.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.185+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa40401d070 con 0x7fa40c15a980 2024-04-24T23:00:02.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.186+0000 7fa402a00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 0x7fa3ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.186+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa40408b930 con 0x7fa40c15a980 2024-04-24T23:00:02.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.186+0000 7fa40aa00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 0x7fa3ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.187+0000 7fa40aa00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 0x7fa3ec06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.190+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa40405a030 con 0x7fa40c15a980 2024-04-24T23:00:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.390+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa40c0ae8b0 con 0x7fa40c15a980 2024-04-24T23:00:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.392+0000 7fa402a00640 1 -- 172.21.15.146:0/3323292335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7fa404059930 con 0x7fa40c15a980 2024-04-24T23:00:02.394 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:02.394 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 msgr2=0x7fa3ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 0x7fa3ec06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 msgr2=0x7fa40c0b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cf20 tx=0x7fa40400a7d0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 shutdown_connections 2024-04-24T23:00:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa40c15a980 0x7fa40c0b1a80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa3ec06be30 0x7fa3ec06e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa40c0d0070 0x7fa40c0b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 --2- 172.21.15.146:0/3323292335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa40c071dd0 0x7fa40c14c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 >> 172.21.15.146:0/3323292335 conn(0x7fa40c06b320 msgr2=0x7fa40c0b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 shutdown_connections 2024-04-24T23:00:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:02.395+0000 7fa40be00640 1 -- 172.21.15.146:0/3323292335 wait complete. 2024-04-24T23:00:02.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T22:59:54.240496+0000', 'modified': '2024-04-24T22:59:59.603376+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/554633282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 554633282}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 554633282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-04-24T23:00:02.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:00:02.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-24T23:00:03.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.020+0000 7f23cbe00640 1 Processor -- start 2024-04-24T23:00:03.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.020+0000 7f23cbe00640 1 -- start start 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23cbe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f23c4070ba0 0x7f23c406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23cbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c4142950 con 0x7f23c40720d0 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23cbe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c4071030 con 0x7f23c4142570 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23cbe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f23c4071c40 con 0x7f23c4070ba0 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23c9e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f23c40720d0 0x7f23c415fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37922/0 (socket says 172.21.15.146:37922) 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23c9e00640 1 -- 172.21.15.146:0/742681232 learned_addr learned my addr 172.21.15.146:0/742681232 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.022+0000 7f23c8a00640 1 --2- 172.21.15.146:0/742681232 >> v2:172.21.15.203:3300/0 conn(0x7f23c4070ba0 0x7f23c406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756706584 0 0) 0x7f23c4142950 con 0x7f23c40720d0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ac003520 con 0x7f23c40720d0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161631782 0 0) 0x7f23ac003520 con 0x7f23c40720d0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 >> v2:172.21.15.203:3300/0 conn(0x7f23c4070ba0 msgr2=0x7f23c406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 --2- 172.21.15.146:0/742681232 >> v2:172.21.15.203:3300/0 conn(0x7f23c4070ba0 0x7f23c406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 >> v1:172.21.15.203:6789/0 conn(0x7f23c4142570 legacy=0x7f23c406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4071310 con 0x7f23c40720d0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f23bc0019f0 con 0x7f23c40720d0 2024-04-24T23:00:03.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 >> v1:172.21.15.146:6789/0 conn(0x7f23c40720d0 legacy=0x7f23c415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23ac0051c0 0x7f23ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4071c40 con 0x7f23ac0039b0 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac00c060 con 0x7f23ac0051c0 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac00c260 con 0x7f23ac004800 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.023+0000 7f23c9400640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9e00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23ac0051c0 0x7f23ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c8a00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9400640 1 -- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23ac004800 msgr2=0x7f23ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9400640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9400640 1 -- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23ac0051c0 msgr2=0x7f23ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9400640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23ac0051c0 0x7f23ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9400640 1 -- 172.21.15.146:0/742681232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac003520 con 0x7f23ac0039b0 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9e00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23ac0051c0 0x7f23ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.024+0000 7f23c9e00640 1 -- 172.21.15.146:0/742681232 reap_dead start 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.025+0000 7f23c9400640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001750 tx=0x7f23ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc53e7ce5fe38227 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.025+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8001370 con 0x7f23ac0039b0 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.025+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b80052d0 con 0x7f23ac0039b0 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.025+0000 7f23c3e00640 1 -- 172.21.15.146:0/742681232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b802abc0 con 0x7f23ac0039b0 2024-04-24T23:00:03.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 -- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 msgr2=0x7f23ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001750 tx=0x7f23ac005830 comp rx=0 tx=0).stop 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 -- 172.21.15.146:0/742681232 shutdown_connections 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 --2- 172.21.15.146:0/742681232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 -- 172.21.15.146:0/742681232 >> 172.21.15.146:0/742681232 conn(0x7f23c406b140 msgr2=0x7f23c406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 -- 172.21.15.146:0/742681232 shutdown_connections 2024-04-24T23:00:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.026+0000 7f23cbe00640 1 -- 172.21.15.146:0/742681232 wait complete. 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.028+0000 7f23cbe00640 1 Processor -- start 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.028+0000 7f23cbe00640 1 -- start start 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23c41f7870 0x7f23c40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 0x7f23c40b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4072c60 con 0x7f23ac0039b0 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40718d0 con 0x7f23c41f7cd0 2024-04-24T23:00:03.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23cbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f23c4072de0 con 0x7f23c41f7870 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49506/0 (socket says 172.21.15.146:49506) 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 -- 172.21.15.146:0/2324336622 learned_addr learned my addr 172.21.15.146:0/2324336622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9e00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 0x7f23c40b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23c41f7870 0x7f23c40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 -- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23c41f7870 msgr2=0x7f23c40b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23c41f7870 0x7f23c40b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 -- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 msgr2=0x7f23c40b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 0x7f23c40b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9400640 1 -- 172.21.15.146:0/2324336622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4131d20 con 0x7f23ac0039b0 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.029+0000 7f23c9e00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 0x7f23c40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23c9400640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005040 tx=0x7f23b8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23c1600640 1 -- 172.21.15.146:0/2324336622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8037040 con 0x7f23ac0039b0 2024-04-24T23:00:03.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23c1600640 1 -- 172.21.15.146:0/2324336622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8040070 con 0x7f23ac0039b0 2024-04-24T23:00:03.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23c1600640 1 -- 172.21.15.146:0/2324336622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8007a30 con 0x7f23ac0039b0 2024-04-24T23:00:03.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c4132000 con 0x7f23ac0039b0 2024-04-24T23:00:03.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.030+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c41325c0 con 0x7f23ac0039b0 2024-04-24T23:00:03.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.033+0000 7f23c1600640 1 -- 172.21.15.146:0/2324336622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23b80052d0 con 0x7f23ac0039b0 2024-04-24T23:00:03.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.034+0000 7f23c1600640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 0x7f23a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.034+0000 7f23c1600640 1 -- 172.21.15.146:0/2324336622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23b80aae60 con 0x7f23ac0039b0 2024-04-24T23:00:03.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.035+0000 7f23cedbe740 1 Processor -- start 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.035+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 0x7f23a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.035+0000 7f23cedbe740 1 -- start start 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x56414026d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414028adb0 0x56414028b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564140142ed0 con 0x5641402431f0 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641401a5df0 con 0x56414026d510 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56414014e8d0 con 0x56414028adb0 2024-04-24T23:00:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 0x7f23a406e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c40aef70 tx=0x7f23b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49508/0 (socket says 172.21.15.146:49508) 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 -- 172.21.15.146:0/1382155524 learned_addr learned my addr 172.21.15.146:0/1382155524 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9400640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x56414026d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c8a00640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414028adb0 0x56414028b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 -- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414028adb0 msgr2=0x56414028b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414028adb0 0x56414028b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 -- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 msgr2=0x56414026d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x56414026d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9e00640 1 -- 172.21.15.146:0/1382155524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413feba2d0 con 0x5641402431f0 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.036+0000 7f23c9400640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x56414026d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23c9e00640 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000f80 tx=0x7f23bc00e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1e6ea993701b5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23b5c00640 1 -- 172.21.15.146:0/1382155524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc018070 con 0x5641402431f0 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23b5c00640 1 -- 172.21.15.146:0/1382155524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc004d60 con 0x5641402431f0 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23b5c00640 1 -- 172.21.15.146:0/1382155524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc007310 con 0x5641402431f0 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23cedbe740 1 -- 172.21.15.146:0/1382155524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 msgr2=0x564140289470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.037+0000 7f23cedbe740 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000f80 tx=0x7f23bc00e590 comp rx=0 tx=0).stop 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 -- 172.21.15.146:0/1382155524 shutdown_connections 2024-04-24T23:00:03.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x564140289470 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414028adb0 0x56414028b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 --2- 172.21.15.146:0/1382155524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x56414026d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 -- 172.21.15.146:0/1382155524 >> 172.21.15.146:0/1382155524 conn(0x56414023fb20 msgr2=0x564140288320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 -- 172.21.15.146:0/1382155524 shutdown_connections 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 -- 172.21.15.146:0/1382155524 wait complete. 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.038+0000 7f23cedbe740 1 -- start start 2024-04-24T23:00:03.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.039+0000 7f23cedbe740 1 Processor -- start 2024-04-24T23:00:03.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 0x564140268510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 0x56414028c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564140161d20 con 0x564140270850 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641401a1db0 con 0x56414028adb0 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564140243f90 con 0x56414026d510 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23cedbe740 10 client.0 _ll_register_callbacks cb 0x56414019cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49518/0 (socket says 172.21.15.146:49518) 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 -- 172.21.15.146:0/2145004882 learned_addr learned my addr 172.21.15.146:0/2145004882 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9400640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 0x564140268510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 0x56414028c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 -- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 msgr2=0x564140268510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 0x564140268510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 -- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 msgr2=0x56414028c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 0x56414028c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9e00640 1 -- 172.21.15.146:0/2145004882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413ff846b0 con 0x564140270850 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c9400640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 0x564140268510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.040+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 0x56414028c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23c9e00640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23c406c8a0 tx=0x7f23c4071bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccfa7d4d6eb516f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc021020 con 0x564140270850 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23bc007820 con 0x564140270850 2024-04-24T23:00:03.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23bc004d60 con 0x564140270850 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f23bc02b050 con 0x564140270850 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23cedbe740 10 client.4368 fetch_fsmap learned FSMap version 6 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564140270050 con 0x564140270850 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc004d60 con 0x564140270850 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.041+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f23bc02e020 con 0x564140270850 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 10 client.4368 fetch_fsmap finished waiting for FSMap version 6 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 10 client.4368 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 20 client.4368 populate_metadata read hostname 'smithi146' 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414023c800 0x56414026e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 4 client.4368 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 --> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641401b3330 con 0x56414023c800 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.042+0000 7f23c9400640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414023c800 0x56414026e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.043+0000 7f23c9400640 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414023c800 0x56414026e900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0856042c6d2dea0 server_cookie=6a540a423d8c7263 in_seq=0 out_seq=0 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.043+0000 7f23aa000640 10 client.4368 ms_handle_connect on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.045+0000 7f23aa000640 1 -- 172.21.15.146:0/2145004882 <== mds.0 v2:172.21.15.203:6835/554633282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5641401b3330 con 0x56414023c800 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.045+0000 7f23aa000640 10 client.4368 handle_command_reply: tid=0 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 client.4368 shutdown 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 msgr2=0x564140272b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23c406c8a0 tx=0x7f23c4071bb0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 shutdown_connections 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414023c800 0x56414026e900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564140270850 0x564140272b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414028adb0 0x56414028c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2145004882 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56414026d510 0x564140268510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23aa000640 0 client.4368 ms_handle_reset on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 >> 172.21.15.146:0/2145004882 conn(0x5641402431f0 msgr2=0x5641402426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 shutdown_connections 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 1 -- 172.21.15.146:0/2145004882 wait complete. 2024-04-24T23:00:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.046+0000 7f23cedbe740 20 client.4368 trim_cache size 0 max 16384 2024-04-24T23:00:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.066+0000 7f23cedbe740 1 Processor -- start 2024-04-24T23:00:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.066+0000 7f23cedbe740 1 -- start start 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x564140238bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564140270850 0x5641402428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4201590 con 0x5641402431f0 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23c41349b0 con 0x56414026d510 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f23c4200f70 con 0x564140270850 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23c9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23c9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49522/0 (socket says 172.21.15.146:49522) 2024-04-24T23:00:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23c9400640 1 -- 172.21.15.146:0/2995857205 learned_addr learned my addr 172.21.15.146:0/2995857205 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23c8a00640 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x564140238bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.067+0000 7f23c9400640 1 -- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564140270850 msgr2=0x5641402428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23c9400640 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564140270850 0x5641402428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23c9400640 1 -- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 msgr2=0x564140238bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23c9400640 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x564140238bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23c9400640 1 -- 172.21.15.146:0/2995857205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414023d6e0 con 0x5641402431f0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23c9400640 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007810 tx=0x7f23b80795b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8804e7a5d41d74b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23b5200640 1 -- 172.21.15.146:0/2995857205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b807d0f0 con 0x5641402431f0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23b5200640 1 -- 172.21.15.146:0/2995857205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b80819b0 con 0x5641402431f0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.068+0000 7f23b5200640 1 -- 172.21.15.146:0/2995857205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8077040 con 0x5641402431f0 2024-04-24T23:00:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- 172.21.15.146:0/2995857205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 msgr2=0x5641402684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007810 tx=0x7f23b80795b0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- 172.21.15.146:0/2995857205 shutdown_connections 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564140270850 0x5641402428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56414026d510 0x564140238bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 --2- 172.21.15.146:0/2995857205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641402431f0 0x5641402684c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- 172.21.15.146:0/2995857205 >> 172.21.15.146:0/2995857205 conn(0x56414023dee0 msgr2=0x5641402abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- 172.21.15.146:0/2995857205 shutdown_connections 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- 172.21.15.146:0/2995857205 wait complete. 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.069+0000 7f23cedbe740 1 -- start start 2024-04-24T23:00:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.070+0000 7f23cedbe740 1 Processor -- start 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 0x564140301fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564140270850 0x564140286ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56414023c680 con 0x56414026d510 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564140270330 con 0x564140270850 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56414023ccd0 con 0x5641402431f0 2024-04-24T23:00:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23cedbe740 10 client.0 _ll_register_callbacks cb 0x7f23bc016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49538/0 (socket says 172.21.15.146:49538) 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 -- 172.21.15.146:0/850373181 learned_addr learned my addr 172.21.15.146:0/850373181 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c9e00640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564140270850 0x564140286ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c9400640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 0x564140301fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 -- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 msgr2=0x564140301fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 0x564140301fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 -- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564140270850 msgr2=0x564140286ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564140270850 0x564140286ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c8a00640 1 -- 172.21.15.146:0/850373181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564140269b20 con 0x56414026d510 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.071+0000 7f23c9400640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 0x564140301fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23c8a00640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23c4069fb0 tx=0x7f23b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb806b1c69f15942 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23aa000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0022660 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23b002bdf0 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b80819b0 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f23b0022800 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23cedbe740 10 client.4374 fetch_fsmap learned FSMap version 6 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.072+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564140241fc0 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b80819b0 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f23b001f040 con 0x56414026d510 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 10 client.4374 fetch_fsmap finished waiting for FSMap version 6 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 10 client.4374 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 20 client.4374 populate_metadata read hostname 'smithi146' 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414028adb0 0x564140289170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 4 client.4374 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 --> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] -- command(tid 0: {"prefix": "status"}) -- 0x5641401ad680 con 0x56414028adb0 2024-04-24T23:00:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.073+0000 7f23c9400640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414028adb0 0x564140289170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.074+0000 7f23aa000640 10 client.4374 ms_handle_connect on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.074+0000 7f23c9400640 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414028adb0 0x564140289170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e336a66ea5a8c4 server_cookie=6f71d57cf72867b1 in_seq=0 out_seq=0 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23aa000640 1 -- 172.21.15.146:0/850373181 <== mds.0 v2:172.21.15.203:6835/554633282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5641401ad680 con 0x56414028adb0 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23aa000640 10 client.4374 handle_command_reply: tid=0 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 client.4374 shutdown 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 msgr2=0x564140288410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23c4069fb0 tx=0x7f23b0004730 comp rx=0 tx=0).stop 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 shutdown_connections 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x56414028adb0 0x564140289170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564140270850 0x564140286ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56414026d510 0x564140288410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 --2- 172.21.15.146:0/850373181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5641402431f0 0x564140301fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23aa000640 0 client.4374 ms_handle_reset on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.075+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 >> 172.21.15.146:0/850373181 conn(0x56414023dee0 msgr2=0x56414028c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 shutdown_connections 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cedbe740 1 -- 172.21.15.146:0/850373181 wait complete. 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cedbe740 20 client.4374 trim_cache size 0 max 16384 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4273, 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 8.2483879489999996, 2024-04-24T23:00:03.081 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 6, 2024-04-24T23:00:03.082 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 27, 2024-04-24T23:00:03.082 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 27, 2024-04-24T23:00:03.082 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.328977446 2024-04-24T23:00:03.082 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 msgr2=0x7f23a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 0x7f23a406e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c40aef70 tx=0x7f23b0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 msgr2=0x7f23c4135070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005040 tx=0x7f23b8001120 comp rx=0 tx=0).stop 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.076+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 shutdown_connections 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23c41f7cd0 0x7f23c40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23a406be60 0x7f23a406e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23c41f7870 0x7f23c40b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 --2- 172.21.15.146:0/2324336622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac0039b0 0x7f23c4135070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 >> 172.21.15.146:0/2324336622 conn(0x7f23c406b140 msgr2=0x7f23c40a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 shutdown_connections 2024-04-24T23:00:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.077+0000 7f23cbe00640 1 -- 172.21.15.146:0/2324336622 wait complete. 2024-04-24T23:00:03.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:03.095 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:03.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:03.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.283+0000 7f95a1200640 1 Processor -- start 2024-04-24T23:00:03.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.283+0000 7f95a1200640 1 -- start start 2024-04-24T23:00:03.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f95a1200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f959c071320 0x7f959c165c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f95a1200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c1449c0 con 0x7f959c1445e0 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f95a1200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c071820 con 0x7f959c0d03a0 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f95a1200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f959c072430 con 0x7f959c071320 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f9599e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f959c1445e0 0x7f959c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37936/0 (socket says 172.21.15.146:37936) 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f9599e00640 1 -- 172.21.15.146:0/668118091 learned_addr learned my addr 172.21.15.146:0/668118091 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f959a800640 1 --2- 172.21.15.146:0/668118091 >> v2:172.21.15.146:3300/0 conn(0x7f959c071320 0x7f959c165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f9599400640 1 -- 172.21.15.146:0/668118091 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435546528 0 0) 0x7f959c1449c0 con 0x7f959c1445e0 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f959a800640 1 -- 172.21.15.146:0/668118091 >> v1:172.21.15.203:6789/0 conn(0x7f959c0d03a0 legacy=0x7f959c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:03.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f959a800640 1 -- 172.21.15.146:0/668118091 >> v1:172.21.15.146:6789/0 conn(0x7f959c1445e0 legacy=0x7f959c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.285+0000 7f959a800640 1 -- 172.21.15.146:0/668118091 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c071b00 con 0x7f959c071320 2024-04-24T23:00:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.286+0000 7f959a800640 1 --2- 172.21.15.146:0/668118091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c071320 0x7f959c165c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f959402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea81ed804622598 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f9599400640 1 -- 172.21.15.146:0/668118091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594037070 con 0x7f959c071320 2024-04-24T23:00:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f9599400640 1 -- 172.21.15.146:0/668118091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594032440 con 0x7f959c071320 2024-04-24T23:00:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f9599400640 1 -- 172.21.15.146:0/668118091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594032810 con 0x7f959c071320 2024-04-24T23:00:03.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 -- 172.21.15.146:0/668118091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c071320 msgr2=0x7f959c165c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 --2- 172.21.15.146:0/668118091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c071320 0x7f959c165c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f959402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 -- 172.21.15.146:0/668118091 shutdown_connections 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 --2- 172.21.15.146:0/668118091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c071320 0x7f959c165c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 -- 172.21.15.146:0/668118091 >> 172.21.15.146:0/668118091 conn(0x7f959c06b320 msgr2=0x7f959c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.287+0000 7f95a1200640 1 -- 172.21.15.146:0/668118091 shutdown_connections 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.288+0000 7f95a1200640 1 -- 172.21.15.146:0/668118091 wait complete. 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.289+0000 7f95a1200640 1 Processor -- start 2024-04-24T23:00:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.289+0000 7f95a1200640 1 -- start start 2024-04-24T23:00:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f959c071320 0x7f959c1f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 0x7f959c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0720c0 con 0x7f959c1445e0 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0b2d70 con 0x7f959c0d03a0 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f95a1200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f959c0728c0 con 0x7f959c071320 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.290+0000 7f959a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49566/0 (socket says 172.21.15.146:49566) 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 -- 172.21.15.146:0/1891403947 learned_addr learned my addr 172.21.15.146:0/1891403947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f9599e00640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f959c071320 0x7f959c1f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f9591400640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 0x7f959c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 -- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f959c071320 msgr2=0x7f959c1f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f959c071320 0x7f959c1f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 -- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 msgr2=0x7f959c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 0x7f959c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 -- 172.21.15.146:0/1891403947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c0ae470 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f9591400640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 0x7f959c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.291+0000 7f959a800640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f95940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.292+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594041070 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.292+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959403c870 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.292+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594037040 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.292+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c0ae710 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.292+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c0aecd0 con 0x7f959c1445e0 2024-04-24T23:00:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.293+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c068190 con 0x7f959c1445e0 2024-04-24T23:00:03.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.294+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9594044070 con 0x7f959c1445e0 2024-04-24T23:00:03.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.295+0000 7f9592a00640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.295+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f95940abf10 con 0x7f959c1445e0 2024-04-24T23:00:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.295+0000 7f9599e00640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.296+0000 7f9599e00640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 0x7f957806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f958c0012e0 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.299+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f959407a6a0 con 0x7f959c1445e0 2024-04-24T23:00:03.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.538+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f959c06eab0 con 0x7f959c1445e0 2024-04-24T23:00:03.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.539+0000 7f9592a00640 1 -- 172.21.15.146:0/1891403947 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f9594079fa0 con 0x7f959c1445e0 2024-04-24T23:00:03.540 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 msgr2=0x7f957806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 0x7f957806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f958c0012e0 tx=0x7f958c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 msgr2=0x7f959c15cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f95940046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 shutdown_connections 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959c1445e0 0x7f959c15cdc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f959c0d03a0 0x7f959c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 --2- 172.21.15.146:0/1891403947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f959c071320 0x7f959c1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 >> 172.21.15.146:0/1891403947 conn(0x7f959c06b320 msgr2=0x7f959c141420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 shutdown_connections 2024-04-24T23:00:03.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03.542+0000 7f95a1200640 1 -- 172.21.15.146:0/1891403947 wait complete. 2024-04-24T23:00:03.562 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:00:03.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:03.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:03.563 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:00:03.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:03.563 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:00:03.615 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:03.616 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:03.617 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:03.617 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:00:03.617 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-04-24T23:00:03.617 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:00:03.617 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:03.618 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:00:03.618 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:03.618 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:03.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:00:03.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2024-04-24T23:00:03.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2024-04-24T23:00:03.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:00:03.619 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:03.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:04.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:04.090 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:04.157 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:00:04.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:04.161 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:00:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:00:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:00:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:00:04.211 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:00:04.212 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:04.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:04.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:04.947 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:00:04.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:04.992 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-04-24T23:00:05.081 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:05.081 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:05.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:05.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-24T23:00:05.081 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:05.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:05.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-24T23:00:05.248 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:05.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:05.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:05.521 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:05.521 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:05.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:00:05.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:00:05.522 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:05.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:05.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:05.718 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-24T23:00:05.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:05.718 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:05.761 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:00:05.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:05.761 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:05.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-04-24T23:00:05.953 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:05.996 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:05.997 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:05.998 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:05.999 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:05.999 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-04-24T23:00:05.999 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:05.999 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:06.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:06.000 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-04-24T23:00:06.088 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:00:06.088 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-24T23:00:06.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-04-24T23:00:06.156 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-04-24T23:00:06.197 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-04-24T23:00:06.198 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:06.199 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:06.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:06.201 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-04-24T23:00:06.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:2024-04-24T23:00:06.290+0000 7f90d5729480 -1 init, newargv = 0x559312d18220 newargc=15 2024-04-24T23:00:06.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[39839]: starting ceph client 2024-04-24T23:00:06.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[39839]: starting fuse 2024-04-24T23:00:07.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-04-24T23:00:07.480 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:07.537 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-04-24T23:00:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-04-24T23:00:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:07.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:07.541 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-04-24T23:00:07.593 INFO:teuthology.orchestra.run.smithi146.stdout:42 2024-04-24T23:00:07.593 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-24T23:00:07.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> import re 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2024-04-24T23:00:07.594 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> return f 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.admin")) 2024-04-24T23:00:07.595 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:00:07.753 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.admin.39839.asok 2024-04-24T23:00:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:07.770 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.39839.asok 2024-04-24T23:00:07.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:07.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.39839.asok status 2024-04-24T23:00:07.996 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:00:07.997 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2024-04-24T23:00:07.997 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:00:07.997 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:00:07.997 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "admin", 2024-04-24T23:00:07.997 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "39839", 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4392, 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2024-04-24T23:00:07.998 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4392 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 242801718 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 242801718 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:00:07.999 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4392 192.168.0.1:0/242801718", 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/242801718", 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 6, 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 27, 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2024-04-24T23:00:08.000 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:00:08.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:08.012 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2024-04-24T23:00:08.012 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:08.063 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2024-04-24T23:00:08.064 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:08.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:08.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:08.149 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-24T23:00:08.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:08.313 INFO:teuthology.orchestra.run.smithi146.stdout:# file: . 2024-04-24T23:00:08.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-24T23:00:08.313 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:08.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:08.324 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:00:08.324 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:08.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.618+0000 7f51b3200640 1 Processor -- start 2024-04-24T23:00:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.618+0000 7f51b3200640 1 -- start start 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51b40d0240 0x7f51b40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40709d0 0x7f51b415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b4070f90 con 0x7f51b41561c0 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f51b40b4310 con 0x7f51b40d0240 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f51b41565a0 con 0x7f51b40709d0 2024-04-24T23:00:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b1e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51b41561c0 0x7f51b40cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45900/0 (socket says 172.21.15.146:45900) 2024-04-24T23:00:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51b1e00640 1 -- 172.21.15.146:0/2137833701 learned_addr learned my addr 172.21.15.146:0/2137833701 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.620+0000 7f51abe00640 1 --2- 172.21.15.146:0/2137833701 >> v2:172.21.15.146:3300/0 conn(0x7f51b40d0240 0x7f51b40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51b2800640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40709d0 0x7f51b415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51b1400640 1 -- 172.21.15.146:0/2137833701 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732523356 0 0) 0x7f51b4070f90 con 0x7f51b41561c0 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51b1400640 1 -- 172.21.15.146:0/2137833701 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5198003520 con 0x7f51b41561c0 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51abe00640 1 -- 172.21.15.146:0/2137833701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40709d0 msgr2=0x7f51b415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51abe00640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40709d0 0x7f51b415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51abe00640 1 -- 172.21.15.146:0/2137833701 >> v1:172.21.15.146:6789/0 conn(0x7f51b41561c0 legacy=0x7f51b40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.621+0000 7f51abe00640 1 -- 172.21.15.146:0/2137833701 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b4071270 con 0x7f51b40d0240 2024-04-24T23:00:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.622+0000 7f51abe00640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40d0240 0x7f51b40cdbf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f519c0097a0 tx=0x7f519c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4716b8852cfeb4f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.622+0000 7f51b1400640 1 -- 172.21.15.146:0/2137833701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c037070 con 0x7f51b40d0240 2024-04-24T23:00:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.622+0000 7f51b1400640 1 -- 172.21.15.146:0/2137833701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c02adb0 con 0x7f51b40d0240 2024-04-24T23:00:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.622+0000 7f51b1400640 1 -- 172.21.15.146:0/2137833701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c032660 con 0x7f51b40d0240 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 -- 172.21.15.146:0/2137833701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40d0240 msgr2=0x7f51b40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40d0240 0x7f51b40cdbf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f519c0097a0 tx=0x7f519c02a060 comp rx=0 tx=0).stop 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 -- 172.21.15.146:0/2137833701 shutdown_connections 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40709d0 0x7f51b415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 --2- 172.21.15.146:0/2137833701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40d0240 0x7f51b40cdbf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 -- 172.21.15.146:0/2137833701 >> 172.21.15.146:0/2137833701 conn(0x7f51b406b320 msgr2=0x7f51b406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 -- 172.21.15.146:0/2137833701 shutdown_connections 2024-04-24T23:00:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.623+0000 7f51b3200640 1 -- 172.21.15.146:0/2137833701 wait complete. 2024-04-24T23:00:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.625+0000 7f51b3200640 1 Processor -- start 2024-04-24T23:00:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.625+0000 7f51b3200640 1 -- start start 2024-04-24T23:00:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40d0240 0x7f51b414d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51b41561c0 0x7f51b414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51b40b2c20 con 0x7f51b40709d0 2024-04-24T23:00:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4071830 con 0x7f51b41561c0 2024-04-24T23:00:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f51b40b2da0 con 0x7f51b40d0240 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.626+0000 7f51b1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48774/0 (socket says 172.21.15.146:48774) 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 -- 172.21.15.146:0/3437543685 learned_addr learned my addr 172.21.15.146:0/3437543685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51abe00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40d0240 0x7f51b414d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b2800640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51b41561c0 0x7f51b414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 -- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40d0240 msgr2=0x7f51b414d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40d0240 0x7f51b414d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 -- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51b41561c0 msgr2=0x7f51b414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51b41561c0 0x7f51b414ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 -- 172.21.15.146:0/3437543685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b413d620 con 0x7f51b40709d0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51b1e00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c3c0 tx=0x7f51a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.627+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4017070 con 0x7f51b40709d0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.628+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a4005ce0 con 0x7f51b40709d0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.628+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b414dcb0 con 0x7f51b40709d0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.628+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40072f0 con 0x7f51b40709d0 2024-04-24T23:00:08.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.628+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b406d2f0 con 0x7f51b40709d0 2024-04-24T23:00:08.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.629+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b406b930 con 0x7f51b40709d0 2024-04-24T23:00:08.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.630+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51a401a070 con 0x7f51b40709d0 2024-04-24T23:00:08.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.631+0000 7f51aa000640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 0x7f519006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:08.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.631+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f51a408a6d0 con 0x7f51b40709d0 2024-04-24T23:00:08.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.631+0000 7f51abe00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 0x7f519006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:08.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.632+0000 7f51abe00640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 0x7f519006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f519c034000 tx=0x7f519c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:08.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.636+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f51b406b930 con 0x7f51b40709d0 2024-04-24T23:00:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.835+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51b404f500 con 0x7f51b40709d0 2024-04-24T23:00:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.837+0000 7f51aa000640 1 -- 172.21.15.146:0/3437543685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f51a4058c10 con 0x7f51b40709d0 2024-04-24T23:00:08.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:08.839 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 msgr2=0x7f519006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 0x7f519006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f519c034000 tx=0x7f519c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 msgr2=0x7f51b406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c3c0 tx=0x7f51a400c880 comp rx=0 tx=0).stop 2024-04-24T23:00:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 shutdown_connections 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51b41561c0 0x7f51b414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f519006be30 0x7f519006e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51b40d0240 0x7f51b414d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 --2- 172.21.15.146:0/3437543685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b40709d0 0x7f51b406ca30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 >> 172.21.15.146:0/3437543685 conn(0x7f51b406b320 msgr2=0x7f51b40ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 shutdown_connections 2024-04-24T23:00:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:08.840+0000 7f51b3200640 1 -- 172.21.15.146:0/3437543685 wait complete. 2024-04-24T23:00:08.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:08.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:09.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.064+0000 7fb5b3200640 1 Processor -- start 2024-04-24T23:00:09.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.065+0000 7fb5b3200640 1 -- start start 2024-04-24T23:00:09.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.066+0000 7fb5b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5ac0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.066+0000 7fb5b3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ac15e3f0 con 0x7fb5ac15e010 2024-04-24T23:00:09.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.066+0000 7fb5b3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ac06e230 con 0x7fb5ac06dd80 2024-04-24T23:00:09.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.066+0000 7fb5b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac06cd20 con 0x7fb5ac06ed30 2024-04-24T23:00:09.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.067+0000 7fb5abe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb5ac15e010 0x7fb5ac071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45904/0 (socket says 172.21.15.146:45904) 2024-04-24T23:00:09.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.067+0000 7fb5abe00640 1 -- 172.21.15.146:0/4184580265 learned_addr learned my addr 172.21.15.146:0/4184580265 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:09.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.067+0000 7fb5b1200640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5ac0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.067+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619868351 0 0) 0x7fb5ac15e3f0 con 0x7fb5ac15e010 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.067+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb590003520 con 0x7fb5ac15e010 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828473778 0 0) 0x7fb590003520 con 0x7fb5ac15e010 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 msgr2=0x7fb5ac0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5ac0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 >> v1:172.21.15.203:6789/0 conn(0x7fb5ac06dd80 legacy=0x7fb5ac06e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac15f440 con 0x7fb5ac15e010 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb59c001670 con 0x7fb5ac15e010 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 >> v1:172.21.15.146:6789/0 conn(0x7fb5ac15e010 legacy=0x7fb5ac071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb590003f60 0x7fb590004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb590004d40 0x7fb5900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac06cd20 con 0x7fb590003f60 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb59000baa0 con 0x7fb590004d40 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb59000bca0 con 0x7fb5ac06ed30 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb590003f60 0x7fb590004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5abe00640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.068+0000 7fb5b1200640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb590004d40 0x7fb5900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.069+0000 7fb5a3e00640 1 -- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 msgr2=0x7fb5900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.069+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5ac06ed30 0x7fb5900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.069+0000 7fb5a3e00640 1 -- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb590004d40 msgr2=0x7fb5900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.069+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb590004d40 0x7fb5900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.069+0000 7fb5a3e00640 1 -- 172.21.15.146:0/4184580265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590003520 con 0x7fb590003f60 2024-04-24T23:00:09.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb590003f60 0x7fb590004800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb594001750 tx=0x7fb590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7482018d34619b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594001370 con 0x7fb590003f60 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940052d0 con 0x7fb590003f60 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5ab400640 1 -- 172.21.15.146:0/4184580265 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59402abe0 con 0x7fb590003f60 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5b3200640 1 -- 172.21.15.146:0/4184580265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb590003f60 msgr2=0x7fb590004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.070+0000 7fb5b3200640 1 --2- 172.21.15.146:0/4184580265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb590003f60 0x7fb590004800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb594001750 tx=0x7fb590005830 comp rx=0 tx=0).stop 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.071+0000 7fb5b1200640 1 -- 172.21.15.146:0/4184580265 reap_dead start 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.071+0000 7fb5b3200640 1 -- 172.21.15.146:0/4184580265 shutdown_connections 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.071+0000 7fb5b3200640 1 -- 172.21.15.146:0/4184580265 >> 172.21.15.146:0/4184580265 conn(0x7fb5ac0b17b0 msgr2=0x7fb5ac0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.071+0000 7fb5b3200640 1 -- 172.21.15.146:0/4184580265 shutdown_connections 2024-04-24T23:00:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.071+0000 7fb5b3200640 1 -- 172.21.15.146:0/4184580265 wait complete. 2024-04-24T23:00:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.072+0000 7fb5b3200640 1 Processor -- start 2024-04-24T23:00:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 -- start start 2024-04-24T23:00:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb590003f60 0x7fb5ac15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac1414a0 0x7fb5ac141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac06d2a0 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac06cfc0 con 0x7fb5ac1414a0 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.073+0000 7fb5b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac06d580 con 0x7fb590003f60 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48802/0 (socket says 172.21.15.146:48802) 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 -- 172.21.15.146:0/781429002 learned_addr learned my addr 172.21.15.146:0/781429002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 -- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb590003f60 msgr2=0x7fb5ac15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5b1200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac1414a0 0x7fb5ac141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb590003f60 0x7fb5ac15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 -- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac1414a0 msgr2=0x7fb5ac141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac1414a0 0x7fb5ac141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.074+0000 7fb5a3e00640 1 -- 172.21.15.146:0/781429002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac1596e0 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5a3e00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb594005040 tx=0x7fb594001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594042070 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59402be50 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594037040 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac15a430 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.075+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac15a6d0 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.076+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ac152860 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.077+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5940052d0 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.078+0000 7fb5a8c00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.078+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb5940aa940 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.078+0000 7fb5abe00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.079+0000 7fb5abe00640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 0x7fb58806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c001cd0 tx=0x7fb59c001b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.083+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb5ac06e230 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.279+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5ac0b3190 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.280+0000 7fb5a8c00640 1 -- 172.21.15.146:0/781429002 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb594078fa0 con 0x7fb5ac13ebb0 2024-04-24T23:00:09.281 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:09.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 msgr2=0x7fb58806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 0x7fb58806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c001cd0 tx=0x7fb59c001b60 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 msgr2=0x7fb5ac156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb594005040 tx=0x7fb594001120 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 shutdown_connections 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac1414a0 0x7fb5ac141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac13ebb0 0x7fb5ac156370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb58806be60 0x7fb58806e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 --2- 172.21.15.146:0/781429002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb590003f60 0x7fb5ac15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 >> 172.21.15.146:0/781429002 conn(0x7fb5ac0b17b0 msgr2=0x7fb5ac0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 shutdown_connections 2024-04-24T23:00:09.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.282+0000 7fb5b3200640 1 -- 172.21.15.146:0/781429002 wait complete. 2024-04-24T23:00:09.303 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:09.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.504+0000 7f1b51200640 1 Processor -- start 2024-04-24T23:00:09.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.504+0000 7f1b51200640 1 -- start start 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b51200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b4c13ef30 0x7f1b4c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b51200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b51200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c0ced40 con 0x7f1b4c0ce5a0 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b51200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c1423d0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b51200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c070f80 con 0x7f1b4c141ab0 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b49e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b4c13ef30 0x7f1b4c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b49e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b4c13ef30 0x7f1b4c141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48810/0 (socket says 172.21.15.146:48810) 2024-04-24T23:00:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b49e00640 1 -- 172.21.15.146:0/2724999937 learned_addr learned my addr 172.21.15.146:0/2724999937 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.506+0000 7f1b49400640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.507+0000 7f1b49e00640 1 -- 172.21.15.146:0/2724999937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 msgr2=0x7f1b4c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.507+0000 7f1b49e00640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.507+0000 7f1b49e00640 1 -- 172.21.15.146:0/2724999937 >> v1:172.21.15.203:6789/0 conn(0x7f1b4c0ce5a0 legacy=0x7f1b4c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.507+0000 7f1b49e00640 1 -- 172.21.15.146:0/2724999937 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c0cf020 con 0x7f1b4c13ef30 2024-04-24T23:00:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.508+0000 7f1b49e00640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c141570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009870 tx=0x7f1b3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113278e54c74b622 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.508+0000 7f1b48a00640 1 -- 172.21.15.146:0/2724999937 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c037070 con 0x7f1b4c13ef30 2024-04-24T23:00:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.508+0000 7f1b48a00640 1 -- 172.21.15.146:0/2724999937 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c032440 con 0x7f1b4c13ef30 2024-04-24T23:00:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.508+0000 7f1b48a00640 1 -- 172.21.15.146:0/2724999937 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c032810 con 0x7f1b4c13ef30 2024-04-24T23:00:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 -- 172.21.15.146:0/2724999937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 msgr2=0x7f1b4c141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c141570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009870 tx=0x7f1b3c02a210 comp rx=0 tx=0).stop 2024-04-24T23:00:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 -- 172.21.15.146:0/2724999937 shutdown_connections 2024-04-24T23:00:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 --2- 172.21.15.146:0/2724999937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c141570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 -- 172.21.15.146:0/2724999937 >> 172.21.15.146:0/2724999937 conn(0x7f1b4c0b17b0 msgr2=0x7f1b4c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 -- 172.21.15.146:0/2724999937 shutdown_connections 2024-04-24T23:00:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.509+0000 7f1b51200640 1 -- 172.21.15.146:0/2724999937 wait complete. 2024-04-24T23:00:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.511+0000 7f1b51200640 1 Processor -- start 2024-04-24T23:00:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.511+0000 7f1b51200640 1 -- start start 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c0ce5a0 0x7f1b4c1f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0cea30 con 0x7f1b4c13ef30 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c070c10 con 0x7f1b4c0ce5a0 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b51200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c072420 con 0x7f1b4c141ab0 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b49400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b49400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48820/0 (socket says 172.21.15.146:48820) 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b49400640 1 -- 172.21.15.146:0/1862125174 learned_addr learned my addr 172.21.15.146:0/1862125174 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.512+0000 7f1b49e00640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c0ce5a0 0x7f1b4c1f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b4a800640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 -- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 msgr2=0x7f1b4c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 -- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c0ce5a0 msgr2=0x7f1b4c1f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c0ce5a0 0x7f1b4c1f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 -- 172.21.15.146:0/1862125174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c1f80c0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b4a800640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b49400640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d5f0 tx=0x7f1b3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380125f0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b38019070 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380129d0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.513+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c1f83a0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.514+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c13a660 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.515+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c04f5a0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.516+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b38012b70 con 0x7f1b4c13ef30 2024-04-24T23:00:09.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.517+0000 7f1b42000640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.517+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1b3808b5d0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.517+0000 7f1b49e00640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.518+0000 7f1b49e00640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c034000 tx=0x7f1b3c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.521+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b38059ba0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.720+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b4c072d30 con 0x7f1b4c13ef30 2024-04-24T23:00:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.721+0000 7f1b42000640 1 -- 172.21.15.146:0/1862125174 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f1b380594a0 con 0x7f1b4c13ef30 2024-04-24T23:00:09.722 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 msgr2=0x7f1b2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c034000 tx=0x7f1b3c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 msgr2=0x7f1b4c13a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d5f0 tx=0x7f1b3800dab0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 shutdown_connections 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b2c06be30 0x7f1b2c06e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b4c141ab0 0x7f1b4c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b4c13ef30 0x7f1b4c13a120 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 --2- 172.21.15.146:0/1862125174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c0ce5a0 0x7f1b4c1f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 >> 172.21.15.146:0/1862125174 conn(0x7f1b4c0b17b0 msgr2=0x7f1b4c0cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 shutdown_connections 2024-04-24T23:00:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.724+0000 7f1b51200640 1 -- 172.21.15.146:0/1862125174 wait complete. 2024-04-24T23:00:09.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.944+0000 7f0212600640 1 Processor -- start 2024-04-24T23:00:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.945+0000 7f0212600640 1 -- start start 2024-04-24T23:00:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.946+0000 7f0212600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f020c1619c0 0x7f020c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.946+0000 7f0212600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 0x7f020c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.946+0000 7f0212600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020c0cf7a0 con 0x7f020c0b5590 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.946+0000 7f0212600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f020c0b6dc0 con 0x7f020c1619c0 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.946+0000 7f0212600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f020c0cfa40 con 0x7f020c0d2c60 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f020c1619c0 0x7f020c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f020c1619c0 0x7f020c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48828/0 (socket says 172.21.15.146:48828) 2024-04-24T23:00:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 -- 172.21.15.146:0/2567108343 learned_addr learned my addr 172.21.15.146:0/2567108343 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020be00640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 0x7f020c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 -- 172.21.15.146:0/2567108343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 msgr2=0x7f020c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 0x7f020c0b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 -- 172.21.15.146:0/2567108343 >> v1:172.21.15.146:6789/0 conn(0x7f020c0b5590 legacy=0x7f020c0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020b400640 1 -- 172.21.15.146:0/2567108343 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c0cfd20 con 0x7f020c1619c0 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.947+0000 7f020be00640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 0x7f020c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.948+0000 7f020b400640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c1619c0 0x7f020c0b5050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f020c0b6f40 tx=0x7f01fc02a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ff93a3fa700e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.948+0000 7f020aa00640 1 -- 172.21.15.146:0/2567108343 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc037070 con 0x7f020c1619c0 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.948+0000 7f020aa00640 1 -- 172.21.15.146:0/2567108343 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc032440 con 0x7f020c1619c0 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.948+0000 7f020aa00640 1 -- 172.21.15.146:0/2567108343 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc032810 con 0x7f020c1619c0 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 -- 172.21.15.146:0/2567108343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c1619c0 msgr2=0x7f020c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c1619c0 0x7f020c0b5050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f020c0b6f40 tx=0x7f01fc02a120 comp rx=0 tx=0).stop 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 -- 172.21.15.146:0/2567108343 shutdown_connections 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c0d2c60 0x7f020c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 --2- 172.21.15.146:0/2567108343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c1619c0 0x7f020c0b5050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 -- 172.21.15.146:0/2567108343 >> 172.21.15.146:0/2567108343 conn(0x7f020c0d3f70 msgr2=0x7f020c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 -- 172.21.15.146:0/2567108343 shutdown_connections 2024-04-24T23:00:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.949+0000 7f0212600640 1 -- 172.21.15.146:0/2567108343 wait complete. 2024-04-24T23:00:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.951+0000 7f0212600640 1 Processor -- start 2024-04-24T23:00:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.951+0000 7f0212600640 1 -- start start 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f020c0b5590 0x7f020c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c1619c0 0x7f020c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f020c161da0 con 0x7f020c0d2c60 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f020c0d1f70 con 0x7f020c0b5590 2024-04-24T23:00:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0212600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f020c161f20 con 0x7f020c1619c0 2024-04-24T23:00:09.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0203e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0203e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48836/0 (socket says 172.21.15.146:48836) 2024-04-24T23:00:09.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.952+0000 7f0203e00640 1 -- 172.21.15.146:0/2910392053 learned_addr learned my addr 172.21.15.146:0/2910392053 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f020b400640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f020c0b5590 0x7f020c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 -- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c1619c0 msgr2=0x7f020c0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c1619c0 0x7f020c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 -- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f020c0b5590 msgr2=0x7f020c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f020c0b5590 0x7f020c156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 -- 172.21.15.146:0/2910392053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c157300 con 0x7f020c0d2c60 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203e00640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c3c0 tx=0x7f01f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40052d0 con 0x7f020c0d2c60 2024-04-24T23:00:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4005490 con 0x7f020c0d2c60 2024-04-24T23:00:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020c1575e0 con 0x7f020c0d2c60 2024-04-24T23:00:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.953+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4007260 con 0x7f020c0d2c60 2024-04-24T23:00:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.954+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020c157ba0 con 0x7f020c0d2c60 2024-04-24T23:00:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.955+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020c160c90 con 0x7f020c0d2c60 2024-04-24T23:00:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.956+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01f4007400 con 0x7f020c0d2c60 2024-04-24T23:00:09.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.957+0000 7f0203400640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.957+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f01f408a5f0 con 0x7f020c0d2c60 2024-04-24T23:00:09.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.957+0000 7f020b400640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.958+0000 7f020b400640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 0x7f01e806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01fc034000 tx=0x7f01fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:09.961+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f020c160c90 con 0x7f020c0d2c60 2024-04-24T23:00:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.158+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f020c0d2330 con 0x7f020c0d2c60 2024-04-24T23:00:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.159+0000 7f0203400640 1 -- 172.21.15.146:0/2910392053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f01f4058cf0 con 0x7f020c0d2c60 2024-04-24T23:00:10.160 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.161+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 msgr2=0x7f01e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.161+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 0x7f01e806e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01fc034000 tx=0x7f01fc02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.161+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 msgr2=0x7f020c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.161+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c3c0 tx=0x7f01f400c880 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 shutdown_connections 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f01e806be30 0x7f01e806e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020c1619c0 0x7f020c0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c0d2c60 0x7f020c0d0300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 --2- 172.21.15.146:0/2910392053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f020c0b5590 0x7f020c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 >> 172.21.15.146:0/2910392053 conn(0x7f020c0d3f70 msgr2=0x7f020c15f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 shutdown_connections 2024-04-24T23:00:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.162+0000 7f0212600640 1 -- 172.21.15.146:0/2910392053 wait complete. 2024-04-24T23:00:10.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.378+0000 7fa233e00640 1 Processor -- start 2024-04-24T23:00:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.379+0000 7fa233e00640 1 -- start start 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa23415e430 0x7fa2340d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2340d1c40 0x7fa2340d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa2340cfb40 con 0x7fa2340d1c40 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa2340cfe20 con 0x7fa23415e430 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa233e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa2340b36c0 con 0x7fa2340d4880 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.380+0000 7fa232000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2340d1c40 0x7fa2340d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2340d1c40 0x7fa2340d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48848/0 (socket says 172.21.15.146:48848) 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 -- 172.21.15.146:0/412533375 learned_addr learned my addr 172.21.15.146:0/412533375 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232a00640 1 --2- 172.21.15.146:0/412533375 >> v2:172.21.15.203:3300/0 conn(0x7fa23415e430 0x7fa2340d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa233400640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 -- 172.21.15.146:0/412533375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 msgr2=0x7fa2340ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 -- 172.21.15.146:0/412533375 >> v2:172.21.15.203:3300/0 conn(0x7fa23415e430 msgr2=0x7fa2340d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 --2- 172.21.15.146:0/412533375 >> v2:172.21.15.203:3300/0 conn(0x7fa23415e430 0x7fa2340d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.381+0000 7fa232000640 1 -- 172.21.15.146:0/412533375 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2340b39a0 con 0x7fa2340d1c40 2024-04-24T23:00:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.383+0000 7fa232000640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa2340d0b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa234073530 tx=0x7fa21c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12f7f6605efcf04 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.383+0000 7fa231600640 1 -- 172.21.15.146:0/412533375 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c036070 con 0x7fa2340d1c40 2024-04-24T23:00:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.383+0000 7fa231600640 1 -- 172.21.15.146:0/412533375 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c031600 con 0x7fa2340d1c40 2024-04-24T23:00:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.383+0000 7fa231600640 1 -- 172.21.15.146:0/412533375 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0319d0 con 0x7fa2340d1c40 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 -- 172.21.15.146:0/412533375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 msgr2=0x7fa2340d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa2340d0b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa234073530 tx=0x7fa21c02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 -- 172.21.15.146:0/412533375 shutdown_connections 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa2340d0b90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 --2- 172.21.15.146:0/412533375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 --2- 172.21.15.146:0/412533375 >> v2:172.21.15.203:3300/0 conn(0x7fa23415e430 0x7fa2340d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 -- 172.21.15.146:0/412533375 >> 172.21.15.146:0/412533375 conn(0x7fa2340d3d60 msgr2=0x7fa2340d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 -- 172.21.15.146:0/412533375 shutdown_connections 2024-04-24T23:00:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.384+0000 7fa233e00640 1 -- 172.21.15.146:0/412533375 wait complete. 2024-04-24T23:00:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.386+0000 7fa233e00640 1 Processor -- start 2024-04-24T23:00:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.386+0000 7fa233e00640 1 -- start start 2024-04-24T23:00:10.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa23415e430 0x7fa2340b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa2340d2b30 con 0x7fa2340d1c40 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa23415e810 con 0x7fa23415e430 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa2340d2cb0 con 0x7fa2340d4880 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa232a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa232a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48858/0 (socket says 172.21.15.146:48858) 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa232a00640 1 -- 172.21.15.146:0/4246593397 learned_addr learned my addr 172.21.15.146:0/4246593397 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.387+0000 7fa233400640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa23415e430 0x7fa2340b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232000640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 -- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 msgr2=0x7fa2340b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 -- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa23415e430 msgr2=0x7fa2340b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa23415e430 0x7fa2340b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 -- 172.21.15.146:0/4246593397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2341f3df0 con 0x7fa2340d1c40 2024-04-24T23:00:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa232a00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa22400d5f0 tx=0x7fa22400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2240125f0 con 0x7fa2340d1c40 2024-04-24T23:00:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224019070 con 0x7fa2340d1c40 2024-04-24T23:00:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2240129d0 con 0x7fa2340d1c40 2024-04-24T23:00:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2341f40b0 con 0x7fa2340d1c40 2024-04-24T23:00:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.388+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2341f4670 con 0x7fa2340d1c40 2024-04-24T23:00:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.389+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23404f500 con 0x7fa2340d1c40 2024-04-24T23:00:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.390+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa224012b70 con 0x7fa2340d1c40 2024-04-24T23:00:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.392+0000 7fa22aa00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 0x7fa21006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.392+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa22408b610 con 0x7fa2340d1c40 2024-04-24T23:00:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.392+0000 7fa232000640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 0x7fa21006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.394+0000 7fa232000640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 0x7fa21006e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa21c033000 tx=0x7fa21c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.397+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa224059be0 con 0x7fa2340d1c40 2024-04-24T23:00:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.594+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa2340b2b70 con 0x7fa2340d1c40 2024-04-24T23:00:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.595+0000 7fa22aa00640 1 -- 172.21.15.146:0/4246593397 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa2240594e0 con 0x7fa2340d1c40 2024-04-24T23:00:10.596 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:10.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 msgr2=0x7fa21006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 0x7fa21006e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa21c033000 tx=0x7fa21c009000 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 msgr2=0x7fa234155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa22400d5f0 tx=0x7fa22400dab0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 shutdown_connections 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa23415e430 0x7fa2340b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa21006be60 0x7fa21006e320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2340d4880 0x7fa2340b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 --2- 172.21.15.146:0/4246593397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2340d1c40 0x7fa234155a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.597+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 >> 172.21.15.146:0/4246593397 conn(0x7fa2340d3d60 msgr2=0x7fa2340b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.598+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 shutdown_connections 2024-04-24T23:00:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.598+0000 7fa233e00640 1 -- 172.21.15.146:0/4246593397 wait complete. 2024-04-24T23:00:10.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:00:10.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.818+0000 7fd8b6400640 1 Processor -- start 2024-04-24T23:00:10.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.818+0000 7fd8b6400640 1 -- start start 2024-04-24T23:00:10.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.819+0000 7fd8b6400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015bdc0 0x7fd8b0072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8b6400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8b015cd80 0x7fd8b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8b6400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b015c1a0 con 0x7fd8b00ae830 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8b6400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b00cc5d0 con 0x7fd8b015cd80 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8b6400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00cf6b0 con 0x7fd8b015bdc0 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8b015cd80 0x7fd8b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8b015cd80 0x7fd8b00718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48864/0 (socket says 172.21.15.146:48864) 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 -- 172.21.15.146:0/785900095 learned_addr learned my addr 172.21.15.146:0/785900095 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8b5000640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015bdc0 0x7fd8b0072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 -- 172.21.15.146:0/785900095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015bdc0 msgr2=0x7fd8b0072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015bdc0 0x7fd8b0072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8afe00640 1 -- 172.21.15.146:0/785900095 >> v1:172.21.15.146:6789/0 conn(0x7fd8b00ae830 legacy=0x7fd8b00cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.821+0000 7fd8afe00640 1 -- 172.21.15.146:0/785900095 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b0072c70 con 0x7fd8b015cd80 2024-04-24T23:00:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.820+0000 7fd8af400640 1 -- 172.21.15.146:0/785900095 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095331644 0 0) 0x7fd8b015c1a0 con 0x7fd8b00ae830 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8afe00640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b015cd80 0x7fd8b00718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009870 tx=0x7fd89c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af4fbc387c568 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8af400640 1 -- 172.21.15.146:0/785900095 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c037070 con 0x7fd8b015cd80 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8af400640 1 -- 172.21.15.146:0/785900095 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c032440 con 0x7fd8b015cd80 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8af400640 1 -- 172.21.15.146:0/785900095 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c032810 con 0x7fd8b015cd80 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8b6400640 1 -- 172.21.15.146:0/785900095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b015cd80 msgr2=0x7fd8b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.822+0000 7fd8b6400640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b015cd80 0x7fd8b00718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009870 tx=0x7fd89c02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 -- 172.21.15.146:0/785900095 shutdown_connections 2024-04-24T23:00:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b015cd80 0x7fd8b00718c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 --2- 172.21.15.146:0/785900095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015bdc0 0x7fd8b0072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 -- 172.21.15.146:0/785900095 >> 172.21.15.146:0/785900095 conn(0x7fd8b00b1560 msgr2=0x7fd8b00b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 -- 172.21.15.146:0/785900095 shutdown_connections 2024-04-24T23:00:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.823+0000 7fd8b6400640 1 -- 172.21.15.146:0/785900095 wait complete. 2024-04-24T23:00:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.825+0000 7fd8b6400640 1 Processor -- start 2024-04-24T23:00:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.825+0000 7fd8b6400640 1 -- start start 2024-04-24T23:00:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b015bdc0 0x7fd8b00aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015cd80 0x7fd8b014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0070de0 con 0x7fd8b00ae830 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0071e00 con 0x7fd8b015bdc0 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b6400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00710c0 con 0x7fd8b015cd80 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48878/0 (socket says 172.21.15.146:48878) 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.826+0000 7fd8b5000640 1 -- 172.21.15.146:0/2788524527 learned_addr learned my addr 172.21.15.146:0/2788524527 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5a00640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015cd80 0x7fd8b014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8afe00640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b015bdc0 0x7fd8b00aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 -- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015cd80 msgr2=0x7fd8b014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015cd80 0x7fd8b014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 -- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b015bdc0 msgr2=0x7fd8b00aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b015bdc0 0x7fd8b00aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 -- 172.21.15.146:0/2788524527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b00abab0 con 0x7fd8b00ae830 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.827+0000 7fd8b5000640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400d800 tx=0x7fd8a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.828+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400b6c0 con 0x7fd8b00ae830 2024-04-24T23:00:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.828+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4019070 con 0x7fd8b00ae830 2024-04-24T23:00:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.828+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b00abd90 con 0x7fd8b00ae830 2024-04-24T23:00:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.828+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400ba80 con 0x7fd8b00ae830 2024-04-24T23:00:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.828+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b00ac350 con 0x7fd8b00ae830 2024-04-24T23:00:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.829+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b004f500 con 0x7fd8b00ae830 2024-04-24T23:00:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.830+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8a400bc20 con 0x7fd8b00ae830 2024-04-24T23:00:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.831+0000 7fd8acc00640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.831+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd8a408b710 con 0x7fd8b00ae830 2024-04-24T23:00:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.832+0000 7fd8afe00640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.833+0000 7fd8afe00640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd89c034000 tx=0x7fd89c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:10.836+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd8a4059ce0 con 0x7fd8b00ae830 2024-04-24T23:00:11.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.047+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd8b00ac770 con 0x7fd8b00ae830 2024-04-24T23:00:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.048+0000 7fd8acc00640 1 -- 172.21.15.146:0/2788524527 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd8a40595e0 con 0x7fd8b00ae830 2024-04-24T23:00:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:00:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 msgr2=0x7fd89006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd89c034000 tx=0x7fd89c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 msgr2=0x7fd8b01e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400d800 tx=0x7fd8a400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 shutdown_connections 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8b015cd80 0x7fd8b014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8b015bdc0 0x7fd8b00aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 --2- 172.21.15.146:0/2788524527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8b00ae830 0x7fd8b01e7640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.051+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 >> 172.21.15.146:0/2788524527 conn(0x7fd8b00b1560 msgr2=0x7fd8b015e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.052+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 shutdown_connections 2024-04-24T23:00:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.052+0000 7fd8b6400640 1 -- 172.21.15.146:0/2788524527 wait complete. 2024-04-24T23:00:11.070 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:00:11.070 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:11.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:11.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.365+0000 7f574f200640 1 Processor -- start 2024-04-24T23:00:11.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.365+0000 7f574f200640 1 -- start start 2024-04-24T23:00:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.366+0000 7f574f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f574815a980 0x7f574806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.366+0000 7f574f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5748071dd0 0x7f57480cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.366+0000 7f574f200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57480ccb10 con 0x7f57480d0070 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.366+0000 7f574f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5748072230 con 0x7f574815a980 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.366+0000 7f574f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f57480aede0 con 0x7f5748071dd0 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f574815a980 0x7f574806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f574815a980 0x7f574806d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48882/0 (socket says 172.21.15.146:48882) 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 -- 172.21.15.146:0/3607048738 learned_addr learned my addr 172.21.15.146:0/3607048738 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574d400640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5748071dd0 0x7f57480cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 -- 172.21.15.146:0/3607048738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5748071dd0 msgr2=0x7f57480cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5748071dd0 0x7f57480cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 -- 172.21.15.146:0/3607048738 >> v1:172.21.15.146:6789/0 conn(0x7f57480d0070 legacy=0x7f57480b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574de00640 1 -- 172.21.15.146:0/3607048738 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574806ddc0 con 0x7f574815a980 2024-04-24T23:00:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.367+0000 7f574ca00640 1 -- 172.21.15.146:0/3607048738 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37631601 0 0) 0x7f5744001490 con 0x7f57480d0070 2024-04-24T23:00:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.368+0000 7f574de00640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f574806d770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f573c009870 tx=0x7f573c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12821c81ee6d4e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.368+0000 7f574ca00640 1 -- 172.21.15.146:0/3607048738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c037070 con 0x7f574815a980 2024-04-24T23:00:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.368+0000 7f574ca00640 1 -- 172.21.15.146:0/3607048738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c032440 con 0x7f574815a980 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.368+0000 7f574ca00640 1 -- 172.21.15.146:0/3607048738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c032810 con 0x7f574815a980 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 -- 172.21.15.146:0/3607048738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 msgr2=0x7f574806d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f574806d770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f573c009870 tx=0x7f573c02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 -- 172.21.15.146:0/3607048738 shutdown_connections 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5748071dd0 0x7f57480cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 --2- 172.21.15.146:0/3607048738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f574806d770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 -- 172.21.15.146:0/3607048738 >> 172.21.15.146:0/3607048738 conn(0x7f574806b320 msgr2=0x7f574806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 -- 172.21.15.146:0/3607048738 shutdown_connections 2024-04-24T23:00:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.369+0000 7f574f200640 1 -- 172.21.15.146:0/3607048738 wait complete. 2024-04-24T23:00:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.371+0000 7f574f200640 1 Processor -- start 2024-04-24T23:00:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.371+0000 7f574f200640 1 -- start start 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5748071dd0 0x7f574814a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57480d0070 0x7f5748154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f574806e660 con 0x7f574815a980 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f574806e380 con 0x7f5748071dd0 2024-04-24T23:00:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f574815ad60 con 0x7f57480d0070 2024-04-24T23:00:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48884/0 (socket says 172.21.15.146:48884) 2024-04-24T23:00:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.372+0000 7f574e800640 1 -- 172.21.15.146:0/4072853182 learned_addr learned my addr 172.21.15.146:0/4072853182 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 -- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57480d0070 msgr2=0x7f5748154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574d400640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57480d0070 0x7f5748154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574de00640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5748071dd0 0x7f574814a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57480d0070 0x7f5748154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 -- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5748071dd0 msgr2=0x7f574814a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5748071dd0 0x7f574814a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 -- 172.21.15.146:0/4072853182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574814ac70 con 0x7f574815a980 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574e800640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f574400c7f0 tx=0x7f574400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744003da0 con 0x7f574815a980 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5744005070 con 0x7f574815a980 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5748154690 con 0x7f574815a980 2024-04-24T23:00:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.373+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744005460 con 0x7f574815a980 2024-04-24T23:00:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.374+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481f7c90 con 0x7f574815a980 2024-04-24T23:00:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.375+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5748072400 con 0x7f574815a980 2024-04-24T23:00:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.375+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5744005600 con 0x7f574815a980 2024-04-24T23:00:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.376+0000 7f5742000640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 0x7f572c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.376+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f574408b190 con 0x7f574815a980 2024-04-24T23:00:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.377+0000 7f574de00640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 0x7f572c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.378+0000 7f574de00640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 0x7f572c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f573c034000 tx=0x7f573c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.380+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5748072400 con 0x7f574815a980 2024-04-24T23:00:11.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.581+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f574804f500 con 0x7f574815a980 2024-04-24T23:00:11.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.583+0000 7f5742000640 1 -- 172.21.15.146:0/4072853182 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f57480ccb10 con 0x7f574815a980 2024-04-24T23:00:11.585 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:11.585 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 msgr2=0x7f572c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 0x7f572c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f573c034000 tx=0x7f573c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 msgr2=0x7f57481f38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f574400c7f0 tx=0x7f574400ccb0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 shutdown_connections 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f574815a980 0x7f57481f38c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f572c06be30 0x7f572c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57480d0070 0x7f5748154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 --2- 172.21.15.146:0/4072853182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5748071dd0 0x7f574814a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 >> 172.21.15.146:0/4072853182 conn(0x7f574806b320 msgr2=0x7f57480b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:11.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 shutdown_connections 2024-04-24T23:00:11.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.587+0000 7f574f200640 1 -- 172.21.15.146:0/4072853182 wait complete. 2024-04-24T23:00:11.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:11.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.813+0000 7f792b200640 1 Processor -- start 2024-04-24T23:00:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.814+0000 7f792b200640 1 -- start start 2024-04-24T23:00:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.815+0000 7f792b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 0x7f7924141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.815+0000 7f792b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79240ced40 con 0x7f7924141ab0 2024-04-24T23:00:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.815+0000 7f792b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79240cf020 con 0x7f79240ce770 2024-04-24T23:00:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.815+0000 7f792b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f79241423d0 con 0x7f792413ef30 2024-04-24T23:00:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f791b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7924141ab0 0x7f79240ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45938/0 (socket says 172.21.15.146:45938) 2024-04-24T23:00:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f791b400640 1 -- 172.21.15.146:0/881648151 learned_addr learned my addr 172.21.15.146:0/881648151 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923e00640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 0x7f7924141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939480291 0 0) 0x7f79240ced40 con 0x7f7924141ab0 2024-04-24T23:00:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7908003520 con 0x7f7924141ab0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2947127424 0 0) 0x7f7908003520 con 0x7f7924141ab0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 msgr2=0x7f7924141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 0x7f7924141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 >> v1:172.21.15.203:6789/0 conn(0x7f79240ce770 legacy=0x7f7924071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79240cf300 con 0x7f7924141ab0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.816+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f790c001670 con 0x7f7924141ab0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 >> v1:172.21.15.146:6789/0 conn(0x7f7924141ab0 legacy=0x7f79240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080039e0 0x7f7908003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 0x7f79080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f790800ba70 con 0x7f79080039e0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f790800bbf0 con 0x7f7908004800 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f790800bdf0 con 0x7f792413ef30 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080039e0 0x7f7908003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 -- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 msgr2=0x7f79080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413ef30 0x7f79080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f791b400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 -- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7908004800 msgr2=0x7f7908004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f7923e00640 1 -- 172.21.15.146:0/881648151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7908003520 con 0x7f79080039e0 2024-04-24T23:00:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.817+0000 7f791b400640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.818+0000 7f7923e00640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080039e0 0x7f7908003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7914009a90 tx=0x7f7908005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42db5f7795954f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914036070 con 0x7f79080039e0 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7914031400 con 0x7f79080039e0 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f7923400640 1 -- 172.21.15.146:0/881648151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914009690 con 0x7f79080039e0 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 -- 172.21.15.146:0/881648151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080039e0 msgr2=0x7f7908003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 --2- 172.21.15.146:0/881648151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080039e0 0x7f7908003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7914009a90 tx=0x7f7908005830 comp rx=0 tx=0).stop 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f7929200640 1 -- 172.21.15.146:0/881648151 reap_dead start 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 -- 172.21.15.146:0/881648151 shutdown_connections 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 -- 172.21.15.146:0/881648151 >> 172.21.15.146:0/881648151 conn(0x7f79240b17b0 msgr2=0x7f79240b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 -- 172.21.15.146:0/881648151 shutdown_connections 2024-04-24T23:00:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.819+0000 7f792b200640 1 -- 172.21.15.146:0/881648151 wait complete. 2024-04-24T23:00:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.821+0000 7f792b200640 1 Processor -- start 2024-04-24T23:00:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.821+0000 7f792b200640 1 -- start start 2024-04-24T23:00:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 0x7f79241f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413b140 0x7f7924139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7924141570 con 0x7f792413acc0 2024-04-24T23:00:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7924070f80 con 0x7f79080039e0 2024-04-24T23:00:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f792b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f79241416f0 con 0x7f792413b140 2024-04-24T23:00:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f791b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f791b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48902/0 (socket says 172.21.15.146:48902) 2024-04-24T23:00:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.822+0000 7f791b400640 1 -- 172.21.15.146:0/2832693498 learned_addr learned my addr 172.21.15.146:0/2832693498 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f7929200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413b140 0x7f7924139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f7923e00640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 0x7f79241f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 -- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413b140 msgr2=0x7f7924139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413b140 0x7f7924139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 -- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 msgr2=0x7f79241f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 0x7f79241f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 -- 172.21.15.146:0/2832693498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79241458f0 con 0x7f792413acc0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f7923e00640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 0x7f79241f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.823+0000 7f791b400640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f790c00d8d0 tx=0x7f790c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.824+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c019070 con 0x7f792413acc0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.824+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c0074e0 con 0x7f792413acc0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.824+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0049e0 con 0x7f792413acc0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.824+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792413da60 con 0x7f792413acc0 2024-04-24T23:00:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.824+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241375c0 con 0x7f792413acc0 2024-04-24T23:00:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.825+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792404f5a0 con 0x7f792413acc0 2024-04-24T23:00:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.826+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f790c004b80 con 0x7f792413acc0 2024-04-24T23:00:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.827+0000 7f7920c00640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 0x7f790006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.827+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f790c08acd0 con 0x7f792413acc0 2024-04-24T23:00:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.827+0000 7f7923e00640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 0x7f790006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.828+0000 7f7923e00640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 0x7f790006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7914033000 tx=0x7f7914008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:11.831+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f790c007690 con 0x7f792413acc0 2024-04-24T23:00:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.014+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7924072d30 con 0x7f792413acc0 2024-04-24T23:00:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.015+0000 7f7920c00640 1 -- 172.21.15.146:0/2832693498 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f790c0593f0 con 0x7f792413acc0 2024-04-24T23:00:12.016 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 msgr2=0x7f790006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 0x7f790006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7914033000 tx=0x7f7914008030 comp rx=0 tx=0).stop 2024-04-24T23:00:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 msgr2=0x7f79241399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f790c00d8d0 tx=0x7f790c00dd90 comp rx=0 tx=0).stop 2024-04-24T23:00:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 shutdown_connections 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f790006be30 0x7f790006e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f792413b140 0x7f7924139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792413acc0 0x7f79241399b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 --2- 172.21.15.146:0/2832693498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79080039e0 0x7f79241f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 >> 172.21.15.146:0/2832693498 conn(0x7f79240b17b0 msgr2=0x7f792413fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 shutdown_connections 2024-04-24T23:00:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.018+0000 7f792b200640 1 -- 172.21.15.146:0/2832693498 wait complete. 2024-04-24T23:00:12.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.235+0000 7f7631200640 1 Processor -- start 2024-04-24T23:00:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.235+0000 7f7631200640 1 -- start start 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7631200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f762c155460 0x7f762c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7631200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f762c06ea40 0x7f762c0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7631200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c0b3250 con 0x7f762c0b2ab0 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7631200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f762c0b3530 con 0x7f762c155460 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7631200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f762c0b3810 con 0x7f762c06ea40 2024-04-24T23:00:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7629e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f762c155460 0x7f762c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7629e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f762c155460 0x7f762c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48918/0 (socket says 172.21.15.146:48918) 2024-04-24T23:00:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7621400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f762c0b2ab0 0x7f762c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45952/0 (socket says 172.21.15.146:45952) 2024-04-24T23:00:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.236+0000 7f7629e00640 1 -- 172.21.15.146:0/1056323621 learned_addr learned my addr 172.21.15.146:0/1056323621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.237+0000 7f7629e00640 1 -- 172.21.15.146:0/1056323621 >> v2:172.21.15.203:3300/0 conn(0x7f762c06ea40 msgr2=0x7f762c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.237+0000 7f7629e00640 1 --2- 172.21.15.146:0/1056323621 >> v2:172.21.15.203:3300/0 conn(0x7f762c06ea40 0x7f762c0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.237+0000 7f7629e00640 1 -- 172.21.15.146:0/1056323621 >> v1:172.21.15.146:6789/0 conn(0x7f762c0b2ab0 legacy=0x7f762c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.237+0000 7f7629e00640 1 -- 172.21.15.146:0/1056323621 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c070ec0 con 0x7f762c155460 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.237+0000 7f7629400640 1 -- 172.21.15.146:0/1056323621 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14095739 0 0) 0x7f762c0b3250 con 0x7f762c0b2ab0 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7629e00640 1 --2- 172.21.15.146:0/1056323621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c155460 0x7f762c15be40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f762c073890 tx=0x7f761c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfed4cc108e2588f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7629400640 1 -- 172.21.15.146:0/1056323621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037070 con 0x7f762c155460 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7629400640 1 -- 172.21.15.146:0/1056323621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c032440 con 0x7f762c155460 2024-04-24T23:00:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7629400640 1 -- 172.21.15.146:0/1056323621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c032810 con 0x7f762c155460 2024-04-24T23:00:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7631200640 1 -- 172.21.15.146:0/1056323621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c155460 msgr2=0x7f762c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.238+0000 7f7631200640 1 --2- 172.21.15.146:0/1056323621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c155460 0x7f762c15be40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f762c073890 tx=0x7f761c02a270 comp rx=0 tx=0).stop 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 -- 172.21.15.146:0/1056323621 shutdown_connections 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 --2- 172.21.15.146:0/1056323621 >> v2:172.21.15.203:3300/0 conn(0x7f762c06ea40 0x7f762c0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 --2- 172.21.15.146:0/1056323621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c155460 0x7f762c15be40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 -- 172.21.15.146:0/1056323621 >> 172.21.15.146:0/1056323621 conn(0x7f762c0b17b0 msgr2=0x7f762c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 -- 172.21.15.146:0/1056323621 shutdown_connections 2024-04-24T23:00:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.239+0000 7f7631200640 1 -- 172.21.15.146:0/1056323621 wait complete. 2024-04-24T23:00:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.240+0000 7f7631200640 1 Processor -- start 2024-04-24T23:00:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 -- start start 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762c06ea40 0x7f762c14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f762c155460 0x7f762c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f762c15c480 con 0x7f762c0b2ab0 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f762c0b3af0 con 0x7f762c06ea40 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.241+0000 7f7631200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f762c15c600 con 0x7f762c155460 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48920/0 (socket says 172.21.15.146:48920) 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 -- 172.21.15.146:0/879297191 learned_addr learned my addr 172.21.15.146:0/879297191 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 -- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f762c155460 msgr2=0x7f762c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f762c155460 0x7f762c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 -- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762c06ea40 msgr2=0x7f762c14d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762c06ea40 0x7f762c14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 -- 172.21.15.146:0/879297191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c1f4870 con 0x7f762c0b2ab0 2024-04-24T23:00:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7621400640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f761400c4d0 tx=0x7f761400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.242+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614018070 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.243+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614007500 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.243+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614004a20 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.243+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c1f4b50 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.243+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c15dc80 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.244+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c15de80 con 0x7f762c0b2ab0 2024-04-24T23:00:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.245+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f761401b070 con 0x7f762c0b2ab0 2024-04-24T23:00:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.245+0000 7f7622a00640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 0x7f760806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.246+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f761408a5c0 con 0x7f762c0b2ab0 2024-04-24T23:00:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.246+0000 7f7629e00640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 0x7f760806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.247+0000 7f7629e00640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 0x7f760806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f761c034000 tx=0x7f761c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.250+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f762c15de80 con 0x7f762c0b2ab0 2024-04-24T23:00:12.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.445+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f762c06ce50 con 0x7f762c0b2ab0 2024-04-24T23:00:12.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.446+0000 7f7622a00640 1 -- 172.21.15.146:0/879297191 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f7614058b90 con 0x7f762c0b2ab0 2024-04-24T23:00:12.447 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.448+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 msgr2=0x7f760806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.448+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 0x7f760806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f761c034000 tx=0x7f761c02c000 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 msgr2=0x7f762c1f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f761400c4d0 tx=0x7f761400c990 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 shutdown_connections 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f760806be30 0x7f760806e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f762c155460 0x7f762c06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762c0b2ab0 0x7f762c1f3dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 --2- 172.21.15.146:0/879297191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762c06ea40 0x7f762c14d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 >> 172.21.15.146:0/879297191 conn(0x7f762c0b17b0 msgr2=0x7f762c152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 shutdown_connections 2024-04-24T23:00:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.449+0000 7f7631200640 1 -- 172.21.15.146:0/879297191 wait complete. 2024-04-24T23:00:12.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.671+0000 7f8595200640 1 Processor -- start 2024-04-24T23:00:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.671+0000 7f8595200640 1 -- start start 2024-04-24T23:00:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f8595200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f859015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f8595200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85900cdff0 0x7f85901524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f8595200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85900d01d0 con 0x7f85901605d0 2024-04-24T23:00:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f8595200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f859015d340 con 0x7f85900cdff0 2024-04-24T23:00:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f8595200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f85900cfef0 con 0x7f85900aebc0 2024-04-24T23:00:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f858e800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85900cdff0 0x7f85901524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f858e800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85900cdff0 0x7f85901524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48932/0 (socket says 172.21.15.146:48932) 2024-04-24T23:00:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.673+0000 7f858e800640 1 -- 172.21.15.146:0/3883704263 learned_addr learned my addr 172.21.15.146:0/3883704263 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.674+0000 7f858e800640 1 -- 172.21.15.146:0/3883704263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 msgr2=0x7f859015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.674+0000 7f858e800640 1 --2- 172.21.15.146:0/3883704263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f859015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.674+0000 7f858e800640 1 -- 172.21.15.146:0/3883704263 >> v1:172.21.15.203:6789/0 conn(0x7f85901605d0 legacy=0x7f85900cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.674+0000 7f858e800640 1 -- 172.21.15.146:0/3883704263 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859015faf0 con 0x7f85900cdff0 2024-04-24T23:00:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.675+0000 7f858e800640 1 --2- 172.21.15.146:0/3883704263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f85901524f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8588009e50 tx=0x7f858802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a975abc6361f43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.675+0000 7f858d400640 1 -- 172.21.15.146:0/3883704263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588036070 con 0x7f85900cdff0 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.675+0000 7f858d400640 1 -- 172.21.15.146:0/3883704263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8588031600 con 0x7f85900cdff0 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.675+0000 7f858d400640 1 -- 172.21.15.146:0/3883704263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85880319d0 con 0x7f85900cdff0 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 -- 172.21.15.146:0/3883704263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 msgr2=0x7f85901524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 --2- 172.21.15.146:0/3883704263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f85901524f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8588009e50 tx=0x7f858802a5b0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 -- 172.21.15.146:0/3883704263 shutdown_connections 2024-04-24T23:00:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 --2- 172.21.15.146:0/3883704263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f85901524f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 --2- 172.21.15.146:0/3883704263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f859015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 -- 172.21.15.146:0/3883704263 >> 172.21.15.146:0/3883704263 conn(0x7f85900b2570 msgr2=0x7f85900b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 -- 172.21.15.146:0/3883704263 shutdown_connections 2024-04-24T23:00:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.676+0000 7f8595200640 1 -- 172.21.15.146:0/3883704263 wait complete. 2024-04-24T23:00:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.678+0000 7f8595200640 1 Processor -- start 2024-04-24T23:00:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.678+0000 7f8595200640 1 -- start start 2024-04-24T23:00:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f85901508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 0x7f85901540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85900aefa0 con 0x7f85900cdff0 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85901600b0 con 0x7f85901605d0 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8595200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f85900af120 con 0x7f85900aebc0 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8585400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.679+0000 7f8585400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48944/0 (socket says 172.21.15.146:48944) 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 -- 172.21.15.146:0/3479480209 learned_addr learned my addr 172.21.15.146:0/3479480209 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f858de00640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f85901508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f858e800640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 0x7f85901540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 -- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 msgr2=0x7f85901508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f85901508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 -- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 msgr2=0x7f85901540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 0x7f85901540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 -- 172.21.15.146:0/3479480209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85901e5c60 con 0x7f85900cdff0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f858e800640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 0x7f85901540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8585400640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f857800c400 tx=0x7f857800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.680+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578011790 con 0x7f85900cdff0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.681+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578017070 con 0x7f85900cdff0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.681+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85901e5f40 con 0x7f85900cdff0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.681+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578011bb0 con 0x7f85900cdff0 2024-04-24T23:00:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.681+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859015e4e0 con 0x7f85900cdff0 2024-04-24T23:00:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.682+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859015e2f0 con 0x7f85900cdff0 2024-04-24T23:00:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.683+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f857801c460 con 0x7f85900cdff0 2024-04-24T23:00:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.683+0000 7f8586a00640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 0x7f856c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.684+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f857808aff0 con 0x7f85900cdff0 2024-04-24T23:00:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.684+0000 7f858de00640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 0x7f856c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.685+0000 7f858de00640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 0x7f856c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8590150e20 tx=0x7f8580008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.688+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8578059690 con 0x7f85900cdff0 2024-04-24T23:00:12.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.884+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85900b3ef0 con 0x7f85900cdff0 2024-04-24T23:00:12.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.885+0000 7f8586a00640 1 -- 172.21.15.146:0/3479480209 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f8578058f90 con 0x7f85900cdff0 2024-04-24T23:00:12.886 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 msgr2=0x7f856c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 0x7f856c06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8590150e20 tx=0x7f8580008040 comp rx=0 tx=0).stop 2024-04-24T23:00:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 msgr2=0x7f8590150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f857800c400 tx=0x7f857800c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 shutdown_connections 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85901605d0 0x7f85901540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85900cdff0 0x7f8590150e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f856c06be30 0x7f856c06e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 --2- 172.21.15.146:0/3479480209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85900aebc0 0x7f85901508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.887+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 >> 172.21.15.146:0/3479480209 conn(0x7f85900b2570 msgr2=0x7f85900cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.888+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 shutdown_connections 2024-04-24T23:00:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:12.888+0000 7f8595200640 1 -- 172.21.15.146:0/3479480209 wait complete. 2024-04-24T23:00:12.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:13.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:13.057 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.099+0000 7f21afe00640 1 Processor -- start 2024-04-24T23:00:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.100+0000 7f21afe00640 1 -- start start 2024-04-24T23:00:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21afe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21b015e060 0x7f21b00d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21afe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21afe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21b00d2510 con 0x7f21b00cea40 2024-04-24T23:00:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21afe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f21b00d0f90 con 0x7f21b015e060 2024-04-24T23:00:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21afe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21b00b0950 con 0x7f21b00d05f0 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21aea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21b015e060 0x7f21b00d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21af400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f21b00cea40 0x7f21b00ceed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45958/0 (socket says 172.21.15.146:45958) 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21aea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21b015e060 0x7f21b00d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48946/0 (socket says 172.21.15.146:48946) 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21af400640 1 -- 172.21.15.146:0/1465245110 learned_addr learned my addr 172.21.15.146:0/1465245110 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.101+0000 7f21a6000640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.102+0000 7f21aea00640 1 -- 172.21.15.146:0/1465245110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 msgr2=0x7f21b00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.102+0000 7f21aea00640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.102+0000 7f21aea00640 1 -- 172.21.15.146:0/1465245110 >> v1:172.21.15.146:6789/0 conn(0x7f21b00cea40 legacy=0x7f21b00ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.102+0000 7f21ae000640 1 -- 172.21.15.146:0/1465245110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861929219 0 0) 0x7f21b00d2510 con 0x7f21b00cea40 2024-04-24T23:00:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.102+0000 7f21aea00640 1 -- 172.21.15.146:0/1465245110 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b00d27f0 con 0x7f21b015e060 2024-04-24T23:00:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.103+0000 7f21aea00640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b00d1ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458ad3902465258e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.103+0000 7f21ae000640 1 -- 172.21.15.146:0/1465245110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0037070 con 0x7f21b015e060 2024-04-24T23:00:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.103+0000 7f21ae000640 1 -- 172.21.15.146:0/1465245110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a002ae50 con 0x7f21b015e060 2024-04-24T23:00:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.103+0000 7f21ae000640 1 -- 172.21.15.146:0/1465245110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0032660 con 0x7f21b015e060 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 -- 172.21.15.146:0/1465245110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 msgr2=0x7f21b00d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b00d1ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002a100 comp rx=0 tx=0).stop 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 -- 172.21.15.146:0/1465245110 shutdown_connections 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 --2- 172.21.15.146:0/1465245110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b00d1ac0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 -- 172.21.15.146:0/1465245110 >> 172.21.15.146:0/1465245110 conn(0x7f21b00d3c50 msgr2=0x7f21b00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 -- 172.21.15.146:0/1465245110 shutdown_connections 2024-04-24T23:00:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.104+0000 7f21afe00640 1 -- 172.21.15.146:0/1465245110 wait complete. 2024-04-24T23:00:13.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.106+0000 7f21afe00640 1 Processor -- start 2024-04-24T23:00:13.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.106+0000 7f21afe00640 1 -- start start 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f21b00d2db0 con 0x7f21b015e060 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21b00d21a0 con 0x7f21b00cea40 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21afe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21b00d49a0 con 0x7f21b00d05f0 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21af400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21a6000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21aea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21aea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:34776/0 (socket says 172.21.15.146:34776) 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21af400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48956/0 (socket says 172.21.15.146:48956) 2024-04-24T23:00:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.107+0000 7f21aea00640 1 -- 172.21.15.146:0/848001445 learned_addr learned my addr 172.21.15.146:0/848001445 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 -- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 msgr2=0x7f21b00b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 -- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 msgr2=0x7f21b00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 -- 172.21.15.146:0/848001445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b01f7af0 con 0x7f21b015e060 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21aea00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.108+0000 7f21af400640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c6d0 tx=0x7f21a800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.109+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8018070 con 0x7f21b015e060 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.109+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a8004d60 con 0x7f21b015e060 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.109+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a800a880 con 0x7f21b015e060 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.109+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b00c7780 con 0x7f21b015e060 2024-04-24T23:00:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.109+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b00c7d40 con 0x7f21b015e060 2024-04-24T23:00:13.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.110+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b004f500 con 0x7f21b015e060 2024-04-24T23:00:13.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.111+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21a801b070 con 0x7f21b015e060 2024-04-24T23:00:13.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.112+0000 7f21a7400640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.112+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f21a808a860 con 0x7f21b015e060 2024-04-24T23:00:13.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.113+0000 7f21aea00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.114+0000 7f21aea00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 0x7f218c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21a002a140 tx=0x7f21a002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.117+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f21a8058870 con 0x7f21b015e060 2024-04-24T23:00:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.312+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f21b00d1c10 con 0x7f21b015e060 2024-04-24T23:00:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.313+0000 7f21a7400640 1 -- 172.21.15.146:0/848001445 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f21a805cb70 con 0x7f21b015e060 2024-04-24T23:00:13.314 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 msgr2=0x7f218c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 0x7f218c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21a002a140 tx=0x7f21a002e000 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 msgr2=0x7f21b01f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c6d0 tx=0x7f21a800cb90 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 shutdown_connections 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21b015e060 0x7f21b01f6d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21b00d05f0 0x7f21b00b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 --2- 172.21.15.146:0/848001445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21b00cea40 0x7f21b00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 >> 172.21.15.146:0/848001445 conn(0x7f21b00d3c50 msgr2=0x7f21b006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.315+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 shutdown_connections 2024-04-24T23:00:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.316+0000 7f21afe00640 1 -- 172.21.15.146:0/848001445 wait complete. 2024-04-24T23:00:13.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:00:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.518+0000 7f1f3fe00640 1 Processor -- start 2024-04-24T23:00:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.518+0000 7f1f3fe00640 1 -- start start 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3815abb0 0x7f1f3806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f3815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3fe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f38071960 con 0x7f1f3815e8b0 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1f38071c40 con 0x7f1f3815abb0 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f38071f20 con 0x7f1f3815f3f0 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3815abb0 0x7f1f3806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3ca00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1f3815e8b0 0x7f1f3815ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45972/0 (socket says 172.21.15.146:45972) 2024-04-24T23:00:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3ca00640 1 -- 172.21.15.146:0/1585105796 learned_addr learned my addr 172.21.15.146:0/1585105796 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3815abb0 0x7f1f3806cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48958/0 (socket says 172.21.15.146:48958) 2024-04-24T23:00:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.520+0000 7f1f3de00640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f3815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.521+0000 7f1f3d400640 1 -- 172.21.15.146:0/1585105796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 msgr2=0x7f1f3815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.521+0000 7f1f3d400640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f3815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.521+0000 7f1f3d400640 1 -- 172.21.15.146:0/1585105796 >> v1:172.21.15.146:6789/0 conn(0x7f1f3815e8b0 legacy=0x7f1f3815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.521+0000 7f1f3d400640 1 -- 172.21.15.146:0/1585105796 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38072200 con 0x7f1f3815abb0 2024-04-24T23:00:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.521+0000 7f1f37e00640 1 -- 172.21.15.146:0/1585105796 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550983031 0 0) 0x7f1f38071960 con 0x7f1f3815e8b0 2024-04-24T23:00:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.522+0000 7f1f3d400640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815abb0 0x7f1f3806cbc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097a0 tx=0x7f1f2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fdd8d27955aea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.522+0000 7f1f37e00640 1 -- 172.21.15.146:0/1585105796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28037070 con 0x7f1f3815abb0 2024-04-24T23:00:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.522+0000 7f1f37e00640 1 -- 172.21.15.146:0/1585105796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28032440 con 0x7f1f3815abb0 2024-04-24T23:00:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.522+0000 7f1f37e00640 1 -- 172.21.15.146:0/1585105796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28032810 con 0x7f1f3815abb0 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 -- 172.21.15.146:0/1585105796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815abb0 msgr2=0x7f1f3806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815abb0 0x7f1f3806cbc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097a0 tx=0x7f1f2802a180 comp rx=0 tx=0).stop 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 -- 172.21.15.146:0/1585105796 shutdown_connections 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f3815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/1585105796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815abb0 0x7f1f3806cbc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 -- 172.21.15.146:0/1585105796 >> 172.21.15.146:0/1585105796 conn(0x7f1f3806b140 msgr2=0x7f1f3806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 -- 172.21.15.146:0/1585105796 shutdown_connections 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.523+0000 7f1f3fe00640 1 -- 172.21.15.146:0/1585105796 wait complete. 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.524+0000 7f1f3fe00640 1 Processor -- start 2024-04-24T23:00:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.525+0000 7f1f3fe00640 1 -- start start 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.525+0000 7f1f3fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f3815abb0 0x7f1f3814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f381504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3815c120 con 0x7f1f3815e8b0 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3815bfa0 con 0x7f1f3815abb0 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3815ccf0 con 0x7f1f3815f3f0 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48966/0 (socket says 172.21.15.146:48966) 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 -- 172.21.15.146:0/308682283 learned_addr learned my addr 172.21.15.146:0/308682283 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3d400640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f3815abb0 0x7f1f3814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 -- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 msgr2=0x7f1f381504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f381504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 -- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f3815abb0 msgr2=0x7f1f3814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f3815abb0 0x7f1f3814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 -- 172.21.15.146:0/308682283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380b3910 con 0x7f1f3815e8b0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.526+0000 7f1f3ca00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c890 tx=0x7f1f2c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.527+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c018070 con 0x7f1f3815e8b0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.527+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00a640 con 0x7f1f3815e8b0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.527+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00aa30 con 0x7f1f3815e8b0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.527+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f380b3bf0 con 0x7f1f3815e8b0 2024-04-24T23:00:13.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.527+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f38163e70 con 0x7f1f3815e8b0 2024-04-24T23:00:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.528+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3804f5a0 con 0x7f1f3815e8b0 2024-04-24T23:00:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.529+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f2c00abd0 con 0x7f1f3815e8b0 2024-04-24T23:00:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.530+0000 7f1f35600640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 0x7f1f1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.530+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1f2c08a790 con 0x7f1f3815e8b0 2024-04-24T23:00:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.531+0000 7f1f3d400640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 0x7f1f1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.531+0000 7f1f3d400640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 0x7f1f1c06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.534+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f2c058df0 con 0x7f1f3815e8b0 2024-04-24T23:00:13.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.750+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1f38073e70 con 0x7f1f3815e8b0 2024-04-24T23:00:13.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.751+0000 7f1f35600640 1 -- 172.21.15.146:0/308682283 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f1f2c0586f0 con 0x7f1f3815e8b0 2024-04-24T23:00:13.753 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:00:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 msgr2=0x7f1f1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 0x7f1f1c06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 msgr2=0x7f1f381666e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c890 tx=0x7f1f2c00cd50 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 shutdown_connections 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1c06be60 0x7f1f1c06e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f3815f3f0 0x7f1f381504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3815e8b0 0x7f1f381666e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 --2- 172.21.15.146:0/308682283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f3815abb0 0x7f1f3814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 >> 172.21.15.146:0/308682283 conn(0x7f1f3806b140 msgr2=0x7f1f3806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 shutdown_connections 2024-04-24T23:00:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:13.754+0000 7f1f3fe00640 1 -- 172.21.15.146:0/308682283 wait complete. 2024-04-24T23:00:13.774 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2024-04-24T23:00:13.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:13.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:13.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[39839]: fuse finished with error 0 and tester_r 0 2024-04-24T23:00:13.860 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:00:19.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:00:19.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:19.963 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-24T23:00:20.035 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:20.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.239+0000 7f37ace00640 1 Processor -- start 2024-04-24T23:00:20.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.240+0000 7f37ace00640 1 -- start start 2024-04-24T23:00:20.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.241+0000 7f37ace00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37a80715f0 0x7f37a8071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.241+0000 7f37ace00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a8158970 con 0x7f37a80cfc90 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.241+0000 7f37ace00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a8070c10 con 0x7f37a8158590 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.241+0000 7f37ace00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f37a8070ef0 con 0x7f37a80715f0 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f37a6800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37a80cfc90 0x7f37a815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47332/0 (socket says 172.21.15.146:47332) 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f379fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37a80715f0 0x7f37a8071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f37a6800640 1 -- 172.21.15.146:0/1876683695 learned_addr learned my addr 172.21.15.146:0/1876683695 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f379fe00640 1 -- 172.21.15.146:0/1876683695 >> v1:172.21.15.203:6789/0 conn(0x7f37a8158590 legacy=0x7f37a8162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f379fe00640 1 -- 172.21.15.146:0/1876683695 >> v1:172.21.15.146:6789/0 conn(0x7f37a80cfc90 legacy=0x7f37a815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.242+0000 7f379fe00640 1 -- 172.21.15.146:0/1876683695 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a80711d0 con 0x7f37a80715f0 2024-04-24T23:00:20.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.243+0000 7f379fe00640 1 --2- 172.21.15.146:0/1876683695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a8071a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37900097a0 tx=0x7f379002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3633863308919ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37a5400640 1 -- 172.21.15.146:0/1876683695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790037070 con 0x7f37a80715f0 2024-04-24T23:00:20.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37a5400640 1 -- 172.21.15.146:0/1876683695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3790032440 con 0x7f37a80715f0 2024-04-24T23:00:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37a5400640 1 -- 172.21.15.146:0/1876683695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790032810 con 0x7f37a80715f0 2024-04-24T23:00:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37ace00640 1 -- 172.21.15.146:0/1876683695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 msgr2=0x7f37a8071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37ace00640 1 --2- 172.21.15.146:0/1876683695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a8071a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37900097a0 tx=0x7f379002a270 comp rx=0 tx=0).stop 2024-04-24T23:00:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37ace00640 1 -- 172.21.15.146:0/1876683695 shutdown_connections 2024-04-24T23:00:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37ace00640 1 --2- 172.21.15.146:0/1876683695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a8071a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.244+0000 7f37ace00640 1 -- 172.21.15.146:0/1876683695 >> 172.21.15.146:0/1876683695 conn(0x7f37a806b320 msgr2=0x7f37a806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.245+0000 7f37ace00640 1 -- 172.21.15.146:0/1876683695 shutdown_connections 2024-04-24T23:00:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.245+0000 7f37ace00640 1 -- 172.21.15.146:0/1876683695 wait complete. 2024-04-24T23:00:20.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.246+0000 7f37ace00640 1 Processor -- start 2024-04-24T23:00:20.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.247+0000 7f37ace00640 1 -- start start 2024-04-24T23:00:20.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37a80cfc90 0x7f37a8159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 0x7f37a815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80d0100 con 0x7f37a80715f0 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8161f30 con 0x7f37a8158590 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37ace00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f37a80d0280 con 0x7f37a80cfc90 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34148/0 (socket says 172.21.15.146:34148) 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 -- 172.21.15.146:0/3078229774 learned_addr learned my addr 172.21.15.146:0/3078229774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f379fe00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37a80cfc90 0x7f37a8159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a6800640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 0x7f37a815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 -- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37a80cfc90 msgr2=0x7f37a8159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37a80cfc90 0x7f37a8159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 -- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 msgr2=0x7f37a815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 0x7f37a815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a5e00640 1 -- 172.21.15.146:0/3078229774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a815ca20 con 0x7f37a80715f0 2024-04-24T23:00:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.248+0000 7f37a6800640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 0x7f37a815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:20.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.249+0000 7f37a5e00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f379800b3f0 tx=0x7f379800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.250+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798015020 con 0x7f37a80715f0 2024-04-24T23:00:20.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.250+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3798011830 con 0x7f37a80715f0 2024-04-24T23:00:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.250+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a815cd00 con 0x7f37a80715f0 2024-04-24T23:00:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.250+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798011c20 con 0x7f37a80715f0 2024-04-24T23:00:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.250+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a815d2c0 con 0x7f37a80715f0 2024-04-24T23:00:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.252+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a80ae010 con 0x7f37a80715f0 2024-04-24T23:00:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.252+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3798018020 con 0x7f37a80715f0 2024-04-24T23:00:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.253+0000 7f379e000640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 0x7f378406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.253+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f379808ae80 con 0x7f37a80715f0 2024-04-24T23:00:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.254+0000 7f379fe00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 0x7f378406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.255+0000 7f379fe00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 0x7f378406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3790034000 tx=0x7f379002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.258+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f37a80ae010 con 0x7f37a80715f0 2024-04-24T23:00:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.460+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37a8068190 con 0x7f37a80715f0 2024-04-24T23:00:20.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.463+0000 7f379e000640 1 -- 172.21.15.146:0/3078229774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f379801f030 con 0x7f37a80715f0 2024-04-24T23:00:20.465 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:20.465 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 msgr2=0x7f378406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 0x7f378406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3790034000 tx=0x7f379002e000 comp rx=0 tx=0).stop 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 msgr2=0x7f37a815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f379800b3f0 tx=0x7f379800b8b0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 shutdown_connections 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37a8158590 0x7f37a815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f378406be30 0x7f378406e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37a80cfc90 0x7f37a8159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 --2- 172.21.15.146:0/3078229774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a80715f0 0x7f37a815edc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 >> 172.21.15.146:0/3078229774 conn(0x7f37a806b320 msgr2=0x7f37a8162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 shutdown_connections 2024-04-24T23:00:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.466+0000 7f37ace00640 1 -- 172.21.15.146:0/3078229774 wait complete. 2024-04-24T23:00:20.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.685+0000 7f6a75e00640 1 Processor -- start 2024-04-24T23:00:20.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.685+0000 7f6a75e00640 1 -- start start 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.686+0000 7f6a75e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 0x7f6a700b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.686+0000 7f6a75e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a7014be80 0x7f6a700cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.686+0000 7f6a75e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a700d05e0 con 0x7f6a700d01d0 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.686+0000 7f6a75e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7014bc30 con 0x7f6a7014be80 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.686+0000 7f6a75e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a701662b0 con 0x7f6a7014b850 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a7014be80 0x7f6a700cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a7014be80 0x7f6a700cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34156/0 (socket says 172.21.15.146:34156) 2024-04-24T23:00:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 -- 172.21.15.146:0/1322079987 learned_addr learned my addr 172.21.15.146:0/1322079987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a6ea00640 1 --2- 172.21.15.146:0/1322079987 >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 0x7f6a700b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 -- 172.21.15.146:0/1322079987 >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 msgr2=0x7f6a700b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 --2- 172.21.15.146:0/1322079987 >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 0x7f6a700b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 -- 172.21.15.146:0/1322079987 >> v1:172.21.15.203:6789/0 conn(0x7f6a700d01d0 legacy=0x7f6a7006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a66000640 1 -- 172.21.15.146:0/1322079987 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a70166590 con 0x7f6a7014be80 2024-04-24T23:00:20.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.687+0000 7f6a6ea00640 1 --2- 172.21.15.146:0/1322079987 >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 0x7f6a700b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:20.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.688+0000 7f6a66000640 1 --2- 172.21.15.146:0/1322079987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7014be80 0x7f6a700cfc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006dcc0 tx=0x7f6a5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843e66f628bbf84d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a6e000640 1 -- 172.21.15.146:0/1322079987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58037070 con 0x7f6a7014be80 2024-04-24T23:00:20.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a6e000640 1 -- 172.21.15.146:0/1322079987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a58032440 con 0x7f6a7014be80 2024-04-24T23:00:20.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a6e000640 1 -- 172.21.15.146:0/1322079987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58032810 con 0x7f6a7014be80 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 -- 172.21.15.146:0/1322079987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7014be80 msgr2=0x7f6a700cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 --2- 172.21.15.146:0/1322079987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7014be80 0x7f6a700cfc90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006dcc0 tx=0x7f6a5802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 -- 172.21.15.146:0/1322079987 shutdown_connections 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 --2- 172.21.15.146:0/1322079987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7014be80 0x7f6a700cfc90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 --2- 172.21.15.146:0/1322079987 >> v2:172.21.15.203:3300/0 conn(0x7f6a7014b850 0x7f6a700b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.689+0000 7f6a75e00640 1 -- 172.21.15.146:0/1322079987 >> 172.21.15.146:0/1322079987 conn(0x7f6a7006b320 msgr2=0x7f6a7006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.690+0000 7f6a75e00640 1 -- 172.21.15.146:0/1322079987 shutdown_connections 2024-04-24T23:00:20.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.690+0000 7f6a75e00640 1 -- 172.21.15.146:0/1322079987 wait complete. 2024-04-24T23:00:20.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.691+0000 7f6a75e00640 1 Processor -- start 2024-04-24T23:00:20.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.691+0000 7f6a75e00640 1 -- start start 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a7014b850 0x7f6a70148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 0x7f6a700a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70165ef0 con 0x7f6a700d01d0 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70166b50 con 0x7f6a7014b850 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.692+0000 7f6a75e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a70166070 con 0x7f6a7014be80 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34164/0 (socket says 172.21.15.146:34164) 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 -- 172.21.15.146:0/4261110557 learned_addr learned my addr 172.21.15.146:0/4261110557 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a66000640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a7014b850 0x7f6a70148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 -- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 msgr2=0x7f6a700a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6f400640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 0x7f6a700a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 0x7f6a700a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 -- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a7014b850 msgr2=0x7f6a70148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a7014b850 0x7f6a70148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6ea00640 1 -- 172.21.15.146:0/4261110557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a70148e70 con 0x7f6a700d01d0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.693+0000 7f6a6f400640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 0x7f6a700a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a6ea00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c820 tx=0x7f6a6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60015070 con 0x7f6a700d01d0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a60007a30 con 0x7f6a700d01d0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007e00 con 0x7f6a700d01d0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a70149150 con 0x7f6a700d01d0 2024-04-24T23:00:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.694+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a70149710 con 0x7f6a700d01d0 2024-04-24T23:00:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.695+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a70068190 con 0x7f6a700d01d0 2024-04-24T23:00:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.696+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a60018070 con 0x7f6a700d01d0 2024-04-24T23:00:20.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.697+0000 7f6a67e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 0x7f6a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.698+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6a6008b1a0 con 0x7f6a700d01d0 2024-04-24T23:00:20.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.698+0000 7f6a66000640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 0x7f6a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.699+0000 7f6a66000640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 0x7f6a4c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.702+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a60059800 con 0x7f6a700d01d0 2024-04-24T23:00:20.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.906+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a7006e770 con 0x7f6a700d01d0 2024-04-24T23:00:20.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.908+0000 7f6a67e00640 1 -- 172.21.15.146:0/4261110557 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f6a60059100 con 0x7f6a700d01d0 2024-04-24T23:00:20.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:20.910 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:20.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 msgr2=0x7f6a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 0x7f6a4c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:20.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 msgr2=0x7f6a701612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000c820 tx=0x7f6a6000cc20 comp rx=0 tx=0).stop 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 shutdown_connections 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a4c06be30 0x7f6a4c06e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a7014be80 0x7f6a700a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a7014b850 0x7f6a70148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 --2- 172.21.15.146:0/4261110557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a700d01d0 0x7f6a701612f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 >> 172.21.15.146:0/4261110557 conn(0x7f6a7006b320 msgr2=0x7f6a7006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 shutdown_connections 2024-04-24T23:00:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:20.911+0000 7f6a75e00640 1 -- 172.21.15.146:0/4261110557 wait complete. 2024-04-24T23:00:20.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:00:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.136+0000 7fe10b000640 1 Processor -- start 2024-04-24T23:00:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.136+0000 7fe10b000640 1 -- start start 2024-04-24T23:00:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1040afbd0 0x7fe1040b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe10406ef30 0x7fe104161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe104162090 0x7fe10415e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe1040b5120 con 0x7fe1040afbd0 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe1040b4880 con 0x7fe104162090 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe10b000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe1040b4b60 con 0x7fe10406ef30 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe103e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1040afbd0 0x7fe1040b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe103e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1040afbd0 0x7fe1040b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34168/0 (socket says 172.21.15.146:34168) 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.138+0000 7fe103e00640 1 -- 172.21.15.146:0/3148666284 learned_addr learned my addr 172.21.15.146:0/3148666284 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103400640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe10406ef30 0x7fe104161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe109000640 1 --2- 172.21.15.146:0/3148666284 >> v2:172.21.15.203:3300/0 conn(0x7fe104162090 0x7fe10415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103e00640 1 -- 172.21.15.146:0/3148666284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe10406ef30 msgr2=0x7fe104161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103e00640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe10406ef30 0x7fe104161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103e00640 1 -- 172.21.15.146:0/3148666284 >> v2:172.21.15.203:3300/0 conn(0x7fe104162090 msgr2=0x7fe10415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103e00640 1 --2- 172.21.15.146:0/3148666284 >> v2:172.21.15.203:3300/0 conn(0x7fe104162090 0x7fe10415e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.139+0000 7fe103e00640 1 -- 172.21.15.146:0/3148666284 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1040b4e40 con 0x7fe1040afbd0 2024-04-24T23:00:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.141+0000 7fe103e00640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1040afbd0 0x7fe1040b4030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe10406db90 tx=0x7fe0f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc68c5bcb37b3b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.141+0000 7fe102a00640 1 -- 172.21.15.146:0/3148666284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4037070 con 0x7fe1040afbd0 2024-04-24T23:00:21.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.141+0000 7fe102a00640 1 -- 172.21.15.146:0/3148666284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4032440 con 0x7fe1040afbd0 2024-04-24T23:00:21.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.141+0000 7fe102a00640 1 -- 172.21.15.146:0/3148666284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4032810 con 0x7fe1040afbd0 2024-04-24T23:00:21.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 -- 172.21.15.146:0/3148666284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1040afbd0 msgr2=0x7fe1040b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1040afbd0 0x7fe1040b4030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe10406db90 tx=0x7fe0f402a140 comp rx=0 tx=0).stop 2024-04-24T23:00:21.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 -- 172.21.15.146:0/3148666284 shutdown_connections 2024-04-24T23:00:21.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 --2- 172.21.15.146:0/3148666284 >> v2:172.21.15.203:3300/0 conn(0x7fe104162090 0x7fe10415e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe10406ef30 0x7fe104161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 --2- 172.21.15.146:0/3148666284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1040afbd0 0x7fe1040b4030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 -- 172.21.15.146:0/3148666284 >> 172.21.15.146:0/3148666284 conn(0x7fe1040b2570 msgr2=0x7fe1040b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 -- 172.21.15.146:0/3148666284 shutdown_connections 2024-04-24T23:00:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.142+0000 7fe10b000640 1 -- 172.21.15.146:0/3148666284 wait complete. 2024-04-24T23:00:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.144+0000 7fe10b000640 1 Processor -- start 2024-04-24T23:00:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.145+0000 7fe10b000640 1 -- start start 2024-04-24T23:00:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1040afbd0 0x7fe1040cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe104162090 0x7fe104143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe10415ea50 con 0x7fe10406ef30 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1040b4570 con 0x7fe104162090 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe10b000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe10415ebd0 con 0x7fe1040afbd0 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe103e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe103e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34182/0 (socket says 172.21.15.146:34182) 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.146+0000 7fe103e00640 1 -- 172.21.15.146:0/1492070464 learned_addr learned my addr 172.21.15.146:0/1492070464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe109000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe104162090 0x7fe104143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103400640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1040afbd0 0x7fe1040cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 -- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1040afbd0 msgr2=0x7fe1040cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1040afbd0 0x7fe1040cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 -- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe104162090 msgr2=0x7fe104143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe104162090 0x7fe104143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 -- 172.21.15.146:0/1492070464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe104144a80 con 0x7fe10406ef30 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe103e00640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0f402a180 tx=0x7fe0f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4041020 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f40306c0 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4037040 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.147+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe104144d60 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.148+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe104145320 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.149+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10404f5a0 con 0x7fe10406ef30 2024-04-24T23:00:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.150+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0f4044020 con 0x7fe10406ef30 2024-04-24T23:00:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.151+0000 7fe0fbe00640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.151+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe0f40aba40 con 0x7fe10406ef30 2024-04-24T23:00:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.151+0000 7fe103400640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.153+0000 7fe103400640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 0x7fe0e406e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1041608b0 tx=0x7fe0f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.155+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0f404b030 con 0x7fe10406ef30 2024-04-24T23:00:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:21.396+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe10406dbf0 con 0x7fe10406ef30 2024-04-24T23:00:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.261+0000 7fe0fbe00640 1 -- 172.21.15.146:0/1492070464 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fe0f407a010 con 0x7fe10406ef30 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 msgr2=0x7fe0e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 0x7fe0e406e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1041608b0 tx=0x7fe0f0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 msgr2=0x7fe104144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0f402a180 tx=0x7fe0f40046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 shutdown_connections 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe104162090 0x7fe104143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe0e406be60 0x7fe0e406e320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1040afbd0 0x7fe1040cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 --2- 172.21.15.146:0/1492070464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe10406ef30 0x7fe104144380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 >> 172.21.15.146:0/1492070464 conn(0x7fe1040b2570 msgr2=0x7fe1040b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 shutdown_connections 2024-04-24T23:00:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.265+0000 7fe10b000640 1 -- 172.21.15.146:0/1492070464 wait complete. 2024-04-24T23:00:22.289 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-24T23:00:22.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:00:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.491+0000 7fe6cde00640 1 Processor -- start 2024-04-24T23:00:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.492+0000 7fe6cde00640 1 -- start start 2024-04-24T23:00:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.493+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6c80cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.493+0000 7fe6cde00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe6c815ed20 0x7fe6c8150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.493+0000 7fe6cde00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c815b530 con 0x7fe6c806ec10 2024-04-24T23:00:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.493+0000 7fe6cde00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c80cf8d0 con 0x7fe6c815ed20 2024-04-24T23:00:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.493+0000 7fe6cde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c815b810 con 0x7fe6c8071b30 2024-04-24T23:00:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6c6a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe6c806ec10 0x7fe6c8071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47338/0 (socket says 172.21.15.146:47338) 2024-04-24T23:00:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6c6a00640 1 -- 172.21.15.146:0/3253532685 learned_addr learned my addr 172.21.15.146:0/3253532685 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6be000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6c80cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6c7400640 1 --2- 172.21.15.146:0/3253532685 >> v2:172.21.15.203:3300/0 conn(0x7fe6c815ed20 0x7fe6c8150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864921905 0 0) 0x7fe6c815b530 con 0x7fe6c806ec10 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.494+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ac005730 con 0x7fe6c806ec10 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2545571921 0 0) 0x7fe6ac005730 con 0x7fe6c806ec10 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 msgr2=0x7fe6c80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6c80cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 >> v2:172.21.15.203:3300/0 conn(0x7fe6c815ed20 msgr2=0x7fe6c8150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 --2- 172.21.15.146:0/3253532685 >> v2:172.21.15.203:3300/0 conn(0x7fe6c815ed20 0x7fe6c8150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c815e240 con 0x7fe6c806ec10 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe6b8001670 con 0x7fe6c806ec10 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 >> v1:172.21.15.146:6789/0 conn(0x7fe6c806ec10 legacy=0x7fe6c8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac005bc0 0x7fe6ac005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6ac006520 0x7fe6ac006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6ac007000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c80cf8d0 con 0x7fe6ac006520 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c815b810 con 0x7fe6ac005bc0 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0077c0 con 0x7fe6c8071b30 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.495+0000 7fe6be000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6ac006520 0x7fe6ac006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6c7400640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6ac007000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6c6a00640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac005bc0 0x7fe6ac005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6be000640 1 -- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 msgr2=0x7fe6ac007000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6be000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6ac007000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6be000640 1 -- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac005bc0 msgr2=0x7fe6ac005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6be000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac005bc0 0x7fe6ac005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6be000640 1 -- 172.21.15.146:0/3253532685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac005730 con 0x7fe6ac006520 2024-04-24T23:00:22.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.496+0000 7fe6c7400640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c8071b30 0x7fe6ac007000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.497+0000 7fe6be000640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6ac006520 0x7fe6ac006a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009a90 tx=0x7fe6ac007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a93aced202f9d32 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.497+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0036070 con 0x7fe6ac006520 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.497+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0031400 con 0x7fe6ac006520 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.497+0000 7fe6c6000640 1 -- 172.21.15.146:0/3253532685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0009690 con 0x7fe6ac006520 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 -- 172.21.15.146:0/3253532685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6ac006520 msgr2=0x7fe6ac006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 --2- 172.21.15.146:0/3253532685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6ac006520 0x7fe6ac006a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009a90 tx=0x7fe6ac007a40 comp rx=0 tx=0).stop 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6c7400640 1 -- 172.21.15.146:0/3253532685 reap_dead start 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 -- 172.21.15.146:0/3253532685 shutdown_connections 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 -- 172.21.15.146:0/3253532685 >> 172.21.15.146:0/3253532685 conn(0x7fe6c80b17b0 msgr2=0x7fe6c80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 -- 172.21.15.146:0/3253532685 shutdown_connections 2024-04-24T23:00:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.498+0000 7fe6cde00640 1 -- 172.21.15.146:0/3253532685 wait complete. 2024-04-24T23:00:22.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.499+0000 7fe6cde00640 1 Processor -- start 2024-04-24T23:00:22.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.500+0000 7fe6cde00640 1 -- start start 2024-04-24T23:00:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac006520 0x7fe6c8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c81f9240 0x7fe6c8156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c80b4b00 con 0x7fe6c8156bd0 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c815e800 con 0x7fe6ac006520 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6cde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c80b4c80 con 0x7fe6c81f9240 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34198/0 (socket says 172.21.15.146:34198) 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 -- 172.21.15.146:0/976419127 learned_addr learned my addr 172.21.15.146:0/976419127 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c6a00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac006520 0x7fe6c8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6be000640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c81f9240 0x7fe6c8156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 -- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c81f9240 msgr2=0x7fe6c8156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c81f9240 0x7fe6c8156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 -- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac006520 msgr2=0x7fe6c8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac006520 0x7fe6c8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.501+0000 7fe6c7400640 1 -- 172.21.15.146:0/976419127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c81f84a0 con 0x7fe6c8156bd0 2024-04-24T23:00:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6c7400640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6c804fa90 tx=0x7fe6c000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0016620 con 0x7fe6c8156bd0 2024-04-24T23:00:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c001b070 con 0x7fe6c8156bd0 2024-04-24T23:00:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00169e0 con 0x7fe6c8156bd0 2024-04-24T23:00:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c8159c50 con 0x7fe6c8156bd0 2024-04-24T23:00:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.502+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c81f8a40 con 0x7fe6c8156bd0 2024-04-24T23:00:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.503+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c804f5a0 con 0x7fe6c8156bd0 2024-04-24T23:00:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.504+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6c0005d10 con 0x7fe6c8156bd0 2024-04-24T23:00:22.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.505+0000 7fe6bfe00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.505+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe6c008bdb0 con 0x7fe6c8156bd0 2024-04-24T23:00:22.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.506+0000 7fe6c6a00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.507+0000 7fe6c6a00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.510+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe6c0090070 con 0x7fe6c8156bd0 2024-04-24T23:00:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:22.742+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe6c80b2fc0 con 0x7fe6c8156bd0 2024-04-24T23:00:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.273+0000 7fe6bfe00640 1 -- 172.21.15.146:0/976419127 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fe6c0025020 con 0x7fe6c8156bd0 2024-04-24T23:00:23.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 msgr2=0x7fe6a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8009040 comp rx=0 tx=0).stop 2024-04-24T23:00:23.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 msgr2=0x7fe6c815cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6c804fa90 tx=0x7fe6c000f520 comp rx=0 tx=0).stop 2024-04-24T23:00:23.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 shutdown_connections 2024-04-24T23:00:23.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8156bd0 0x7fe6c815cc30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6c81f9240 0x7fe6c8156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 --2- 172.21.15.146:0/976419127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6ac006520 0x7fe6c8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 >> 172.21.15.146:0/976419127 conn(0x7fe6c80b17b0 msgr2=0x7fe6c815baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 shutdown_connections 2024-04-24T23:00:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.277+0000 7fe6cde00640 1 -- 172.21.15.146:0/976419127 wait complete. 2024-04-24T23:00:23.299 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:00:23.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:23.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.496+0000 7eff5b800640 1 Processor -- start 2024-04-24T23:00:23.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.497+0000 7eff5b800640 1 -- start start 2024-04-24T23:00:23.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff5b800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff5415e490 0x7eff540d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff5b800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540d49e0 0x7eff540d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff5b800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff540b3930 con 0x7eff540b3e30 2024-04-24T23:00:23.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff5b800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7eff540d0f50 con 0x7eff5415e490 2024-04-24T23:00:23.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff5b800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff540d1d40 con 0x7eff540d49e0 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.498+0000 7eff58e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff5415e490 0x7eff540d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff5415e490 0x7eff540d24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34210/0 (socket says 172.21.15.146:34210) 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 -- 172.21.15.146:0/547277720 learned_addr learned my addr 172.21.15.146:0/547277720 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 -- 172.21.15.146:0/547277720 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540d49e0 msgr2=0x7eff540d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 --2- 172.21.15.146:0/547277720 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540d49e0 0x7eff540d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 -- 172.21.15.146:0/547277720 >> v1:172.21.15.203:6789/0 conn(0x7eff540b3e30 legacy=0x7eff540b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.499+0000 7eff58e00640 1 -- 172.21.15.146:0/547277720 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff540d2020 con 0x7eff5415e490 2024-04-24T23:00:23.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.500+0000 7eff58e00640 1 --2- 172.21.15.146:0/547277720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff540d24a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009870 tx=0x7eff3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9a89e46d3df63 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.501+0000 7eff53400640 1 -- 172.21.15.146:0/547277720 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c037070 con 0x7eff5415e490 2024-04-24T23:00:23.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.501+0000 7eff53400640 1 -- 172.21.15.146:0/547277720 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c032440 con 0x7eff5415e490 2024-04-24T23:00:23.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.501+0000 7eff53400640 1 -- 172.21.15.146:0/547277720 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c032810 con 0x7eff5415e490 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.501+0000 7eff5b800640 1 -- 172.21.15.146:0/547277720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 msgr2=0x7eff540d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.501+0000 7eff5b800640 1 --2- 172.21.15.146:0/547277720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff540d24a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009870 tx=0x7eff3c02a210 comp rx=0 tx=0).stop 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 -- 172.21.15.146:0/547277720 shutdown_connections 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 --2- 172.21.15.146:0/547277720 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540d49e0 0x7eff540d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 --2- 172.21.15.146:0/547277720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff540d24a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 -- 172.21.15.146:0/547277720 >> 172.21.15.146:0/547277720 conn(0x7eff540d3ec0 msgr2=0x7eff540d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 -- 172.21.15.146:0/547277720 shutdown_connections 2024-04-24T23:00:23.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.502+0000 7eff5b800640 1 -- 172.21.15.146:0/547277720 wait complete. 2024-04-24T23:00:23.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.503+0000 7eff5b800640 1 Processor -- start 2024-04-24T23:00:23.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.503+0000 7eff5b800640 1 -- start start 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540b3e30 0x7eff5406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff540d49e0 0x7eff54155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff540cfac0 con 0x7eff5415e490 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff540d11a0 con 0x7eff540d49e0 2024-04-24T23:00:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.504+0000 7eff5b800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff540cfc40 con 0x7eff540b3e30 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34218/0 (socket says 172.21.15.146:34218) 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 -- 172.21.15.146:0/2470283264 learned_addr learned my addr 172.21.15.146:0/2470283264 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff58e00640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540b3e30 0x7eff5406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff53e00640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff540d49e0 0x7eff54155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 -- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540b3e30 msgr2=0x7eff5406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540b3e30 0x7eff5406c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 -- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff540d49e0 msgr2=0x7eff54155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff540d49e0 0x7eff54155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.505+0000 7eff59800640 1 -- 172.21.15.146:0/2470283264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff54160310 con 0x7eff5415e490 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff59800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c410 tx=0x7eff4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c011790 con 0x7eff5415e490 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c017070 con 0x7eff5415e490 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c011bb0 con 0x7eff5415e490 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff541605f0 con 0x7eff5415e490 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.506+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff54160bb0 con 0x7eff5415e490 2024-04-24T23:00:23.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.507+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff540688a0 con 0x7eff5415e490 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.508+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff4c01c460 con 0x7eff5415e490 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.509+0000 7eff50c00640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.509+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7eff4c08ae20 con 0x7eff5415e490 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.509+0000 7eff58e00640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.511+0000 7eff58e00640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 0x7eff3006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff3c034000 tx=0x7eff3c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.514+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff4c021020 con 0x7eff5415e490 2024-04-24T23:00:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.752+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff54073cb0 con 0x7eff5415e490 2024-04-24T23:00:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.753+0000 7eff50c00640 1 -- 172.21.15.146:0/2470283264 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7eff4c0593f0 con 0x7eff5415e490 2024-04-24T23:00:23.755 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:23.755 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:23.756 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:00:23.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 msgr2=0x7eff3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 0x7eff3006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff3c034000 tx=0x7eff3c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:23.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 msgr2=0x7eff541558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c410 tx=0x7eff4c00c8d0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 shutdown_connections 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff5415e490 0x7eff541558d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff540d49e0 0x7eff54155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 --2- 172.21.15.146:0/2470283264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff540b3e30 0x7eff5406c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 >> 172.21.15.146:0/2470283264 conn(0x7eff540d3ec0 msgr2=0x7eff540b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 shutdown_connections 2024-04-24T23:00:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.756+0000 7eff5b800640 1 -- 172.21.15.146:0/2470283264 wait complete. 2024-04-24T23:00:23.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.978+0000 7f25b1800640 1 Processor -- start 2024-04-24T23:00:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.978+0000 7f25b1800640 1 -- start start 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.979+0000 7f25b1800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f25ac0d03a0 0x7f25ac070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.979+0000 7f25b1800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25ac0728c0 0x7f25ac071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.979+0000 7f25b1800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25ac1449c0 con 0x7f25ac1445e0 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.979+0000 7f25b1800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f25ac072430 con 0x7f25ac0728c0 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.979+0000 7f25b1800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f25ac0b2d70 con 0x7f25ac0d03a0 2024-04-24T23:00:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25ac0728c0 0x7f25ac071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25ac0728c0 0x7f25ac071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34232/0 (socket says 172.21.15.146:34232) 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 -- 172.21.15.146:0/2465192544 learned_addr learned my addr 172.21.15.146:0/2465192544 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25a2000640 1 --2- 172.21.15.146:0/2465192544 >> v2:172.21.15.203:3300/0 conn(0x7f25ac0d03a0 0x7f25ac070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 -- 172.21.15.146:0/2465192544 >> v2:172.21.15.203:3300/0 conn(0x7f25ac0d03a0 msgr2=0x7f25ac070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 --2- 172.21.15.146:0/2465192544 >> v2:172.21.15.203:3300/0 conn(0x7f25ac0d03a0 0x7f25ac070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 -- 172.21.15.146:0/2465192544 >> v1:172.21.15.203:6789/0 conn(0x7f25ac1445e0 legacy=0x7f25ac0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.980+0000 7f25ab400640 1 -- 172.21.15.146:0/2465192544 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac071820 con 0x7f25ac0728c0 2024-04-24T23:00:23.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.981+0000 7f25ab400640 1 --2- 172.21.15.146:0/2465192544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0728c0 0x7f25ac071150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b4700 tx=0x7f25a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e9a692fbc9b35f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25aa000640 1 -- 172.21.15.146:0/2465192544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4037070 con 0x7f25ac0728c0 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25aa000640 1 -- 172.21.15.146:0/2465192544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a4032440 con 0x7f25ac0728c0 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25aa000640 1 -- 172.21.15.146:0/2465192544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4032810 con 0x7f25ac0728c0 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 -- 172.21.15.146:0/2465192544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0728c0 msgr2=0x7f25ac071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 --2- 172.21.15.146:0/2465192544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0728c0 0x7f25ac071150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b4700 tx=0x7f25a402a230 comp rx=0 tx=0).stop 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 -- 172.21.15.146:0/2465192544 shutdown_connections 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 --2- 172.21.15.146:0/2465192544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0728c0 0x7f25ac071150 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 --2- 172.21.15.146:0/2465192544 >> v2:172.21.15.203:3300/0 conn(0x7f25ac0d03a0 0x7f25ac070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.982+0000 7f25b1800640 1 -- 172.21.15.146:0/2465192544 >> 172.21.15.146:0/2465192544 conn(0x7f25ac06b320 msgr2=0x7f25ac06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.983+0000 7f25b1800640 1 -- 172.21.15.146:0/2465192544 shutdown_connections 2024-04-24T23:00:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.983+0000 7f25b1800640 1 -- 172.21.15.146:0/2465192544 wait complete. 2024-04-24T23:00:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.984+0000 7f25b1800640 1 Processor -- start 2024-04-24T23:00:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.984+0000 7f25b1800640 1 -- start start 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25ac0728c0 0x7f25ac1e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 0x7f25ac142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac0720c0 con 0x7f25ac0d03a0 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac071de0 con 0x7f25ac1445e0 2024-04-24T23:00:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.985+0000 7f25b1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac0cced0 con 0x7f25ac0728c0 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34236/0 (socket says 172.21.15.146:34236) 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 -- 172.21.15.146:0/2609402359 learned_addr learned my addr 172.21.15.146:0/2609402359 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25ab400640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 0x7f25ac142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25aaa00640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25ac0728c0 0x7f25ac1e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 -- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25ac0728c0 msgr2=0x7f25ac1e58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25ac0728c0 0x7f25ac1e58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 -- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 msgr2=0x7f25ac142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 0x7f25ac142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 -- 172.21.15.146:0/2609402359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac15cfc0 con 0x7f25ac0d03a0 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25ab400640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 0x7f25ac142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.986+0000 7f25a2000640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f259400d800 tx=0x7f259400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.987+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400b6c0 con 0x7f25ac0d03a0 2024-04-24T23:00:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.987+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594019070 con 0x7f25ac0d03a0 2024-04-24T23:00:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.987+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400ba80 con 0x7f25ac0d03a0 2024-04-24T23:00:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.987+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac15d2a0 con 0x7f25ac0d03a0 2024-04-24T23:00:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.987+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac15d860 con 0x7f25ac0d03a0 2024-04-24T23:00:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.988+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac068190 con 0x7f25ac0d03a0 2024-04-24T23:00:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.989+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f259400bc20 con 0x7f25ac0d03a0 2024-04-24T23:00:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.990+0000 7f25a3400640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 0x7f258806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.990+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f259408b660 con 0x7f25ac0d03a0 2024-04-24T23:00:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.991+0000 7f25aaa00640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 0x7f258806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.992+0000 7f25aaa00640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 0x7f258806e320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f259c007bf0 tx=0x7f259c007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:23.994+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f259401c360 con 0x7f25ac0d03a0 2024-04-24T23:00:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.190+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25ac06eab0 con 0x7f25ac0d03a0 2024-04-24T23:00:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.193+0000 7f25a3400640 1 -- 172.21.15.146:0/2609402359 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f2594088880 con 0x7f25ac0d03a0 2024-04-24T23:00:24.195 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:24.195 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.195+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 msgr2=0x7f258806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.195+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 0x7f258806e320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f259c007bf0 tx=0x7f259c007240 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.195+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 msgr2=0x7f25ac15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.195+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f259400d800 tx=0x7f259400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 shutdown_connections 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25ac1445e0 0x7f25ac142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25ac0d03a0 0x7f25ac15c4c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f258806be60 0x7f258806e320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 --2- 172.21.15.146:0/2609402359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25ac0728c0 0x7f25ac1e58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 >> 172.21.15.146:0/2609402359 conn(0x7f25ac06b320 msgr2=0x7f25ac15e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 shutdown_connections 2024-04-24T23:00:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.196+0000 7f25b1800640 1 -- 172.21.15.146:0/2609402359 wait complete. 2024-04-24T23:00:24.216 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:00:24.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:24.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.411+0000 7f23db200640 1 Processor -- start 2024-04-24T23:00:24.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.411+0000 7f23db200640 1 -- start start 2024-04-24T23:00:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23db200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23d4158590 0x7f23d4162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23db200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f23d40715f0 0x7f23d4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23db200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d4162990 con 0x7f23d40cfc90 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23db200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f23d4158970 con 0x7f23d4158590 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23db200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f23d4070c10 con 0x7f23d40715f0 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23d3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23d4158590 0x7f23d4162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23d3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23d4158590 0x7f23d4162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34252/0 (socket says 172.21.15.146:34252) 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23d3e00640 1 -- 172.21.15.146:0/617882778 learned_addr learned my addr 172.21.15.146:0/617882778 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.413+0000 7f23cb400640 1 --2- 172.21.15.146:0/617882778 >> v2:172.21.15.203:3300/0 conn(0x7f23d40715f0 0x7f23d4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.414+0000 7f23d3e00640 1 -- 172.21.15.146:0/617882778 >> v2:172.21.15.203:3300/0 conn(0x7f23d40715f0 msgr2=0x7f23d4071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.414+0000 7f23d3e00640 1 --2- 172.21.15.146:0/617882778 >> v2:172.21.15.203:3300/0 conn(0x7f23d40715f0 0x7f23d4071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.414+0000 7f23d3e00640 1 -- 172.21.15.146:0/617882778 >> v1:172.21.15.203:6789/0 conn(0x7f23d40cfc90 legacy=0x7f23d415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.414+0000 7f23d3e00640 1 -- 172.21.15.146:0/617882778 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d4070ef0 con 0x7f23d4158590 2024-04-24T23:00:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.415+0000 7f23d3e00640 1 --2- 172.21.15.146:0/617882778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4158590 0x7f23d4162450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23d40d0ab0 tx=0x7f23c402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d44a98218993416 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23d3400640 1 -- 172.21.15.146:0/617882778 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037070 con 0x7f23d4158590 2024-04-24T23:00:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23d3400640 1 -- 172.21.15.146:0/617882778 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4032440 con 0x7f23d4158590 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23d3400640 1 -- 172.21.15.146:0/617882778 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4032810 con 0x7f23d4158590 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 -- 172.21.15.146:0/617882778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4158590 msgr2=0x7f23d4162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 --2- 172.21.15.146:0/617882778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4158590 0x7f23d4162450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23d40d0ab0 tx=0x7f23c402a2c0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 -- 172.21.15.146:0/617882778 shutdown_connections 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 --2- 172.21.15.146:0/617882778 >> v2:172.21.15.203:3300/0 conn(0x7f23d40715f0 0x7f23d4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 --2- 172.21.15.146:0/617882778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4158590 0x7f23d4162450 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.416+0000 7f23db200640 1 -- 172.21.15.146:0/617882778 >> 172.21.15.146:0/617882778 conn(0x7f23d406b320 msgr2=0x7f23d406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.417+0000 7f23db200640 1 -- 172.21.15.146:0/617882778 shutdown_connections 2024-04-24T23:00:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.417+0000 7f23db200640 1 -- 172.21.15.146:0/617882778 wait complete. 2024-04-24T23:00:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.418+0000 7f23db200640 1 Processor -- start 2024-04-24T23:00:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.418+0000 7f23db200640 1 -- start start 2024-04-24T23:00:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d40cfc90 0x7f23d415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 0x7f23d4145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4161f30 con 0x7f23d40715f0 2024-04-24T23:00:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4161c50 con 0x7f23d40cfc90 2024-04-24T23:00:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.419+0000 7f23db200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f23d40d0100 con 0x7f23d4158590 2024-04-24T23:00:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34260/0 (socket says 172.21.15.146:34260) 2024-04-24T23:00:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 -- 172.21.15.146:0/82123104 learned_addr learned my addr 172.21.15.146:0/82123104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23cb400640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d40cfc90 0x7f23d415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d9200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 0x7f23d4145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 -- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 msgr2=0x7f23d4145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 0x7f23d4145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 -- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d40cfc90 msgr2=0x7f23d415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d40cfc90 0x7f23d415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 -- 172.21.15.146:0/82123104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41f4780 con 0x7f23d40715f0 2024-04-24T23:00:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d9200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 0x7f23d4145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.420+0000 7f23d3e00640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23c402a300 tx=0x7f23c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.421+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4041020 con 0x7f23d40715f0 2024-04-24T23:00:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.421+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c40306c0 con 0x7f23d40715f0 2024-04-24T23:00:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.421+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037040 con 0x7f23d40715f0 2024-04-24T23:00:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.421+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d415cb30 con 0x7f23d40715f0 2024-04-24T23:00:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.421+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d415d0f0 con 0x7f23d40715f0 2024-04-24T23:00:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.422+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d4068190 con 0x7f23d40715f0 2024-04-24T23:00:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.423+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23c4044020 con 0x7f23d40715f0 2024-04-24T23:00:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.424+0000 7f23d0c00640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.424+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23c40ab8d0 con 0x7f23d40715f0 2024-04-24T23:00:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.425+0000 7f23cb400640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.426+0000 7f23cb400640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 0x7f23b006e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23d40cf260 tx=0x7f23bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.429+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f23c404b030 con 0x7f23d40715f0 2024-04-24T23:00:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.622+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23d4159ba0 con 0x7f23b006be30 2024-04-24T23:00:24.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.653+0000 7f23d0c00640 1 -- 172.21.15.146:0/82123104 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f23d4159ba0 con 0x7f23b006be30 2024-04-24T23:00:24.661 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 msgr2=0x7f23b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 0x7f23b006e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23d40cf260 tx=0x7f23bc008040 comp rx=0 tx=0).stop 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 msgr2=0x7f23d41f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f23c402a300 tx=0x7f23c40046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 shutdown_connections 2024-04-24T23:00:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23d4158590 0x7f23d4145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d40cfc90 0x7f23d415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 --2- 172.21.15.146:0/82123104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d40715f0 0x7f23d41f4240 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.659+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 >> 172.21.15.146:0/82123104 conn(0x7f23d406b320 msgr2=0x7f23d415f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.660+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 shutdown_connections 2024-04-24T23:00:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.660+0000 7f23db200640 1 -- 172.21.15.146:0/82123104 wait complete. 2024-04-24T23:00:24.681 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-24T23:00:23.588206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004946"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010800+0000","last_change":"2024-04-24T22:59:53.808035+0000","last_active":"2024-04-24T23:00:01.010800+0000","last_peered":"2024-04-24T23:00:01.010800+0000","last_clean":"2024-04-24T23:00:01.010800+0000","last_became_active":"2024-04-24T22:59:53.807655+0000","last_became_peered":"2024-04-24T22:59:53.807655+0000","last_unstale":"2024-04-24T23:00:01.010800+0000","last_undegraded":"2024-04-24T23:00:01.010800+0000","last_fullsized":"2024-04-24T23:00:01.010800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185694+0000","last_change":"2024-04-24T22:59:54.844377+0000","last_active":"2024-04-24T23:00:01.185694+0000","last_peered":"2024-04-24T23:00:01.185694+0000","last_clean":"2024-04-24T23:00:01.185694+0000","last_became_active":"2024-04-24T22:59:54.844081+0000","last_became_peered":"2024-04-24T22:59:54.844081+0000","last_unstale":"2024-04-24T23:00:01.185694+0000","last_undegraded":"2024-04-24T23:00:01.185694+0000","last_fullsized":"2024-04-24T23:00:01.185694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:03:46.525647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158053+0000","last_change":"2024-04-24T22:59:59.190167+0000","last_active":"2024-04-24T23:00:00.158053+0000","last_peered":"2024-04-24T23:00:00.158053+0000","last_clean":"2024-04-24T23:00:00.158053+0000","last_became_active":"2024-04-24T22:59:59.189393+0000","last_became_peered":"2024-04-24T22:59:59.189393+0000","last_unstale":"2024-04-24T23:00:00.158053+0000","last_undegraded":"2024-04-24T23:00:00.158053+0000","last_fullsized":"2024-04-24T23:00:00.158053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.516700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185829+0000","last_change":"2024-04-24T22:59:53.799029+0000","last_active":"2024-04-24T23:00:01.185829+0000","last_peered":"2024-04-24T23:00:01.185829+0000","last_clean":"2024-04-24T23:00:01.185829+0000","last_became_active":"2024-04-24T22:59:53.798727+0000","last_became_peered":"2024-04-24T22:59:53.798727+0000","last_unstale":"2024-04-24T23:00:01.185829+0000","last_undegraded":"2024-04-24T23:00:01.185829+0000","last_fullsized":"2024-04-24T23:00:01.185829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:14:29.506259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185571+0000","last_change":"2024-04-24T22:59:54.844472+0000","last_active":"2024-04-24T23:00:01.185571+0000","last_peered":"2024-04-24T23:00:01.185571+0000","last_clean":"2024-04-24T23:00:01.185571+0000","last_became_active":"2024-04-24T22:59:54.844134+0000","last_became_peered":"2024-04-24T22:59:54.844134+0000","last_unstale":"2024-04-24T23:00:01.185571+0000","last_undegraded":"2024-04-24T23:00:01.185571+0000","last_fullsized":"2024-04-24T23:00:01.185571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:19.889185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155534+0000","last_change":"2024-04-24T22:59:59.170482+0000","last_active":"2024-04-24T23:00:00.155534+0000","last_peered":"2024-04-24T23:00:00.155534+0000","last_clean":"2024-04-24T23:00:00.155534+0000","last_became_active":"2024-04-24T22:59:59.169481+0000","last_became_peered":"2024-04-24T22:59:59.169481+0000","last_unstale":"2024-04-24T23:00:00.155534+0000","last_undegraded":"2024-04-24T23:00:00.155534+0000","last_fullsized":"2024-04-24T23:00:00.155534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:26.004993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246604+0000","last_change":"2024-04-24T22:59:53.796317+0000","last_active":"2024-04-24T23:00:00.246604+0000","last_peered":"2024-04-24T23:00:00.246604+0000","last_clean":"2024-04-24T23:00:00.246604+0000","last_became_active":"2024-04-24T22:59:53.795867+0000","last_became_peered":"2024-04-24T22:59:53.795867+0000","last_unstale":"2024-04-24T23:00:00.246604+0000","last_undegraded":"2024-04-24T23:00:00.246604+0000","last_fullsized":"2024-04-24T23:00:00.246604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337219+0000","last_change":"2024-04-24T22:59:54.819137+0000","last_active":"2024-04-24T23:00:00.337219+0000","last_peered":"2024-04-24T23:00:00.337219+0000","last_clean":"2024-04-24T23:00:00.337219+0000","last_became_active":"2024-04-24T22:59:54.818824+0000","last_became_peered":"2024-04-24T22:59:54.818824+0000","last_unstale":"2024-04-24T23:00:00.337219+0000","last_undegraded":"2024-04-24T23:00:00.337219+0000","last_fullsized":"2024-04-24T23:00:00.337219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156424+0000","last_change":"2024-04-24T22:59:59.175621+0000","last_active":"2024-04-24T23:00:00.156424+0000","last_peered":"2024-04-24T23:00:00.156424+0000","last_clean":"2024-04-24T23:00:00.156424+0000","last_became_active":"2024-04-24T22:59:59.175193+0000","last_became_peered":"2024-04-24T22:59:59.175193+0000","last_unstale":"2024-04-24T23:00:00.156424+0000","last_undegraded":"2024-04-24T23:00:00.156424+0000","last_fullsized":"2024-04-24T23:00:00.156424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246019+0000","last_change":"2024-04-24T22:59:53.789351+0000","last_active":"2024-04-24T23:00:00.246019+0000","last_peered":"2024-04-24T23:00:00.246019+0000","last_clean":"2024-04-24T23:00:00.246019+0000","last_became_active":"2024-04-24T22:59:53.789011+0000","last_became_peered":"2024-04-24T22:59:53.789011+0000","last_unstale":"2024-04-24T23:00:00.246019+0000","last_undegraded":"2024-04-24T23:00:00.246019+0000","last_fullsized":"2024-04-24T23:00:00.246019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184542+0000","last_change":"2024-04-24T22:59:54.831152+0000","last_active":"2024-04-24T23:00:01.184542+0000","last_peered":"2024-04-24T23:00:01.184542+0000","last_clean":"2024-04-24T23:00:01.184542+0000","last_became_active":"2024-04-24T22:59:54.829948+0000","last_became_peered":"2024-04-24T22:59:54.829948+0000","last_unstale":"2024-04-24T23:00:01.184542+0000","last_undegraded":"2024-04-24T23:00:01.184542+0000","last_fullsized":"2024-04-24T23:00:01.184542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:00.243216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155762+0000","last_change":"2024-04-24T22:59:59.183804+0000","last_active":"2024-04-24T23:00:00.155762+0000","last_peered":"2024-04-24T23:00:00.155762+0000","last_clean":"2024-04-24T23:00:00.155762+0000","last_became_active":"2024-04-24T22:59:59.183323+0000","last_became_peered":"2024-04-24T22:59:59.183323+0000","last_unstale":"2024-04-24T23:00:00.155762+0000","last_undegraded":"2024-04-24T23:00:00.155762+0000","last_fullsized":"2024-04-24T23:00:00.155762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184098+0000","last_change":"2024-04-24T22:59:54.822754+0000","last_active":"2024-04-24T23:00:01.184098+0000","last_peered":"2024-04-24T23:00:01.184098+0000","last_clean":"2024-04-24T23:00:01.184098+0000","last_became_active":"2024-04-24T22:59:54.822388+0000","last_became_peered":"2024-04-24T22:59:54.822388+0000","last_unstale":"2024-04-24T23:00:01.184098+0000","last_undegraded":"2024-04-24T23:00:01.184098+0000","last_fullsized":"2024-04-24T23:00:01.184098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:30.347602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183966+0000","last_change":"2024-04-24T22:59:53.802267+0000","last_active":"2024-04-24T23:00:01.183966+0000","last_peered":"2024-04-24T23:00:01.183966+0000","last_clean":"2024-04-24T23:00:01.183966+0000","last_became_active":"2024-04-24T22:59:53.801524+0000","last_became_peered":"2024-04-24T22:59:53.801524+0000","last_unstale":"2024-04-24T23:00:01.183966+0000","last_undegraded":"2024-04-24T23:00:01.183966+0000","last_fullsized":"2024-04-24T23:00:01.183966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:11.327838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183950+0000","last_change":"2024-04-24T22:59:59.177746+0000","last_active":"2024-04-24T23:00:01.183950+0000","last_peered":"2024-04-24T23:00:01.183950+0000","last_clean":"2024-04-24T23:00:01.183950+0000","last_became_active":"2024-04-24T22:59:59.176645+0000","last_became_peered":"2024-04-24T22:59:59.176645+0000","last_unstale":"2024-04-24T23:00:01.183950+0000","last_undegraded":"2024-04-24T23:00:01.183950+0000","last_fullsized":"2024-04-24T23:00:01.183950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:59:28.582936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162596+0000","last_change":"2024-04-24T22:59:54.833871+0000","last_active":"2024-04-24T23:00:00.162596+0000","last_peered":"2024-04-24T23:00:00.162596+0000","last_clean":"2024-04-24T23:00:00.162596+0000","last_became_active":"2024-04-24T22:59:54.833620+0000","last_became_peered":"2024-04-24T22:59:54.833620+0000","last_unstale":"2024-04-24T23:00:00.162596+0000","last_undegraded":"2024-04-24T23:00:00.162596+0000","last_fullsized":"2024-04-24T23:00:00.162596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159199+0000","last_change":"2024-04-24T22:59:53.801795+0000","last_active":"2024-04-24T23:00:00.159199+0000","last_peered":"2024-04-24T23:00:00.159199+0000","last_clean":"2024-04-24T23:00:00.159199+0000","last_became_active":"2024-04-24T22:59:53.801129+0000","last_became_peered":"2024-04-24T22:59:53.801129+0000","last_unstale":"2024-04-24T23:00:00.159199+0000","last_undegraded":"2024-04-24T23:00:00.159199+0000","last_fullsized":"2024-04-24T23:00:00.159199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245637+0000","last_change":"2024-04-24T22:59:59.180795+0000","last_active":"2024-04-24T23:00:00.245637+0000","last_peered":"2024-04-24T23:00:00.245637+0000","last_clean":"2024-04-24T23:00:00.245637+0000","last_became_active":"2024-04-24T22:59:59.179570+0000","last_became_peered":"2024-04-24T22:59:59.179570+0000","last_unstale":"2024-04-24T23:00:00.245637+0000","last_undegraded":"2024-04-24T23:00:00.245637+0000","last_fullsized":"2024-04-24T23:00:00.245637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.008767+0000","last_change":"2024-04-24T22:59:54.830621+0000","last_active":"2024-04-24T23:00:01.008767+0000","last_peered":"2024-04-24T23:00:01.008767+0000","last_clean":"2024-04-24T23:00:01.008767+0000","last_became_active":"2024-04-24T22:59:54.830261+0000","last_became_peered":"2024-04-24T22:59:54.830261+0000","last_unstale":"2024-04-24T23:00:01.008767+0000","last_undegraded":"2024-04-24T23:00:01.008767+0000","last_fullsized":"2024-04-24T23:00:01.008767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009662+0000","last_change":"2024-04-24T22:59:53.797083+0000","last_active":"2024-04-24T23:00:01.009662+0000","last_peered":"2024-04-24T23:00:01.009662+0000","last_clean":"2024-04-24T23:00:01.009662+0000","last_became_active":"2024-04-24T22:59:53.796741+0000","last_became_peered":"2024-04-24T22:59:53.796741+0000","last_unstale":"2024-04-24T23:00:01.009662+0000","last_undegraded":"2024-04-24T23:00:01.009662+0000","last_fullsized":"2024-04-24T23:00:01.009662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162937+0000","last_change":"2024-04-24T22:59:59.187326+0000","last_active":"2024-04-24T23:00:00.162937+0000","last_peered":"2024-04-24T23:00:00.162937+0000","last_clean":"2024-04-24T23:00:00.162937+0000","last_became_active":"2024-04-24T22:59:59.186542+0000","last_became_peered":"2024-04-24T22:59:59.186542+0000","last_unstale":"2024-04-24T23:00:00.162937+0000","last_undegraded":"2024-04-24T23:00:00.162937+0000","last_fullsized":"2024-04-24T23:00:00.162937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:20.837462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183491+0000","last_change":"2024-04-24T22:59:54.819833+0000","last_active":"2024-04-24T23:00:01.183491+0000","last_peered":"2024-04-24T23:00:01.183491+0000","last_clean":"2024-04-24T23:00:01.183491+0000","last_became_active":"2024-04-24T22:59:54.817443+0000","last_became_peered":"2024-04-24T22:59:54.817443+0000","last_unstale":"2024-04-24T23:00:01.183491+0000","last_undegraded":"2024-04-24T23:00:01.183491+0000","last_fullsized":"2024-04-24T23:00:01.183491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:05.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.244949+0000","last_change":"2024-04-24T22:59:53.796852+0000","last_active":"2024-04-24T23:00:00.244949+0000","last_peered":"2024-04-24T23:00:00.244949+0000","last_clean":"2024-04-24T23:00:00.244949+0000","last_became_active":"2024-04-24T22:59:53.796053+0000","last_became_peered":"2024-04-24T22:59:53.796053+0000","last_unstale":"2024-04-24T23:00:00.244949+0000","last_undegraded":"2024-04-24T23:00:00.244949+0000","last_fullsized":"2024-04-24T23:00:00.244949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.870817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157682+0000","last_change":"2024-04-24T22:59:59.168702+0000","last_active":"2024-04-24T23:00:00.157682+0000","last_peered":"2024-04-24T23:00:00.157682+0000","last_clean":"2024-04-24T23:00:00.157682+0000","last_became_active":"2024-04-24T22:59:59.168344+0000","last_became_peered":"2024-04-24T22:59:59.168344+0000","last_unstale":"2024-04-24T23:00:00.157682+0000","last_undegraded":"2024-04-24T23:00:00.157682+0000","last_fullsized":"2024-04-24T23:00:00.157682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009609+0000","last_change":"2024-04-24T22:59:54.831524+0000","last_active":"2024-04-24T23:00:01.009609+0000","last_peered":"2024-04-24T23:00:01.009609+0000","last_clean":"2024-04-24T23:00:01.009609+0000","last_became_active":"2024-04-24T22:59:54.831142+0000","last_became_peered":"2024-04-24T22:59:54.831142+0000","last_unstale":"2024-04-24T23:00:01.009609+0000","last_undegraded":"2024-04-24T23:00:01.009609+0000","last_fullsized":"2024-04-24T23:00:01.009609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185674+0000","last_change":"2024-04-24T22:59:53.797494+0000","last_active":"2024-04-24T23:00:01.185674+0000","last_peered":"2024-04-24T23:00:01.185674+0000","last_clean":"2024-04-24T23:00:01.185674+0000","last_became_active":"2024-04-24T22:59:53.796774+0000","last_became_peered":"2024-04-24T22:59:53.796774+0000","last_unstale":"2024-04-24T23:00:01.185674+0000","last_undegraded":"2024-04-24T23:00:01.185674+0000","last_fullsized":"2024-04-24T23:00:01.185674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155573+0000","last_change":"2024-04-24T22:59:59.172300+0000","last_active":"2024-04-24T23:00:00.155573+0000","last_peered":"2024-04-24T23:00:00.155573+0000","last_clean":"2024-04-24T23:00:00.155573+0000","last_became_active":"2024-04-24T22:59:59.171942+0000","last_became_peered":"2024-04-24T22:59:59.171942+0000","last_unstale":"2024-04-24T23:00:00.155573+0000","last_undegraded":"2024-04-24T23:00:00.155573+0000","last_fullsized":"2024-04-24T23:00:00.155573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:16.270363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010273+0000","last_change":"2024-04-24T22:59:54.831365+0000","last_active":"2024-04-24T23:00:01.010273+0000","last_peered":"2024-04-24T23:00:01.010273+0000","last_clean":"2024-04-24T23:00:01.010273+0000","last_became_active":"2024-04-24T22:59:54.830470+0000","last_became_peered":"2024-04-24T22:59:54.830470+0000","last_unstale":"2024-04-24T23:00:01.010273+0000","last_undegraded":"2024-04-24T23:00:01.010273+0000","last_fullsized":"2024-04-24T23:00:01.010273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010410+0000","last_change":"2024-04-24T22:59:53.803366+0000","last_active":"2024-04-24T23:00:01.010410+0000","last_peered":"2024-04-24T23:00:01.010410+0000","last_clean":"2024-04-24T23:00:01.010410+0000","last_became_active":"2024-04-24T22:59:53.802969+0000","last_became_peered":"2024-04-24T22:59:53.802969+0000","last_unstale":"2024-04-24T23:00:01.010410+0000","last_undegraded":"2024-04-24T23:00:01.010410+0000","last_fullsized":"2024-04-24T23:00:01.010410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009016+0000","last_change":"2024-04-24T22:59:59.177853+0000","last_active":"2024-04-24T23:00:01.009016+0000","last_peered":"2024-04-24T23:00:01.009016+0000","last_clean":"2024-04-24T23:00:01.009016+0000","last_became_active":"2024-04-24T22:59:59.177268+0000","last_became_peered":"2024-04-24T22:59:59.177268+0000","last_unstale":"2024-04-24T23:00:01.009016+0000","last_undegraded":"2024-04-24T23:00:01.009016+0000","last_fullsized":"2024-04-24T23:00:01.009016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:44.225608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159891+0000","last_change":"2024-04-24T22:59:54.842312+0000","last_active":"2024-04-24T23:00:00.159891+0000","last_peered":"2024-04-24T23:00:00.159891+0000","last_clean":"2024-04-24T23:00:00.159891+0000","last_became_active":"2024-04-24T22:59:54.842034+0000","last_became_peered":"2024-04-24T22:59:54.842034+0000","last_unstale":"2024-04-24T23:00:00.159891+0000","last_undegraded":"2024-04-24T23:00:00.159891+0000","last_fullsized":"2024-04-24T23:00:00.159891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:56.808348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184853+0000","last_change":"2024-04-24T22:59:53.801680+0000","last_active":"2024-04-24T23:00:01.184853+0000","last_peered":"2024-04-24T23:00:01.184853+0000","last_clean":"2024-04-24T23:00:01.184853+0000","last_became_active":"2024-04-24T22:59:53.801365+0000","last_became_peered":"2024-04-24T22:59:53.801365+0000","last_unstale":"2024-04-24T23:00:01.184853+0000","last_undegraded":"2024-04-24T23:00:01.184853+0000","last_fullsized":"2024-04-24T23:00:01.184853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:29.189206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160460+0000","last_change":"2024-04-24T22:59:59.180894+0000","last_active":"2024-04-24T23:00:00.160460+0000","last_peered":"2024-04-24T23:00:00.160460+0000","last_clean":"2024-04-24T23:00:00.160460+0000","last_became_active":"2024-04-24T22:59:59.177236+0000","last_became_peered":"2024-04-24T22:59:59.177236+0000","last_unstale":"2024-04-24T23:00:00.160460+0000","last_undegraded":"2024-04-24T23:00:00.160460+0000","last_fullsized":"2024-04-24T23:00:00.160460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157352+0000","last_change":"2024-04-24T22:59:54.836662+0000","last_active":"2024-04-24T23:00:00.157352+0000","last_peered":"2024-04-24T23:00:00.157352+0000","last_clean":"2024-04-24T23:00:00.157352+0000","last_became_active":"2024-04-24T22:59:54.835790+0000","last_became_peered":"2024-04-24T22:59:54.835790+0000","last_unstale":"2024-04-24T23:00:00.157352+0000","last_undegraded":"2024-04-24T23:00:00.157352+0000","last_fullsized":"2024-04-24T23:00:00.157352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184827+0000","last_change":"2024-04-24T22:59:53.805218+0000","last_active":"2024-04-24T23:00:01.184827+0000","last_peered":"2024-04-24T23:00:01.184827+0000","last_clean":"2024-04-24T23:00:01.184827+0000","last_became_active":"2024-04-24T22:59:53.803401+0000","last_became_peered":"2024-04-24T22:59:53.803401+0000","last_unstale":"2024-04-24T23:00:01.184827+0000","last_undegraded":"2024-04-24T23:00:01.184827+0000","last_fullsized":"2024-04-24T23:00:01.184827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:56.417305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158402+0000","last_change":"2024-04-24T22:59:59.180784+0000","last_active":"2024-04-24T23:00:00.158402+0000","last_peered":"2024-04-24T23:00:00.158402+0000","last_clean":"2024-04-24T23:00:00.158402+0000","last_became_active":"2024-04-24T22:59:59.180017+0000","last_became_peered":"2024-04-24T22:59:59.180017+0000","last_unstale":"2024-04-24T23:00:00.158402+0000","last_undegraded":"2024-04-24T23:00:00.158402+0000","last_fullsized":"2024-04-24T23:00:00.158402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245322+0000","last_change":"2024-04-24T22:59:54.836197+0000","last_active":"2024-04-24T23:00:00.245322+0000","last_peered":"2024-04-24T23:00:00.245322+0000","last_clean":"2024-04-24T23:00:00.245322+0000","last_became_active":"2024-04-24T22:59:54.835647+0000","last_became_peered":"2024-04-24T22:59:54.835647+0000","last_unstale":"2024-04-24T23:00:00.245322+0000","last_undegraded":"2024-04-24T23:00:00.245322+0000","last_fullsized":"2024-04-24T23:00:00.245322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184333+0000","last_change":"2024-04-24T22:59:53.804121+0000","last_active":"2024-04-24T23:00:01.184333+0000","last_peered":"2024-04-24T23:00:01.184333+0000","last_clean":"2024-04-24T23:00:01.184333+0000","last_became_active":"2024-04-24T22:59:53.803732+0000","last_became_peered":"2024-04-24T22:59:53.803732+0000","last_unstale":"2024-04-24T23:00:01.184333+0000","last_undegraded":"2024-04-24T23:00:01.184333+0000","last_fullsized":"2024-04-24T23:00:01.184333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:55.794648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159307+0000","last_change":"2024-04-24T22:59:59.180854+0000","last_active":"2024-04-24T23:00:00.159307+0000","last_peered":"2024-04-24T23:00:00.159307+0000","last_clean":"2024-04-24T23:00:00.159307+0000","last_became_active":"2024-04-24T22:59:59.179885+0000","last_became_peered":"2024-04-24T22:59:59.179885+0000","last_unstale":"2024-04-24T23:00:00.159307+0000","last_undegraded":"2024-04-24T23:00:00.159307+0000","last_fullsized":"2024-04-24T23:00:00.159307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183892+0000","last_change":"2024-04-24T22:59:54.841245+0000","last_active":"2024-04-24T23:00:01.183892+0000","last_peered":"2024-04-24T23:00:01.183892+0000","last_clean":"2024-04-24T23:00:01.183892+0000","last_became_active":"2024-04-24T22:59:54.840779+0000","last_became_peered":"2024-04-24T22:59:54.840779+0000","last_unstale":"2024-04-24T23:00:01.183892+0000","last_undegraded":"2024-04-24T23:00:01.183892+0000","last_fullsized":"2024-04-24T23:00:01.183892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:21.114664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158462+0000","last_change":"2024-04-24T22:59:53.800686+0000","last_active":"2024-04-24T23:00:00.158462+0000","last_peered":"2024-04-24T23:00:00.158462+0000","last_clean":"2024-04-24T23:00:00.158462+0000","last_became_active":"2024-04-24T22:59:53.799843+0000","last_became_peered":"2024-04-24T22:59:53.799843+0000","last_unstale":"2024-04-24T23:00:00.158462+0000","last_undegraded":"2024-04-24T23:00:00.158462+0000","last_fullsized":"2024-04-24T23:00:00.158462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159857+0000","last_change":"2024-04-24T22:59:59.185850+0000","last_active":"2024-04-24T23:00:00.159857+0000","last_peered":"2024-04-24T23:00:00.159857+0000","last_clean":"2024-04-24T23:00:00.159857+0000","last_became_active":"2024-04-24T22:59:59.181277+0000","last_became_peered":"2024-04-24T22:59:59.181277+0000","last_unstale":"2024-04-24T23:00:00.159857+0000","last_undegraded":"2024-04-24T23:00:00.159857+0000","last_fullsized":"2024-04-24T23:00:00.159857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159354+0000","last_change":"2024-04-24T22:59:54.833216+0000","last_active":"2024-04-24T23:00:00.159354+0000","last_peered":"2024-04-24T23:00:00.159354+0000","last_clean":"2024-04-24T23:00:00.159354+0000","last_became_active":"2024-04-24T22:59:54.832933+0000","last_became_peered":"2024-04-24T22:59:54.832933+0000","last_unstale":"2024-04-24T23:00:00.159354+0000","last_undegraded":"2024-04-24T23:00:00.159354+0000","last_fullsized":"2024-04-24T23:00:00.159354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183544+0000","last_change":"2024-04-24T22:59:53.797462+0000","last_active":"2024-04-24T23:00:01.183544+0000","last_peered":"2024-04-24T23:00:01.183544+0000","last_clean":"2024-04-24T23:00:01.183544+0000","last_became_active":"2024-04-24T22:59:53.797136+0000","last_became_peered":"2024-04-24T22:59:53.797136+0000","last_unstale":"2024-04-24T23:00:01.183544+0000","last_undegraded":"2024-04-24T23:00:01.183544+0000","last_fullsized":"2024-04-24T23:00:01.183544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185371+0000","last_change":"2024-04-24T22:59:59.183061+0000","last_active":"2024-04-24T23:00:01.185371+0000","last_peered":"2024-04-24T23:00:01.185371+0000","last_clean":"2024-04-24T23:00:01.185371+0000","last_became_active":"2024-04-24T22:59:59.182605+0000","last_became_peered":"2024-04-24T22:59:59.182605+0000","last_unstale":"2024-04-24T23:00:01.185371+0000","last_undegraded":"2024-04-24T23:00:01.185371+0000","last_fullsized":"2024-04-24T23:00:01.185371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:52.103486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010031+0000","last_change":"2024-04-24T22:59:54.826763+0000","last_active":"2024-04-24T23:00:01.010031+0000","last_peered":"2024-04-24T23:00:01.010031+0000","last_clean":"2024-04-24T23:00:01.010031+0000","last_became_active":"2024-04-24T22:59:54.826396+0000","last_became_peered":"2024-04-24T22:59:54.826396+0000","last_unstale":"2024-04-24T23:00:01.010031+0000","last_undegraded":"2024-04-24T23:00:01.010031+0000","last_fullsized":"2024-04-24T23:00:01.010031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184139+0000","last_change":"2024-04-24T22:59:53.802569+0000","last_active":"2024-04-24T23:00:01.184139+0000","last_peered":"2024-04-24T23:00:01.184139+0000","last_clean":"2024-04-24T23:00:01.184139+0000","last_became_active":"2024-04-24T22:59:53.801965+0000","last_became_peered":"2024-04-24T22:59:53.801965+0000","last_unstale":"2024-04-24T23:00:01.184139+0000","last_undegraded":"2024-04-24T23:00:01.184139+0000","last_fullsized":"2024-04-24T23:00:01.184139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:09.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336798+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:00:00.336798+0000","last_peered":"2024-04-24T23:00:00.336798+0000","last_clean":"2024-04-24T23:00:00.336798+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:00:00.336798+0000","last_undegraded":"2024-04-24T23:00:00.336798+0000","last_fullsized":"2024-04-24T23:00:00.336798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184761+0000","last_change":"2024-04-24T22:59:59.161211+0000","last_active":"2024-04-24T23:00:01.184761+0000","last_peered":"2024-04-24T23:00:01.184761+0000","last_clean":"2024-04-24T23:00:01.184761+0000","last_became_active":"2024-04-24T22:59:59.160734+0000","last_became_peered":"2024-04-24T22:59:59.160734+0000","last_unstale":"2024-04-24T23:00:01.184761+0000","last_undegraded":"2024-04-24T23:00:01.184761+0000","last_fullsized":"2024-04-24T23:00:01.184761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:36.104485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184606+0000","last_change":"2024-04-24T22:59:54.819610+0000","last_active":"2024-04-24T23:00:01.184606+0000","last_peered":"2024-04-24T23:00:01.184606+0000","last_clean":"2024-04-24T23:00:01.184606+0000","last_became_active":"2024-04-24T22:59:54.819070+0000","last_became_peered":"2024-04-24T22:59:54.819070+0000","last_unstale":"2024-04-24T23:00:01.184606+0000","last_undegraded":"2024-04-24T23:00:01.184606+0000","last_fullsized":"2024-04-24T23:00:01.184606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:53.348359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160124+0000","last_change":"2024-04-24T22:59:53.799389+0000","last_active":"2024-04-24T23:00:00.160124+0000","last_peered":"2024-04-24T23:00:00.160124+0000","last_clean":"2024-04-24T23:00:00.160124+0000","last_became_active":"2024-04-24T22:59:53.799041+0000","last_became_peered":"2024-04-24T22:59:53.799041+0000","last_unstale":"2024-04-24T23:00:00.160124+0000","last_undegraded":"2024-04-24T23:00:00.160124+0000","last_fullsized":"2024-04-24T23:00:00.160124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156106+0000","last_change":"2024-04-24T22:59:59.174885+0000","last_active":"2024-04-24T23:00:00.156106+0000","last_peered":"2024-04-24T23:00:00.156106+0000","last_clean":"2024-04-24T23:00:00.156106+0000","last_became_active":"2024-04-24T22:59:59.174370+0000","last_became_peered":"2024-04-24T22:59:59.174370+0000","last_unstale":"2024-04-24T23:00:00.156106+0000","last_undegraded":"2024-04-24T23:00:00.156106+0000","last_fullsized":"2024-04-24T23:00:00.156106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245921+0000","last_change":"2024-04-24T22:59:54.835634+0000","last_active":"2024-04-24T23:00:00.245921+0000","last_peered":"2024-04-24T23:00:00.245921+0000","last_clean":"2024-04-24T23:00:00.245921+0000","last_became_active":"2024-04-24T22:59:54.833569+0000","last_became_peered":"2024-04-24T22:59:54.833569+0000","last_unstale":"2024-04-24T23:00:00.245921+0000","last_undegraded":"2024-04-24T23:00:00.245921+0000","last_fullsized":"2024-04-24T23:00:00.245921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:29.860749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185367+0000","last_change":"2024-04-24T22:59:53.802150+0000","last_active":"2024-04-24T23:00:01.185367+0000","last_peered":"2024-04-24T23:00:01.185367+0000","last_clean":"2024-04-24T23:00:01.185367+0000","last_became_active":"2024-04-24T22:59:53.799509+0000","last_became_peered":"2024-04-24T22:59:53.799509+0000","last_unstale":"2024-04-24T23:00:01.185367+0000","last_undegraded":"2024-04-24T23:00:01.185367+0000","last_fullsized":"2024-04-24T23:00:01.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:36.050787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184895+0000","last_change":"2024-04-24T22:59:59.177414+0000","last_active":"2024-04-24T23:00:01.184895+0000","last_peered":"2024-04-24T23:00:01.184895+0000","last_clean":"2024-04-24T23:00:01.184895+0000","last_became_active":"2024-04-24T22:59:59.174313+0000","last_became_peered":"2024-04-24T22:59:59.174313+0000","last_unstale":"2024-04-24T23:00:01.184895+0000","last_undegraded":"2024-04-24T23:00:01.184895+0000","last_fullsized":"2024-04-24T23:00:01.184895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:22.796518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245879+0000","last_change":"2024-04-24T22:59:54.823918+0000","last_active":"2024-04-24T23:00:00.245879+0000","last_peered":"2024-04-24T23:00:00.245879+0000","last_clean":"2024-04-24T23:00:00.245879+0000","last_became_active":"2024-04-24T22:59:54.823619+0000","last_became_peered":"2024-04-24T22:59:54.823619+0000","last_unstale":"2024-04-24T23:00:00.245879+0000","last_undegraded":"2024-04-24T23:00:00.245879+0000","last_fullsized":"2024-04-24T23:00:00.245879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009718+0000","last_change":"2024-04-24T22:59:53.802658+0000","last_active":"2024-04-24T23:00:01.009718+0000","last_peered":"2024-04-24T23:00:01.009718+0000","last_clean":"2024-04-24T23:00:01.009718+0000","last_became_active":"2024-04-24T22:59:53.802337+0000","last_became_peered":"2024-04-24T22:59:53.802337+0000","last_unstale":"2024-04-24T23:00:01.009718+0000","last_undegraded":"2024-04-24T23:00:01.009718+0000","last_fullsized":"2024-04-24T23:00:01.009718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183130+0000","last_change":"2024-04-24T22:59:59.158432+0000","last_active":"2024-04-24T23:00:01.183130+0000","last_peered":"2024-04-24T23:00:01.183130+0000","last_clean":"2024-04-24T23:00:01.183130+0000","last_became_active":"2024-04-24T22:59:59.157980+0000","last_became_peered":"2024-04-24T22:59:59.157980+0000","last_unstale":"2024-04-24T23:00:01.183130+0000","last_undegraded":"2024-04-24T23:00:01.183130+0000","last_fullsized":"2024-04-24T23:00:01.183130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:13.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158298+0000","last_change":"2024-04-24T22:59:54.830501+0000","last_active":"2024-04-24T23:00:00.158298+0000","last_peered":"2024-04-24T23:00:00.158298+0000","last_clean":"2024-04-24T23:00:00.158298+0000","last_became_active":"2024-04-24T22:59:54.829827+0000","last_became_peered":"2024-04-24T22:59:54.829827+0000","last_unstale":"2024-04-24T23:00:00.158298+0000","last_undegraded":"2024-04-24T23:00:00.158298+0000","last_fullsized":"2024-04-24T23:00:00.158298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245937+0000","last_change":"2024-04-24T22:59:53.804112+0000","last_active":"2024-04-24T23:00:00.245937+0000","last_peered":"2024-04-24T23:00:00.245937+0000","last_clean":"2024-04-24T23:00:00.245937+0000","last_became_active":"2024-04-24T22:59:53.803737+0000","last_became_peered":"2024-04-24T22:59:53.803737+0000","last_unstale":"2024-04-24T23:00:00.245937+0000","last_undegraded":"2024-04-24T23:00:00.245937+0000","last_fullsized":"2024-04-24T23:00:00.245937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336897+0000","last_change":"2024-04-24T22:59:59.170945+0000","last_active":"2024-04-24T23:00:00.336897+0000","last_peered":"2024-04-24T23:00:00.336897+0000","last_clean":"2024-04-24T23:00:00.336897+0000","last_became_active":"2024-04-24T22:59:59.170564+0000","last_became_peered":"2024-04-24T22:59:59.170564+0000","last_unstale":"2024-04-24T23:00:00.336897+0000","last_undegraded":"2024-04-24T23:00:00.336897+0000","last_fullsized":"2024-04-24T23:00:00.336897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:46.104989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183495+0000","last_change":"2024-04-24T22:59:54.834918+0000","last_active":"2024-04-24T23:00:01.183495+0000","last_peered":"2024-04-24T23:00:01.183495+0000","last_clean":"2024-04-24T23:00:01.183495+0000","last_became_active":"2024-04-24T22:59:54.834596+0000","last_became_peered":"2024-04-24T22:59:54.834596+0000","last_unstale":"2024-04-24T23:00:01.183495+0000","last_undegraded":"2024-04-24T23:00:01.183495+0000","last_fullsized":"2024-04-24T23:00:01.183495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:55.731536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009071+0000","last_change":"2024-04-24T22:59:53.801950+0000","last_active":"2024-04-24T23:00:01.009071+0000","last_peered":"2024-04-24T23:00:01.009071+0000","last_clean":"2024-04-24T23:00:01.009071+0000","last_became_active":"2024-04-24T22:59:53.801646+0000","last_became_peered":"2024-04-24T22:59:53.801646+0000","last_unstale":"2024-04-24T23:00:01.009071+0000","last_undegraded":"2024-04-24T23:00:01.009071+0000","last_fullsized":"2024-04-24T23:00:01.009071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185946+0000","last_change":"2024-04-24T22:59:59.175741+0000","last_active":"2024-04-24T23:00:01.185946+0000","last_peered":"2024-04-24T23:00:01.185946+0000","last_clean":"2024-04-24T23:00:01.185946+0000","last_became_active":"2024-04-24T22:59:59.175281+0000","last_became_peered":"2024-04-24T22:59:59.175281+0000","last_unstale":"2024-04-24T23:00:01.185946+0000","last_undegraded":"2024-04-24T23:00:01.185946+0000","last_fullsized":"2024-04-24T23:00:01.185946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:23:30.733798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336673+0000","last_change":"2024-04-24T22:59:54.846255+0000","last_active":"2024-04-24T23:00:00.336673+0000","last_peered":"2024-04-24T23:00:00.336673+0000","last_clean":"2024-04-24T23:00:00.336673+0000","last_became_active":"2024-04-24T22:59:54.845933+0000","last_became_peered":"2024-04-24T22:59:54.845933+0000","last_unstale":"2024-04-24T23:00:00.336673+0000","last_undegraded":"2024-04-24T23:00:00.336673+0000","last_fullsized":"2024-04-24T23:00:00.336673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245177+0000","last_change":"2024-04-24T22:59:53.807192+0000","last_active":"2024-04-24T23:00:00.245177+0000","last_peered":"2024-04-24T23:00:00.245177+0000","last_clean":"2024-04-24T23:00:00.245177+0000","last_became_active":"2024-04-24T22:59:53.806934+0000","last_became_peered":"2024-04-24T22:59:53.806934+0000","last_unstale":"2024-04-24T23:00:00.245177+0000","last_undegraded":"2024-04-24T23:00:00.245177+0000","last_fullsized":"2024-04-24T23:00:00.245177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185730+0000","last_change":"2024-04-24T22:59:59.183999+0000","last_active":"2024-04-24T23:00:01.185730+0000","last_peered":"2024-04-24T23:00:01.185730+0000","last_clean":"2024-04-24T23:00:01.185730+0000","last_became_active":"2024-04-24T22:59:59.183567+0000","last_became_peered":"2024-04-24T22:59:59.183567+0000","last_unstale":"2024-04-24T23:00:01.185730+0000","last_undegraded":"2024-04-24T23:00:01.185730+0000","last_fullsized":"2024-04-24T23:00:01.185730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:48.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183858+0000","last_change":"2024-04-24T22:59:54.832242+0000","last_active":"2024-04-24T23:00:01.183858+0000","last_peered":"2024-04-24T23:00:01.183858+0000","last_clean":"2024-04-24T23:00:01.183858+0000","last_became_active":"2024-04-24T22:59:54.830703+0000","last_became_peered":"2024-04-24T22:59:54.830703+0000","last_unstale":"2024-04-24T23:00:01.183858+0000","last_undegraded":"2024-04-24T23:00:01.183858+0000","last_fullsized":"2024-04-24T23:00:01.183858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184359+0000","last_change":"2024-04-24T22:59:53.798756+0000","last_active":"2024-04-24T23:00:01.184359+0000","last_peered":"2024-04-24T23:00:01.184359+0000","last_clean":"2024-04-24T23:00:01.184359+0000","last_became_active":"2024-04-24T22:59:53.798399+0000","last_became_peered":"2024-04-24T22:59:53.798399+0000","last_unstale":"2024-04-24T23:00:01.184359+0000","last_undegraded":"2024-04-24T23:00:01.184359+0000","last_fullsized":"2024-04-24T23:00:01.184359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:17.930808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158868+0000","last_change":"2024-04-24T22:59:59.180893+0000","last_active":"2024-04-24T23:00:00.158868+0000","last_peered":"2024-04-24T23:00:00.158868+0000","last_clean":"2024-04-24T23:00:00.158868+0000","last_became_active":"2024-04-24T22:59:59.180250+0000","last_became_peered":"2024-04-24T22:59:59.180250+0000","last_unstale":"2024-04-24T23:00:00.158868+0000","last_undegraded":"2024-04-24T23:00:00.158868+0000","last_fullsized":"2024-04-24T23:00:00.158868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158938+0000","last_change":"2024-04-24T22:59:54.824357+0000","last_active":"2024-04-24T23:00:00.158938+0000","last_peered":"2024-04-24T23:00:00.158938+0000","last_clean":"2024-04-24T23:00:00.158938+0000","last_became_active":"2024-04-24T22:59:54.823831+0000","last_became_peered":"2024-04-24T22:59:54.823831+0000","last_unstale":"2024-04-24T23:00:00.158938+0000","last_undegraded":"2024-04-24T23:00:00.158938+0000","last_fullsized":"2024-04-24T23:00:00.158938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162832+0000","last_change":"2024-04-24T22:59:53.798640+0000","last_active":"2024-04-24T23:00:00.162832+0000","last_peered":"2024-04-24T23:00:00.162832+0000","last_clean":"2024-04-24T23:00:00.162832+0000","last_became_active":"2024-04-24T22:59:53.798298+0000","last_became_peered":"2024-04-24T22:59:53.798298+0000","last_unstale":"2024-04-24T23:00:00.162832+0000","last_undegraded":"2024-04-24T23:00:00.162832+0000","last_fullsized":"2024-04-24T23:00:00.162832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184286+0000","last_change":"2024-04-24T22:59:59.178160+0000","last_active":"2024-04-24T23:00:01.184286+0000","last_peered":"2024-04-24T23:00:01.184286+0000","last_clean":"2024-04-24T23:00:01.184286+0000","last_became_active":"2024-04-24T22:59:59.177275+0000","last_became_peered":"2024-04-24T22:59:59.177275+0000","last_unstale":"2024-04-24T23:00:01.184286+0000","last_undegraded":"2024-04-24T23:00:01.184286+0000","last_fullsized":"2024-04-24T23:00:01.184286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:06.997646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246471+0000","last_change":"2024-04-24T22:59:54.828946+0000","last_active":"2024-04-24T23:00:00.246471+0000","last_peered":"2024-04-24T23:00:00.246471+0000","last_clean":"2024-04-24T23:00:00.246471+0000","last_became_active":"2024-04-24T22:59:54.828694+0000","last_became_peered":"2024-04-24T22:59:54.828694+0000","last_unstale":"2024-04-24T23:00:00.246471+0000","last_undegraded":"2024-04-24T23:00:00.246471+0000","last_fullsized":"2024-04-24T23:00:00.246471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:13.857989+0000","last_change":"2024-04-24T22:59:53.802324+0000","last_active":"2024-04-24T23:00:13.857989+0000","last_peered":"2024-04-24T23:00:13.857989+0000","last_clean":"2024-04-24T23:00:13.857989+0000","last_became_active":"2024-04-24T22:59:53.801956+0000","last_became_peered":"2024-04-24T22:59:53.801956+0000","last_unstale":"2024-04-24T23:00:13.857989+0000","last_undegraded":"2024-04-24T23:00:13.857989+0000","last_fullsized":"2024-04-24T23:00:13.857989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009080+0000","last_change":"2024-04-24T22:59:59.175987+0000","last_active":"2024-04-24T23:00:01.009080+0000","last_peered":"2024-04-24T23:00:01.009080+0000","last_clean":"2024-04-24T23:00:01.009080+0000","last_became_active":"2024-04-24T22:59:59.175539+0000","last_became_peered":"2024-04-24T22:59:59.175539+0000","last_unstale":"2024-04-24T23:00:01.009080+0000","last_undegraded":"2024-04-24T23:00:01.009080+0000","last_fullsized":"2024-04-24T23:00:01.009080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:46.474442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183741+0000","last_change":"2024-04-24T22:59:54.827006+0000","last_active":"2024-04-24T23:00:01.183741+0000","last_peered":"2024-04-24T23:00:01.183741+0000","last_clean":"2024-04-24T23:00:01.183741+0000","last_became_active":"2024-04-24T22:59:54.825162+0000","last_became_peered":"2024-04-24T22:59:54.825162+0000","last_unstale":"2024-04-24T23:00:01.183741+0000","last_undegraded":"2024-04-24T23:00:01.183741+0000","last_fullsized":"2024-04-24T23:00:01.183741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162078+0000","last_change":"2024-04-24T22:59:53.805610+0000","last_active":"2024-04-24T23:00:00.162078+0000","last_peered":"2024-04-24T23:00:00.162078+0000","last_clean":"2024-04-24T23:00:00.162078+0000","last_became_active":"2024-04-24T22:59:53.805286+0000","last_became_peered":"2024-04-24T22:59:53.805286+0000","last_unstale":"2024-04-24T23:00:00.162078+0000","last_undegraded":"2024-04-24T23:00:00.162078+0000","last_fullsized":"2024-04-24T23:00:00.162078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156548+0000","last_change":"2024-04-24T22:59:59.176914+0000","last_active":"2024-04-24T23:00:00.156548+0000","last_peered":"2024-04-24T23:00:00.156548+0000","last_clean":"2024-04-24T23:00:00.156548+0000","last_became_active":"2024-04-24T22:59:59.176522+0000","last_became_peered":"2024-04-24T22:59:59.176522+0000","last_unstale":"2024-04-24T23:00:00.156548+0000","last_undegraded":"2024-04-24T23:00:00.156548+0000","last_fullsized":"2024-04-24T23:00:00.156548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185735+0000","last_change":"2024-04-24T22:59:54.843770+0000","last_active":"2024-04-24T23:00:01.185735+0000","last_peered":"2024-04-24T23:00:01.185735+0000","last_clean":"2024-04-24T23:00:01.185735+0000","last_became_active":"2024-04-24T22:59:54.838700+0000","last_became_peered":"2024-04-24T22:59:54.838700+0000","last_unstale":"2024-04-24T23:00:01.185735+0000","last_undegraded":"2024-04-24T23:00:01.185735+0000","last_fullsized":"2024-04-24T23:00:01.185735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:16.370386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245598+0000","last_change":"2024-04-24T22:59:53.800926+0000","last_active":"2024-04-24T23:00:00.245598+0000","last_peered":"2024-04-24T23:00:00.245598+0000","last_clean":"2024-04-24T23:00:00.245598+0000","last_became_active":"2024-04-24T22:59:53.800666+0000","last_became_peered":"2024-04-24T22:59:53.800666+0000","last_unstale":"2024-04-24T23:00:00.245598+0000","last_undegraded":"2024-04-24T23:00:00.245598+0000","last_fullsized":"2024-04-24T23:00:00.245598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157317+0000","last_change":"2024-04-24T22:59:59.184549+0000","last_active":"2024-04-24T23:00:00.157317+0000","last_peered":"2024-04-24T23:00:00.157317+0000","last_clean":"2024-04-24T23:00:00.157317+0000","last_became_active":"2024-04-24T22:59:59.184095+0000","last_became_peered":"2024-04-24T22:59:59.184095+0000","last_unstale":"2024-04-24T23:00:00.157317+0000","last_undegraded":"2024-04-24T23:00:00.157317+0000","last_fullsized":"2024-04-24T23:00:00.157317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:45.603508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158054+0000","last_change":"2024-04-24T22:59:54.840299+0000","last_active":"2024-04-24T23:00:00.158054+0000","last_peered":"2024-04-24T23:00:00.158054+0000","last_clean":"2024-04-24T23:00:00.158054+0000","last_became_active":"2024-04-24T22:59:54.839835+0000","last_became_peered":"2024-04-24T22:59:54.839835+0000","last_unstale":"2024-04-24T23:00:00.158054+0000","last_undegraded":"2024-04-24T23:00:00.158054+0000","last_fullsized":"2024-04-24T23:00:00.158054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.338011+0000","last_change":"2024-04-24T22:59:53.802398+0000","last_active":"2024-04-24T23:00:00.338011+0000","last_peered":"2024-04-24T23:00:00.338011+0000","last_clean":"2024-04-24T23:00:00.338011+0000","last_became_active":"2024-04-24T22:59:53.802067+0000","last_became_peered":"2024-04-24T22:59:53.802067+0000","last_unstale":"2024-04-24T23:00:00.338011+0000","last_undegraded":"2024-04-24T23:00:00.338011+0000","last_fullsized":"2024-04-24T23:00:00.338011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009830+0000","last_change":"2024-04-24T22:59:59.167854+0000","last_active":"2024-04-24T23:00:01.009830+0000","last_peered":"2024-04-24T23:00:01.009830+0000","last_clean":"2024-04-24T23:00:01.009830+0000","last_became_active":"2024-04-24T22:59:59.167352+0000","last_became_peered":"2024-04-24T22:59:59.167352+0000","last_unstale":"2024-04-24T23:00:01.009830+0000","last_undegraded":"2024-04-24T23:00:01.009830+0000","last_fullsized":"2024-04-24T23:00:01.009830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:10.083772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009441+0000","last_change":"2024-04-24T22:59:59.177020+0000","last_active":"2024-04-24T23:00:01.009441+0000","last_peered":"2024-04-24T23:00:01.009441+0000","last_clean":"2024-04-24T23:00:01.009441+0000","last_became_active":"2024-04-24T22:59:59.176501+0000","last_became_peered":"2024-04-24T22:59:59.176501+0000","last_unstale":"2024-04-24T23:00:01.009441+0000","last_undegraded":"2024-04-24T23:00:01.009441+0000","last_fullsized":"2024-04-24T23:00:01.009441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:00.091139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009043+0000","last_change":"2024-04-24T22:59:54.808811+0000","last_active":"2024-04-24T23:00:01.009043+0000","last_peered":"2024-04-24T23:00:01.009043+0000","last_clean":"2024-04-24T23:00:01.009043+0000","last_became_active":"2024-04-24T22:59:54.807983+0000","last_became_peered":"2024-04-24T22:59:54.807983+0000","last_unstale":"2024-04-24T23:00:01.009043+0000","last_undegraded":"2024-04-24T23:00:01.009043+0000","last_fullsized":"2024-04-24T23:00:01.009043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:31.328568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183452+0000","last_change":"2024-04-24T22:59:53.795814+0000","last_active":"2024-04-24T23:00:01.183452+0000","last_peered":"2024-04-24T23:00:01.183452+0000","last_clean":"2024-04-24T23:00:01.183452+0000","last_became_active":"2024-04-24T22:59:53.795530+0000","last_became_peered":"2024-04-24T22:59:53.795530+0000","last_unstale":"2024-04-24T23:00:01.183452+0000","last_undegraded":"2024-04-24T23:00:01.183452+0000","last_fullsized":"2024-04-24T23:00:01.183452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185190+0000","last_change":"2024-04-24T22:59:59.178038+0000","last_active":"2024-04-24T23:00:01.185190+0000","last_peered":"2024-04-24T23:00:01.185190+0000","last_clean":"2024-04-24T23:00:01.185190+0000","last_became_active":"2024-04-24T22:59:59.177590+0000","last_became_peered":"2024-04-24T22:59:59.177590+0000","last_unstale":"2024-04-24T23:00:01.185190+0000","last_undegraded":"2024-04-24T23:00:01.185190+0000","last_fullsized":"2024-04-24T23:00:01.185190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:33.544037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184156+0000","last_change":"2024-04-24T22:59:54.835646+0000","last_active":"2024-04-24T23:00:01.184156+0000","last_peered":"2024-04-24T23:00:01.184156+0000","last_clean":"2024-04-24T23:00:01.184156+0000","last_became_active":"2024-04-24T22:59:54.835384+0000","last_became_peered":"2024-04-24T22:59:54.835384+0000","last_unstale":"2024-04-24T23:00:01.184156+0000","last_undegraded":"2024-04-24T23:00:01.184156+0000","last_fullsized":"2024-04-24T23:00:01.184156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:29.063136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159519+0000","last_change":"2024-04-24T22:59:53.798938+0000","last_active":"2024-04-24T23:00:00.159519+0000","last_peered":"2024-04-24T23:00:00.159519+0000","last_clean":"2024-04-24T23:00:00.159519+0000","last_became_active":"2024-04-24T22:59:53.798646+0000","last_became_peered":"2024-04-24T22:59:53.798646+0000","last_unstale":"2024-04-24T23:00:00.159519+0000","last_undegraded":"2024-04-24T23:00:00.159519+0000","last_fullsized":"2024-04-24T23:00:00.159519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184247+0000","last_change":"2024-04-24T22:59:53.797818+0000","last_active":"2024-04-24T23:00:01.184247+0000","last_peered":"2024-04-24T23:00:01.184247+0000","last_clean":"2024-04-24T23:00:01.184247+0000","last_became_active":"2024-04-24T22:59:53.796837+0000","last_became_peered":"2024-04-24T22:59:53.796837+0000","last_unstale":"2024-04-24T23:00:01.184247+0000","last_undegraded":"2024-04-24T23:00:01.184247+0000","last_fullsized":"2024-04-24T23:00:01.184247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:40.731687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009363+0000","last_change":"2024-04-24T22:59:54.827809+0000","last_active":"2024-04-24T23:00:01.009363+0000","last_peered":"2024-04-24T23:00:01.009363+0000","last_clean":"2024-04-24T23:00:01.009363+0000","last_became_active":"2024-04-24T22:59:54.827260+0000","last_became_peered":"2024-04-24T22:59:54.827260+0000","last_unstale":"2024-04-24T23:00:01.009363+0000","last_undegraded":"2024-04-24T23:00:01.009363+0000","last_fullsized":"2024-04-24T23:00:01.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:16.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009993+0000","last_change":"2024-04-24T22:59:59.178920+0000","last_active":"2024-04-24T23:00:01.009993+0000","last_peered":"2024-04-24T23:00:01.009993+0000","last_clean":"2024-04-24T23:00:01.009993+0000","last_became_active":"2024-04-24T22:59:59.178525+0000","last_became_peered":"2024-04-24T22:59:59.178525+0000","last_unstale":"2024-04-24T23:00:01.009993+0000","last_undegraded":"2024-04-24T23:00:01.009993+0000","last_fullsized":"2024-04-24T23:00:01.009993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184831+0000","last_change":"2024-04-24T22:59:53.803387+0000","last_active":"2024-04-24T23:00:01.184831+0000","last_peered":"2024-04-24T23:00:01.184831+0000","last_clean":"2024-04-24T23:00:01.184831+0000","last_became_active":"2024-04-24T22:59:53.802947+0000","last_became_peered":"2024-04-24T22:59:53.802947+0000","last_unstale":"2024-04-24T23:00:01.184831+0000","last_undegraded":"2024-04-24T23:00:01.184831+0000","last_fullsized":"2024-04-24T23:00:01.184831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:03.901704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337215+0000","last_change":"2024-04-24T22:59:54.846364+0000","last_active":"2024-04-24T23:00:00.337215+0000","last_peered":"2024-04-24T23:00:00.337215+0000","last_clean":"2024-04-24T23:00:00.337215+0000","last_became_active":"2024-04-24T22:59:54.846003+0000","last_became_peered":"2024-04-24T22:59:54.846003+0000","last_unstale":"2024-04-24T23:00:00.337215+0000","last_undegraded":"2024-04-24T23:00:00.337215+0000","last_fullsized":"2024-04-24T23:00:00.337215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.161971+0000","last_change":"2024-04-24T22:59:59.184791+0000","last_active":"2024-04-24T23:00:00.161971+0000","last_peered":"2024-04-24T23:00:00.161971+0000","last_clean":"2024-04-24T23:00:00.161971+0000","last_became_active":"2024-04-24T22:59:59.184116+0000","last_became_peered":"2024-04-24T22:59:59.184116+0000","last_unstale":"2024-04-24T23:00:00.161971+0000","last_undegraded":"2024-04-24T23:00:00.161971+0000","last_fullsized":"2024-04-24T23:00:00.161971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:35.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155812+0000","last_change":"2024-04-24T22:59:54.827064+0000","last_active":"2024-04-24T23:00:00.155812+0000","last_peered":"2024-04-24T23:00:00.155812+0000","last_clean":"2024-04-24T23:00:00.155812+0000","last_became_active":"2024-04-24T22:59:54.826759+0000","last_became_peered":"2024-04-24T22:59:54.826759+0000","last_unstale":"2024-04-24T23:00:00.155812+0000","last_undegraded":"2024-04-24T23:00:00.155812+0000","last_fullsized":"2024-04-24T23:00:00.155812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158202+0000","last_change":"2024-04-24T22:59:54.830406+0000","last_active":"2024-04-24T23:00:00.158202+0000","last_peered":"2024-04-24T23:00:00.158202+0000","last_clean":"2024-04-24T23:00:00.158202+0000","last_became_active":"2024-04-24T22:59:54.830092+0000","last_became_peered":"2024-04-24T22:59:54.830092+0000","last_unstale":"2024-04-24T23:00:00.158202+0000","last_undegraded":"2024-04-24T23:00:00.158202+0000","last_fullsized":"2024-04-24T23:00:00.158202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184023+0000","last_change":"2024-04-24T22:59:54.842436+0000","last_active":"2024-04-24T23:00:01.184023+0000","last_peered":"2024-04-24T23:00:01.184023+0000","last_clean":"2024-04-24T23:00:01.184023+0000","last_became_active":"2024-04-24T22:59:54.842135+0000","last_became_peered":"2024-04-24T22:59:54.842135+0000","last_unstale":"2024-04-24T23:00:01.184023+0000","last_undegraded":"2024-04-24T23:00:01.184023+0000","last_fullsized":"2024-04-24T23:00:01.184023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:04.584734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184555+0000","last_change":"2024-04-24T22:59:54.845478+0000","last_active":"2024-04-24T23:00:01.184555+0000","last_peered":"2024-04-24T23:00:01.184555+0000","last_clean":"2024-04-24T23:00:01.184555+0000","last_became_active":"2024-04-24T22:59:54.845154+0000","last_became_peered":"2024-04-24T22:59:54.845154+0000","last_unstale":"2024-04-24T23:00:01.184555+0000","last_undegraded":"2024-04-24T23:00:01.184555+0000","last_fullsized":"2024-04-24T23:00:01.184555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.211633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159644+0000","last_change":"2024-04-24T22:59:54.833101+0000","last_active":"2024-04-24T23:00:00.159644+0000","last_peered":"2024-04-24T23:00:00.159644+0000","last_clean":"2024-04-24T23:00:00.159644+0000","last_became_active":"2024-04-24T22:59:54.832808+0000","last_became_peered":"2024-04-24T22:59:54.832808+0000","last_unstale":"2024-04-24T23:00:00.159644+0000","last_undegraded":"2024-04-24T23:00:00.159644+0000","last_fullsized":"2024-04-24T23:00:00.159644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:18.944507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160607+0000","last_change":"2024-04-24T22:59:54.832279+0000","last_active":"2024-04-24T23:00:00.160607+0000","last_peered":"2024-04-24T23:00:00.160607+0000","last_clean":"2024-04-24T23:00:00.160607+0000","last_became_active":"2024-04-24T22:59:54.831479+0000","last_became_peered":"2024-04-24T22:59:54.831479+0000","last_unstale":"2024-04-24T23:00:00.160607+0000","last_undegraded":"2024-04-24T23:00:00.160607+0000","last_fullsized":"2024-04-24T23:00:00.160607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:41.243906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157820+0000","last_change":"2024-04-24T22:59:54.841252+0000","last_active":"2024-04-24T23:00:00.157820+0000","last_peered":"2024-04-24T23:00:00.157820+0000","last_clean":"2024-04-24T23:00:00.157820+0000","last_became_active":"2024-04-24T22:59:54.840960+0000","last_became_peered":"2024-04-24T22:59:54.840960+0000","last_unstale":"2024-04-24T23:00:00.157820+0000","last_undegraded":"2024-04-24T23:00:00.157820+0000","last_fullsized":"2024-04-24T23:00:00.157820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185364+0000","last_change":"2024-04-24T22:59:54.844485+0000","last_active":"2024-04-24T23:00:01.185364+0000","last_peered":"2024-04-24T23:00:01.185364+0000","last_clean":"2024-04-24T23:00:01.185364+0000","last_became_active":"2024-04-24T22:59:54.844149+0000","last_became_peered":"2024-04-24T22:59:54.844149+0000","last_unstale":"2024-04-24T23:00:01.185364+0000","last_undegraded":"2024-04-24T23:00:01.185364+0000","last_fullsized":"2024-04-24T23:00:01.185364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:05.971282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183253+0000","last_change":"2024-04-24T22:59:54.843547+0000","last_active":"2024-04-24T23:00:01.183253+0000","last_peered":"2024-04-24T23:00:01.183253+0000","last_clean":"2024-04-24T23:00:01.183253+0000","last_became_active":"2024-04-24T22:59:54.842984+0000","last_became_peered":"2024-04-24T22:59:54.842984+0000","last_unstale":"2024-04-24T23:00:01.183253+0000","last_undegraded":"2024-04-24T23:00:01.183253+0000","last_fullsized":"2024-04-24T23:00:01.183253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184055+0000","last_change":"2024-04-24T22:59:54.848279+0000","last_active":"2024-04-24T23:00:01.184055+0000","last_peered":"2024-04-24T23:00:01.184055+0000","last_clean":"2024-04-24T23:00:01.184055+0000","last_became_active":"2024-04-24T22:59:54.847833+0000","last_became_peered":"2024-04-24T22:59:54.847833+0000","last_unstale":"2024-04-24T23:00:01.184055+0000","last_undegraded":"2024-04-24T23:00:01.184055+0000","last_fullsized":"2024-04-24T23:00:01.184055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:10.672755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336955+0000","last_change":"2024-04-24T22:59:54.821637+0000","last_active":"2024-04-24T23:00:00.336955+0000","last_peered":"2024-04-24T23:00:00.336955+0000","last_clean":"2024-04-24T23:00:00.336955+0000","last_became_active":"2024-04-24T22:59:54.819868+0000","last_became_peered":"2024-04-24T22:59:54.819868+0000","last_unstale":"2024-04-24T23:00:00.336955+0000","last_undegraded":"2024-04-24T23:00:00.336955+0000","last_fullsized":"2024-04-24T23:00:00.336955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.860484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009044+0000","last_change":"2024-04-24T22:59:54.839683+0000","last_active":"2024-04-24T23:00:01.009044+0000","last_peered":"2024-04-24T23:00:01.009044+0000","last_clean":"2024-04-24T23:00:01.009044+0000","last_became_active":"2024-04-24T22:59:54.834098+0000","last_became_peered":"2024-04-24T22:59:54.834098+0000","last_unstale":"2024-04-24T23:00:01.009044+0000","last_undegraded":"2024-04-24T23:00:01.009044+0000","last_fullsized":"2024-04-24T23:00:01.009044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:58.717221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245911+0000","last_change":"2024-04-24T22:59:54.832261+0000","last_active":"2024-04-24T23:00:00.245911+0000","last_peered":"2024-04-24T23:00:00.245911+0000","last_clean":"2024-04-24T23:00:00.245911+0000","last_became_active":"2024-04-24T22:59:54.831321+0000","last_became_peered":"2024-04-24T22:59:54.831321+0000","last_unstale":"2024-04-24T23:00:00.245911+0000","last_undegraded":"2024-04-24T23:00:00.245911+0000","last_fullsized":"2024-04-24T23:00:00.245911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:12.911957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184771+0000","last_change":"2024-04-24T22:59:54.819368+0000","last_active":"2024-04-24T23:00:01.184771+0000","last_peered":"2024-04-24T23:00:01.184771+0000","last_clean":"2024-04-24T23:00:01.184771+0000","last_became_active":"2024-04-24T22:59:54.818749+0000","last_became_peered":"2024-04-24T22:59:54.818749+0000","last_unstale":"2024-04-24T23:00:01.184771+0000","last_undegraded":"2024-04-24T23:00:01.184771+0000","last_fullsized":"2024-04-24T23:00:01.184771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:14.960710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162580+0000","last_change":"2024-04-24T22:59:54.834877+0000","last_active":"2024-04-24T23:00:00.162580+0000","last_peered":"2024-04-24T23:00:00.162580+0000","last_clean":"2024-04-24T23:00:00.162580+0000","last_became_active":"2024-04-24T22:59:54.833131+0000","last_became_peered":"2024-04-24T22:59:54.833131+0000","last_unstale":"2024-04-24T23:00:00.162580+0000","last_undegraded":"2024-04-24T23:00:00.162580+0000","last_fullsized":"2024-04-24T23:00:00.162580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185603+0000","last_change":"2024-04-24T22:59:54.826869+0000","last_active":"2024-04-24T23:00:01.185603+0000","last_peered":"2024-04-24T23:00:01.185603+0000","last_clean":"2024-04-24T23:00:01.185603+0000","last_became_active":"2024-04-24T22:59:54.826268+0000","last_became_peered":"2024-04-24T22:59:54.826268+0000","last_unstale":"2024-04-24T23:00:01.185603+0000","last_undegraded":"2024-04-24T23:00:01.185603+0000","last_fullsized":"2024-04-24T23:00:01.185603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:22.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183254+0000","last_change":"2024-04-24T22:59:54.829640+0000","last_active":"2024-04-24T23:00:01.183254+0000","last_peered":"2024-04-24T23:00:01.183254+0000","last_clean":"2024-04-24T23:00:01.183254+0000","last_became_active":"2024-04-24T22:59:54.829295+0000","last_became_peered":"2024-04-24T22:59:54.829295+0000","last_unstale":"2024-04-24T23:00:01.183254+0000","last_undegraded":"2024-04-24T23:00:01.183254+0000","last_fullsized":"2024-04-24T23:00:01.183254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183689+0000","last_change":"2024-04-24T22:59:54.845490+0000","last_active":"2024-04-24T23:00:01.183689+0000","last_peered":"2024-04-24T23:00:01.183689+0000","last_clean":"2024-04-24T23:00:01.183689+0000","last_became_active":"2024-04-24T22:59:54.842390+0000","last_became_peered":"2024-04-24T22:59:54.842390+0000","last_unstale":"2024-04-24T23:00:01.183689+0000","last_undegraded":"2024-04-24T23:00:01.183689+0000","last_fullsized":"2024-04-24T23:00:01.183689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:25.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158717+0000","last_change":"2024-04-24T22:59:54.837049+0000","last_active":"2024-04-24T23:00:00.158717+0000","last_peered":"2024-04-24T23:00:00.158717+0000","last_clean":"2024-04-24T23:00:00.158717+0000","last_became_active":"2024-04-24T22:59:54.836650+0000","last_became_peered":"2024-04-24T22:59:54.836650+0000","last_unstale":"2024-04-24T23:00:00.158717+0000","last_undegraded":"2024-04-24T23:00:00.158717+0000","last_fullsized":"2024-04-24T23:00:00.158717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160882+0000","last_change":"2024-04-24T22:59:54.823987+0000","last_active":"2024-04-24T23:00:00.160882+0000","last_peered":"2024-04-24T23:00:00.160882+0000","last_clean":"2024-04-24T23:00:00.160882+0000","last_became_active":"2024-04-24T22:59:54.823738+0000","last_became_peered":"2024-04-24T22:59:54.823738+0000","last_unstale":"2024-04-24T23:00:00.160882+0000","last_undegraded":"2024-04-24T23:00:00.160882+0000","last_fullsized":"2024-04-24T23:00:00.160882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245783+0000","last_change":"2024-04-24T22:59:54.828844+0000","last_active":"2024-04-24T23:00:00.245783+0000","last_peered":"2024-04-24T23:00:00.245783+0000","last_clean":"2024-04-24T23:00:00.245783+0000","last_became_active":"2024-04-24T22:59:54.827890+0000","last_became_peered":"2024-04-24T22:59:54.827890+0000","last_unstale":"2024-04-24T23:00:00.245783+0000","last_undegraded":"2024-04-24T23:00:00.245783+0000","last_fullsized":"2024-04-24T23:00:00.245783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:11.910761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246404+0000","last_change":"2024-04-24T22:59:54.841028+0000","last_active":"2024-04-24T23:00:00.246404+0000","last_peered":"2024-04-24T23:00:00.246404+0000","last_clean":"2024-04-24T23:00:00.246404+0000","last_became_active":"2024-04-24T22:59:54.839890+0000","last_became_peered":"2024-04-24T22:59:54.839890+0000","last_unstale":"2024-04-24T23:00:00.246404+0000","last_undegraded":"2024-04-24T23:00:00.246404+0000","last_fullsized":"2024-04-24T23:00:00.246404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:55.257739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245594+0000","last_change":"2024-04-24T22:59:54.834999+0000","last_active":"2024-04-24T23:00:00.245594+0000","last_peered":"2024-04-24T23:00:00.245594+0000","last_clean":"2024-04-24T23:00:00.245594+0000","last_became_active":"2024-04-24T22:59:54.834737+0000","last_became_peered":"2024-04-24T22:59:54.834737+0000","last_unstale":"2024-04-24T23:00:00.245594+0000","last_undegraded":"2024-04-24T23:00:00.245594+0000","last_fullsized":"2024-04-24T23:00:00.245594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337929+0000","last_change":"2024-04-24T22:59:54.825114+0000","last_active":"2024-04-24T23:00:00.337929+0000","last_peered":"2024-04-24T23:00:00.337929+0000","last_clean":"2024-04-24T23:00:00.337929+0000","last_became_active":"2024-04-24T22:59:54.824804+0000","last_became_peered":"2024-04-24T22:59:54.824804+0000","last_unstale":"2024-04-24T23:00:00.337929+0000","last_undegraded":"2024-04-24T23:00:00.337929+0000","last_fullsized":"2024-04-24T23:00:00.337929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183824+0000","last_change":"2024-04-24T22:59:54.841039+0000","last_active":"2024-04-24T23:00:01.183824+0000","last_peered":"2024-04-24T23:00:01.183824+0000","last_clean":"2024-04-24T23:00:01.183824+0000","last_became_active":"2024-04-24T22:59:54.840480+0000","last_became_peered":"2024-04-24T22:59:54.840480+0000","last_unstale":"2024-04-24T23:00:01.183824+0000","last_undegraded":"2024-04-24T23:00:01.183824+0000","last_fullsized":"2024-04-24T23:00:01.183824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:56.253783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245118+0000","last_change":"2024-04-24T22:59:54.829835+0000","last_active":"2024-04-24T23:00:00.245118+0000","last_peered":"2024-04-24T23:00:00.245118+0000","last_clean":"2024-04-24T23:00:00.245118+0000","last_became_active":"2024-04-24T22:59:54.829572+0000","last_became_peered":"2024-04-24T22:59:54.829572+0000","last_unstale":"2024-04-24T23:00:00.245118+0000","last_undegraded":"2024-04-24T23:00:00.245118+0000","last_fullsized":"2024-04-24T23:00:00.245118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156074+0000","last_change":"2024-04-24T22:59:54.831968+0000","last_active":"2024-04-24T23:00:00.156074+0000","last_peered":"2024-04-24T23:00:00.156074+0000","last_clean":"2024-04-24T23:00:00.156074+0000","last_became_active":"2024-04-24T22:59:54.831606+0000","last_became_peered":"2024-04-24T22:59:54.831606+0000","last_unstale":"2024-04-24T23:00:00.156074+0000","last_undegraded":"2024-04-24T23:00:00.156074+0000","last_fullsized":"2024-04-24T23:00:00.156074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245463+0000","last_change":"2024-04-24T22:59:54.848714+0000","last_active":"2024-04-24T23:00:00.245463+0000","last_peered":"2024-04-24T23:00:00.245463+0000","last_clean":"2024-04-24T23:00:00.245463+0000","last_became_active":"2024-04-24T22:59:54.848325+0000","last_became_peered":"2024-04-24T22:59:54.848325+0000","last_unstale":"2024-04-24T23:00:00.245463+0000","last_undegraded":"2024-04-24T23:00:00.245463+0000","last_fullsized":"2024-04-24T23:00:00.245463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156975+0000","last_change":"2024-04-24T22:59:54.836067+0000","last_active":"2024-04-24T23:00:00.156975+0000","last_peered":"2024-04-24T23:00:00.156975+0000","last_clean":"2024-04-24T23:00:00.156975+0000","last_became_active":"2024-04-24T22:59:54.830678+0000","last_became_peered":"2024-04-24T22:59:54.830678+0000","last_unstale":"2024-04-24T23:00:00.156975+0000","last_undegraded":"2024-04-24T23:00:00.156975+0000","last_fullsized":"2024-04-24T23:00:00.156975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185093+0000","last_change":"2024-04-24T22:59:54.846617+0000","last_active":"2024-04-24T23:00:01.185093+0000","last_peered":"2024-04-24T23:00:01.185093+0000","last_clean":"2024-04-24T23:00:01.185093+0000","last_became_active":"2024-04-24T22:59:54.844346+0000","last_became_peered":"2024-04-24T22:59:54.844346+0000","last_unstale":"2024-04-24T23:00:01.185093+0000","last_undegraded":"2024-04-24T23:00:01.185093+0000","last_fullsized":"2024-04-24T23:00:01.185093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:47.647894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185538+0000","last_change":"2024-04-24T22:59:54.840915+0000","last_active":"2024-04-24T23:00:01.185538+0000","last_peered":"2024-04-24T23:00:01.185538+0000","last_clean":"2024-04-24T23:00:01.185538+0000","last_became_active":"2024-04-24T22:59:54.840307+0000","last_became_peered":"2024-04-24T22:59:54.840307+0000","last_unstale":"2024-04-24T23:00:01.185538+0000","last_undegraded":"2024-04-24T23:00:01.185538+0000","last_fullsized":"2024-04-24T23:00:01.185538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:25.146607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245791+0000","last_change":"2024-04-24T22:59:54.839361+0000","last_active":"2024-04-24T23:00:00.245791+0000","last_peered":"2024-04-24T23:00:00.245791+0000","last_clean":"2024-04-24T23:00:00.245791+0000","last_became_active":"2024-04-24T22:59:54.838975+0000","last_became_peered":"2024-04-24T22:59:54.838975+0000","last_unstale":"2024-04-24T23:00:00.245791+0000","last_undegraded":"2024-04-24T23:00:00.245791+0000","last_fullsized":"2024-04-24T23:00:00.245791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:24.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.925+0000 7fb663000640 1 Processor -- start 2024-04-24T23:00:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.925+0000 7fb663000640 1 -- start start 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb663000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb65c145640 0x7fb65c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb663000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65c0cdf70 con 0x7fb65c0d03a0 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb663000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65c15d360 con 0x7fb65c0b2a20 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb663000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb65c145a20 con 0x7fb65c145640 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb661000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb65c0d03a0 0x7fb65c0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47354/0 (socket says 172.21.15.146:47354) 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb661000640 1 -- 172.21.15.146:0/1655282912 learned_addr learned my addr 172.21.15.146:0/1655282912 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.927+0000 7fb65be00640 1 --2- 172.21.15.146:0/1655282912 >> v2:172.21.15.146:3300/0 conn(0x7fb65c145640 0x7fb65c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.928+0000 7fb65be00640 1 -- 172.21.15.146:0/1655282912 >> v1:172.21.15.203:6789/0 conn(0x7fb65c0b2a20 legacy=0x7fb65c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:24.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.928+0000 7fb65be00640 1 -- 172.21.15.146:0/1655282912 >> v1:172.21.15.146:6789/0 conn(0x7fb65c0d03a0 legacy=0x7fb65c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.928+0000 7fb65be00640 1 -- 172.21.15.146:0/1655282912 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c06d140 con 0x7fb65c145640 2024-04-24T23:00:24.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.929+0000 7fb65be00640 1 --2- 172.21.15.146:0/1655282912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c145640 0x7fb65c15ce20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0097a0 tx=0x7fb64c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de392409f9f8fd53 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.929+0000 7fb65aa00640 1 -- 172.21.15.146:0/1655282912 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c037070 con 0x7fb65c145640 2024-04-24T23:00:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.929+0000 7fb65aa00640 1 -- 172.21.15.146:0/1655282912 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64c032440 con 0x7fb65c145640 2024-04-24T23:00:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.929+0000 7fb65aa00640 1 -- 172.21.15.146:0/1655282912 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c032810 con 0x7fb65c145640 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 -- 172.21.15.146:0/1655282912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c145640 msgr2=0x7fb65c15ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 --2- 172.21.15.146:0/1655282912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c145640 0x7fb65c15ce20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0097a0 tx=0x7fb64c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 -- 172.21.15.146:0/1655282912 shutdown_connections 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 --2- 172.21.15.146:0/1655282912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c145640 0x7fb65c15ce20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 -- 172.21.15.146:0/1655282912 >> 172.21.15.146:0/1655282912 conn(0x7fb65c06b320 msgr2=0x7fb65c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 -- 172.21.15.146:0/1655282912 shutdown_connections 2024-04-24T23:00:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.930+0000 7fb663000640 1 -- 172.21.15.146:0/1655282912 wait complete. 2024-04-24T23:00:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.932+0000 7fb663000640 1 Processor -- start 2024-04-24T23:00:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.932+0000 7fb663000640 1 -- start start 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb65c0b2a20 0x7fb65c131490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb65c145640 0x7fb65c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c06d9e0 con 0x7fb65c0d03a0 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c06d700 con 0x7fb65c0b2a20 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.933+0000 7fb663000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb65c06cbc0 con 0x7fb65c145640 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34272/0 (socket says 172.21.15.146:34272) 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 -- 172.21.15.146:0/2354235513 learned_addr learned my addr 172.21.15.146:0/2354235513 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65be00640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb65c0b2a20 0x7fb65c131490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb661000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb65c145640 0x7fb65c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 -- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb65c145640 msgr2=0x7fb65c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb65c145640 0x7fb65c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 -- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb65c0b2a20 msgr2=0x7fb65c131490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb65c0b2a20 0x7fb65c131490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.934+0000 7fb65b400640 1 -- 172.21.15.146:0/2354235513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c141e40 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb65b400640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c440 tx=0x7fb64400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644017070 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6440035f0 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c142120 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6440039e0 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.935+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1426e0 con 0x7fb65c0d03a0 2024-04-24T23:00:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.936+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c068190 con 0x7fb65c0d03a0 2024-04-24T23:00:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.937+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb64401a070 con 0x7fb65c0d03a0 2024-04-24T23:00:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.938+0000 7fb653e00640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 0x7fb63806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.938+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb64408a540 con 0x7fb65c0d03a0 2024-04-24T23:00:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.939+0000 7fb65be00640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 0x7fb63806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:24.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.940+0000 7fb65be00640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 0x7fb63806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb64c034000 tx=0x7fb64c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:24.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:24.942+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb644058ba0 con 0x7fb65c0d03a0 2024-04-24T23:00:25.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.136+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb65c159bb0 con 0x7fb63806be30 2024-04-24T23:00:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.160+0000 7fb653e00640 1 -- 172.21.15.146:0/2354235513 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fb65c159bb0 con 0x7fb63806be30 2024-04-24T23:00:25.166 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:25.168 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.165+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 msgr2=0x7fb63806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.165+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 0x7fb63806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb64c034000 tx=0x7fb64c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.165+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 msgr2=0x7fb65c13c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.165+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c440 tx=0x7fb64400c900 comp rx=0 tx=0).stop 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 shutdown_connections 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb63806be30 0x7fb63806e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb65c145640 0x7fb65c15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0d03a0 0x7fb65c13c130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 --2- 172.21.15.146:0/2354235513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb65c0b2a20 0x7fb65c131490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 >> 172.21.15.146:0/2354235513 conn(0x7fb65c06b320 msgr2=0x7fb65c0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 shutdown_connections 2024-04-24T23:00:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.166+0000 7fb663000640 1 -- 172.21.15.146:0/2354235513 wait complete. 2024-04-24T23:00:25.187 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-24T23:00:23.588206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004946"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010800+0000","last_change":"2024-04-24T22:59:53.808035+0000","last_active":"2024-04-24T23:00:01.010800+0000","last_peered":"2024-04-24T23:00:01.010800+0000","last_clean":"2024-04-24T23:00:01.010800+0000","last_became_active":"2024-04-24T22:59:53.807655+0000","last_became_peered":"2024-04-24T22:59:53.807655+0000","last_unstale":"2024-04-24T23:00:01.010800+0000","last_undegraded":"2024-04-24T23:00:01.010800+0000","last_fullsized":"2024-04-24T23:00:01.010800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185694+0000","last_change":"2024-04-24T22:59:54.844377+0000","last_active":"2024-04-24T23:00:01.185694+0000","last_peered":"2024-04-24T23:00:01.185694+0000","last_clean":"2024-04-24T23:00:01.185694+0000","last_became_active":"2024-04-24T22:59:54.844081+0000","last_became_peered":"2024-04-24T22:59:54.844081+0000","last_unstale":"2024-04-24T23:00:01.185694+0000","last_undegraded":"2024-04-24T23:00:01.185694+0000","last_fullsized":"2024-04-24T23:00:01.185694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:03:46.525647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158053+0000","last_change":"2024-04-24T22:59:59.190167+0000","last_active":"2024-04-24T23:00:00.158053+0000","last_peered":"2024-04-24T23:00:00.158053+0000","last_clean":"2024-04-24T23:00:00.158053+0000","last_became_active":"2024-04-24T22:59:59.189393+0000","last_became_peered":"2024-04-24T22:59:59.189393+0000","last_unstale":"2024-04-24T23:00:00.158053+0000","last_undegraded":"2024-04-24T23:00:00.158053+0000","last_fullsized":"2024-04-24T23:00:00.158053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.516700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185829+0000","last_change":"2024-04-24T22:59:53.799029+0000","last_active":"2024-04-24T23:00:01.185829+0000","last_peered":"2024-04-24T23:00:01.185829+0000","last_clean":"2024-04-24T23:00:01.185829+0000","last_became_active":"2024-04-24T22:59:53.798727+0000","last_became_peered":"2024-04-24T22:59:53.798727+0000","last_unstale":"2024-04-24T23:00:01.185829+0000","last_undegraded":"2024-04-24T23:00:01.185829+0000","last_fullsized":"2024-04-24T23:00:01.185829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:14:29.506259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185571+0000","last_change":"2024-04-24T22:59:54.844472+0000","last_active":"2024-04-24T23:00:01.185571+0000","last_peered":"2024-04-24T23:00:01.185571+0000","last_clean":"2024-04-24T23:00:01.185571+0000","last_became_active":"2024-04-24T22:59:54.844134+0000","last_became_peered":"2024-04-24T22:59:54.844134+0000","last_unstale":"2024-04-24T23:00:01.185571+0000","last_undegraded":"2024-04-24T23:00:01.185571+0000","last_fullsized":"2024-04-24T23:00:01.185571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:19.889185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155534+0000","last_change":"2024-04-24T22:59:59.170482+0000","last_active":"2024-04-24T23:00:00.155534+0000","last_peered":"2024-04-24T23:00:00.155534+0000","last_clean":"2024-04-24T23:00:00.155534+0000","last_became_active":"2024-04-24T22:59:59.169481+0000","last_became_peered":"2024-04-24T22:59:59.169481+0000","last_unstale":"2024-04-24T23:00:00.155534+0000","last_undegraded":"2024-04-24T23:00:00.155534+0000","last_fullsized":"2024-04-24T23:00:00.155534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:26.004993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246604+0000","last_change":"2024-04-24T22:59:53.796317+0000","last_active":"2024-04-24T23:00:00.246604+0000","last_peered":"2024-04-24T23:00:00.246604+0000","last_clean":"2024-04-24T23:00:00.246604+0000","last_became_active":"2024-04-24T22:59:53.795867+0000","last_became_peered":"2024-04-24T22:59:53.795867+0000","last_unstale":"2024-04-24T23:00:00.246604+0000","last_undegraded":"2024-04-24T23:00:00.246604+0000","last_fullsized":"2024-04-24T23:00:00.246604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337219+0000","last_change":"2024-04-24T22:59:54.819137+0000","last_active":"2024-04-24T23:00:00.337219+0000","last_peered":"2024-04-24T23:00:00.337219+0000","last_clean":"2024-04-24T23:00:00.337219+0000","last_became_active":"2024-04-24T22:59:54.818824+0000","last_became_peered":"2024-04-24T22:59:54.818824+0000","last_unstale":"2024-04-24T23:00:00.337219+0000","last_undegraded":"2024-04-24T23:00:00.337219+0000","last_fullsized":"2024-04-24T23:00:00.337219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156424+0000","last_change":"2024-04-24T22:59:59.175621+0000","last_active":"2024-04-24T23:00:00.156424+0000","last_peered":"2024-04-24T23:00:00.156424+0000","last_clean":"2024-04-24T23:00:00.156424+0000","last_became_active":"2024-04-24T22:59:59.175193+0000","last_became_peered":"2024-04-24T22:59:59.175193+0000","last_unstale":"2024-04-24T23:00:00.156424+0000","last_undegraded":"2024-04-24T23:00:00.156424+0000","last_fullsized":"2024-04-24T23:00:00.156424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246019+0000","last_change":"2024-04-24T22:59:53.789351+0000","last_active":"2024-04-24T23:00:00.246019+0000","last_peered":"2024-04-24T23:00:00.246019+0000","last_clean":"2024-04-24T23:00:00.246019+0000","last_became_active":"2024-04-24T22:59:53.789011+0000","last_became_peered":"2024-04-24T22:59:53.789011+0000","last_unstale":"2024-04-24T23:00:00.246019+0000","last_undegraded":"2024-04-24T23:00:00.246019+0000","last_fullsized":"2024-04-24T23:00:00.246019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184542+0000","last_change":"2024-04-24T22:59:54.831152+0000","last_active":"2024-04-24T23:00:01.184542+0000","last_peered":"2024-04-24T23:00:01.184542+0000","last_clean":"2024-04-24T23:00:01.184542+0000","last_became_active":"2024-04-24T22:59:54.829948+0000","last_became_peered":"2024-04-24T22:59:54.829948+0000","last_unstale":"2024-04-24T23:00:01.184542+0000","last_undegraded":"2024-04-24T23:00:01.184542+0000","last_fullsized":"2024-04-24T23:00:01.184542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:00.243216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155762+0000","last_change":"2024-04-24T22:59:59.183804+0000","last_active":"2024-04-24T23:00:00.155762+0000","last_peered":"2024-04-24T23:00:00.155762+0000","last_clean":"2024-04-24T23:00:00.155762+0000","last_became_active":"2024-04-24T22:59:59.183323+0000","last_became_peered":"2024-04-24T22:59:59.183323+0000","last_unstale":"2024-04-24T23:00:00.155762+0000","last_undegraded":"2024-04-24T23:00:00.155762+0000","last_fullsized":"2024-04-24T23:00:00.155762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184098+0000","last_change":"2024-04-24T22:59:54.822754+0000","last_active":"2024-04-24T23:00:01.184098+0000","last_peered":"2024-04-24T23:00:01.184098+0000","last_clean":"2024-04-24T23:00:01.184098+0000","last_became_active":"2024-04-24T22:59:54.822388+0000","last_became_peered":"2024-04-24T22:59:54.822388+0000","last_unstale":"2024-04-24T23:00:01.184098+0000","last_undegraded":"2024-04-24T23:00:01.184098+0000","last_fullsized":"2024-04-24T23:00:01.184098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:30.347602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183966+0000","last_change":"2024-04-24T22:59:53.802267+0000","last_active":"2024-04-24T23:00:01.183966+0000","last_peered":"2024-04-24T23:00:01.183966+0000","last_clean":"2024-04-24T23:00:01.183966+0000","last_became_active":"2024-04-24T22:59:53.801524+0000","last_became_peered":"2024-04-24T22:59:53.801524+0000","last_unstale":"2024-04-24T23:00:01.183966+0000","last_undegraded":"2024-04-24T23:00:01.183966+0000","last_fullsized":"2024-04-24T23:00:01.183966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:11.327838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183950+0000","last_change":"2024-04-24T22:59:59.177746+0000","last_active":"2024-04-24T23:00:01.183950+0000","last_peered":"2024-04-24T23:00:01.183950+0000","last_clean":"2024-04-24T23:00:01.183950+0000","last_became_active":"2024-04-24T22:59:59.176645+0000","last_became_peered":"2024-04-24T22:59:59.176645+0000","last_unstale":"2024-04-24T23:00:01.183950+0000","last_undegraded":"2024-04-24T23:00:01.183950+0000","last_fullsized":"2024-04-24T23:00:01.183950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:59:28.582936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162596+0000","last_change":"2024-04-24T22:59:54.833871+0000","last_active":"2024-04-24T23:00:00.162596+0000","last_peered":"2024-04-24T23:00:00.162596+0000","last_clean":"2024-04-24T23:00:00.162596+0000","last_became_active":"2024-04-24T22:59:54.833620+0000","last_became_peered":"2024-04-24T22:59:54.833620+0000","last_unstale":"2024-04-24T23:00:00.162596+0000","last_undegraded":"2024-04-24T23:00:00.162596+0000","last_fullsized":"2024-04-24T23:00:00.162596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159199+0000","last_change":"2024-04-24T22:59:53.801795+0000","last_active":"2024-04-24T23:00:00.159199+0000","last_peered":"2024-04-24T23:00:00.159199+0000","last_clean":"2024-04-24T23:00:00.159199+0000","last_became_active":"2024-04-24T22:59:53.801129+0000","last_became_peered":"2024-04-24T22:59:53.801129+0000","last_unstale":"2024-04-24T23:00:00.159199+0000","last_undegraded":"2024-04-24T23:00:00.159199+0000","last_fullsized":"2024-04-24T23:00:00.159199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245637+0000","last_change":"2024-04-24T22:59:59.180795+0000","last_active":"2024-04-24T23:00:00.245637+0000","last_peered":"2024-04-24T23:00:00.245637+0000","last_clean":"2024-04-24T23:00:00.245637+0000","last_became_active":"2024-04-24T22:59:59.179570+0000","last_became_peered":"2024-04-24T22:59:59.179570+0000","last_unstale":"2024-04-24T23:00:00.245637+0000","last_undegraded":"2024-04-24T23:00:00.245637+0000","last_fullsized":"2024-04-24T23:00:00.245637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.008767+0000","last_change":"2024-04-24T22:59:54.830621+0000","last_active":"2024-04-24T23:00:01.008767+0000","last_peered":"2024-04-24T23:00:01.008767+0000","last_clean":"2024-04-24T23:00:01.008767+0000","last_became_active":"2024-04-24T22:59:54.830261+0000","last_became_peered":"2024-04-24T22:59:54.830261+0000","last_unstale":"2024-04-24T23:00:01.008767+0000","last_undegraded":"2024-04-24T23:00:01.008767+0000","last_fullsized":"2024-04-24T23:00:01.008767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009662+0000","last_change":"2024-04-24T22:59:53.797083+0000","last_active":"2024-04-24T23:00:01.009662+0000","last_peered":"2024-04-24T23:00:01.009662+0000","last_clean":"2024-04-24T23:00:01.009662+0000","last_became_active":"2024-04-24T22:59:53.796741+0000","last_became_peered":"2024-04-24T22:59:53.796741+0000","last_unstale":"2024-04-24T23:00:01.009662+0000","last_undegraded":"2024-04-24T23:00:01.009662+0000","last_fullsized":"2024-04-24T23:00:01.009662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162937+0000","last_change":"2024-04-24T22:59:59.187326+0000","last_active":"2024-04-24T23:00:00.162937+0000","last_peered":"2024-04-24T23:00:00.162937+0000","last_clean":"2024-04-24T23:00:00.162937+0000","last_became_active":"2024-04-24T22:59:59.186542+0000","last_became_peered":"2024-04-24T22:59:59.186542+0000","last_unstale":"2024-04-24T23:00:00.162937+0000","last_undegraded":"2024-04-24T23:00:00.162937+0000","last_fullsized":"2024-04-24T23:00:00.162937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:20.837462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183491+0000","last_change":"2024-04-24T22:59:54.819833+0000","last_active":"2024-04-24T23:00:01.183491+0000","last_peered":"2024-04-24T23:00:01.183491+0000","last_clean":"2024-04-24T23:00:01.183491+0000","last_became_active":"2024-04-24T22:59:54.817443+0000","last_became_peered":"2024-04-24T22:59:54.817443+0000","last_unstale":"2024-04-24T23:00:01.183491+0000","last_undegraded":"2024-04-24T23:00:01.183491+0000","last_fullsized":"2024-04-24T23:00:01.183491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:05.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.244949+0000","last_change":"2024-04-24T22:59:53.796852+0000","last_active":"2024-04-24T23:00:00.244949+0000","last_peered":"2024-04-24T23:00:00.244949+0000","last_clean":"2024-04-24T23:00:00.244949+0000","last_became_active":"2024-04-24T22:59:53.796053+0000","last_became_peered":"2024-04-24T22:59:53.796053+0000","last_unstale":"2024-04-24T23:00:00.244949+0000","last_undegraded":"2024-04-24T23:00:00.244949+0000","last_fullsized":"2024-04-24T23:00:00.244949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.870817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157682+0000","last_change":"2024-04-24T22:59:59.168702+0000","last_active":"2024-04-24T23:00:00.157682+0000","last_peered":"2024-04-24T23:00:00.157682+0000","last_clean":"2024-04-24T23:00:00.157682+0000","last_became_active":"2024-04-24T22:59:59.168344+0000","last_became_peered":"2024-04-24T22:59:59.168344+0000","last_unstale":"2024-04-24T23:00:00.157682+0000","last_undegraded":"2024-04-24T23:00:00.157682+0000","last_fullsized":"2024-04-24T23:00:00.157682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009609+0000","last_change":"2024-04-24T22:59:54.831524+0000","last_active":"2024-04-24T23:00:01.009609+0000","last_peered":"2024-04-24T23:00:01.009609+0000","last_clean":"2024-04-24T23:00:01.009609+0000","last_became_active":"2024-04-24T22:59:54.831142+0000","last_became_peered":"2024-04-24T22:59:54.831142+0000","last_unstale":"2024-04-24T23:00:01.009609+0000","last_undegraded":"2024-04-24T23:00:01.009609+0000","last_fullsized":"2024-04-24T23:00:01.009609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185674+0000","last_change":"2024-04-24T22:59:53.797494+0000","last_active":"2024-04-24T23:00:01.185674+0000","last_peered":"2024-04-24T23:00:01.185674+0000","last_clean":"2024-04-24T23:00:01.185674+0000","last_became_active":"2024-04-24T22:59:53.796774+0000","last_became_peered":"2024-04-24T22:59:53.796774+0000","last_unstale":"2024-04-24T23:00:01.185674+0000","last_undegraded":"2024-04-24T23:00:01.185674+0000","last_fullsized":"2024-04-24T23:00:01.185674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155573+0000","last_change":"2024-04-24T22:59:59.172300+0000","last_active":"2024-04-24T23:00:00.155573+0000","last_peered":"2024-04-24T23:00:00.155573+0000","last_clean":"2024-04-24T23:00:00.155573+0000","last_became_active":"2024-04-24T22:59:59.171942+0000","last_became_peered":"2024-04-24T22:59:59.171942+0000","last_unstale":"2024-04-24T23:00:00.155573+0000","last_undegraded":"2024-04-24T23:00:00.155573+0000","last_fullsized":"2024-04-24T23:00:00.155573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:16.270363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010273+0000","last_change":"2024-04-24T22:59:54.831365+0000","last_active":"2024-04-24T23:00:01.010273+0000","last_peered":"2024-04-24T23:00:01.010273+0000","last_clean":"2024-04-24T23:00:01.010273+0000","last_became_active":"2024-04-24T22:59:54.830470+0000","last_became_peered":"2024-04-24T22:59:54.830470+0000","last_unstale":"2024-04-24T23:00:01.010273+0000","last_undegraded":"2024-04-24T23:00:01.010273+0000","last_fullsized":"2024-04-24T23:00:01.010273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010410+0000","last_change":"2024-04-24T22:59:53.803366+0000","last_active":"2024-04-24T23:00:01.010410+0000","last_peered":"2024-04-24T23:00:01.010410+0000","last_clean":"2024-04-24T23:00:01.010410+0000","last_became_active":"2024-04-24T22:59:53.802969+0000","last_became_peered":"2024-04-24T22:59:53.802969+0000","last_unstale":"2024-04-24T23:00:01.010410+0000","last_undegraded":"2024-04-24T23:00:01.010410+0000","last_fullsized":"2024-04-24T23:00:01.010410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009016+0000","last_change":"2024-04-24T22:59:59.177853+0000","last_active":"2024-04-24T23:00:01.009016+0000","last_peered":"2024-04-24T23:00:01.009016+0000","last_clean":"2024-04-24T23:00:01.009016+0000","last_became_active":"2024-04-24T22:59:59.177268+0000","last_became_peered":"2024-04-24T22:59:59.177268+0000","last_unstale":"2024-04-24T23:00:01.009016+0000","last_undegraded":"2024-04-24T23:00:01.009016+0000","last_fullsized":"2024-04-24T23:00:01.009016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:44.225608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159891+0000","last_change":"2024-04-24T22:59:54.842312+0000","last_active":"2024-04-24T23:00:00.159891+0000","last_peered":"2024-04-24T23:00:00.159891+0000","last_clean":"2024-04-24T23:00:00.159891+0000","last_became_active":"2024-04-24T22:59:54.842034+0000","last_became_peered":"2024-04-24T22:59:54.842034+0000","last_unstale":"2024-04-24T23:00:00.159891+0000","last_undegraded":"2024-04-24T23:00:00.159891+0000","last_fullsized":"2024-04-24T23:00:00.159891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:56.808348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184853+0000","last_change":"2024-04-24T22:59:53.801680+0000","last_active":"2024-04-24T23:00:01.184853+0000","last_peered":"2024-04-24T23:00:01.184853+0000","last_clean":"2024-04-24T23:00:01.184853+0000","last_became_active":"2024-04-24T22:59:53.801365+0000","last_became_peered":"2024-04-24T22:59:53.801365+0000","last_unstale":"2024-04-24T23:00:01.184853+0000","last_undegraded":"2024-04-24T23:00:01.184853+0000","last_fullsized":"2024-04-24T23:00:01.184853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:29.189206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160460+0000","last_change":"2024-04-24T22:59:59.180894+0000","last_active":"2024-04-24T23:00:00.160460+0000","last_peered":"2024-04-24T23:00:00.160460+0000","last_clean":"2024-04-24T23:00:00.160460+0000","last_became_active":"2024-04-24T22:59:59.177236+0000","last_became_peered":"2024-04-24T22:59:59.177236+0000","last_unstale":"2024-04-24T23:00:00.160460+0000","last_undegraded":"2024-04-24T23:00:00.160460+0000","last_fullsized":"2024-04-24T23:00:00.160460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157352+0000","last_change":"2024-04-24T22:59:54.836662+0000","last_active":"2024-04-24T23:00:00.157352+0000","last_peered":"2024-04-24T23:00:00.157352+0000","last_clean":"2024-04-24T23:00:00.157352+0000","last_became_active":"2024-04-24T22:59:54.835790+0000","last_became_peered":"2024-04-24T22:59:54.835790+0000","last_unstale":"2024-04-24T23:00:00.157352+0000","last_undegraded":"2024-04-24T23:00:00.157352+0000","last_fullsized":"2024-04-24T23:00:00.157352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184827+0000","last_change":"2024-04-24T22:59:53.805218+0000","last_active":"2024-04-24T23:00:01.184827+0000","last_peered":"2024-04-24T23:00:01.184827+0000","last_clean":"2024-04-24T23:00:01.184827+0000","last_became_active":"2024-04-24T22:59:53.803401+0000","last_became_peered":"2024-04-24T22:59:53.803401+0000","last_unstale":"2024-04-24T23:00:01.184827+0000","last_undegraded":"2024-04-24T23:00:01.184827+0000","last_fullsized":"2024-04-24T23:00:01.184827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:56.417305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158402+0000","last_change":"2024-04-24T22:59:59.180784+0000","last_active":"2024-04-24T23:00:00.158402+0000","last_peered":"2024-04-24T23:00:00.158402+0000","last_clean":"2024-04-24T23:00:00.158402+0000","last_became_active":"2024-04-24T22:59:59.180017+0000","last_became_peered":"2024-04-24T22:59:59.180017+0000","last_unstale":"2024-04-24T23:00:00.158402+0000","last_undegraded":"2024-04-24T23:00:00.158402+0000","last_fullsized":"2024-04-24T23:00:00.158402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245322+0000","last_change":"2024-04-24T22:59:54.836197+0000","last_active":"2024-04-24T23:00:00.245322+0000","last_peered":"2024-04-24T23:00:00.245322+0000","last_clean":"2024-04-24T23:00:00.245322+0000","last_became_active":"2024-04-24T22:59:54.835647+0000","last_became_peered":"2024-04-24T22:59:54.835647+0000","last_unstale":"2024-04-24T23:00:00.245322+0000","last_undegraded":"2024-04-24T23:00:00.245322+0000","last_fullsized":"2024-04-24T23:00:00.245322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184333+0000","last_change":"2024-04-24T22:59:53.804121+0000","last_active":"2024-04-24T23:00:01.184333+0000","last_peered":"2024-04-24T23:00:01.184333+0000","last_clean":"2024-04-24T23:00:01.184333+0000","last_became_active":"2024-04-24T22:59:53.803732+0000","last_became_peered":"2024-04-24T22:59:53.803732+0000","last_unstale":"2024-04-24T23:00:01.184333+0000","last_undegraded":"2024-04-24T23:00:01.184333+0000","last_fullsized":"2024-04-24T23:00:01.184333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:55.794648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159307+0000","last_change":"2024-04-24T22:59:59.180854+0000","last_active":"2024-04-24T23:00:00.159307+0000","last_peered":"2024-04-24T23:00:00.159307+0000","last_clean":"2024-04-24T23:00:00.159307+0000","last_became_active":"2024-04-24T22:59:59.179885+0000","last_became_peered":"2024-04-24T22:59:59.179885+0000","last_unstale":"2024-04-24T23:00:00.159307+0000","last_undegraded":"2024-04-24T23:00:00.159307+0000","last_fullsized":"2024-04-24T23:00:00.159307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183892+0000","last_change":"2024-04-24T22:59:54.841245+0000","last_active":"2024-04-24T23:00:01.183892+0000","last_peered":"2024-04-24T23:00:01.183892+0000","last_clean":"2024-04-24T23:00:01.183892+0000","last_became_active":"2024-04-24T22:59:54.840779+0000","last_became_peered":"2024-04-24T22:59:54.840779+0000","last_unstale":"2024-04-24T23:00:01.183892+0000","last_undegraded":"2024-04-24T23:00:01.183892+0000","last_fullsized":"2024-04-24T23:00:01.183892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:21.114664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158462+0000","last_change":"2024-04-24T22:59:53.800686+0000","last_active":"2024-04-24T23:00:00.158462+0000","last_peered":"2024-04-24T23:00:00.158462+0000","last_clean":"2024-04-24T23:00:00.158462+0000","last_became_active":"2024-04-24T22:59:53.799843+0000","last_became_peered":"2024-04-24T22:59:53.799843+0000","last_unstale":"2024-04-24T23:00:00.158462+0000","last_undegraded":"2024-04-24T23:00:00.158462+0000","last_fullsized":"2024-04-24T23:00:00.158462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159857+0000","last_change":"2024-04-24T22:59:59.185850+0000","last_active":"2024-04-24T23:00:00.159857+0000","last_peered":"2024-04-24T23:00:00.159857+0000","last_clean":"2024-04-24T23:00:00.159857+0000","last_became_active":"2024-04-24T22:59:59.181277+0000","last_became_peered":"2024-04-24T22:59:59.181277+0000","last_unstale":"2024-04-24T23:00:00.159857+0000","last_undegraded":"2024-04-24T23:00:00.159857+0000","last_fullsized":"2024-04-24T23:00:00.159857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159354+0000","last_change":"2024-04-24T22:59:54.833216+0000","last_active":"2024-04-24T23:00:00.159354+0000","last_peered":"2024-04-24T23:00:00.159354+0000","last_clean":"2024-04-24T23:00:00.159354+0000","last_became_active":"2024-04-24T22:59:54.832933+0000","last_became_peered":"2024-04-24T22:59:54.832933+0000","last_unstale":"2024-04-24T23:00:00.159354+0000","last_undegraded":"2024-04-24T23:00:00.159354+0000","last_fullsized":"2024-04-24T23:00:00.159354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183544+0000","last_change":"2024-04-24T22:59:53.797462+0000","last_active":"2024-04-24T23:00:01.183544+0000","last_peered":"2024-04-24T23:00:01.183544+0000","last_clean":"2024-04-24T23:00:01.183544+0000","last_became_active":"2024-04-24T22:59:53.797136+0000","last_became_peered":"2024-04-24T22:59:53.797136+0000","last_unstale":"2024-04-24T23:00:01.183544+0000","last_undegraded":"2024-04-24T23:00:01.183544+0000","last_fullsized":"2024-04-24T23:00:01.183544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185371+0000","last_change":"2024-04-24T22:59:59.183061+0000","last_active":"2024-04-24T23:00:01.185371+0000","last_peered":"2024-04-24T23:00:01.185371+0000","last_clean":"2024-04-24T23:00:01.185371+0000","last_became_active":"2024-04-24T22:59:59.182605+0000","last_became_peered":"2024-04-24T22:59:59.182605+0000","last_unstale":"2024-04-24T23:00:01.185371+0000","last_undegraded":"2024-04-24T23:00:01.185371+0000","last_fullsized":"2024-04-24T23:00:01.185371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:52.103486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010031+0000","last_change":"2024-04-24T22:59:54.826763+0000","last_active":"2024-04-24T23:00:01.010031+0000","last_peered":"2024-04-24T23:00:01.010031+0000","last_clean":"2024-04-24T23:00:01.010031+0000","last_became_active":"2024-04-24T22:59:54.826396+0000","last_became_peered":"2024-04-24T22:59:54.826396+0000","last_unstale":"2024-04-24T23:00:01.010031+0000","last_undegraded":"2024-04-24T23:00:01.010031+0000","last_fullsized":"2024-04-24T23:00:01.010031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184139+0000","last_change":"2024-04-24T22:59:53.802569+0000","last_active":"2024-04-24T23:00:01.184139+0000","last_peered":"2024-04-24T23:00:01.184139+0000","last_clean":"2024-04-24T23:00:01.184139+0000","last_became_active":"2024-04-24T22:59:53.801965+0000","last_became_peered":"2024-04-24T22:59:53.801965+0000","last_unstale":"2024-04-24T23:00:01.184139+0000","last_undegraded":"2024-04-24T23:00:01.184139+0000","last_fullsized":"2024-04-24T23:00:01.184139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:09.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336798+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:00:00.336798+0000","last_peered":"2024-04-24T23:00:00.336798+0000","last_clean":"2024-04-24T23:00:00.336798+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:00:00.336798+0000","last_undegraded":"2024-04-24T23:00:00.336798+0000","last_fullsized":"2024-04-24T23:00:00.336798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184761+0000","last_change":"2024-04-24T22:59:59.161211+0000","last_active":"2024-04-24T23:00:01.184761+0000","last_peered":"2024-04-24T23:00:01.184761+0000","last_clean":"2024-04-24T23:00:01.184761+0000","last_became_active":"2024-04-24T22:59:59.160734+0000","last_became_peered":"2024-04-24T22:59:59.160734+0000","last_unstale":"2024-04-24T23:00:01.184761+0000","last_undegraded":"2024-04-24T23:00:01.184761+0000","last_fullsized":"2024-04-24T23:00:01.184761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:36.104485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184606+0000","last_change":"2024-04-24T22:59:54.819610+0000","last_active":"2024-04-24T23:00:01.184606+0000","last_peered":"2024-04-24T23:00:01.184606+0000","last_clean":"2024-04-24T23:00:01.184606+0000","last_became_active":"2024-04-24T22:59:54.819070+0000","last_became_peered":"2024-04-24T22:59:54.819070+0000","last_unstale":"2024-04-24T23:00:01.184606+0000","last_undegraded":"2024-04-24T23:00:01.184606+0000","last_fullsized":"2024-04-24T23:00:01.184606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:53.348359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160124+0000","last_change":"2024-04-24T22:59:53.799389+0000","last_active":"2024-04-24T23:00:00.160124+0000","last_peered":"2024-04-24T23:00:00.160124+0000","last_clean":"2024-04-24T23:00:00.160124+0000","last_became_active":"2024-04-24T22:59:53.799041+0000","last_became_peered":"2024-04-24T22:59:53.799041+0000","last_unstale":"2024-04-24T23:00:00.160124+0000","last_undegraded":"2024-04-24T23:00:00.160124+0000","last_fullsized":"2024-04-24T23:00:00.160124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156106+0000","last_change":"2024-04-24T22:59:59.174885+0000","last_active":"2024-04-24T23:00:00.156106+0000","last_peered":"2024-04-24T23:00:00.156106+0000","last_clean":"2024-04-24T23:00:00.156106+0000","last_became_active":"2024-04-24T22:59:59.174370+0000","last_became_peered":"2024-04-24T22:59:59.174370+0000","last_unstale":"2024-04-24T23:00:00.156106+0000","last_undegraded":"2024-04-24T23:00:00.156106+0000","last_fullsized":"2024-04-24T23:00:00.156106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245921+0000","last_change":"2024-04-24T22:59:54.835634+0000","last_active":"2024-04-24T23:00:00.245921+0000","last_peered":"2024-04-24T23:00:00.245921+0000","last_clean":"2024-04-24T23:00:00.245921+0000","last_became_active":"2024-04-24T22:59:54.833569+0000","last_became_peered":"2024-04-24T22:59:54.833569+0000","last_unstale":"2024-04-24T23:00:00.245921+0000","last_undegraded":"2024-04-24T23:00:00.245921+0000","last_fullsized":"2024-04-24T23:00:00.245921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:29.860749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185367+0000","last_change":"2024-04-24T22:59:53.802150+0000","last_active":"2024-04-24T23:00:01.185367+0000","last_peered":"2024-04-24T23:00:01.185367+0000","last_clean":"2024-04-24T23:00:01.185367+0000","last_became_active":"2024-04-24T22:59:53.799509+0000","last_became_peered":"2024-04-24T22:59:53.799509+0000","last_unstale":"2024-04-24T23:00:01.185367+0000","last_undegraded":"2024-04-24T23:00:01.185367+0000","last_fullsized":"2024-04-24T23:00:01.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:36.050787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184895+0000","last_change":"2024-04-24T22:59:59.177414+0000","last_active":"2024-04-24T23:00:01.184895+0000","last_peered":"2024-04-24T23:00:01.184895+0000","last_clean":"2024-04-24T23:00:01.184895+0000","last_became_active":"2024-04-24T22:59:59.174313+0000","last_became_peered":"2024-04-24T22:59:59.174313+0000","last_unstale":"2024-04-24T23:00:01.184895+0000","last_undegraded":"2024-04-24T23:00:01.184895+0000","last_fullsized":"2024-04-24T23:00:01.184895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:22.796518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245879+0000","last_change":"2024-04-24T22:59:54.823918+0000","last_active":"2024-04-24T23:00:00.245879+0000","last_peered":"2024-04-24T23:00:00.245879+0000","last_clean":"2024-04-24T23:00:00.245879+0000","last_became_active":"2024-04-24T22:59:54.823619+0000","last_became_peered":"2024-04-24T22:59:54.823619+0000","last_unstale":"2024-04-24T23:00:00.245879+0000","last_undegraded":"2024-04-24T23:00:00.245879+0000","last_fullsized":"2024-04-24T23:00:00.245879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009718+0000","last_change":"2024-04-24T22:59:53.802658+0000","last_active":"2024-04-24T23:00:01.009718+0000","last_peered":"2024-04-24T23:00:01.009718+0000","last_clean":"2024-04-24T23:00:01.009718+0000","last_became_active":"2024-04-24T22:59:53.802337+0000","last_became_peered":"2024-04-24T22:59:53.802337+0000","last_unstale":"2024-04-24T23:00:01.009718+0000","last_undegraded":"2024-04-24T23:00:01.009718+0000","last_fullsized":"2024-04-24T23:00:01.009718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183130+0000","last_change":"2024-04-24T22:59:59.158432+0000","last_active":"2024-04-24T23:00:01.183130+0000","last_peered":"2024-04-24T23:00:01.183130+0000","last_clean":"2024-04-24T23:00:01.183130+0000","last_became_active":"2024-04-24T22:59:59.157980+0000","last_became_peered":"2024-04-24T22:59:59.157980+0000","last_unstale":"2024-04-24T23:00:01.183130+0000","last_undegraded":"2024-04-24T23:00:01.183130+0000","last_fullsized":"2024-04-24T23:00:01.183130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:13.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158298+0000","last_change":"2024-04-24T22:59:54.830501+0000","last_active":"2024-04-24T23:00:00.158298+0000","last_peered":"2024-04-24T23:00:00.158298+0000","last_clean":"2024-04-24T23:00:00.158298+0000","last_became_active":"2024-04-24T22:59:54.829827+0000","last_became_peered":"2024-04-24T22:59:54.829827+0000","last_unstale":"2024-04-24T23:00:00.158298+0000","last_undegraded":"2024-04-24T23:00:00.158298+0000","last_fullsized":"2024-04-24T23:00:00.158298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245937+0000","last_change":"2024-04-24T22:59:53.804112+0000","last_active":"2024-04-24T23:00:00.245937+0000","last_peered":"2024-04-24T23:00:00.245937+0000","last_clean":"2024-04-24T23:00:00.245937+0000","last_became_active":"2024-04-24T22:59:53.803737+0000","last_became_peered":"2024-04-24T22:59:53.803737+0000","last_unstale":"2024-04-24T23:00:00.245937+0000","last_undegraded":"2024-04-24T23:00:00.245937+0000","last_fullsized":"2024-04-24T23:00:00.245937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336897+0000","last_change":"2024-04-24T22:59:59.170945+0000","last_active":"2024-04-24T23:00:00.336897+0000","last_peered":"2024-04-24T23:00:00.336897+0000","last_clean":"2024-04-24T23:00:00.336897+0000","last_became_active":"2024-04-24T22:59:59.170564+0000","last_became_peered":"2024-04-24T22:59:59.170564+0000","last_unstale":"2024-04-24T23:00:00.336897+0000","last_undegraded":"2024-04-24T23:00:00.336897+0000","last_fullsized":"2024-04-24T23:00:00.336897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:46.104989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183495+0000","last_change":"2024-04-24T22:59:54.834918+0000","last_active":"2024-04-24T23:00:01.183495+0000","last_peered":"2024-04-24T23:00:01.183495+0000","last_clean":"2024-04-24T23:00:01.183495+0000","last_became_active":"2024-04-24T22:59:54.834596+0000","last_became_peered":"2024-04-24T22:59:54.834596+0000","last_unstale":"2024-04-24T23:00:01.183495+0000","last_undegraded":"2024-04-24T23:00:01.183495+0000","last_fullsized":"2024-04-24T23:00:01.183495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:55.731536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009071+0000","last_change":"2024-04-24T22:59:53.801950+0000","last_active":"2024-04-24T23:00:01.009071+0000","last_peered":"2024-04-24T23:00:01.009071+0000","last_clean":"2024-04-24T23:00:01.009071+0000","last_became_active":"2024-04-24T22:59:53.801646+0000","last_became_peered":"2024-04-24T22:59:53.801646+0000","last_unstale":"2024-04-24T23:00:01.009071+0000","last_undegraded":"2024-04-24T23:00:01.009071+0000","last_fullsized":"2024-04-24T23:00:01.009071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185946+0000","last_change":"2024-04-24T22:59:59.175741+0000","last_active":"2024-04-24T23:00:01.185946+0000","last_peered":"2024-04-24T23:00:01.185946+0000","last_clean":"2024-04-24T23:00:01.185946+0000","last_became_active":"2024-04-24T22:59:59.175281+0000","last_became_peered":"2024-04-24T22:59:59.175281+0000","last_unstale":"2024-04-24T23:00:01.185946+0000","last_undegraded":"2024-04-24T23:00:01.185946+0000","last_fullsized":"2024-04-24T23:00:01.185946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:23:30.733798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336673+0000","last_change":"2024-04-24T22:59:54.846255+0000","last_active":"2024-04-24T23:00:00.336673+0000","last_peered":"2024-04-24T23:00:00.336673+0000","last_clean":"2024-04-24T23:00:00.336673+0000","last_became_active":"2024-04-24T22:59:54.845933+0000","last_became_peered":"2024-04-24T22:59:54.845933+0000","last_unstale":"2024-04-24T23:00:00.336673+0000","last_undegraded":"2024-04-24T23:00:00.336673+0000","last_fullsized":"2024-04-24T23:00:00.336673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245177+0000","last_change":"2024-04-24T22:59:53.807192+0000","last_active":"2024-04-24T23:00:00.245177+0000","last_peered":"2024-04-24T23:00:00.245177+0000","last_clean":"2024-04-24T23:00:00.245177+0000","last_became_active":"2024-04-24T22:59:53.806934+0000","last_became_peered":"2024-04-24T22:59:53.806934+0000","last_unstale":"2024-04-24T23:00:00.245177+0000","last_undegraded":"2024-04-24T23:00:00.245177+0000","last_fullsized":"2024-04-24T23:00:00.245177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185730+0000","last_change":"2024-04-24T22:59:59.183999+0000","last_active":"2024-04-24T23:00:01.185730+0000","last_peered":"2024-04-24T23:00:01.185730+0000","last_clean":"2024-04-24T23:00:01.185730+0000","last_became_active":"2024-04-24T22:59:59.183567+0000","last_became_peered":"2024-04-24T22:59:59.183567+0000","last_unstale":"2024-04-24T23:00:01.185730+0000","last_undegraded":"2024-04-24T23:00:01.185730+0000","last_fullsized":"2024-04-24T23:00:01.185730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:48.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183858+0000","last_change":"2024-04-24T22:59:54.832242+0000","last_active":"2024-04-24T23:00:01.183858+0000","last_peered":"2024-04-24T23:00:01.183858+0000","last_clean":"2024-04-24T23:00:01.183858+0000","last_became_active":"2024-04-24T22:59:54.830703+0000","last_became_peered":"2024-04-24T22:59:54.830703+0000","last_unstale":"2024-04-24T23:00:01.183858+0000","last_undegraded":"2024-04-24T23:00:01.183858+0000","last_fullsized":"2024-04-24T23:00:01.183858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184359+0000","last_change":"2024-04-24T22:59:53.798756+0000","last_active":"2024-04-24T23:00:01.184359+0000","last_peered":"2024-04-24T23:00:01.184359+0000","last_clean":"2024-04-24T23:00:01.184359+0000","last_became_active":"2024-04-24T22:59:53.798399+0000","last_became_peered":"2024-04-24T22:59:53.798399+0000","last_unstale":"2024-04-24T23:00:01.184359+0000","last_undegraded":"2024-04-24T23:00:01.184359+0000","last_fullsized":"2024-04-24T23:00:01.184359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:17.930808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158868+0000","last_change":"2024-04-24T22:59:59.180893+0000","last_active":"2024-04-24T23:00:00.158868+0000","last_peered":"2024-04-24T23:00:00.158868+0000","last_clean":"2024-04-24T23:00:00.158868+0000","last_became_active":"2024-04-24T22:59:59.180250+0000","last_became_peered":"2024-04-24T22:59:59.180250+0000","last_unstale":"2024-04-24T23:00:00.158868+0000","last_undegraded":"2024-04-24T23:00:00.158868+0000","last_fullsized":"2024-04-24T23:00:00.158868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158938+0000","last_change":"2024-04-24T22:59:54.824357+0000","last_active":"2024-04-24T23:00:00.158938+0000","last_peered":"2024-04-24T23:00:00.158938+0000","last_clean":"2024-04-24T23:00:00.158938+0000","last_became_active":"2024-04-24T22:59:54.823831+0000","last_became_peered":"2024-04-24T22:59:54.823831+0000","last_unstale":"2024-04-24T23:00:00.158938+0000","last_undegraded":"2024-04-24T23:00:00.158938+0000","last_fullsized":"2024-04-24T23:00:00.158938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162832+0000","last_change":"2024-04-24T22:59:53.798640+0000","last_active":"2024-04-24T23:00:00.162832+0000","last_peered":"2024-04-24T23:00:00.162832+0000","last_clean":"2024-04-24T23:00:00.162832+0000","last_became_active":"2024-04-24T22:59:53.798298+0000","last_became_peered":"2024-04-24T22:59:53.798298+0000","last_unstale":"2024-04-24T23:00:00.162832+0000","last_undegraded":"2024-04-24T23:00:00.162832+0000","last_fullsized":"2024-04-24T23:00:00.162832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184286+0000","last_change":"2024-04-24T22:59:59.178160+0000","last_active":"2024-04-24T23:00:01.184286+0000","last_peered":"2024-04-24T23:00:01.184286+0000","last_clean":"2024-04-24T23:00:01.184286+0000","last_became_active":"2024-04-24T22:59:59.177275+0000","last_became_peered":"2024-04-24T22:59:59.177275+0000","last_unstale":"2024-04-24T23:00:01.184286+0000","last_undegraded":"2024-04-24T23:00:01.184286+0000","last_fullsized":"2024-04-24T23:00:01.184286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:06.997646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246471+0000","last_change":"2024-04-24T22:59:54.828946+0000","last_active":"2024-04-24T23:00:00.246471+0000","last_peered":"2024-04-24T23:00:00.246471+0000","last_clean":"2024-04-24T23:00:00.246471+0000","last_became_active":"2024-04-24T22:59:54.828694+0000","last_became_peered":"2024-04-24T22:59:54.828694+0000","last_unstale":"2024-04-24T23:00:00.246471+0000","last_undegraded":"2024-04-24T23:00:00.246471+0000","last_fullsized":"2024-04-24T23:00:00.246471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:13.857989+0000","last_change":"2024-04-24T22:59:53.802324+0000","last_active":"2024-04-24T23:00:13.857989+0000","last_peered":"2024-04-24T23:00:13.857989+0000","last_clean":"2024-04-24T23:00:13.857989+0000","last_became_active":"2024-04-24T22:59:53.801956+0000","last_became_peered":"2024-04-24T22:59:53.801956+0000","last_unstale":"2024-04-24T23:00:13.857989+0000","last_undegraded":"2024-04-24T23:00:13.857989+0000","last_fullsized":"2024-04-24T23:00:13.857989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009080+0000","last_change":"2024-04-24T22:59:59.175987+0000","last_active":"2024-04-24T23:00:01.009080+0000","last_peered":"2024-04-24T23:00:01.009080+0000","last_clean":"2024-04-24T23:00:01.009080+0000","last_became_active":"2024-04-24T22:59:59.175539+0000","last_became_peered":"2024-04-24T22:59:59.175539+0000","last_unstale":"2024-04-24T23:00:01.009080+0000","last_undegraded":"2024-04-24T23:00:01.009080+0000","last_fullsized":"2024-04-24T23:00:01.009080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:46.474442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183741+0000","last_change":"2024-04-24T22:59:54.827006+0000","last_active":"2024-04-24T23:00:01.183741+0000","last_peered":"2024-04-24T23:00:01.183741+0000","last_clean":"2024-04-24T23:00:01.183741+0000","last_became_active":"2024-04-24T22:59:54.825162+0000","last_became_peered":"2024-04-24T22:59:54.825162+0000","last_unstale":"2024-04-24T23:00:01.183741+0000","last_undegraded":"2024-04-24T23:00:01.183741+0000","last_fullsized":"2024-04-24T23:00:01.183741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162078+0000","last_change":"2024-04-24T22:59:53.805610+0000","last_active":"2024-04-24T23:00:00.162078+0000","last_peered":"2024-04-24T23:00:00.162078+0000","last_clean":"2024-04-24T23:00:00.162078+0000","last_became_active":"2024-04-24T22:59:53.805286+0000","last_became_peered":"2024-04-24T22:59:53.805286+0000","last_unstale":"2024-04-24T23:00:00.162078+0000","last_undegraded":"2024-04-24T23:00:00.162078+0000","last_fullsized":"2024-04-24T23:00:00.162078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156548+0000","last_change":"2024-04-24T22:59:59.176914+0000","last_active":"2024-04-24T23:00:00.156548+0000","last_peered":"2024-04-24T23:00:00.156548+0000","last_clean":"2024-04-24T23:00:00.156548+0000","last_became_active":"2024-04-24T22:59:59.176522+0000","last_became_peered":"2024-04-24T22:59:59.176522+0000","last_unstale":"2024-04-24T23:00:00.156548+0000","last_undegraded":"2024-04-24T23:00:00.156548+0000","last_fullsized":"2024-04-24T23:00:00.156548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185735+0000","last_change":"2024-04-24T22:59:54.843770+0000","last_active":"2024-04-24T23:00:01.185735+0000","last_peered":"2024-04-24T23:00:01.185735+0000","last_clean":"2024-04-24T23:00:01.185735+0000","last_became_active":"2024-04-24T22:59:54.838700+0000","last_became_peered":"2024-04-24T22:59:54.838700+0000","last_unstale":"2024-04-24T23:00:01.185735+0000","last_undegraded":"2024-04-24T23:00:01.185735+0000","last_fullsized":"2024-04-24T23:00:01.185735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:16.370386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245598+0000","last_change":"2024-04-24T22:59:53.800926+0000","last_active":"2024-04-24T23:00:00.245598+0000","last_peered":"2024-04-24T23:00:00.245598+0000","last_clean":"2024-04-24T23:00:00.245598+0000","last_became_active":"2024-04-24T22:59:53.800666+0000","last_became_peered":"2024-04-24T22:59:53.800666+0000","last_unstale":"2024-04-24T23:00:00.245598+0000","last_undegraded":"2024-04-24T23:00:00.245598+0000","last_fullsized":"2024-04-24T23:00:00.245598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157317+0000","last_change":"2024-04-24T22:59:59.184549+0000","last_active":"2024-04-24T23:00:00.157317+0000","last_peered":"2024-04-24T23:00:00.157317+0000","last_clean":"2024-04-24T23:00:00.157317+0000","last_became_active":"2024-04-24T22:59:59.184095+0000","last_became_peered":"2024-04-24T22:59:59.184095+0000","last_unstale":"2024-04-24T23:00:00.157317+0000","last_undegraded":"2024-04-24T23:00:00.157317+0000","last_fullsized":"2024-04-24T23:00:00.157317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:45.603508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158054+0000","last_change":"2024-04-24T22:59:54.840299+0000","last_active":"2024-04-24T23:00:00.158054+0000","last_peered":"2024-04-24T23:00:00.158054+0000","last_clean":"2024-04-24T23:00:00.158054+0000","last_became_active":"2024-04-24T22:59:54.839835+0000","last_became_peered":"2024-04-24T22:59:54.839835+0000","last_unstale":"2024-04-24T23:00:00.158054+0000","last_undegraded":"2024-04-24T23:00:00.158054+0000","last_fullsized":"2024-04-24T23:00:00.158054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.338011+0000","last_change":"2024-04-24T22:59:53.802398+0000","last_active":"2024-04-24T23:00:00.338011+0000","last_peered":"2024-04-24T23:00:00.338011+0000","last_clean":"2024-04-24T23:00:00.338011+0000","last_became_active":"2024-04-24T22:59:53.802067+0000","last_became_peered":"2024-04-24T22:59:53.802067+0000","last_unstale":"2024-04-24T23:00:00.338011+0000","last_undegraded":"2024-04-24T23:00:00.338011+0000","last_fullsized":"2024-04-24T23:00:00.338011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009830+0000","last_change":"2024-04-24T22:59:59.167854+0000","last_active":"2024-04-24T23:00:01.009830+0000","last_peered":"2024-04-24T23:00:01.009830+0000","last_clean":"2024-04-24T23:00:01.009830+0000","last_became_active":"2024-04-24T22:59:59.167352+0000","last_became_peered":"2024-04-24T22:59:59.167352+0000","last_unstale":"2024-04-24T23:00:01.009830+0000","last_undegraded":"2024-04-24T23:00:01.009830+0000","last_fullsized":"2024-04-24T23:00:01.009830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:10.083772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009441+0000","last_change":"2024-04-24T22:59:59.177020+0000","last_active":"2024-04-24T23:00:01.009441+0000","last_peered":"2024-04-24T23:00:01.009441+0000","last_clean":"2024-04-24T23:00:01.009441+0000","last_became_active":"2024-04-24T22:59:59.176501+0000","last_became_peered":"2024-04-24T22:59:59.176501+0000","last_unstale":"2024-04-24T23:00:01.009441+0000","last_undegraded":"2024-04-24T23:00:01.009441+0000","last_fullsized":"2024-04-24T23:00:01.009441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:00.091139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009043+0000","last_change":"2024-04-24T22:59:54.808811+0000","last_active":"2024-04-24T23:00:01.009043+0000","last_peered":"2024-04-24T23:00:01.009043+0000","last_clean":"2024-04-24T23:00:01.009043+0000","last_became_active":"2024-04-24T22:59:54.807983+0000","last_became_peered":"2024-04-24T22:59:54.807983+0000","last_unstale":"2024-04-24T23:00:01.009043+0000","last_undegraded":"2024-04-24T23:00:01.009043+0000","last_fullsized":"2024-04-24T23:00:01.009043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:31.328568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183452+0000","last_change":"2024-04-24T22:59:53.795814+0000","last_active":"2024-04-24T23:00:01.183452+0000","last_peered":"2024-04-24T23:00:01.183452+0000","last_clean":"2024-04-24T23:00:01.183452+0000","last_became_active":"2024-04-24T22:59:53.795530+0000","last_became_peered":"2024-04-24T22:59:53.795530+0000","last_unstale":"2024-04-24T23:00:01.183452+0000","last_undegraded":"2024-04-24T23:00:01.183452+0000","last_fullsized":"2024-04-24T23:00:01.183452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185190+0000","last_change":"2024-04-24T22:59:59.178038+0000","last_active":"2024-04-24T23:00:01.185190+0000","last_peered":"2024-04-24T23:00:01.185190+0000","last_clean":"2024-04-24T23:00:01.185190+0000","last_became_active":"2024-04-24T22:59:59.177590+0000","last_became_peered":"2024-04-24T22:59:59.177590+0000","last_unstale":"2024-04-24T23:00:01.185190+0000","last_undegraded":"2024-04-24T23:00:01.185190+0000","last_fullsized":"2024-04-24T23:00:01.185190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:33.544037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184156+0000","last_change":"2024-04-24T22:59:54.835646+0000","last_active":"2024-04-24T23:00:01.184156+0000","last_peered":"2024-04-24T23:00:01.184156+0000","last_clean":"2024-04-24T23:00:01.184156+0000","last_became_active":"2024-04-24T22:59:54.835384+0000","last_became_peered":"2024-04-24T22:59:54.835384+0000","last_unstale":"2024-04-24T23:00:01.184156+0000","last_undegraded":"2024-04-24T23:00:01.184156+0000","last_fullsized":"2024-04-24T23:00:01.184156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:29.063136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159519+0000","last_change":"2024-04-24T22:59:53.798938+0000","last_active":"2024-04-24T23:00:00.159519+0000","last_peered":"2024-04-24T23:00:00.159519+0000","last_clean":"2024-04-24T23:00:00.159519+0000","last_became_active":"2024-04-24T22:59:53.798646+0000","last_became_peered":"2024-04-24T22:59:53.798646+0000","last_unstale":"2024-04-24T23:00:00.159519+0000","last_undegraded":"2024-04-24T23:00:00.159519+0000","last_fullsized":"2024-04-24T23:00:00.159519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184247+0000","last_change":"2024-04-24T22:59:53.797818+0000","last_active":"2024-04-24T23:00:01.184247+0000","last_peered":"2024-04-24T23:00:01.184247+0000","last_clean":"2024-04-24T23:00:01.184247+0000","last_became_active":"2024-04-24T22:59:53.796837+0000","last_became_peered":"2024-04-24T22:59:53.796837+0000","last_unstale":"2024-04-24T23:00:01.184247+0000","last_undegraded":"2024-04-24T23:00:01.184247+0000","last_fullsized":"2024-04-24T23:00:01.184247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:40.731687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009363+0000","last_change":"2024-04-24T22:59:54.827809+0000","last_active":"2024-04-24T23:00:01.009363+0000","last_peered":"2024-04-24T23:00:01.009363+0000","last_clean":"2024-04-24T23:00:01.009363+0000","last_became_active":"2024-04-24T22:59:54.827260+0000","last_became_peered":"2024-04-24T22:59:54.827260+0000","last_unstale":"2024-04-24T23:00:01.009363+0000","last_undegraded":"2024-04-24T23:00:01.009363+0000","last_fullsized":"2024-04-24T23:00:01.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:16.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009993+0000","last_change":"2024-04-24T22:59:59.178920+0000","last_active":"2024-04-24T23:00:01.009993+0000","last_peered":"2024-04-24T23:00:01.009993+0000","last_clean":"2024-04-24T23:00:01.009993+0000","last_became_active":"2024-04-24T22:59:59.178525+0000","last_became_peered":"2024-04-24T22:59:59.178525+0000","last_unstale":"2024-04-24T23:00:01.009993+0000","last_undegraded":"2024-04-24T23:00:01.009993+0000","last_fullsized":"2024-04-24T23:00:01.009993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184831+0000","last_change":"2024-04-24T22:59:53.803387+0000","last_active":"2024-04-24T23:00:01.184831+0000","last_peered":"2024-04-24T23:00:01.184831+0000","last_clean":"2024-04-24T23:00:01.184831+0000","last_became_active":"2024-04-24T22:59:53.802947+0000","last_became_peered":"2024-04-24T22:59:53.802947+0000","last_unstale":"2024-04-24T23:00:01.184831+0000","last_undegraded":"2024-04-24T23:00:01.184831+0000","last_fullsized":"2024-04-24T23:00:01.184831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:03.901704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337215+0000","last_change":"2024-04-24T22:59:54.846364+0000","last_active":"2024-04-24T23:00:00.337215+0000","last_peered":"2024-04-24T23:00:00.337215+0000","last_clean":"2024-04-24T23:00:00.337215+0000","last_became_active":"2024-04-24T22:59:54.846003+0000","last_became_peered":"2024-04-24T22:59:54.846003+0000","last_unstale":"2024-04-24T23:00:00.337215+0000","last_undegraded":"2024-04-24T23:00:00.337215+0000","last_fullsized":"2024-04-24T23:00:00.337215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.161971+0000","last_change":"2024-04-24T22:59:59.184791+0000","last_active":"2024-04-24T23:00:00.161971+0000","last_peered":"2024-04-24T23:00:00.161971+0000","last_clean":"2024-04-24T23:00:00.161971+0000","last_became_active":"2024-04-24T22:59:59.184116+0000","last_became_peered":"2024-04-24T22:59:59.184116+0000","last_unstale":"2024-04-24T23:00:00.161971+0000","last_undegraded":"2024-04-24T23:00:00.161971+0000","last_fullsized":"2024-04-24T23:00:00.161971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:35.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155812+0000","last_change":"2024-04-24T22:59:54.827064+0000","last_active":"2024-04-24T23:00:00.155812+0000","last_peered":"2024-04-24T23:00:00.155812+0000","last_clean":"2024-04-24T23:00:00.155812+0000","last_became_active":"2024-04-24T22:59:54.826759+0000","last_became_peered":"2024-04-24T22:59:54.826759+0000","last_unstale":"2024-04-24T23:00:00.155812+0000","last_undegraded":"2024-04-24T23:00:00.155812+0000","last_fullsized":"2024-04-24T23:00:00.155812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158202+0000","last_change":"2024-04-24T22:59:54.830406+0000","last_active":"2024-04-24T23:00:00.158202+0000","last_peered":"2024-04-24T23:00:00.158202+0000","last_clean":"2024-04-24T23:00:00.158202+0000","last_became_active":"2024-04-24T22:59:54.830092+0000","last_became_peered":"2024-04-24T22:59:54.830092+0000","last_unstale":"2024-04-24T23:00:00.158202+0000","last_undegraded":"2024-04-24T23:00:00.158202+0000","last_fullsized":"2024-04-24T23:00:00.158202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184023+0000","last_change":"2024-04-24T22:59:54.842436+0000","last_active":"2024-04-24T23:00:01.184023+0000","last_peered":"2024-04-24T23:00:01.184023+0000","last_clean":"2024-04-24T23:00:01.184023+0000","last_became_active":"2024-04-24T22:59:54.842135+0000","last_became_peered":"2024-04-24T22:59:54.842135+0000","last_unstale":"2024-04-24T23:00:01.184023+0000","last_undegraded":"2024-04-24T23:00:01.184023+0000","last_fullsized":"2024-04-24T23:00:01.184023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:04.584734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184555+0000","last_change":"2024-04-24T22:59:54.845478+0000","last_active":"2024-04-24T23:00:01.184555+0000","last_peered":"2024-04-24T23:00:01.184555+0000","last_clean":"2024-04-24T23:00:01.184555+0000","last_became_active":"2024-04-24T22:59:54.845154+0000","last_became_peered":"2024-04-24T22:59:54.845154+0000","last_unstale":"2024-04-24T23:00:01.184555+0000","last_undegraded":"2024-04-24T23:00:01.184555+0000","last_fullsized":"2024-04-24T23:00:01.184555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.211633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159644+0000","last_change":"2024-04-24T22:59:54.833101+0000","last_active":"2024-04-24T23:00:00.159644+0000","last_peered":"2024-04-24T23:00:00.159644+0000","last_clean":"2024-04-24T23:00:00.159644+0000","last_became_active":"2024-04-24T22:59:54.832808+0000","last_became_peered":"2024-04-24T22:59:54.832808+0000","last_unstale":"2024-04-24T23:00:00.159644+0000","last_undegraded":"2024-04-24T23:00:00.159644+0000","last_fullsized":"2024-04-24T23:00:00.159644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:18.944507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160607+0000","last_change":"2024-04-24T22:59:54.832279+0000","last_active":"2024-04-24T23:00:00.160607+0000","last_peered":"2024-04-24T23:00:00.160607+0000","last_clean":"2024-04-24T23:00:00.160607+0000","last_became_active":"2024-04-24T22:59:54.831479+0000","last_became_peered":"2024-04-24T22:59:54.831479+0000","last_unstale":"2024-04-24T23:00:00.160607+0000","last_undegraded":"2024-04-24T23:00:00.160607+0000","last_fullsized":"2024-04-24T23:00:00.160607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:41.243906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157820+0000","last_change":"2024-04-24T22:59:54.841252+0000","last_active":"2024-04-24T23:00:00.157820+0000","last_peered":"2024-04-24T23:00:00.157820+0000","last_clean":"2024-04-24T23:00:00.157820+0000","last_became_active":"2024-04-24T22:59:54.840960+0000","last_became_peered":"2024-04-24T22:59:54.840960+0000","last_unstale":"2024-04-24T23:00:00.157820+0000","last_undegraded":"2024-04-24T23:00:00.157820+0000","last_fullsized":"2024-04-24T23:00:00.157820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185364+0000","last_change":"2024-04-24T22:59:54.844485+0000","last_active":"2024-04-24T23:00:01.185364+0000","last_peered":"2024-04-24T23:00:01.185364+0000","last_clean":"2024-04-24T23:00:01.185364+0000","last_became_active":"2024-04-24T22:59:54.844149+0000","last_became_peered":"2024-04-24T22:59:54.844149+0000","last_unstale":"2024-04-24T23:00:01.185364+0000","last_undegraded":"2024-04-24T23:00:01.185364+0000","last_fullsized":"2024-04-24T23:00:01.185364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:05.971282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183253+0000","last_change":"2024-04-24T22:59:54.843547+0000","last_active":"2024-04-24T23:00:01.183253+0000","last_peered":"2024-04-24T23:00:01.183253+0000","last_clean":"2024-04-24T23:00:01.183253+0000","last_became_active":"2024-04-24T22:59:54.842984+0000","last_became_peered":"2024-04-24T22:59:54.842984+0000","last_unstale":"2024-04-24T23:00:01.183253+0000","last_undegraded":"2024-04-24T23:00:01.183253+0000","last_fullsized":"2024-04-24T23:00:01.183253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184055+0000","last_change":"2024-04-24T22:59:54.848279+0000","last_active":"2024-04-24T23:00:01.184055+0000","last_peered":"2024-04-24T23:00:01.184055+0000","last_clean":"2024-04-24T23:00:01.184055+0000","last_became_active":"2024-04-24T22:59:54.847833+0000","last_became_peered":"2024-04-24T22:59:54.847833+0000","last_unstale":"2024-04-24T23:00:01.184055+0000","last_undegraded":"2024-04-24T23:00:01.184055+0000","last_fullsized":"2024-04-24T23:00:01.184055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:10.672755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336955+0000","last_change":"2024-04-24T22:59:54.821637+0000","last_active":"2024-04-24T23:00:00.336955+0000","last_peered":"2024-04-24T23:00:00.336955+0000","last_clean":"2024-04-24T23:00:00.336955+0000","last_became_active":"2024-04-24T22:59:54.819868+0000","last_became_peered":"2024-04-24T22:59:54.819868+0000","last_unstale":"2024-04-24T23:00:00.336955+0000","last_undegraded":"2024-04-24T23:00:00.336955+0000","last_fullsized":"2024-04-24T23:00:00.336955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.860484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009044+0000","last_change":"2024-04-24T22:59:54.839683+0000","last_active":"2024-04-24T23:00:01.009044+0000","last_peered":"2024-04-24T23:00:01.009044+0000","last_clean":"2024-04-24T23:00:01.009044+0000","last_became_active":"2024-04-24T22:59:54.834098+0000","last_became_peered":"2024-04-24T22:59:54.834098+0000","last_unstale":"2024-04-24T23:00:01.009044+0000","last_undegraded":"2024-04-24T23:00:01.009044+0000","last_fullsized":"2024-04-24T23:00:01.009044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:58.717221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245911+0000","last_change":"2024-04-24T22:59:54.832261+0000","last_active":"2024-04-24T23:00:00.245911+0000","last_peered":"2024-04-24T23:00:00.245911+0000","last_clean":"2024-04-24T23:00:00.245911+0000","last_became_active":"2024-04-24T22:59:54.831321+0000","last_became_peered":"2024-04-24T22:59:54.831321+0000","last_unstale":"2024-04-24T23:00:00.245911+0000","last_undegraded":"2024-04-24T23:00:00.245911+0000","last_fullsized":"2024-04-24T23:00:00.245911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:12.911957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184771+0000","last_change":"2024-04-24T22:59:54.819368+0000","last_active":"2024-04-24T23:00:01.184771+0000","last_peered":"2024-04-24T23:00:01.184771+0000","last_clean":"2024-04-24T23:00:01.184771+0000","last_became_active":"2024-04-24T22:59:54.818749+0000","last_became_peered":"2024-04-24T22:59:54.818749+0000","last_unstale":"2024-04-24T23:00:01.184771+0000","last_undegraded":"2024-04-24T23:00:01.184771+0000","last_fullsized":"2024-04-24T23:00:01.184771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:14.960710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162580+0000","last_change":"2024-04-24T22:59:54.834877+0000","last_active":"2024-04-24T23:00:00.162580+0000","last_peered":"2024-04-24T23:00:00.162580+0000","last_clean":"2024-04-24T23:00:00.162580+0000","last_became_active":"2024-04-24T22:59:54.833131+0000","last_became_peered":"2024-04-24T22:59:54.833131+0000","last_unstale":"2024-04-24T23:00:00.162580+0000","last_undegraded":"2024-04-24T23:00:00.162580+0000","last_fullsized":"2024-04-24T23:00:00.162580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185603+0000","last_change":"2024-04-24T22:59:54.826869+0000","last_active":"2024-04-24T23:00:01.185603+0000","last_peered":"2024-04-24T23:00:01.185603+0000","last_clean":"2024-04-24T23:00:01.185603+0000","last_became_active":"2024-04-24T22:59:54.826268+0000","last_became_peered":"2024-04-24T22:59:54.826268+0000","last_unstale":"2024-04-24T23:00:01.185603+0000","last_undegraded":"2024-04-24T23:00:01.185603+0000","last_fullsized":"2024-04-24T23:00:01.185603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:22.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183254+0000","last_change":"2024-04-24T22:59:54.829640+0000","last_active":"2024-04-24T23:00:01.183254+0000","last_peered":"2024-04-24T23:00:01.183254+0000","last_clean":"2024-04-24T23:00:01.183254+0000","last_became_active":"2024-04-24T22:59:54.829295+0000","last_became_peered":"2024-04-24T22:59:54.829295+0000","last_unstale":"2024-04-24T23:00:01.183254+0000","last_undegraded":"2024-04-24T23:00:01.183254+0000","last_fullsized":"2024-04-24T23:00:01.183254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183689+0000","last_change":"2024-04-24T22:59:54.845490+0000","last_active":"2024-04-24T23:00:01.183689+0000","last_peered":"2024-04-24T23:00:01.183689+0000","last_clean":"2024-04-24T23:00:01.183689+0000","last_became_active":"2024-04-24T22:59:54.842390+0000","last_became_peered":"2024-04-24T22:59:54.842390+0000","last_unstale":"2024-04-24T23:00:01.183689+0000","last_undegraded":"2024-04-24T23:00:01.183689+0000","last_fullsized":"2024-04-24T23:00:01.183689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:25.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158717+0000","last_change":"2024-04-24T22:59:54.837049+0000","last_active":"2024-04-24T23:00:00.158717+0000","last_peered":"2024-04-24T23:00:00.158717+0000","last_clean":"2024-04-24T23:00:00.158717+0000","last_became_active":"2024-04-24T22:59:54.836650+0000","last_became_peered":"2024-04-24T22:59:54.836650+0000","last_unstale":"2024-04-24T23:00:00.158717+0000","last_undegraded":"2024-04-24T23:00:00.158717+0000","last_fullsized":"2024-04-24T23:00:00.158717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160882+0000","last_change":"2024-04-24T22:59:54.823987+0000","last_active":"2024-04-24T23:00:00.160882+0000","last_peered":"2024-04-24T23:00:00.160882+0000","last_clean":"2024-04-24T23:00:00.160882+0000","last_became_active":"2024-04-24T22:59:54.823738+0000","last_became_peered":"2024-04-24T22:59:54.823738+0000","last_unstale":"2024-04-24T23:00:00.160882+0000","last_undegraded":"2024-04-24T23:00:00.160882+0000","last_fullsized":"2024-04-24T23:00:00.160882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245783+0000","last_change":"2024-04-24T22:59:54.828844+0000","last_active":"2024-04-24T23:00:00.245783+0000","last_peered":"2024-04-24T23:00:00.245783+0000","last_clean":"2024-04-24T23:00:00.245783+0000","last_became_active":"2024-04-24T22:59:54.827890+0000","last_became_peered":"2024-04-24T22:59:54.827890+0000","last_unstale":"2024-04-24T23:00:00.245783+0000","last_undegraded":"2024-04-24T23:00:00.245783+0000","last_fullsized":"2024-04-24T23:00:00.245783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:11.910761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246404+0000","last_change":"2024-04-24T22:59:54.841028+0000","last_active":"2024-04-24T23:00:00.246404+0000","last_peered":"2024-04-24T23:00:00.246404+0000","last_clean":"2024-04-24T23:00:00.246404+0000","last_became_active":"2024-04-24T22:59:54.839890+0000","last_became_peered":"2024-04-24T22:59:54.839890+0000","last_unstale":"2024-04-24T23:00:00.246404+0000","last_undegraded":"2024-04-24T23:00:00.246404+0000","last_fullsized":"2024-04-24T23:00:00.246404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:55.257739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245594+0000","last_change":"2024-04-24T22:59:54.834999+0000","last_active":"2024-04-24T23:00:00.245594+0000","last_peered":"2024-04-24T23:00:00.245594+0000","last_clean":"2024-04-24T23:00:00.245594+0000","last_became_active":"2024-04-24T22:59:54.834737+0000","last_became_peered":"2024-04-24T22:59:54.834737+0000","last_unstale":"2024-04-24T23:00:00.245594+0000","last_undegraded":"2024-04-24T23:00:00.245594+0000","last_fullsized":"2024-04-24T23:00:00.245594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337929+0000","last_change":"2024-04-24T22:59:54.825114+0000","last_active":"2024-04-24T23:00:00.337929+0000","last_peered":"2024-04-24T23:00:00.337929+0000","last_clean":"2024-04-24T23:00:00.337929+0000","last_became_active":"2024-04-24T22:59:54.824804+0000","last_became_peered":"2024-04-24T22:59:54.824804+0000","last_unstale":"2024-04-24T23:00:00.337929+0000","last_undegraded":"2024-04-24T23:00:00.337929+0000","last_fullsized":"2024-04-24T23:00:00.337929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183824+0000","last_change":"2024-04-24T22:59:54.841039+0000","last_active":"2024-04-24T23:00:01.183824+0000","last_peered":"2024-04-24T23:00:01.183824+0000","last_clean":"2024-04-24T23:00:01.183824+0000","last_became_active":"2024-04-24T22:59:54.840480+0000","last_became_peered":"2024-04-24T22:59:54.840480+0000","last_unstale":"2024-04-24T23:00:01.183824+0000","last_undegraded":"2024-04-24T23:00:01.183824+0000","last_fullsized":"2024-04-24T23:00:01.183824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:56.253783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245118+0000","last_change":"2024-04-24T22:59:54.829835+0000","last_active":"2024-04-24T23:00:00.245118+0000","last_peered":"2024-04-24T23:00:00.245118+0000","last_clean":"2024-04-24T23:00:00.245118+0000","last_became_active":"2024-04-24T22:59:54.829572+0000","last_became_peered":"2024-04-24T22:59:54.829572+0000","last_unstale":"2024-04-24T23:00:00.245118+0000","last_undegraded":"2024-04-24T23:00:00.245118+0000","last_fullsized":"2024-04-24T23:00:00.245118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156074+0000","last_change":"2024-04-24T22:59:54.831968+0000","last_active":"2024-04-24T23:00:00.156074+0000","last_peered":"2024-04-24T23:00:00.156074+0000","last_clean":"2024-04-24T23:00:00.156074+0000","last_became_active":"2024-04-24T22:59:54.831606+0000","last_became_peered":"2024-04-24T22:59:54.831606+0000","last_unstale":"2024-04-24T23:00:00.156074+0000","last_undegraded":"2024-04-24T23:00:00.156074+0000","last_fullsized":"2024-04-24T23:00:00.156074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245463+0000","last_change":"2024-04-24T22:59:54.848714+0000","last_active":"2024-04-24T23:00:00.245463+0000","last_peered":"2024-04-24T23:00:00.245463+0000","last_clean":"2024-04-24T23:00:00.245463+0000","last_became_active":"2024-04-24T22:59:54.848325+0000","last_became_peered":"2024-04-24T22:59:54.848325+0000","last_unstale":"2024-04-24T23:00:00.245463+0000","last_undegraded":"2024-04-24T23:00:00.245463+0000","last_fullsized":"2024-04-24T23:00:00.245463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156975+0000","last_change":"2024-04-24T22:59:54.836067+0000","last_active":"2024-04-24T23:00:00.156975+0000","last_peered":"2024-04-24T23:00:00.156975+0000","last_clean":"2024-04-24T23:00:00.156975+0000","last_became_active":"2024-04-24T22:59:54.830678+0000","last_became_peered":"2024-04-24T22:59:54.830678+0000","last_unstale":"2024-04-24T23:00:00.156975+0000","last_undegraded":"2024-04-24T23:00:00.156975+0000","last_fullsized":"2024-04-24T23:00:00.156975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185093+0000","last_change":"2024-04-24T22:59:54.846617+0000","last_active":"2024-04-24T23:00:01.185093+0000","last_peered":"2024-04-24T23:00:01.185093+0000","last_clean":"2024-04-24T23:00:01.185093+0000","last_became_active":"2024-04-24T22:59:54.844346+0000","last_became_peered":"2024-04-24T22:59:54.844346+0000","last_unstale":"2024-04-24T23:00:01.185093+0000","last_undegraded":"2024-04-24T23:00:01.185093+0000","last_fullsized":"2024-04-24T23:00:01.185093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:47.647894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185538+0000","last_change":"2024-04-24T22:59:54.840915+0000","last_active":"2024-04-24T23:00:01.185538+0000","last_peered":"2024-04-24T23:00:01.185538+0000","last_clean":"2024-04-24T23:00:01.185538+0000","last_became_active":"2024-04-24T22:59:54.840307+0000","last_became_peered":"2024-04-24T22:59:54.840307+0000","last_unstale":"2024-04-24T23:00:01.185538+0000","last_undegraded":"2024-04-24T23:00:01.185538+0000","last_fullsized":"2024-04-24T23:00:01.185538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:25.146607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245791+0000","last_change":"2024-04-24T22:59:54.839361+0000","last_active":"2024-04-24T23:00:00.245791+0000","last_peered":"2024-04-24T23:00:00.245791+0000","last_clean":"2024-04-24T23:00:00.245791+0000","last_became_active":"2024-04-24T22:59:54.838975+0000","last_became_peered":"2024-04-24T22:59:54.838975+0000","last_unstale":"2024-04-24T23:00:00.245791+0000","last_undegraded":"2024-04-24T23:00:00.245791+0000","last_fullsized":"2024-04-24T23:00:00.245791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:25.192 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:00:25.192 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T23:00:25.192 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T23:00:25.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T23:00:25.193 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T23:00:25.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.435+0000 7f1b07c00640 1 Processor -- start 2024-04-24T23:00:25.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.435+0000 7f1b07c00640 1 -- start start 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1b07c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1b00158590 0x7f1b00162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1b07c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1b00071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1b07c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b00162990 con 0x7f1b000715f0 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1b07c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1b00158970 con 0x7f1b00158590 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1b07c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b00070c10 con 0x7f1b000d03a0 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1af7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b000715f0 0x7f1b000cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47358/0 (socket says 172.21.15.146:47358) 2024-04-24T23:00:25.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.437+0000 7f1af7e00640 1 -- 172.21.15.146:0/970913561 learned_addr learned my addr 172.21.15.146:0/970913561 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1b05200640 1 --2- 172.21.15.146:0/970913561 >> v2:172.21.15.203:3300/0 conn(0x7f1b00158590 0x7f1b00162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1b05c00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1b00071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111923214 0 0) 0x7f1ae8001110 con 0x7f1b000715f0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ae4003520 con 0x7f1b000715f0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 962612867 0 0) 0x7f1ae4003520 con 0x7f1b000715f0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 msgr2=0x7f1b00071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1b00071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 >> v2:172.21.15.203:3300/0 conn(0x7f1b00158590 msgr2=0x7f1b00162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 --2- 172.21.15.146:0/970913561 >> v2:172.21.15.203:3300/0 conn(0x7f1b00158590 0x7f1b00162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b00070ef0 con 0x7f1b000715f0 2024-04-24T23:00:25.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1ae8001840 con 0x7f1b000715f0 2024-04-24T23:00:25.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 >> v1:172.21.15.146:6789/0 conn(0x7f1b000715f0 legacy=0x7f1b000cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ae40039b0 0x7f1ae4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1ae4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1ae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00158970 con 0x7f1ae4004800 2024-04-24T23:00:25.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00070c10 con 0x7f1ae40039b0 2024-04-24T23:00:25.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.438+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae400b9f0 con 0x7f1b000d03a0 2024-04-24T23:00:25.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1ae4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1b05200640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ae40039b0 0x7f1ae4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1b05c00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1ae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 -- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 msgr2=0x7f1ae40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b000d03a0 0x7f1ae40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 -- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ae40039b0 msgr2=0x7f1ae4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ae40039b0 0x7f1ae4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.439+0000 7f1af7e00640 1 -- 172.21.15.146:0/970913561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae4003520 con 0x7f1ae4004800 2024-04-24T23:00:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.440+0000 7f1af7e00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1ae4004c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c3e0 tx=0x7f1ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea71138da1b8692 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.440+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8032020 con 0x7f1ae4004800 2024-04-24T23:00:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.440+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae8005af0 con 0x7f1ae4004800 2024-04-24T23:00:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.440+0000 7f1affe00640 1 -- 172.21.15.146:0/970913561 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800c0e0 con 0x7f1ae4004800 2024-04-24T23:00:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 -- 172.21.15.146:0/970913561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 msgr2=0x7f1ae4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 --2- 172.21.15.146:0/970913561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1ae4004c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c3e0 tx=0x7f1ae4005830 comp rx=0 tx=0).stop 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b05c00640 1 -- 172.21.15.146:0/970913561 reap_dead start 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 -- 172.21.15.146:0/970913561 shutdown_connections 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 -- 172.21.15.146:0/970913561 >> 172.21.15.146:0/970913561 conn(0x7f1b0006b320 msgr2=0x7f1b0006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 -- 172.21.15.146:0/970913561 shutdown_connections 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.441+0000 7f1b07c00640 1 -- 172.21.15.146:0/970913561 wait complete. 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.443+0000 7f1b07c00640 1 Processor -- start 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.443+0000 7f1b07c00640 1 -- start start 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 0x7f1b001f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 0x7f1b001f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00161f30 con 0x7f1ae4004800 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00161c50 con 0x7f1b0015c040 2024-04-24T23:00:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b07c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b00071a70 con 0x7f1b0015c4a0 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b05200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b05200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34292/0 (socket says 172.21.15.146:34292) 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.444+0000 7f1b05200640 1 -- 172.21.15.146:0/702928791 learned_addr learned my addr 172.21.15.146:0/702928791 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1af7e00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 0x7f1b001f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 0x7f1b001f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 -- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 msgr2=0x7f1b001f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 0x7f1b001f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 -- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 msgr2=0x7f1b001f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 0x7f1b001f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 -- 172.21.15.146:0/702928791 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b001f7e00 con 0x7f1ae4004800 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1af7e00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 0x7f1b001f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 0x7f1b001f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b05200640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1af0011600 tx=0x7f1af0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af000f920 con 0x7f1ae4004800 2024-04-24T23:00:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af000fac0 con 0x7f1ae4004800 2024-04-24T23:00:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af000fe70 con 0x7f1ae4004800 2024-04-24T23:00:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.445+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0015e730 con 0x7f1ae4004800 2024-04-24T23:00:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.446+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0015ecf0 con 0x7f1ae4004800 2024-04-24T23:00:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.447+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b00068190 con 0x7f1ae4004800 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.448+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1af0015460 con 0x7f1ae4004800 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.449+0000 7f1afd600640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 0x7f1adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.449+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1af008bb30 con 0x7f1ae4004800 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.449+0000 7f1af7e00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 0x7f1adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.450+0000 7f1af7e00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 0x7f1adc06e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8033000 tx=0x7f1ae8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.453+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1af0019030 con 0x7f1ae4004800 2024-04-24T23:00:25.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.691+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1b00073ee0 con 0x7f1ae4004800 2024-04-24T23:00:25.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.700+0000 7f1afd600640 1 -- 172.21.15.146:0/702928791 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172943 (secure 0 0 0) 0x7f1af005a1a0 con 0x7f1ae4004800 2024-04-24T23:00:25.704 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 msgr2=0x7f1adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 0x7f1adc06e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8033000 tx=0x7f1ae8009030 comp rx=0 tx=0).stop 2024-04-24T23:00:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 msgr2=0x7f1b0015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1af0011600 tx=0x7f1af0011ac0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 shutdown_connections 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1adc06be30 0x7f1adc06e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b0015c4a0 0x7f1b001f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b0015c040 0x7f1b001f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 --2- 172.21.15.146:0/702928791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4004800 0x7f1b0015a690 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 >> 172.21.15.146:0/702928791 conn(0x7f1b0006b320 msgr2=0x7f1b00160900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 shutdown_connections 2024-04-24T23:00:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.704+0000 7f1b07c00640 1 -- 172.21.15.146:0/702928791 wait complete. 2024-04-24T23:00:25.723 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2371625945},{"type":"v1","addr":"172.21.15.203:6833","nonce":2371625945}]},"active_addr":"172.21.15.203:6833/2371625945","active_change":"2024-04-24T22:59:35.559184+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":3008068463}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":4716938}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2050018161}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2260118629}]}]} 2024-04-24T23:00:25.727 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T23:00:25.727 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T23:00:25.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.930+0000 7fce0b000640 1 Processor -- start 2024-04-24T23:00:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.930+0000 7fce0b000640 1 -- start start 2024-04-24T23:00:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.931+0000 7fce0b000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fce041561c0 0x7fce040cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.931+0000 7fce0b000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04070f90 con 0x7fce040d0240 2024-04-24T23:00:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.931+0000 7fce0b000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04071270 con 0x7fce040709d0 2024-04-24T23:00:25.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.931+0000 7fce0b000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fce040b4310 con 0x7fce041561c0 2024-04-24T23:00:25.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce0a600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fce040d0240 0x7fce040b2c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47374/0 (socket says 172.21.15.146:47374) 2024-04-24T23:00:25.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce0a600640 1 -- 172.21.15.146:0/2960799554 learned_addr learned my addr 172.21.15.146:0/2960799554 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce09c00640 1 --2- 172.21.15.146:0/2960799554 >> v2:172.21.15.203:3300/0 conn(0x7fce041561c0 0x7fce040cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704619758 0 0) 0x7fce04070f90 con 0x7fce040d0240 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec003520 con 0x7fce040d0240 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639204676 0 0) 0x7fcdec003520 con 0x7fce040d0240 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 >> v2:172.21.15.203:3300/0 conn(0x7fce041561c0 msgr2=0x7fce040cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 --2- 172.21.15.146:0/2960799554 >> v2:172.21.15.203:3300/0 conn(0x7fce041561c0 0x7fce040cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 >> v1:172.21.15.203:6789/0 conn(0x7fce040709d0 legacy=0x7fce040cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce04071550 con 0x7fce040d0240 2024-04-24T23:00:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.932+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fcdfc0019f0 con 0x7fce040d0240 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 >> v1:172.21.15.146:6789/0 conn(0x7fce040d0240 legacy=0x7fce040b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdec0039b0 0x7fcdec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec004800 0x7fcdec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 0x7fcdec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce040b4310 con 0x7fcdec0052e0 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec00c1b0 con 0x7fcdec004800 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcdec00c3b0 con 0x7fcdec0039b0 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 0x7fcdec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce09200640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec004800 0x7fcdec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce09c00640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdec0039b0 0x7fcdec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 -- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdec0039b0 msgr2=0x7fcdec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdec0039b0 0x7fcdec003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 -- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec004800 msgr2=0x7fcdec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec004800 0x7fcdec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.933+0000 7fce0a600640 1 -- 172.21.15.146:0/2960799554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec003520 con 0x7fcdec0052e0 2024-04-24T23:00:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.934+0000 7fce0a600640 1 -- 172.21.15.146:0/2960799554 reap_dead start 2024-04-24T23:00:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.934+0000 7fce0a600640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 0x7fcdec00b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fcdec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e6508ebdced683 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00a460 con 0x7fcdec0052e0 2024-04-24T23:00:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc02f070 con 0x7fcdec0052e0 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce03e00640 1 -- 172.21.15.146:0/2960799554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc02bc90 con 0x7fcdec0052e0 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 -- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 msgr2=0x7fcdec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 0x7fcdec00b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fcdec005830 comp rx=0 tx=0).stop 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 -- 172.21.15.146:0/2960799554 shutdown_connections 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 --2- 172.21.15.146:0/2960799554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdec0052e0 0x7fcdec00b9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 -- 172.21.15.146:0/2960799554 >> 172.21.15.146:0/2960799554 conn(0x7fce0406b320 msgr2=0x7fce0406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 -- 172.21.15.146:0/2960799554 shutdown_connections 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.935+0000 7fce0b000640 1 -- 172.21.15.146:0/2960799554 wait complete. 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.937+0000 7fce0b000640 1 Processor -- start 2024-04-24T23:00:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.937+0000 7fce0b000640 1 -- start start 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 0x7fce040ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce04152e60 0x7fce041522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce040cdbf0 con 0x7fce040addd0 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce040cdd70 con 0x7fcdec0052e0 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0b000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fce040cdef0 con 0x7fce04152e60 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34312/0 (socket says 172.21.15.146:34312) 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.938+0000 7fce0a600640 1 -- 172.21.15.146:0/3529222170 learned_addr learned my addr 172.21.15.146:0/3529222170 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce09c00640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 0x7fce040ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce09200640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce04152e60 0x7fce041522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 -- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce04152e60 msgr2=0x7fce041522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce04152e60 0x7fce041522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 -- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 msgr2=0x7fce040ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 0x7fce040ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 -- 172.21.15.146:0/3529222170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce040ab910 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce09c00640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 0x7fce040ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce0a600640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fce04071440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc02b830 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.939+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc02b9d0 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.940+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce040abbf0 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.940+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc02bda0 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.940+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce040ad8b0 con 0x7fce040addd0 2024-04-24T23:00:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.941+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce040adab0 con 0x7fce040addd0 2024-04-24T23:00:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.942+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdfc034470 con 0x7fce040addd0 2024-04-24T23:00:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.943+0000 7fce01600640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 0x7fcde406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.943+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcdfc0ab290 con 0x7fce040addd0 2024-04-24T23:00:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.944+0000 7fce09c00640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 0x7fcde406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.945+0000 7fce09c00640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 0x7fcde406e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80099e0 tx=0x7fcdf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:25.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:25.948+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce040adab0 con 0x7fce040addd0 2024-04-24T23:00:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.133+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce0404f500 con 0x7fce040addd0 2024-04-24T23:00:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.135+0000 7fce01600640 1 -- 172.21.15.146:0/3529222170 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7fcdfc079180 con 0x7fce040addd0 2024-04-24T23:00:26.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:26.137 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 msgr2=0x7fcde406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 0x7fcde406e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80099e0 tx=0x7fcdf8008040 comp rx=0 tx=0).stop 2024-04-24T23:00:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 msgr2=0x7fce04153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fce04071440 comp rx=0 tx=0).stop 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 shutdown_connections 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce040addd0 0x7fce04153ea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcde406be30 0x7fcde406e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce04152e60 0x7fce041522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 --2- 172.21.15.146:0/3529222170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdec0052e0 0x7fce040ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 >> 172.21.15.146:0/3529222170 conn(0x7fce0406b320 msgr2=0x7fce040af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 shutdown_connections 2024-04-24T23:00:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.138+0000 7fce0b000640 1 -- 172.21.15.146:0/3529222170 wait complete. 2024-04-24T23:00:26.158 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T23:00:26.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.347+0000 7f88b1c00640 1 Processor -- start 2024-04-24T23:00:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.347+0000 7f88b1c00640 1 -- start start 2024-04-24T23:00:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88b1c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f88ac0d03a0 0x7f88ac070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88b1c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac1449c0 con 0x7f88ac0728c0 2024-04-24T23:00:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88b1c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac071820 con 0x7f88ac1445e0 2024-04-24T23:00:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88b1c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac072430 con 0x7f88ac0d03a0 2024-04-24T23:00:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88ab400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f88ac0728c0 0x7f88ac0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47386/0 (socket says 172.21.15.146:47386) 2024-04-24T23:00:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.348+0000 7f88ab400640 1 -- 172.21.15.146:0/3504069797 learned_addr learned my addr 172.21.15.146:0/3504069797 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88a3e00640 1 --2- 172.21.15.146:0/3504069797 >> v2:172.21.15.203:3300/0 conn(0x7f88ac0d03a0 0x7f88ac070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103358853 0 0) 0x7f88ac1449c0 con 0x7f88ac0728c0 2024-04-24T23:00:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8890003520 con 0x7f88ac0728c0 2024-04-24T23:00:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 103849768 0 0) 0x7f8890003520 con 0x7f88ac0728c0 2024-04-24T23:00:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 >> v2:172.21.15.203:3300/0 conn(0x7f88ac0d03a0 msgr2=0x7f88ac070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 --2- 172.21.15.146:0/3504069797 >> v2:172.21.15.203:3300/0 conn(0x7f88ac0d03a0 0x7f88ac070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 >> v1:172.21.15.203:6789/0 conn(0x7f88ac1445e0 legacy=0x7f88ac0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac071b00 con 0x7f88ac0728c0 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f88a40019f0 con 0x7f88ac0728c0 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 >> v1:172.21.15.146:6789/0 conn(0x7f88ac0728c0 legacy=0x7f88ac0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8890003a00 0x7f8890003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f8890004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.349+0000 7f88aa000640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88900051c0 0x7f889000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac072430 con 0x7f8890004800 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f889000c0c0 con 0x7f88900051c0 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f889000c2c0 con 0x7f8890003a00 2024-04-24T23:00:26.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f8890004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88ab400640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88900051c0 0x7f889000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88aaa00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8890003a00 0x7f8890003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 -- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8890003a00 msgr2=0x7f8890003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8890003a00 0x7f8890003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 -- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88900051c0 msgr2=0x7f889000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88900051c0 0x7f889000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88a3e00640 1 -- 172.21.15.146:0/3504069797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8890003520 con 0x7f8890004800 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.350+0000 7f88ab400640 1 -- 172.21.15.146:0/3504069797 reap_dead start 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.351+0000 7f88a3e00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f8890004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8894009ac0 tx=0x7f8890005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e7d924f9251901 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.351+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894036070 con 0x7f8890004800 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.351+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894031400 con 0x7f8890004800 2024-04-24T23:00:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.351+0000 7f88aa000640 1 -- 172.21.15.146:0/3504069797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894009690 con 0x7f8890004800 2024-04-24T23:00:26.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 -- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 msgr2=0x7f8890004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f8890004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8894009ac0 tx=0x7f8890005830 comp rx=0 tx=0).stop 2024-04-24T23:00:26.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 -- 172.21.15.146:0/3504069797 shutdown_connections 2024-04-24T23:00:26.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 --2- 172.21.15.146:0/3504069797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f8890004c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 -- 172.21.15.146:0/3504069797 >> 172.21.15.146:0/3504069797 conn(0x7f88ac06b320 msgr2=0x7f88ac06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 -- 172.21.15.146:0/3504069797 shutdown_connections 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.352+0000 7f88b1c00640 1 -- 172.21.15.146:0/3504069797 wait complete. 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.354+0000 7f88b1c00640 1 Processor -- start 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.354+0000 7f88b1c00640 1 -- start start 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88ac13e7c0 0x7f88ac13ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88ac13f9d0 0x7f88ac13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0720c0 con 0x7f8890004800 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0b2d70 con 0x7f88ac13e7c0 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88b1c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0cfc90 con 0x7f88ac13f9d0 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34332/0 (socket says 172.21.15.146:34332) 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 -- 172.21.15.146:0/1908695945 learned_addr learned my addr 172.21.15.146:0/1908695945 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 -- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88ac13f9d0 msgr2=0x7f88ac13fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88ac13f9d0 0x7f88ac13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 -- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88ac13e7c0 msgr2=0x7f88ac13ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88ac13e7c0 0x7f88ac13ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.355+0000 7f88aaa00640 1 -- 172.21.15.146:0/1908695945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac13f270 con 0x7f8890004800 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88aaa00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f889c00d4b0 tx=0x7f889c00d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c005480 con 0x7f8890004800 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c017070 con 0x7f8890004800 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c003810 con 0x7f8890004800 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac13f550 con 0x7f8890004800 2024-04-24T23:00:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.356+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac14fc60 con 0x7f8890004800 2024-04-24T23:00:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.357+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac0725e0 con 0x7f8890004800 2024-04-24T23:00:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.358+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f889c0039b0 con 0x7f8890004800 2024-04-24T23:00:26.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.359+0000 7f88a2a00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.359+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f889c08af40 con 0x7f8890004800 2024-04-24T23:00:26.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.360+0000 7f88a3e00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.361+0000 7f88a3e00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 0x7f888806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8894033000 tx=0x7f889402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.363+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f88ac0725e0 con 0x7f8890004800 2024-04-24T23:00:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.561+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88ac068190 con 0x7f8890004800 2024-04-24T23:00:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.563+0000 7f88a2a00640 1 -- 172.21.15.146:0/1908695945 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f889c0595d0 con 0x7f8890004800 2024-04-24T23:00:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:26.565 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 msgr2=0x7f888806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 0x7f888806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8894033000 tx=0x7f889402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 msgr2=0x7f88ac1f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f889c00d4b0 tx=0x7f889c00d970 comp rx=0 tx=0).stop 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 shutdown_connections 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88ac13f9d0 0x7f88ac13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88ac13e7c0 0x7f88ac13ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 --2- 172.21.15.146:0/1908695945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8890004800 0x7f88ac1f17c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 >> 172.21.15.146:0/1908695945 conn(0x7f88ac06b320 msgr2=0x7f88ac15f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 shutdown_connections 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.566+0000 7f88b1c00640 1 -- 172.21.15.146:0/1908695945 wait complete. 2024-04-24T23:00:26.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T23:00:26.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T23:00:26.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T23:00:26.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T23:00:26.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T23:00:26.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T23:00:26.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T23:00:26.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T23:00:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.874+0000 7f52d7200640 1 Processor -- start 2024-04-24T23:00:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.874+0000 7f52d7200640 1 -- start start 2024-04-24T23:00:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.876+0000 7f52d7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 0x7f52d80cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.876+0000 7f52d7200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f52d816b060 0x7f52d816b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.876+0000 7f52d7200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d816f570 con 0x7f52d816f090 2024-04-24T23:00:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.876+0000 7f52d7200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f52d8072cd0 con 0x7f52d816b060 2024-04-24T23:00:26.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.877+0000 7f52d7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52d8072510 con 0x7f52d80cf7c0 2024-04-24T23:00:26.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.877+0000 7f52d5400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f52d816f090 0x7f52d80cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:54114/0 (socket says 172.21.15.146:54114) 2024-04-24T23:00:26.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.877+0000 7f52d5400640 1 -- 172.21.15.146:0/3084046864 learned_addr learned my addr 172.21.15.146:0/3084046864 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.878+0000 7f52d6800640 1 --2- 172.21.15.146:0/3084046864 >> v2:172.21.15.203:3300/0 conn(0x7f52d816b060 0x7f52d816b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.878+0000 7f52d5e00640 1 --2- 172.21.15.146:0/3084046864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 0x7f52d80cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.878+0000 7f52d4a00640 1 -- 172.21.15.146:0/3084046864 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797484919 0 0) 0x7f52d816f570 con 0x7f52d816f090 2024-04-24T23:00:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.878+0000 7f52d4a00640 1 -- 172.21.15.146:0/3084046864 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52bc005730 con 0x7f52d816f090 2024-04-24T23:00:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.879+0000 7f52d5e00640 1 -- 172.21.15.146:0/3084046864 >> v2:172.21.15.203:3300/0 conn(0x7f52d816b060 msgr2=0x7f52d816b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.879+0000 7f52d5e00640 1 --2- 172.21.15.146:0/3084046864 >> v2:172.21.15.203:3300/0 conn(0x7f52d816b060 0x7f52d816b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.879+0000 7f52d5e00640 1 -- 172.21.15.146:0/3084046864 >> v1:172.21.15.203:6789/0 conn(0x7f52d816f090 legacy=0x7f52d80cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.879+0000 7f52d5e00640 1 -- 172.21.15.146:0/3084046864 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8070b00 con 0x7f52d80cf7c0 2024-04-24T23:00:26.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.882+0000 7f52d5e00640 1 --2- 172.21.15.146:0/3084046864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 0x7f52d80cf180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097a0 tx=0x7f52c402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717ed3cbb50c17fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.882+0000 7f52d4a00640 1 -- 172.21.15.146:0/3084046864 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4037070 con 0x7f52d80cf7c0 2024-04-24T23:00:26.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.883+0000 7f52d4a00640 1 -- 172.21.15.146:0/3084046864 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4032440 con 0x7f52d80cf7c0 2024-04-24T23:00:26.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.883+0000 7f52d4a00640 1 -- 172.21.15.146:0/3084046864 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c402ae60 con 0x7f52d80cf7c0 2024-04-24T23:00:26.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 -- 172.21.15.146:0/3084046864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 msgr2=0x7f52d80cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 --2- 172.21.15.146:0/3084046864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 0x7f52d80cf180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097a0 tx=0x7f52c402a110 comp rx=0 tx=0).stop 2024-04-24T23:00:26.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 -- 172.21.15.146:0/3084046864 shutdown_connections 2024-04-24T23:00:26.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 --2- 172.21.15.146:0/3084046864 >> v2:172.21.15.203:3300/0 conn(0x7f52d816b060 0x7f52d816b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 --2- 172.21.15.146:0/3084046864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d80cf7c0 0x7f52d80cf180 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.884+0000 7f52d7200640 1 -- 172.21.15.146:0/3084046864 >> 172.21.15.146:0/3084046864 conn(0x7f52d806b140 msgr2=0x7f52d806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.885+0000 7f52d7200640 1 -- 172.21.15.146:0/3084046864 shutdown_connections 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.885+0000 7f52d7200640 1 -- 172.21.15.146:0/3084046864 wait complete. 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.885+0000 7f0b6ac00640 1 Processor -- start 2024-04-24T23:00:26.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.885+0000 7f0b6ac00640 1 -- start start 2024-04-24T23:00:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f0b6ac00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b640720f0 0x7f0b64070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f0b6ac00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 0x7f0b640ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f0b6ac00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b6406e600 con 0x7f0b6415ac20 2024-04-24T23:00:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f0b6ac00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0b640ce000 con 0x7f0b640720f0 2024-04-24T23:00:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f0b6ac00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0b6406e8e0 con 0x7f0b64071490 2024-04-24T23:00:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f9b1a200640 1 Processor -- start 2024-04-24T23:00:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f0b63400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b640720f0 0x7f0b64070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f0b68c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 0x7f0b640ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f0b63400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b640720f0 0x7f0b64070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34334/0 (socket says 172.21.15.146:34334) 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f0b68c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 0x7f0b640ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41800/0 (socket says 172.21.15.146:41800) 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f0b63400640 1 -- 172.21.15.146:0/2422176458 learned_addr learned my addr 172.21.15.146:0/2422176458 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.886+0000 7f3bd8a00640 1 Processor -- start 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.887+0000 7f3bd8a00640 1 -- start start 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 0x7f3bd4166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd8a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 0x7f3bd40b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f52d7200640 1 Processor -- start 2024-04-24T23:00:26.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f0b63400640 1 -- 172.21.15.146:0/2422176458 >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 msgr2=0x7f0b640ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.888+0000 7f9b1a200640 1 -- start start 2024-04-24T23:00:26.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f0b63400640 1 --2- 172.21.15.146:0/2422176458 >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 0x7f0b640ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f0b63400640 1 -- 172.21.15.146:0/2422176458 >> v1:172.21.15.203:6789/0 conn(0x7f0b6415ac20 legacy=0x7f0b640719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd8a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd40b4390 con 0x7f3bd414beb0 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd8a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd406d4f0 con 0x7f3bd4166550 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd8a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd406cbc0 con 0x7f3bd4162a60 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 0x7f3bd40b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f52d7200640 1 -- start start 2024-04-24T23:00:26.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.890+0000 7f0b63400640 1 -- 172.21.15.146:0/2422176458 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b640cdc90 con 0x7f0b640720f0 2024-04-24T23:00:26.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd1e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3bd414beb0 0x7f3bd4072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47400/0 (socket says 172.21.15.146:47400) 2024-04-24T23:00:26.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.890+0000 7f3bd1e00640 1 -- 172.21.15.146:0/1322804615 learned_addr learned my addr 172.21.15.146:0/1322804615 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 0x7f3bd40b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34342/0 (socket says 172.21.15.146:34342) 2024-04-24T23:00:26.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.889+0000 7f3bd1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 0x7f3bd4166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f9b1a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b14071690 0x7f9b140b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f9b1a200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b140af100 con 0x7f9b140cf860 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f9b1a200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14070bb0 con 0x7f9b140ae9b0 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f9b1a200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9b14070960 con 0x7f9b14071690 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 0x7f52d815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52d816b060 0x7f52d81613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d816f090 0x7f52d80cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f52d808bae0 con 0x7f52d816b060 2024-04-24T23:00:26.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80727b0 con 0x7f52d80cf7c0 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f52d7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80b2860 con 0x7f52d816f090 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f3bd1400640 1 -- 172.21.15.146:0/1322804615 >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 msgr2=0x7f3bd40b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f3bd1400640 1 --2- 172.21.15.146:0/1322804615 >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 0x7f3bd40b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f3bd1400640 1 -- 172.21.15.146:0/1322804615 >> v1:172.21.15.146:6789/0 conn(0x7f3bd414beb0 legacy=0x7f3bd4072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.891+0000 7f3bd1400640 1 -- 172.21.15.146:0/1322804615 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd406cea0 con 0x7f3bd4162a60 2024-04-24T23:00:26.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f2de8c00640 1 Processor -- start 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f52d5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52d816b060 0x7f52d81613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f52d5e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 0x7f52d815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f52d5e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 0x7f52d815e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41816/0 (socket says 172.21.15.146:41816) 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f52d5e00640 1 -- 172.21.15.146:0/2298850876 learned_addr learned my addr 172.21.15.146:0/2298850876 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f52d6800640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d816f090 0x7f52d80cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f9b13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b14071690 0x7f9b140b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f9b13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b14071690 0x7f9b140b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34348/0 (socket says 172.21.15.146:34348) 2024-04-24T23:00:26.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f9b13e00640 1 -- 172.21.15.146:0/1997409653 learned_addr learned my addr 172.21.15.146:0/1997409653 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f2de8c00640 1 -- start start 2024-04-24T23:00:26.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.892+0000 7f0b63400640 1 --2- 172.21.15.146:0/2422176458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b64070db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406ebc0 tx=0x7f0b5402e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a318bb5ece7b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f3bd1400640 1 --2- 172.21.15.146:0/1322804615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 0x7f3bd4166010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097d0 tx=0x7f3bc002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48b6a8fefd48a7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f0b62a00640 1 -- 172.21.15.146:0/2422176458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5403a070 con 0x7f0b640720f0 2024-04-24T23:00:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f0b62a00640 1 -- 172.21.15.146:0/2422176458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54033710 con 0x7f0b640720f0 2024-04-24T23:00:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f0b62a00640 1 -- 172.21.15.146:0/2422176458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54033ae0 con 0x7f0b640720f0 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f52d5e00640 1 -- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d816f090 msgr2=0x7f52d80cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f52d5e00640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52d816f090 0x7f52d80cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f52d5e00640 1 -- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52d816b060 msgr2=0x7f52d81613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f52d5e00640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52d816b060 0x7f52d81613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f52d5e00640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d815ef70 con 0x7f52d80cf7c0 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f52d5400640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52d816b060 0x7f52d81613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.893+0000 7f9b13400640 1 -- 172.21.15.146:0/1997409653 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271371049 0 0) 0x7f9b14070bb0 con 0x7f9b140ae9b0 2024-04-24T23:00:26.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f9b13400640 1 -- 172.21.15.146:0/1997409653 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af8003520 con 0x7f9b140ae9b0 2024-04-24T23:00:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f3bd0a00640 1 -- 172.21.15.146:0/1322804615 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0037070 con 0x7f3bd4162a60 2024-04-24T23:00:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f3bd0a00640 1 -- 172.21.15.146:0/1322804615 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0032440 con 0x7f3bd4162a60 2024-04-24T23:00:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f3bd0a00640 1 -- 172.21.15.146:0/1322804615 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0032850 con 0x7f3bd4162a60 2024-04-24T23:00:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f9b13e00640 1 -- 172.21.15.146:0/1997409653 >> v1:172.21.15.203:6789/0 conn(0x7f9b140ae9b0 legacy=0x7f9b14162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f9b13e00640 1 -- 172.21.15.146:0/1997409653 >> v1:172.21.15.146:6789/0 conn(0x7f9b140cf860 legacy=0x7f9b140cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f9b13e00640 1 -- 172.21.15.146:0/1997409653 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14070e90 con 0x7f9b14071690 2024-04-24T23:00:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f2de8c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 0x7f2de40c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.894+0000 7f2de8c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2de40d0f40 0x7f2de40b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de8c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de40d14c0 con 0x7f2de40d1ee0 2024-04-24T23:00:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de8c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40cf620 con 0x7f2de40d0f40 2024-04-24T23:00:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de8c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40b7dd0 con 0x7f2de40d0b60 2024-04-24T23:00:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 -- 172.21.15.146:0/2422176458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 msgr2=0x7f0b64070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 --2- 172.21.15.146:0/2422176458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b64070db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406ebc0 tx=0x7f0b5402e4d0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 -- 172.21.15.146:0/1322804615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 msgr2=0x7f3bd4166010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/1322804615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 0x7f3bd4166010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097d0 tx=0x7f3bc002a200 comp rx=0 tx=0).stop 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 -- 172.21.15.146:0/2422176458 shutdown_connections 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 --2- 172.21.15.146:0/2422176458 >> v2:172.21.15.203:3300/0 conn(0x7f0b64071490 0x7f0b640ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 --2- 172.21.15.146:0/2422176458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b64070db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f0b6ac00640 1 -- 172.21.15.146:0/2422176458 >> 172.21.15.146:0/2422176458 conn(0x7f0b6406b140 msgr2=0x7f0b6406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 -- 172.21.15.146:0/1322804615 shutdown_connections 2024-04-24T23:00:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/1322804615 >> v2:172.21.15.146:3300/0 conn(0x7f3bd4166550 0x7f3bd40b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/1322804615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd4162a60 0x7f3bd4166010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 -- 172.21.15.146:0/1322804615 >> 172.21.15.146:0/1322804615 conn(0x7f3bd406b140 msgr2=0x7f3bd406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de2800640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f2de40d1ee0 0x7f2de40d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:54148/0 (socket says 172.21.15.146:54148) 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de2800640 1 -- 172.21.15.146:0/3381020656 learned_addr learned my addr 172.21.15.146:0/3381020656 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f2de1400640 1 --2- 172.21.15.146:0/3381020656 >> v2:172.21.15.146:3300/0 conn(0x7f2de40d0f40 0x7f2de40b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f52d5e00640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 0x7f52d815e870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52c40098c0 tx=0x7f52c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.895+0000 7f3bd8a00640 1 -- 172.21.15.146:0/1322804615 shutdown_connections 2024-04-24T23:00:26.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4037040 con 0x7f52d80cf7c0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f2de1e00640 1 --2- 172.21.15.146:0/3381020656 >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 0x7f2de40c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f2de0a00640 1 -- 172.21.15.146:0/3381020656 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158383300 0 0) 0x7f2de40d14c0 con 0x7f2de40d1ee0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4042070 con 0x7f52d80cf7c0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d815f250 con 0x7f52d80cf7c0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4032830 con 0x7f52d80cf7c0 2024-04-24T23:00:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d815f810 con 0x7f52d80cf7c0 2024-04-24T23:00:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f0b6ac00640 1 -- 172.21.15.146:0/2422176458 shutdown_connections 2024-04-24T23:00:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f3bd8a00640 1 -- 172.21.15.146:0/1322804615 wait complete. 2024-04-24T23:00:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f9b13e00640 1 --2- 172.21.15.146:0/1997409653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b14071690 0x7f9b140b48f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009e50 tx=0x7f9b0c02a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6eebe94ec97156 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.896+0000 7f2de0a00640 1 -- 172.21.15.146:0/3381020656 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc8003520 con 0x7f2de40d1ee0 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f2de1400640 1 -- 172.21.15.146:0/3381020656 >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 msgr2=0x7f2de40c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f2de1400640 1 --2- 172.21.15.146:0/3381020656 >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 0x7f2de40c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f2de1400640 1 -- 172.21.15.146:0/3381020656 >> v1:172.21.15.203:6789/0 conn(0x7f2de40d1ee0 legacy=0x7f2de40d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f2de1400640 1 -- 172.21.15.146:0/3381020656 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de40d1760 con 0x7f2de40d0f40 2024-04-24T23:00:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f2de1e00640 1 --2- 172.21.15.146:0/3381020656 >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 0x7f2de40c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f9b13400640 1 -- 172.21.15.146:0/1997409653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c036070 con 0x7f9b14071690 2024-04-24T23:00:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f9b13400640 1 -- 172.21.15.146:0/1997409653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c031600 con 0x7f9b14071690 2024-04-24T23:00:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7f9b13400640 1 -- 172.21.15.146:0/1997409653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0319d0 con 0x7f9b14071690 2024-04-24T23:00:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7fd1e8a00640 1 Processor -- start 2024-04-24T23:00:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.897+0000 7fd1e8a00640 1 -- start start 2024-04-24T23:00:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.898+0000 7f3bd8a00640 1 Processor -- start 2024-04-24T23:00:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.898+0000 7f3bd8a00640 1 -- start start 2024-04-24T23:00:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.898+0000 7f9b1a200640 1 -- 172.21.15.146:0/1997409653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b14071690 msgr2=0x7f9b140b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.898+0000 7f9b1a200640 1 --2- 172.21.15.146:0/1997409653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b14071690 0x7f9b140b48f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009e50 tx=0x7f9b0c02a7b0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f2249800640 1 Processor -- start 2024-04-24T23:00:26.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52d804f500 con 0x7f52d80cf7c0 2024-04-24T23:00:26.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.898+0000 7f0b6ac00640 1 -- 172.21.15.146:0/2422176458 wait complete. 2024-04-24T23:00:26.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f0b6ac00640 1 Processor -- start 2024-04-24T23:00:26.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f0b6ac00640 1 -- start start 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f3bd8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd414beb0 0x7f3bd4162060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd8a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4162a60 0x7f3bd40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 0x7f3bd40ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd8a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4166e80 con 0x7f3bd4166550 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd8a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4166d00 con 0x7f3bd4162a60 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd8a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd40b3500 con 0x7f3bd414beb0 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd414beb0 0x7f3bd4162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 0x7f3bd40ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 0x7f3bd40ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34384/0 (socket says 172.21.15.146:34384) 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7f3bd2800640 1 -- 172.21.15.146:0/3211095150 learned_addr learned my addr 172.21.15.146:0/3211095150 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1400640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4162a60 0x7f3bd40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f9b1a200640 1 -- 172.21.15.146:0/1997409653 shutdown_connections 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f9b1a200640 1 --2- 172.21.15.146:0/1997409653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b14071690 0x7f9b140b48f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f9b1a200640 1 -- 172.21.15.146:0/1997409653 >> 172.21.15.146:0/1997409653 conn(0x7f9b1406b140 msgr2=0x7f9b1406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f9b1a200640 1 -- 172.21.15.146:0/1997409653 shutdown_connections 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f9b1a200640 1 -- 172.21.15.146:0/1997409653 wait complete. 2024-04-24T23:00:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7fc878600640 1 Processor -- start 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.899+0000 7f2249800640 1 -- start start 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7fd1e8a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 0x7fd1e406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7fd1e8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 0x7fd1e40b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7fd1e8a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e40b2860 con 0x7fd1e40b4780 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7fd1e8a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e406e510 con 0x7fd1e406eac0 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.900+0000 7fd1e8a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e40b2b40 con 0x7fd1e40b3900 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7fd1e3200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd1e40b4780 0x7fd1e40709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47426/0 (socket says 172.21.15.146:47426) 2024-04-24T23:00:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7fd1e3200640 1 -- 172.21.15.146:0/3152950673 learned_addr learned my addr 172.21.15.146:0/3152950673 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1e00640 1 -- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4162a60 msgr2=0x7f3bd40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1e00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bd4162a60 0x7f3bd40b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1e00640 1 -- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 msgr2=0x7f3bd40ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1e00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 0x7f3bd40ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd1e00640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd40acd50 con 0x7f3bd414beb0 2024-04-24T23:00:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/3152950673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 0x7fd1e40b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f3bd2800640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd4166550 0x7f3bd40ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7fc878600640 1 -- start start 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2de1400640 1 --2- 172.21.15.146:0/3381020656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d0f40 0x7f2de40b5380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2de40cf7a0 tx=0x7f2dd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654686a65d77680 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2de0a00640 1 -- 172.21.15.146:0/3381020656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0037070 con 0x7f2de40d0f40 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2de0a00640 1 -- 172.21.15.146:0/3381020656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0032440 con 0x7f2de40d0f40 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2de0a00640 1 -- 172.21.15.146:0/3381020656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd002ae60 con 0x7f2de40d0f40 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2249800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f223c0ead00 0x7f223c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2249800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f223c04ffd0 0x7f223c037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2249800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223c053720 con 0x7f223c038110 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2249800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f223c054330 con 0x7f223c04ffd0 2024-04-24T23:00:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.901+0000 7f2249800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f223c053a00 con 0x7f223c0ead00 2024-04-24T23:00:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7fd1e2800640 1 --2- 172.21.15.146:0/3152950673 >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 0x7fd1e406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7f9b1a200640 1 Processor -- start 2024-04-24T23:00:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7fd1e1400640 1 -- 172.21.15.146:0/3152950673 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644322623 0 0) 0x7fd1e40b2860 con 0x7fd1e40b4780 2024-04-24T23:00:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7f3bd1e00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd414beb0 0x7f3bd4162060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cae0 tx=0x7f3bcc00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc017070 con 0x7f3bd414beb0 2024-04-24T23:00:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f2de8c00640 1 -- 172.21.15.146:0/3381020656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d0f40 msgr2=0x7f2de40b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3381020656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d0f40 0x7f2de40b5380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2de40cf7a0 tx=0x7f2dd002a110 comp rx=0 tx=0).stop 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fd1e1e00640 1 -- 172.21.15.146:0/3152950673 >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 msgr2=0x7fd1e406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/3152950673 >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 0x7fd1e406dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fd1e1e00640 1 -- 172.21.15.146:0/3152950673 >> v1:172.21.15.146:6789/0 conn(0x7fd1e40b4780 legacy=0x7fd1e40709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fd1e1e00640 1 -- 172.21.15.146:0/3152950673 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e40b2e20 con 0x7fd1e40b3900 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fd1e2800640 1 --2- 172.21.15.146:0/3152950673 >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 0x7fd1e406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00ac40 con 0x7f3bd414beb0 2024-04-24T23:00:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc012600 con 0x7f3bd414beb0 2024-04-24T23:00:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fc878600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc87014b2d0 0x7fc870072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fc878600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc870070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fc878600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87014c0e0 con 0x7fc8700710e0 2024-04-24T23:00:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fc878600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc870071540 con 0x7fc87014b2d0 2024-04-24T23:00:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7fc878600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc87014b6b0 con 0x7fc87014b870 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7f2248e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f223c038110 0x7f223c038580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47428/0 (socket says 172.21.15.146:47428) 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f2248e00640 1 -- 172.21.15.146:0/187239673 learned_addr learned my addr 172.21.15.146:0/187239673 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7f2243400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f223c04ffd0 0x7f223c037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.902+0000 7f2243e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f223c0ead00 0x7f223c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b64071490 0x7f0b6415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b641567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 0x7f0b64150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6415b180 con 0x7f0b640720f0 2024-04-24T23:00:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6415b000 con 0x7f0b6415ac20 2024-04-24T23:00:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f0b6ac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0b640b29b0 con 0x7f0b64071490 2024-04-24T23:00:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f9b1a200640 1 -- start start 2024-04-24T23:00:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f0b68c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 0x7f0b64150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f0b68c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 0x7f0b64150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41838/0 (socket says 172.21.15.146:41838) 2024-04-24T23:00:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f0b68c00640 1 -- 172.21.15.146:0/916293561 learned_addr learned my addr 172.21.15.146:0/916293561 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.903+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd40ad030 con 0x7f3bd414beb0 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd40ad5f0 con 0x7f3bd414beb0 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2de8c00640 1 -- 172.21.15.146:0/3381020656 shutdown_connections 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3381020656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d0f40 0x7f2de40b5380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3381020656 >> v2:172.21.15.203:3300/0 conn(0x7f2de40d0b60 0x7f2de40c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2de8c00640 1 -- 172.21.15.146:0/3381020656 >> 172.21.15.146:0/3381020656 conn(0x7f2de40d3f70 msgr2=0x7f2de40d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7fc875c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc87014b2d0 0x7fc870072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7fc875200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc870070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7fc875200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc870070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:37764/0 (socket says 172.21.15.146:37764) 2024-04-24T23:00:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7fc875200640 1 -- 172.21.15.146:0/390757276 learned_addr learned my addr 172.21.15.146:0/390757276 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975611790 0 0) 0x7f223c053720 con 0x7f223c038110 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f0b63400640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b641567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f0b63e00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b64071490 0x7f0b6415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f222c003520 con 0x7f223c038110 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 -- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b64071490 msgr2=0x7f0b6415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b64071490 0x7f0b6415bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 -- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 msgr2=0x7f0b641567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b640720f0 0x7f0b641567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b64156f60 con 0x7f0b6415ac20 2024-04-24T23:00:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2de8c00640 1 -- 172.21.15.146:0/3381020656 shutdown_connections 2024-04-24T23:00:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/3152950673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 0x7fd1e40b4240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00097a0 tx=0x7fd1d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86031901d2b353f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.904+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52c40329d0 con 0x7f52d80cf7c0 2024-04-24T23:00:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2de8c00640 1 -- 172.21.15.146:0/3381020656 wait complete. 2024-04-24T23:00:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7fc875c00640 1 -- 172.21.15.146:0/390757276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 msgr2=0x7fc870070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7fc875c00640 1 --2- 172.21.15.146:0/390757276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc870070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7fc875c00640 1 -- 172.21.15.146:0/390757276 >> v1:172.21.15.146:6789/0 conn(0x7fc8700710e0 legacy=0x7fc8700b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 182872980 0 0) 0x7f222c003520 con 0x7f223c038110 2024-04-24T23:00:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 >> v2:172.21.15.203:3300/0 conn(0x7f223c0ead00 msgr2=0x7f223c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7fc875c00640 1 -- 172.21.15.146:0/390757276 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87006d770 con 0x7fc87014b2d0 2024-04-24T23:00:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 --2- 172.21.15.146:0/187239673 >> v2:172.21.15.203:3300/0 conn(0x7f223c0ead00 0x7f223c04fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f0b68c00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 0x7f0b64150ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c007e70 tx=0x7f0b5c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 >> v2:172.21.15.146:3300/0 conn(0x7f223c04ffd0 msgr2=0x7f223c037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 --2- 172.21.15.146:0/187239673 >> v2:172.21.15.146:3300/0 conn(0x7f223c04ffd0 0x7f223c037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c053ce0 con 0x7f223c038110 2024-04-24T23:00:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f9b1a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 0x7f9b14151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f9b1a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140ae9b0 0x7f9b140ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f224404fa20 con 0x7f223c038110 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 >> v1:172.21.15.146:6789/0 conn(0x7f223c038110 legacy=0x7f223c038580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f222c0039b0 0x7f222c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f222c004350 0x7f222c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f222c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f223c054330 con 0x7f222c004350 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f223c053a00 con 0x7f222c0039b0 2024-04-24T23:00:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f222c00bf00 con 0x7f222c004e40 2024-04-24T23:00:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7fd1e1400640 1 -- 172.21.15.146:0/3152950673 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0037070 con 0x7fd1e40b3900 2024-04-24T23:00:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7fd1e1400640 1 -- 172.21.15.146:0/3152950673 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d0032440 con 0x7fd1e40b3900 2024-04-24T23:00:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7fd1e1400640 1 -- 172.21.15.146:0/3152950673 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0032810 con 0x7fd1e40b3900 2024-04-24T23:00:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f52ce000640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52b806be30 0x7f52b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f9b18e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 0x7f9b14151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f9b18e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 0x7f9b14151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41844/0 (socket says 172.21.15.146:41844) 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b1a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9b140cf860 0x7f9b140acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7fc875c00640 1 --2- 172.21.15.146:0/390757276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870072a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e7bb4e21d865ef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.906+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52c40ab950 con 0x7f52d80cf7c0 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f52ce000640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f52b8075530 0x7f52b8077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52b8078040 con 0x7f52b8075530 2024-04-24T23:00:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f52c4075b50 con 0x7f52d80cf7c0 2024-04-24T23:00:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f2248e00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f222c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f52d5400640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52b806be30 0x7f52b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b1a200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14162a90 con 0x7f9b140ae9b0 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b1a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14071200 con 0x7f9b14071690 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b1a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14162c10 con 0x7f9b140cf860 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f2243e00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f222c0039b0 0x7f222c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7fd1e8a00640 1 -- 172.21.15.146:0/3152950673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 msgr2=0x7fd1e40b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/3152950673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 0x7fd1e40b4240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00097a0 tx=0x7fd1d002a180 comp rx=0 tx=0).stop 2024-04-24T23:00:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f2243400640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f222c004350 0x7f222c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.905+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bd404f5a0 con 0x7f3bd414beb0 2024-04-24T23:00:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c014620 con 0x7f0b6415ac20 2024-04-24T23:00:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b18e00640 1 -- 172.21.15.146:0/164185193 learned_addr learned my addr 172.21.15.146:0/164185193 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c019070 con 0x7f0b6415ac20 2024-04-24T23:00:26.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f9b13e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140ae9b0 0x7f9b140ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f0b6ac00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b64157240 con 0x7f0b6415ac20 2024-04-24T23:00:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.907+0000 7f2de8c00640 1 Processor -- start 2024-04-24T23:00:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c014a20 con 0x7f0b6415ac20 2024-04-24T23:00:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f52d6800640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f52b8075530 0x7f52b8077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f0b6ac00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b64157800 con 0x7f0b6415ac20 2024-04-24T23:00:26.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7fc86fe00640 1 -- 172.21.15.146:0/390757276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864037070 con 0x7fc87014b2d0 2024-04-24T23:00:26.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7fc86fe00640 1 -- 172.21.15.146:0/390757276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86402ae40 con 0x7fc87014b2d0 2024-04-24T23:00:26.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7fc86fe00640 1 -- 172.21.15.146:0/390757276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864032660 con 0x7fc87014b2d0 2024-04-24T23:00:26.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2de8c00640 1 -- start start 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f52d5400640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52b806be30 0x7f52b806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ce960 tx=0x7f52c8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b18e00640 1 -- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9b140cf860 msgr2=0x7f9b140acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b19800640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9b140cf860 0x7f9b140acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2248e00640 1 -- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f222c0039b0 msgr2=0x7f222c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2248e00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f222c0039b0 0x7f222c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2248e00640 1 -- 172.21.15.146:0/187239673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f222c004350 msgr2=0x7f222c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2248e00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f222c004350 0x7f222c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.908+0000 7f2248e00640 1 -- 172.21.15.146:0/187239673 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c053ce0 con 0x7f222c004e40 2024-04-24T23:00:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f2248e00640 1 -- 172.21.15.146:0/187239673 reap_dead start 2024-04-24T23:00:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b18e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9b140cf860 0x7f9b140acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b18e00640 1 -- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140ae9b0 msgr2=0x7f9b140ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f2243400640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f222c004350 0x7f222c004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 -- 172.21.15.146:0/3152950673 shutdown_connections 2024-04-24T23:00:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/3152950673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e40b3900 0x7fd1e40b4240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/3152950673 >> v2:172.21.15.146:3300/0 conn(0x7fd1e406eac0 0x7fd1e406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 -- 172.21.15.146:0/3152950673 >> 172.21.15.146:0/3152950673 conn(0x7fd1e40b1560 msgr2=0x7fd1e40b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f2248e00640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f222c00b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f224406a950 tx=0x7f222c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126cb372f3400ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b18e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140ae9b0 0x7f9b140ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b18e00640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14200b70 con 0x7f9b14071690 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b19800640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9b140cf860 0x7f9b140acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 -- 172.21.15.146:0/3152950673 shutdown_connections 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fd1e8a00640 1 -- 172.21.15.146:0/3152950673 wait complete. 2024-04-24T23:00:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f0b6ac00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b6404f5a0 con 0x7f0b6415ac20 2024-04-24T23:00:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f9b13e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140ae9b0 0x7f9b140ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f52d6800640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f52b8075530 0x7f52b8077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fc878600640 1 -- 172.21.15.146:0/390757276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 msgr2=0x7fc870072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7fc878600640 1 --2- 172.21.15.146:0/390757276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870072a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402a130 comp rx=0 tx=0).stop 2024-04-24T23:00:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 -- 172.21.15.146:0/390757276 shutdown_connections 2024-04-24T23:00:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.909+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440b3070 con 0x7f222c004e40 2024-04-24T23:00:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 --2- 172.21.15.146:0/390757276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc870070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 --2- 172.21.15.146:0/390757276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870072a10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 -- 172.21.15.146:0/390757276 >> 172.21.15.146:0/390757276 conn(0x7fc87006b140 msgr2=0x7fc87006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22440a6c20 con 0x7f222c004e40 2024-04-24T23:00:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2242a00640 1 -- 172.21.15.146:0/187239673 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440b3070 con 0x7f222c004e40 2024-04-24T23:00:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2de40d0b60 0x7f2de40c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2de40d0f40 0x7f2de4163470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 0x7f2de40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 -- 172.21.15.146:0/390757276 shutdown_connections 2024-04-24T23:00:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b5010 con 0x7f2de40d1ee0 2024-04-24T23:00:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40cfb50 con 0x7f2de40d0b60 2024-04-24T23:00:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de8c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40d0050 con 0x7f2de40d0f40 2024-04-24T23:00:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7fc878600640 1 -- 172.21.15.146:0/390757276 wait complete. 2024-04-24T23:00:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bcc01a070 con 0x7f3bd414beb0 2024-04-24T23:00:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f9b18e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 0x7f9b14151ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000c3c0 tx=0x7f9b0000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b000052d0 con 0x7f9b14071690 2024-04-24T23:00:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b00005490 con 0x7f9b14071690 2024-04-24T23:00:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00007260 con 0x7f9b14071690 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 0x7f2de40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.910+0000 7f2de2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 0x7f2de40cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34444/0 (socket says 172.21.15.146:34444) 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 -- 172.21.15.146:0/3465463003 learned_addr learned my addr 172.21.15.146:0/3465463003 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de1400640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2de40d0f40 0x7f2de4163470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 -- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2de40d0f40 msgr2=0x7f2de4163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2de40d0f40 0x7f2de4163470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 -- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2de40d0b60 msgr2=0x7f2de40c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2de40d0b60 0x7f2de40c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2de2800640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de40cb940 con 0x7f2de40d1ee0 2024-04-24T23:00:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2249800640 1 -- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 msgr2=0x7f222c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2249800640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f222c00b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f224406a950 tx=0x7f222c005830 comp rx=0 tx=0).stop 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2249800640 1 -- 172.21.15.146:0/187239673 shutdown_connections 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2249800640 1 --2- 172.21.15.146:0/187239673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f222c00b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.911+0000 7f2249800640 1 -- 172.21.15.146:0/187239673 >> 172.21.15.146:0/187239673 conn(0x7f223c009fb0 msgr2=0x7f223c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7f2de2800640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 0x7f2de40cb040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c3c0 tx=0x7f2dd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7f2249800640 1 -- 172.21.15.146:0/187239673 shutdown_connections 2024-04-24T23:00:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7fd1e8a00640 1 Processor -- start 2024-04-24T23:00:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7f2249800640 1 -- 172.21.15.146:0/187239673 wait complete. 2024-04-24T23:00:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7fd1e8a00640 1 -- start start 2024-04-24T23:00:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52b8078040 con 0x7f52b8075530 2024-04-24T23:00:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7fc878600640 1 Processor -- start 2024-04-24T23:00:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b141f6ee0 con 0x7f9b14071690 2024-04-24T23:00:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.912+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b140a9fe0 con 0x7f9b14071690 2024-04-24T23:00:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7fc878600640 1 -- start start 2024-04-24T23:00:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4017070 con 0x7f2de40d1ee0 2024-04-24T23:00:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd4005ce0 con 0x7f2de40d1ee0 2024-04-24T23:00:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4007310 con 0x7f2de40d1ee0 2024-04-24T23:00:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b5c014bc0 con 0x7f0b6415ac20 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7fd1e8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e406eac0 0x7fd1e41410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7fd1e8a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1e40b3900 0x7fd1e414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7fd1e8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 0x7fd1e4140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7fd1e8a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40b3d60 con 0x7fd1e40b4780 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7fd1e8a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40b33e0 con 0x7fd1e40b3900 2024-04-24T23:00:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7fd1e8a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e415b2a0 con 0x7fd1e406eac0 2024-04-24T23:00:26.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f0b5be00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0b4006bf30 0x7f0b4006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0b5c08c900 con 0x7f0b6415ac20 2024-04-24T23:00:26.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de40cbc20 con 0x7f2de40d1ee0 2024-04-24T23:00:26.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de40cb580 con 0x7f2de40d1ee0 2024-04-24T23:00:26.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b140aa6a0 con 0x7f9b14071690 2024-04-24T23:00:26.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8700710e0 0x7fc8700b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f0b5be00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f0b400756b0 0x7f0b40077af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc8701fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc87006dd30 con 0x7fc87014b2d0 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc87006e380 con 0x7fc8700710e0 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc878600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc87006e010 con 0x7fc87014b870 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.914+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b5c016e70 con 0x7f0b400756b0 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b5c08ccf0 con 0x7f0b6415ac20 2024-04-24T23:00:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7f0b63e00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0b4006bf30 0x7f0b4006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bca000640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3bb406be60 0x7f3bb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3bcc08b6c0 con 0x7f3bd414beb0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bca000640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f3bb40755e0 0x7f3bb4077a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bcc009eb0 con 0x7f3bb40755e0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3bcc08bab0 con 0x7f3bd414beb0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.913+0000 7f3bd1400640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3bb406be60 0x7f3bb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc875200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc875200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870161ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34466/0 (socket says 172.21.15.146:34466) 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fc875200640 1 -- 172.21.15.146:0/1404469167 learned_addr learned my addr 172.21.15.146:0/1404469167 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fd1e3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 0x7fd1e4140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fd1e3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 0x7fd1e4140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34450/0 (socket says 172.21.15.146:34450) 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fd1e3200640 1 -- 172.21.15.146:0/1772862241 learned_addr learned my addr 172.21.15.146:0/1772862241 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1e40b3900 0x7fd1e414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7fd1e2800640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e406eac0 0x7fd1e41410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875c00640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8700710e0 0x7fc8700b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875200640 1 -- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 msgr2=0x7fc8701fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875200640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc87014b870 0x7fc8701fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875200640 1 -- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8700710e0 msgr2=0x7fc8700b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875200640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8700710e0 0x7fc8700b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7f0b63400640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f0b400756b0 0x7f0b40077af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fc875200640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700ab980 con 0x7fc87014b2d0 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 -- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e406eac0 msgr2=0x7fd1e41410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1e406eac0 0x7fd1e41410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 -- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1e40b3900 msgr2=0x7fd1e414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1e40b3900 0x7fd1e414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e4157e30 con 0x7fd1e40b4780 2024-04-24T23:00:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7fd1e3200640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 0x7fd1e4140530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c780 tx=0x7fd1dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7f0b63400640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f0b400756b0 0x7f0b40077af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7f0b63e00640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0b4006bf30 0x7f0b4006e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000f60 tx=0x7f0b4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.915+0000 7f2249800640 1 Processor -- start 2024-04-24T23:00:26.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2de40cca70 con 0x7f2de40d1ee0 2024-04-24T23:00:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc018070 con 0x7fd1e40b4780 2024-04-24T23:00:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00a640 con 0x7fd1e40b4780 2024-04-24T23:00:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00aa30 con 0x7fd1e40b4780 2024-04-24T23:00:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e41580d0 con 0x7fd1e40b4780 2024-04-24T23:00:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.917+0000 7f2249800640 1 -- start start 2024-04-24T23:00:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7f3bd1400640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3bb406be60 0x7f3bb406e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0034000 tx=0x7f3bc002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.916+0000 7f3bd2800640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f3bb40755e0 0x7f3bb4077a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.918+0000 7f3bd2800640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f3bb40755e0 0x7f3bb4077a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.918+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e4158690 con 0x7fd1e40b4780 2024-04-24T23:00:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.918+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b5c016e70 con 0x7f0b400756b0 2024-04-24T23:00:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.918+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b00007400 con 0x7f9b14071690 2024-04-24T23:00:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.918+0000 7fc875200640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870161ca0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00e840 tx=0x7fc85c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1e404f500 con 0x7fd1e40b4780 2024-04-24T23:00:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7f9b10c00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9af406be30 0x7f9af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9b0008a670 con 0x7f9b14071690 2024-04-24T23:00:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dd401a070 con 0x7f2de40d1ee0 2024-04-24T23:00:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7f2249800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f223c186810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.919+0000 7f9b10c00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9af4075530 0x7f9af4077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b00009e50 con 0x7f9af4075530 2024-04-24T23:00:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b00091050 con 0x7f9b14071690 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2249800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f223c039650 0x7f223c02ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2249800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f223c02e310 0x7f223c032be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f9b13e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9af406be30 0x7f9af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f9b19800640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9af4075530 0x7f9af4077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2243e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f223c186810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2243400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f223c039650 0x7f223c02ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bcc009eb0 con 0x7f3bb40755e0 2024-04-24T23:00:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2dda000640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2dc406bf00 0x7f2dc406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2dd408a500 con 0x7f2de40d1ee0 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2249800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f223c054940 con 0x7f223c02e310 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2249800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0547c0 con 0x7f223c039650 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2249800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f223c04f550 con 0x7f222c004e40 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f223c186810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:37816/0 (socket says 172.21.15.146:37816) 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243e00640 1 -- 172.21.15.146:0/3140311837 learned_addr learned my addr 172.21.15.146:0/3140311837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.920+0000 7f2248e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f223c02e310 0x7f223c032be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f9b19800640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9af4075530 0x7f9af4077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2dda000640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f2dc4075600 0x7f2dc4077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dd401fe50 con 0x7f2dc4075600 2024-04-24T23:00:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f9b13e00640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9af406be30 0x7f9af406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b14071d70 tx=0x7f9b0c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c017070 con 0x7fc87014b2d0 2024-04-24T23:00:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c00c8e0 con 0x7fc87014b2d0 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00cc90 con 0x7fc87014b2d0 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f223c039650 0x7f223c02ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41874/0 (socket says 172.21.15.146:41874) 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243e00640 1 -- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f223c039650 msgr2=0x7f223c02ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f223c039650 0x7f223c02ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.921+0000 7f2243e00640 1 -- 172.21.15.146:0/3140311837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f223c02e310 msgr2=0x7f223c032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f2243e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f223c02e310 0x7f223c032be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f2243e00640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c189020 con 0x7f222c004e40 2024-04-24T23:00:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8700abc60 con 0x7fc87014b2d0 2024-04-24T23:00:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f2de1e00640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2dc406bf00 0x7f2dc406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f2de1400640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f2dc4075600 0x7f2dc4077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701621e0 con 0x7fc87014b2d0 2024-04-24T23:00:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.922+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2dd4091050 con 0x7f2de40d1ee0 2024-04-24T23:00:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7f2248e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f223c02e310 0x7f223c032be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7f2de1400640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f2dc4075600 0x7f2dc4077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8700ada20 con 0x7fc87014b2d0 2024-04-24T23:00:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7f2de1e00640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2dc406bf00 0x7f2dc406e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e250 tx=0x7f2ddc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b00009e50 con 0x7f9af4075530 2024-04-24T23:00:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.923+0000 7f2243e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f223c186810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2238011910 tx=0x7f2238011dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800faf0 con 0x7f222c004e40 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223800fc90 con 0x7f222c004e40 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238014440 con 0x7f222c004e40 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1dc01b070 con 0x7fd1e40b4780 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c189300 con 0x7f222c004e40 2024-04-24T23:00:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.924+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c1898c0 con 0x7f222c004e40 2024-04-24T23:00:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.925+0000 7fd1daa00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd1c406be80 0x7fd1c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.925+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f223c186d50 con 0x7f222c004e40 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.925+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd1dc08a6a0 con 0x7fd1e40b4780 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.925+0000 7fd1daa00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7fd1c4075600 0x7fd1c4077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.925+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1c4078110 con 0x7fd1c4075600 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.926+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1dc091050 con 0x7fd1e40b4780 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.926+0000 7fd1e2800640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd1c406be80 0x7fd1c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.926+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7fd1c4075600 0x7fd1c4077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.926+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2dd401fe50 con 0x7f2dc4075600 2024-04-24T23:00:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.927+0000 7fd1e2800640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd1c406be80 0x7fd1c406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4006fd0 tx=0x7fd1d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.928+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2238012040 con 0x7f222c004e40 2024-04-24T23:00:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.927+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc85c01a070 con 0x7fc87014b2d0 2024-04-24T23:00:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.928+0000 7fc86d600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc85c00ce30 con 0x7fc87014b2d0 2024-04-24T23:00:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7f2237e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7fc86d600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7fc850076320 0x7fc8500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f223808bed0 con 0x7f222c004e40 2024-04-24T23:00:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc850078e90 con 0x7fc850076320 2024-04-24T23:00:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc85c055e90 con 0x7fc87014b2d0 2024-04-24T23:00:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7f2237e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f2224075530 0x7f2224077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2238007e50 con 0x7f2224075530 2024-04-24T23:00:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.929+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f223808c280 con 0x7f222c004e40 2024-04-24T23:00:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.930+0000 7fc876600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7fc850076320 0x7fc8500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.930+0000 7f2248e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f2224075530 0x7f2224077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.931+0000 7fc876600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7fc850076320 0x7fc8500787c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.931+0000 7fc875c00640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.931+0000 7fd1e1e00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7fd1c4075600 0x7fd1c4077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.932+0000 7fc875c00640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc85006be80 0x7fc85006e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc864034000 tx=0x7fc86402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.931+0000 7f2243400640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f222406be30 0x7f222406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.933+0000 7f2243400640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f223c036560 tx=0x7f2230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.933+0000 7f2248e00640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f2224075530 0x7f2224077970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.933+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc850078e90 con 0x7fc850076320 2024-04-24T23:00:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.934+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1c4078110 con 0x7fd1c4075600 2024-04-24T23:00:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.935+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2238007e50 con 0x7f2224075530 2024-04-24T23:00:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.950+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52d806e150 con 0x7f52b8075530 2024-04-24T23:00:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.951+0000 7f52ce000640 1 -- 172.21.15.146:0/2298850876 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f52d806e150 con 0x7f52b8075530 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f52b8075530 msgr2=0x7f52b8077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f52b8075530 0x7f52b8077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52b806be30 msgr2=0x7f52b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52b806be30 0x7f52b806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ce960 tx=0x7f52c8007d30 comp rx=0 tx=0).stop 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 msgr2=0x7f52d815e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 --2- 172.21.15.146:0/2298850876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52d80cf7c0 0x7f52d815e870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52c40098c0 tx=0x7f52c40046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d6800640 1 -- 172.21.15.146:0/2298850876 reap_dead start 2024-04-24T23:00:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f0b6ac00640 1 -- 172.21.15.146:0/916293561 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b641513e0 con 0x7f0b400756b0 2024-04-24T23:00:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 shutdown_connections 2024-04-24T23:00:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.952+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 >> 172.21.15.146:0/2298850876 conn(0x7f52d806b140 msgr2=0x7f52d80cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.953+0000 7f0b5be00640 1 -- 172.21.15.146:0/916293561 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b641513e0 con 0x7f0b400756b0 2024-04-24T23:00:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.953+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 shutdown_connections 2024-04-24T23:00:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.953+0000 7f52d7200640 1 -- 172.21.15.146:0/2298850876 wait complete. 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f0b400756b0 msgr2=0x7f0b40077af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f0b400756b0 0x7f0b40077af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0b4006bf30 msgr2=0x7f0b4006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0b4006bf30 0x7f0b4006e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000f60 tx=0x7f0b4c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 msgr2=0x7f0b64150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b59600640 1 --2- 172.21.15.146:0/916293561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b6415ac20 0x7f0b64150ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c007e70 tx=0x7f0b5c00e4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.955+0000 7f0b68c00640 1 -- 172.21.15.146:0/916293561 reap_dead start 2024-04-24T23:00:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.957+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 shutdown_connections 2024-04-24T23:00:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.957+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bd406ea40 con 0x7f3bb40755e0 2024-04-24T23:00:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.957+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 >> 172.21.15.146:0/916293561 conn(0x7f0b6406b140 msgr2=0x7f0b64155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.957+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 shutdown_connections 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.958+0000 7f0b59600640 1 -- 172.21.15.146:0/916293561 wait complete. 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.958+0000 7f3bca000640 1 -- 172.21.15.146:0/3211095150 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bd406ea40 con 0x7f3bb40755e0 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f3bb40755e0 msgr2=0x7f3bb4077a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f3bb40755e0 0x7f3bb4077a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3bb406be60 msgr2=0x7f3bb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3bb406be60 0x7f3bb406e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0034000 tx=0x7f3bc002e000 comp rx=0 tx=0).stop 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd414beb0 msgr2=0x7f3bd4162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 --2- 172.21.15.146:0/3211095150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bd414beb0 0x7f3bd4162060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cae0 tx=0x7f3bcc00a060 comp rx=0 tx=0).stop 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd2800640 1 -- 172.21.15.146:0/3211095150 reap_dead start 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 shutdown_connections 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 >> 172.21.15.146:0/3211095150 conn(0x7f3bd406b140 msgr2=0x7f3bd41641c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.960+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 shutdown_connections 2024-04-24T23:00:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.960+0000 7f3bd8a00640 1 -- 172.21.15.146:0/3211095150 wait complete. 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.959+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b1404f500 con 0x7f9af4075530 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.961+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd1e40b2120 con 0x7fd1c4075600 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.962+0000 7fd1daa00640 1 -- 172.21.15.146:0/1772862241 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd1e40b2120 con 0x7fd1c4075600 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.963+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc87004f5a0 con 0x7fc850076320 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.963+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7fd1c4075600 msgr2=0x7fd1c4077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.963+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7fd1c4075600 0x7fd1c4077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd1c406be80 msgr2=0x7fd1c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7f9b10c00640 1 -- 172.21.15.146:0/164185193 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b1404f500 con 0x7f9af4075530 2024-04-24T23:00:26.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd1c406be80 0x7fd1c406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4006fd0 tx=0x7fd1d4008040 comp rx=0 tx=0).stop 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2de40d04e0 con 0x7f2dc4075600 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 msgr2=0x7fd1e4140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 --2- 172.21.15.146:0/1772862241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e40b4780 0x7fd1e4140530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c780 tx=0x7fd1dc00cc40 comp rx=0 tx=0).stop 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e3200640 1 -- 172.21.15.146:0/1772862241 reap_dead start 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 shutdown_connections 2024-04-24T23:00:26.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 >> 172.21.15.146:0/1772862241 conn(0x7fd1e40b1560 msgr2=0x7fd1e4074690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.964+0000 7fc86d600640 1 -- 172.21.15.146:0/1404469167 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc87004f5a0 con 0x7fc850076320 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9af4075530 msgr2=0x7f9af4077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9af4075530 0x7f9af4077970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 shutdown_connections 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7fd1e8a00640 1 -- 172.21.15.146:0/1772862241 wait complete. 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f2dda000640 1 -- 172.21.15.146:0/3465463003 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2de40d04e0 con 0x7f2dc4075600 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9af406be30 msgr2=0x7f9af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9af406be30 0x7f9af406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b14071d70 tx=0x7f9b0c009000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 msgr2=0x7f9b14151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.965+0000 7f9b1a200640 1 --2- 172.21.15.146:0/164185193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b14071690 0x7f9b14151ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000c3c0 tx=0x7f9b0000c880 comp rx=0 tx=0).stop 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f9b19800640 1 -- 172.21.15.146:0/164185193 reap_dead start 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 shutdown_connections 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 >> 172.21.15.146:0/164185193 conn(0x7f9b1406b140 msgr2=0x7f9b1415f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 shutdown_connections 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f2dc4075600 msgr2=0x7f2dc4077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f2dc4075600 0x7f2dc4077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7fc850076320 msgr2=0x7fc8500787c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7fc878600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7fc850076320 0x7fc8500787c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f9b1a200640 1 -- 172.21.15.146:0/164185193 wait complete. 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2dc406bf00 msgr2=0x7f2dc406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2dc406bf00 0x7f2dc406e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e250 tx=0x7f2ddc00b040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 msgr2=0x7f2de40cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de8c00640 1 --2- 172.21.15.146:0/3465463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de40d1ee0 0x7f2de40cb040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c3c0 tx=0x7f2dd400c880 comp rx=0 tx=0).stop 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.966+0000 7f2de2800640 1 -- 172.21.15.146:0/3465463003 reap_dead start 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 shutdown_connections 2024-04-24T23:00:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc85006be80 msgr2=0x7fc85006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 >> 172.21.15.146:0/3465463003 conn(0x7f2de40d3f70 msgr2=0x7f2de40b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc878600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc85006be80 0x7fc85006e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc864034000 tx=0x7fc86402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 msgr2=0x7fc870161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc878600640 1 --2- 172.21.15.146:0/1404469167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87014b2d0 0x7fc870161ca0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00e840 tx=0x7fc85c00ed00 comp rx=0 tx=0).stop 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 shutdown_connections 2024-04-24T23:00:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7f2de8c00640 1 -- 172.21.15.146:0/3465463003 wait complete. 2024-04-24T23:00:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc876600640 1 -- 172.21.15.146:0/1404469167 reap_dead start 2024-04-24T23:00:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.967+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 shutdown_connections 2024-04-24T23:00:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.968+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 >> 172.21.15.146:0/1404469167 conn(0x7fc87006b140 msgr2=0x7fc870146610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.968+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 shutdown_connections 2024-04-24T23:00:27.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.968+0000 7fc878600640 1 -- 172.21.15.146:0/1404469167 wait complete. 2024-04-24T23:00:27.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.969+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f223c005390 con 0x7f2224075530 2024-04-24T23:00:27.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.970+0000 7f2237e00640 1 -- 172.21.15.146:0/3140311837 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f223c005390 con 0x7f2224075530 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f2224075530 msgr2=0x7f2224077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f2224075530 0x7f2224077970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f222406be30 msgr2=0x7f222406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f222406be30 0x7f222406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f223c036560 tx=0x7f2230008040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 msgr2=0x7f223c186810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.971+0000 7f2249800640 1 --2- 172.21.15.146:0/3140311837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f222c004e40 0x7f223c186810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2238011910 tx=0x7f2238011dd0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.974+0000 7f2248e00640 1 -- 172.21.15.146:0/3140311837 reap_dead start 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.974+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 shutdown_connections 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.974+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 >> 172.21.15.146:0/3140311837 conn(0x7f223c009fb0 msgr2=0x7f223c006530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.974+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 shutdown_connections 2024-04-24T23:00:27.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:26.974+0000 7f2249800640 1 -- 172.21.15.146:0/3140311837 wait complete. 2024-04-24T23:00:27.009 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:27.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:00:27.010 INFO:teuthology.orchestra.run.smithi146.stdout:64424509452 2024-04-24T23:00:27.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:00:27.012 INFO:teuthology.orchestra.run.smithi146.stdout:64424509452 2024-04-24T23:00:27.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:00:27.013 INFO:teuthology.orchestra.run.smithi146.stdout:60129542156 2024-04-24T23:00:27.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:00:27.014 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:27.014 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:00:27.015 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:27.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:00:27.016 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:27.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:00:27.017 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:27.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.323+0000 7f4dff200640 1 Processor -- start 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.324+0000 7f4dff200640 1 -- start start 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.326+0000 7f4dff200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 0x7f4df80e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.326+0000 7f4dff200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df8058050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.326+0000 7f4dff200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df8058590 con 0x7f4df8053cb0 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.326+0000 7f4dff200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4df8007b70 con 0x7f4df80e3160 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.326+0000 7f4dff200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4df8058810 con 0x7f4df803c0a0 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.327+0000 7f4dfde00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 0x7f4df80e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.327+0000 7f4dfde00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 0x7f4df80e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41888/0 (socket says 172.21.15.146:41888) 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.327+0000 7f4dfde00640 1 -- 172.21.15.146:0/13384179 learned_addr learned my addr 172.21.15.146:0/13384179 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.327+0000 7f4dfd400640 1 --2- 172.21.15.146:0/13384179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df8058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.328+0000 7f4dfd400640 1 -- 172.21.15.146:0/13384179 >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 msgr2=0x7f4df80e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.328+0000 7f4dfd400640 1 --2- 172.21.15.146:0/13384179 >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 0x7f4df80e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.328+0000 7f4dfd400640 1 -- 172.21.15.146:0/13384179 >> v1:172.21.15.203:6789/0 conn(0x7f4df8053cb0 legacy=0x7f4df8054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.328+0000 7f4dfd400640 1 -- 172.21.15.146:0/13384179 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df8058af0 con 0x7f4df803c0a0 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.330+0000 7f4dfd400640 1 --2- 172.21.15.146:0/13384179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df8058050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0097a0 tx=0x7f4dec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392a6cdbbbf8c988 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.332+0000 7f4dfca00640 1 -- 172.21.15.146:0/13384179 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec037070 con 0x7f4df803c0a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.332+0000 7f4dfca00640 1 -- 172.21.15.146:0/13384179 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec032440 con 0x7f4df803c0a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.332+0000 7f4dfca00640 1 -- 172.21.15.146:0/13384179 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0327f0 con 0x7f4df803c0a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.332+0000 7f4dff200640 1 -- 172.21.15.146:0/13384179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 msgr2=0x7f4df8058050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.332+0000 7f4dff200640 1 --2- 172.21.15.146:0/13384179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df8058050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0097a0 tx=0x7f4dec02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.333+0000 7f4dff200640 1 -- 172.21.15.146:0/13384179 shutdown_connections 2024-04-24T23:00:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.333+0000 7f4dff200640 1 --2- 172.21.15.146:0/13384179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df8058050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.333+0000 7f4dff200640 1 --2- 172.21.15.146:0/13384179 >> v2:172.21.15.203:3300/0 conn(0x7f4df80e3160 0x7f4df80e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.333+0000 7f4dff200640 1 -- 172.21.15.146:0/13384179 >> 172.21.15.146:0/13384179 conn(0x7f4df8058ee0 msgr2=0x7f4df80592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.333+0000 7f4dff200640 1 -- 172.21.15.146:0/13384179 shutdown_connections 2024-04-24T23:00:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.334+0000 7f4dff200640 1 -- 172.21.15.146:0/13384179 wait complete. 2024-04-24T23:00:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.336+0000 7f4dff200640 1 Processor -- start 2024-04-24T23:00:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.337+0000 7f4dff200640 1 -- start start 2024-04-24T23:00:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.337+0000 7f3e81200640 1 Processor -- start 2024-04-24T23:00:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.337+0000 7f3e81200640 1 -- start start 2024-04-24T23:00:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f710a600640 1 Processor -- start 2024-04-24T23:00:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f3e81200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f3e81200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 0x7f3e7c160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f3e81200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7c0cfae0 con 0x7f3e7c15c010 2024-04-24T23:00:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f3e81200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7c0cfdc0 con 0x7f3e7c15c3f0 2024-04-24T23:00:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.339+0000 7f3e81200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7c0d00a0 con 0x7f3e7c0cda70 2024-04-24T23:00:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df816cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df8053cb0 0x7f4df8178db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f3e79400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 0x7f4df80c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4df80e3540 con 0x7f4df80e3160 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4df8006640 con 0x7f4df8053cb0 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dff200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4df8006b60 con 0x7f4df803c0a0 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f710a600640 1 -- start start 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f3e79400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:37822/0 (socket says 172.21.15.146:37822) 2024-04-24T23:00:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f3e79400640 1 -- 172.21.15.146:0/1583169999 learned_addr learned my addr 172.21.15.146:0/1583169999 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.341+0000 7f3e7a800640 1 --2- 172.21.15.146:0/1583169999 >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 0x7f3e7c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.340+0000 7f4dfe800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 0x7f4df80c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.341+0000 7f4dfde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df816cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.341+0000 7f4dfde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df816cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:37824/0 (socket says 172.21.15.146:37824) 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.341+0000 7f4dfde00640 1 -- 172.21.15.146:0/2855203595 learned_addr learned my addr 172.21.15.146:0/2855203595 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.341+0000 7f4dfd400640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df8053cb0 0x7f4df8178db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f4dfe800640 1 -- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 msgr2=0x7f4df816cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f4dfe800640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df816cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f4dfe800640 1 -- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df8053cb0 msgr2=0x7f4df8178db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f4dfe800640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df8053cb0 0x7f4df8178db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f4dfe800640 1 -- 172.21.15.146:0/2855203595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df80c6370 con 0x7f4df80e3160 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f3e79400640 1 -- 172.21.15.146:0/1583169999 >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 msgr2=0x7f3e7c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f3e79400640 1 --2- 172.21.15.146:0/1583169999 >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 0x7f3e7c160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f3e79400640 1 -- 172.21.15.146:0/1583169999 >> v1:172.21.15.146:6789/0 conn(0x7f3e7c15c010 legacy=0x7f3e7c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f3e79400640 1 -- 172.21.15.146:0/1583169999 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c0d0380 con 0x7f3e7c0cda70 2024-04-24T23:00:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f3e7a800640 1 --2- 172.21.15.146:0/1583169999 >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 0x7f3e7c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f710a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71040b3ac0 0x7f7104072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f710a600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710414c0e0 con 0x7f71040712b0 2024-04-24T23:00:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f710a600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710406d770 con 0x7f710414b2d0 2024-04-24T23:00:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f710a600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f710414b6b0 con 0x7f71040b3ac0 2024-04-24T23:00:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f8d2fa00640 1 Processor -- start 2024-04-24T23:00:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.343+0000 7f7103400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f710414b2d0 0x7f7104070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:54164/0 (socket says 172.21.15.146:54164) 2024-04-24T23:00:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.343+0000 7f7103400640 1 -- 172.21.15.146:0/2102374684 learned_addr learned my addr 172.21.15.146:0/2102374684 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.343+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638341754 0 0) 0x7f710406d770 con 0x7f710414b2d0 2024-04-24T23:00:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.343+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70e8003520 con 0x7f710414b2d0 2024-04-24T23:00:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.343+0000 7f4dfe800640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 0x7f4df80c7410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e00050e00 tx=0x7f4e00068c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.342+0000 7f8d2fa00640 1 -- start start 2024-04-24T23:00:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0008f070 con 0x7f4df80e3160 2024-04-24T23:00:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3259336311 0 0) 0x7f70e8003520 con 0x7f710414b2d0 2024-04-24T23:00:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 >> v2:172.21.15.146:3300/0 conn(0x7f71040b3ac0 msgr2=0x7f7104072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 --2- 172.21.15.146:0/2102374684 >> v2:172.21.15.146:3300/0 conn(0x7f71040b3ac0 0x7f7104072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 >> v1:172.21.15.146:6789/0 conn(0x7f71040712b0 legacy=0x7f710416a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710406da50 con 0x7f710414b2d0 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f70fc0019f0 con 0x7f710414b2d0 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 >> v1:172.21.15.203:6789/0 conn(0x7f710414b2d0 legacy=0x7f7104070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70e80039b0 0x7f70e8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f70e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70e80052e0 0x7f70e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f710414b6b0 con 0x7f70e80039b0 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70e800c1e0 con 0x7f70e8004800 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70e800c3e0 con 0x7f70e80052e0 2024-04-24T23:00:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df80c6650 con 0x7f4df80e3160 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df80c6c10 con 0x7f4df80e3160 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e00073750 con 0x7f4df80e3160 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.344+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0008f070 con 0x7f4df80e3160 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f3e79400640 1 --2- 172.21.15.146:0/1583169999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009870 tx=0x7f3e6802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee49dcbcad865ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d2806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2fa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d28071a80 0x7f8d280b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2fa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d280b2820 con 0x7f8d2806b140 2024-04-24T23:00:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2fa00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8d280d1180 con 0x7f8d28071a80 2024-04-24T23:00:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280d0600 con 0x7f8d280b1f00 2024-04-24T23:00:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f7102a00640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f70e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f7103400640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70e80039b0 0x7f70e8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f7103e00640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70e80052e0 0x7f70e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2da00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f8d2806b140 0x7f8d2806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:54178/0 (socket says 172.21.15.146:54178) 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.345+0000 7f8d2da00640 1 -- 172.21.15.146:0/2999597549 learned_addr learned my addr 172.21.15.146:0/2999597549 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f8d2d000640 1 --2- 172.21.15.146:0/2999597549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d2806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f7102a00640 1 -- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70e80052e0 msgr2=0x7f70e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f7102a00640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70e80052e0 0x7f70e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f7102a00640 1 -- 172.21.15.146:0/2102374684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70e80039b0 msgr2=0x7f70e8003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f7102a00640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70e80039b0 0x7f70e8003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f7102a00640 1 -- 172.21.15.146:0/2102374684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710406da50 con 0x7f70e8004800 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f8d2d000640 1 -- 172.21.15.146:0/2999597549 >> v2:172.21.15.146:3300/0 conn(0x7f8d28071a80 msgr2=0x7f8d280b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f8d2d000640 1 --2- 172.21.15.146:0/2999597549 >> v2:172.21.15.146:3300/0 conn(0x7f8d28071a80 0x7f8d280b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f8d2d000640 1 -- 172.21.15.146:0/2999597549 >> v1:172.21.15.203:6789/0 conn(0x7f8d2806b140 legacy=0x7f8d2806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.346+0000 7f8d2d000640 1 -- 172.21.15.146:0/2999597549 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d280d08e0 con 0x7f8d280b1f00 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.347+0000 7f7103e00640 1 -- 172.21.15.146:0/2102374684 reap_dead start 2024-04-24T23:00:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.347+0000 7f3e78a00640 1 -- 172.21.15.146:0/1583169999 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68037070 con 0x7f3e7c0cda70 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.347+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd8005290 con 0x7f4df80e3160 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.347+0000 7f3e78a00640 1 -- 172.21.15.146:0/1583169999 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6802ae50 con 0x7f3e7c0cda70 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.347+0000 7f3e78a00640 1 -- 172.21.15.146:0/1583169999 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68032860 con 0x7f3e7c0cda70 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 -- 172.21.15.146:0/1583169999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 msgr2=0x7f3e7c15fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 --2- 172.21.15.146:0/1583169999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009870 tx=0x7f3e6802a300 comp rx=0 tx=0).stop 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 -- 172.21.15.146:0/1583169999 shutdown_connections 2024-04-24T23:00:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 --2- 172.21.15.146:0/1583169999 >> v2:172.21.15.203:3300/0 conn(0x7f3e7c15c3f0 0x7f3e7c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 --2- 172.21.15.146:0/1583169999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c0cda70 0x7f3e7c15fd30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 -- 172.21.15.146:0/1583169999 >> 172.21.15.146:0/1583169999 conn(0x7f3e7c0d1d70 msgr2=0x7f3e7c0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f8d2d000640 1 --2- 172.21.15.146:0/2999597549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d2806c610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097a0 tx=0x7f8d1802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de23a0867178043 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 -- 172.21.15.146:0/1583169999 shutdown_connections 2024-04-24T23:00:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f3e81200640 1 -- 172.21.15.146:0/1583169999 wait complete. 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f8d27400640 1 -- 172.21.15.146:0/2999597549 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18037070 con 0x7f8d280b1f00 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f8d27400640 1 -- 172.21.15.146:0/2999597549 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d18032440 con 0x7f8d280b1f00 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f8d27400640 1 -- 172.21.15.146:0/2999597549 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18032850 con 0x7f8d280b1f00 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.349+0000 7f7102a00640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f70e8004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001620 tx=0x7f70e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1ec2165e35fc80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.350+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0001220 con 0x7f70e8004800 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.350+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f002e070 con 0x7f70e8004800 2024-04-24T23:00:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.350+0000 7f7102000640 1 -- 172.21.15.146:0/2102374684 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f002a770 con 0x7f70e8004800 2024-04-24T23:00:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 -- 172.21.15.146:0/2999597549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 msgr2=0x7f8d2806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/2999597549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d2806c610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097a0 tx=0x7f8d1802a130 comp rx=0 tx=0).stop 2024-04-24T23:00:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f710a600640 1 -- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 msgr2=0x7f70e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f710a600640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f70e8004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001620 tx=0x7f70e8005830 comp rx=0 tx=0).stop 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 -- 172.21.15.146:0/2999597549 shutdown_connections 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/2999597549 >> v2:172.21.15.146:3300/0 conn(0x7f8d28071a80 0x7f8d280b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/2999597549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d2806c610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f8d2fa00640 1 -- 172.21.15.146:0/2999597549 >> 172.21.15.146:0/2999597549 conn(0x7f8d280b3e70 msgr2=0x7f8d280b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f3e81200640 1 Processor -- start 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.351+0000 7f710a600640 1 -- 172.21.15.146:0/2102374684 shutdown_connections 2024-04-24T23:00:27.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f710a600640 1 --2- 172.21.15.146:0/2102374684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f70e8004c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f710a600640 1 -- 172.21.15.146:0/2102374684 >> 172.21.15.146:0/2102374684 conn(0x7f710406b140 msgr2=0x7f710406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f8d2fa00640 1 -- 172.21.15.146:0/2999597549 shutdown_connections 2024-04-24T23:00:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f3e81200640 1 -- start start 2024-04-24T23:00:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f8d2fa00640 1 -- 172.21.15.146:0/2999597549 wait complete. 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.352+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e00092070 con 0x7f4df80e3160 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7fc81dc00640 1 Processor -- start 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c15c010 0x7f3e7c0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c15c3f0 0x7f3e7c0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c0d0d00 con 0x7f3e7c15c010 2024-04-24T23:00:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c0d0b80 con 0x7f3e7c0cda70 2024-04-24T23:00:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f3e81200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7c166060 con 0x7f3e7c15c3f0 2024-04-24T23:00:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f38ef000640 1 Processor -- start 2024-04-24T23:00:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7fc81dc00640 1 -- start start 2024-04-24T23:00:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.353+0000 7f38ef000640 1 -- start start 2024-04-24T23:00:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f4df6000640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 0x7f4de006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4e00106060 con 0x7f4df80e3160 2024-04-24T23:00:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f3e79e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f3e79e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41934/0 (socket says 172.21.15.146:41934) 2024-04-24T23:00:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f8d2fa00640 1 Processor -- start 2024-04-24T23:00:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f710a600640 1 -- 172.21.15.146:0/2102374684 shutdown_connections 2024-04-24T23:00:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f3e79e00640 1 -- 172.21.15.146:0/1444601057 learned_addr learned my addr 172.21.15.146:0/1444601057 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f3e7a800640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c15c3f0 0x7f3e7c0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f8d2fa00640 1 -- start start 2024-04-24T23:00:27.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f3e79e00640 1 -- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c15c3f0 msgr2=0x7f3e7c0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f3e79e00640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c15c3f0 0x7f3e7c0afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f3e79e00640 1 -- 172.21.15.146:0/1444601057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c15c010 msgr2=0x7f3e7c0c8e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-24T23:00:27.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.354+0000 7f710a600640 1 -- 172.21.15.146:0/2102374684 wait complete. 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f3e79e00640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c15c010 0x7f3e7c0c8e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f3e79e00640 1 -- 172.21.15.146:0/1444601057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c151260 con 0x7f3e7c0cda70 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f38ef000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38e80712b0 0x7f38e8072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.355+0000 7f38ef000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f38e80b3ac0 0x7f38e816c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38ef000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e814c0e0 con 0x7f38e814b2d0 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38ef000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f38e814b6b0 con 0x7f38e80712b0 2024-04-24T23:00:27.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38ef000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f38e806e380 con 0x7f38e80b3ac0 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 0x7f8d28168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 0x7f8d28155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d28155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d02b0 con 0x7f8d2806b140 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d0ea0 con 0x7f8d28071a80 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f8d2fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280ae5d0 con 0x7f8d280b1f00 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38e7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f38e814b2d0 0x7f38e8070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47464/0 (socket says 172.21.15.146:47464) 2024-04-24T23:00:27.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38e7400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38e80712b0 0x7f38e8072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7f38e7e00640 1 -- 172.21.15.146:0/1447496737 learned_addr learned my addr 172.21.15.146:0/1447496737 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7fc81dc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc8180d2720 0x7fc8180b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f38ed000640 1 --2- 172.21.15.146:0/1447496737 >> v2:172.21.15.203:3300/0 conn(0x7f38e80b3ac0 0x7f38e816c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f4dfde00640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 0x7f4de006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7fc81dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8180d0d20 0x7fc8180b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7fc81dc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8180d4a50 con 0x7fc81815e050 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7fc81dc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc8180d4800 con 0x7fc8180d0d20 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.356+0000 7fc81dc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc8180b3190 con 0x7fc8180d2720 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f8d27e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 0x7f8d28155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f8d2d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 0x7f8d28168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f8d27e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 0x7f8d28155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41956/0 (socket says 172.21.15.146:41956) 2024-04-24T23:00:27.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f8d27e00640 1 -- 172.21.15.146:0/334832280 learned_addr learned my addr 172.21.15.146:0/334832280 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f8d2da00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d28155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f3e79e00640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c450 tx=0x7f3e6c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7fc817e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc81815e050 0x7fc8180d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47472/0 (socket says 172.21.15.146:47472) 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7fc817e00640 1 -- 172.21.15.146:0/3318053756 learned_addr learned my addr 172.21.15.146:0/3318053756 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f38e7400640 1 -- 172.21.15.146:0/1447496737 >> v2:172.21.15.203:3300/0 conn(0x7f38e80b3ac0 msgr2=0x7f38e816c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f38e7400640 1 --2- 172.21.15.146:0/1447496737 >> v2:172.21.15.203:3300/0 conn(0x7f38e80b3ac0 0x7f38e816c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.357+0000 7f38e7400640 1 -- 172.21.15.146:0/1447496737 >> v1:172.21.15.146:6789/0 conn(0x7f38e814b2d0 legacy=0x7f38e8070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7fc81d200640 1 --2- 172.21.15.146:0/3318053756 >> v2:172.21.15.146:3300/0 conn(0x7fc8180d0d20 0x7fc8180b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f38e7400640 1 -- 172.21.15.146:0/1447496737 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e806d770 con 0x7f38e80712b0 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f8d2d000640 1 -- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 msgr2=0x7f8d28155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f8d2d000640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d28155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f8d2d000640 1 -- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 msgr2=0x7f8d28155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f8d2d000640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 0x7f8d28155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.358+0000 7f8d2d000640 1 -- 172.21.15.146:0/334832280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d281f8860 con 0x7f8d2806b140 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0052d0 con 0x7f3e7c0cda70 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c005470 con 0x7f3e7c0cda70 2024-04-24T23:00:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c012850 con 0x7f3e7c0cda70 2024-04-24T23:00:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f4dfde00640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 0x7f4de006e4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006f40 tx=0x7f4df0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7fc81d200640 1 -- 172.21.15.146:0/3318053756 >> v2:172.21.15.203:3300/0 conn(0x7fc8180d2720 msgr2=0x7fc8180b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7fc817400640 1 --2- 172.21.15.146:0/3318053756 >> v2:172.21.15.203:3300/0 conn(0x7fc8180d2720 0x7fc8180b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f710a600640 1 Processor -- start 2024-04-24T23:00:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7fc81d200640 1 --2- 172.21.15.146:0/3318053756 >> v2:172.21.15.203:3300/0 conn(0x7fc8180d2720 0x7fc8180b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f8d2d000640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 0x7f8d28168690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d18031000 tx=0x7f8d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7fc81d200640 1 -- 172.21.15.146:0/3318053756 >> v1:172.21.15.146:6789/0 conn(0x7fc81815e050 legacy=0x7fc8180d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7fc81d200640 1 -- 172.21.15.146:0/3318053756 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8180b33e0 con 0x7fc8180d0d20 2024-04-24T23:00:27.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c0cac70 con 0x7f3e7c0cda70 2024-04-24T23:00:27.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c0cb230 con 0x7f3e7c0cda70 2024-04-24T23:00:27.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.360+0000 7f38e7400640 1 --2- 172.21.15.146:0/1447496737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80712b0 0x7f38e8072a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f38e80af5c0 tx=0x7f38d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a558ae322cc8a73f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.359+0000 7f710a600640 1 -- start start 2024-04-24T23:00:27.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.360+0000 7ff42a600640 1 Processor -- start 2024-04-24T23:00:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7ff42a600640 1 -- start start 2024-04-24T23:00:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7fc81d200640 1 --2- 172.21.15.146:0/3318053756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d0d20 0x7fc8180b4120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc818161b90 tx=0x7fc81002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f869f5b90762836c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e54005290 con 0x7f3e7c0cda70 2024-04-24T23:00:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18042020 con 0x7f8d2806b140 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71041eb540 0x7f71040a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710413a7d0 0x7f71040a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f710406e010 con 0x7f710413a7d0 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f710406e380 con 0x7f70e8004800 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f710a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f710414b870 con 0x7f71041eb540 2024-04-24T23:00:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d180308f0 con 0x7f8d2806b140 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18037040 con 0x7f8d2806b140 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7fc961800640 1 Processor -- start 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.361+0000 7f38e6a00640 1 -- 172.21.15.146:0/1447496737 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037070 con 0x7f38e80712b0 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f38e6a00640 1 -- 172.21.15.146:0/1447496737 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d8032440 con 0x7f38e80712b0 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f38e6a00640 1 -- 172.21.15.146:0/1447496737 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037070 con 0x7f38e80712b0 2024-04-24T23:00:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7fc961800640 1 -- start start 2024-04-24T23:00:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f7103400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f7103400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41970/0 (socket says 172.21.15.146:41970) 2024-04-24T23:00:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f7103400640 1 -- 172.21.15.146:0/2553924805 learned_addr learned my addr 172.21.15.146:0/2553924805 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7fc816a00640 1 -- 172.21.15.146:0/3318053756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810007740 con 0x7fc8180d0d20 2024-04-24T23:00:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7fc816a00640 1 -- 172.21.15.146:0/3318053756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8100078e0 con 0x7fc8180d0d20 2024-04-24T23:00:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7fc816a00640 1 -- 172.21.15.146:0/3318053756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810007cb0 con 0x7fc8180d0d20 2024-04-24T23:00:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f7102a00640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71041eb540 0x7f71040a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4df8058590 con 0x7f4df80e3160 2024-04-24T23:00:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 -- 172.21.15.146:0/1447496737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80712b0 msgr2=0x7f38e8072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d28158a50 con 0x7f8d2806b140 2024-04-24T23:00:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.362+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281f8e00 con 0x7f8d2806b140 2024-04-24T23:00:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 --2- 172.21.15.146:0/1447496737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80712b0 0x7f38e8072a10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f38e80af5c0 tx=0x7f38d802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff42a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 0x7ff4240b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff42a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff4240d2c60 0x7ff4240b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 -- 172.21.15.146:0/1447496737 shutdown_connections 2024-04-24T23:00:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff42a600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4240cf7a0 con 0x7ff4240b5590 2024-04-24T23:00:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff42a600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff4240b6dc0 con 0x7ff4241619c0 2024-04-24T23:00:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff42a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff4240cfa40 con 0x7ff4240d2c60 2024-04-24T23:00:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 --2- 172.21.15.146:0/1447496737 >> v2:172.21.15.203:3300/0 conn(0x7f38e80b3ac0 0x7f38e816c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 --2- 172.21.15.146:0/1447496737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80712b0 0x7f38e8072a10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7f38ef000640 1 -- 172.21.15.146:0/1447496737 >> 172.21.15.146:0/1447496737 conn(0x7f38e806b140 msgr2=0x7f38e806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff423e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff4240d2c60 0x7ff4240b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff423e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff4240d2c60 0x7ff4240b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41980/0 (socket says 172.21.15.146:41980) 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.363+0000 7ff423e00640 1 -- 172.21.15.146:0/1562740108 learned_addr learned my addr 172.21.15.146:0/1562740108 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 -- 172.21.15.146:0/3318053756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d0d20 msgr2=0x7fc8180b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 --2- 172.21.15.146:0/3318053756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d0d20 0x7fc8180b4120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc818161b90 tx=0x7fc81002a5f0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103e00640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710413a7d0 0x7f71040a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2804f5a0 con 0x7f8d2806b140 2024-04-24T23:00:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f38ef000640 1 -- 172.21.15.146:0/1447496737 shutdown_connections 2024-04-24T23:00:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f38ef000640 1 -- 172.21.15.146:0/1447496737 wait complete. 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 -- 172.21.15.146:0/3318053756 shutdown_connections 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 --2- 172.21.15.146:0/3318053756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d0d20 0x7fc8180b4120 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 --2- 172.21.15.146:0/3318053756 >> v2:172.21.15.203:3300/0 conn(0x7fc8180d2720 0x7fc8180b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 -- 172.21.15.146:0/3318053756 >> 172.21.15.146:0/3318053756 conn(0x7fc8180d3ce0 msgr2=0x7fc8180d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7fc81dc00640 1 -- 172.21.15.146:0/3318053756 shutdown_connections 2024-04-24T23:00:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423400640 1 --2- 172.21.15.146:0/1562740108 >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 0x7ff4240b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423e00640 1 -- 172.21.15.146:0/1562740108 >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 msgr2=0x7ff4240b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423e00640 1 --2- 172.21.15.146:0/1562740108 >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 0x7ff4240b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423e00640 1 -- 172.21.15.146:0/1562740108 >> v1:172.21.15.146:6789/0 conn(0x7ff4240b5590 legacy=0x7ff4240d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423e00640 1 -- 172.21.15.146:0/1562740108 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4240cfd20 con 0x7ff4240d2c60 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7ff423400640 1 --2- 172.21.15.146:0/1562740108 >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 0x7ff4240b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103400640 1 -- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71041eb540 msgr2=0x7f71040a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103400640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71041eb540 0x7f71040a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103400640 1 -- 172.21.15.146:0/2553924805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710413a7d0 msgr2=0x7f71040a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103400640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710413a7d0 0x7f71040a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.364+0000 7f7103400640 1 -- 172.21.15.146:0/2553924805 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71041f7d80 con 0x7f70e8004800 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.365+0000 7fc961800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc95c0712b0 0x7fc95c072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.365+0000 7fc961800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc95c0b3ac0 0x7fc95c16c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.365+0000 7fc961800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c14c0e0 con 0x7fc95c14b2d0 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.365+0000 7fc961800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c14b6b0 con 0x7fc95c0712b0 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.365+0000 7fc961800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c06e380 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.366+0000 7fc95aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc95c14b2d0 0x7fc95c070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47492/0 (socket says 172.21.15.146:47492) 2024-04-24T23:00:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.366+0000 7fc95aa00640 1 -- 172.21.15.146:0/880293061 learned_addr learned my addr 172.21.15.146:0/880293061 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.366+0000 7fc95b400640 1 --2- 172.21.15.146:0/880293061 >> v2:172.21.15.203:3300/0 conn(0x7fc95c0b3ac0 0x7fc95c16c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.366+0000 7f38ef000640 1 Processor -- start 2024-04-24T23:00:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.367+0000 7fc95b400640 1 -- 172.21.15.146:0/880293061 >> v2:172.21.15.146:3300/0 conn(0x7fc95c0712b0 msgr2=0x7fc95c072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.367+0000 7fc95b400640 1 --2- 172.21.15.146:0/880293061 >> v2:172.21.15.146:3300/0 conn(0x7fc95c0712b0 0x7fc95c072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.367+0000 7fc95b400640 1 -- 172.21.15.146:0/880293061 >> v1:172.21.15.146:6789/0 conn(0x7fc95c14b2d0 legacy=0x7fc95c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.367+0000 7fc95b400640 1 -- 172.21.15.146:0/880293061 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c06d770 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.367+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e6c0129f0 con 0x7f3e7c0cda70 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7f3e72000640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 0x7f3e5c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7f7103400640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70fc007a80 tx=0x7f70fc00e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7ff423e00640 1 --2- 172.21.15.146:0/1562740108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4240d2c60 0x7ff4240b7530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4240b6f40 tx=0x7ff41c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a5f3fcbdd2e31ac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7f3e79400640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 0x7f3e5c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.366+0000 7fc81dc00640 1 -- 172.21.15.146:0/3318053756 wait complete. 2024-04-24T23:00:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7fc81dc00640 1 Processor -- start 2024-04-24T23:00:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7fc95b400640 1 --2- 172.21.15.146:0/880293061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c16c080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0af5c0 tx=0x7fc95402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e03426c37f0d46e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7fc81dc00640 1 -- start start 2024-04-24T23:00:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3e6c08b7d0 con 0x7f3e7c0cda70 2024-04-24T23:00:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d18045020 con 0x7f8d2806b140 2024-04-24T23:00:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f3e79400640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 0x7f3e5c06e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e68034000 tx=0x7f3e6802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.368+0000 7f38ef000640 1 -- start start 2024-04-24T23:00:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38e80712b0 0x7f38e81612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 0x7f38e80af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 0x7f38e80c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38e806e010 con 0x7f38e80b3ac0 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f38e806dd30 con 0x7f38e814b2d0 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.369+0000 7f38ef000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38e814b870 con 0x7f38e80712b0 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f38ed000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 0x7f38e80c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f38ed000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 0x7f38e80c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41994/0 (socket says 172.21.15.146:41994) 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f38ed000640 1 -- 172.21.15.146:0/3348179689 learned_addr learned my addr 172.21.15.146:0/3348179689 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f8d24c00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 0x7f8d0806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f38e7400640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 0x7f38e80af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8d180ac250 con 0x7f8d2806b140 2024-04-24T23:00:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.370+0000 7f8d27e00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 0x7f8d0806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7e00640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38e80712b0 0x7f38e81612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7fc81dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 0x7fc8180c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7fc81dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 -- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38e80712b0 msgr2=0x7f38e81612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38e80712b0 0x7f38e81612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 -- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 msgr2=0x7f38e80c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 0x7f38e80c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 -- 172.21.15.146:0/3348179689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e80c4b30 con 0x7f38e80b3ac0 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7fc81dc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 0x7fc8180ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7f38e7400640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 0x7f38e80af290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38d8031000 tx=0x7f38d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.371+0000 7fc817e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 0x7fc8180c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7f8d27e00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 0x7f8d0806e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d281543b0 tx=0x7f8d14009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc817e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 0x7fc8180c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:37904/0 (socket says 172.21.15.146:37904) 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc817400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc817400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34566/0 (socket says 172.21.15.146:34566) 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc81d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 0x7fc8180ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc81d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 0x7fc8180ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41998/0 (socket says 172.21.15.146:41998) 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.372+0000 7fc817e00640 1 -- 172.21.15.146:0/2353651106 learned_addr learned my addr 172.21.15.146:0/2353651106 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180cfa70 con 0x7fc8180d2720 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180b3750 con 0x7fc81815e050 2024-04-24T23:00:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180cfbf0 con 0x7fc8180d0d20 2024-04-24T23:00:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037040 con 0x7f38e80b3ac0 2024-04-24T23:00:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d8042070 con 0x7f38e80b3ac0 2024-04-24T23:00:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8032a50 con 0x7f38e80b3ac0 2024-04-24T23:00:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.373+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d1804c030 con 0x7f8d2806b140 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 -- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 msgr2=0x7fc8180c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 0x7fc8180c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 -- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 msgr2=0x7fc8180ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 0x7fc8180ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8181555c0 con 0x7fc8180d2720 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e80c4e10 con 0x7f38e80b3ac0 2024-04-24T23:00:27.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7fc817400640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c610 tx=0x7fc80400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.374+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e8161800 con 0x7f38e80b3ac0 2024-04-24T23:00:27.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.375+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804015070 con 0x7fc8180d2720 2024-04-24T23:00:27.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.375+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc804004220 con 0x7fc8180d2720 2024-04-24T23:00:27.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.375+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804003610 con 0x7fc8180d2720 2024-04-24T23:00:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.375+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8181558a0 con 0x7fc8180d2720 2024-04-24T23:00:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.376+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc818155e60 con 0x7fc8180d2720 2024-04-24T23:00:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.377+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38d8032bf0 con 0x7f38e80b3ac0 2024-04-24T23:00:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.377+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e8149920 con 0x7f38e80b3ac0 2024-04-24T23:00:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.378+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81804f500 con 0x7fc8180d2720 2024-04-24T23:00:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.378+0000 7f38dfe00640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 0x7f38c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.378+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f38d80abc10 con 0x7f38e80b3ac0 2024-04-24T23:00:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.379+0000 7f38e7e00640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 0x7f38c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.379+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8040037b0 con 0x7fc8180d2720 2024-04-24T23:00:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.380+0000 7f38e7e00640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 0x7f38c806e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005880 tx=0x7f38d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.381+0000 7fc80fe00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.381+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc80408b390 con 0x7fc8180d2720 2024-04-24T23:00:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.381+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc013420 con 0x7f70e8004800 2024-04-24T23:00:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.381+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71041eba20 con 0x7f70e8004800 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.381+0000 7ff422000640 1 -- 172.21.15.146:0/1562740108 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c036070 con 0x7ff4240d2c60 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7ff422000640 1 -- 172.21.15.146:0/1562740108 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41c031600 con 0x7ff4240d2c60 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e7c151260 con 0x7f3e7c0cda70 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71041ebfe0 con 0x7f70e8004800 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc018070 con 0x7f70e8004800 2024-04-24T23:00:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0137e0 con 0x7f70e8004800 2024-04-24T23:00:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7fc817e00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7fc959600640 1 -- 172.21.15.146:0/880293061 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954007740 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7fc959600640 1 -- 172.21.15.146:0/880293061 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9540078e0 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.382+0000 7fc959600640 1 -- 172.21.15.146:0/880293061 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954007cf0 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc817e00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 0x7fc7f806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc808005880 tx=0x7fc808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7ff422000640 1 -- 172.21.15.146:0/1562740108 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0319d0 con 0x7ff4240d2c60 2024-04-24T23:00:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 -- 172.21.15.146:0/880293061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 msgr2=0x7fc95c16c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 --2- 172.21.15.146:0/880293061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c16c080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0af5c0 tx=0x7fc95402a6c0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70dc005290 con 0x7f70e8004800 2024-04-24T23:00:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 -- 172.21.15.146:0/880293061 shutdown_connections 2024-04-24T23:00:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 --2- 172.21.15.146:0/880293061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c16c080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 --2- 172.21.15.146:0/880293061 >> v2:172.21.15.146:3300/0 conn(0x7fc95c0712b0 0x7fc95c072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.383+0000 7fc961800640 1 -- 172.21.15.146:0/880293061 >> 172.21.15.146:0/880293061 conn(0x7fc95c06b140 msgr2=0x7fc95c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.384+0000 7ff42a600640 1 -- 172.21.15.146:0/1562740108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4240d2c60 msgr2=0x7ff4240b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 --2- 172.21.15.146:0/1562740108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4240d2c60 0x7ff4240b7530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4240b6f40 tx=0x7ff41c02a610 comp rx=0 tx=0).stop 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 -- 172.21.15.146:0/1562740108 shutdown_connections 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 --2- 172.21.15.146:0/1562740108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4240d2c60 0x7ff4240b7530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 --2- 172.21.15.146:0/1562740108 >> v2:172.21.15.146:3300/0 conn(0x7ff4241619c0 0x7ff4240b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 -- 172.21.15.146:0/1562740108 >> 172.21.15.146:0/1562740108 conn(0x7ff4240d3f70 msgr2=0x7ff4240d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7ff42a600640 1 -- 172.21.15.146:0/1562740108 shutdown_connections 2024-04-24T23:00:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.386+0000 7ff42a600640 1 -- 172.21.15.146:0/1562740108 wait complete. 2024-04-24T23:00:27.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.385+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70fc013980 con 0x7f70e8004800 2024-04-24T23:00:27.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.384+0000 7fc961800640 1 -- 172.21.15.146:0/880293061 shutdown_connections 2024-04-24T23:00:27.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.384+0000 7fc961800640 1 -- 172.21.15.146:0/880293061 wait complete. 2024-04-24T23:00:27.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.386+0000 7fc961800640 1 Processor -- start 2024-04-24T23:00:27.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.386+0000 7f70fb400640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 0x7f70e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.386+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f70fc08b700 con 0x7f70e8004800 2024-04-24T23:00:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.387+0000 7fc961800640 1 -- start start 2024-04-24T23:00:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.386+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f38d807a360 con 0x7f38e80b3ac0 2024-04-24T23:00:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.388+0000 7ff42a600640 1 Processor -- start 2024-04-24T23:00:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.388+0000 7fc961800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.388+0000 7fc961800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.388+0000 7fc961800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc95c14b2d0 0x7fc95c144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7ff42a600640 1 -- start start 2024-04-24T23:00:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7f7102a00640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 0x7f70e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.388+0000 7fc961800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c06e010 con 0x7fc95c0712b0 2024-04-24T23:00:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc961800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c06dd30 con 0x7fc95c0b3ac0 2024-04-24T23:00:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc961800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c14b870 con 0x7fc95c14b2d0 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34572/0 (socket says 172.21.15.146:34572) 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 -- 172.21.15.146:0/1537901244 learned_addr learned my addr 172.21.15.146:0/1537901244 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95b400640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc95c14b2d0 0x7fc95c144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95a000640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 -- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc95c14b2d0 msgr2=0x7fc95c144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc95c14b2d0 0x7fc95c144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 -- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 msgr2=0x7fc95c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.389+0000 7fc95aa00640 1 -- 172.21.15.146:0/1537901244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c1ea6b0 con 0x7fc95c0712b0 2024-04-24T23:00:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.390+0000 7fc95aa00640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c3c0 tx=0x7fc94800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.390+0000 7ff42a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4240b5590 0x7ff4241f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff42a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff42a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4241619c0 0x7ff42414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff42a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff424161da0 con 0x7ff4240d2c60 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff42a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff4240d1f70 con 0x7ff4241619c0 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff42a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff424161f20 con 0x7ff4240b5590 2024-04-24T23:00:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7f7102a00640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 0x7f70e406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f0032000 tx=0x7f70f0005000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff422a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff422a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34580/0 (socket says 172.21.15.146:34580) 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff422a00640 1 -- 172.21.15.146:0/4220277770 learned_addr learned my addr 172.21.15.146:0/4220277770 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff423400640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4240b5590 0x7ff4241f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.391+0000 7ff423e00640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4241619c0 0x7ff42414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 -- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4240b5590 msgr2=0x7ff4241f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4240b5590 0x7ff4241f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 -- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4241619c0 msgr2=0x7ff42414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4241619c0 0x7ff42414dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 -- 172.21.15.146:0/4220277770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4240a01e0 con 0x7ff4240d2c60 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.392+0000 7ff422a00640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c400 tx=0x7ff41000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948017070 con 0x7fc95c0712b0 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948005ce0 con 0x7fc95c0712b0 2024-04-24T23:00:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410017070 con 0x7ff4240d2c60 2024-04-24T23:00:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4100052d0 con 0x7ff4240d2c60 2024-04-24T23:00:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410003830 con 0x7ff4240d2c60 2024-04-24T23:00:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9480072d0 con 0x7fc95c0712b0 2024-04-24T23:00:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c1eabc0 con 0x7fc95c0712b0 2024-04-24T23:00:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc804059290 con 0x7fc8180d2720 2024-04-24T23:00:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.395+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4240a04c0 con 0x7ff4240d2c60 2024-04-24T23:00:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.396+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4240a0a80 con 0x7ff4240d2c60 2024-04-24T23:00:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.397+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1eb180 con 0x7fc95c0712b0 2024-04-24T23:00:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.398+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4240d4be0 con 0x7ff4240d2c60 2024-04-24T23:00:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.401+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f70fc059710 con 0x7f70e8004800 2024-04-24T23:00:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.399+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c04f5a0 con 0x7fc95c0712b0 2024-04-24T23:00:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.399+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc94801a070 con 0x7fc95c0712b0 2024-04-24T23:00:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.401+0000 7fc952a00640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.401+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc948056280 con 0x7fc95c0712b0 2024-04-24T23:00:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.401+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff41001a070 con 0x7ff4240d2c60 2024-04-24T23:00:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.403+0000 7ff41b400640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 0x7ff40406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.403+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff41008a430 con 0x7ff4240d2c60 2024-04-24T23:00:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.403+0000 7fc95a000640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.404+0000 7ff423400640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 0x7ff40406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.405+0000 7ff423400640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 0x7ff40406e3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff42406c320 tx=0x7ff414008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.405+0000 7fc95a000640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 0x7fc93c06e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc95c145270 tx=0x7fc94c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.411+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc9480588e0 con 0x7fc95c0712b0 2024-04-24T23:00:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.421+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4240d4be0 con 0x7ff4240d2c60 2024-04-24T23:00:27.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.776+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4dd8005580 con 0x7f4df80e3160 2024-04-24T23:00:27.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.777+0000 7f4df6000640 1 -- 172.21.15.146:0/2855203595 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e000d3fe0 con 0x7f4df80e3160 2024-04-24T23:00:27.780 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-04-24T23:00:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.781+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 msgr2=0x7f4de006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.781+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 0x7f4de006e4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006f40 tx=0x7f4df0009240 comp rx=0 tx=0).stop 2024-04-24T23:00:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.781+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 msgr2=0x7f4df80c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.781+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 0x7f4df80c7410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e00050e00 tx=0x7f4e00068c70 comp rx=0 tx=0).stop 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 shutdown_connections 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df80e3160 0x7f4df80c7410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df8053cb0 0x7f4df8178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4de006c030 0x7f4de006e4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 --2- 172.21.15.146:0/2855203595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4df803c0a0 0x7f4df816cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.782+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 >> 172.21.15.146:0/2855203595 conn(0x7f4df8058ee0 msgr2=0x7f4df8056e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.783+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 shutdown_connections 2024-04-24T23:00:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.783+0000 7f4dff200640 1 -- 172.21.15.146:0/2855203595 wait complete. 2024-04-24T23:00:27.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-04-24T23:00:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.810+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8d280afc60 con 0x7f8d2806b140 2024-04-24T23:00:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.811+0000 7f8d24c00640 1 -- 172.21.15.146:0/334832280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d1807a3e0 con 0x7f8d2806b140 2024-04-24T23:00:27.813 INFO:teuthology.orchestra.run.smithi146.stdout:60129542154 2024-04-24T23:00:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.814+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 msgr2=0x7f8d0806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.814+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 0x7f8d0806e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d281543b0 tx=0x7f8d14009190 comp rx=0 tx=0).stop 2024-04-24T23:00:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.814+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 msgr2=0x7f8d28168690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.814+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 0x7f8d28168690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d18031000 tx=0x7f8d180046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 shutdown_connections 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d0806be80 0x7f8d0806e340 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d280b1f00 0x7f8d28155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d28071a80 0x7f8d28155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 --2- 172.21.15.146:0/334832280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d2806b140 0x7f8d28168690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 >> 172.21.15.146:0/334832280 conn(0x7f8d280b3e70 msgr2=0x7f8d2806d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 shutdown_connections 2024-04-24T23:00:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.815+0000 7f8d2fa00640 1 -- 172.21.15.146:0/334832280 wait complete. 2024-04-24T23:00:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.821+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f38e8070cb0 con 0x7f38e80b3ac0 2024-04-24T23:00:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.822+0000 7f38dfe00640 1 -- 172.21.15.146:0/3348179689 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38d80044a0 con 0x7f38e80b3ac0 2024-04-24T23:00:27.825 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-04-24T23:00:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.823+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3e54005850 con 0x7f3e7c0cda70 2024-04-24T23:00:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.824+0000 7f3e72000640 1 -- 172.21.15.146:0/1444601057 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e6c059eb0 con 0x7f3e7c0cda70 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 msgr2=0x7f38c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 0x7f38c806e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005880 tx=0x7f38d4009040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 msgr2=0x7f38e80af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 0x7f38e80af290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38d8031000 tx=0x7f38d80046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 shutdown_connections 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38e814b2d0 0x7f38e80c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b3ac0 0x7f38e80af290 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f38c806be80 0x7f38c806e340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 --2- 172.21.15.146:0/3348179689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38e80712b0 0x7f38e81612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 >> 172.21.15.146:0/3348179689 conn(0x7f38e806b140 msgr2=0x7f38e8148fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.826+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 shutdown_connections 2024-04-24T23:00:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.827+0000 7f38ef000640 1 -- 172.21.15.146:0/3348179689 wait complete. 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.827+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 msgr2=0x7f3e5c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.827+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 0x7f3e5c06e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e68034000 tx=0x7f3e6802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.827+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 msgr2=0x7f3e7c150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.827+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c450 tx=0x7f3e6c00c910 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 shutdown_connections 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e5c06bf00 0x7f3e5c06e3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e7c15c3f0 0x7f3e7c0afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c15c010 0x7f3e7c0c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 --2- 172.21.15.146:0/1444601057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e7c0cda70 0x7f3e7c150d20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 >> 172.21.15.146:0/1444601057 conn(0x7f3e7c0d1d70 msgr2=0x7f3e7c15b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 shutdown_connections 2024-04-24T23:00:27.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.828+0000 7f3e81200640 1 -- 172.21.15.146:0/1444601057 wait complete. 2024-04-24T23:00:27.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.833+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc95c0684c0 con 0x7fc95c0712b0 2024-04-24T23:00:27.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.834+0000 7fc952a00640 1 -- 172.21.15.146:0/1537901244 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9480581e0 con 0x7fc95c0712b0 2024-04-24T23:00:27.837 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:27.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.837+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f70dc005580 con 0x7f70e8004800 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 msgr2=0x7fc93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 0x7fc93c06e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc95c145270 tx=0x7fc94c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 msgr2=0x7fc95c143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c3c0 tx=0x7fc94800c880 comp rx=0 tx=0).stop 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 shutdown_connections 2024-04-24T23:00:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc95c14b2d0 0x7fc95c144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc95c0b3ac0 0x7fc95c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 --2- 172.21.15.146:0/1537901244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc95c0712b0 0x7fc95c143ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 >> 172.21.15.146:0/1537901244 conn(0x7fc95c06b140 msgr2=0x7fc95c149410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 shutdown_connections 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7f70fb400640 1 -- 172.21.15.146:0/2553924805 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70fc05da10 con 0x7f70e8004800 2024-04-24T23:00:27.841 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:27.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.838+0000 7fc961800640 1 -- 172.21.15.146:0/1537901244 wait complete. 2024-04-24T23:00:27.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.841+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc8180ce1a0 con 0x7fc8180d2720 2024-04-24T23:00:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.841+0000 7fc80fe00640 1 -- 172.21.15.146:0/2353651106 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc80405d590 con 0x7fc8180d2720 2024-04-24T23:00:27.843 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 msgr2=0x7f70e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 0x7f70e406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f0032000 tx=0x7f70f0005000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 msgr2=0x7f71041eb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70fc007a80 tx=0x7f70fc00e530 comp rx=0 tx=0).stop 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 shutdown_connections 2024-04-24T23:00:27.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710413a7d0 0x7f71040a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70e406be30 0x7f70e406e2f0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f0032000 tx=0x7f70f0005000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71041eb540 0x7f71040a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 --2- 172.21.15.146:0/2553924805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70e8004800 0x7f71041eb000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.842+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 >> 172.21.15.146:0/2553924805 conn(0x7f710406b140 msgr2=0x7f7104149450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.843+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 shutdown_connections 2024-04-24T23:00:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.843+0000 7f710a600640 1 -- 172.21.15.146:0/2553924805 wait complete. 2024-04-24T23:00:27.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.5 2024-04-24T23:00:27.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 msgr2=0x7fc7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 0x7fc7f806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc808005880 tx=0x7fc808009040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 msgr2=0x7fc818154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c610 tx=0x7fc80400cad0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 shutdown_connections 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc81815e050 0x7fc8180ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180d2720 0x7fc818154e90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 --2- 172.21.15.146:0/2353651106 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8180d0d20 0x7fc8180c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 >> 172.21.15.146:0/2353651106 conn(0x7fc8180d3ce0 msgr2=0x7fc81806b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 shutdown_connections 2024-04-24T23:00:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.847+0000 7fc81dc00640 1 -- 172.21.15.146:0/2353651106 wait complete. 2024-04-24T23:00:27.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.1 2024-04-24T23:00:27.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-04-24T23:00:27.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.855+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff42414dcc0 con 0x7ff4240d2c60 2024-04-24T23:00:27.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.855+0000 7ff41b400640 1 -- 172.21.15.146:0/4220277770 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff42414dcc0 con 0x7ff4240d2c60 2024-04-24T23:00:27.858 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 msgr2=0x7ff40406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 0x7ff40406e3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff42406c320 tx=0x7ff414008040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 msgr2=0x7ff4240c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c400 tx=0x7ff41000c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 shutdown_connections 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4241619c0 0x7ff42414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4240d2c60 0x7ff4240c9c30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff40406bf00 0x7ff40406e3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 --2- 172.21.15.146:0/4220277770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4240b5590 0x7ff4241f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 >> 172.21.15.146:0/4220277770 conn(0x7ff4240d3f70 msgr2=0x7ff4240b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 shutdown_connections 2024-04-24T23:00:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:27.859+0000 7ff42a600640 1 -- 172.21.15.146:0/4220277770 wait complete. 2024-04-24T23:00:27.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2024-04-24T23:00:27.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-04-24T23:00:27.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-04-24T23:00:27.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-04-24T23:00:28.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:00:28.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:00:28.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:00:28.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:00:28.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:00:28.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:00:28.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:00:28.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:00:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.061+0000 7fa80de00640 1 Processor -- start 2024-04-24T23:00:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.062+0000 7fa80de00640 1 -- start start 2024-04-24T23:00:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.063+0000 7fa80de00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa8080d2ae0 0x7fa8080d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.064+0000 7fa80de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa8080d1cf0 0x7fa8080b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.064+0000 7fa80de00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8080cfcf0 con 0x7fa80815e320 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.064+0000 7fa80de00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080cfac0 con 0x7fa8080d2ae0 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.064+0000 7fa80de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080d21d0 con 0x7fa8080d1cf0 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.065+0000 7fa806a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fa80815e320 0x7fa8080d23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:37094/0 (socket says 172.21.15.146:37094) 2024-04-24T23:00:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.065+0000 7fa806a00640 1 -- 172.21.15.146:0/405413535 learned_addr learned my addr 172.21.15.146:0/405413535 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.065+0000 7fa807400640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa8080d1cf0 0x7fa8080b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.065+0000 7fa806000640 1 --2- 172.21.15.146:0/405413535 >> v2:172.21.15.203:3300/0 conn(0x7fa8080d2ae0 0x7fa8080d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.066+0000 7fa806000640 1 -- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa8080d1cf0 msgr2=0x7fa8080b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.066+0000 7fa806000640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa8080d1cf0 0x7fa8080b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.066+0000 7fa805600640 1 -- 172.21.15.146:0/405413535 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575423572 0 0) 0x7fa8080cfcf0 con 0x7fa80815e320 2024-04-24T23:00:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.066+0000 7fa806000640 1 -- 172.21.15.146:0/405413535 >> v1:172.21.15.203:6789/0 conn(0x7fa80815e320 legacy=0x7fa8080d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.066+0000 7fa806000640 1 -- 172.21.15.146:0/405413535 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080cffd0 con 0x7fa8080d2ae0 2024-04-24T23:00:29.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.068+0000 7fa806000640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d2ae0 0x7fa8080d4a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7908d24180260fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.069+0000 7fa805600640 1 -- 172.21.15.146:0/405413535 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa8080d2ae0 2024-04-24T23:00:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.069+0000 7fa805600640 1 -- 172.21.15.146:0/405413535 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8032440 con 0x7fa8080d2ae0 2024-04-24T23:00:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.069+0000 7fa805600640 1 -- 172.21.15.146:0/405413535 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa8080d2ae0 2024-04-24T23:00:29.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.070+0000 7fa80de00640 1 -- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d2ae0 msgr2=0x7fa8080d4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.071+0000 7fa80de00640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d2ae0 0x7fa8080d4a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a180 comp rx=0 tx=0).stop 2024-04-24T23:00:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.071+0000 7fa80de00640 1 -- 172.21.15.146:0/405413535 shutdown_connections 2024-04-24T23:00:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.071+0000 7fa80de00640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa8080d1cf0 0x7fa8080b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.071+0000 7fa80de00640 1 --2- 172.21.15.146:0/405413535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d2ae0 0x7fa8080d4a30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.071+0000 7fa80de00640 1 -- 172.21.15.146:0/405413535 >> 172.21.15.146:0/405413535 conn(0x7fa8080d3f10 msgr2=0x7fa8080d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.072+0000 7fa80de00640 1 -- 172.21.15.146:0/405413535 shutdown_connections 2024-04-24T23:00:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.072+0000 7fa80de00640 1 -- 172.21.15.146:0/405413535 wait complete. 2024-04-24T23:00:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.076+0000 7fa80de00640 1 Processor -- start 2024-04-24T23:00:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.076+0000 7fa80de00640 1 -- start start 2024-04-24T23:00:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.078+0000 7fa80de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.079+0000 7fa80de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 0x7fa8081f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.079+0000 7fa80de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa80815e320 0x7fa8081f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.080+0000 7fa80de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa80815e700 con 0x7fa8080d2ae0 2024-04-24T23:00:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.080+0000 7fa806a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.080+0000 7fa806a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:44606/0 (socket says 172.21.15.146:44606) 2024-04-24T23:00:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.080+0000 7fa806a00640 1 -- 172.21.15.146:0/2105171904 learned_addr learned my addr 172.21.15.146:0/2105171904 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.080+0000 7fa807400640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa80815e320 0x7fa8081f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.081+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080b3160 con 0x7fa8080d1cf0 2024-04-24T23:00:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.081+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa80815e880 con 0x7fa80815e320 2024-04-24T23:00:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.081+0000 7fa806000640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 0x7fa8081f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.082+0000 7fa806000640 1 -- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa80815e320 msgr2=0x7fa8081f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.083+0000 7fa806000640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa80815e320 0x7fa8081f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.083+0000 7fa806000640 1 -- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 msgr2=0x7fa8080cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.083+0000 7fa806000640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.083+0000 7fa806000640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080cc440 con 0x7fa8080d2ae0 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.083+0000 7fa806a00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.084+0000 7fa806000640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 0x7fa8081f7ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8031000 tx=0x7fa7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.084+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8037050 con 0x7fa8080d2ae0 2024-04-24T23:00:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.085+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8038040 con 0x7fa8080d2ae0 2024-04-24T23:00:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.085+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8006e10 con 0x7fa8080d2ae0 2024-04-24T23:00:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.085+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8080cc720 con 0x7fa8080d2ae0 2024-04-24T23:00:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.085+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081f4020 con 0x7fa8080d2ae0 2024-04-24T23:00:29.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.092+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e0005290 con 0x7fa8080d2ae0 2024-04-24T23:00:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.096+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7f8045020 con 0x7fa8080d2ae0 2024-04-24T23:00:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.097+0000 7fa7ff400640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 0x7fa7e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.097+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa7f80ab3f0 con 0x7fa8080d2ae0 2024-04-24T23:00:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.100+0000 7fa806a00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 0x7fa7e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.101+0000 7fa806a00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 0x7fa7e806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa800007fd0 tx=0x7fa800005c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.105+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa7f804c020 con 0x7fa8080d2ae0 2024-04-24T23:00:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.109+0000 7f6565000640 1 Processor -- start 2024-04-24T23:00:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.110+0000 7f6565000640 1 -- start start 2024-04-24T23:00:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.111+0000 7f450de00640 1 Processor -- start 2024-04-24T23:00:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.111+0000 7f6565000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f450de00640 1 -- start start 2024-04-24T23:00:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f6565000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65600d47a0 con 0x7f65600b6c30 2024-04-24T23:00:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f6565000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65600d4a80 con 0x7f65600d2a10 2024-04-24T23:00:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f6565000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f65600ce9f0 con 0x7f65600d2630 2024-04-24T23:00:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f655de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f655de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41580/0 (socket says 172.21.15.146:41580) 2024-04-24T23:00:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.112+0000 7f655de00640 1 -- 172.21.15.146:0/2976992422 learned_addr learned my addr 172.21.15.146:0/2976992422 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.113+0000 7f655ca00640 1 -- 172.21.15.146:0/2976992422 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132755911 0 0) 0x7f65600d47a0 con 0x7f65600b6c30 2024-04-24T23:00:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f655de00640 1 -- 172.21.15.146:0/2976992422 >> v1:172.21.15.203:6789/0 conn(0x7f65600d2a10 legacy=0x7f65600d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f655de00640 1 -- 172.21.15.146:0/2976992422 >> v1:172.21.15.146:6789/0 conn(0x7f65600b6c30 legacy=0x7f6560161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f655de00640 1 -- 172.21.15.146:0/2976992422 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600cec20 con 0x7f65600d2630 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f450de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f4508072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f450de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f450814b870 0x7f4508070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.114+0000 7f450de00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450814c0e0 con 0x7f45080710e0 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.115+0000 7f450de00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4508071540 con 0x7f450814b870 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.115+0000 7f450de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f450814b6b0 con 0x7f450814b2d0 2024-04-24T23:00:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.115+0000 7f4506a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f4508072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.115+0000 7f655de00640 1 --2- 172.21.15.146:0/2976992422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65500098a0 tx=0x7f655002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146d7cde6e8c4a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f4506000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f450814b870 0x7f4508070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f4507400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f45080710e0 0x7f45080b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:37114/0 (socket says 172.21.15.146:37114) 2024-04-24T23:00:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f4507400640 1 -- 172.21.15.146:0/468239645 learned_addr learned my addr 172.21.15.146:0/468239645 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f655ca00640 1 -- 172.21.15.146:0/2976992422 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550037070 con 0x7f65600d2630 2024-04-24T23:00:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f655ca00640 1 -- 172.21.15.146:0/2976992422 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655002ae50 con 0x7f65600d2630 2024-04-24T23:00:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.116+0000 7f655ca00640 1 -- 172.21.15.146:0/2976992422 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65500328a0 con 0x7f65600d2630 2024-04-24T23:00:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.117+0000 7f4506000640 1 -- 172.21.15.146:0/468239645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 msgr2=0x7f4508072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 -- 172.21.15.146:0/2976992422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 msgr2=0x7f6560162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 --2- 172.21.15.146:0/2976992422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65500098a0 tx=0x7f655002a300 comp rx=0 tx=0).stop 2024-04-24T23:00:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.117+0000 7f4506000640 1 --2- 172.21.15.146:0/468239645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f4508072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.117+0000 7f4506000640 1 -- 172.21.15.146:0/468239645 >> v1:172.21.15.203:6789/0 conn(0x7f45080710e0 legacy=0x7f45080b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.117+0000 7f4506000640 1 -- 172.21.15.146:0/468239645 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450806d770 con 0x7f450814b870 2024-04-24T23:00:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 -- 172.21.15.146:0/2976992422 shutdown_connections 2024-04-24T23:00:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 --2- 172.21.15.146:0/2976992422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2630 0x7f6560162a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 -- 172.21.15.146:0/2976992422 >> 172.21.15.146:0/2976992422 conn(0x7f656009d050 msgr2=0x7f65600d3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 -- 172.21.15.146:0/2976992422 shutdown_connections 2024-04-24T23:00:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.118+0000 7f6565000640 1 -- 172.21.15.146:0/2976992422 wait complete. 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f6565000640 1 Processor -- start 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.119+0000 7f4506000640 1 --2- 172.21.15.146:0/468239645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450814b870 0x7f4508070ba0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097a0 tx=0x7f44f402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3accf78be545f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.119+0000 7f4505600640 1 -- 172.21.15.146:0/468239645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4037070 con 0x7f450814b870 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.119+0000 7f4505600640 1 -- 172.21.15.146:0/468239645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f402ad10 con 0x7f450814b870 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.119+0000 7f4505600640 1 -- 172.21.15.146:0/468239645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4032660 con 0x7f450814b870 2024-04-24T23:00:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 -- 172.21.15.146:0/468239645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450814b870 msgr2=0x7f4508070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 --2- 172.21.15.146:0/468239645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450814b870 0x7f4508070ba0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097a0 tx=0x7f44f402a080 comp rx=0 tx=0).stop 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 -- 172.21.15.146:0/468239645 shutdown_connections 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 --2- 172.21.15.146:0/468239645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450814b870 0x7f4508070ba0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 --2- 172.21.15.146:0/468239645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f4508072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f450de00640 1 -- 172.21.15.146:0/468239645 >> 172.21.15.146:0/468239645 conn(0x7f450806b140 msgr2=0x7f450806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.121+0000 7f6565000640 1 -- start start 2024-04-24T23:00:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.123+0000 7f6565000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.123+0000 7f6565000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f6565000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.122+0000 7f450de00640 1 -- 172.21.15.146:0/468239645 shutdown_connections 2024-04-24T23:00:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.122+0000 7f450de00640 1 -- 172.21.15.146:0/468239645 wait complete. 2024-04-24T23:00:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f450de00640 1 Processor -- start 2024-04-24T23:00:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f655de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f450de00640 1 -- start start 2024-04-24T23:00:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f655d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f655d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45058/0 (socket says 172.21.15.146:45058) 2024-04-24T23:00:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.124+0000 7f655de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:44610/0 (socket says 172.21.15.146:44610) 2024-04-24T23:00:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.125+0000 7f655e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.125+0000 7f655e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41600/0 (socket says 172.21.15.146:41600) 2024-04-24T23:00:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.125+0000 7f655d400640 1 -- 172.21.15.146:0/1425607863 learned_addr learned my addr 172.21.15.146:0/1425607863 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.125+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65600d4d60 con 0x7f65600d2630 2024-04-24T23:00:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.126+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65600b72d0 con 0x7f65600b6c30 2024-04-24T23:00:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.126+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f65600cef90 con 0x7f65600d2a10 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.126+0000 7f450de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 0x7f45081440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f450de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f45080adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f450de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f450814b870 0x7f45080b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f450de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f450806dd30 con 0x7f45080710e0 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f4506a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 0x7f45081440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f4506000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f45080adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f4506000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f45080adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41608/0 (socket says 172.21.15.146:41608) 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f4506000640 1 -- 172.21.15.146:0/148407574 learned_addr learned my addr 172.21.15.146:0/148407574 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f450de00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f450806e380 con 0x7f450814b870 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f450806e010 con 0x7f450814b2d0 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f4507400640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f450814b870 0x7f45080b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655e800640 1 -- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 msgr2=0x7f656015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655e800640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655e800640 1 -- 172.21.15.146:0/1425607863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 msgr2=0x7f65600b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655e800640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655e800640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600b2440 con 0x7f65600d2a10 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.127+0000 7f655d400640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f655e800640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6558001560 tx=0x7f655800cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.128+0000 7f655de00640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558017070 con 0x7f65600d2a10 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f4506a00640 1 -- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 msgr2=0x7f45080adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f4506a00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f45080adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f4506a00640 1 -- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f450814b870 msgr2=0x7f45080b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f4506a00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f450814b870 0x7f45080b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f4506a00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45080aca60 con 0x7f45080710e0 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558003da0 con 0x7f65600d2a10 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65580052b0 con 0x7f65600d2a10 2024-04-24T23:00:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.130+0000 7f4506a00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 0x7f45081440f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e850 tx=0x7f44f800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656015a6f0 con 0x7f65600d2a10 2024-04-24T23:00:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.129+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65600b2160 con 0x7f65600d2a10 2024-04-24T23:00:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.131+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017070 con 0x7f45080710e0 2024-04-24T23:00:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.131+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f800c8e0 con 0x7f45080710e0 2024-04-24T23:00:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.131+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f800ccb0 con 0x7f45080710e0 2024-04-24T23:00:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.131+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45080acd40 con 0x7f45080710e0 2024-04-24T23:00:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.131+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45080ad300 con 0x7f45080710e0 2024-04-24T23:00:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.132+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656004f500 con 0x7f65600d2a10 2024-04-24T23:00:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.133+0000 7fdc9de00640 1 Processor -- start 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.133+0000 7fdc9de00640 1 -- start start 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.135+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc9815f6e0 0x7fdc980b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.135+0000 7fdc9de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc980b50a0 0x7fdc980cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.135+0000 7fdc9de00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc980d0e20 con 0x7fdc980cd930 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.135+0000 7fdc9de00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdc980cddc0 con 0x7fdc980b50a0 2024-04-24T23:00:29.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.135+0000 7fdc9de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdc980cc950 con 0x7fdc9815f6e0 2024-04-24T23:00:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.136+0000 7fdc96a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc9815f6e0 0x7fdc980b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.136+0000 7fdc96000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc980b50a0 0x7fdc980cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.134+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e0005290 con 0x7f45080710e0 2024-04-24T23:00:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.136+0000 7fdc96000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc980b50a0 0x7fdc980cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45076/0 (socket says 172.21.15.146:45076) 2024-04-24T23:00:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.136+0000 7fdc96000640 1 -- 172.21.15.146:0/4047377104 learned_addr learned my addr 172.21.15.146:0/4047377104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.138+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44f801a070 con 0x7f45080710e0 2024-04-24T23:00:29.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.137+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f655801a070 con 0x7f65600d2a10 2024-04-24T23:00:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.140+0000 7f44ff400640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 0x7f44e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.137+0000 7fdc96000640 1 -- 172.21.15.146:0/4047377104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc9815f6e0 msgr2=0x7fdc980b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.137+0000 7fdc96000640 1 --2- 172.21.15.146:0/4047377104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc9815f6e0 0x7fdc980b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.137+0000 7fdc96000640 1 -- 172.21.15.146:0/4047377104 >> v1:172.21.15.203:6789/0 conn(0x7fdc980cd930 legacy=0x7fdc9815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.137+0000 7fdc96000640 1 -- 172.21.15.146:0/4047377104 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc980d0860 con 0x7fdc980b50a0 2024-04-24T23:00:29.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.141+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f44f808b390 con 0x7f45080710e0 2024-04-24T23:00:29.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.141+0000 7fdc96000640 1 --2- 172.21.15.146:0/4047377104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc980b50a0 0x7fdc980cd3f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009870 tx=0x7fdc8802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3071911c1e4ee91 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.141+0000 7f4506000640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 0x7f44e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.141+0000 7f6556000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 0x7f654006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.141+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f655808a6b0 con 0x7f65600d2a10 2024-04-24T23:00:29.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.142+0000 7f4506000640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 0x7f44e806e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45081e7890 tx=0x7f44f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.143+0000 7f655de00640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 0x7f654006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.144+0000 7f655de00640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 0x7f654006e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6550034000 tx=0x7f655002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.147+0000 7fdc95600640 1 -- 172.21.15.146:0/4047377104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88037070 con 0x7fdc980b50a0 2024-04-24T23:00:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.148+0000 7fdc95600640 1 -- 172.21.15.146:0/4047377104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc88032440 con 0x7fdc980b50a0 2024-04-24T23:00:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.148+0000 7fdc95600640 1 -- 172.21.15.146:0/4047377104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88032830 con 0x7fdc980b50a0 2024-04-24T23:00:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.148+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f44f8059390 con 0x7f45080710e0 2024-04-24T23:00:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.149+0000 7fdc9de00640 1 -- 172.21.15.146:0/4047377104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc980b50a0 msgr2=0x7fdc980cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.149+0000 7fdc9de00640 1 --2- 172.21.15.146:0/4047377104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc980b50a0 0x7fdc980cd3f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009870 tx=0x7fdc8802a290 comp rx=0 tx=0).stop 2024-04-24T23:00:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 -- 172.21.15.146:0/4047377104 shutdown_connections 2024-04-24T23:00:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 --2- 172.21.15.146:0/4047377104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc980b50a0 0x7fdc980cd3f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 --2- 172.21.15.146:0/4047377104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc9815f6e0 0x7fdc980b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 -- 172.21.15.146:0/4047377104 >> 172.21.15.146:0/4047377104 conn(0x7fdc980b3860 msgr2=0x7fdc980b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 -- 172.21.15.146:0/4047377104 shutdown_connections 2024-04-24T23:00:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.150+0000 7fdc9de00640 1 -- 172.21.15.146:0/4047377104 wait complete. 2024-04-24T23:00:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.152+0000 7fdc9de00640 1 Processor -- start 2024-04-24T23:00:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.153+0000 7fdc9de00640 1 -- start start 2024-04-24T23:00:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.154+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.155+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 0x7fdc9815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.155+0000 7fdc9de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.155+0000 7fdc96a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.155+0000 7fdc96a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41616/0 (socket says 172.21.15.146:41616) 2024-04-24T23:00:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc97400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc97400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45092/0 (socket says 172.21.15.146:45092) 2024-04-24T23:00:29.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc96000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 0x7fdc9815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc96a00640 1 -- 172.21.15.146:0/713559349 learned_addr learned my addr 172.21.15.146:0/713559349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdc980cced0 con 0x7fdc9815f6e0 2024-04-24T23:00:29.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdc980ccbf0 con 0x7fdc980cd930 2024-04-24T23:00:29.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.156+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdc980d0570 con 0x7fdc980b50a0 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.157+0000 7fdc97400640 1 -- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 msgr2=0x7fdc980c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.157+0000 7fdc97400640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.157+0000 7fdc97400640 1 -- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 msgr2=0x7fdc9815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.157+0000 7fdc97400640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 0x7fdc9815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.157+0000 7fdc97400640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc980c8320 con 0x7fdc9815f6e0 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.158+0000 7fdc96a00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.158+0000 7fdc96000640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 0x7fdc9815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:29.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.158+0000 7fdc97400640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c760 tx=0x7fdc9000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.159+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90016020 con 0x7fdc9815f6e0 2024-04-24T23:00:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.159+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90006d50 con 0x7fdc9815f6e0 2024-04-24T23:00:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.159+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90003b90 con 0x7fdc9815f6e0 2024-04-24T23:00:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.159+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9814fe30 con 0x7fdc9815f6e0 2024-04-24T23:00:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.159+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9806f3b0 con 0x7fdc9815f6e0 2024-04-24T23:00:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.161+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9804f5a0 con 0x7fdc9815f6e0 2024-04-24T23:00:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.164+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc9000a850 con 0x7fdc9815f6e0 2024-04-24T23:00:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.165+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f65580586b0 con 0x7f65600d2a10 2024-04-24T23:00:29.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.165+0000 7fdc8f400640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 0x7fdc7806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.166+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdc9008bb60 con 0x7fdc9815f6e0 2024-04-24T23:00:29.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.170+0000 7fdc96a00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 0x7fdc7806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.171+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdc90020020 con 0x7fdc9815f6e0 2024-04-24T23:00:29.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.172+0000 7fdc96a00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 0x7fdc7806e3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009be0 tx=0x7fdc84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.188+0000 7f18a7000640 1 Processor -- start 2024-04-24T23:00:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.188+0000 7f18a7000640 1 -- start start 2024-04-24T23:00:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.191+0000 7f18a7000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f18a00ae710 0x7f18a00cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.191+0000 7f18a7000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a0162700 con 0x7f18a0163300 2024-04-24T23:00:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.191+0000 7f18a7000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a0070b70 con 0x7f18a00b28f0 2024-04-24T23:00:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.191+0000 7f18a7000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f18a0072d30 con 0x7f18a00ae710 2024-04-24T23:00:29.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.192+0000 7f18a5200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f18a0163300 0x7f18a00aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50004/0 (socket says 172.21.15.146:50004) 2024-04-24T23:00:29.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.192+0000 7f18a5200640 1 -- 172.21.15.146:0/2375536449 learned_addr learned my addr 172.21.15.146:0/2375536449 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.192+0000 7f18a5c00640 1 --2- 172.21.15.146:0/2375536449 >> v2:172.21.15.203:3300/0 conn(0x7f18a00ae710 0x7f18a00cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299503290 0 0) 0x7f18a0162700 con 0x7f18a0163300 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1888003520 con 0x7f18a0163300 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557635839 0 0) 0x7f18a0070b70 con 0x7f18a00b28f0 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a0162700 con 0x7f18a00b28f0 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f18a5c00640 1 -- 172.21.15.146:0/2375536449 >> v1:172.21.15.203:6789/0 conn(0x7f18a00b28f0 legacy=0x7f18a00b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f18a5c00640 1 -- 172.21.15.146:0/2375536449 >> v1:172.21.15.146:6789/0 conn(0x7f18a0163300 legacy=0x7f18a00aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.194+0000 7f18a5c00640 1 -- 172.21.15.146:0/2375536449 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a0072770 con 0x7f18a00ae710 2024-04-24T23:00:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.196+0000 7f18a5c00640 1 --2- 172.21.15.146:0/2375536449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a00ae710 0x7f18a00cf1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18940097a0 tx=0x7f189402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5800116b7928123 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.197+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894037070 con 0x7f18a00ae710 2024-04-24T23:00:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.197+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1894032440 con 0x7f18a00ae710 2024-04-24T23:00:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.197+0000 7f189fe00640 1 -- 172.21.15.146:0/2375536449 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894032810 con 0x7f18a00ae710 2024-04-24T23:00:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7ff9f5a00640 1 Processor -- start 2024-04-24T23:00:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 -- 172.21.15.146:0/2375536449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a00ae710 msgr2=0x7f18a00cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 --2- 172.21.15.146:0/2375536449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a00ae710 0x7f18a00cf1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18940097a0 tx=0x7f189402a1c0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 -- 172.21.15.146:0/2375536449 shutdown_connections 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 --2- 172.21.15.146:0/2375536449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a00ae710 0x7f18a00cf1f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 -- 172.21.15.146:0/2375536449 >> 172.21.15.146:0/2375536449 conn(0x7f18a00b1560 msgr2=0x7f18a00b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 -- 172.21.15.146:0/2375536449 shutdown_connections 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7f18a7000640 1 -- 172.21.15.146:0/2375536449 wait complete. 2024-04-24T23:00:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.198+0000 7ff9f5a00640 1 -- start start 2024-04-24T23:00:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.201+0000 7ff9f5a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff9f00b46b0 0x7ff9f00d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.201+0000 7f18a7000640 1 Processor -- start 2024-04-24T23:00:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.201+0000 7ff9f5a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00d1440 con 0x7ff9f00b4b00 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7f18a7000640 1 -- start start 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7ff9f5a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00d1720 con 0x7ff9f00b42d0 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7ff9f5a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00cf6b0 con 0x7ff9f00b46b0 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7ff9eea00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7ff9f00b42d0 0x7ff9f00d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:37156/0 (socket says 172.21.15.146:37156) 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7ff9eea00640 1 -- 172.21.15.146:0/704392202 learned_addr learned my addr 172.21.15.146:0/704392202 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.202+0000 7ff9ef400640 1 --2- 172.21.15.146:0/704392202 >> v2:172.21.15.203:3300/0 conn(0x7ff9f00b46b0 0x7ff9f00d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7fea81e00640 1 Processor -- start 2024-04-24T23:00:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676529237 0 0) 0x7ff9f00d1720 con 0x7ff9f00b42d0 2024-04-24T23:00:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d4003520 con 0x7ff9f00b42d0 2024-04-24T23:00:29.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7fea81e00640 1 -- start start 2024-04-24T23:00:29.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a00b28f0 0x7f18a015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 0x7f18a00ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7ff9ef400640 1 -- 172.21.15.146:0/704392202 >> v1:172.21.15.203:6789/0 conn(0x7ff9f00b42d0 legacy=0x7ff9f00d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00cec70 con 0x7f18a00ae710 2024-04-24T23:00:29.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7ff9ef400640 1 -- 172.21.15.146:0/704392202 >> v1:172.21.15.146:6789/0 conn(0x7ff9f00b4b00 legacy=0x7ff9f00c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408669964 0 0) 0x7ff9f00d1440 con 0x7ff9f00b4b00 2024-04-24T23:00:29.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7ff9ef400640 1 -- 172.21.15.146:0/704392202 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00cfe20 con 0x7ff9f00b46b0 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0163760 con 0x7f18a0163300 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.203+0000 7f18a7000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00cedf0 con 0x7f18a00b28f0 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7f18a5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7f18a5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45104/0 (socket says 172.21.15.146:45104) 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7f18a5c00640 1 -- 172.21.15.146:0/808821584 learned_addr learned my addr 172.21.15.146:0/808821584 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.204+0000 7f18a6600640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 0x7f18a00ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a5200640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a00b28f0 0x7f18a015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a6600640 1 -- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a00b28f0 msgr2=0x7f18a015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a6600640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a00b28f0 0x7f18a015f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a6600640 1 -- 172.21.15.146:0/808821584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 msgr2=0x7f18a015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a6600640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a6600640 1 -- 172.21.15.146:0/808821584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a0164710 con 0x7f18a0163300 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.205+0000 7f18a5c00640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7ff9ef400640 1 --2- 172.21.15.146:0/704392202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b46b0 0x7ff9f00d0dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72f8b878024c78dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7f18a6600640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 0x7f18a00ac300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c390 tx=0x7f188c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7fea81e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea7c072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7fea81e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fea7c14b870 0x7fea7c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7fea81e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea7c14c0e0 con 0x7fea7c0710e0 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7fea81e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fea7c071540 con 0x7fea7c14b870 2024-04-24T23:00:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7fea81e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c14b6b0 con 0x7fea7c14b2d0 2024-04-24T23:00:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037070 con 0x7ff9f00b46b0 2024-04-24T23:00:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc032440 con 0x7ff9f00b46b0 2024-04-24T23:00:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.206+0000 7ff9ed600640 1 -- 172.21.15.146:0/704392202 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc032810 con 0x7ff9f00b46b0 2024-04-24T23:00:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c017070 con 0x7f18a0163300 2024-04-24T23:00:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c0052d0 con 0x7f18a0163300 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c003830 con 0x7f18a0163300 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a01649f0 con 0x7f18a0163300 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a0164fb0 con 0x7f18a0163300 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7fea7aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea7c072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7fea7b400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fea7c0710e0 0x7fea7c0b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:37160/0 (socket says 172.21.15.146:37160) 2024-04-24T23:00:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.207+0000 7fea7b400640 1 -- 172.21.15.146:0/3536057568 learned_addr learned my addr 172.21.15.146:0/3536057568 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518733624 0 0) 0x7fea7c14c0e0 con 0x7fea7c0710e0 2024-04-24T23:00:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea60003520 con 0x7fea7c0710e0 2024-04-24T23:00:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7ff9f5a00640 1 -- 172.21.15.146:0/704392202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b46b0 msgr2=0x7ff9f00d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 309746185 0 0) 0x7fea60003520 con 0x7fea7c0710e0 2024-04-24T23:00:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a004f500 con 0x7f18a0163300 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 msgr2=0x7fea7c072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7fea79600640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea7c072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 >> v2:172.21.15.203:3300/0 conn(0x7fea7c14b870 msgr2=0x7fea7c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 --2- 172.21.15.146:0/3536057568 >> v2:172.21.15.203:3300/0 conn(0x7fea7c14b870 0x7fea7c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c06d770 con 0x7fea7c0710e0 2024-04-24T23:00:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.208+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/704392202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b46b0 0x7ff9f00d0dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0097a0 tx=0x7ff9dc02a130 comp rx=0 tx=0).stop 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fea740019d0 con 0x7fea7c0710e0 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 >> v1:172.21.15.203:6789/0 conn(0x7fea7c0710e0 legacy=0x7fea7c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea60003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60004800 0x7fea60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea60005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7ff9f5a00640 1 -- 172.21.15.146:0/704392202 shutdown_connections 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c14b6b0 con 0x7fea600039b0 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea6000bbe0 con 0x7fea60004800 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea6000bdb0 con 0x7fea7c14b2d0 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/704392202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b46b0 0x7ff9f00d0dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.209+0000 7ff9f5a00640 1 -- 172.21.15.146:0/704392202 >> 172.21.15.146:0/704392202 conn(0x7ff9f00d3f90 msgr2=0x7ff9f00d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7aa00640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea60003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7a000640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60004800 0x7fea60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7b400640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea60005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7ff9f5a00640 1 -- 172.21.15.146:0/704392202 shutdown_connections 2024-04-24T23:00:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.213+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f188c01a070 con 0x7f18a0163300 2024-04-24T23:00:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7aa00640 1 -- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 msgr2=0x7fea60005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7aa00640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c14b2d0 0x7fea60005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7aa00640 1 -- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60004800 msgr2=0x7fea60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7fea7aa00640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60004800 0x7fea60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.211+0000 7fea7aa00640 1 -- 172.21.15.146:0/3536057568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea60003520 con 0x7fea600039b0 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.212+0000 7fea7aa00640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea60003df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea6800ba60 tx=0x7fea60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d151da2965884e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.213+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68030070 con 0x7fea600039b0 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.213+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea68034400 con 0x7fea600039b0 2024-04-24T23:00:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.213+0000 7fea79600640 1 -- 172.21.15.146:0/3536057568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6800b600 con 0x7fea600039b0 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.210+0000 7ff9f5a00640 1 -- 172.21.15.146:0/704392202 wait complete. 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.213+0000 7ff9f5a00640 1 Processor -- start 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7ff9f5a00640 1 -- start start 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7fea81e00640 1 -- 172.21.15.146:0/3536057568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 msgr2=0x7fea60003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7fea81e00640 1 --2- 172.21.15.146:0/3536057568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea60003df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea6800ba60 tx=0x7fea60005830 comp rx=0 tx=0).stop 2024-04-24T23:00:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7fea7b400640 1 -- 172.21.15.146:0/3536057568 reap_dead start 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7f189d600640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 0x7f188006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.214+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f188c08a770 con 0x7f18a0163300 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.215+0000 7fea81e00640 1 -- 172.21.15.146:0/3536057568 shutdown_connections 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.215+0000 7fea81e00640 1 -- 172.21.15.146:0/3536057568 >> 172.21.15.146:0/3536057568 conn(0x7fea7c06b140 msgr2=0x7fea7c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.215+0000 7fea81e00640 1 -- 172.21.15.146:0/3536057568 shutdown_connections 2024-04-24T23:00:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.215+0000 7fea81e00640 1 -- 172.21.15.146:0/3536057568 wait complete. 2024-04-24T23:00:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.215+0000 7f18a5c00640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 0x7f188006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.216+0000 7f18a5c00640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 0x7f188006e340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1894035040 tx=0x7f189402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.216+0000 7ff9f5a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 0x7ff9f00b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.216+0000 7ff9f5a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff9f00b46b0 0x7ff9f00b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.217+0000 7ff9f5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 0x7ff9f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.217+0000 7fea81e00640 1 Processor -- start 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.217+0000 7ff9f5a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00b5050 con 0x7ff9f00b86b0 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.217+0000 7ff9eea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 0x7ff9f00b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7ff9eea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 0x7ff9f00b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:44670/0 (socket says 172.21.15.146:44670) 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7ff9eea00640 1 -- 172.21.15.146:0/2026002721 learned_addr learned my addr 172.21.15.146:0/2026002721 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00d3080 con 0x7ff9f00b42d0 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00b51d0 con 0x7ff9f00b46b0 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7ff9ef400640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 0x7ff9f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.217+0000 7fea81e00640 1 -- start start 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7fea81e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.218+0000 7fea81e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea7c0b06d0 0x7fea7c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea81e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c0aa500 0x7fea7c0aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea81e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c06dd30 con 0x7fea600039b0 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea81e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c06e380 con 0x7fea7c0b06d0 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea81e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c06e010 con 0x7fea7c0aa500 2024-04-24T23:00:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7ff9ee000640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff9f00b46b0 0x7ff9f00b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea7aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea7aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45130/0 (socket says 172.21.15.146:45130) 2024-04-24T23:00:29.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea7aa00640 1 -- 172.21.15.146:0/4131722118 learned_addr learned my addr 172.21.15.146:0/4131722118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.219+0000 7fea7b400640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c0aa500 0x7fea7c0aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7a000640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea7c0b06d0 0x7fea7c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7ff9ef400640 1 -- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff9f00b46b0 msgr2=0x7ff9f00b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7ff9ef400640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff9f00b46b0 0x7ff9f00b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7ff9ef400640 1 -- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 msgr2=0x7ff9f00b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7ff9ef400640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 0x7ff9f00b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7ff9ef400640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f01ea190 con 0x7ff9f00b86b0 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7aa00640 1 -- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c0aa500 msgr2=0x7fea7c0aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7aa00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c0aa500 0x7fea7c0aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7aa00640 1 -- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea7c0b06d0 msgr2=0x7fea7c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7aa00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea7c0b06d0 0x7fea7c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.220+0000 7fea7aa00640 1 -- 172.21.15.146:0/4131722118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c0ab1f0 con 0x7fea600039b0 2024-04-24T23:00:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7ff9ef400640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 0x7ff9f00b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc031000 tx=0x7ff9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7fea7aa00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea6802a950 tx=0x7fea68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6800b600 con 0x7fea600039b0 2024-04-24T23:00:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037050 con 0x7ff9f00b86b0 2024-04-24T23:00:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc043070 con 0x7ff9f00b86b0 2024-04-24T23:00:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc03cb10 con 0x7ff9f00b86b0 2024-04-24T23:00:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f00b80b0 con 0x7ff9f00b86b0 2024-04-24T23:00:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.221+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea68035ea0 con 0x7fea600039b0 2024-04-24T23:00:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.222+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f00cb060 con 0x7ff9f00b86b0 2024-04-24T23:00:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.224+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68033bf0 con 0x7fea600039b0 2024-04-24T23:00:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.224+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1567d0 con 0x7fea600039b0 2024-04-24T23:00:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.224+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c156d90 con 0x7fea600039b0 2024-04-24T23:00:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.225+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f00733a0 con 0x7ff9f00b86b0 2024-04-24T23:00:29.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.226+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f188c021080 con 0x7f18a0163300 2024-04-24T23:00:29.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.226+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9dc03ccb0 con 0x7ff9f00b86b0 2024-04-24T23:00:29.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.227+0000 7ff9e6a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 0x7ff9d006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.227+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff9dc0abd20 con 0x7ff9f00b86b0 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.225+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c0b1090 con 0x7fea600039b0 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.226+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea68045020 con 0x7fea600039b0 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.228+0000 7fea73400640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 0x7fea5c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.228+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fea680ab420 con 0x7fea600039b0 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.229+0000 7ff9eea00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 0x7ff9d006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.230+0000 7ff9eea00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 0x7ff9d006e3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005c00 tx=0x7ff9e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.231+0000 7fea7a000640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 0x7fea5c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.232+0000 7fea7a000640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 0x7fea5c06e340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea7c158d40 tx=0x7fea6c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.233+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fea6804c020 con 0x7fea600039b0 2024-04-24T23:00:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.238+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9f00733a0 con 0x7ff9f00b86b0 2024-04-24T23:00:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.263+0000 7fd34e800640 1 Processor -- start 2024-04-24T23:00:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.264+0000 7fd34e800640 1 -- start start 2024-04-24T23:00:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.266+0000 7fd34e800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd3480cf300 0x7fd3480d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.266+0000 7fd34e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.266+0000 7fd34e800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3480cf790 con 0x7fd3480d22a0 2024-04-24T23:00:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.266+0000 7fd34e800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd3480b3640 con 0x7fd3480cf300 2024-04-24T23:00:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.266+0000 7fd34e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd3480cfa70 con 0x7fd3480b4090 2024-04-24T23:00:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41676/0 (socket says 172.21.15.146:41676) 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 -- 172.21.15.146:0/246344136 learned_addr learned my addr 172.21.15.146:0/246344136 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34ca00640 1 --2- 172.21.15.146:0/246344136 >> v2:172.21.15.203:3300/0 conn(0x7fd3480cf300 0x7fd3480d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 -- 172.21.15.146:0/246344136 >> v2:172.21.15.203:3300/0 conn(0x7fd3480cf300 msgr2=0x7fd3480d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 --2- 172.21.15.146:0/246344136 >> v2:172.21.15.203:3300/0 conn(0x7fd3480cf300 0x7fd3480d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 -- 172.21.15.146:0/246344136 >> v1:172.21.15.203:6789/0 conn(0x7fd3480d22a0 legacy=0x7fd3480d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.267+0000 7fd34de00640 1 -- 172.21.15.146:0/246344136 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3480b3890 con 0x7fd3480b4090 2024-04-24T23:00:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.269+0000 7fd34de00640 1 --2- 172.21.15.146:0/246344136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd340009e50 tx=0x7fd34002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29cc64ff2cc45ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.270+0000 7fd347e00640 1 -- 172.21.15.146:0/246344136 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340036070 con 0x7fd3480b4090 2024-04-24T23:00:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.271+0000 7fd347e00640 1 -- 172.21.15.146:0/246344136 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340031600 con 0x7fd3480b4090 2024-04-24T23:00:29.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.272+0000 7fd347e00640 1 -- 172.21.15.146:0/246344136 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3400319b0 con 0x7fd3480b4090 2024-04-24T23:00:29.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.272+0000 7fd34e800640 1 -- 172.21.15.146:0/246344136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 msgr2=0x7fd3480b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.272+0000 7fd34e800640 1 --2- 172.21.15.146:0/246344136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd340009e50 tx=0x7fd34002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 -- 172.21.15.146:0/246344136 shutdown_connections 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 --2- 172.21.15.146:0/246344136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480b4090 0x7fd3480b4520 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 --2- 172.21.15.146:0/246344136 >> v2:172.21.15.203:3300/0 conn(0x7fd3480cf300 0x7fd3480d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 -- 172.21.15.146:0/246344136 >> 172.21.15.146:0/246344136 conn(0x7fd3480d3ce0 msgr2=0x7fd3480d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 -- 172.21.15.146:0/246344136 shutdown_connections 2024-04-24T23:00:29.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.273+0000 7fd34e800640 1 -- 172.21.15.146:0/246344136 wait complete. 2024-04-24T23:00:29.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.276+0000 7fd34e800640 1 Processor -- start 2024-04-24T23:00:29.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.276+0000 7fd34e800640 1 -- start start 2024-04-24T23:00:29.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.278+0000 7fd34e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3480b4090 0x7fd34815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.278+0000 7fd34e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd348160ac0 0x7fd34815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34e800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd34815e310 con 0x7fd348160ac0 2024-04-24T23:00:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41682/0 (socket says 172.21.15.146:41682) 2024-04-24T23:00:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34ca00640 1 -- 172.21.15.146:0/3740758547 learned_addr learned my addr 172.21.15.146:0/3740758547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.279+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd34815e190 con 0x7fd3480b4090 2024-04-24T23:00:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.280+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd3480d1ed0 con 0x7fd3480d22a0 2024-04-24T23:00:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.281+0000 7fd34ca00640 1 -- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3480b4090 msgr2=0x7fd34815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.281+0000 7fd34ca00640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3480b4090 0x7fd34815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.281+0000 7fd34ca00640 1 -- 172.21.15.146:0/3740758547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd348160ac0 msgr2=0x7fd34815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.281+0000 7fd34ca00640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd348160ac0 0x7fd34815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.281+0000 7fd34ca00640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3480ca560 con 0x7fd3480d22a0 2024-04-24T23:00:29.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.282+0000 7fd34ca00640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d800 tx=0x7fd33400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.283+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33400b6c0 con 0x7fd3480d22a0 2024-04-24T23:00:29.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.283+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd334019070 con 0x7fd3480d22a0 2024-04-24T23:00:29.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.283+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3480ca820 con 0x7fd3480d22a0 2024-04-24T23:00:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.283+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34815efd0 con 0x7fd3480d22a0 2024-04-24T23:00:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.285+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33400ba80 con 0x7fd3480d22a0 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.291+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34804f500 con 0x7fd3480d22a0 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.291+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd33400bc20 con 0x7fd3480d22a0 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.292+0000 7fd345600640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 0x7fd32806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.293+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd33408b690 con 0x7fd3480d22a0 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.294+0000 7fd34d400640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 0x7fd32806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.295+0000 7fd34d400640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 0x7fd32806e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001560 tx=0x7fd33c007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.306+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd334059c60 con 0x7fd3480d22a0 2024-04-24T23:00:29.549 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.546+0000 7fa80de00640 1 -- 172.21.15.146:0/2105171904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa7e0005580 con 0x7fa8080d2ae0 2024-04-24T23:00:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.547+0000 7fa7ff400640 1 -- 172.21.15.146:0/2105171904 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7f80799c0 con 0x7fa8080d2ae0 2024-04-24T23:00:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.550+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 msgr2=0x7fa7e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.550+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 0x7fa7e806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa800007fd0 tx=0x7fa800005c90 comp rx=0 tx=0).stop 2024-04-24T23:00:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.550+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 msgr2=0x7fa8081f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.550+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 0x7fa8081f7ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8031000 tx=0x7fa7f80046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 shutdown_connections 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa7e806be30 0x7fa7e806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa80815e320 0x7fa8081f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8080d2ae0 0x7fa8081f7ac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 --2- 172.21.15.146:0/2105171904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8080d1cf0 0x7fa8080cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 >> 172.21.15.146:0/2105171904 conn(0x7fa8080d3f10 msgr2=0x7fa8080d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 shutdown_connections 2024-04-24T23:00:29.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.551+0000 7fa7fcc00640 1 -- 172.21.15.146:0/2105171904 wait complete. 2024-04-24T23:00:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.576+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f44e0005580 con 0x7f45080710e0 2024-04-24T23:00:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.577+0000 7f44ff400640 1 -- 172.21.15.146:0/148407574 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44f805d690 con 0x7f45080710e0 2024-04-24T23:00:29.580 INFO:teuthology.orchestra.run.smithi146.stdout:60129542156 2024-04-24T23:00:29.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-04-24T23:00:29.581 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.581+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 msgr2=0x7f44e806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.581+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 0x7f44e806e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45081e7890 tx=0x7f44f402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.581+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 msgr2=0x7f45081440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.581+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 0x7f45081440f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e850 tx=0x7f44f800ed10 comp rx=0 tx=0).stop 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 shutdown_connections 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f450814b870 0x7f45080b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44e806bf00 0x7f44e806e3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f450814b2d0 0x7f45080adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 --2- 172.21.15.146:0/148407574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45080710e0 0x7f45081440f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 >> 172.21.15.146:0/148407574 conn(0x7f450806b140 msgr2=0x7f4508147670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 shutdown_connections 2024-04-24T23:00:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.582+0000 7f450de00640 1 -- 172.21.15.146:0/148407574 wait complete. 2024-04-24T23:00:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.594+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f65600a1a10 con 0x7f65600d2a10 2024-04-24T23:00:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.594+0000 7f6556000640 1 -- 172.21.15.146:0/1425607863 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f655805c9b0 con 0x7f65600d2a10 2024-04-24T23:00:29.596 INFO:teuthology.orchestra.run.smithi146.stdout:64424509452 2024-04-24T23:00:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 msgr2=0x7f654006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 0x7f654006e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6550034000 tx=0x7f655002e000 comp rx=0 tx=0).stop 2024-04-24T23:00:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 msgr2=0x7f65600b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6558001560 tx=0x7f655800cbe0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 shutdown_connections 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f654006bf00 0x7f654006e3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f65600d2a10 0x7f65600b1890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65600d2630 0x7f65600b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 --2- 172.21.15.146:0/1425607863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65600b6c30 0x7f656015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 >> 172.21.15.146:0/1425607863 conn(0x7f656009d050 msgr2=0x7f656006b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.598+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 shutdown_connections 2024-04-24T23:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.599+0000 7f6565000640 1 -- 172.21.15.146:0/1425607863 wait complete. 2024-04-24T23:00:29.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.602+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdc980ce780 con 0x7fdc9815f6e0 2024-04-24T23:00:29.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.602+0000 7fdc8f400640 1 -- 172.21.15.146:0/713559349 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc980d0e20 con 0x7fdc9815f6e0 2024-04-24T23:00:29.604 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.604+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 msgr2=0x7fdc7806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.604+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 0x7fdc7806e3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009be0 tx=0x7fdc84008040 comp rx=0 tx=0).stop 2024-04-24T23:00:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.604+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 msgr2=0x7fdc981fc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.604+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c760 tx=0x7fdc9000cc20 comp rx=0 tx=0).stop 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 shutdown_connections 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9815f6e0 0x7fdc981fc300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc980cd930 0x7fdc9815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdc7806bf00 0x7fdc7806e3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 --2- 172.21.15.146:0/713559349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc980b50a0 0x7fdc980c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.605+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 >> 172.21.15.146:0/713559349 conn(0x7fdc980b3860 msgr2=0x7fdc980d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.606+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 shutdown_connections 2024-04-24T23:00:29.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.608+0000 7fdc9de00640 1 -- 172.21.15.146:0/713559349 wait complete. 2024-04-24T23:00:29.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.5 2024-04-24T23:00:29.612 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-04-24T23:00:29.628 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.1 2024-04-24T23:00:29.629 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.636+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fea7c072be0 con 0x7fea600039b0 2024-04-24T23:00:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.636+0000 7fea73400640 1 -- 172.21.15.146:0/4131722118 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea680794b0 con 0x7fea600039b0 2024-04-24T23:00:29.638 INFO:teuthology.orchestra.run.smithi146.stdout:64424509452 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 msgr2=0x7fea5c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 0x7fea5c06e340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea7c158d40 tx=0x7fea6c009060 comp rx=0 tx=0).stop 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 msgr2=0x7fea7c143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea6802a950 tx=0x7fea68004730 comp rx=0 tx=0).stop 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 shutdown_connections 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea5c06be80 0x7fea5c06e340 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea7c0aa500 0x7fea7c0aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea7c0b06d0 0x7fea7c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 --2- 172.21.15.146:0/4131722118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea600039b0 0x7fea7c143c10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 >> 172.21.15.146:0/4131722118 conn(0x7fea7c06b140 msgr2=0x7fea7c14a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 shutdown_connections 2024-04-24T23:00:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.640+0000 7fea81e00640 1 -- 172.21.15.146:0/4131722118 wait complete. 2024-04-24T23:00:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.643+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f18a01651b0 con 0x7f18a0163300 2024-04-24T23:00:29.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.644+0000 7f189d600640 1 -- 172.21.15.146:0/808821584 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f188c058e30 con 0x7f18a0163300 2024-04-24T23:00:29.646 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 msgr2=0x7f188006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 0x7f188006e340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1894035040 tx=0x7f189402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 msgr2=0x7f18a00ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 0x7f18a00ac300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c390 tx=0x7f188c00c850 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 shutdown_connections 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a0163300 0x7f18a00ac300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f188006be80 0x7f188006e340 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a00b28f0 0x7f18a015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 --2- 172.21.15.146:0/808821584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a00ae710 0x7f18a015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 >> 172.21.15.146:0/808821584 conn(0x7f18a00b1560 msgr2=0x7f18a00d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 shutdown_connections 2024-04-24T23:00:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.646+0000 7f18a7000640 1 -- 172.21.15.146:0/808821584 wait complete. 2024-04-24T23:00:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.661+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd348161230 con 0x7fd3480d22a0 2024-04-24T23:00:29.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.662+0000 7fd345600640 1 -- 172.21.15.146:0/3740758547 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd334059560 con 0x7fd3480d22a0 2024-04-24T23:00:29.664 INFO:teuthology.orchestra.run.smithi146.stdout:64424509451 2024-04-24T23:00:29.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-04-24T23:00:29.667 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 msgr2=0x7fd32806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 0x7fd32806e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001560 tx=0x7fd33c007990 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 msgr2=0x7fd3480cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d800 tx=0x7fd33400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 shutdown_connections 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd348160ac0 0x7fd34815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd32806be60 0x7fd32806e320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3480d22a0 0x7fd3480cbea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 --2- 172.21.15.146:0/3740758547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3480b4090 0x7fd34815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.664+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 >> 172.21.15.146:0/3740758547 conn(0x7fd3480d3ce0 msgr2=0x7fd34806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.665+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 shutdown_connections 2024-04-24T23:00:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.665+0000 7fd34e800640 1 -- 172.21.15.146:0/3740758547 wait complete. 2024-04-24T23:00:29.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.6 2024-04-24T23:00:29.669 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.672+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff9f00d1680 con 0x7ff9f00b86b0 2024-04-24T23:00:29.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.672+0000 7ff9e6a00640 1 -- 172.21.15.146:0/2026002721 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9f00d1680 con 0x7ff9f00b86b0 2024-04-24T23:00:29.674 INFO:teuthology.orchestra.run.smithi146.stdout:64424509450 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.674+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 msgr2=0x7ff9d006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.674+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 0x7ff9d006e3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005c00 tx=0x7ff9e8009040 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.674+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 msgr2=0x7ff9f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.674+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 0x7ff9f00b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc031000 tx=0x7ff9dc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 shutdown_connections 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f00b86b0 0x7ff9f00b8b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9d006bf00 0x7ff9d006e3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff9f00b46b0 0x7ff9f00b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 --2- 172.21.15.146:0/2026002721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9f00b42d0 0x7ff9f00b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 >> 172.21.15.146:0/2026002721 conn(0x7ff9f00d3f90 msgr2=0x7ff9f00c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 shutdown_connections 2024-04-24T23:00:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.675+0000 7ff9f5a00640 1 -- 172.21.15.146:0/2026002721 wait complete. 2024-04-24T23:00:29.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-04-24T23:00:29.683 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-04-24T23:00:29.694 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:29.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:00:29.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.930+0000 7ff337e00640 1 Processor -- start 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.930+0000 7ff337e00640 1 -- start start 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff337e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff338168970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff337e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33815e1b0 con 0x7ff338072920 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff337e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3380713b0 con 0x7ff33815ddd0 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff337e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff338071690 con 0x7ff3380d0240 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff32e000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff338072920 0x7ff3380cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50018/0 (socket says 172.21.15.146:50018) 2024-04-24T23:00:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.932+0000 7ff32e000640 1 -- 172.21.15.146:0/807230267 learned_addr learned my addr 172.21.15.146:0/807230267 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:29.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff337400640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff338168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155477263 0 0) 0x7ff33815e1b0 con 0x7ff338072920 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff31c003520 con 0x7ff338072920 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2074349802 0 0) 0x7ff31c003520 con 0x7ff338072920 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 msgr2=0x7ff338168970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff338168970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 >> v1:172.21.15.203:6789/0 conn(0x7ff33815ddd0 legacy=0x7ff338070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff338071970 con 0x7ff338072920 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ff320001690 con 0x7ff338072920 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 >> v1:172.21.15.146:6789/0 conn(0x7ff338072920 legacy=0x7ff3380cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0039e0 0x7ff31c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff31c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff31c004d40 0x7ff31c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff338071690 con 0x7ff31c0039e0 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c00ba70 con 0x7ff31c004d40 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.933+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c00bc70 con 0x7ff3380d0240 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0039e0 0x7ff31c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff32e000640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff31c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff337400640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff31c004d40 0x7ff31c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 -- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 msgr2=0x7ff31c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3380d0240 0x7ff31c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 -- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff31c004d40 msgr2=0x7ff31c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff31c004d40 0x7ff31c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.934+0000 7ff336a00640 1 -- 172.21.15.146:0/807230267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c003520 con 0x7ff31c0039e0 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.935+0000 7ff336a00640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0039e0 0x7ff31c003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff328001720 tx=0x7ff31c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240b662540911df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.935+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328001370 con 0x7ff31c0039e0 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.935+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3280052d0 con 0x7ff31c0039e0 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.935+0000 7ff336000640 1 -- 172.21.15.146:0/807230267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32802abc0 con 0x7ff31c0039e0 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 -- 172.21.15.146:0/807230267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0039e0 msgr2=0x7ff31c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 --2- 172.21.15.146:0/807230267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0039e0 0x7ff31c003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff328001720 tx=0x7ff31c005830 comp rx=0 tx=0).stop 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337400640 1 -- 172.21.15.146:0/807230267 reap_dead start 2024-04-24T23:00:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 -- 172.21.15.146:0/807230267 shutdown_connections 2024-04-24T23:00:29.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 -- 172.21.15.146:0/807230267 >> 172.21.15.146:0/807230267 conn(0x7ff33806b320 msgr2=0x7ff33806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 -- 172.21.15.146:0/807230267 shutdown_connections 2024-04-24T23:00:29.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.936+0000 7ff337e00640 1 -- 172.21.15.146:0/807230267 wait complete. 2024-04-24T23:00:29.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.938+0000 7ff337e00640 1 Processor -- start 2024-04-24T23:00:29.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.938+0000 7ff337e00640 1 -- start start 2024-04-24T23:00:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff31c0039e0 0x7ff338152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3380cbb00 0x7ff338145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380b3d90 con 0x7ff33814f440 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380b3c10 con 0x7ff3380cbb00 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff337e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff3380b3f10 con 0x7ff31c0039e0 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff32e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff32e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45158/0 (socket says 172.21.15.146:45158) 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.939+0000 7ff32e000640 1 -- 172.21.15.146:0/3014300794 learned_addr learned my addr 172.21.15.146:0/3014300794 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff337400640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3380cbb00 0x7ff338145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff336a00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff31c0039e0 0x7ff338152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 -- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff31c0039e0 msgr2=0x7ff338152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff31c0039e0 0x7ff338152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 -- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3380cbb00 msgr2=0x7ff338145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3380cbb00 0x7ff338145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 -- 172.21.15.146:0/3014300794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33814fc30 con 0x7ff33814f440 2024-04-24T23:00:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32e000640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff32000e700 tx=0x7ff32000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32000ee10 con 0x7ff33814f440 2024-04-24T23:00:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff320018070 con 0x7ff33814f440 2024-04-24T23:00:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32000cb10 con 0x7ff33814f440 2024-04-24T23:00:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33815f750 con 0x7ff33814f440 2024-04-24T23:00:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.940+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33815fd10 con 0x7ff33814f440 2024-04-24T23:00:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.941+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33804f500 con 0x7ff33814f440 2024-04-24T23:00:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.942+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff32000ccb0 con 0x7ff33814f440 2024-04-24T23:00:29.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.943+0000 7ff32f400640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 0x7ff31406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.944+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff32008b060 con 0x7ff33814f440 2024-04-24T23:00:29.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.944+0000 7ff336a00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 0x7ff31406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.945+0000 7ff336a00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 0x7ff31406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff328032000 tx=0x7ff32802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:29.948+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff3200596c0 con 0x7ff33814f440 2024-04-24T23:00:30.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.130+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff33806b950 con 0x7ff31406be30 2024-04-24T23:00:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.154+0000 7ff32f400640 1 -- 172.21.15.146:0/3014300794 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7ff33806b950 con 0x7ff31406be30 2024-04-24T23:00:30.161 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:30.163 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:00:30.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 msgr2=0x7ff31406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 0x7ff31406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff328032000 tx=0x7ff32802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 msgr2=0x7ff3381594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff32000e700 tx=0x7ff32000ebc0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 shutdown_connections 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3380cbb00 0x7ff338145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff33814f440 0x7ff3381594f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff31406be30 0x7ff31406e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 --2- 172.21.15.146:0/3014300794 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff31c0039e0 0x7ff338152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 >> 172.21.15.146:0/3014300794 conn(0x7ff33806b320 msgr2=0x7ff3380affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.161+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 shutdown_connections 2024-04-24T23:00:30.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.162+0000 7ff337e00640 1 -- 172.21.15.146:0/3014300794 wait complete. 2024-04-24T23:00:30.182 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-24T23:00:29.591358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005612"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010800+0000","last_change":"2024-04-24T22:59:53.808035+0000","last_active":"2024-04-24T23:00:01.010800+0000","last_peered":"2024-04-24T23:00:01.010800+0000","last_clean":"2024-04-24T23:00:01.010800+0000","last_became_active":"2024-04-24T22:59:53.807655+0000","last_became_peered":"2024-04-24T22:59:53.807655+0000","last_unstale":"2024-04-24T23:00:01.010800+0000","last_undegraded":"2024-04-24T23:00:01.010800+0000","last_fullsized":"2024-04-24T23:00:01.010800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185694+0000","last_change":"2024-04-24T22:59:54.844377+0000","last_active":"2024-04-24T23:00:01.185694+0000","last_peered":"2024-04-24T23:00:01.185694+0000","last_clean":"2024-04-24T23:00:01.185694+0000","last_became_active":"2024-04-24T22:59:54.844081+0000","last_became_peered":"2024-04-24T22:59:54.844081+0000","last_unstale":"2024-04-24T23:00:01.185694+0000","last_undegraded":"2024-04-24T23:00:01.185694+0000","last_fullsized":"2024-04-24T23:00:01.185694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:03:46.525647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158053+0000","last_change":"2024-04-24T22:59:59.190167+0000","last_active":"2024-04-24T23:00:00.158053+0000","last_peered":"2024-04-24T23:00:00.158053+0000","last_clean":"2024-04-24T23:00:00.158053+0000","last_became_active":"2024-04-24T22:59:59.189393+0000","last_became_peered":"2024-04-24T22:59:59.189393+0000","last_unstale":"2024-04-24T23:00:00.158053+0000","last_undegraded":"2024-04-24T23:00:00.158053+0000","last_fullsized":"2024-04-24T23:00:00.158053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.516700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185829+0000","last_change":"2024-04-24T22:59:53.799029+0000","last_active":"2024-04-24T23:00:01.185829+0000","last_peered":"2024-04-24T23:00:01.185829+0000","last_clean":"2024-04-24T23:00:01.185829+0000","last_became_active":"2024-04-24T22:59:53.798727+0000","last_became_peered":"2024-04-24T22:59:53.798727+0000","last_unstale":"2024-04-24T23:00:01.185829+0000","last_undegraded":"2024-04-24T23:00:01.185829+0000","last_fullsized":"2024-04-24T23:00:01.185829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:14:29.506259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185571+0000","last_change":"2024-04-24T22:59:54.844472+0000","last_active":"2024-04-24T23:00:01.185571+0000","last_peered":"2024-04-24T23:00:01.185571+0000","last_clean":"2024-04-24T23:00:01.185571+0000","last_became_active":"2024-04-24T22:59:54.844134+0000","last_became_peered":"2024-04-24T22:59:54.844134+0000","last_unstale":"2024-04-24T23:00:01.185571+0000","last_undegraded":"2024-04-24T23:00:01.185571+0000","last_fullsized":"2024-04-24T23:00:01.185571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:19.889185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155534+0000","last_change":"2024-04-24T22:59:59.170482+0000","last_active":"2024-04-24T23:00:00.155534+0000","last_peered":"2024-04-24T23:00:00.155534+0000","last_clean":"2024-04-24T23:00:00.155534+0000","last_became_active":"2024-04-24T22:59:59.169481+0000","last_became_peered":"2024-04-24T22:59:59.169481+0000","last_unstale":"2024-04-24T23:00:00.155534+0000","last_undegraded":"2024-04-24T23:00:00.155534+0000","last_fullsized":"2024-04-24T23:00:00.155534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:26.004993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246604+0000","last_change":"2024-04-24T22:59:53.796317+0000","last_active":"2024-04-24T23:00:00.246604+0000","last_peered":"2024-04-24T23:00:00.246604+0000","last_clean":"2024-04-24T23:00:00.246604+0000","last_became_active":"2024-04-24T22:59:53.795867+0000","last_became_peered":"2024-04-24T22:59:53.795867+0000","last_unstale":"2024-04-24T23:00:00.246604+0000","last_undegraded":"2024-04-24T23:00:00.246604+0000","last_fullsized":"2024-04-24T23:00:00.246604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337219+0000","last_change":"2024-04-24T22:59:54.819137+0000","last_active":"2024-04-24T23:00:00.337219+0000","last_peered":"2024-04-24T23:00:00.337219+0000","last_clean":"2024-04-24T23:00:00.337219+0000","last_became_active":"2024-04-24T22:59:54.818824+0000","last_became_peered":"2024-04-24T22:59:54.818824+0000","last_unstale":"2024-04-24T23:00:00.337219+0000","last_undegraded":"2024-04-24T23:00:00.337219+0000","last_fullsized":"2024-04-24T23:00:00.337219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156424+0000","last_change":"2024-04-24T22:59:59.175621+0000","last_active":"2024-04-24T23:00:00.156424+0000","last_peered":"2024-04-24T23:00:00.156424+0000","last_clean":"2024-04-24T23:00:00.156424+0000","last_became_active":"2024-04-24T22:59:59.175193+0000","last_became_peered":"2024-04-24T22:59:59.175193+0000","last_unstale":"2024-04-24T23:00:00.156424+0000","last_undegraded":"2024-04-24T23:00:00.156424+0000","last_fullsized":"2024-04-24T23:00:00.156424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246019+0000","last_change":"2024-04-24T22:59:53.789351+0000","last_active":"2024-04-24T23:00:00.246019+0000","last_peered":"2024-04-24T23:00:00.246019+0000","last_clean":"2024-04-24T23:00:00.246019+0000","last_became_active":"2024-04-24T22:59:53.789011+0000","last_became_peered":"2024-04-24T22:59:53.789011+0000","last_unstale":"2024-04-24T23:00:00.246019+0000","last_undegraded":"2024-04-24T23:00:00.246019+0000","last_fullsized":"2024-04-24T23:00:00.246019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184542+0000","last_change":"2024-04-24T22:59:54.831152+0000","last_active":"2024-04-24T23:00:01.184542+0000","last_peered":"2024-04-24T23:00:01.184542+0000","last_clean":"2024-04-24T23:00:01.184542+0000","last_became_active":"2024-04-24T22:59:54.829948+0000","last_became_peered":"2024-04-24T22:59:54.829948+0000","last_unstale":"2024-04-24T23:00:01.184542+0000","last_undegraded":"2024-04-24T23:00:01.184542+0000","last_fullsized":"2024-04-24T23:00:01.184542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:00.243216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155762+0000","last_change":"2024-04-24T22:59:59.183804+0000","last_active":"2024-04-24T23:00:00.155762+0000","last_peered":"2024-04-24T23:00:00.155762+0000","last_clean":"2024-04-24T23:00:00.155762+0000","last_became_active":"2024-04-24T22:59:59.183323+0000","last_became_peered":"2024-04-24T22:59:59.183323+0000","last_unstale":"2024-04-24T23:00:00.155762+0000","last_undegraded":"2024-04-24T23:00:00.155762+0000","last_fullsized":"2024-04-24T23:00:00.155762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184098+0000","last_change":"2024-04-24T22:59:54.822754+0000","last_active":"2024-04-24T23:00:01.184098+0000","last_peered":"2024-04-24T23:00:01.184098+0000","last_clean":"2024-04-24T23:00:01.184098+0000","last_became_active":"2024-04-24T22:59:54.822388+0000","last_became_peered":"2024-04-24T22:59:54.822388+0000","last_unstale":"2024-04-24T23:00:01.184098+0000","last_undegraded":"2024-04-24T23:00:01.184098+0000","last_fullsized":"2024-04-24T23:00:01.184098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:30.347602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183966+0000","last_change":"2024-04-24T22:59:53.802267+0000","last_active":"2024-04-24T23:00:01.183966+0000","last_peered":"2024-04-24T23:00:01.183966+0000","last_clean":"2024-04-24T23:00:01.183966+0000","last_became_active":"2024-04-24T22:59:53.801524+0000","last_became_peered":"2024-04-24T22:59:53.801524+0000","last_unstale":"2024-04-24T23:00:01.183966+0000","last_undegraded":"2024-04-24T23:00:01.183966+0000","last_fullsized":"2024-04-24T23:00:01.183966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:11.327838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183950+0000","last_change":"2024-04-24T22:59:59.177746+0000","last_active":"2024-04-24T23:00:01.183950+0000","last_peered":"2024-04-24T23:00:01.183950+0000","last_clean":"2024-04-24T23:00:01.183950+0000","last_became_active":"2024-04-24T22:59:59.176645+0000","last_became_peered":"2024-04-24T22:59:59.176645+0000","last_unstale":"2024-04-24T23:00:01.183950+0000","last_undegraded":"2024-04-24T23:00:01.183950+0000","last_fullsized":"2024-04-24T23:00:01.183950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:59:28.582936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162596+0000","last_change":"2024-04-24T22:59:54.833871+0000","last_active":"2024-04-24T23:00:00.162596+0000","last_peered":"2024-04-24T23:00:00.162596+0000","last_clean":"2024-04-24T23:00:00.162596+0000","last_became_active":"2024-04-24T22:59:54.833620+0000","last_became_peered":"2024-04-24T22:59:54.833620+0000","last_unstale":"2024-04-24T23:00:00.162596+0000","last_undegraded":"2024-04-24T23:00:00.162596+0000","last_fullsized":"2024-04-24T23:00:00.162596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159199+0000","last_change":"2024-04-24T22:59:53.801795+0000","last_active":"2024-04-24T23:00:00.159199+0000","last_peered":"2024-04-24T23:00:00.159199+0000","last_clean":"2024-04-24T23:00:00.159199+0000","last_became_active":"2024-04-24T22:59:53.801129+0000","last_became_peered":"2024-04-24T22:59:53.801129+0000","last_unstale":"2024-04-24T23:00:00.159199+0000","last_undegraded":"2024-04-24T23:00:00.159199+0000","last_fullsized":"2024-04-24T23:00:00.159199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245637+0000","last_change":"2024-04-24T22:59:59.180795+0000","last_active":"2024-04-24T23:00:00.245637+0000","last_peered":"2024-04-24T23:00:00.245637+0000","last_clean":"2024-04-24T23:00:00.245637+0000","last_became_active":"2024-04-24T22:59:59.179570+0000","last_became_peered":"2024-04-24T22:59:59.179570+0000","last_unstale":"2024-04-24T23:00:00.245637+0000","last_undegraded":"2024-04-24T23:00:00.245637+0000","last_fullsized":"2024-04-24T23:00:00.245637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.008767+0000","last_change":"2024-04-24T22:59:54.830621+0000","last_active":"2024-04-24T23:00:01.008767+0000","last_peered":"2024-04-24T23:00:01.008767+0000","last_clean":"2024-04-24T23:00:01.008767+0000","last_became_active":"2024-04-24T22:59:54.830261+0000","last_became_peered":"2024-04-24T22:59:54.830261+0000","last_unstale":"2024-04-24T23:00:01.008767+0000","last_undegraded":"2024-04-24T23:00:01.008767+0000","last_fullsized":"2024-04-24T23:00:01.008767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009662+0000","last_change":"2024-04-24T22:59:53.797083+0000","last_active":"2024-04-24T23:00:01.009662+0000","last_peered":"2024-04-24T23:00:01.009662+0000","last_clean":"2024-04-24T23:00:01.009662+0000","last_became_active":"2024-04-24T22:59:53.796741+0000","last_became_peered":"2024-04-24T22:59:53.796741+0000","last_unstale":"2024-04-24T23:00:01.009662+0000","last_undegraded":"2024-04-24T23:00:01.009662+0000","last_fullsized":"2024-04-24T23:00:01.009662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162937+0000","last_change":"2024-04-24T22:59:59.187326+0000","last_active":"2024-04-24T23:00:00.162937+0000","last_peered":"2024-04-24T23:00:00.162937+0000","last_clean":"2024-04-24T23:00:00.162937+0000","last_became_active":"2024-04-24T22:59:59.186542+0000","last_became_peered":"2024-04-24T22:59:59.186542+0000","last_unstale":"2024-04-24T23:00:00.162937+0000","last_undegraded":"2024-04-24T23:00:00.162937+0000","last_fullsized":"2024-04-24T23:00:00.162937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:20.837462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183491+0000","last_change":"2024-04-24T22:59:54.819833+0000","last_active":"2024-04-24T23:00:01.183491+0000","last_peered":"2024-04-24T23:00:01.183491+0000","last_clean":"2024-04-24T23:00:01.183491+0000","last_became_active":"2024-04-24T22:59:54.817443+0000","last_became_peered":"2024-04-24T22:59:54.817443+0000","last_unstale":"2024-04-24T23:00:01.183491+0000","last_undegraded":"2024-04-24T23:00:01.183491+0000","last_fullsized":"2024-04-24T23:00:01.183491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:05.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.244949+0000","last_change":"2024-04-24T22:59:53.796852+0000","last_active":"2024-04-24T23:00:00.244949+0000","last_peered":"2024-04-24T23:00:00.244949+0000","last_clean":"2024-04-24T23:00:00.244949+0000","last_became_active":"2024-04-24T22:59:53.796053+0000","last_became_peered":"2024-04-24T22:59:53.796053+0000","last_unstale":"2024-04-24T23:00:00.244949+0000","last_undegraded":"2024-04-24T23:00:00.244949+0000","last_fullsized":"2024-04-24T23:00:00.244949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.870817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157682+0000","last_change":"2024-04-24T22:59:59.168702+0000","last_active":"2024-04-24T23:00:00.157682+0000","last_peered":"2024-04-24T23:00:00.157682+0000","last_clean":"2024-04-24T23:00:00.157682+0000","last_became_active":"2024-04-24T22:59:59.168344+0000","last_became_peered":"2024-04-24T22:59:59.168344+0000","last_unstale":"2024-04-24T23:00:00.157682+0000","last_undegraded":"2024-04-24T23:00:00.157682+0000","last_fullsized":"2024-04-24T23:00:00.157682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009609+0000","last_change":"2024-04-24T22:59:54.831524+0000","last_active":"2024-04-24T23:00:01.009609+0000","last_peered":"2024-04-24T23:00:01.009609+0000","last_clean":"2024-04-24T23:00:01.009609+0000","last_became_active":"2024-04-24T22:59:54.831142+0000","last_became_peered":"2024-04-24T22:59:54.831142+0000","last_unstale":"2024-04-24T23:00:01.009609+0000","last_undegraded":"2024-04-24T23:00:01.009609+0000","last_fullsized":"2024-04-24T23:00:01.009609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185674+0000","last_change":"2024-04-24T22:59:53.797494+0000","last_active":"2024-04-24T23:00:01.185674+0000","last_peered":"2024-04-24T23:00:01.185674+0000","last_clean":"2024-04-24T23:00:01.185674+0000","last_became_active":"2024-04-24T22:59:53.796774+0000","last_became_peered":"2024-04-24T22:59:53.796774+0000","last_unstale":"2024-04-24T23:00:01.185674+0000","last_undegraded":"2024-04-24T23:00:01.185674+0000","last_fullsized":"2024-04-24T23:00:01.185674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155573+0000","last_change":"2024-04-24T22:59:59.172300+0000","last_active":"2024-04-24T23:00:00.155573+0000","last_peered":"2024-04-24T23:00:00.155573+0000","last_clean":"2024-04-24T23:00:00.155573+0000","last_became_active":"2024-04-24T22:59:59.171942+0000","last_became_peered":"2024-04-24T22:59:59.171942+0000","last_unstale":"2024-04-24T23:00:00.155573+0000","last_undegraded":"2024-04-24T23:00:00.155573+0000","last_fullsized":"2024-04-24T23:00:00.155573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:16.270363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010273+0000","last_change":"2024-04-24T22:59:54.831365+0000","last_active":"2024-04-24T23:00:01.010273+0000","last_peered":"2024-04-24T23:00:01.010273+0000","last_clean":"2024-04-24T23:00:01.010273+0000","last_became_active":"2024-04-24T22:59:54.830470+0000","last_became_peered":"2024-04-24T22:59:54.830470+0000","last_unstale":"2024-04-24T23:00:01.010273+0000","last_undegraded":"2024-04-24T23:00:01.010273+0000","last_fullsized":"2024-04-24T23:00:01.010273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010410+0000","last_change":"2024-04-24T22:59:53.803366+0000","last_active":"2024-04-24T23:00:01.010410+0000","last_peered":"2024-04-24T23:00:01.010410+0000","last_clean":"2024-04-24T23:00:01.010410+0000","last_became_active":"2024-04-24T22:59:53.802969+0000","last_became_peered":"2024-04-24T22:59:53.802969+0000","last_unstale":"2024-04-24T23:00:01.010410+0000","last_undegraded":"2024-04-24T23:00:01.010410+0000","last_fullsized":"2024-04-24T23:00:01.010410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009016+0000","last_change":"2024-04-24T22:59:59.177853+0000","last_active":"2024-04-24T23:00:01.009016+0000","last_peered":"2024-04-24T23:00:01.009016+0000","last_clean":"2024-04-24T23:00:01.009016+0000","last_became_active":"2024-04-24T22:59:59.177268+0000","last_became_peered":"2024-04-24T22:59:59.177268+0000","last_unstale":"2024-04-24T23:00:01.009016+0000","last_undegraded":"2024-04-24T23:00:01.009016+0000","last_fullsized":"2024-04-24T23:00:01.009016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:44.225608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159891+0000","last_change":"2024-04-24T22:59:54.842312+0000","last_active":"2024-04-24T23:00:00.159891+0000","last_peered":"2024-04-24T23:00:00.159891+0000","last_clean":"2024-04-24T23:00:00.159891+0000","last_became_active":"2024-04-24T22:59:54.842034+0000","last_became_peered":"2024-04-24T22:59:54.842034+0000","last_unstale":"2024-04-24T23:00:00.159891+0000","last_undegraded":"2024-04-24T23:00:00.159891+0000","last_fullsized":"2024-04-24T23:00:00.159891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:56.808348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184853+0000","last_change":"2024-04-24T22:59:53.801680+0000","last_active":"2024-04-24T23:00:01.184853+0000","last_peered":"2024-04-24T23:00:01.184853+0000","last_clean":"2024-04-24T23:00:01.184853+0000","last_became_active":"2024-04-24T22:59:53.801365+0000","last_became_peered":"2024-04-24T22:59:53.801365+0000","last_unstale":"2024-04-24T23:00:01.184853+0000","last_undegraded":"2024-04-24T23:00:01.184853+0000","last_fullsized":"2024-04-24T23:00:01.184853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:29.189206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160460+0000","last_change":"2024-04-24T22:59:59.180894+0000","last_active":"2024-04-24T23:00:00.160460+0000","last_peered":"2024-04-24T23:00:00.160460+0000","last_clean":"2024-04-24T23:00:00.160460+0000","last_became_active":"2024-04-24T22:59:59.177236+0000","last_became_peered":"2024-04-24T22:59:59.177236+0000","last_unstale":"2024-04-24T23:00:00.160460+0000","last_undegraded":"2024-04-24T23:00:00.160460+0000","last_fullsized":"2024-04-24T23:00:00.160460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157352+0000","last_change":"2024-04-24T22:59:54.836662+0000","last_active":"2024-04-24T23:00:00.157352+0000","last_peered":"2024-04-24T23:00:00.157352+0000","last_clean":"2024-04-24T23:00:00.157352+0000","last_became_active":"2024-04-24T22:59:54.835790+0000","last_became_peered":"2024-04-24T22:59:54.835790+0000","last_unstale":"2024-04-24T23:00:00.157352+0000","last_undegraded":"2024-04-24T23:00:00.157352+0000","last_fullsized":"2024-04-24T23:00:00.157352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184827+0000","last_change":"2024-04-24T22:59:53.805218+0000","last_active":"2024-04-24T23:00:01.184827+0000","last_peered":"2024-04-24T23:00:01.184827+0000","last_clean":"2024-04-24T23:00:01.184827+0000","last_became_active":"2024-04-24T22:59:53.803401+0000","last_became_peered":"2024-04-24T22:59:53.803401+0000","last_unstale":"2024-04-24T23:00:01.184827+0000","last_undegraded":"2024-04-24T23:00:01.184827+0000","last_fullsized":"2024-04-24T23:00:01.184827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:56.417305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158402+0000","last_change":"2024-04-24T22:59:59.180784+0000","last_active":"2024-04-24T23:00:00.158402+0000","last_peered":"2024-04-24T23:00:00.158402+0000","last_clean":"2024-04-24T23:00:00.158402+0000","last_became_active":"2024-04-24T22:59:59.180017+0000","last_became_peered":"2024-04-24T22:59:59.180017+0000","last_unstale":"2024-04-24T23:00:00.158402+0000","last_undegraded":"2024-04-24T23:00:00.158402+0000","last_fullsized":"2024-04-24T23:00:00.158402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245322+0000","last_change":"2024-04-24T22:59:54.836197+0000","last_active":"2024-04-24T23:00:00.245322+0000","last_peered":"2024-04-24T23:00:00.245322+0000","last_clean":"2024-04-24T23:00:00.245322+0000","last_became_active":"2024-04-24T22:59:54.835647+0000","last_became_peered":"2024-04-24T22:59:54.835647+0000","last_unstale":"2024-04-24T23:00:00.245322+0000","last_undegraded":"2024-04-24T23:00:00.245322+0000","last_fullsized":"2024-04-24T23:00:00.245322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184333+0000","last_change":"2024-04-24T22:59:53.804121+0000","last_active":"2024-04-24T23:00:01.184333+0000","last_peered":"2024-04-24T23:00:01.184333+0000","last_clean":"2024-04-24T23:00:01.184333+0000","last_became_active":"2024-04-24T22:59:53.803732+0000","last_became_peered":"2024-04-24T22:59:53.803732+0000","last_unstale":"2024-04-24T23:00:01.184333+0000","last_undegraded":"2024-04-24T23:00:01.184333+0000","last_fullsized":"2024-04-24T23:00:01.184333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:55.794648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159307+0000","last_change":"2024-04-24T22:59:59.180854+0000","last_active":"2024-04-24T23:00:00.159307+0000","last_peered":"2024-04-24T23:00:00.159307+0000","last_clean":"2024-04-24T23:00:00.159307+0000","last_became_active":"2024-04-24T22:59:59.179885+0000","last_became_peered":"2024-04-24T22:59:59.179885+0000","last_unstale":"2024-04-24T23:00:00.159307+0000","last_undegraded":"2024-04-24T23:00:00.159307+0000","last_fullsized":"2024-04-24T23:00:00.159307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183892+0000","last_change":"2024-04-24T22:59:54.841245+0000","last_active":"2024-04-24T23:00:01.183892+0000","last_peered":"2024-04-24T23:00:01.183892+0000","last_clean":"2024-04-24T23:00:01.183892+0000","last_became_active":"2024-04-24T22:59:54.840779+0000","last_became_peered":"2024-04-24T22:59:54.840779+0000","last_unstale":"2024-04-24T23:00:01.183892+0000","last_undegraded":"2024-04-24T23:00:01.183892+0000","last_fullsized":"2024-04-24T23:00:01.183892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:21.114664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158462+0000","last_change":"2024-04-24T22:59:53.800686+0000","last_active":"2024-04-24T23:00:00.158462+0000","last_peered":"2024-04-24T23:00:00.158462+0000","last_clean":"2024-04-24T23:00:00.158462+0000","last_became_active":"2024-04-24T22:59:53.799843+0000","last_became_peered":"2024-04-24T22:59:53.799843+0000","last_unstale":"2024-04-24T23:00:00.158462+0000","last_undegraded":"2024-04-24T23:00:00.158462+0000","last_fullsized":"2024-04-24T23:00:00.158462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159857+0000","last_change":"2024-04-24T22:59:59.185850+0000","last_active":"2024-04-24T23:00:00.159857+0000","last_peered":"2024-04-24T23:00:00.159857+0000","last_clean":"2024-04-24T23:00:00.159857+0000","last_became_active":"2024-04-24T22:59:59.181277+0000","last_became_peered":"2024-04-24T22:59:59.181277+0000","last_unstale":"2024-04-24T23:00:00.159857+0000","last_undegraded":"2024-04-24T23:00:00.159857+0000","last_fullsized":"2024-04-24T23:00:00.159857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159354+0000","last_change":"2024-04-24T22:59:54.833216+0000","last_active":"2024-04-24T23:00:00.159354+0000","last_peered":"2024-04-24T23:00:00.159354+0000","last_clean":"2024-04-24T23:00:00.159354+0000","last_became_active":"2024-04-24T22:59:54.832933+0000","last_became_peered":"2024-04-24T22:59:54.832933+0000","last_unstale":"2024-04-24T23:00:00.159354+0000","last_undegraded":"2024-04-24T23:00:00.159354+0000","last_fullsized":"2024-04-24T23:00:00.159354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183544+0000","last_change":"2024-04-24T22:59:53.797462+0000","last_active":"2024-04-24T23:00:01.183544+0000","last_peered":"2024-04-24T23:00:01.183544+0000","last_clean":"2024-04-24T23:00:01.183544+0000","last_became_active":"2024-04-24T22:59:53.797136+0000","last_became_peered":"2024-04-24T22:59:53.797136+0000","last_unstale":"2024-04-24T23:00:01.183544+0000","last_undegraded":"2024-04-24T23:00:01.183544+0000","last_fullsized":"2024-04-24T23:00:01.183544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185371+0000","last_change":"2024-04-24T22:59:59.183061+0000","last_active":"2024-04-24T23:00:01.185371+0000","last_peered":"2024-04-24T23:00:01.185371+0000","last_clean":"2024-04-24T23:00:01.185371+0000","last_became_active":"2024-04-24T22:59:59.182605+0000","last_became_peered":"2024-04-24T22:59:59.182605+0000","last_unstale":"2024-04-24T23:00:01.185371+0000","last_undegraded":"2024-04-24T23:00:01.185371+0000","last_fullsized":"2024-04-24T23:00:01.185371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:52.103486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010031+0000","last_change":"2024-04-24T22:59:54.826763+0000","last_active":"2024-04-24T23:00:01.010031+0000","last_peered":"2024-04-24T23:00:01.010031+0000","last_clean":"2024-04-24T23:00:01.010031+0000","last_became_active":"2024-04-24T22:59:54.826396+0000","last_became_peered":"2024-04-24T22:59:54.826396+0000","last_unstale":"2024-04-24T23:00:01.010031+0000","last_undegraded":"2024-04-24T23:00:01.010031+0000","last_fullsized":"2024-04-24T23:00:01.010031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184139+0000","last_change":"2024-04-24T22:59:53.802569+0000","last_active":"2024-04-24T23:00:01.184139+0000","last_peered":"2024-04-24T23:00:01.184139+0000","last_clean":"2024-04-24T23:00:01.184139+0000","last_became_active":"2024-04-24T22:59:53.801965+0000","last_became_peered":"2024-04-24T22:59:53.801965+0000","last_unstale":"2024-04-24T23:00:01.184139+0000","last_undegraded":"2024-04-24T23:00:01.184139+0000","last_fullsized":"2024-04-24T23:00:01.184139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:09.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336798+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:00:00.336798+0000","last_peered":"2024-04-24T23:00:00.336798+0000","last_clean":"2024-04-24T23:00:00.336798+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:00:00.336798+0000","last_undegraded":"2024-04-24T23:00:00.336798+0000","last_fullsized":"2024-04-24T23:00:00.336798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184761+0000","last_change":"2024-04-24T22:59:59.161211+0000","last_active":"2024-04-24T23:00:01.184761+0000","last_peered":"2024-04-24T23:00:01.184761+0000","last_clean":"2024-04-24T23:00:01.184761+0000","last_became_active":"2024-04-24T22:59:59.160734+0000","last_became_peered":"2024-04-24T22:59:59.160734+0000","last_unstale":"2024-04-24T23:00:01.184761+0000","last_undegraded":"2024-04-24T23:00:01.184761+0000","last_fullsized":"2024-04-24T23:00:01.184761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:36.104485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184606+0000","last_change":"2024-04-24T22:59:54.819610+0000","last_active":"2024-04-24T23:00:01.184606+0000","last_peered":"2024-04-24T23:00:01.184606+0000","last_clean":"2024-04-24T23:00:01.184606+0000","last_became_active":"2024-04-24T22:59:54.819070+0000","last_became_peered":"2024-04-24T22:59:54.819070+0000","last_unstale":"2024-04-24T23:00:01.184606+0000","last_undegraded":"2024-04-24T23:00:01.184606+0000","last_fullsized":"2024-04-24T23:00:01.184606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:53.348359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160124+0000","last_change":"2024-04-24T22:59:53.799389+0000","last_active":"2024-04-24T23:00:00.160124+0000","last_peered":"2024-04-24T23:00:00.160124+0000","last_clean":"2024-04-24T23:00:00.160124+0000","last_became_active":"2024-04-24T22:59:53.799041+0000","last_became_peered":"2024-04-24T22:59:53.799041+0000","last_unstale":"2024-04-24T23:00:00.160124+0000","last_undegraded":"2024-04-24T23:00:00.160124+0000","last_fullsized":"2024-04-24T23:00:00.160124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156106+0000","last_change":"2024-04-24T22:59:59.174885+0000","last_active":"2024-04-24T23:00:00.156106+0000","last_peered":"2024-04-24T23:00:00.156106+0000","last_clean":"2024-04-24T23:00:00.156106+0000","last_became_active":"2024-04-24T22:59:59.174370+0000","last_became_peered":"2024-04-24T22:59:59.174370+0000","last_unstale":"2024-04-24T23:00:00.156106+0000","last_undegraded":"2024-04-24T23:00:00.156106+0000","last_fullsized":"2024-04-24T23:00:00.156106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245921+0000","last_change":"2024-04-24T22:59:54.835634+0000","last_active":"2024-04-24T23:00:00.245921+0000","last_peered":"2024-04-24T23:00:00.245921+0000","last_clean":"2024-04-24T23:00:00.245921+0000","last_became_active":"2024-04-24T22:59:54.833569+0000","last_became_peered":"2024-04-24T22:59:54.833569+0000","last_unstale":"2024-04-24T23:00:00.245921+0000","last_undegraded":"2024-04-24T23:00:00.245921+0000","last_fullsized":"2024-04-24T23:00:00.245921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:29.860749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185367+0000","last_change":"2024-04-24T22:59:53.802150+0000","last_active":"2024-04-24T23:00:01.185367+0000","last_peered":"2024-04-24T23:00:01.185367+0000","last_clean":"2024-04-24T23:00:01.185367+0000","last_became_active":"2024-04-24T22:59:53.799509+0000","last_became_peered":"2024-04-24T22:59:53.799509+0000","last_unstale":"2024-04-24T23:00:01.185367+0000","last_undegraded":"2024-04-24T23:00:01.185367+0000","last_fullsized":"2024-04-24T23:00:01.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:36.050787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184895+0000","last_change":"2024-04-24T22:59:59.177414+0000","last_active":"2024-04-24T23:00:01.184895+0000","last_peered":"2024-04-24T23:00:01.184895+0000","last_clean":"2024-04-24T23:00:01.184895+0000","last_became_active":"2024-04-24T22:59:59.174313+0000","last_became_peered":"2024-04-24T22:59:59.174313+0000","last_unstale":"2024-04-24T23:00:01.184895+0000","last_undegraded":"2024-04-24T23:00:01.184895+0000","last_fullsized":"2024-04-24T23:00:01.184895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:22.796518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245879+0000","last_change":"2024-04-24T22:59:54.823918+0000","last_active":"2024-04-24T23:00:00.245879+0000","last_peered":"2024-04-24T23:00:00.245879+0000","last_clean":"2024-04-24T23:00:00.245879+0000","last_became_active":"2024-04-24T22:59:54.823619+0000","last_became_peered":"2024-04-24T22:59:54.823619+0000","last_unstale":"2024-04-24T23:00:00.245879+0000","last_undegraded":"2024-04-24T23:00:00.245879+0000","last_fullsized":"2024-04-24T23:00:00.245879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009718+0000","last_change":"2024-04-24T22:59:53.802658+0000","last_active":"2024-04-24T23:00:01.009718+0000","last_peered":"2024-04-24T23:00:01.009718+0000","last_clean":"2024-04-24T23:00:01.009718+0000","last_became_active":"2024-04-24T22:59:53.802337+0000","last_became_peered":"2024-04-24T22:59:53.802337+0000","last_unstale":"2024-04-24T23:00:01.009718+0000","last_undegraded":"2024-04-24T23:00:01.009718+0000","last_fullsized":"2024-04-24T23:00:01.009718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183130+0000","last_change":"2024-04-24T22:59:59.158432+0000","last_active":"2024-04-24T23:00:01.183130+0000","last_peered":"2024-04-24T23:00:01.183130+0000","last_clean":"2024-04-24T23:00:01.183130+0000","last_became_active":"2024-04-24T22:59:59.157980+0000","last_became_peered":"2024-04-24T22:59:59.157980+0000","last_unstale":"2024-04-24T23:00:01.183130+0000","last_undegraded":"2024-04-24T23:00:01.183130+0000","last_fullsized":"2024-04-24T23:00:01.183130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:13.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158298+0000","last_change":"2024-04-24T22:59:54.830501+0000","last_active":"2024-04-24T23:00:00.158298+0000","last_peered":"2024-04-24T23:00:00.158298+0000","last_clean":"2024-04-24T23:00:00.158298+0000","last_became_active":"2024-04-24T22:59:54.829827+0000","last_became_peered":"2024-04-24T22:59:54.829827+0000","last_unstale":"2024-04-24T23:00:00.158298+0000","last_undegraded":"2024-04-24T23:00:00.158298+0000","last_fullsized":"2024-04-24T23:00:00.158298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245937+0000","last_change":"2024-04-24T22:59:53.804112+0000","last_active":"2024-04-24T23:00:00.245937+0000","last_peered":"2024-04-24T23:00:00.245937+0000","last_clean":"2024-04-24T23:00:00.245937+0000","last_became_active":"2024-04-24T22:59:53.803737+0000","last_became_peered":"2024-04-24T22:59:53.803737+0000","last_unstale":"2024-04-24T23:00:00.245937+0000","last_undegraded":"2024-04-24T23:00:00.245937+0000","last_fullsized":"2024-04-24T23:00:00.245937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336897+0000","last_change":"2024-04-24T22:59:59.170945+0000","last_active":"2024-04-24T23:00:00.336897+0000","last_peered":"2024-04-24T23:00:00.336897+0000","last_clean":"2024-04-24T23:00:00.336897+0000","last_became_active":"2024-04-24T22:59:59.170564+0000","last_became_peered":"2024-04-24T22:59:59.170564+0000","last_unstale":"2024-04-24T23:00:00.336897+0000","last_undegraded":"2024-04-24T23:00:00.336897+0000","last_fullsized":"2024-04-24T23:00:00.336897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:46.104989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183495+0000","last_change":"2024-04-24T22:59:54.834918+0000","last_active":"2024-04-24T23:00:01.183495+0000","last_peered":"2024-04-24T23:00:01.183495+0000","last_clean":"2024-04-24T23:00:01.183495+0000","last_became_active":"2024-04-24T22:59:54.834596+0000","last_became_peered":"2024-04-24T22:59:54.834596+0000","last_unstale":"2024-04-24T23:00:01.183495+0000","last_undegraded":"2024-04-24T23:00:01.183495+0000","last_fullsized":"2024-04-24T23:00:01.183495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:55.731536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009071+0000","last_change":"2024-04-24T22:59:53.801950+0000","last_active":"2024-04-24T23:00:01.009071+0000","last_peered":"2024-04-24T23:00:01.009071+0000","last_clean":"2024-04-24T23:00:01.009071+0000","last_became_active":"2024-04-24T22:59:53.801646+0000","last_became_peered":"2024-04-24T22:59:53.801646+0000","last_unstale":"2024-04-24T23:00:01.009071+0000","last_undegraded":"2024-04-24T23:00:01.009071+0000","last_fullsized":"2024-04-24T23:00:01.009071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185946+0000","last_change":"2024-04-24T22:59:59.175741+0000","last_active":"2024-04-24T23:00:01.185946+0000","last_peered":"2024-04-24T23:00:01.185946+0000","last_clean":"2024-04-24T23:00:01.185946+0000","last_became_active":"2024-04-24T22:59:59.175281+0000","last_became_peered":"2024-04-24T22:59:59.175281+0000","last_unstale":"2024-04-24T23:00:01.185946+0000","last_undegraded":"2024-04-24T23:00:01.185946+0000","last_fullsized":"2024-04-24T23:00:01.185946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:23:30.733798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336673+0000","last_change":"2024-04-24T22:59:54.846255+0000","last_active":"2024-04-24T23:00:00.336673+0000","last_peered":"2024-04-24T23:00:00.336673+0000","last_clean":"2024-04-24T23:00:00.336673+0000","last_became_active":"2024-04-24T22:59:54.845933+0000","last_became_peered":"2024-04-24T22:59:54.845933+0000","last_unstale":"2024-04-24T23:00:00.336673+0000","last_undegraded":"2024-04-24T23:00:00.336673+0000","last_fullsized":"2024-04-24T23:00:00.336673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245177+0000","last_change":"2024-04-24T22:59:53.807192+0000","last_active":"2024-04-24T23:00:00.245177+0000","last_peered":"2024-04-24T23:00:00.245177+0000","last_clean":"2024-04-24T23:00:00.245177+0000","last_became_active":"2024-04-24T22:59:53.806934+0000","last_became_peered":"2024-04-24T22:59:53.806934+0000","last_unstale":"2024-04-24T23:00:00.245177+0000","last_undegraded":"2024-04-24T23:00:00.245177+0000","last_fullsized":"2024-04-24T23:00:00.245177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185730+0000","last_change":"2024-04-24T22:59:59.183999+0000","last_active":"2024-04-24T23:00:01.185730+0000","last_peered":"2024-04-24T23:00:01.185730+0000","last_clean":"2024-04-24T23:00:01.185730+0000","last_became_active":"2024-04-24T22:59:59.183567+0000","last_became_peered":"2024-04-24T22:59:59.183567+0000","last_unstale":"2024-04-24T23:00:01.185730+0000","last_undegraded":"2024-04-24T23:00:01.185730+0000","last_fullsized":"2024-04-24T23:00:01.185730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:48.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183858+0000","last_change":"2024-04-24T22:59:54.832242+0000","last_active":"2024-04-24T23:00:01.183858+0000","last_peered":"2024-04-24T23:00:01.183858+0000","last_clean":"2024-04-24T23:00:01.183858+0000","last_became_active":"2024-04-24T22:59:54.830703+0000","last_became_peered":"2024-04-24T22:59:54.830703+0000","last_unstale":"2024-04-24T23:00:01.183858+0000","last_undegraded":"2024-04-24T23:00:01.183858+0000","last_fullsized":"2024-04-24T23:00:01.183858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184359+0000","last_change":"2024-04-24T22:59:53.798756+0000","last_active":"2024-04-24T23:00:01.184359+0000","last_peered":"2024-04-24T23:00:01.184359+0000","last_clean":"2024-04-24T23:00:01.184359+0000","last_became_active":"2024-04-24T22:59:53.798399+0000","last_became_peered":"2024-04-24T22:59:53.798399+0000","last_unstale":"2024-04-24T23:00:01.184359+0000","last_undegraded":"2024-04-24T23:00:01.184359+0000","last_fullsized":"2024-04-24T23:00:01.184359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:17.930808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158868+0000","last_change":"2024-04-24T22:59:59.180893+0000","last_active":"2024-04-24T23:00:00.158868+0000","last_peered":"2024-04-24T23:00:00.158868+0000","last_clean":"2024-04-24T23:00:00.158868+0000","last_became_active":"2024-04-24T22:59:59.180250+0000","last_became_peered":"2024-04-24T22:59:59.180250+0000","last_unstale":"2024-04-24T23:00:00.158868+0000","last_undegraded":"2024-04-24T23:00:00.158868+0000","last_fullsized":"2024-04-24T23:00:00.158868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158938+0000","last_change":"2024-04-24T22:59:54.824357+0000","last_active":"2024-04-24T23:00:00.158938+0000","last_peered":"2024-04-24T23:00:00.158938+0000","last_clean":"2024-04-24T23:00:00.158938+0000","last_became_active":"2024-04-24T22:59:54.823831+0000","last_became_peered":"2024-04-24T22:59:54.823831+0000","last_unstale":"2024-04-24T23:00:00.158938+0000","last_undegraded":"2024-04-24T23:00:00.158938+0000","last_fullsized":"2024-04-24T23:00:00.158938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162832+0000","last_change":"2024-04-24T22:59:53.798640+0000","last_active":"2024-04-24T23:00:00.162832+0000","last_peered":"2024-04-24T23:00:00.162832+0000","last_clean":"2024-04-24T23:00:00.162832+0000","last_became_active":"2024-04-24T22:59:53.798298+0000","last_became_peered":"2024-04-24T22:59:53.798298+0000","last_unstale":"2024-04-24T23:00:00.162832+0000","last_undegraded":"2024-04-24T23:00:00.162832+0000","last_fullsized":"2024-04-24T23:00:00.162832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184286+0000","last_change":"2024-04-24T22:59:59.178160+0000","last_active":"2024-04-24T23:00:01.184286+0000","last_peered":"2024-04-24T23:00:01.184286+0000","last_clean":"2024-04-24T23:00:01.184286+0000","last_became_active":"2024-04-24T22:59:59.177275+0000","last_became_peered":"2024-04-24T22:59:59.177275+0000","last_unstale":"2024-04-24T23:00:01.184286+0000","last_undegraded":"2024-04-24T23:00:01.184286+0000","last_fullsized":"2024-04-24T23:00:01.184286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:06.997646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246471+0000","last_change":"2024-04-24T22:59:54.828946+0000","last_active":"2024-04-24T23:00:00.246471+0000","last_peered":"2024-04-24T23:00:00.246471+0000","last_clean":"2024-04-24T23:00:00.246471+0000","last_became_active":"2024-04-24T22:59:54.828694+0000","last_became_peered":"2024-04-24T22:59:54.828694+0000","last_unstale":"2024-04-24T23:00:00.246471+0000","last_undegraded":"2024-04-24T23:00:00.246471+0000","last_fullsized":"2024-04-24T23:00:00.246471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:13.857989+0000","last_change":"2024-04-24T22:59:53.802324+0000","last_active":"2024-04-24T23:00:13.857989+0000","last_peered":"2024-04-24T23:00:13.857989+0000","last_clean":"2024-04-24T23:00:13.857989+0000","last_became_active":"2024-04-24T22:59:53.801956+0000","last_became_peered":"2024-04-24T22:59:53.801956+0000","last_unstale":"2024-04-24T23:00:13.857989+0000","last_undegraded":"2024-04-24T23:00:13.857989+0000","last_fullsized":"2024-04-24T23:00:13.857989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009080+0000","last_change":"2024-04-24T22:59:59.175987+0000","last_active":"2024-04-24T23:00:01.009080+0000","last_peered":"2024-04-24T23:00:01.009080+0000","last_clean":"2024-04-24T23:00:01.009080+0000","last_became_active":"2024-04-24T22:59:59.175539+0000","last_became_peered":"2024-04-24T22:59:59.175539+0000","last_unstale":"2024-04-24T23:00:01.009080+0000","last_undegraded":"2024-04-24T23:00:01.009080+0000","last_fullsized":"2024-04-24T23:00:01.009080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:46.474442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183741+0000","last_change":"2024-04-24T22:59:54.827006+0000","last_active":"2024-04-24T23:00:01.183741+0000","last_peered":"2024-04-24T23:00:01.183741+0000","last_clean":"2024-04-24T23:00:01.183741+0000","last_became_active":"2024-04-24T22:59:54.825162+0000","last_became_peered":"2024-04-24T22:59:54.825162+0000","last_unstale":"2024-04-24T23:00:01.183741+0000","last_undegraded":"2024-04-24T23:00:01.183741+0000","last_fullsized":"2024-04-24T23:00:01.183741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162078+0000","last_change":"2024-04-24T22:59:53.805610+0000","last_active":"2024-04-24T23:00:00.162078+0000","last_peered":"2024-04-24T23:00:00.162078+0000","last_clean":"2024-04-24T23:00:00.162078+0000","last_became_active":"2024-04-24T22:59:53.805286+0000","last_became_peered":"2024-04-24T22:59:53.805286+0000","last_unstale":"2024-04-24T23:00:00.162078+0000","last_undegraded":"2024-04-24T23:00:00.162078+0000","last_fullsized":"2024-04-24T23:00:00.162078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156548+0000","last_change":"2024-04-24T22:59:59.176914+0000","last_active":"2024-04-24T23:00:00.156548+0000","last_peered":"2024-04-24T23:00:00.156548+0000","last_clean":"2024-04-24T23:00:00.156548+0000","last_became_active":"2024-04-24T22:59:59.176522+0000","last_became_peered":"2024-04-24T22:59:59.176522+0000","last_unstale":"2024-04-24T23:00:00.156548+0000","last_undegraded":"2024-04-24T23:00:00.156548+0000","last_fullsized":"2024-04-24T23:00:00.156548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185735+0000","last_change":"2024-04-24T22:59:54.843770+0000","last_active":"2024-04-24T23:00:01.185735+0000","last_peered":"2024-04-24T23:00:01.185735+0000","last_clean":"2024-04-24T23:00:01.185735+0000","last_became_active":"2024-04-24T22:59:54.838700+0000","last_became_peered":"2024-04-24T22:59:54.838700+0000","last_unstale":"2024-04-24T23:00:01.185735+0000","last_undegraded":"2024-04-24T23:00:01.185735+0000","last_fullsized":"2024-04-24T23:00:01.185735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:16.370386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245598+0000","last_change":"2024-04-24T22:59:53.800926+0000","last_active":"2024-04-24T23:00:00.245598+0000","last_peered":"2024-04-24T23:00:00.245598+0000","last_clean":"2024-04-24T23:00:00.245598+0000","last_became_active":"2024-04-24T22:59:53.800666+0000","last_became_peered":"2024-04-24T22:59:53.800666+0000","last_unstale":"2024-04-24T23:00:00.245598+0000","last_undegraded":"2024-04-24T23:00:00.245598+0000","last_fullsized":"2024-04-24T23:00:00.245598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157317+0000","last_change":"2024-04-24T22:59:59.184549+0000","last_active":"2024-04-24T23:00:00.157317+0000","last_peered":"2024-04-24T23:00:00.157317+0000","last_clean":"2024-04-24T23:00:00.157317+0000","last_became_active":"2024-04-24T22:59:59.184095+0000","last_became_peered":"2024-04-24T22:59:59.184095+0000","last_unstale":"2024-04-24T23:00:00.157317+0000","last_undegraded":"2024-04-24T23:00:00.157317+0000","last_fullsized":"2024-04-24T23:00:00.157317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:45.603508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158054+0000","last_change":"2024-04-24T22:59:54.840299+0000","last_active":"2024-04-24T23:00:00.158054+0000","last_peered":"2024-04-24T23:00:00.158054+0000","last_clean":"2024-04-24T23:00:00.158054+0000","last_became_active":"2024-04-24T22:59:54.839835+0000","last_became_peered":"2024-04-24T22:59:54.839835+0000","last_unstale":"2024-04-24T23:00:00.158054+0000","last_undegraded":"2024-04-24T23:00:00.158054+0000","last_fullsized":"2024-04-24T23:00:00.158054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.338011+0000","last_change":"2024-04-24T22:59:53.802398+0000","last_active":"2024-04-24T23:00:00.338011+0000","last_peered":"2024-04-24T23:00:00.338011+0000","last_clean":"2024-04-24T23:00:00.338011+0000","last_became_active":"2024-04-24T22:59:53.802067+0000","last_became_peered":"2024-04-24T22:59:53.802067+0000","last_unstale":"2024-04-24T23:00:00.338011+0000","last_undegraded":"2024-04-24T23:00:00.338011+0000","last_fullsized":"2024-04-24T23:00:00.338011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009830+0000","last_change":"2024-04-24T22:59:59.167854+0000","last_active":"2024-04-24T23:00:01.009830+0000","last_peered":"2024-04-24T23:00:01.009830+0000","last_clean":"2024-04-24T23:00:01.009830+0000","last_became_active":"2024-04-24T22:59:59.167352+0000","last_became_peered":"2024-04-24T22:59:59.167352+0000","last_unstale":"2024-04-24T23:00:01.009830+0000","last_undegraded":"2024-04-24T23:00:01.009830+0000","last_fullsized":"2024-04-24T23:00:01.009830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:10.083772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009441+0000","last_change":"2024-04-24T22:59:59.177020+0000","last_active":"2024-04-24T23:00:01.009441+0000","last_peered":"2024-04-24T23:00:01.009441+0000","last_clean":"2024-04-24T23:00:01.009441+0000","last_became_active":"2024-04-24T22:59:59.176501+0000","last_became_peered":"2024-04-24T22:59:59.176501+0000","last_unstale":"2024-04-24T23:00:01.009441+0000","last_undegraded":"2024-04-24T23:00:01.009441+0000","last_fullsized":"2024-04-24T23:00:01.009441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:00.091139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009043+0000","last_change":"2024-04-24T22:59:54.808811+0000","last_active":"2024-04-24T23:00:01.009043+0000","last_peered":"2024-04-24T23:00:01.009043+0000","last_clean":"2024-04-24T23:00:01.009043+0000","last_became_active":"2024-04-24T22:59:54.807983+0000","last_became_peered":"2024-04-24T22:59:54.807983+0000","last_unstale":"2024-04-24T23:00:01.009043+0000","last_undegraded":"2024-04-24T23:00:01.009043+0000","last_fullsized":"2024-04-24T23:00:01.009043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:31.328568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183452+0000","last_change":"2024-04-24T22:59:53.795814+0000","last_active":"2024-04-24T23:00:01.183452+0000","last_peered":"2024-04-24T23:00:01.183452+0000","last_clean":"2024-04-24T23:00:01.183452+0000","last_became_active":"2024-04-24T22:59:53.795530+0000","last_became_peered":"2024-04-24T22:59:53.795530+0000","last_unstale":"2024-04-24T23:00:01.183452+0000","last_undegraded":"2024-04-24T23:00:01.183452+0000","last_fullsized":"2024-04-24T23:00:01.183452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185190+0000","last_change":"2024-04-24T22:59:59.178038+0000","last_active":"2024-04-24T23:00:01.185190+0000","last_peered":"2024-04-24T23:00:01.185190+0000","last_clean":"2024-04-24T23:00:01.185190+0000","last_became_active":"2024-04-24T22:59:59.177590+0000","last_became_peered":"2024-04-24T22:59:59.177590+0000","last_unstale":"2024-04-24T23:00:01.185190+0000","last_undegraded":"2024-04-24T23:00:01.185190+0000","last_fullsized":"2024-04-24T23:00:01.185190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:33.544037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184156+0000","last_change":"2024-04-24T22:59:54.835646+0000","last_active":"2024-04-24T23:00:01.184156+0000","last_peered":"2024-04-24T23:00:01.184156+0000","last_clean":"2024-04-24T23:00:01.184156+0000","last_became_active":"2024-04-24T22:59:54.835384+0000","last_became_peered":"2024-04-24T22:59:54.835384+0000","last_unstale":"2024-04-24T23:00:01.184156+0000","last_undegraded":"2024-04-24T23:00:01.184156+0000","last_fullsized":"2024-04-24T23:00:01.184156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:29.063136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159519+0000","last_change":"2024-04-24T22:59:53.798938+0000","last_active":"2024-04-24T23:00:00.159519+0000","last_peered":"2024-04-24T23:00:00.159519+0000","last_clean":"2024-04-24T23:00:00.159519+0000","last_became_active":"2024-04-24T22:59:53.798646+0000","last_became_peered":"2024-04-24T22:59:53.798646+0000","last_unstale":"2024-04-24T23:00:00.159519+0000","last_undegraded":"2024-04-24T23:00:00.159519+0000","last_fullsized":"2024-04-24T23:00:00.159519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184247+0000","last_change":"2024-04-24T22:59:53.797818+0000","last_active":"2024-04-24T23:00:01.184247+0000","last_peered":"2024-04-24T23:00:01.184247+0000","last_clean":"2024-04-24T23:00:01.184247+0000","last_became_active":"2024-04-24T22:59:53.796837+0000","last_became_peered":"2024-04-24T22:59:53.796837+0000","last_unstale":"2024-04-24T23:00:01.184247+0000","last_undegraded":"2024-04-24T23:00:01.184247+0000","last_fullsized":"2024-04-24T23:00:01.184247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:40.731687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009363+0000","last_change":"2024-04-24T22:59:54.827809+0000","last_active":"2024-04-24T23:00:01.009363+0000","last_peered":"2024-04-24T23:00:01.009363+0000","last_clean":"2024-04-24T23:00:01.009363+0000","last_became_active":"2024-04-24T22:59:54.827260+0000","last_became_peered":"2024-04-24T22:59:54.827260+0000","last_unstale":"2024-04-24T23:00:01.009363+0000","last_undegraded":"2024-04-24T23:00:01.009363+0000","last_fullsized":"2024-04-24T23:00:01.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:16.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009993+0000","last_change":"2024-04-24T22:59:59.178920+0000","last_active":"2024-04-24T23:00:01.009993+0000","last_peered":"2024-04-24T23:00:01.009993+0000","last_clean":"2024-04-24T23:00:01.009993+0000","last_became_active":"2024-04-24T22:59:59.178525+0000","last_became_peered":"2024-04-24T22:59:59.178525+0000","last_unstale":"2024-04-24T23:00:01.009993+0000","last_undegraded":"2024-04-24T23:00:01.009993+0000","last_fullsized":"2024-04-24T23:00:01.009993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184831+0000","last_change":"2024-04-24T22:59:53.803387+0000","last_active":"2024-04-24T23:00:01.184831+0000","last_peered":"2024-04-24T23:00:01.184831+0000","last_clean":"2024-04-24T23:00:01.184831+0000","last_became_active":"2024-04-24T22:59:53.802947+0000","last_became_peered":"2024-04-24T22:59:53.802947+0000","last_unstale":"2024-04-24T23:00:01.184831+0000","last_undegraded":"2024-04-24T23:00:01.184831+0000","last_fullsized":"2024-04-24T23:00:01.184831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:03.901704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337215+0000","last_change":"2024-04-24T22:59:54.846364+0000","last_active":"2024-04-24T23:00:00.337215+0000","last_peered":"2024-04-24T23:00:00.337215+0000","last_clean":"2024-04-24T23:00:00.337215+0000","last_became_active":"2024-04-24T22:59:54.846003+0000","last_became_peered":"2024-04-24T22:59:54.846003+0000","last_unstale":"2024-04-24T23:00:00.337215+0000","last_undegraded":"2024-04-24T23:00:00.337215+0000","last_fullsized":"2024-04-24T23:00:00.337215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.161971+0000","last_change":"2024-04-24T22:59:59.184791+0000","last_active":"2024-04-24T23:00:00.161971+0000","last_peered":"2024-04-24T23:00:00.161971+0000","last_clean":"2024-04-24T23:00:00.161971+0000","last_became_active":"2024-04-24T22:59:59.184116+0000","last_became_peered":"2024-04-24T22:59:59.184116+0000","last_unstale":"2024-04-24T23:00:00.161971+0000","last_undegraded":"2024-04-24T23:00:00.161971+0000","last_fullsized":"2024-04-24T23:00:00.161971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:35.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155812+0000","last_change":"2024-04-24T22:59:54.827064+0000","last_active":"2024-04-24T23:00:00.155812+0000","last_peered":"2024-04-24T23:00:00.155812+0000","last_clean":"2024-04-24T23:00:00.155812+0000","last_became_active":"2024-04-24T22:59:54.826759+0000","last_became_peered":"2024-04-24T22:59:54.826759+0000","last_unstale":"2024-04-24T23:00:00.155812+0000","last_undegraded":"2024-04-24T23:00:00.155812+0000","last_fullsized":"2024-04-24T23:00:00.155812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158202+0000","last_change":"2024-04-24T22:59:54.830406+0000","last_active":"2024-04-24T23:00:00.158202+0000","last_peered":"2024-04-24T23:00:00.158202+0000","last_clean":"2024-04-24T23:00:00.158202+0000","last_became_active":"2024-04-24T22:59:54.830092+0000","last_became_peered":"2024-04-24T22:59:54.830092+0000","last_unstale":"2024-04-24T23:00:00.158202+0000","last_undegraded":"2024-04-24T23:00:00.158202+0000","last_fullsized":"2024-04-24T23:00:00.158202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184023+0000","last_change":"2024-04-24T22:59:54.842436+0000","last_active":"2024-04-24T23:00:01.184023+0000","last_peered":"2024-04-24T23:00:01.184023+0000","last_clean":"2024-04-24T23:00:01.184023+0000","last_became_active":"2024-04-24T22:59:54.842135+0000","last_became_peered":"2024-04-24T22:59:54.842135+0000","last_unstale":"2024-04-24T23:00:01.184023+0000","last_undegraded":"2024-04-24T23:00:01.184023+0000","last_fullsized":"2024-04-24T23:00:01.184023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:04.584734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184555+0000","last_change":"2024-04-24T22:59:54.845478+0000","last_active":"2024-04-24T23:00:01.184555+0000","last_peered":"2024-04-24T23:00:01.184555+0000","last_clean":"2024-04-24T23:00:01.184555+0000","last_became_active":"2024-04-24T22:59:54.845154+0000","last_became_peered":"2024-04-24T22:59:54.845154+0000","last_unstale":"2024-04-24T23:00:01.184555+0000","last_undegraded":"2024-04-24T23:00:01.184555+0000","last_fullsized":"2024-04-24T23:00:01.184555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.211633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159644+0000","last_change":"2024-04-24T22:59:54.833101+0000","last_active":"2024-04-24T23:00:00.159644+0000","last_peered":"2024-04-24T23:00:00.159644+0000","last_clean":"2024-04-24T23:00:00.159644+0000","last_became_active":"2024-04-24T22:59:54.832808+0000","last_became_peered":"2024-04-24T22:59:54.832808+0000","last_unstale":"2024-04-24T23:00:00.159644+0000","last_undegraded":"2024-04-24T23:00:00.159644+0000","last_fullsized":"2024-04-24T23:00:00.159644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:18.944507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160607+0000","last_change":"2024-04-24T22:59:54.832279+0000","last_active":"2024-04-24T23:00:00.160607+0000","last_peered":"2024-04-24T23:00:00.160607+0000","last_clean":"2024-04-24T23:00:00.160607+0000","last_became_active":"2024-04-24T22:59:54.831479+0000","last_became_peered":"2024-04-24T22:59:54.831479+0000","last_unstale":"2024-04-24T23:00:00.160607+0000","last_undegraded":"2024-04-24T23:00:00.160607+0000","last_fullsized":"2024-04-24T23:00:00.160607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:41.243906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157820+0000","last_change":"2024-04-24T22:59:54.841252+0000","last_active":"2024-04-24T23:00:00.157820+0000","last_peered":"2024-04-24T23:00:00.157820+0000","last_clean":"2024-04-24T23:00:00.157820+0000","last_became_active":"2024-04-24T22:59:54.840960+0000","last_became_peered":"2024-04-24T22:59:54.840960+0000","last_unstale":"2024-04-24T23:00:00.157820+0000","last_undegraded":"2024-04-24T23:00:00.157820+0000","last_fullsized":"2024-04-24T23:00:00.157820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185364+0000","last_change":"2024-04-24T22:59:54.844485+0000","last_active":"2024-04-24T23:00:01.185364+0000","last_peered":"2024-04-24T23:00:01.185364+0000","last_clean":"2024-04-24T23:00:01.185364+0000","last_became_active":"2024-04-24T22:59:54.844149+0000","last_became_peered":"2024-04-24T22:59:54.844149+0000","last_unstale":"2024-04-24T23:00:01.185364+0000","last_undegraded":"2024-04-24T23:00:01.185364+0000","last_fullsized":"2024-04-24T23:00:01.185364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:05.971282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183253+0000","last_change":"2024-04-24T22:59:54.843547+0000","last_active":"2024-04-24T23:00:01.183253+0000","last_peered":"2024-04-24T23:00:01.183253+0000","last_clean":"2024-04-24T23:00:01.183253+0000","last_became_active":"2024-04-24T22:59:54.842984+0000","last_became_peered":"2024-04-24T22:59:54.842984+0000","last_unstale":"2024-04-24T23:00:01.183253+0000","last_undegraded":"2024-04-24T23:00:01.183253+0000","last_fullsized":"2024-04-24T23:00:01.183253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184055+0000","last_change":"2024-04-24T22:59:54.848279+0000","last_active":"2024-04-24T23:00:01.184055+0000","last_peered":"2024-04-24T23:00:01.184055+0000","last_clean":"2024-04-24T23:00:01.184055+0000","last_became_active":"2024-04-24T22:59:54.847833+0000","last_became_peered":"2024-04-24T22:59:54.847833+0000","last_unstale":"2024-04-24T23:00:01.184055+0000","last_undegraded":"2024-04-24T23:00:01.184055+0000","last_fullsized":"2024-04-24T23:00:01.184055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:10.672755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336955+0000","last_change":"2024-04-24T22:59:54.821637+0000","last_active":"2024-04-24T23:00:00.336955+0000","last_peered":"2024-04-24T23:00:00.336955+0000","last_clean":"2024-04-24T23:00:00.336955+0000","last_became_active":"2024-04-24T22:59:54.819868+0000","last_became_peered":"2024-04-24T22:59:54.819868+0000","last_unstale":"2024-04-24T23:00:00.336955+0000","last_undegraded":"2024-04-24T23:00:00.336955+0000","last_fullsized":"2024-04-24T23:00:00.336955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.860484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009044+0000","last_change":"2024-04-24T22:59:54.839683+0000","last_active":"2024-04-24T23:00:01.009044+0000","last_peered":"2024-04-24T23:00:01.009044+0000","last_clean":"2024-04-24T23:00:01.009044+0000","last_became_active":"2024-04-24T22:59:54.834098+0000","last_became_peered":"2024-04-24T22:59:54.834098+0000","last_unstale":"2024-04-24T23:00:01.009044+0000","last_undegraded":"2024-04-24T23:00:01.009044+0000","last_fullsized":"2024-04-24T23:00:01.009044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:58.717221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245911+0000","last_change":"2024-04-24T22:59:54.832261+0000","last_active":"2024-04-24T23:00:00.245911+0000","last_peered":"2024-04-24T23:00:00.245911+0000","last_clean":"2024-04-24T23:00:00.245911+0000","last_became_active":"2024-04-24T22:59:54.831321+0000","last_became_peered":"2024-04-24T22:59:54.831321+0000","last_unstale":"2024-04-24T23:00:00.245911+0000","last_undegraded":"2024-04-24T23:00:00.245911+0000","last_fullsized":"2024-04-24T23:00:00.245911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:12.911957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184771+0000","last_change":"2024-04-24T22:59:54.819368+0000","last_active":"2024-04-24T23:00:01.184771+0000","last_peered":"2024-04-24T23:00:01.184771+0000","last_clean":"2024-04-24T23:00:01.184771+0000","last_became_active":"2024-04-24T22:59:54.818749+0000","last_became_peered":"2024-04-24T22:59:54.818749+0000","last_unstale":"2024-04-24T23:00:01.184771+0000","last_undegraded":"2024-04-24T23:00:01.184771+0000","last_fullsized":"2024-04-24T23:00:01.184771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:14.960710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162580+0000","last_change":"2024-04-24T22:59:54.834877+0000","last_active":"2024-04-24T23:00:00.162580+0000","last_peered":"2024-04-24T23:00:00.162580+0000","last_clean":"2024-04-24T23:00:00.162580+0000","last_became_active":"2024-04-24T22:59:54.833131+0000","last_became_peered":"2024-04-24T22:59:54.833131+0000","last_unstale":"2024-04-24T23:00:00.162580+0000","last_undegraded":"2024-04-24T23:00:00.162580+0000","last_fullsized":"2024-04-24T23:00:00.162580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185603+0000","last_change":"2024-04-24T22:59:54.826869+0000","last_active":"2024-04-24T23:00:01.185603+0000","last_peered":"2024-04-24T23:00:01.185603+0000","last_clean":"2024-04-24T23:00:01.185603+0000","last_became_active":"2024-04-24T22:59:54.826268+0000","last_became_peered":"2024-04-24T22:59:54.826268+0000","last_unstale":"2024-04-24T23:00:01.185603+0000","last_undegraded":"2024-04-24T23:00:01.185603+0000","last_fullsized":"2024-04-24T23:00:01.185603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:22.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183254+0000","last_change":"2024-04-24T22:59:54.829640+0000","last_active":"2024-04-24T23:00:01.183254+0000","last_peered":"2024-04-24T23:00:01.183254+0000","last_clean":"2024-04-24T23:00:01.183254+0000","last_became_active":"2024-04-24T22:59:54.829295+0000","last_became_peered":"2024-04-24T22:59:54.829295+0000","last_unstale":"2024-04-24T23:00:01.183254+0000","last_undegraded":"2024-04-24T23:00:01.183254+0000","last_fullsized":"2024-04-24T23:00:01.183254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183689+0000","last_change":"2024-04-24T22:59:54.845490+0000","last_active":"2024-04-24T23:00:01.183689+0000","last_peered":"2024-04-24T23:00:01.183689+0000","last_clean":"2024-04-24T23:00:01.183689+0000","last_became_active":"2024-04-24T22:59:54.842390+0000","last_became_peered":"2024-04-24T22:59:54.842390+0000","last_unstale":"2024-04-24T23:00:01.183689+0000","last_undegraded":"2024-04-24T23:00:01.183689+0000","last_fullsized":"2024-04-24T23:00:01.183689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:25.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158717+0000","last_change":"2024-04-24T22:59:54.837049+0000","last_active":"2024-04-24T23:00:00.158717+0000","last_peered":"2024-04-24T23:00:00.158717+0000","last_clean":"2024-04-24T23:00:00.158717+0000","last_became_active":"2024-04-24T22:59:54.836650+0000","last_became_peered":"2024-04-24T22:59:54.836650+0000","last_unstale":"2024-04-24T23:00:00.158717+0000","last_undegraded":"2024-04-24T23:00:00.158717+0000","last_fullsized":"2024-04-24T23:00:00.158717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160882+0000","last_change":"2024-04-24T22:59:54.823987+0000","last_active":"2024-04-24T23:00:00.160882+0000","last_peered":"2024-04-24T23:00:00.160882+0000","last_clean":"2024-04-24T23:00:00.160882+0000","last_became_active":"2024-04-24T22:59:54.823738+0000","last_became_peered":"2024-04-24T22:59:54.823738+0000","last_unstale":"2024-04-24T23:00:00.160882+0000","last_undegraded":"2024-04-24T23:00:00.160882+0000","last_fullsized":"2024-04-24T23:00:00.160882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245783+0000","last_change":"2024-04-24T22:59:54.828844+0000","last_active":"2024-04-24T23:00:00.245783+0000","last_peered":"2024-04-24T23:00:00.245783+0000","last_clean":"2024-04-24T23:00:00.245783+0000","last_became_active":"2024-04-24T22:59:54.827890+0000","last_became_peered":"2024-04-24T22:59:54.827890+0000","last_unstale":"2024-04-24T23:00:00.245783+0000","last_undegraded":"2024-04-24T23:00:00.245783+0000","last_fullsized":"2024-04-24T23:00:00.245783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:11.910761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246404+0000","last_change":"2024-04-24T22:59:54.841028+0000","last_active":"2024-04-24T23:00:00.246404+0000","last_peered":"2024-04-24T23:00:00.246404+0000","last_clean":"2024-04-24T23:00:00.246404+0000","last_became_active":"2024-04-24T22:59:54.839890+0000","last_became_peered":"2024-04-24T22:59:54.839890+0000","last_unstale":"2024-04-24T23:00:00.246404+0000","last_undegraded":"2024-04-24T23:00:00.246404+0000","last_fullsized":"2024-04-24T23:00:00.246404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:55.257739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245594+0000","last_change":"2024-04-24T22:59:54.834999+0000","last_active":"2024-04-24T23:00:00.245594+0000","last_peered":"2024-04-24T23:00:00.245594+0000","last_clean":"2024-04-24T23:00:00.245594+0000","last_became_active":"2024-04-24T22:59:54.834737+0000","last_became_peered":"2024-04-24T22:59:54.834737+0000","last_unstale":"2024-04-24T23:00:00.245594+0000","last_undegraded":"2024-04-24T23:00:00.245594+0000","last_fullsized":"2024-04-24T23:00:00.245594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337929+0000","last_change":"2024-04-24T22:59:54.825114+0000","last_active":"2024-04-24T23:00:00.337929+0000","last_peered":"2024-04-24T23:00:00.337929+0000","last_clean":"2024-04-24T23:00:00.337929+0000","last_became_active":"2024-04-24T22:59:54.824804+0000","last_became_peered":"2024-04-24T22:59:54.824804+0000","last_unstale":"2024-04-24T23:00:00.337929+0000","last_undegraded":"2024-04-24T23:00:00.337929+0000","last_fullsized":"2024-04-24T23:00:00.337929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183824+0000","last_change":"2024-04-24T22:59:54.841039+0000","last_active":"2024-04-24T23:00:01.183824+0000","last_peered":"2024-04-24T23:00:01.183824+0000","last_clean":"2024-04-24T23:00:01.183824+0000","last_became_active":"2024-04-24T22:59:54.840480+0000","last_became_peered":"2024-04-24T22:59:54.840480+0000","last_unstale":"2024-04-24T23:00:01.183824+0000","last_undegraded":"2024-04-24T23:00:01.183824+0000","last_fullsized":"2024-04-24T23:00:01.183824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:56.253783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245118+0000","last_change":"2024-04-24T22:59:54.829835+0000","last_active":"2024-04-24T23:00:00.245118+0000","last_peered":"2024-04-24T23:00:00.245118+0000","last_clean":"2024-04-24T23:00:00.245118+0000","last_became_active":"2024-04-24T22:59:54.829572+0000","last_became_peered":"2024-04-24T22:59:54.829572+0000","last_unstale":"2024-04-24T23:00:00.245118+0000","last_undegraded":"2024-04-24T23:00:00.245118+0000","last_fullsized":"2024-04-24T23:00:00.245118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156074+0000","last_change":"2024-04-24T22:59:54.831968+0000","last_active":"2024-04-24T23:00:00.156074+0000","last_peered":"2024-04-24T23:00:00.156074+0000","last_clean":"2024-04-24T23:00:00.156074+0000","last_became_active":"2024-04-24T22:59:54.831606+0000","last_became_peered":"2024-04-24T22:59:54.831606+0000","last_unstale":"2024-04-24T23:00:00.156074+0000","last_undegraded":"2024-04-24T23:00:00.156074+0000","last_fullsized":"2024-04-24T23:00:00.156074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245463+0000","last_change":"2024-04-24T22:59:54.848714+0000","last_active":"2024-04-24T23:00:00.245463+0000","last_peered":"2024-04-24T23:00:00.245463+0000","last_clean":"2024-04-24T23:00:00.245463+0000","last_became_active":"2024-04-24T22:59:54.848325+0000","last_became_peered":"2024-04-24T22:59:54.848325+0000","last_unstale":"2024-04-24T23:00:00.245463+0000","last_undegraded":"2024-04-24T23:00:00.245463+0000","last_fullsized":"2024-04-24T23:00:00.245463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156975+0000","last_change":"2024-04-24T22:59:54.836067+0000","last_active":"2024-04-24T23:00:00.156975+0000","last_peered":"2024-04-24T23:00:00.156975+0000","last_clean":"2024-04-24T23:00:00.156975+0000","last_became_active":"2024-04-24T22:59:54.830678+0000","last_became_peered":"2024-04-24T22:59:54.830678+0000","last_unstale":"2024-04-24T23:00:00.156975+0000","last_undegraded":"2024-04-24T23:00:00.156975+0000","last_fullsized":"2024-04-24T23:00:00.156975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185093+0000","last_change":"2024-04-24T22:59:54.846617+0000","last_active":"2024-04-24T23:00:01.185093+0000","last_peered":"2024-04-24T23:00:01.185093+0000","last_clean":"2024-04-24T23:00:01.185093+0000","last_became_active":"2024-04-24T22:59:54.844346+0000","last_became_peered":"2024-04-24T22:59:54.844346+0000","last_unstale":"2024-04-24T23:00:01.185093+0000","last_undegraded":"2024-04-24T23:00:01.185093+0000","last_fullsized":"2024-04-24T23:00:01.185093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:47.647894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185538+0000","last_change":"2024-04-24T22:59:54.840915+0000","last_active":"2024-04-24T23:00:01.185538+0000","last_peered":"2024-04-24T23:00:01.185538+0000","last_clean":"2024-04-24T23:00:01.185538+0000","last_became_active":"2024-04-24T22:59:54.840307+0000","last_became_peered":"2024-04-24T22:59:54.840307+0000","last_unstale":"2024-04-24T23:00:01.185538+0000","last_undegraded":"2024-04-24T23:00:01.185538+0000","last_fullsized":"2024-04-24T23:00:01.185538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:25.146607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245791+0000","last_change":"2024-04-24T22:59:54.839361+0000","last_active":"2024-04-24T23:00:00.245791+0000","last_peered":"2024-04-24T23:00:00.245791+0000","last_clean":"2024-04-24T23:00:00.245791+0000","last_became_active":"2024-04-24T22:59:54.838975+0000","last_became_peered":"2024-04-24T22:59:54.838975+0000","last_unstale":"2024-04-24T23:00:00.245791+0000","last_undegraded":"2024-04-24T23:00:00.245791+0000","last_fullsized":"2024-04-24T23:00:00.245791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:30.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.408+0000 7f280c800640 1 Processor -- start 2024-04-24T23:00:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.409+0000 7f280c800640 1 -- start start 2024-04-24T23:00:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28040b2a20 0x7f28040cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280c800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f280406cbc0 0x7f28040d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280c800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28040cdf70 con 0x7f2804145640 2024-04-24T23:00:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280c800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2804145a20 con 0x7f280406cbc0 2024-04-24T23:00:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f280406d140 con 0x7f28040b2a20 2024-04-24T23:00:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.410+0000 7f280a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f280406cbc0 0x7f28040d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f280406cbc0 0x7f28040d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45166/0 (socket says 172.21.15.146:45166) 2024-04-24T23:00:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 -- 172.21.15.146:0/3434944759 learned_addr learned my addr 172.21.15.146:0/3434944759 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f2809400640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28040b2a20 0x7f28040cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 -- 172.21.15.146:0/3434944759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28040b2a20 msgr2=0x7f28040cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28040b2a20 0x7f28040cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 -- 172.21.15.146:0/3434944759 >> v1:172.21.15.203:6789/0 conn(0x7f2804145640 legacy=0x7f280415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.411+0000 7f280a800640 1 -- 172.21.15.146:0/3434944759 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280406d420 con 0x7f280406cbc0 2024-04-24T23:00:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.412+0000 7f280a800640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280406cbc0 0x7f28040d01d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2800009e50 tx=0x7f280002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f5c862f2995f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.412+0000 7f2808a00640 1 -- 172.21.15.146:0/3434944759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800036070 con 0x7f280406cbc0 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.412+0000 7f2808a00640 1 -- 172.21.15.146:0/3434944759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2800031600 con 0x7f280406cbc0 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.412+0000 7f2808a00640 1 -- 172.21.15.146:0/3434944759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000319d0 con 0x7f280406cbc0 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 -- 172.21.15.146:0/3434944759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280406cbc0 msgr2=0x7f28040d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280406cbc0 0x7f28040d01d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2800009e50 tx=0x7f280002a6c0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 -- 172.21.15.146:0/3434944759 shutdown_connections 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280406cbc0 0x7f28040d01d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 --2- 172.21.15.146:0/3434944759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28040b2a20 0x7f28040cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 -- 172.21.15.146:0/3434944759 >> 172.21.15.146:0/3434944759 conn(0x7f280406b320 msgr2=0x7f280406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 -- 172.21.15.146:0/3434944759 shutdown_connections 2024-04-24T23:00:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.413+0000 7f280c800640 1 -- 172.21.15.146:0/3434944759 wait complete. 2024-04-24T23:00:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.414+0000 7f280c800640 1 Processor -- start 2024-04-24T23:00:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 -- start start 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f280406cbc0 0x7f2804144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2804145640 0x7f28040aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28040ce450 con 0x7f28040b2a20 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f280406d9e0 con 0x7f2804145640 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.415+0000 7f280c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28040ce5d0 con 0x7f280406cbc0 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45182/0 (socket says 172.21.15.146:45182) 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 -- 172.21.15.146:0/26319412 learned_addr learned my addr 172.21.15.146:0/26319412 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f280a800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2804145640 0x7f28040aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809e00640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f280406cbc0 0x7f2804144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 -- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f280406cbc0 msgr2=0x7f2804144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f280406cbc0 0x7f2804144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 -- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2804145640 msgr2=0x7f28040aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2804145640 0x7f28040aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 -- 172.21.15.146:0/26319412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2804144670 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.416+0000 7f2809400640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d800 tx=0x7f27f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.417+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f000b6c0 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.417+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f0019070 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.417+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28041449b0 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.417+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f000ba80 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.417+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280415a700 con 0x7f28040b2a20 2024-04-24T23:00:30.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.418+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2804140cc0 con 0x7f28040b2a20 2024-04-24T23:00:30.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.419+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27f000bc20 con 0x7f28040b2a20 2024-04-24T23:00:30.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.420+0000 7f27fe000640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 0x7f27e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.420+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f27f008b670 con 0x7f28040b2a20 2024-04-24T23:00:30.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.420+0000 7f2809e00640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 0x7f27e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.421+0000 7f2809e00640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 0x7f27e406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006fd0 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.424+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f28041449b0 con 0x7f28040b2a20 2024-04-24T23:00:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.602+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2804068190 con 0x7f27e406be30 2024-04-24T23:00:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.627+0000 7f27fe000640 1 -- 172.21.15.146:0/26319412 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f2804068190 con 0x7f27e406be30 2024-04-24T23:00:30.634 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:30.636 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 msgr2=0x7f27e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 0x7f27e406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006fd0 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 msgr2=0x7f2804140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d800 tx=0x7f27f000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 shutdown_connections 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2804145640 0x7f28040aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.632+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28040b2a20 0x7f2804140720 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.633+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f27e406be30 0x7f27e406e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.633+0000 7f280c800640 1 --2- 172.21.15.146:0/26319412 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f280406cbc0 0x7f2804144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.633+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 >> 172.21.15.146:0/26319412 conn(0x7f280406b320 msgr2=0x7f280415ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.633+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 shutdown_connections 2024-04-24T23:00:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.633+0000 7f280c800640 1 -- 172.21.15.146:0/26319412 wait complete. 2024-04-24T23:00:30.653 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-24T23:00:29.591358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219608,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755112,"statfs":{"total":773094113280,"available":772869234688,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005612"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010800+0000","last_change":"2024-04-24T22:59:53.808035+0000","last_active":"2024-04-24T23:00:01.010800+0000","last_peered":"2024-04-24T23:00:01.010800+0000","last_clean":"2024-04-24T23:00:01.010800+0000","last_became_active":"2024-04-24T22:59:53.807655+0000","last_became_peered":"2024-04-24T22:59:53.807655+0000","last_unstale":"2024-04-24T23:00:01.010800+0000","last_undegraded":"2024-04-24T23:00:01.010800+0000","last_fullsized":"2024-04-24T23:00:01.010800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185694+0000","last_change":"2024-04-24T22:59:54.844377+0000","last_active":"2024-04-24T23:00:01.185694+0000","last_peered":"2024-04-24T23:00:01.185694+0000","last_clean":"2024-04-24T23:00:01.185694+0000","last_became_active":"2024-04-24T22:59:54.844081+0000","last_became_peered":"2024-04-24T22:59:54.844081+0000","last_unstale":"2024-04-24T23:00:01.185694+0000","last_undegraded":"2024-04-24T23:00:01.185694+0000","last_fullsized":"2024-04-24T23:00:01.185694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:03:46.525647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158053+0000","last_change":"2024-04-24T22:59:59.190167+0000","last_active":"2024-04-24T23:00:00.158053+0000","last_peered":"2024-04-24T23:00:00.158053+0000","last_clean":"2024-04-24T23:00:00.158053+0000","last_became_active":"2024-04-24T22:59:59.189393+0000","last_became_peered":"2024-04-24T22:59:59.189393+0000","last_unstale":"2024-04-24T23:00:00.158053+0000","last_undegraded":"2024-04-24T23:00:00.158053+0000","last_fullsized":"2024-04-24T23:00:00.158053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.516700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185829+0000","last_change":"2024-04-24T22:59:53.799029+0000","last_active":"2024-04-24T23:00:01.185829+0000","last_peered":"2024-04-24T23:00:01.185829+0000","last_clean":"2024-04-24T23:00:01.185829+0000","last_became_active":"2024-04-24T22:59:53.798727+0000","last_became_peered":"2024-04-24T22:59:53.798727+0000","last_unstale":"2024-04-24T23:00:01.185829+0000","last_undegraded":"2024-04-24T23:00:01.185829+0000","last_fullsized":"2024-04-24T23:00:01.185829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:14:29.506259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185571+0000","last_change":"2024-04-24T22:59:54.844472+0000","last_active":"2024-04-24T23:00:01.185571+0000","last_peered":"2024-04-24T23:00:01.185571+0000","last_clean":"2024-04-24T23:00:01.185571+0000","last_became_active":"2024-04-24T22:59:54.844134+0000","last_became_peered":"2024-04-24T22:59:54.844134+0000","last_unstale":"2024-04-24T23:00:01.185571+0000","last_undegraded":"2024-04-24T23:00:01.185571+0000","last_fullsized":"2024-04-24T23:00:01.185571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:19.889185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155534+0000","last_change":"2024-04-24T22:59:59.170482+0000","last_active":"2024-04-24T23:00:00.155534+0000","last_peered":"2024-04-24T23:00:00.155534+0000","last_clean":"2024-04-24T23:00:00.155534+0000","last_became_active":"2024-04-24T22:59:59.169481+0000","last_became_peered":"2024-04-24T22:59:59.169481+0000","last_unstale":"2024-04-24T23:00:00.155534+0000","last_undegraded":"2024-04-24T23:00:00.155534+0000","last_fullsized":"2024-04-24T23:00:00.155534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:26.004993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246604+0000","last_change":"2024-04-24T22:59:53.796317+0000","last_active":"2024-04-24T23:00:00.246604+0000","last_peered":"2024-04-24T23:00:00.246604+0000","last_clean":"2024-04-24T23:00:00.246604+0000","last_became_active":"2024-04-24T22:59:53.795867+0000","last_became_peered":"2024-04-24T22:59:53.795867+0000","last_unstale":"2024-04-24T23:00:00.246604+0000","last_undegraded":"2024-04-24T23:00:00.246604+0000","last_fullsized":"2024-04-24T23:00:00.246604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337219+0000","last_change":"2024-04-24T22:59:54.819137+0000","last_active":"2024-04-24T23:00:00.337219+0000","last_peered":"2024-04-24T23:00:00.337219+0000","last_clean":"2024-04-24T23:00:00.337219+0000","last_became_active":"2024-04-24T22:59:54.818824+0000","last_became_peered":"2024-04-24T22:59:54.818824+0000","last_unstale":"2024-04-24T23:00:00.337219+0000","last_undegraded":"2024-04-24T23:00:00.337219+0000","last_fullsized":"2024-04-24T23:00:00.337219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156424+0000","last_change":"2024-04-24T22:59:59.175621+0000","last_active":"2024-04-24T23:00:00.156424+0000","last_peered":"2024-04-24T23:00:00.156424+0000","last_clean":"2024-04-24T23:00:00.156424+0000","last_became_active":"2024-04-24T22:59:59.175193+0000","last_became_peered":"2024-04-24T22:59:59.175193+0000","last_unstale":"2024-04-24T23:00:00.156424+0000","last_undegraded":"2024-04-24T23:00:00.156424+0000","last_fullsized":"2024-04-24T23:00:00.156424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246019+0000","last_change":"2024-04-24T22:59:53.789351+0000","last_active":"2024-04-24T23:00:00.246019+0000","last_peered":"2024-04-24T23:00:00.246019+0000","last_clean":"2024-04-24T23:00:00.246019+0000","last_became_active":"2024-04-24T22:59:53.789011+0000","last_became_peered":"2024-04-24T22:59:53.789011+0000","last_unstale":"2024-04-24T23:00:00.246019+0000","last_undegraded":"2024-04-24T23:00:00.246019+0000","last_fullsized":"2024-04-24T23:00:00.246019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184542+0000","last_change":"2024-04-24T22:59:54.831152+0000","last_active":"2024-04-24T23:00:01.184542+0000","last_peered":"2024-04-24T23:00:01.184542+0000","last_clean":"2024-04-24T23:00:01.184542+0000","last_became_active":"2024-04-24T22:59:54.829948+0000","last_became_peered":"2024-04-24T22:59:54.829948+0000","last_unstale":"2024-04-24T23:00:01.184542+0000","last_undegraded":"2024-04-24T23:00:01.184542+0000","last_fullsized":"2024-04-24T23:00:01.184542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:00.243216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155762+0000","last_change":"2024-04-24T22:59:59.183804+0000","last_active":"2024-04-24T23:00:00.155762+0000","last_peered":"2024-04-24T23:00:00.155762+0000","last_clean":"2024-04-24T23:00:00.155762+0000","last_became_active":"2024-04-24T22:59:59.183323+0000","last_became_peered":"2024-04-24T22:59:59.183323+0000","last_unstale":"2024-04-24T23:00:00.155762+0000","last_undegraded":"2024-04-24T23:00:00.155762+0000","last_fullsized":"2024-04-24T23:00:00.155762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184098+0000","last_change":"2024-04-24T22:59:54.822754+0000","last_active":"2024-04-24T23:00:01.184098+0000","last_peered":"2024-04-24T23:00:01.184098+0000","last_clean":"2024-04-24T23:00:01.184098+0000","last_became_active":"2024-04-24T22:59:54.822388+0000","last_became_peered":"2024-04-24T22:59:54.822388+0000","last_unstale":"2024-04-24T23:00:01.184098+0000","last_undegraded":"2024-04-24T23:00:01.184098+0000","last_fullsized":"2024-04-24T23:00:01.184098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:30.347602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183966+0000","last_change":"2024-04-24T22:59:53.802267+0000","last_active":"2024-04-24T23:00:01.183966+0000","last_peered":"2024-04-24T23:00:01.183966+0000","last_clean":"2024-04-24T23:00:01.183966+0000","last_became_active":"2024-04-24T22:59:53.801524+0000","last_became_peered":"2024-04-24T22:59:53.801524+0000","last_unstale":"2024-04-24T23:00:01.183966+0000","last_undegraded":"2024-04-24T23:00:01.183966+0000","last_fullsized":"2024-04-24T23:00:01.183966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:11.327838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183950+0000","last_change":"2024-04-24T22:59:59.177746+0000","last_active":"2024-04-24T23:00:01.183950+0000","last_peered":"2024-04-24T23:00:01.183950+0000","last_clean":"2024-04-24T23:00:01.183950+0000","last_became_active":"2024-04-24T22:59:59.176645+0000","last_became_peered":"2024-04-24T22:59:59.176645+0000","last_unstale":"2024-04-24T23:00:01.183950+0000","last_undegraded":"2024-04-24T23:00:01.183950+0000","last_fullsized":"2024-04-24T23:00:01.183950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:59:28.582936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162596+0000","last_change":"2024-04-24T22:59:54.833871+0000","last_active":"2024-04-24T23:00:00.162596+0000","last_peered":"2024-04-24T23:00:00.162596+0000","last_clean":"2024-04-24T23:00:00.162596+0000","last_became_active":"2024-04-24T22:59:54.833620+0000","last_became_peered":"2024-04-24T22:59:54.833620+0000","last_unstale":"2024-04-24T23:00:00.162596+0000","last_undegraded":"2024-04-24T23:00:00.162596+0000","last_fullsized":"2024-04-24T23:00:00.162596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159199+0000","last_change":"2024-04-24T22:59:53.801795+0000","last_active":"2024-04-24T23:00:00.159199+0000","last_peered":"2024-04-24T23:00:00.159199+0000","last_clean":"2024-04-24T23:00:00.159199+0000","last_became_active":"2024-04-24T22:59:53.801129+0000","last_became_peered":"2024-04-24T22:59:53.801129+0000","last_unstale":"2024-04-24T23:00:00.159199+0000","last_undegraded":"2024-04-24T23:00:00.159199+0000","last_fullsized":"2024-04-24T23:00:00.159199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245637+0000","last_change":"2024-04-24T22:59:59.180795+0000","last_active":"2024-04-24T23:00:00.245637+0000","last_peered":"2024-04-24T23:00:00.245637+0000","last_clean":"2024-04-24T23:00:00.245637+0000","last_became_active":"2024-04-24T22:59:59.179570+0000","last_became_peered":"2024-04-24T22:59:59.179570+0000","last_unstale":"2024-04-24T23:00:00.245637+0000","last_undegraded":"2024-04-24T23:00:00.245637+0000","last_fullsized":"2024-04-24T23:00:00.245637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.008767+0000","last_change":"2024-04-24T22:59:54.830621+0000","last_active":"2024-04-24T23:00:01.008767+0000","last_peered":"2024-04-24T23:00:01.008767+0000","last_clean":"2024-04-24T23:00:01.008767+0000","last_became_active":"2024-04-24T22:59:54.830261+0000","last_became_peered":"2024-04-24T22:59:54.830261+0000","last_unstale":"2024-04-24T23:00:01.008767+0000","last_undegraded":"2024-04-24T23:00:01.008767+0000","last_fullsized":"2024-04-24T23:00:01.008767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009662+0000","last_change":"2024-04-24T22:59:53.797083+0000","last_active":"2024-04-24T23:00:01.009662+0000","last_peered":"2024-04-24T23:00:01.009662+0000","last_clean":"2024-04-24T23:00:01.009662+0000","last_became_active":"2024-04-24T22:59:53.796741+0000","last_became_peered":"2024-04-24T22:59:53.796741+0000","last_unstale":"2024-04-24T23:00:01.009662+0000","last_undegraded":"2024-04-24T23:00:01.009662+0000","last_fullsized":"2024-04-24T23:00:01.009662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162937+0000","last_change":"2024-04-24T22:59:59.187326+0000","last_active":"2024-04-24T23:00:00.162937+0000","last_peered":"2024-04-24T23:00:00.162937+0000","last_clean":"2024-04-24T23:00:00.162937+0000","last_became_active":"2024-04-24T22:59:59.186542+0000","last_became_peered":"2024-04-24T22:59:59.186542+0000","last_unstale":"2024-04-24T23:00:00.162937+0000","last_undegraded":"2024-04-24T23:00:00.162937+0000","last_fullsized":"2024-04-24T23:00:00.162937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:20.837462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183491+0000","last_change":"2024-04-24T22:59:54.819833+0000","last_active":"2024-04-24T23:00:01.183491+0000","last_peered":"2024-04-24T23:00:01.183491+0000","last_clean":"2024-04-24T23:00:01.183491+0000","last_became_active":"2024-04-24T22:59:54.817443+0000","last_became_peered":"2024-04-24T22:59:54.817443+0000","last_unstale":"2024-04-24T23:00:01.183491+0000","last_undegraded":"2024-04-24T23:00:01.183491+0000","last_fullsized":"2024-04-24T23:00:01.183491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:05.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.244949+0000","last_change":"2024-04-24T22:59:53.796852+0000","last_active":"2024-04-24T23:00:00.244949+0000","last_peered":"2024-04-24T23:00:00.244949+0000","last_clean":"2024-04-24T23:00:00.244949+0000","last_became_active":"2024-04-24T22:59:53.796053+0000","last_became_peered":"2024-04-24T22:59:53.796053+0000","last_unstale":"2024-04-24T23:00:00.244949+0000","last_undegraded":"2024-04-24T23:00:00.244949+0000","last_fullsized":"2024-04-24T23:00:00.244949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.870817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157682+0000","last_change":"2024-04-24T22:59:59.168702+0000","last_active":"2024-04-24T23:00:00.157682+0000","last_peered":"2024-04-24T23:00:00.157682+0000","last_clean":"2024-04-24T23:00:00.157682+0000","last_became_active":"2024-04-24T22:59:59.168344+0000","last_became_peered":"2024-04-24T22:59:59.168344+0000","last_unstale":"2024-04-24T23:00:00.157682+0000","last_undegraded":"2024-04-24T23:00:00.157682+0000","last_fullsized":"2024-04-24T23:00:00.157682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009609+0000","last_change":"2024-04-24T22:59:54.831524+0000","last_active":"2024-04-24T23:00:01.009609+0000","last_peered":"2024-04-24T23:00:01.009609+0000","last_clean":"2024-04-24T23:00:01.009609+0000","last_became_active":"2024-04-24T22:59:54.831142+0000","last_became_peered":"2024-04-24T22:59:54.831142+0000","last_unstale":"2024-04-24T23:00:01.009609+0000","last_undegraded":"2024-04-24T23:00:01.009609+0000","last_fullsized":"2024-04-24T23:00:01.009609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185674+0000","last_change":"2024-04-24T22:59:53.797494+0000","last_active":"2024-04-24T23:00:01.185674+0000","last_peered":"2024-04-24T23:00:01.185674+0000","last_clean":"2024-04-24T23:00:01.185674+0000","last_became_active":"2024-04-24T22:59:53.796774+0000","last_became_peered":"2024-04-24T22:59:53.796774+0000","last_unstale":"2024-04-24T23:00:01.185674+0000","last_undegraded":"2024-04-24T23:00:01.185674+0000","last_fullsized":"2024-04-24T23:00:01.185674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155573+0000","last_change":"2024-04-24T22:59:59.172300+0000","last_active":"2024-04-24T23:00:00.155573+0000","last_peered":"2024-04-24T23:00:00.155573+0000","last_clean":"2024-04-24T23:00:00.155573+0000","last_became_active":"2024-04-24T22:59:59.171942+0000","last_became_peered":"2024-04-24T22:59:59.171942+0000","last_unstale":"2024-04-24T23:00:00.155573+0000","last_undegraded":"2024-04-24T23:00:00.155573+0000","last_fullsized":"2024-04-24T23:00:00.155573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:16.270363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010273+0000","last_change":"2024-04-24T22:59:54.831365+0000","last_active":"2024-04-24T23:00:01.010273+0000","last_peered":"2024-04-24T23:00:01.010273+0000","last_clean":"2024-04-24T23:00:01.010273+0000","last_became_active":"2024-04-24T22:59:54.830470+0000","last_became_peered":"2024-04-24T22:59:54.830470+0000","last_unstale":"2024-04-24T23:00:01.010273+0000","last_undegraded":"2024-04-24T23:00:01.010273+0000","last_fullsized":"2024-04-24T23:00:01.010273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010410+0000","last_change":"2024-04-24T22:59:53.803366+0000","last_active":"2024-04-24T23:00:01.010410+0000","last_peered":"2024-04-24T23:00:01.010410+0000","last_clean":"2024-04-24T23:00:01.010410+0000","last_became_active":"2024-04-24T22:59:53.802969+0000","last_became_peered":"2024-04-24T22:59:53.802969+0000","last_unstale":"2024-04-24T23:00:01.010410+0000","last_undegraded":"2024-04-24T23:00:01.010410+0000","last_fullsized":"2024-04-24T23:00:01.010410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:22.846785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009016+0000","last_change":"2024-04-24T22:59:59.177853+0000","last_active":"2024-04-24T23:00:01.009016+0000","last_peered":"2024-04-24T23:00:01.009016+0000","last_clean":"2024-04-24T23:00:01.009016+0000","last_became_active":"2024-04-24T22:59:59.177268+0000","last_became_peered":"2024-04-24T22:59:59.177268+0000","last_unstale":"2024-04-24T23:00:01.009016+0000","last_undegraded":"2024-04-24T23:00:01.009016+0000","last_fullsized":"2024-04-24T23:00:01.009016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:44.225608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159891+0000","last_change":"2024-04-24T22:59:54.842312+0000","last_active":"2024-04-24T23:00:00.159891+0000","last_peered":"2024-04-24T23:00:00.159891+0000","last_clean":"2024-04-24T23:00:00.159891+0000","last_became_active":"2024-04-24T22:59:54.842034+0000","last_became_peered":"2024-04-24T22:59:54.842034+0000","last_unstale":"2024-04-24T23:00:00.159891+0000","last_undegraded":"2024-04-24T23:00:00.159891+0000","last_fullsized":"2024-04-24T23:00:00.159891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:56.808348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184853+0000","last_change":"2024-04-24T22:59:53.801680+0000","last_active":"2024-04-24T23:00:01.184853+0000","last_peered":"2024-04-24T23:00:01.184853+0000","last_clean":"2024-04-24T23:00:01.184853+0000","last_became_active":"2024-04-24T22:59:53.801365+0000","last_became_peered":"2024-04-24T22:59:53.801365+0000","last_unstale":"2024-04-24T23:00:01.184853+0000","last_undegraded":"2024-04-24T23:00:01.184853+0000","last_fullsized":"2024-04-24T23:00:01.184853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:29.189206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160460+0000","last_change":"2024-04-24T22:59:59.180894+0000","last_active":"2024-04-24T23:00:00.160460+0000","last_peered":"2024-04-24T23:00:00.160460+0000","last_clean":"2024-04-24T23:00:00.160460+0000","last_became_active":"2024-04-24T22:59:59.177236+0000","last_became_peered":"2024-04-24T22:59:59.177236+0000","last_unstale":"2024-04-24T23:00:00.160460+0000","last_undegraded":"2024-04-24T23:00:00.160460+0000","last_fullsized":"2024-04-24T23:00:00.160460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:33.734842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157352+0000","last_change":"2024-04-24T22:59:54.836662+0000","last_active":"2024-04-24T23:00:00.157352+0000","last_peered":"2024-04-24T23:00:00.157352+0000","last_clean":"2024-04-24T23:00:00.157352+0000","last_became_active":"2024-04-24T22:59:54.835790+0000","last_became_peered":"2024-04-24T22:59:54.835790+0000","last_unstale":"2024-04-24T23:00:00.157352+0000","last_undegraded":"2024-04-24T23:00:00.157352+0000","last_fullsized":"2024-04-24T23:00:00.157352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184827+0000","last_change":"2024-04-24T22:59:53.805218+0000","last_active":"2024-04-24T23:00:01.184827+0000","last_peered":"2024-04-24T23:00:01.184827+0000","last_clean":"2024-04-24T23:00:01.184827+0000","last_became_active":"2024-04-24T22:59:53.803401+0000","last_became_peered":"2024-04-24T22:59:53.803401+0000","last_unstale":"2024-04-24T23:00:01.184827+0000","last_undegraded":"2024-04-24T23:00:01.184827+0000","last_fullsized":"2024-04-24T23:00:01.184827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:56.417305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158402+0000","last_change":"2024-04-24T22:59:59.180784+0000","last_active":"2024-04-24T23:00:00.158402+0000","last_peered":"2024-04-24T23:00:00.158402+0000","last_clean":"2024-04-24T23:00:00.158402+0000","last_became_active":"2024-04-24T22:59:59.180017+0000","last_became_peered":"2024-04-24T22:59:59.180017+0000","last_unstale":"2024-04-24T23:00:00.158402+0000","last_undegraded":"2024-04-24T23:00:00.158402+0000","last_fullsized":"2024-04-24T23:00:00.158402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:17.271560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245322+0000","last_change":"2024-04-24T22:59:54.836197+0000","last_active":"2024-04-24T23:00:00.245322+0000","last_peered":"2024-04-24T23:00:00.245322+0000","last_clean":"2024-04-24T23:00:00.245322+0000","last_became_active":"2024-04-24T22:59:54.835647+0000","last_became_peered":"2024-04-24T22:59:54.835647+0000","last_unstale":"2024-04-24T23:00:00.245322+0000","last_undegraded":"2024-04-24T23:00:00.245322+0000","last_fullsized":"2024-04-24T23:00:00.245322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184333+0000","last_change":"2024-04-24T22:59:53.804121+0000","last_active":"2024-04-24T23:00:01.184333+0000","last_peered":"2024-04-24T23:00:01.184333+0000","last_clean":"2024-04-24T23:00:01.184333+0000","last_became_active":"2024-04-24T22:59:53.803732+0000","last_became_peered":"2024-04-24T22:59:53.803732+0000","last_unstale":"2024-04-24T23:00:01.184333+0000","last_undegraded":"2024-04-24T23:00:01.184333+0000","last_fullsized":"2024-04-24T23:00:01.184333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:55.794648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159307+0000","last_change":"2024-04-24T22:59:59.180854+0000","last_active":"2024-04-24T23:00:00.159307+0000","last_peered":"2024-04-24T23:00:00.159307+0000","last_clean":"2024-04-24T23:00:00.159307+0000","last_became_active":"2024-04-24T22:59:59.179885+0000","last_became_peered":"2024-04-24T22:59:59.179885+0000","last_unstale":"2024-04-24T23:00:00.159307+0000","last_undegraded":"2024-04-24T23:00:00.159307+0000","last_fullsized":"2024-04-24T23:00:00.159307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:59.617342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183892+0000","last_change":"2024-04-24T22:59:54.841245+0000","last_active":"2024-04-24T23:00:01.183892+0000","last_peered":"2024-04-24T23:00:01.183892+0000","last_clean":"2024-04-24T23:00:01.183892+0000","last_became_active":"2024-04-24T22:59:54.840779+0000","last_became_peered":"2024-04-24T22:59:54.840779+0000","last_unstale":"2024-04-24T23:00:01.183892+0000","last_undegraded":"2024-04-24T23:00:01.183892+0000","last_fullsized":"2024-04-24T23:00:01.183892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:21.114664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158462+0000","last_change":"2024-04-24T22:59:53.800686+0000","last_active":"2024-04-24T23:00:00.158462+0000","last_peered":"2024-04-24T23:00:00.158462+0000","last_clean":"2024-04-24T23:00:00.158462+0000","last_became_active":"2024-04-24T22:59:53.799843+0000","last_became_peered":"2024-04-24T22:59:53.799843+0000","last_unstale":"2024-04-24T23:00:00.158462+0000","last_undegraded":"2024-04-24T23:00:00.158462+0000","last_fullsized":"2024-04-24T23:00:00.158462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:19.098736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159857+0000","last_change":"2024-04-24T22:59:59.185850+0000","last_active":"2024-04-24T23:00:00.159857+0000","last_peered":"2024-04-24T23:00:00.159857+0000","last_clean":"2024-04-24T23:00:00.159857+0000","last_became_active":"2024-04-24T22:59:59.181277+0000","last_became_peered":"2024-04-24T22:59:59.181277+0000","last_unstale":"2024-04-24T23:00:00.159857+0000","last_undegraded":"2024-04-24T23:00:00.159857+0000","last_fullsized":"2024-04-24T23:00:00.159857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159354+0000","last_change":"2024-04-24T22:59:54.833216+0000","last_active":"2024-04-24T23:00:00.159354+0000","last_peered":"2024-04-24T23:00:00.159354+0000","last_clean":"2024-04-24T23:00:00.159354+0000","last_became_active":"2024-04-24T22:59:54.832933+0000","last_became_peered":"2024-04-24T22:59:54.832933+0000","last_unstale":"2024-04-24T23:00:00.159354+0000","last_undegraded":"2024-04-24T23:00:00.159354+0000","last_fullsized":"2024-04-24T23:00:00.159354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183544+0000","last_change":"2024-04-24T22:59:53.797462+0000","last_active":"2024-04-24T23:00:01.183544+0000","last_peered":"2024-04-24T23:00:01.183544+0000","last_clean":"2024-04-24T23:00:01.183544+0000","last_became_active":"2024-04-24T22:59:53.797136+0000","last_became_peered":"2024-04-24T22:59:53.797136+0000","last_unstale":"2024-04-24T23:00:01.183544+0000","last_undegraded":"2024-04-24T23:00:01.183544+0000","last_fullsized":"2024-04-24T23:00:01.183544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185371+0000","last_change":"2024-04-24T22:59:59.183061+0000","last_active":"2024-04-24T23:00:01.185371+0000","last_peered":"2024-04-24T23:00:01.185371+0000","last_clean":"2024-04-24T23:00:01.185371+0000","last_became_active":"2024-04-24T22:59:59.182605+0000","last_became_peered":"2024-04-24T22:59:59.182605+0000","last_unstale":"2024-04-24T23:00:01.185371+0000","last_undegraded":"2024-04-24T23:00:01.185371+0000","last_fullsized":"2024-04-24T23:00:01.185371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:52.103486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.010031+0000","last_change":"2024-04-24T22:59:54.826763+0000","last_active":"2024-04-24T23:00:01.010031+0000","last_peered":"2024-04-24T23:00:01.010031+0000","last_clean":"2024-04-24T23:00:01.010031+0000","last_became_active":"2024-04-24T22:59:54.826396+0000","last_became_peered":"2024-04-24T22:59:54.826396+0000","last_unstale":"2024-04-24T23:00:01.010031+0000","last_undegraded":"2024-04-24T23:00:01.010031+0000","last_fullsized":"2024-04-24T23:00:01.010031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:53:15.280102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184139+0000","last_change":"2024-04-24T22:59:53.802569+0000","last_active":"2024-04-24T23:00:01.184139+0000","last_peered":"2024-04-24T23:00:01.184139+0000","last_clean":"2024-04-24T23:00:01.184139+0000","last_became_active":"2024-04-24T22:59:53.801965+0000","last_became_peered":"2024-04-24T22:59:53.801965+0000","last_unstale":"2024-04-24T23:00:01.184139+0000","last_undegraded":"2024-04-24T23:00:01.184139+0000","last_fullsized":"2024-04-24T23:00:01.184139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:09.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336798+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:00:00.336798+0000","last_peered":"2024-04-24T23:00:00.336798+0000","last_clean":"2024-04-24T23:00:00.336798+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:00:00.336798+0000","last_undegraded":"2024-04-24T23:00:00.336798+0000","last_fullsized":"2024-04-24T23:00:00.336798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184761+0000","last_change":"2024-04-24T22:59:59.161211+0000","last_active":"2024-04-24T23:00:01.184761+0000","last_peered":"2024-04-24T23:00:01.184761+0000","last_clean":"2024-04-24T23:00:01.184761+0000","last_became_active":"2024-04-24T22:59:59.160734+0000","last_became_peered":"2024-04-24T22:59:59.160734+0000","last_unstale":"2024-04-24T23:00:01.184761+0000","last_undegraded":"2024-04-24T23:00:01.184761+0000","last_fullsized":"2024-04-24T23:00:01.184761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:36.104485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184606+0000","last_change":"2024-04-24T22:59:54.819610+0000","last_active":"2024-04-24T23:00:01.184606+0000","last_peered":"2024-04-24T23:00:01.184606+0000","last_clean":"2024-04-24T23:00:01.184606+0000","last_became_active":"2024-04-24T22:59:54.819070+0000","last_became_peered":"2024-04-24T22:59:54.819070+0000","last_unstale":"2024-04-24T23:00:01.184606+0000","last_undegraded":"2024-04-24T23:00:01.184606+0000","last_fullsized":"2024-04-24T23:00:01.184606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:53.348359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160124+0000","last_change":"2024-04-24T22:59:53.799389+0000","last_active":"2024-04-24T23:00:00.160124+0000","last_peered":"2024-04-24T23:00:00.160124+0000","last_clean":"2024-04-24T23:00:00.160124+0000","last_became_active":"2024-04-24T22:59:53.799041+0000","last_became_peered":"2024-04-24T22:59:53.799041+0000","last_unstale":"2024-04-24T23:00:00.160124+0000","last_undegraded":"2024-04-24T23:00:00.160124+0000","last_fullsized":"2024-04-24T23:00:00.160124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156106+0000","last_change":"2024-04-24T22:59:59.174885+0000","last_active":"2024-04-24T23:00:00.156106+0000","last_peered":"2024-04-24T23:00:00.156106+0000","last_clean":"2024-04-24T23:00:00.156106+0000","last_became_active":"2024-04-24T22:59:59.174370+0000","last_became_peered":"2024-04-24T22:59:59.174370+0000","last_unstale":"2024-04-24T23:00:00.156106+0000","last_undegraded":"2024-04-24T23:00:00.156106+0000","last_fullsized":"2024-04-24T23:00:00.156106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245921+0000","last_change":"2024-04-24T22:59:54.835634+0000","last_active":"2024-04-24T23:00:00.245921+0000","last_peered":"2024-04-24T23:00:00.245921+0000","last_clean":"2024-04-24T23:00:00.245921+0000","last_became_active":"2024-04-24T22:59:54.833569+0000","last_became_peered":"2024-04-24T22:59:54.833569+0000","last_unstale":"2024-04-24T23:00:00.245921+0000","last_undegraded":"2024-04-24T23:00:00.245921+0000","last_fullsized":"2024-04-24T23:00:00.245921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:29.860749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185367+0000","last_change":"2024-04-24T22:59:53.802150+0000","last_active":"2024-04-24T23:00:01.185367+0000","last_peered":"2024-04-24T23:00:01.185367+0000","last_clean":"2024-04-24T23:00:01.185367+0000","last_became_active":"2024-04-24T22:59:53.799509+0000","last_became_peered":"2024-04-24T22:59:53.799509+0000","last_unstale":"2024-04-24T23:00:01.185367+0000","last_undegraded":"2024-04-24T23:00:01.185367+0000","last_fullsized":"2024-04-24T23:00:01.185367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:36.050787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184895+0000","last_change":"2024-04-24T22:59:59.177414+0000","last_active":"2024-04-24T23:00:01.184895+0000","last_peered":"2024-04-24T23:00:01.184895+0000","last_clean":"2024-04-24T23:00:01.184895+0000","last_became_active":"2024-04-24T22:59:59.174313+0000","last_became_peered":"2024-04-24T22:59:59.174313+0000","last_unstale":"2024-04-24T23:00:01.184895+0000","last_undegraded":"2024-04-24T23:00:01.184895+0000","last_fullsized":"2024-04-24T23:00:01.184895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:22.796518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245879+0000","last_change":"2024-04-24T22:59:54.823918+0000","last_active":"2024-04-24T23:00:00.245879+0000","last_peered":"2024-04-24T23:00:00.245879+0000","last_clean":"2024-04-24T23:00:00.245879+0000","last_became_active":"2024-04-24T22:59:54.823619+0000","last_became_peered":"2024-04-24T22:59:54.823619+0000","last_unstale":"2024-04-24T23:00:00.245879+0000","last_undegraded":"2024-04-24T23:00:00.245879+0000","last_fullsized":"2024-04-24T23:00:00.245879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009718+0000","last_change":"2024-04-24T22:59:53.802658+0000","last_active":"2024-04-24T23:00:01.009718+0000","last_peered":"2024-04-24T23:00:01.009718+0000","last_clean":"2024-04-24T23:00:01.009718+0000","last_became_active":"2024-04-24T22:59:53.802337+0000","last_became_peered":"2024-04-24T22:59:53.802337+0000","last_unstale":"2024-04-24T23:00:01.009718+0000","last_undegraded":"2024-04-24T23:00:01.009718+0000","last_fullsized":"2024-04-24T23:00:01.009718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183130+0000","last_change":"2024-04-24T22:59:59.158432+0000","last_active":"2024-04-24T23:00:01.183130+0000","last_peered":"2024-04-24T23:00:01.183130+0000","last_clean":"2024-04-24T23:00:01.183130+0000","last_became_active":"2024-04-24T22:59:59.157980+0000","last_became_peered":"2024-04-24T22:59:59.157980+0000","last_unstale":"2024-04-24T23:00:01.183130+0000","last_undegraded":"2024-04-24T23:00:01.183130+0000","last_fullsized":"2024-04-24T23:00:01.183130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:13.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158298+0000","last_change":"2024-04-24T22:59:54.830501+0000","last_active":"2024-04-24T23:00:00.158298+0000","last_peered":"2024-04-24T23:00:00.158298+0000","last_clean":"2024-04-24T23:00:00.158298+0000","last_became_active":"2024-04-24T22:59:54.829827+0000","last_became_peered":"2024-04-24T22:59:54.829827+0000","last_unstale":"2024-04-24T23:00:00.158298+0000","last_undegraded":"2024-04-24T23:00:00.158298+0000","last_fullsized":"2024-04-24T23:00:00.158298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245937+0000","last_change":"2024-04-24T22:59:53.804112+0000","last_active":"2024-04-24T23:00:00.245937+0000","last_peered":"2024-04-24T23:00:00.245937+0000","last_clean":"2024-04-24T23:00:00.245937+0000","last_became_active":"2024-04-24T22:59:53.803737+0000","last_became_peered":"2024-04-24T22:59:53.803737+0000","last_unstale":"2024-04-24T23:00:00.245937+0000","last_undegraded":"2024-04-24T23:00:00.245937+0000","last_fullsized":"2024-04-24T23:00:00.245937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:07.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336897+0000","last_change":"2024-04-24T22:59:59.170945+0000","last_active":"2024-04-24T23:00:00.336897+0000","last_peered":"2024-04-24T23:00:00.336897+0000","last_clean":"2024-04-24T23:00:00.336897+0000","last_became_active":"2024-04-24T22:59:59.170564+0000","last_became_peered":"2024-04-24T22:59:59.170564+0000","last_unstale":"2024-04-24T23:00:00.336897+0000","last_undegraded":"2024-04-24T23:00:00.336897+0000","last_fullsized":"2024-04-24T23:00:00.336897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:46.104989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183495+0000","last_change":"2024-04-24T22:59:54.834918+0000","last_active":"2024-04-24T23:00:01.183495+0000","last_peered":"2024-04-24T23:00:01.183495+0000","last_clean":"2024-04-24T23:00:01.183495+0000","last_became_active":"2024-04-24T22:59:54.834596+0000","last_became_peered":"2024-04-24T22:59:54.834596+0000","last_unstale":"2024-04-24T23:00:01.183495+0000","last_undegraded":"2024-04-24T23:00:01.183495+0000","last_fullsized":"2024-04-24T23:00:01.183495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:55.731536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009071+0000","last_change":"2024-04-24T22:59:53.801950+0000","last_active":"2024-04-24T23:00:01.009071+0000","last_peered":"2024-04-24T23:00:01.009071+0000","last_clean":"2024-04-24T23:00:01.009071+0000","last_became_active":"2024-04-24T22:59:53.801646+0000","last_became_peered":"2024-04-24T22:59:53.801646+0000","last_unstale":"2024-04-24T23:00:01.009071+0000","last_undegraded":"2024-04-24T23:00:01.009071+0000","last_fullsized":"2024-04-24T23:00:01.009071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:01.595597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185946+0000","last_change":"2024-04-24T22:59:59.175741+0000","last_active":"2024-04-24T23:00:01.185946+0000","last_peered":"2024-04-24T23:00:01.185946+0000","last_clean":"2024-04-24T23:00:01.185946+0000","last_became_active":"2024-04-24T22:59:59.175281+0000","last_became_peered":"2024-04-24T22:59:59.175281+0000","last_unstale":"2024-04-24T23:00:01.185946+0000","last_undegraded":"2024-04-24T23:00:01.185946+0000","last_fullsized":"2024-04-24T23:00:01.185946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:23:30.733798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336673+0000","last_change":"2024-04-24T22:59:54.846255+0000","last_active":"2024-04-24T23:00:00.336673+0000","last_peered":"2024-04-24T23:00:00.336673+0000","last_clean":"2024-04-24T23:00:00.336673+0000","last_became_active":"2024-04-24T22:59:54.845933+0000","last_became_peered":"2024-04-24T22:59:54.845933+0000","last_unstale":"2024-04-24T23:00:00.336673+0000","last_undegraded":"2024-04-24T23:00:00.336673+0000","last_fullsized":"2024-04-24T23:00:00.336673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245177+0000","last_change":"2024-04-24T22:59:53.807192+0000","last_active":"2024-04-24T23:00:00.245177+0000","last_peered":"2024-04-24T23:00:00.245177+0000","last_clean":"2024-04-24T23:00:00.245177+0000","last_became_active":"2024-04-24T22:59:53.806934+0000","last_became_peered":"2024-04-24T22:59:53.806934+0000","last_unstale":"2024-04-24T23:00:00.245177+0000","last_undegraded":"2024-04-24T23:00:00.245177+0000","last_fullsized":"2024-04-24T23:00:00.245177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:52:40.366630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185730+0000","last_change":"2024-04-24T22:59:59.183999+0000","last_active":"2024-04-24T23:00:01.185730+0000","last_peered":"2024-04-24T23:00:01.185730+0000","last_clean":"2024-04-24T23:00:01.185730+0000","last_became_active":"2024-04-24T22:59:59.183567+0000","last_became_peered":"2024-04-24T22:59:59.183567+0000","last_unstale":"2024-04-24T23:00:01.185730+0000","last_undegraded":"2024-04-24T23:00:01.185730+0000","last_fullsized":"2024-04-24T23:00:01.185730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:48.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183858+0000","last_change":"2024-04-24T22:59:54.832242+0000","last_active":"2024-04-24T23:00:01.183858+0000","last_peered":"2024-04-24T23:00:01.183858+0000","last_clean":"2024-04-24T23:00:01.183858+0000","last_became_active":"2024-04-24T22:59:54.830703+0000","last_became_peered":"2024-04-24T22:59:54.830703+0000","last_unstale":"2024-04-24T23:00:01.183858+0000","last_undegraded":"2024-04-24T23:00:01.183858+0000","last_fullsized":"2024-04-24T23:00:01.183858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184359+0000","last_change":"2024-04-24T22:59:53.798756+0000","last_active":"2024-04-24T23:00:01.184359+0000","last_peered":"2024-04-24T23:00:01.184359+0000","last_clean":"2024-04-24T23:00:01.184359+0000","last_became_active":"2024-04-24T22:59:53.798399+0000","last_became_peered":"2024-04-24T22:59:53.798399+0000","last_unstale":"2024-04-24T23:00:01.184359+0000","last_undegraded":"2024-04-24T23:00:01.184359+0000","last_fullsized":"2024-04-24T23:00:01.184359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:17.930808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158868+0000","last_change":"2024-04-24T22:59:59.180893+0000","last_active":"2024-04-24T23:00:00.158868+0000","last_peered":"2024-04-24T23:00:00.158868+0000","last_clean":"2024-04-24T23:00:00.158868+0000","last_became_active":"2024-04-24T22:59:59.180250+0000","last_became_peered":"2024-04-24T22:59:59.180250+0000","last_unstale":"2024-04-24T23:00:00.158868+0000","last_undegraded":"2024-04-24T23:00:00.158868+0000","last_fullsized":"2024-04-24T23:00:00.158868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:34.220352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158938+0000","last_change":"2024-04-24T22:59:54.824357+0000","last_active":"2024-04-24T23:00:00.158938+0000","last_peered":"2024-04-24T23:00:00.158938+0000","last_clean":"2024-04-24T23:00:00.158938+0000","last_became_active":"2024-04-24T22:59:54.823831+0000","last_became_peered":"2024-04-24T22:59:54.823831+0000","last_unstale":"2024-04-24T23:00:00.158938+0000","last_undegraded":"2024-04-24T23:00:00.158938+0000","last_fullsized":"2024-04-24T23:00:00.158938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:41.745386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162832+0000","last_change":"2024-04-24T22:59:53.798640+0000","last_active":"2024-04-24T23:00:00.162832+0000","last_peered":"2024-04-24T23:00:00.162832+0000","last_clean":"2024-04-24T23:00:00.162832+0000","last_became_active":"2024-04-24T22:59:53.798298+0000","last_became_peered":"2024-04-24T22:59:53.798298+0000","last_unstale":"2024-04-24T23:00:00.162832+0000","last_undegraded":"2024-04-24T23:00:00.162832+0000","last_fullsized":"2024-04-24T23:00:00.162832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184286+0000","last_change":"2024-04-24T22:59:59.178160+0000","last_active":"2024-04-24T23:00:01.184286+0000","last_peered":"2024-04-24T23:00:01.184286+0000","last_clean":"2024-04-24T23:00:01.184286+0000","last_became_active":"2024-04-24T22:59:59.177275+0000","last_became_peered":"2024-04-24T22:59:59.177275+0000","last_unstale":"2024-04-24T23:00:01.184286+0000","last_undegraded":"2024-04-24T23:00:01.184286+0000","last_fullsized":"2024-04-24T23:00:01.184286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:06.997646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246471+0000","last_change":"2024-04-24T22:59:54.828946+0000","last_active":"2024-04-24T23:00:00.246471+0000","last_peered":"2024-04-24T23:00:00.246471+0000","last_clean":"2024-04-24T23:00:00.246471+0000","last_became_active":"2024-04-24T22:59:54.828694+0000","last_became_peered":"2024-04-24T22:59:54.828694+0000","last_unstale":"2024-04-24T23:00:00.246471+0000","last_undegraded":"2024-04-24T23:00:00.246471+0000","last_fullsized":"2024-04-24T23:00:00.246471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:13.857989+0000","last_change":"2024-04-24T22:59:53.802324+0000","last_active":"2024-04-24T23:00:13.857989+0000","last_peered":"2024-04-24T23:00:13.857989+0000","last_clean":"2024-04-24T23:00:13.857989+0000","last_became_active":"2024-04-24T22:59:53.801956+0000","last_became_peered":"2024-04-24T22:59:53.801956+0000","last_unstale":"2024-04-24T23:00:13.857989+0000","last_undegraded":"2024-04-24T23:00:13.857989+0000","last_fullsized":"2024-04-24T23:00:13.857989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009080+0000","last_change":"2024-04-24T22:59:59.175987+0000","last_active":"2024-04-24T23:00:01.009080+0000","last_peered":"2024-04-24T23:00:01.009080+0000","last_clean":"2024-04-24T23:00:01.009080+0000","last_became_active":"2024-04-24T22:59:59.175539+0000","last_became_peered":"2024-04-24T22:59:59.175539+0000","last_unstale":"2024-04-24T23:00:01.009080+0000","last_undegraded":"2024-04-24T23:00:01.009080+0000","last_fullsized":"2024-04-24T23:00:01.009080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:46.474442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183741+0000","last_change":"2024-04-24T22:59:54.827006+0000","last_active":"2024-04-24T23:00:01.183741+0000","last_peered":"2024-04-24T23:00:01.183741+0000","last_clean":"2024-04-24T23:00:01.183741+0000","last_became_active":"2024-04-24T22:59:54.825162+0000","last_became_peered":"2024-04-24T22:59:54.825162+0000","last_unstale":"2024-04-24T23:00:01.183741+0000","last_undegraded":"2024-04-24T23:00:01.183741+0000","last_fullsized":"2024-04-24T23:00:01.183741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:42.114839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162078+0000","last_change":"2024-04-24T22:59:53.805610+0000","last_active":"2024-04-24T23:00:00.162078+0000","last_peered":"2024-04-24T23:00:00.162078+0000","last_clean":"2024-04-24T23:00:00.162078+0000","last_became_active":"2024-04-24T22:59:53.805286+0000","last_became_peered":"2024-04-24T22:59:53.805286+0000","last_unstale":"2024-04-24T23:00:00.162078+0000","last_undegraded":"2024-04-24T23:00:00.162078+0000","last_fullsized":"2024-04-24T23:00:00.162078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:18.600603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156548+0000","last_change":"2024-04-24T22:59:59.176914+0000","last_active":"2024-04-24T23:00:00.156548+0000","last_peered":"2024-04-24T23:00:00.156548+0000","last_clean":"2024-04-24T23:00:00.156548+0000","last_became_active":"2024-04-24T22:59:59.176522+0000","last_became_peered":"2024-04-24T22:59:59.176522+0000","last_unstale":"2024-04-24T23:00:00.156548+0000","last_undegraded":"2024-04-24T23:00:00.156548+0000","last_fullsized":"2024-04-24T23:00:00.156548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:39.722731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185735+0000","last_change":"2024-04-24T22:59:54.843770+0000","last_active":"2024-04-24T23:00:01.185735+0000","last_peered":"2024-04-24T23:00:01.185735+0000","last_clean":"2024-04-24T23:00:01.185735+0000","last_became_active":"2024-04-24T22:59:54.838700+0000","last_became_peered":"2024-04-24T22:59:54.838700+0000","last_unstale":"2024-04-24T23:00:01.185735+0000","last_undegraded":"2024-04-24T23:00:01.185735+0000","last_fullsized":"2024-04-24T23:00:01.185735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:16.370386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245598+0000","last_change":"2024-04-24T22:59:53.800926+0000","last_active":"2024-04-24T23:00:00.245598+0000","last_peered":"2024-04-24T23:00:00.245598+0000","last_clean":"2024-04-24T23:00:00.245598+0000","last_became_active":"2024-04-24T22:59:53.800666+0000","last_became_peered":"2024-04-24T22:59:53.800666+0000","last_unstale":"2024-04-24T23:00:00.245598+0000","last_undegraded":"2024-04-24T23:00:00.245598+0000","last_fullsized":"2024-04-24T23:00:00.245598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:22.175181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157317+0000","last_change":"2024-04-24T22:59:59.184549+0000","last_active":"2024-04-24T23:00:00.157317+0000","last_peered":"2024-04-24T23:00:00.157317+0000","last_clean":"2024-04-24T23:00:00.157317+0000","last_became_active":"2024-04-24T22:59:59.184095+0000","last_became_peered":"2024-04-24T22:59:59.184095+0000","last_unstale":"2024-04-24T23:00:00.157317+0000","last_undegraded":"2024-04-24T23:00:00.157317+0000","last_fullsized":"2024-04-24T23:00:00.157317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:45.603508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158054+0000","last_change":"2024-04-24T22:59:54.840299+0000","last_active":"2024-04-24T23:00:00.158054+0000","last_peered":"2024-04-24T23:00:00.158054+0000","last_clean":"2024-04-24T23:00:00.158054+0000","last_became_active":"2024-04-24T22:59:54.839835+0000","last_became_peered":"2024-04-24T22:59:54.839835+0000","last_unstale":"2024-04-24T23:00:00.158054+0000","last_undegraded":"2024-04-24T23:00:00.158054+0000","last_fullsized":"2024-04-24T23:00:00.158054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.338011+0000","last_change":"2024-04-24T22:59:53.802398+0000","last_active":"2024-04-24T23:00:00.338011+0000","last_peered":"2024-04-24T23:00:00.338011+0000","last_clean":"2024-04-24T23:00:00.338011+0000","last_became_active":"2024-04-24T22:59:53.802067+0000","last_became_peered":"2024-04-24T22:59:53.802067+0000","last_unstale":"2024-04-24T23:00:00.338011+0000","last_undegraded":"2024-04-24T23:00:00.338011+0000","last_fullsized":"2024-04-24T23:00:00.338011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:37.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009830+0000","last_change":"2024-04-24T22:59:59.167854+0000","last_active":"2024-04-24T23:00:01.009830+0000","last_peered":"2024-04-24T23:00:01.009830+0000","last_clean":"2024-04-24T23:00:01.009830+0000","last_became_active":"2024-04-24T22:59:59.167352+0000","last_became_peered":"2024-04-24T22:59:59.167352+0000","last_unstale":"2024-04-24T23:00:01.009830+0000","last_undegraded":"2024-04-24T23:00:01.009830+0000","last_fullsized":"2024-04-24T23:00:01.009830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:10.083772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009441+0000","last_change":"2024-04-24T22:59:59.177020+0000","last_active":"2024-04-24T23:00:01.009441+0000","last_peered":"2024-04-24T23:00:01.009441+0000","last_clean":"2024-04-24T23:00:01.009441+0000","last_became_active":"2024-04-24T22:59:59.176501+0000","last_became_peered":"2024-04-24T22:59:59.176501+0000","last_unstale":"2024-04-24T23:00:01.009441+0000","last_undegraded":"2024-04-24T23:00:01.009441+0000","last_fullsized":"2024-04-24T23:00:01.009441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:00.091139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009043+0000","last_change":"2024-04-24T22:59:54.808811+0000","last_active":"2024-04-24T23:00:01.009043+0000","last_peered":"2024-04-24T23:00:01.009043+0000","last_clean":"2024-04-24T23:00:01.009043+0000","last_became_active":"2024-04-24T22:59:54.807983+0000","last_became_peered":"2024-04-24T22:59:54.807983+0000","last_unstale":"2024-04-24T23:00:01.009043+0000","last_undegraded":"2024-04-24T23:00:01.009043+0000","last_fullsized":"2024-04-24T23:00:01.009043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:31.328568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183452+0000","last_change":"2024-04-24T22:59:53.795814+0000","last_active":"2024-04-24T23:00:01.183452+0000","last_peered":"2024-04-24T23:00:01.183452+0000","last_clean":"2024-04-24T23:00:01.183452+0000","last_became_active":"2024-04-24T22:59:53.795530+0000","last_became_peered":"2024-04-24T22:59:53.795530+0000","last_unstale":"2024-04-24T23:00:01.183452+0000","last_undegraded":"2024-04-24T23:00:01.183452+0000","last_fullsized":"2024-04-24T23:00:01.183452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:03.118395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185190+0000","last_change":"2024-04-24T22:59:59.178038+0000","last_active":"2024-04-24T23:00:01.185190+0000","last_peered":"2024-04-24T23:00:01.185190+0000","last_clean":"2024-04-24T23:00:01.185190+0000","last_became_active":"2024-04-24T22:59:59.177590+0000","last_became_peered":"2024-04-24T22:59:59.177590+0000","last_unstale":"2024-04-24T23:00:01.185190+0000","last_undegraded":"2024-04-24T23:00:01.185190+0000","last_fullsized":"2024-04-24T23:00:01.185190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:20:33.544037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184156+0000","last_change":"2024-04-24T22:59:54.835646+0000","last_active":"2024-04-24T23:00:01.184156+0000","last_peered":"2024-04-24T23:00:01.184156+0000","last_clean":"2024-04-24T23:00:01.184156+0000","last_became_active":"2024-04-24T22:59:54.835384+0000","last_became_peered":"2024-04-24T22:59:54.835384+0000","last_unstale":"2024-04-24T23:00:01.184156+0000","last_undegraded":"2024-04-24T23:00:01.184156+0000","last_fullsized":"2024-04-24T23:00:01.184156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:29.063136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159519+0000","last_change":"2024-04-24T22:59:53.798938+0000","last_active":"2024-04-24T23:00:00.159519+0000","last_peered":"2024-04-24T23:00:00.159519+0000","last_clean":"2024-04-24T23:00:00.159519+0000","last_became_active":"2024-04-24T22:59:53.798646+0000","last_became_peered":"2024-04-24T22:59:53.798646+0000","last_unstale":"2024-04-24T23:00:00.159519+0000","last_undegraded":"2024-04-24T23:00:00.159519+0000","last_fullsized":"2024-04-24T23:00:00.159519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:20:59.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184247+0000","last_change":"2024-04-24T22:59:53.797818+0000","last_active":"2024-04-24T23:00:01.184247+0000","last_peered":"2024-04-24T23:00:01.184247+0000","last_clean":"2024-04-24T23:00:01.184247+0000","last_became_active":"2024-04-24T22:59:53.796837+0000","last_became_peered":"2024-04-24T22:59:53.796837+0000","last_unstale":"2024-04-24T23:00:01.184247+0000","last_undegraded":"2024-04-24T23:00:01.184247+0000","last_fullsized":"2024-04-24T23:00:01.184247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:40.731687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009363+0000","last_change":"2024-04-24T22:59:54.827809+0000","last_active":"2024-04-24T23:00:01.009363+0000","last_peered":"2024-04-24T23:00:01.009363+0000","last_clean":"2024-04-24T23:00:01.009363+0000","last_became_active":"2024-04-24T22:59:54.827260+0000","last_became_peered":"2024-04-24T22:59:54.827260+0000","last_unstale":"2024-04-24T23:00:01.009363+0000","last_undegraded":"2024-04-24T23:00:01.009363+0000","last_fullsized":"2024-04-24T23:00:01.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:16.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009993+0000","last_change":"2024-04-24T22:59:59.178920+0000","last_active":"2024-04-24T23:00:01.009993+0000","last_peered":"2024-04-24T23:00:01.009993+0000","last_clean":"2024-04-24T23:00:01.009993+0000","last_became_active":"2024-04-24T22:59:59.178525+0000","last_became_peered":"2024-04-24T22:59:59.178525+0000","last_unstale":"2024-04-24T23:00:01.009993+0000","last_undegraded":"2024-04-24T23:00:01.009993+0000","last_fullsized":"2024-04-24T23:00:01.009993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:04.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184831+0000","last_change":"2024-04-24T22:59:53.803387+0000","last_active":"2024-04-24T23:00:01.184831+0000","last_peered":"2024-04-24T23:00:01.184831+0000","last_clean":"2024-04-24T23:00:01.184831+0000","last_became_active":"2024-04-24T22:59:53.802947+0000","last_became_peered":"2024-04-24T22:59:53.802947+0000","last_unstale":"2024-04-24T23:00:01.184831+0000","last_undegraded":"2024-04-24T23:00:01.184831+0000","last_fullsized":"2024-04-24T23:00:01.184831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:52.742419+0000","last_clean_scrub_stamp":"2024-04-24T22:59:52.742419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:03.901704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337215+0000","last_change":"2024-04-24T22:59:54.846364+0000","last_active":"2024-04-24T23:00:00.337215+0000","last_peered":"2024-04-24T23:00:00.337215+0000","last_clean":"2024-04-24T23:00:00.337215+0000","last_became_active":"2024-04-24T22:59:54.846003+0000","last_became_peered":"2024-04-24T22:59:54.846003+0000","last_unstale":"2024-04-24T23:00:00.337215+0000","last_undegraded":"2024-04-24T23:00:00.337215+0000","last_fullsized":"2024-04-24T23:00:00.337215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.161971+0000","last_change":"2024-04-24T22:59:59.184791+0000","last_active":"2024-04-24T23:00:00.161971+0000","last_peered":"2024-04-24T23:00:00.161971+0000","last_clean":"2024-04-24T23:00:00.161971+0000","last_became_active":"2024-04-24T22:59:59.184116+0000","last_became_peered":"2024-04-24T22:59:59.184116+0000","last_unstale":"2024-04-24T23:00:00.161971+0000","last_undegraded":"2024-04-24T23:00:00.161971+0000","last_fullsized":"2024-04-24T23:00:00.161971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:58.115721+0000","last_clean_scrub_stamp":"2024-04-24T22:59:58.115721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:35.688170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.155812+0000","last_change":"2024-04-24T22:59:54.827064+0000","last_active":"2024-04-24T23:00:00.155812+0000","last_peered":"2024-04-24T23:00:00.155812+0000","last_clean":"2024-04-24T23:00:00.155812+0000","last_became_active":"2024-04-24T22:59:54.826759+0000","last_became_peered":"2024-04-24T22:59:54.826759+0000","last_unstale":"2024-04-24T23:00:00.155812+0000","last_undegraded":"2024-04-24T23:00:00.155812+0000","last_fullsized":"2024-04-24T23:00:00.155812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:04.132095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158202+0000","last_change":"2024-04-24T22:59:54.830406+0000","last_active":"2024-04-24T23:00:00.158202+0000","last_peered":"2024-04-24T23:00:00.158202+0000","last_clean":"2024-04-24T23:00:00.158202+0000","last_became_active":"2024-04-24T22:59:54.830092+0000","last_became_peered":"2024-04-24T22:59:54.830092+0000","last_unstale":"2024-04-24T23:00:00.158202+0000","last_undegraded":"2024-04-24T23:00:00.158202+0000","last_fullsized":"2024-04-24T23:00:00.158202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184023+0000","last_change":"2024-04-24T22:59:54.842436+0000","last_active":"2024-04-24T23:00:01.184023+0000","last_peered":"2024-04-24T23:00:01.184023+0000","last_clean":"2024-04-24T23:00:01.184023+0000","last_became_active":"2024-04-24T22:59:54.842135+0000","last_became_peered":"2024-04-24T22:59:54.842135+0000","last_unstale":"2024-04-24T23:00:01.184023+0000","last_undegraded":"2024-04-24T23:00:01.184023+0000","last_fullsized":"2024-04-24T23:00:01.184023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:04.584734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184555+0000","last_change":"2024-04-24T22:59:54.845478+0000","last_active":"2024-04-24T23:00:01.184555+0000","last_peered":"2024-04-24T23:00:01.184555+0000","last_clean":"2024-04-24T23:00:01.184555+0000","last_became_active":"2024-04-24T22:59:54.845154+0000","last_became_peered":"2024-04-24T22:59:54.845154+0000","last_unstale":"2024-04-24T23:00:01.184555+0000","last_undegraded":"2024-04-24T23:00:01.184555+0000","last_fullsized":"2024-04-24T23:00:01.184555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.211633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.159644+0000","last_change":"2024-04-24T22:59:54.833101+0000","last_active":"2024-04-24T23:00:00.159644+0000","last_peered":"2024-04-24T23:00:00.159644+0000","last_clean":"2024-04-24T23:00:00.159644+0000","last_became_active":"2024-04-24T22:59:54.832808+0000","last_became_peered":"2024-04-24T22:59:54.832808+0000","last_unstale":"2024-04-24T23:00:00.159644+0000","last_undegraded":"2024-04-24T23:00:00.159644+0000","last_fullsized":"2024-04-24T23:00:00.159644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:18.944507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160607+0000","last_change":"2024-04-24T22:59:54.832279+0000","last_active":"2024-04-24T23:00:00.160607+0000","last_peered":"2024-04-24T23:00:00.160607+0000","last_clean":"2024-04-24T23:00:00.160607+0000","last_became_active":"2024-04-24T22:59:54.831479+0000","last_became_peered":"2024-04-24T22:59:54.831479+0000","last_unstale":"2024-04-24T23:00:00.160607+0000","last_undegraded":"2024-04-24T23:00:00.160607+0000","last_fullsized":"2024-04-24T23:00:00.160607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:41.243906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.157820+0000","last_change":"2024-04-24T22:59:54.841252+0000","last_active":"2024-04-24T23:00:00.157820+0000","last_peered":"2024-04-24T23:00:00.157820+0000","last_clean":"2024-04-24T23:00:00.157820+0000","last_became_active":"2024-04-24T22:59:54.840960+0000","last_became_peered":"2024-04-24T22:59:54.840960+0000","last_unstale":"2024-04-24T23:00:00.157820+0000","last_undegraded":"2024-04-24T23:00:00.157820+0000","last_fullsized":"2024-04-24T23:00:00.157820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:10.608984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185364+0000","last_change":"2024-04-24T22:59:54.844485+0000","last_active":"2024-04-24T23:00:01.185364+0000","last_peered":"2024-04-24T23:00:01.185364+0000","last_clean":"2024-04-24T23:00:01.185364+0000","last_became_active":"2024-04-24T22:59:54.844149+0000","last_became_peered":"2024-04-24T22:59:54.844149+0000","last_unstale":"2024-04-24T23:00:01.185364+0000","last_undegraded":"2024-04-24T23:00:01.185364+0000","last_fullsized":"2024-04-24T23:00:01.185364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:05.971282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183253+0000","last_change":"2024-04-24T22:59:54.843547+0000","last_active":"2024-04-24T23:00:01.183253+0000","last_peered":"2024-04-24T23:00:01.183253+0000","last_clean":"2024-04-24T23:00:01.183253+0000","last_became_active":"2024-04-24T22:59:54.842984+0000","last_became_peered":"2024-04-24T22:59:54.842984+0000","last_unstale":"2024-04-24T23:00:01.183253+0000","last_undegraded":"2024-04-24T23:00:01.183253+0000","last_fullsized":"2024-04-24T23:00:01.183253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184055+0000","last_change":"2024-04-24T22:59:54.848279+0000","last_active":"2024-04-24T23:00:01.184055+0000","last_peered":"2024-04-24T23:00:01.184055+0000","last_clean":"2024-04-24T23:00:01.184055+0000","last_became_active":"2024-04-24T22:59:54.847833+0000","last_became_peered":"2024-04-24T22:59:54.847833+0000","last_unstale":"2024-04-24T23:00:01.184055+0000","last_undegraded":"2024-04-24T23:00:01.184055+0000","last_fullsized":"2024-04-24T23:00:01.184055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:10.672755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.336955+0000","last_change":"2024-04-24T22:59:54.821637+0000","last_active":"2024-04-24T23:00:00.336955+0000","last_peered":"2024-04-24T23:00:00.336955+0000","last_clean":"2024-04-24T23:00:00.336955+0000","last_became_active":"2024-04-24T22:59:54.819868+0000","last_became_peered":"2024-04-24T22:59:54.819868+0000","last_unstale":"2024-04-24T23:00:00.336955+0000","last_undegraded":"2024-04-24T23:00:00.336955+0000","last_fullsized":"2024-04-24T23:00:00.336955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.860484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.009044+0000","last_change":"2024-04-24T22:59:54.839683+0000","last_active":"2024-04-24T23:00:01.009044+0000","last_peered":"2024-04-24T23:00:01.009044+0000","last_clean":"2024-04-24T23:00:01.009044+0000","last_became_active":"2024-04-24T22:59:54.834098+0000","last_became_peered":"2024-04-24T22:59:54.834098+0000","last_unstale":"2024-04-24T23:00:01.009044+0000","last_undegraded":"2024-04-24T23:00:01.009044+0000","last_fullsized":"2024-04-24T23:00:01.009044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:58.717221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245911+0000","last_change":"2024-04-24T22:59:54.832261+0000","last_active":"2024-04-24T23:00:00.245911+0000","last_peered":"2024-04-24T23:00:00.245911+0000","last_clean":"2024-04-24T23:00:00.245911+0000","last_became_active":"2024-04-24T22:59:54.831321+0000","last_became_peered":"2024-04-24T22:59:54.831321+0000","last_unstale":"2024-04-24T23:00:00.245911+0000","last_undegraded":"2024-04-24T23:00:00.245911+0000","last_fullsized":"2024-04-24T23:00:00.245911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:12.911957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.184771+0000","last_change":"2024-04-24T22:59:54.819368+0000","last_active":"2024-04-24T23:00:01.184771+0000","last_peered":"2024-04-24T23:00:01.184771+0000","last_clean":"2024-04-24T23:00:01.184771+0000","last_became_active":"2024-04-24T22:59:54.818749+0000","last_became_peered":"2024-04-24T22:59:54.818749+0000","last_unstale":"2024-04-24T23:00:01.184771+0000","last_undegraded":"2024-04-24T23:00:01.184771+0000","last_fullsized":"2024-04-24T23:00:01.184771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:14.960710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.162580+0000","last_change":"2024-04-24T22:59:54.834877+0000","last_active":"2024-04-24T23:00:00.162580+0000","last_peered":"2024-04-24T23:00:00.162580+0000","last_clean":"2024-04-24T23:00:00.162580+0000","last_became_active":"2024-04-24T22:59:54.833131+0000","last_became_peered":"2024-04-24T22:59:54.833131+0000","last_unstale":"2024-04-24T23:00:00.162580+0000","last_undegraded":"2024-04-24T23:00:00.162580+0000","last_fullsized":"2024-04-24T23:00:00.162580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185603+0000","last_change":"2024-04-24T22:59:54.826869+0000","last_active":"2024-04-24T23:00:01.185603+0000","last_peered":"2024-04-24T23:00:01.185603+0000","last_clean":"2024-04-24T23:00:01.185603+0000","last_became_active":"2024-04-24T22:59:54.826268+0000","last_became_peered":"2024-04-24T22:59:54.826268+0000","last_unstale":"2024-04-24T23:00:01.185603+0000","last_undegraded":"2024-04-24T23:00:01.185603+0000","last_fullsized":"2024-04-24T23:00:01.185603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:22.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183254+0000","last_change":"2024-04-24T22:59:54.829640+0000","last_active":"2024-04-24T23:00:01.183254+0000","last_peered":"2024-04-24T23:00:01.183254+0000","last_clean":"2024-04-24T23:00:01.183254+0000","last_became_active":"2024-04-24T22:59:54.829295+0000","last_became_peered":"2024-04-24T22:59:54.829295+0000","last_unstale":"2024-04-24T23:00:01.183254+0000","last_undegraded":"2024-04-24T23:00:01.183254+0000","last_fullsized":"2024-04-24T23:00:01.183254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:35.363128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183689+0000","last_change":"2024-04-24T22:59:54.845490+0000","last_active":"2024-04-24T23:00:01.183689+0000","last_peered":"2024-04-24T23:00:01.183689+0000","last_clean":"2024-04-24T23:00:01.183689+0000","last_became_active":"2024-04-24T22:59:54.842390+0000","last_became_peered":"2024-04-24T22:59:54.842390+0000","last_unstale":"2024-04-24T23:00:01.183689+0000","last_undegraded":"2024-04-24T23:00:01.183689+0000","last_fullsized":"2024-04-24T23:00:01.183689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:25.870553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.158717+0000","last_change":"2024-04-24T22:59:54.837049+0000","last_active":"2024-04-24T23:00:00.158717+0000","last_peered":"2024-04-24T23:00:00.158717+0000","last_clean":"2024-04-24T23:00:00.158717+0000","last_became_active":"2024-04-24T22:59:54.836650+0000","last_became_peered":"2024-04-24T22:59:54.836650+0000","last_unstale":"2024-04-24T23:00:00.158717+0000","last_undegraded":"2024-04-24T23:00:00.158717+0000","last_fullsized":"2024-04-24T23:00:00.158717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:30.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.160882+0000","last_change":"2024-04-24T22:59:54.823987+0000","last_active":"2024-04-24T23:00:00.160882+0000","last_peered":"2024-04-24T23:00:00.160882+0000","last_clean":"2024-04-24T23:00:00.160882+0000","last_became_active":"2024-04-24T22:59:54.823738+0000","last_became_peered":"2024-04-24T22:59:54.823738+0000","last_unstale":"2024-04-24T23:00:00.160882+0000","last_undegraded":"2024-04-24T23:00:00.160882+0000","last_fullsized":"2024-04-24T23:00:00.160882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:13.157098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245783+0000","last_change":"2024-04-24T22:59:54.828844+0000","last_active":"2024-04-24T23:00:00.245783+0000","last_peered":"2024-04-24T23:00:00.245783+0000","last_clean":"2024-04-24T23:00:00.245783+0000","last_became_active":"2024-04-24T22:59:54.827890+0000","last_became_peered":"2024-04-24T22:59:54.827890+0000","last_unstale":"2024-04-24T23:00:00.245783+0000","last_undegraded":"2024-04-24T23:00:00.245783+0000","last_fullsized":"2024-04-24T23:00:00.245783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:29:11.910761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.246404+0000","last_change":"2024-04-24T22:59:54.841028+0000","last_active":"2024-04-24T23:00:00.246404+0000","last_peered":"2024-04-24T23:00:00.246404+0000","last_clean":"2024-04-24T23:00:00.246404+0000","last_became_active":"2024-04-24T22:59:54.839890+0000","last_became_peered":"2024-04-24T22:59:54.839890+0000","last_unstale":"2024-04-24T23:00:00.246404+0000","last_undegraded":"2024-04-24T23:00:00.246404+0000","last_fullsized":"2024-04-24T23:00:00.246404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:55.257739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245594+0000","last_change":"2024-04-24T22:59:54.834999+0000","last_active":"2024-04-24T23:00:00.245594+0000","last_peered":"2024-04-24T23:00:00.245594+0000","last_clean":"2024-04-24T23:00:00.245594+0000","last_became_active":"2024-04-24T22:59:54.834737+0000","last_became_peered":"2024-04-24T22:59:54.834737+0000","last_unstale":"2024-04-24T23:00:00.245594+0000","last_undegraded":"2024-04-24T23:00:00.245594+0000","last_fullsized":"2024-04-24T23:00:00.245594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:29.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.337929+0000","last_change":"2024-04-24T22:59:54.825114+0000","last_active":"2024-04-24T23:00:00.337929+0000","last_peered":"2024-04-24T23:00:00.337929+0000","last_clean":"2024-04-24T23:00:00.337929+0000","last_became_active":"2024-04-24T22:59:54.824804+0000","last_became_peered":"2024-04-24T22:59:54.824804+0000","last_unstale":"2024-04-24T23:00:00.337929+0000","last_undegraded":"2024-04-24T23:00:00.337929+0000","last_fullsized":"2024-04-24T23:00:00.337929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:12.341538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.183824+0000","last_change":"2024-04-24T22:59:54.841039+0000","last_active":"2024-04-24T23:00:01.183824+0000","last_peered":"2024-04-24T23:00:01.183824+0000","last_clean":"2024-04-24T23:00:01.183824+0000","last_became_active":"2024-04-24T22:59:54.840480+0000","last_became_peered":"2024-04-24T22:59:54.840480+0000","last_unstale":"2024-04-24T23:00:01.183824+0000","last_undegraded":"2024-04-24T23:00:01.183824+0000","last_fullsized":"2024-04-24T23:00:01.183824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:56.253783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245118+0000","last_change":"2024-04-24T22:59:54.829835+0000","last_active":"2024-04-24T23:00:00.245118+0000","last_peered":"2024-04-24T23:00:00.245118+0000","last_clean":"2024-04-24T23:00:00.245118+0000","last_became_active":"2024-04-24T22:59:54.829572+0000","last_became_peered":"2024-04-24T22:59:54.829572+0000","last_unstale":"2024-04-24T23:00:00.245118+0000","last_undegraded":"2024-04-24T23:00:00.245118+0000","last_fullsized":"2024-04-24T23:00:00.245118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:21:34.878821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156074+0000","last_change":"2024-04-24T22:59:54.831968+0000","last_active":"2024-04-24T23:00:00.156074+0000","last_peered":"2024-04-24T23:00:00.156074+0000","last_clean":"2024-04-24T23:00:00.156074+0000","last_became_active":"2024-04-24T22:59:54.831606+0000","last_became_peered":"2024-04-24T22:59:54.831606+0000","last_unstale":"2024-04-24T23:00:00.156074+0000","last_undegraded":"2024-04-24T23:00:00.156074+0000","last_fullsized":"2024-04-24T23:00:00.156074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:23.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245463+0000","last_change":"2024-04-24T22:59:54.848714+0000","last_active":"2024-04-24T23:00:00.245463+0000","last_peered":"2024-04-24T23:00:00.245463+0000","last_clean":"2024-04-24T23:00:00.245463+0000","last_became_active":"2024-04-24T22:59:54.848325+0000","last_became_peered":"2024-04-24T22:59:54.848325+0000","last_unstale":"2024-04-24T23:00:00.245463+0000","last_undegraded":"2024-04-24T23:00:00.245463+0000","last_fullsized":"2024-04-24T23:00:00.245463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:21.645391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.156975+0000","last_change":"2024-04-24T22:59:54.836067+0000","last_active":"2024-04-24T23:00:00.156975+0000","last_peered":"2024-04-24T23:00:00.156975+0000","last_clean":"2024-04-24T23:00:00.156975+0000","last_became_active":"2024-04-24T22:59:54.830678+0000","last_became_peered":"2024-04-24T22:59:54.830678+0000","last_unstale":"2024-04-24T23:00:00.156975+0000","last_undegraded":"2024-04-24T23:00:00.156975+0000","last_fullsized":"2024-04-24T23:00:00.156975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:08.975096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185093+0000","last_change":"2024-04-24T22:59:54.846617+0000","last_active":"2024-04-24T23:00:01.185093+0000","last_peered":"2024-04-24T23:00:01.185093+0000","last_clean":"2024-04-24T23:00:01.185093+0000","last_became_active":"2024-04-24T22:59:54.844346+0000","last_became_peered":"2024-04-24T22:59:54.844346+0000","last_unstale":"2024-04-24T23:00:01.185093+0000","last_undegraded":"2024-04-24T23:00:01.185093+0000","last_fullsized":"2024-04-24T23:00:01.185093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:47.647894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:01.185538+0000","last_change":"2024-04-24T22:59:54.840915+0000","last_active":"2024-04-24T23:00:01.185538+0000","last_peered":"2024-04-24T23:00:01.185538+0000","last_clean":"2024-04-24T23:00:01.185538+0000","last_became_active":"2024-04-24T22:59:54.840307+0000","last_became_peered":"2024-04-24T22:59:54.840307+0000","last_unstale":"2024-04-24T23:00:01.185538+0000","last_undegraded":"2024-04-24T23:00:01.185538+0000","last_fullsized":"2024-04-24T23:00:01.185538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:25.146607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:00:00.245791+0000","last_change":"2024-04-24T22:59:54.839361+0000","last_active":"2024-04-24T23:00:00.245791+0000","last_peered":"2024-04-24T23:00:00.245791+0000","last_clean":"2024-04-24T23:00:00.245791+0000","last_became_active":"2024-04-24T22:59:54.838975+0000","last_became_peered":"2024-04-24T22:59:54.838975+0000","last_unstale":"2024-04-24T23:00:00.245791+0000","last_undegraded":"2024-04-24T23:00:00.245791+0000","last_fullsized":"2024-04-24T23:00:00.245791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:53.756119+0000","last_clean_scrub_stamp":"2024-04-24T22:59:53.756119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:39.866005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:30.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:00:30.658 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T23:00:30.658 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T23:00:30.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T23:00:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.886+0000 7fba89a00640 1 Processor -- start 2024-04-24T23:00:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.887+0000 7fba89a00640 1 -- start start 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.888+0000 7fba89a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba840d0240 0x7fba8406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.888+0000 7fba89a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.888+0000 7fba89a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba840ccb10 con 0x7fba8415a980 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.888+0000 7fba89a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fba84072240 con 0x7fba840d0240 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.888+0000 7fba89a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba840aede0 con 0x7fba84071dd0 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba840d0240 0x7fba8406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba840d0240 0x7fba8406d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45194/0 (socket says 172.21.15.146:45194) 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 -- 172.21.15.146:0/1559416829 learned_addr learned my addr 172.21.15.146:0/1559416829 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba89000640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 -- 172.21.15.146:0/1559416829 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 msgr2=0x7fba840ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 -- 172.21.15.146:0/1559416829 >> v1:172.21.15.203:6789/0 conn(0x7fba8415a980 legacy=0x7fba840cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba7b400640 1 -- 172.21.15.146:0/1559416829 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8406ddc0 con 0x7fba840d0240 2024-04-24T23:00:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.889+0000 7fba89000640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.890+0000 7fba7b400640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba840d0240 0x7fba8406d770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0098a0 tx=0x7fba6c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4207adde84326825 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.890+0000 7fba83400640 1 -- 172.21.15.146:0/1559416829 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c037070 con 0x7fba840d0240 2024-04-24T23:00:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.890+0000 7fba83400640 1 -- 172.21.15.146:0/1559416829 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c032440 con 0x7fba840d0240 2024-04-24T23:00:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.890+0000 7fba83400640 1 -- 172.21.15.146:0/1559416829 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c032810 con 0x7fba840d0240 2024-04-24T23:00:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 -- 172.21.15.146:0/1559416829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba840d0240 msgr2=0x7fba8406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba840d0240 0x7fba8406d770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0098a0 tx=0x7fba6c02a1a0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 -- 172.21.15.146:0/1559416829 shutdown_connections 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 --2- 172.21.15.146:0/1559416829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba840d0240 0x7fba8406d770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 -- 172.21.15.146:0/1559416829 >> 172.21.15.146:0/1559416829 conn(0x7fba8406b320 msgr2=0x7fba8406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 -- 172.21.15.146:0/1559416829 shutdown_connections 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.891+0000 7fba89a00640 1 -- 172.21.15.146:0/1559416829 wait complete. 2024-04-24T23:00:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.893+0000 7fba89a00640 1 Processor -- start 2024-04-24T23:00:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.893+0000 7fba89a00640 1 -- start start 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba840d0240 0x7fba8415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba8406e660 con 0x7fba8415a980 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba8406e380 con 0x7fba840d0240 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba8415ad60 con 0x7fba84071dd0 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45202/0 (socket says 172.21.15.146:45202) 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 -- 172.21.15.146:0/384017756 learned_addr learned my addr 172.21.15.146:0/384017756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba83e00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba7b400640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba840d0240 0x7fba8415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 -- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 msgr2=0x7fba840b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 -- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba840d0240 msgr2=0x7fba8415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba840d0240 0x7fba8415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.894+0000 7fba89000640 1 -- 172.21.15.146:0/384017756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba840b2690 con 0x7fba8415a980 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba89000640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00cd50 tx=0x7fba7c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00f680 con 0x7fba8415a980 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c00f840 con 0x7fba8415a980 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00fc30 con 0x7fba8415a980 2024-04-24T23:00:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8415c930 con 0x7fba8415a980 2024-04-24T23:00:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.895+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba840b1950 con 0x7fba8415a980 2024-04-24T23:00:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.896+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8404f500 con 0x7fba8415a980 2024-04-24T23:00:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.897+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba7c00e3e0 con 0x7fba8415a980 2024-04-24T23:00:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.898+0000 7fba80c00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 0x7fba6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.898+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fba7c08bf30 con 0x7fba8415a980 2024-04-24T23:00:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.898+0000 7fba83e00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 0x7fba6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.899+0000 7fba83e00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 0x7fba6006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba74004ea0 tx=0x7fba74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:30.902+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba7c014030 con 0x7fba8415a980 2024-04-24T23:00:31.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.123+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba840cbdb0 con 0x7fba8415a980 2024-04-24T23:00:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.123+0000 7fba80c00640 1 -- 172.21.15.146:0/384017756 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fba7c05a630 con 0x7fba8415a980 2024-04-24T23:00:31.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:31.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T23:00:31.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 msgr2=0x7fba6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 0x7fba6006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba74004ea0 tx=0x7fba74009040 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 msgr2=0x7fba8414ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00cd50 tx=0x7fba7c00a650 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 shutdown_connections 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba8415a980 0x7fba8414ee30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba840d0240 0x7fba8415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba6006be30 0x7fba6006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 --2- 172.21.15.146:0/384017756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba84071dd0 0x7fba840b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 >> 172.21.15.146:0/384017756 conn(0x7fba8406b320 msgr2=0x7fba84159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 shutdown_connections 2024-04-24T23:00:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.126+0000 7fba89a00640 1 -- 172.21.15.146:0/384017756 wait complete. 2024-04-24T23:00:31.147 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T23:00:31.147 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:31.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.337+0000 7f399fe00640 1 Processor -- start 2024-04-24T23:00:31.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.337+0000 7f399fe00640 1 -- start start 2024-04-24T23:00:31.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39a01561c0 0x7f39a00cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f39a00709d0 0x7f39a015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a00cfb30 0x7f39a00cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f39a00b4310 con 0x7f39a01561c0 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f39a01565a0 con 0x7f39a00709d0 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39a00d04c0 con 0x7f39a00cfb30 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39a01561c0 0x7f39a00cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39a01561c0 0x7f39a00cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45216/0 (socket says 172.21.15.146:45216) 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399ea00640 1 -- 172.21.15.146:0/3119604023 learned_addr learned my addr 172.21.15.146:0/3119604023 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399e000640 1 --2- 172.21.15.146:0/3119604023 >> v2:172.21.15.203:3300/0 conn(0x7f39a00709d0 0x7f39a015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.339+0000 7f399f400640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a00cfb30 0x7f39a00cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.340+0000 7f399ea00640 1 -- 172.21.15.146:0/3119604023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a00cfb30 msgr2=0x7f39a00cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.340+0000 7f399ea00640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a00cfb30 0x7f39a00cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.340+0000 7f399ea00640 1 -- 172.21.15.146:0/3119604023 >> v2:172.21.15.203:3300/0 conn(0x7f39a00709d0 msgr2=0x7f39a015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.340+0000 7f399ea00640 1 --2- 172.21.15.146:0/3119604023 >> v2:172.21.15.203:3300/0 conn(0x7f39a00709d0 0x7f39a015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.340+0000 7f399ea00640 1 -- 172.21.15.146:0/3119604023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a0070f90 con 0x7f39a01561c0 2024-04-24T23:00:31.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.341+0000 7f399ea00640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a01561c0 0x7f39a00cdbf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39a00b3f70 tx=0x7f398802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca017e232823b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399d600640 1 -- 172.21.15.146:0/3119604023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988037070 con 0x7f39a01561c0 2024-04-24T23:00:31.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399d600640 1 -- 172.21.15.146:0/3119604023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398802ae00 con 0x7f39a01561c0 2024-04-24T23:00:31.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399d600640 1 -- 172.21.15.146:0/3119604023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988032660 con 0x7f39a01561c0 2024-04-24T23:00:31.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 -- 172.21.15.146:0/3119604023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a01561c0 msgr2=0x7f39a00cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a01561c0 0x7f39a00cdbf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39a00b3f70 tx=0x7f398802a0b0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 -- 172.21.15.146:0/3119604023 shutdown_connections 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a00cfb30 0x7f39a00cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 --2- 172.21.15.146:0/3119604023 >> v2:172.21.15.203:3300/0 conn(0x7f39a00709d0 0x7f39a015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 --2- 172.21.15.146:0/3119604023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a01561c0 0x7f39a00cdbf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 -- 172.21.15.146:0/3119604023 >> 172.21.15.146:0/3119604023 conn(0x7f39a006b320 msgr2=0x7f39a006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.343+0000 7f399fe00640 1 -- 172.21.15.146:0/3119604023 shutdown_connections 2024-04-24T23:00:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.344+0000 7f399fe00640 1 -- 172.21.15.146:0/3119604023 wait complete. 2024-04-24T23:00:31.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.345+0000 7f399fe00640 1 Processor -- start 2024-04-24T23:00:31.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.345+0000 7f399fe00640 1 -- start start 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 0x7f39a01446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a01561c0 0x7f39a0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0071830 con 0x7f39a00cfb30 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0071550 con 0x7f39a00709d0 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39a00b2c20 con 0x7f39a01561c0 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.346+0000 7f399e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45220/0 (socket says 172.21.15.146:45220) 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 -- 172.21.15.146:0/1914398596 learned_addr learned my addr 172.21.15.146:0/1914398596 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399ea00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 0x7f39a01446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399f400640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a01561c0 0x7f39a0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 -- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a01561c0 msgr2=0x7f39a0158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a01561c0 0x7f39a0158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 -- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 msgr2=0x7f39a01446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 0x7f39a01446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 -- 172.21.15.146:0/1914398596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a006cbd0 con 0x7f39a00cfb30 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399ea00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 0x7f39a01446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f399e000640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3990007f20 tx=0x7f399000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.347+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990014620 con 0x7f39a00cfb30 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.348+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3990019070 con 0x7f39a00cfb30 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.348+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a006ceb0 con 0x7f39a00cfb30 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.348+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990014a00 con 0x7f39a00cfb30 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.348+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a006d470 con 0x7f39a00cfb30 2024-04-24T23:00:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.349+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a004f500 con 0x7f39a00cfb30 2024-04-24T23:00:31.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.350+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3990014ba0 con 0x7f39a00cfb30 2024-04-24T23:00:31.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.351+0000 7f3997400640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 0x7f397c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.351+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f399008bb80 con 0x7f39a00cfb30 2024-04-24T23:00:31.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.351+0000 7f399ea00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 0x7f397c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.352+0000 7f399ea00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 0x7f397c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3988034000 tx=0x7f398802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.355+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f399005a150 con 0x7f39a00cfb30 2024-04-24T23:00:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.558+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39a0153910 con 0x7f39a00cfb30 2024-04-24T23:00:31.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.560+0000 7f3997400640 1 -- 172.21.15.146:0/1914398596 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7f3990059a50 con 0x7f39a00cfb30 2024-04-24T23:00:31.563 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:31.563 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:31.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 msgr2=0x7f397c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 0x7f397c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3988034000 tx=0x7f398802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 msgr2=0x7f39a006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3990007f20 tx=0x7f399000e570 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 shutdown_connections 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f397c06be30 0x7f397c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a01561c0 0x7f39a0158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a00cfb30 0x7f39a006dc70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 --2- 172.21.15.146:0/1914398596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a00709d0 0x7f39a01446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.563+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 >> 172.21.15.146:0/1914398596 conn(0x7f39a006b320 msgr2=0x7f39a015fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.564+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 shutdown_connections 2024-04-24T23:00:31.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.564+0000 7f399fe00640 1 -- 172.21.15.146:0/1914398596 wait complete. 2024-04-24T23:00:31.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:31.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.788+0000 7f7d93200640 1 Processor -- start 2024-04-24T23:00:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.788+0000 7f7d93200640 1 -- start start 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 0x7f7d940b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d940cfcc0 0x7f7d940d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 0x7f7d9406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7d940d0660 con 0x7f7d940cfcc0 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7d94155500 con 0x7f7d9406d860 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.789+0000 7f7d93200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d94071ab0 con 0x7f7d94155120 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d940cfcc0 0x7f7d940d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d940cfcc0 0x7f7d940d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45234/0 (socket says 172.21.15.146:45234) 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 -- 172.21.15.146:0/1701899844 learned_addr learned my addr 172.21.15.146:0/1701899844 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d92800640 1 --2- 172.21.15.146:0/1701899844 >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 0x7f7d9406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91e00640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 0x7f7d940b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 -- 172.21.15.146:0/1701899844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 msgr2=0x7f7d940b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 0x7f7d940b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 -- 172.21.15.146:0/1701899844 >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 msgr2=0x7f7d9406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 --2- 172.21.15.146:0/1701899844 >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 0x7f7d9406dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91400640 1 -- 172.21.15.146:0/1701899844 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94071d90 con 0x7f7d940cfcc0 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d92800640 1 --2- 172.21.15.146:0/1701899844 >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 0x7f7d9406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.790+0000 7f7d91e00640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 0x7f7d940b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.791+0000 7f7d91400640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d940cfcc0 0x7f7d940d0120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d94158ba0 tx=0x7f7d7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eddb610604380c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.791+0000 7f7d90a00640 1 -- 172.21.15.146:0/1701899844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c037070 con 0x7f7d940cfcc0 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.791+0000 7f7d90a00640 1 -- 172.21.15.146:0/1701899844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c032440 con 0x7f7d940cfcc0 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.791+0000 7f7d90a00640 1 -- 172.21.15.146:0/1701899844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032810 con 0x7f7d940cfcc0 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 -- 172.21.15.146:0/1701899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d940cfcc0 msgr2=0x7f7d940d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d940cfcc0 0x7f7d940d0120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d94158ba0 tx=0x7f7d7c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 -- 172.21.15.146:0/1701899844 shutdown_connections 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d940cfcc0 0x7f7d940d0120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 --2- 172.21.15.146:0/1701899844 >> v2:172.21.15.203:3300/0 conn(0x7f7d9406d860 0x7f7d9406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 --2- 172.21.15.146:0/1701899844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d94155120 0x7f7d940b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 -- 172.21.15.146:0/1701899844 >> 172.21.15.146:0/1701899844 conn(0x7f7d9406b560 msgr2=0x7f7d9406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 -- 172.21.15.146:0/1701899844 shutdown_connections 2024-04-24T23:00:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.792+0000 7f7d93200640 1 -- 172.21.15.146:0/1701899844 wait complete. 2024-04-24T23:00:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.794+0000 7f7d93200640 1 Processor -- start 2024-04-24T23:00:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.794+0000 7f7d93200640 1 -- start start 2024-04-24T23:00:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 0x7f7d941f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94155120 0x7f7d9413f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94072630 con 0x7f7d9406d860 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94072350 con 0x7f7d94155120 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d93200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d940b4280 con 0x7f7d940cfcc0 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d91e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d91e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45248/0 (socket says 172.21.15.146:45248) 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.795+0000 7f7d91e00640 1 -- 172.21.15.146:0/533806891 learned_addr learned my addr 172.21.15.146:0/533806891 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91400640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 0x7f7d941f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d92800640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94155120 0x7f7d9413f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 -- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 msgr2=0x7f7d941f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 0x7f7d941f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 -- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94155120 msgr2=0x7f7d9413f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94155120 0x7f7d9413f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 -- 172.21.15.146:0/533806891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d941f3c80 con 0x7f7d9406d860 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91400640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 0x7f7d941f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d91e00640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c7f0 tx=0x7f7d8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84015070 con 0x7f7d9406d860 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d84007a30 con 0x7f7d9406d860 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.796+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9413fd30 con 0x7f7d9406d860 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.797+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84007e00 con 0x7f7d9406d860 2024-04-24T23:00:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.797+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941f7fb0 con 0x7f7d9406d860 2024-04-24T23:00:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.798+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9404f500 con 0x7f7d9406d860 2024-04-24T23:00:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.798+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d84018070 con 0x7f7d9406d860 2024-04-24T23:00:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.799+0000 7f7d8a000640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 0x7f7d7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.799+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7d8408b0e0 con 0x7f7d9406d860 2024-04-24T23:00:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.800+0000 7f7d91400640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 0x7f7d7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.801+0000 7f7d91400640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 0x7f7d7006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:31.804+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7d941f3c80 con 0x7f7d9406d860 2024-04-24T23:00:32.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.003+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d940cc190 con 0x7f7d9406d860 2024-04-24T23:00:32.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.004+0000 7f7d8a000640 1 -- 172.21.15.146:0/533806891 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f7d84059730 con 0x7f7d9406d860 2024-04-24T23:00:32.006 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.006+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 msgr2=0x7f7d7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.006+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 0x7f7d7006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.006+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 msgr2=0x7f7d9413ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.006+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c7f0 tx=0x7f7d8400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 shutdown_connections 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d94155120 0x7f7d9413f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7006be30 0x7f7d7006e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d940cfcc0 0x7f7d941f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 --2- 172.21.15.146:0/533806891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9406d860 0x7f7d9413ec50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 >> 172.21.15.146:0/533806891 conn(0x7f7d9406b560 msgr2=0x7f7d94159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 shutdown_connections 2024-04-24T23:00:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.007+0000 7f7d93200640 1 -- 172.21.15.146:0/533806891 wait complete. 2024-04-24T23:00:32.028 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:32.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.233+0000 7f6d3ea00640 1 Processor -- start 2024-04-24T23:00:32.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.233+0000 7f6d3ea00640 1 -- start start 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3ea00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d3815bcd0 0x7f6d380cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 0x7f6d3815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3ea00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d380b4df0 con 0x7f6d3815cd60 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3ea00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3815c8d0 con 0x7f6d3815bcd0 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380b4b10 con 0x7f6d380d03d0 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3cc00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6d3815cd60 0x7f6d380cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50024/0 (socket says 172.21.15.146:50024) 2024-04-24T23:00:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.235+0000 7f6d3cc00640 1 -- 172.21.15.146:0/523791603 learned_addr learned my addr 172.21.15.146:0/523791603 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d3d600640 1 --2- 172.21.15.146:0/523791603 >> v2:172.21.15.203:3300/0 conn(0x7f6d3815bcd0 0x7f6d380cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d3e000640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 0x7f6d3815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683804331 0 0) 0x7f6d380b4df0 con 0x7f6d3815cd60 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d20003520 con 0x7f6d3815cd60 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1963847013 0 0) 0x7f6d20003520 con 0x7f6d3815cd60 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 msgr2=0x7f6d3815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 0x7f6d3815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 >> v2:172.21.15.203:3300/0 conn(0x7f6d3815bcd0 msgr2=0x7f6d380cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 --2- 172.21.15.146:0/523791603 >> v2:172.21.15.203:3300/0 conn(0x7f6d3815bcd0 0x7f6d380cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3815c280 con 0x7f6d3815cd60 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6d24001670 con 0x7f6d3815cd60 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 >> v1:172.21.15.146:6789/0 conn(0x7f6d3815cd60 legacy=0x7f6d380cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d200039b0 0x7f6d20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 0x7f6d20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d20004d40 0x7f6d200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3815c8d0 con 0x7f6d200039b0 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380b4b10 con 0x7f6d20004d40 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.236+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2000b9c0 con 0x7f6d380d03d0 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d200039b0 0x7f6d20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3e000640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d20004d40 0x7f6d200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 -- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 msgr2=0x7f6d20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d380d03d0 0x7f6d20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 -- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d20004d40 msgr2=0x7f6d200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d20004d40 0x7f6d200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.237+0000 7f6d3d600640 1 -- 172.21.15.146:0/523791603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20003520 con 0x7f6d200039b0 2024-04-24T23:00:32.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.238+0000 7f6d3d600640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d200039b0 0x7f6d20003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009af0 tx=0x7f6d20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b560959edcc483 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c036070 con 0x7f6d200039b0 2024-04-24T23:00:32.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c031400 con 0x7f6d200039b0 2024-04-24T23:00:32.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d37e00640 1 -- 172.21.15.146:0/523791603 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c009690 con 0x7f6d200039b0 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 -- 172.21.15.146:0/523791603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d200039b0 msgr2=0x7f6d20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/523791603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d200039b0 0x7f6d20003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009af0 tx=0x7f6d20005830 comp rx=0 tx=0).stop 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3e000640 1 -- 172.21.15.146:0/523791603 reap_dead start 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 -- 172.21.15.146:0/523791603 shutdown_connections 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 -- 172.21.15.146:0/523791603 >> 172.21.15.146:0/523791603 conn(0x7f6d3806b560 msgr2=0x7f6d3806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 -- 172.21.15.146:0/523791603 shutdown_connections 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.239+0000 7f6d3ea00640 1 -- 172.21.15.146:0/523791603 wait complete. 2024-04-24T23:00:32.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.241+0000 7f6d3ea00640 1 Processor -- start 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.241+0000 7f6d3ea00640 1 -- start start 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d200039b0 0x7f6d380b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d381e7e10 0x7f6d38149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3806e590 con 0x7f6d381e7990 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380cc770 con 0x7f6d381e7e10 2024-04-24T23:00:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.242+0000 7f6d3ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380b4790 con 0x7f6d200039b0 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45264/0 (socket says 172.21.15.146:45264) 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 -- 172.21.15.146:0/889565036 learned_addr learned my addr 172.21.15.146:0/889565036 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3d600640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d200039b0 0x7f6d380b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3e000640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d381e7e10 0x7f6d38149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 -- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d200039b0 msgr2=0x7f6d380b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d200039b0 0x7f6d380b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 -- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d381e7e10 msgr2=0x7f6d38149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d381e7e10 0x7f6d38149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 -- 172.21.15.146:0/889565036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d380af5e0 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.243+0000 7f6d3cc00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c7a0 tx=0x7f6d2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.244+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24018070 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.244+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24007500 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.244+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24004a20 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.244+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d380af8c0 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.244+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d380afe80 con 0x7f6d381e7990 2024-04-24T23:00:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.245+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3815b530 con 0x7f6d381e7990 2024-04-24T23:00:32.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.246+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d24004bc0 con 0x7f6d381e7990 2024-04-24T23:00:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.247+0000 7f6d35600640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 0x7f6d1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.247+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6d2408a730 con 0x7f6d381e7990 2024-04-24T23:00:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.247+0000 7f6d3d600640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 0x7f6d1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.248+0000 7f6d3d600640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 0x7f6d1806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c033000 tx=0x7f6d2c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.251+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6d3815b530 con 0x7f6d381e7990 2024-04-24T23:00:32.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.455+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6d38160400 con 0x7f6d381e7990 2024-04-24T23:00:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.456+0000 7f6d35600640 1 -- 172.21.15.146:0/889565036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6d38160400 con 0x7f6d381e7990 2024-04-24T23:00:32.459 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 msgr2=0x7f6d1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 0x7f6d1806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c033000 tx=0x7f6d2c008030 comp rx=0 tx=0).stop 2024-04-24T23:00:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 msgr2=0x7f6d381491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c7a0 tx=0x7f6d2400cc60 comp rx=0 tx=0).stop 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 shutdown_connections 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d381e7e10 0x7f6d38149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d381e7990 0x7f6d381491d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d1806be30 0x7f6d1806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 --2- 172.21.15.146:0/889565036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d200039b0 0x7f6d380b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 >> 172.21.15.146:0/889565036 conn(0x7f6d3806b560 msgr2=0x7f6d3815ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 shutdown_connections 2024-04-24T23:00:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.459+0000 7f6d3ea00640 1 -- 172.21.15.146:0/889565036 wait complete. 2024-04-24T23:00:32.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:32.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.678+0000 7f0779600640 1 Processor -- start 2024-04-24T23:00:32.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.678+0000 7f0779600640 1 -- start start 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.679+0000 7f0779600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 0x7f07740b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.679+0000 7f0779600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f07740d0120 0x7f077406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.679+0000 7f0779600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0774071ab0 con 0x7f07740cfcc0 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.679+0000 7f0779600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0774155500 con 0x7f07740d0120 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.679+0000 7f0779600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f077415d1b0 con 0x7f0774155120 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.680+0000 7f0773e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 0x7f07740b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.680+0000 7f0778c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f07740d0120 0x7f077406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.680+0000 7f0773e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 0x7f07740b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:41812/0 (socket says 172.21.15.146:41812) 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.680+0000 7f0773e00640 1 -- 172.21.15.146:0/2244849193 learned_addr learned my addr 172.21.15.146:0/2244849193 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.681+0000 7f0778c00640 1 -- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 msgr2=0x7f07740b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.681+0000 7f0778c00640 1 --2- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 0x7f07740b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.681+0000 7f0778c00640 1 -- 172.21.15.146:0/2244849193 >> v1:172.21.15.203:6789/0 conn(0x7f07740cfcc0 legacy=0x7f077406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.681+0000 7f0778c00640 1 -- 172.21.15.146:0/2244849193 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0774071d90 con 0x7f07740d0120 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.682+0000 7f0778c00640 1 --2- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740d0120 0x7f077406df70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f076c009d90 tx=0x7f076c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ceba4a9f160f675 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0772a00640 1 -- 172.21.15.146:0/2244849193 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c007740 con 0x7f07740d0120 2024-04-24T23:00:32.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0772a00640 1 -- 172.21.15.146:0/2244849193 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c0078e0 con 0x7f07740d0120 2024-04-24T23:00:32.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0772a00640 1 -- 172.21.15.146:0/2244849193 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c007cb0 con 0x7f07740d0120 2024-04-24T23:00:32.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 -- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740d0120 msgr2=0x7f077406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 --2- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740d0120 0x7f077406df70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f076c009d90 tx=0x7f076c02a660 comp rx=0 tx=0).stop 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 -- 172.21.15.146:0/2244849193 shutdown_connections 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 --2- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740d0120 0x7f077406df70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 --2- 172.21.15.146:0/2244849193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0774155120 0x7f07740b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 -- 172.21.15.146:0/2244849193 >> 172.21.15.146:0/2244849193 conn(0x7f077406b560 msgr2=0x7f077406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 -- 172.21.15.146:0/2244849193 shutdown_connections 2024-04-24T23:00:32.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.683+0000 7f0779600640 1 -- 172.21.15.146:0/2244849193 wait complete. 2024-04-24T23:00:32.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.685+0000 7f0779600640 1 Processor -- start 2024-04-24T23:00:32.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.685+0000 7f0779600640 1 -- start start 2024-04-24T23:00:32.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 0x7f0774140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07740d0120 0x7f07741417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0774072630 con 0x7f0774155120 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0774072350 con 0x7f07740cfcc0 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0779600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f07740d05b0 con 0x7f07740d0120 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0778c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0778c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45266/0 (socket says 172.21.15.146:45266) 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.686+0000 7f0778c00640 1 -- 172.21.15.146:0/429436843 learned_addr learned my addr 172.21.15.146:0/429436843 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0773400640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07740d0120 0x7f07741417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0773e00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 0x7f0774140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 -- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07740d0120 msgr2=0x7f07741417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07740d0120 0x7f07741417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 -- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 msgr2=0x7f0774140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 0x7f0774140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 -- 172.21.15.146:0/429436843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07741409b0 con 0x7f0774155120 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0773e00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 0x7f0774140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f0778c00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f076c02ac50 tx=0x7f076c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.687+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c040070 con 0x7f0774155120 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.688+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c031bc0 con 0x7f0774155120 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.688+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c009450 con 0x7f0774155120 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.688+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07741511b0 con 0x7f0774155120 2024-04-24T23:00:32.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.688+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0774167110 con 0x7f0774155120 2024-04-24T23:00:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.689+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077404f500 con 0x7f0774155120 2024-04-24T23:00:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.690+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f076c039040 con 0x7f0774155120 2024-04-24T23:00:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.691+0000 7f076be00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 0x7f075406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.691+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f076c0ac9e0 con 0x7f0774155120 2024-04-24T23:00:32.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.691+0000 7f0773e00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 0x7f075406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.692+0000 7f0773e00640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 0x7f075406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0764009a20 tx=0x7f0764008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.695+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f07741409b0 con 0x7f0774155120 2024-04-24T23:00:32.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.890+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f07740b44d0 con 0x7f0774155120 2024-04-24T23:00:32.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.891+0000 7f076be00640 1 -- 172.21.15.146:0/429436843 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f076c07b170 con 0x7f0774155120 2024-04-24T23:00:32.893 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 msgr2=0x7f075406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 0x7f075406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0764009a20 tx=0x7f0764008040 comp rx=0 tx=0).stop 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 msgr2=0x7f077414bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f076c02ac50 tx=0x7f076c004a40 comp rx=0 tx=0).stop 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 shutdown_connections 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0774155120 0x7f077414bc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f075406be30 0x7f075406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07740d0120 0x7f07741417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 --2- 172.21.15.146:0/429436843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07740cfcc0 0x7f0774140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 >> 172.21.15.146:0/429436843 conn(0x7f077406b560 msgr2=0x7f07740b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 shutdown_connections 2024-04-24T23:00:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:32.894+0000 7f0779600640 1 -- 172.21.15.146:0/429436843 wait complete. 2024-04-24T23:00:32.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.107+0000 7ff059800640 1 Processor -- start 2024-04-24T23:00:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.107+0000 7ff059800640 1 -- start start 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.108+0000 7ff059800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff05413ef30 0x7ff054141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.108+0000 7ff059800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff0540ce770 0x7ff054071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.108+0000 7ff059800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0540ced40 con 0x7ff054141ab0 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.108+0000 7ff059800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff0541423d0 con 0x7ff05413ef30 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.108+0000 7ff059800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff054070f80 con 0x7ff0540ce770 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff05413ef30 0x7ff054141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff04be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff054141ab0 0x7ff0540ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50030/0 (socket says 172.21.15.146:50030) 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff04be00640 1 -- 172.21.15.146:0/4219617202 learned_addr learned my addr 172.21.15.146:0/4219617202 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff053400640 1 --2- 172.21.15.146:0/4219617202 >> v2:172.21.15.203:3300/0 conn(0x7ff0540ce770 0x7ff054071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052a00640 1 -- 172.21.15.146:0/4219617202 >> v2:172.21.15.203:3300/0 conn(0x7ff0540ce770 msgr2=0x7ff054071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052a00640 1 --2- 172.21.15.146:0/4219617202 >> v2:172.21.15.203:3300/0 conn(0x7ff0540ce770 0x7ff054071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052a00640 1 -- 172.21.15.146:0/4219617202 >> v1:172.21.15.146:6789/0 conn(0x7ff054141ab0 legacy=0x7ff0540ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052a00640 1 -- 172.21.15.146:0/4219617202 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0540cf020 con 0x7ff05413ef30 2024-04-24T23:00:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.109+0000 7ff052000640 1 -- 172.21.15.146:0/4219617202 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543345003 0 0) 0x7ff0540ced40 con 0x7ff054141ab0 2024-04-24T23:00:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.110+0000 7ff052a00640 1 --2- 172.21.15.146:0/4219617202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05413ef30 0x7ff054141570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff054160aa0 tx=0x7ff04402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744afc83fce70eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.110+0000 7ff052000640 1 -- 172.21.15.146:0/4219617202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044037070 con 0x7ff05413ef30 2024-04-24T23:00:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.110+0000 7ff052000640 1 -- 172.21.15.146:0/4219617202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044032440 con 0x7ff05413ef30 2024-04-24T23:00:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.110+0000 7ff052000640 1 -- 172.21.15.146:0/4219617202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044032810 con 0x7ff05413ef30 2024-04-24T23:00:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 -- 172.21.15.146:0/4219617202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05413ef30 msgr2=0x7ff054141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 --2- 172.21.15.146:0/4219617202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05413ef30 0x7ff054141570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff054160aa0 tx=0x7ff04402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 -- 172.21.15.146:0/4219617202 shutdown_connections 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 --2- 172.21.15.146:0/4219617202 >> v2:172.21.15.203:3300/0 conn(0x7ff0540ce770 0x7ff054071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 --2- 172.21.15.146:0/4219617202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05413ef30 0x7ff054141570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 -- 172.21.15.146:0/4219617202 >> 172.21.15.146:0/4219617202 conn(0x7ff0540b17b0 msgr2=0x7ff0540b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 -- 172.21.15.146:0/4219617202 shutdown_connections 2024-04-24T23:00:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.111+0000 7ff059800640 1 -- 172.21.15.146:0/4219617202 wait complete. 2024-04-24T23:00:33.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.113+0000 7ff059800640 1 Processor -- start 2024-04-24T23:00:33.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.113+0000 7ff059800640 1 -- start start 2024-04-24T23:00:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 0x7ff05413a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff05413ef30 0x7ff054140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff054071950 con 0x7ff054141ab0 2024-04-24T23:00:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff054070c10 con 0x7ff0540ce770 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff059800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff054071ad0 con 0x7ff05413ef30 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff053400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff053400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45280/0 (socket says 172.21.15.146:45280) 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff053400640 1 -- 172.21.15.146:0/2250789425 learned_addr learned my addr 172.21.15.146:0/2250789425 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.114+0000 7ff052a00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 0x7ff05413a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff04be00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff05413ef30 0x7ff054140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 -- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff05413ef30 msgr2=0x7ff054140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff05413ef30 0x7ff054140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 -- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 msgr2=0x7ff05413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 0x7ff05413a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 -- 172.21.15.146:0/2250789425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05414fde0 con 0x7ff054141ab0 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff052a00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 0x7ff05413a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff053400640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff04c007e70 tx=0x7ff04c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c014620 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c019070 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05413aa90 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c014a20 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.115+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff054143600 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.116+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05404f5a0 con 0x7ff054141ab0 2024-04-24T23:00:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.117+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff04c014bc0 con 0x7ff054141ab0 2024-04-24T23:00:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.118+0000 7ff04aa00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 0x7ff03006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.118+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff04c08baf0 con 0x7ff054141ab0 2024-04-24T23:00:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.119+0000 7ff052a00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 0x7ff03006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.120+0000 7ff052a00640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 0x7ff03006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff044034000 tx=0x7ff04402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.122+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff05413aa90 con 0x7ff054141ab0 2024-04-24T23:00:33.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.319+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff0540aeb70 con 0x7ff054141ab0 2024-04-24T23:00:33.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.320+0000 7ff04aa00640 1 -- 172.21.15.146:0/2250789425 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff04c05a0c0 con 0x7ff054141ab0 2024-04-24T23:00:33.322 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:33.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 msgr2=0x7ff03006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 0x7ff03006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff044034000 tx=0x7ff04402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 msgr2=0x7ff0541408a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff04c007e70 tx=0x7ff04c00e4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 shutdown_connections 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff054141ab0 0x7ff0541408a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03006be30 0x7ff03006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.322+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff05413ef30 0x7ff054140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.323+0000 7ff059800640 1 --2- 172.21.15.146:0/2250789425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0540ce770 0x7ff05413a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.323+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 >> 172.21.15.146:0/2250789425 conn(0x7ff0540b17b0 msgr2=0x7ff0540720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.323+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 shutdown_connections 2024-04-24T23:00:33.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.323+0000 7ff059800640 1 -- 172.21.15.146:0/2250789425 wait complete. 2024-04-24T23:00:33.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:33.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.516+0000 7f0908a00640 1 Processor -- start 2024-04-24T23:00:33.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.516+0000 7f0908a00640 1 -- start start 2024-04-24T23:00:33.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09040d06e0 0x7f09040b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040b2dc0 0x7f090415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f09040d0ac0 0x7f090415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f09040d4bc0 con 0x7f09040d06e0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f09040cf5b0 con 0x7f09040d0ac0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0908a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f09040d48e0 con 0x7f09040b2dc0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0902800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09040d06e0 0x7f09040b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0902800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09040d06e0 0x7f09040b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45292/0 (socket says 172.21.15.146:45292) 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0902800640 1 -- 172.21.15.146:0/2593503556 learned_addr learned my addr 172.21.15.146:0/2593503556 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.518+0000 7f0901e00640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040b2dc0 0x7f090415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0903200640 1 --2- 172.21.15.146:0/2593503556 >> v2:172.21.15.203:3300/0 conn(0x7f09040d0ac0 0x7f090415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0902800640 1 -- 172.21.15.146:0/2593503556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040b2dc0 msgr2=0x7f090415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0902800640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040b2dc0 0x7f090415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0902800640 1 -- 172.21.15.146:0/2593503556 >> v2:172.21.15.203:3300/0 conn(0x7f09040d0ac0 msgr2=0x7f090415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0902800640 1 --2- 172.21.15.146:0/2593503556 >> v2:172.21.15.203:3300/0 conn(0x7f09040d0ac0 0x7f090415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.519+0000 7f0902800640 1 -- 172.21.15.146:0/2593503556 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040cf850 con 0x7f09040d06e0 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.520+0000 7f0902800640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d06e0 0x7f09040b52d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0904067e80 tx=0x7f08f402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62febb24776773d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.520+0000 7f0901400640 1 -- 172.21.15.146:0/2593503556 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4037070 con 0x7f09040d06e0 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.520+0000 7f0901400640 1 -- 172.21.15.146:0/2593503556 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f402ae00 con 0x7f09040d06e0 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.520+0000 7f0901400640 1 -- 172.21.15.146:0/2593503556 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4032660 con 0x7f09040d06e0 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 -- 172.21.15.146:0/2593503556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d06e0 msgr2=0x7f09040b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d06e0 0x7f09040b52d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0904067e80 tx=0x7f08f402a0b0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 -- 172.21.15.146:0/2593503556 shutdown_connections 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 --2- 172.21.15.146:0/2593503556 >> v2:172.21.15.203:3300/0 conn(0x7f09040d0ac0 0x7f090415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040b2dc0 0x7f090415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 --2- 172.21.15.146:0/2593503556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d06e0 0x7f09040b52d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 -- 172.21.15.146:0/2593503556 >> 172.21.15.146:0/2593503556 conn(0x7f09040d3d20 msgr2=0x7f09040d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 -- 172.21.15.146:0/2593503556 shutdown_connections 2024-04-24T23:00:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.521+0000 7f0908a00640 1 -- 172.21.15.146:0/2593503556 wait complete. 2024-04-24T23:00:33.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.523+0000 7f0908a00640 1 Processor -- start 2024-04-24T23:00:33.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.523+0000 7f0908a00640 1 -- start start 2024-04-24T23:00:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09040b2dc0 0x7f09040cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040d06e0 0x7f09041f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09040d2e40 con 0x7f09040d0ac0 2024-04-24T23:00:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f09040d2cc0 con 0x7f09040b2dc0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0908a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f09040d1c20 con 0x7f09040d06e0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45294/0 (socket says 172.21.15.146:45294) 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 -- 172.21.15.146:0/3246377813 learned_addr learned my addr 172.21.15.146:0/3246377813 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0902800640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09040b2dc0 0x7f09040cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0901e00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040d06e0 0x7f09041f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 -- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040d06e0 msgr2=0x7f09041f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040d06e0 0x7f09041f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 -- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09040b2dc0 msgr2=0x7f09040cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09040b2dc0 0x7f09040cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.524+0000 7f0903200640 1 -- 172.21.15.146:0/3246377813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040cdcc0 con 0x7f09040d0ac0 2024-04-24T23:00:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f0903200640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cc30 tx=0x7f08fc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00ce40 con 0x7f09040d0ac0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08fc003990 con 0x7f09040d0ac0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09040b74f0 con 0x7f09040d0ac0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc003d40 con 0x7f09040d0ac0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.525+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09040b7ab0 con 0x7f09040d0ac0 2024-04-24T23:00:33.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.526+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090404f500 con 0x7f09040d0ac0 2024-04-24T23:00:33.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.527+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08fc004000 con 0x7f09040d0ac0 2024-04-24T23:00:33.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.529+0000 7f08faa00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 0x7f08e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.529+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f08fc08b550 con 0x7f09040d0ac0 2024-04-24T23:00:33.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.529+0000 7f0902800640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 0x7f08e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.530+0000 7f0902800640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 0x7f08e006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08f4034000 tx=0x7f08f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.533+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08fc014030 con 0x7f09040d0ac0 2024-04-24T23:00:33.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.768+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f090415d580 con 0x7f09040d0ac0 2024-04-24T23:00:33.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.769+0000 7f08faa00640 1 -- 172.21.15.146:0/3246377813 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f08fc059c50 con 0x7f09040d0ac0 2024-04-24T23:00:33.771 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:33.771 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:33.772 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:00:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 msgr2=0x7f08e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 0x7f08e006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08f4034000 tx=0x7f08f402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 msgr2=0x7f09041f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cc30 tx=0x7f08fc00a5c0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 shutdown_connections 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09040d0ac0 0x7f09041f7b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08e006be30 0x7f08e006e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09040d06e0 0x7f09041f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 --2- 172.21.15.146:0/3246377813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09040b2dc0 0x7f09040cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 >> 172.21.15.146:0/3246377813 conn(0x7f09040d3d20 msgr2=0x7f0904157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 shutdown_connections 2024-04-24T23:00:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.772+0000 7f0908a00640 1 -- 172.21.15.146:0/3246377813 wait complete. 2024-04-24T23:00:33.793 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:33.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.981+0000 7fb692e00640 1 Processor -- start 2024-04-24T23:00:33.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.981+0000 7fb692e00640 1 -- start start 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.982+0000 7fb692e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb68c145640 0x7fb68c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb692e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb68c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb692e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb68c0cdf70 con 0x7fb68c0b2a20 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb692e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb68c15d360 con 0x7fb68c145640 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb692e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb68c145a20 con 0x7fb68c0d03a0 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb683e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb68c0b2a20 0x7fb68c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50042/0 (socket says 172.21.15.146:50042) 2024-04-24T23:00:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb683e00640 1 -- 172.21.15.146:0/2429217431 learned_addr learned my addr 172.21.15.146:0/2429217431 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb68be00640 1 --2- 172.21.15.146:0/2429217431 >> v2:172.21.15.203:3300/0 conn(0x7fb68c145640 0x7fb68c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb690e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb68c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802479669 0 0) 0x7fb68c0cdf70 con 0x7fb68c0b2a20 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.983+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb670003520 con 0x7fb68c0b2a20 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2869728833 0 0) 0x7fb670003520 con 0x7fb68c0b2a20 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 msgr2=0x7fb68c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb68c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 >> v2:172.21.15.203:3300/0 conn(0x7fb68c145640 msgr2=0x7fb68c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 --2- 172.21.15.146:0/2429217431 >> v2:172.21.15.203:3300/0 conn(0x7fb68c145640 0x7fb68c15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c06d140 con 0x7fb68c0b2a20 2024-04-24T23:00:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb674001690 con 0x7fb68c0b2a20 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 >> v1:172.21.15.146:6789/0 conn(0x7fb68c0b2a20 legacy=0x7fb68c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb6700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb670003f80 0x7fb670004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb6700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c15d360 con 0x7fb670004d40 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c145a20 con 0x7fb670003f80 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb67000b9c0 con 0x7fb68c0d03a0 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb690e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb6700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.984+0000 7fb68be00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb6700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.985+0000 7fb690e00640 1 -- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 msgr2=0x7fb6700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.985+0000 7fb690e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c0d03a0 0x7fb6700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.985+0000 7fb690e00640 1 -- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb670003f80 msgr2=0x7fb670004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.985+0000 7fb690e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb670003f80 0x7fb670004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.985+0000 7fb690e00640 1 -- 172.21.15.146:0/2429217431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb670003520 con 0x7fb670004d40 2024-04-24T23:00:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb690e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb6700051c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb68400e170 tx=0x7fb670005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd6ee8c9034329b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684034020 con 0x7fb670004d40 2024-04-24T23:00:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6840305f0 con 0x7fb670004d40 2024-04-24T23:00:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb68b400640 1 -- 172.21.15.146:0/2429217431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684009c10 con 0x7fb670004d40 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb692e00640 1 -- 172.21.15.146:0/2429217431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 msgr2=0x7fb6700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.986+0000 7fb692e00640 1 --2- 172.21.15.146:0/2429217431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb6700051c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb68400e170 tx=0x7fb670005830 comp rx=0 tx=0).stop 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.987+0000 7fb690e00640 1 -- 172.21.15.146:0/2429217431 reap_dead start 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.987+0000 7fb692e00640 1 -- 172.21.15.146:0/2429217431 shutdown_connections 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.987+0000 7fb692e00640 1 -- 172.21.15.146:0/2429217431 >> 172.21.15.146:0/2429217431 conn(0x7fb68c06b320 msgr2=0x7fb68c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.987+0000 7fb692e00640 1 -- 172.21.15.146:0/2429217431 shutdown_connections 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.987+0000 7fb692e00640 1 -- 172.21.15.146:0/2429217431 wait complete. 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.988+0000 7fb692e00640 1 Processor -- start 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 -- start start 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68c13cd70 0x7fb68c13d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c071e50 0x7fb68c0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c06d9e0 con 0x7fb670004d40 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c06d700 con 0x7fb68c13cd70 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.989+0000 7fb692e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb68c06cbc0 con 0x7fb68c071e50 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45308/0 (socket says 172.21.15.146:45308) 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 -- 172.21.15.146:0/116117419 learned_addr learned my addr 172.21.15.146:0/116117419 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb683e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68c13cd70 0x7fb68c13d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb690e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c071e50 0x7fb68c0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 -- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c071e50 msgr2=0x7fb68c0722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c071e50 0x7fb68c0722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 -- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68c13cd70 msgr2=0x7fb68c13d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68c13cd70 0x7fb68c13d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.990+0000 7fb68be00640 1 -- 172.21.15.146:0/116117419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c072c30 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb68be00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011700 tx=0x7fb67c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00f9c0 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c00fb60 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c015460 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c13c2d0 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.991+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c13c570 con 0x7fb670004d40 2024-04-24T23:00:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.992+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c13c100 con 0x7fb670004d40 2024-04-24T23:00:33.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.993+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb67c015600 con 0x7fb670004d40 2024-04-24T23:00:33.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.994+0000 7fb688c00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 0x7fb66806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.994+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb67c08b790 con 0x7fb670004d40 2024-04-24T23:00:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.995+0000 7fb683e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 0x7fb66806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.996+0000 7fb683e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 0x7fb66806e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb674001eb0 tx=0x7fb6740016b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:33.999+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb67c019030 con 0x7fb670004d40 2024-04-24T23:00:34.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.182+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb68c13df10 con 0x7fb670004d40 2024-04-24T23:00:34.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.183+0000 7fb688c00640 1 -- 172.21.15.146:0/116117419 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18542 (secure 0 0 0) 0x7fb67c059df0 con 0x7fb670004d40 2024-04-24T23:00:34.186 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:34.186 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T22:59:59.603020+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.186+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 msgr2=0x7fb66806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.186+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 0x7fb66806e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb674001eb0 tx=0x7fb6740016b0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.186+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 msgr2=0x7fb68c159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.186+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb67c011700 tx=0x7fb67c011bc0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 shutdown_connections 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb66806be60 0x7fb66806e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb68c071e50 0x7fb68c0722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68c13cd70 0x7fb68c13d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 --2- 172.21.15.146:0/116117419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb670004d40 0x7fb68c159a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 >> 172.21.15.146:0/116117419 conn(0x7fb68c06b320 msgr2=0x7fb68c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 shutdown_connections 2024-04-24T23:00:34.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.187+0000 7fb692e00640 1 -- 172.21.15.146:0/116117419 wait complete. 2024-04-24T23:00:34.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:34.208 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:34.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.407+0000 7f2a30600640 1 Processor -- start 2024-04-24T23:00:34.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.407+0000 7f2a30600640 1 -- start start 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a30600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a28141c80 0x7f2a280ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a30600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2a280ce5a0 0x7f2a28071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a30600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a280ced40 con 0x7f2a2813ef30 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a30600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a281423d0 con 0x7f2a28141c80 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a30600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2a28070f80 con 0x7f2a280ce5a0 2024-04-24T23:00:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a2d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a28141c80 0x7f2a280ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a2d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a28141c80 0x7f2a280ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45316/0 (socket says 172.21.15.146:45316) 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.408+0000 7f2a2d200640 1 -- 172.21.15.146:0/2438718332 learned_addr learned my addr 172.21.15.146:0/2438718332 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.409+0000 7f2a2e600640 1 --2- 172.21.15.146:0/2438718332 >> v2:172.21.15.203:3300/0 conn(0x7f2a280ce5a0 0x7f2a28071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.409+0000 7f2a2d200640 1 -- 172.21.15.146:0/2438718332 >> v2:172.21.15.203:3300/0 conn(0x7f2a280ce5a0 msgr2=0x7f2a28071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.409+0000 7f2a2d200640 1 --2- 172.21.15.146:0/2438718332 >> v2:172.21.15.203:3300/0 conn(0x7f2a280ce5a0 0x7f2a28071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.409+0000 7f2a2d200640 1 -- 172.21.15.146:0/2438718332 >> v1:172.21.15.203:6789/0 conn(0x7f2a2813ef30 legacy=0x7f2a28141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.409+0000 7f2a2d200640 1 -- 172.21.15.146:0/2438718332 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a280cf020 con 0x7f2a28141c80 2024-04-24T23:00:34.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.410+0000 7f2a2d200640 1 --2- 172.21.15.146:0/2438718332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a28141c80 0x7f2a280ce060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2a280cf5e0 tx=0x7f2a1402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f60949e7e8a1c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.410+0000 7f2a27e00640 1 -- 172.21.15.146:0/2438718332 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14037070 con 0x7f2a28141c80 2024-04-24T23:00:34.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.410+0000 7f2a27e00640 1 -- 172.21.15.146:0/2438718332 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a14032440 con 0x7f2a28141c80 2024-04-24T23:00:34.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.410+0000 7f2a27e00640 1 -- 172.21.15.146:0/2438718332 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14032810 con 0x7f2a28141c80 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 -- 172.21.15.146:0/2438718332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a28141c80 msgr2=0x7f2a280ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 --2- 172.21.15.146:0/2438718332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a28141c80 0x7f2a280ce060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2a280cf5e0 tx=0x7f2a1402a230 comp rx=0 tx=0).stop 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 -- 172.21.15.146:0/2438718332 shutdown_connections 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 --2- 172.21.15.146:0/2438718332 >> v2:172.21.15.203:3300/0 conn(0x7f2a280ce5a0 0x7f2a28071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 --2- 172.21.15.146:0/2438718332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a28141c80 0x7f2a280ce060 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 -- 172.21.15.146:0/2438718332 >> 172.21.15.146:0/2438718332 conn(0x7f2a280b17b0 msgr2=0x7f2a280b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 -- 172.21.15.146:0/2438718332 shutdown_connections 2024-04-24T23:00:34.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.411+0000 7f2a30600640 1 -- 172.21.15.146:0/2438718332 wait complete. 2024-04-24T23:00:34.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.413+0000 7f2a30600640 1 Processor -- start 2024-04-24T23:00:34.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.413+0000 7f2a30600640 1 -- start start 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a2813ef30 0x7f2a281f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 0x7f2a280b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a280cea30 con 0x7f2a280ce5a0 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28070c10 con 0x7f2a28141c80 2024-04-24T23:00:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a30600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a28071950 con 0x7f2a2813ef30 2024-04-24T23:00:34.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45322/0 (socket says 172.21.15.146:45322) 2024-04-24T23:00:34.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 -- 172.21.15.146:0/988190538 learned_addr learned my addr 172.21.15.146:0/988190538 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:34.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2e600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 0x7f2a280b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2d200640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a2813ef30 0x7f2a281f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 -- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a2813ef30 msgr2=0x7f2a281f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a2813ef30 0x7f2a281f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 -- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 msgr2=0x7f2a280b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 0x7f2a280b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2dc00640 1 -- 172.21.15.146:0/988190538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a281364e0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.414+0000 7f2a2e600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 0x7f2a280b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a2dc00640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c7a0 tx=0x7f2a1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18017070 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18003da0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a180052b0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a281367c0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.415+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a28136100 con 0x7f2a280ce5a0 2024-04-24T23:00:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.416+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2804f5a0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.417+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a18005450 con 0x7f2a280ce5a0 2024-04-24T23:00:34.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.418+0000 7f2a25600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 0x7f2a0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.418+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2a1808a770 con 0x7f2a280ce5a0 2024-04-24T23:00:34.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.419+0000 7f2a2d200640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 0x7f2a0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.420+0000 7f2a2d200640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 0x7f2a0806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a14034000 tx=0x7f2a1402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.422+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a18058de0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.623+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a28072d30 con 0x7f2a280ce5a0 2024-04-24T23:00:34.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.624+0000 7f2a25600640 1 -- 172.21.15.146:0/988190538 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f2a180586e0 con 0x7f2a280ce5a0 2024-04-24T23:00:34.626 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.627+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 msgr2=0x7f2a0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.627+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 0x7f2a0806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a14034000 tx=0x7f2a1402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.627+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 msgr2=0x7f2a28071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.627+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800c7a0 tx=0x7f2a1800cc60 comp rx=0 tx=0).stop 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 shutdown_connections 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a28141c80 0x7f2a280b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a0806be30 0x7f2a0806e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a2813ef30 0x7f2a281f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 --2- 172.21.15.146:0/988190538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a280ce5a0 0x7f2a28071f80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 >> 172.21.15.146:0/988190538 conn(0x7f2a280b17b0 msgr2=0x7f2a2806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 shutdown_connections 2024-04-24T23:00:34.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.628+0000 7f2a30600640 1 -- 172.21.15.146:0/988190538 wait complete. 2024-04-24T23:00:34.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.837+0000 7f9a0e400640 1 Processor -- start 2024-04-24T23:00:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.838+0000 7f9a0e400640 1 -- start start 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0e400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9a08162580 0x7f9a0815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0e400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0815f070 con 0x7f9a08158300 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0e400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a08161aa0 con 0x7f9a080d03d0 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0e400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9a080b2ae0 con 0x7f9a08162580 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0d000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a08158300 0x7f9a080cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50054/0 (socket says 172.21.15.146:50054) 2024-04-24T23:00:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0d000640 1 -- 172.21.15.146:0/2388564557 learned_addr learned my addr 172.21.15.146:0/2388564557 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a0da00640 1 --2- 172.21.15.146:0/2388564557 >> v2:172.21.15.203:3300/0 conn(0x7f9a08162580 0x7f9a0815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.840+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292837528 0 0) 0x7f9a0815f070 con 0x7f9a08158300 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f0003520 con 0x7f9a08158300 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3657000333 0 0) 0x7f99f0003520 con 0x7f9a08158300 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 >> v2:172.21.15.203:3300/0 conn(0x7f9a08162580 msgr2=0x7f9a0815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 --2- 172.21.15.146:0/2388564557 >> v2:172.21.15.203:3300/0 conn(0x7f9a08162580 0x7f9a0815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 >> v1:172.21.15.203:6789/0 conn(0x7f9a080d03d0 legacy=0x7f9a0815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a08161d80 con 0x7f9a08158300 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f99fc001670 con 0x7f9a08158300 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 >> v1:172.21.15.146:6789/0 conn(0x7f9a08158300 legacy=0x7f9a080cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99f0004800 0x7f99f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 0x7f99f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99f000c040 con 0x7f99f00051c0 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99f000c1f0 con 0x7f99f00039b0 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f99f000c3f0 con 0x7f99f0004800 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.841+0000 7f9a0da00640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 0x7f99f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0d000640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0da00640 1 -- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99f0004800 msgr2=0x7f99f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0da00640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99f0004800 0x7f99f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0da00640 1 -- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00039b0 msgr2=0x7f99f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0da00640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0da00640 1 -- 172.21.15.146:0/2388564557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f0003520 con 0x7f99f00051c0 2024-04-24T23:00:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.842+0000 7f9a0d000640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.843+0000 7f9a0da00640 1 -- 172.21.15.146:0/2388564557 reap_dead start 2024-04-24T23:00:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.843+0000 7f9a0da00640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 0x7f99f000b9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009fc0 tx=0x7f99f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810f337c95bfe76a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.843+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00035020 con 0x7f99f00051c0 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.843+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00003b90 con 0x7f99f00051c0 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.843+0000 7f9a07400640 1 -- 172.21.15.146:0/2388564557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00009c10 con 0x7f99f00051c0 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 -- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 msgr2=0x7f99f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 0x7f99f000b9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009fc0 tx=0x7f99f0005830 comp rx=0 tx=0).stop 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 -- 172.21.15.146:0/2388564557 shutdown_connections 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 --2- 172.21.15.146:0/2388564557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99f00051c0 0x7f99f000b9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 -- 172.21.15.146:0/2388564557 >> 172.21.15.146:0/2388564557 conn(0x7f9a0806b560 msgr2=0x7f9a0806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 -- 172.21.15.146:0/2388564557 shutdown_connections 2024-04-24T23:00:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.844+0000 7f9a0e400640 1 -- 172.21.15.146:0/2388564557 wait complete. 2024-04-24T23:00:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.846+0000 7f9a0e400640 1 Processor -- start 2024-04-24T23:00:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.846+0000 7f9a0e400640 1 -- start start 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 0x7f9a080b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a0815e3e0 0x7f9a0815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a080cfcc0 con 0x7f9a0815da70 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a081586e0 con 0x7f99f00051c0 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a0e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a080cfe40 con 0x7f9a0815e3e0 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a07e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a07e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45328/0 (socket says 172.21.15.146:45328) 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.847+0000 7f9a07e00640 1 -- 172.21.15.146:0/3025387517 learned_addr learned my addr 172.21.15.146:0/3025387517 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a0d000640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 0x7f9a080b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a0da00640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a0815e3e0 0x7f9a0815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 -- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a0815e3e0 msgr2=0x7f9a0815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a0815e3e0 0x7f9a0815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 -- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 msgr2=0x7f9a080b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 0x7f9a080b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 -- 172.21.15.146:0/3025387517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0815ed80 con 0x7f9a0815da70 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a0d000640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 0x7f9a080b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.848+0000 7f9a07e00640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c440 tx=0x7f99f400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.849+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40052d0 con 0x7f9a0815da70 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.849+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f4005490 con 0x7f9a0815da70 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.849+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4012870 con 0x7f9a0815da70 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.849+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a080b4460 con 0x7f9a0815da70 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.849+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a080b4700 con 0x7f9a0815da70 2024-04-24T23:00:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.850+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0804f500 con 0x7f9a0815da70 2024-04-24T23:00:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.851+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99f4012a10 con 0x7f9a0815da70 2024-04-24T23:00:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.852+0000 7f9a04c00640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 0x7f99e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.852+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f99f408ae60 con 0x7f9a0815da70 2024-04-24T23:00:34.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.852+0000 7f9a0d000640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 0x7f99e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.853+0000 7f9a0d000640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 0x7f99e806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99fc001920 tx=0x7f99fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:34.856+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a0815ed80 con 0x7f9a0815da70 2024-04-24T23:00:35.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.050+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9a080b4dd0 con 0x7f9a0815da70 2024-04-24T23:00:35.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.051+0000 7f9a04c00640 1 -- 172.21.15.146:0/3025387517 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f99f4059430 con 0x7f9a0815da70 2024-04-24T23:00:35.054 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 msgr2=0x7f99e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 0x7f99e806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99fc001920 tx=0x7f99fc009040 comp rx=0 tx=0).stop 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 msgr2=0x7f9a08160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c440 tx=0x7f99f400c900 comp rx=0 tx=0).stop 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 shutdown_connections 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99e806be30 0x7f99e806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a0815e3e0 0x7f9a0815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a0815da70 0x7f9a08160610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 --2- 172.21.15.146:0/3025387517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99f00051c0 0x7f9a080b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 >> 172.21.15.146:0/3025387517 conn(0x7f9a0806b560 msgr2=0x7f9a080afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 shutdown_connections 2024-04-24T23:00:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.054+0000 7f9a0e400640 1 -- 172.21.15.146:0/3025387517 wait complete. 2024-04-24T23:00:35.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.266+0000 7fa97be00640 1 Processor -- start 2024-04-24T23:00:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.266+0000 7fa97be00640 1 -- start start 2024-04-24T23:00:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.267+0000 7fa97be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa97c158300 0x7fa97c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c15f070 con 0x7fa97c15ea20 2024-04-24T23:00:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c161aa0 con 0x7fa97c162580 2024-04-24T23:00:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa97c15ee50 con 0x7fa97c158300 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa97c15ea20 0x7fa97c06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50066/0 (socket says 172.21.15.146:50066) 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97b400640 1 -- 172.21.15.146:0/2858875141 learned_addr learned my addr 172.21.15.146:0/2858875141 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97aa00640 1 --2- 172.21.15.146:0/2858875141 >> v2:172.21.15.146:3300/0 conn(0x7fa97c158300 0x7fa97c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97aa00640 1 -- 172.21.15.146:0/2858875141 >> v1:172.21.15.203:6789/0 conn(0x7fa97c162580 legacy=0x7fa97c15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.268+0000 7fa97aa00640 1 -- 172.21.15.146:0/2858875141 >> v1:172.21.15.146:6789/0 conn(0x7fa97c15ea20 legacy=0x7fa97c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.269+0000 7fa97aa00640 1 -- 172.21.15.146:0/2858875141 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c161d80 con 0x7fa97c158300 2024-04-24T23:00:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.269+0000 7fa97aa00640 1 --2- 172.21.15.146:0/2858875141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c158300 0x7fa97c0cfcc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097a0 tx=0x7fa96c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2867616794bacb29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa979600640 1 -- 172.21.15.146:0/2858875141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c037070 con 0x7fa97c158300 2024-04-24T23:00:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa979600640 1 -- 172.21.15.146:0/2858875141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c032440 con 0x7fa97c158300 2024-04-24T23:00:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa979600640 1 -- 172.21.15.146:0/2858875141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c032810 con 0x7fa97c158300 2024-04-24T23:00:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa97be00640 1 -- 172.21.15.146:0/2858875141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c158300 msgr2=0x7fa97c0cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa97be00640 1 --2- 172.21.15.146:0/2858875141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c158300 0x7fa97c0cfcc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097a0 tx=0x7fa96c02a270 comp rx=0 tx=0).stop 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa97be00640 1 -- 172.21.15.146:0/2858875141 shutdown_connections 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa97be00640 1 --2- 172.21.15.146:0/2858875141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c158300 0x7fa97c0cfcc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.270+0000 7fa97be00640 1 -- 172.21.15.146:0/2858875141 >> 172.21.15.146:0/2858875141 conn(0x7fa97c06b560 msgr2=0x7fa97c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.271+0000 7fa97be00640 1 -- 172.21.15.146:0/2858875141 shutdown_connections 2024-04-24T23:00:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.271+0000 7fa97be00640 1 -- 172.21.15.146:0/2858875141 wait complete. 2024-04-24T23:00:35.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.272+0000 7fa97be00640 1 Processor -- start 2024-04-24T23:00:35.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.272+0000 7fa97be00640 1 -- start start 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa97c158300 0x7fa97c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 0x7fa97c15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c1586e0 con 0x7fa97c162580 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c0d0200 con 0x7fa97c15ea20 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.273+0000 7fa97be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa97c0d0380 con 0x7fa97c158300 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45336/0 (socket says 172.21.15.146:45336) 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 -- 172.21.15.146:0/3787860686 learned_addr learned my addr 172.21.15.146:0/3787860686 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97a000640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 0x7fa97c15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97aa00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa97c158300 0x7fa97c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 -- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa97c158300 msgr2=0x7fa97c1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa97c158300 0x7fa97c1490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 -- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 msgr2=0x7fa97c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 0x7fa97c15dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 -- 172.21.15.146:0/3787860686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c14b960 con 0x7fa97c162580 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97a000640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 0x7fa97c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa97b400640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa97400cbc0 tx=0x7fa97400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.274+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974017070 con 0x7fa97c162580 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.275+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97400ad40 con 0x7fa97c162580 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.275+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c14bc40 con 0x7fa97c162580 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.275+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974012600 con 0x7fa97c162580 2024-04-24T23:00:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.275+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c14b150 con 0x7fa97c162580 2024-04-24T23:00:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.276+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c148bc0 con 0x7fa97c162580 2024-04-24T23:00:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.277+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa97401a070 con 0x7fa97c162580 2024-04-24T23:00:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.278+0000 7fa972a00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 0x7fa95c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.278+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa97408ada0 con 0x7fa97c162580 2024-04-24T23:00:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.278+0000 7fa97aa00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 0x7fa95c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.279+0000 7fa97aa00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 0x7fa95c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa96c034000 tx=0x7fa96c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.282+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa97c148bc0 con 0x7fa97c162580 2024-04-24T23:00:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.484+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa97c072930 con 0x7fa97c162580 2024-04-24T23:00:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.485+0000 7fa972a00640 1 -- 172.21.15.146:0/3787860686 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa974058e50 con 0x7fa97c162580 2024-04-24T23:00:35.487 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.487+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 msgr2=0x7fa95c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.487+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 0x7fa95c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa96c034000 tx=0x7fa96c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.487+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 msgr2=0x7fa97c1f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.487+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa97400cbc0 tx=0x7fa97400a430 comp rx=0 tx=0).stop 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 shutdown_connections 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c162580 0x7fa97c1f50e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa97c15ea20 0x7fa97c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa95c06be30 0x7fa95c06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 --2- 172.21.15.146:0/3787860686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa97c158300 0x7fa97c1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 >> 172.21.15.146:0/3787860686 conn(0x7fa97c06b560 msgr2=0x7fa97c0709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 shutdown_connections 2024-04-24T23:00:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.488+0000 7fa97be00640 1 -- 172.21.15.146:0/3787860686 wait complete. 2024-04-24T23:00:35.508 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.709+0000 7fe041000640 1 Processor -- start 2024-04-24T23:00:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.710+0000 7fe041000640 1 -- start start 2024-04-24T23:00:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.711+0000 7fe041000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe03c06dd80 0x7fe03c06e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.711+0000 7fe041000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe03c06eb60 0x7fe03c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.711+0000 7fe041000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c15e3f0 con 0x7fe03c15e010 2024-04-24T23:00:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.711+0000 7fe041000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c06ef90 con 0x7fe03c06dd80 2024-04-24T23:00:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.711+0000 7fe041000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c06e230 con 0x7fe03c06eb60 2024-04-24T23:00:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe039e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe03c15e010 0x7fe03c071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50068/0 (socket says 172.21.15.146:50068) 2024-04-24T23:00:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe039e00640 1 -- 172.21.15.146:0/2443139072 learned_addr learned my addr 172.21.15.146:0/2443139072 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe031400640 1 --2- 172.21.15.146:0/2443139072 >> v2:172.21.15.146:3300/0 conn(0x7fe03c06dd80 0x7fe03c06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe03a800640 1 --2- 172.21.15.146:0/2443139072 >> v2:172.21.15.203:3300/0 conn(0x7fe03c06eb60 0x7fe03c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe031400640 1 -- 172.21.15.146:0/2443139072 >> v2:172.21.15.203:3300/0 conn(0x7fe03c06eb60 msgr2=0x7fe03c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe031400640 1 --2- 172.21.15.146:0/2443139072 >> v2:172.21.15.203:3300/0 conn(0x7fe03c06eb60 0x7fe03c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe031400640 1 -- 172.21.15.146:0/2443139072 >> v1:172.21.15.146:6789/0 conn(0x7fe03c15e010 legacy=0x7fe03c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe039400640 1 -- 172.21.15.146:0/2443139072 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990278912 0 0) 0x7fe03c15e3f0 con 0x7fe03c15e010 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.712+0000 7fe031400640 1 -- 172.21.15.146:0/2443139072 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c06cd20 con 0x7fe03c06dd80 2024-04-24T23:00:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.713+0000 7fe031400640 1 --2- 172.21.15.146:0/2443139072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c06e620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe03c070ba0 tx=0x7fe02402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb98e96cf9a90e20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.714+0000 7fe039400640 1 -- 172.21.15.146:0/2443139072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024037070 con 0x7fe03c06dd80 2024-04-24T23:00:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.714+0000 7fe039400640 1 -- 172.21.15.146:0/2443139072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024032440 con 0x7fe03c06dd80 2024-04-24T23:00:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.714+0000 7fe039400640 1 -- 172.21.15.146:0/2443139072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024032810 con 0x7fe03c06dd80 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.714+0000 7fe041000640 1 -- 172.21.15.146:0/2443139072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 msgr2=0x7fe03c06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.714+0000 7fe041000640 1 --2- 172.21.15.146:0/2443139072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c06e620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe03c070ba0 tx=0x7fe02402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 -- 172.21.15.146:0/2443139072 shutdown_connections 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 --2- 172.21.15.146:0/2443139072 >> v2:172.21.15.203:3300/0 conn(0x7fe03c06eb60 0x7fe03c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 --2- 172.21.15.146:0/2443139072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c06e620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 -- 172.21.15.146:0/2443139072 >> 172.21.15.146:0/2443139072 conn(0x7fe03c0b17b0 msgr2=0x7fe03c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 -- 172.21.15.146:0/2443139072 shutdown_connections 2024-04-24T23:00:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.715+0000 7fe041000640 1 -- 172.21.15.146:0/2443139072 wait complete. 2024-04-24T23:00:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.716+0000 7fe041000640 1 Processor -- start 2024-04-24T23:00:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 -- start start 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe03c06eb60 0x7fe03c143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 0x7fe03c0cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c06cfc0 con 0x7fe03c06dd80 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c071fe0 con 0x7fe03c15e010 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.717+0000 7fe041000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c06d2a0 con 0x7fe03c06eb60 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45356/0 (socket says 172.21.15.146:45356) 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 -- 172.21.15.146:0/3004369391 learned_addr learned my addr 172.21.15.146:0/3004369391 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe03a800640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 0x7fe03c0cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe031400640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe03c06eb60 0x7fe03c143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 -- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe03c06eb60 msgr2=0x7fe03c143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe03c06eb60 0x7fe03c143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 -- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 msgr2=0x7fe03c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 0x7fe03c0cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 -- 172.21.15.146:0/3004369391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c158140 con 0x7fe03c06dd80 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe03a800640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 0x7fe03c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.718+0000 7fe039e00640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c430 tx=0x7fe02c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.719+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0074e0 con 0x7fe03c06dd80 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.719+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c0047e0 con 0x7fe03c06dd80 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.719+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c004bd0 con 0x7fe03c06dd80 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.719+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c158400 con 0x7fe03c06dd80 2024-04-24T23:00:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.719+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1589c0 con 0x7fe03c06dd80 2024-04-24T23:00:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.720+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c04f5a0 con 0x7fe03c06dd80 2024-04-24T23:00:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.721+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe02c011070 con 0x7fe03c06dd80 2024-04-24T23:00:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.722+0000 7fe032a00640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.722+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe02c08ae10 con 0x7fe03c06dd80 2024-04-24T23:00:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.723+0000 7fe031400640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.724+0000 7fe031400640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe024034000 tx=0x7fe02402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.726+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe02c08e030 con 0x7fe03c06dd80 2024-04-24T23:00:35.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.925+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe03c073eb0 con 0x7fe03c06dd80 2024-04-24T23:00:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.926+0000 7fe032a00640 1 -- 172.21.15.146:0/3004369391 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe02c00e280 con 0x7fe03c06dd80 2024-04-24T23:00:35.928 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 msgr2=0x7fe01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe024034000 tx=0x7fe02402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 msgr2=0x7fe03c156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c430 tx=0x7fe02c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 shutdown_connections 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe03c15e010 0x7fe03c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe03c06eb60 0x7fe03c143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 --2- 172.21.15.146:0/3004369391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe03c06dd80 0x7fe03c156630 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 >> 172.21.15.146:0/3004369391 conn(0x7fe03c0b17b0 msgr2=0x7fe03c0ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 shutdown_connections 2024-04-24T23:00:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:35.929+0000 7fe041000640 1 -- 172.21.15.146:0/3004369391 wait complete. 2024-04-24T23:00:35.952 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.146+0000 7f787d200640 1 Processor -- start 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.147+0000 7f787d200640 1 -- start start 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f787d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f787815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f787d200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78780cdf70 con 0x7f78780b2a20 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f787d200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787815d360 con 0x7f78780d03a0 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f787d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7878145a20 con 0x7f7878145640 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f786d400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f78780b2a20 0x7f78780cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50080/0 (socket says 172.21.15.146:50080) 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.148+0000 7f786d400640 1 -- 172.21.15.146:0/3992631881 learned_addr learned my addr 172.21.15.146:0/3992631881 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875e00640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f787815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463006479 0 0) 0x7f78780cdf70 con 0x7f78780b2a20 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f785c003520 con 0x7f78780b2a20 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 766180266 0 0) 0x7f785c003520 con 0x7f78780b2a20 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 msgr2=0x7f787815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f787815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 >> v1:172.21.15.203:6789/0 conn(0x7f78780d03a0 legacy=0x7f78780ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787806d140 con 0x7f78780b2a20 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7860001670 con 0x7f78780b2a20 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 >> v1:172.21.15.146:6789/0 conn(0x7f78780b2a20 legacy=0x7f78780cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.149+0000 7f7875400640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785c0039e0 0x7f785c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875400640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f785c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875400640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c004d40 0x7f785c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7878145a20 con 0x7f785c0039e0 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f785c00ba70 con 0x7f785c004d40 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f785c00bc70 con 0x7f7878145640 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785c0039e0 0x7f785c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f786d400640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f785c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 -- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 msgr2=0x7f785c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7876800640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c004d40 0x7f785c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7878145640 0x7f785c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 -- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c004d40 msgr2=0x7f785c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c004d40 0x7f785c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7875e00640 1 -- 172.21.15.146:0/3992631881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c003520 con 0x7f785c0039e0 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.150+0000 7f7876800640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c004d40 0x7f785c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.151+0000 7f7875e00640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785c0039e0 0x7f785c003e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7868009a90 tx=0x7f785c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d58c2c10751c09a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.151+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868036070 con 0x7f785c0039e0 2024-04-24T23:00:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7868031400 con 0x7f785c0039e0 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f7875400640 1 -- 172.21.15.146:0/3992631881 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868009690 con 0x7f785c0039e0 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 -- 172.21.15.146:0/3992631881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785c0039e0 msgr2=0x7f785c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 --2- 172.21.15.146:0/3992631881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785c0039e0 0x7f785c003e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7868009a90 tx=0x7f785c005830 comp rx=0 tx=0).stop 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f7876800640 1 -- 172.21.15.146:0/3992631881 reap_dead start 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 -- 172.21.15.146:0/3992631881 shutdown_connections 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 -- 172.21.15.146:0/3992631881 >> 172.21.15.146:0/3992631881 conn(0x7f787806b320 msgr2=0x7f787806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 -- 172.21.15.146:0/3992631881 shutdown_connections 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.152+0000 7f787d200640 1 -- 172.21.15.146:0/3992631881 wait complete. 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.154+0000 7f787d200640 1 Processor -- start 2024-04-24T23:00:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.154+0000 7f787d200640 1 -- start start 2024-04-24T23:00:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c0039e0 0x7f78781f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 0x7f78781f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f787806d9e0 con 0x7f7878159610 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f787806d700 con 0x7f785c0039e0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f787d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f787806cbc0 con 0x7f787815f0f0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f786d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.155+0000 7f786d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45376/0 (socket says 172.21.15.146:45376) 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 -- 172.21.15.146:0/3912065804 learned_addr learned my addr 172.21.15.146:0/3912065804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f7875e00640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c0039e0 0x7f78781f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f7876800640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 0x7f78781f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 -- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 msgr2=0x7f78781f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 0x7f78781f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 -- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c0039e0 msgr2=0x7f78781f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c0039e0 0x7f78781f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 -- 172.21.15.146:0/3912065804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78781f5140 con 0x7f7878159610 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f7876800640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 0x7f78781f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786d400640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f786000d860 tx=0x7f786000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860019070 con 0x7f7878159610 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600074e0 con 0x7f7878159610 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.156+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787815d910 con 0x7f7878159610 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.157+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600049e0 con 0x7f7878159610 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.157+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787815ded0 con 0x7f7878159610 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.158+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7878068190 con 0x7f7878159610 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.159+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f786001c070 con 0x7f7878159610 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.160+0000 7f786ea00640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.160+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f786008ad20 con 0x7f7878159610 2024-04-24T23:00:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.160+0000 7f7875e00640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.161+0000 7f7875e00640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 0x7f785406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7868033000 tx=0x7f7868008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.164+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78600592f0 con 0x7f7878159610 2024-04-24T23:00:36.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.407+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f787815f4d0 con 0x7f7878159610 2024-04-24T23:00:36.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.408+0000 7f786ea00640 1 -- 172.21.15.146:0/3912065804 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f7860058bf0 con 0x7f7878159610 2024-04-24T23:00:36.410 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:36.410 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 msgr2=0x7f785406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 0x7f785406e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7868033000 tx=0x7f7868008030 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 msgr2=0x7f787815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f786000d860 tx=0x7f786000dd20 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 shutdown_connections 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f787815f0f0 0x7f78781f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7878159610 0x7f787815ebb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 --2- 172.21.15.146:0/3912065804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f785c0039e0 0x7f78781f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 >> 172.21.15.146:0/3912065804 conn(0x7f787806b320 msgr2=0x7f78780b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.411+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 shutdown_connections 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.412+0000 7f787d200640 1 -- 172.21.15.146:0/3912065804 wait complete. 2024-04-24T23:00:36.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:36.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.616+0000 7ff6fac00640 1 Processor -- start 2024-04-24T23:00:36.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.616+0000 7ff6fac00640 1 -- start start 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.617+0000 7ff6fac00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f415a980 0x7ff6f406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fac00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff6f4071dd0 0x7ff6f40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 0x7ff6f40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fac00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f4072230 con 0x7ff6f415a980 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fac00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f40aede0 con 0x7ff6f4071dd0 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f40ccb10 con 0x7ff6f40d0070 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f415a980 0x7ff6f406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f415a980 0x7ff6f406d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45384/0 (socket says 172.21.15.146:45384) 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 -- 172.21.15.146:0/2046454806 learned_addr learned my addr 172.21.15.146:0/2046454806 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f8e00640 1 --2- 172.21.15.146:0/2046454806 >> v2:172.21.15.203:3300/0 conn(0x7ff6f4071dd0 0x7ff6f40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fa200640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 0x7ff6f40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 -- 172.21.15.146:0/2046454806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 msgr2=0x7ff6f40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 0x7ff6f40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 -- 172.21.15.146:0/2046454806 >> v2:172.21.15.203:3300/0 conn(0x7ff6f4071dd0 msgr2=0x7ff6f40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 --2- 172.21.15.146:0/2046454806 >> v2:172.21.15.203:3300/0 conn(0x7ff6f4071dd0 0x7ff6f40cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6f9800640 1 -- 172.21.15.146:0/2046454806 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f406ddc0 con 0x7ff6f415a980 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.618+0000 7ff6fa200640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 0x7ff6f40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.619+0000 7ff6f9800640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f406d770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b4d30 tx=0x7ff6e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947a7de299d5aed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6f3e00640 1 -- 172.21.15.146:0/2046454806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8037070 con 0x7ff6f415a980 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6f3e00640 1 -- 172.21.15.146:0/2046454806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e8032440 con 0x7ff6f415a980 2024-04-24T23:00:36.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6f3e00640 1 -- 172.21.15.146:0/2046454806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8032810 con 0x7ff6f415a980 2024-04-24T23:00:36.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 -- 172.21.15.146:0/2046454806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 msgr2=0x7ff6f406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f406d770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b4d30 tx=0x7ff6e802a140 comp rx=0 tx=0).stop 2024-04-24T23:00:36.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 -- 172.21.15.146:0/2046454806 shutdown_connections 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f40d0070 0x7ff6f40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 --2- 172.21.15.146:0/2046454806 >> v2:172.21.15.203:3300/0 conn(0x7ff6f4071dd0 0x7ff6f40cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 --2- 172.21.15.146:0/2046454806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f406d770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.620+0000 7ff6fac00640 1 -- 172.21.15.146:0/2046454806 >> 172.21.15.146:0/2046454806 conn(0x7ff6f406b320 msgr2=0x7ff6f406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.621+0000 7ff6fac00640 1 -- 172.21.15.146:0/2046454806 shutdown_connections 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.621+0000 7ff6fac00640 1 -- 172.21.15.146:0/2046454806 wait complete. 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.622+0000 7ff6fac00640 1 Processor -- start 2024-04-24T23:00:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.623+0000 7ff6fac00640 1 -- start start 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 0x7ff6f4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f40d0070 0x7ff6f415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f406e660 con 0x7ff6f415a980 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f406e380 con 0x7ff6f40d0070 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f415ad60 con 0x7ff6f4071dd0 2024-04-24T23:00:36.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45400/0 (socket says 172.21.15.146:45400) 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6fa200640 1 -- 172.21.15.146:0/4044087503 learned_addr learned my addr 172.21.15.146:0/4044087503 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.624+0000 7ff6f9800640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 0x7ff6f4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6f8e00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f40d0070 0x7ff6f415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 -- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 msgr2=0x7ff6f4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 0x7ff6f4154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 -- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f40d0070 msgr2=0x7ff6f415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f40d0070 0x7ff6f415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 -- 172.21.15.146:0/4044087503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f415de70 con 0x7ff6f415a980 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6f9800640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 0x7ff6f4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:36.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fa200640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00cef0 tx=0x7ff6ec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec01a070 con 0x7ff6f415a980 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00d860 con 0x7ff6f415a980 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f4154bc0 con 0x7ff6f415a980 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.625+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00dc50 con 0x7ff6f415a980 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.626+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f415d0b0 con 0x7ff6f415a980 2024-04-24T23:00:36.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.626+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f404f500 con 0x7ff6f415a980 2024-04-24T23:00:36.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.628+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6ec01d070 con 0x7ff6f415a980 2024-04-24T23:00:36.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.629+0000 7ff6f1600640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 0x7ff6d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.629+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7ff6ec08b990 con 0x7ff6f415a980 2024-04-24T23:00:36.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.630+0000 7ff6f9800640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 0x7ff6d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.631+0000 7ff6f9800640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 0x7ff6d406e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8034000 tx=0x7ff6e802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.634+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6ec05a080 con 0x7ff6f415a980 2024-04-24T23:00:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.818+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6f40b1090 con 0x7ff6f415a980 2024-04-24T23:00:36.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.820+0000 7ff6f1600640 1 -- 172.21.15.146:0/4044087503 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18638 (secure 0 0 0) 0x7ff6ec059980 con 0x7ff6f415a980 2024-04-24T23:00:36.822 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:36.823 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:36.368005+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 msgr2=0x7ff6d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 0x7ff6d406e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8034000 tx=0x7ff6e802e000 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 msgr2=0x7ff6f41560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00cef0 tx=0x7ff6ec00a710 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 shutdown_connections 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f415a980 0x7ff6f41560d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f40d0070 0x7ff6f415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6d406be60 0x7ff6d406e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 --2- 172.21.15.146:0/4044087503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f4071dd0 0x7ff6f4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 >> 172.21.15.146:0/4044087503 conn(0x7ff6f406b320 msgr2=0x7ff6f406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 shutdown_connections 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:36.823+0000 7ff6fac00640 1 -- 172.21.15.146:0/4044087503 wait complete. 2024-04-24T23:00:36.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.028+0000 7fe46da00640 1 Processor -- start 2024-04-24T23:00:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.028+0000 7fe46da00640 1 -- start start 2024-04-24T23:00:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe46da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 0x7fe4680cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe46da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4680709d0 0x7fe46815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe46da00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe468070f90 con 0x7fe4680cfb30 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe46da00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe4680b4310 con 0x7fe4680709d0 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe46da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4681565a0 con 0x7fe4681561c0 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4680709d0 0x7fe46815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4680709d0 0x7fe46815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45412/0 (socket says 172.21.15.146:45412) 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 -- 172.21.15.146:0/2590410748 learned_addr learned my addr 172.21.15.146:0/2590410748 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467e00640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 0x7fe4680cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 -- 172.21.15.146:0/2590410748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 msgr2=0x7fe4680cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 0x7fe4680cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.030+0000 7fe467400640 1 -- 172.21.15.146:0/2590410748 >> v1:172.21.15.203:6789/0 conn(0x7fe4680cfb30 legacy=0x7fe4680b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.031+0000 7fe467400640 1 -- 172.21.15.146:0/2590410748 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe468071270 con 0x7fe4680709d0 2024-04-24T23:00:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.031+0000 7fe467e00640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 0x7fe4680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.031+0000 7fe467400640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680709d0 0x7fe46815cb80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe454009870 tx=0x7fe45402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebdece87323d2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe466a00640 1 -- 172.21.15.146:0/2590410748 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454037070 con 0x7fe4680709d0 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe466a00640 1 -- 172.21.15.146:0/2590410748 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45402ae10 con 0x7fe4680709d0 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe466a00640 1 -- 172.21.15.146:0/2590410748 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454032660 con 0x7fe4680709d0 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 -- 172.21.15.146:0/2590410748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680709d0 msgr2=0x7fe46815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680709d0 0x7fe46815cb80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe454009870 tx=0x7fe45402a100 comp rx=0 tx=0).stop 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 -- 172.21.15.146:0/2590410748 shutdown_connections 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680709d0 0x7fe46815cb80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 --2- 172.21.15.146:0/2590410748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4681561c0 0x7fe4680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.032+0000 7fe46da00640 1 -- 172.21.15.146:0/2590410748 >> 172.21.15.146:0/2590410748 conn(0x7fe46806b320 msgr2=0x7fe46806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.033+0000 7fe46da00640 1 -- 172.21.15.146:0/2590410748 shutdown_connections 2024-04-24T23:00:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.033+0000 7fe46da00640 1 -- 172.21.15.146:0/2590410748 wait complete. 2024-04-24T23:00:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.034+0000 7fe46da00640 1 Processor -- start 2024-04-24T23:00:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.034+0000 7fe46da00640 1 -- start start 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4680709d0 0x7fe468156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4681561c0 0x7fe4681f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4680cffa0 con 0x7fe4680cfb30 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe468071830 con 0x7fe4681561c0 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.035+0000 7fe46da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4680d0120 con 0x7fe4680709d0 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45414/0 (socket says 172.21.15.146:45414) 2024-04-24T23:00:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 -- 172.21.15.146:0/652757305 learned_addr learned my addr 172.21.15.146:0/652757305 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467e00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4680709d0 0x7fe468156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 -- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4680709d0 msgr2=0x7fe468156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4680709d0 0x7fe468156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 -- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4681561c0 msgr2=0x7fe4681f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4681561c0 0x7fe4681f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 -- 172.21.15.146:0/652757305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4680af0c0 con 0x7fe4680cfb30 2024-04-24T23:00:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe467400640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe454009870 tx=0x7fe4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.036+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454041070 con 0x7fe4680cfb30 2024-04-24T23:00:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.037+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45403c680 con 0x7fe4680cfb30 2024-04-24T23:00:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.037+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4680af3a0 con 0x7fe4680cfb30 2024-04-24T23:00:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.037+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454037040 con 0x7fe4680cfb30 2024-04-24T23:00:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.037+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4680af960 con 0x7fe4680cfb30 2024-04-24T23:00:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.038+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46804f500 con 0x7fe4680cfb30 2024-04-24T23:00:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.039+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe454044070 con 0x7fe4680cfb30 2024-04-24T23:00:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.040+0000 7fe45fe00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 0x7fe44806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.040+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fe4540abc20 con 0x7fe4680cfb30 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.041+0000 7fe467e00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 0x7fe44806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.042+0000 7fe467e00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 0x7fe44806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe45800b840 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.045+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe45407a370 con 0x7fe4680cfb30 2024-04-24T23:00:37.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.281+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4680afdf0 con 0x7fe4680cfb30 2024-04-24T23:00:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.282+0000 7fe45fe00640 1 -- 172.21.15.146:0/652757305 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fe454080070 con 0x7fe4680cfb30 2024-04-24T23:00:37.285 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:37.285 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:00:37.285 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:00:37.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 msgr2=0x7fe44806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 0x7fe44806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe45800b840 tx=0x7fe458008040 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 msgr2=0x7fe4681f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe454009870 tx=0x7fe4540046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 shutdown_connections 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4681561c0 0x7fe4681f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4680cfb30 0x7fe4681f4ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe44806be30 0x7fe44806e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 --2- 172.21.15.146:0/652757305 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4680709d0 0x7fe468156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 >> 172.21.15.146:0/652757305 conn(0x7fe46806b320 msgr2=0x7fe46815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 shutdown_connections 2024-04-24T23:00:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.285+0000 7fe46da00640 1 -- 172.21.15.146:0/652757305 wait complete. 2024-04-24T23:00:37.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T22:59:54.240496+0000', 'modified': '2024-04-24T23:00:22.744636+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/554633282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 554633282}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 554633282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-04-24T23:00:37.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:00:37.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-24T23:00:37.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.916+0000 7fb139800640 1 Processor -- start 2024-04-24T23:00:37.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.916+0000 7fb139800640 1 -- start start 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb139800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 0x7fb1340c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb139800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb13406dd10 0x7fb13406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb139800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340c71a0 con 0x7fb13406b520 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb139800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb1340cbc10 con 0x7fb13406dd10 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb139800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340c5ea0 con 0x7fb13406b140 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.918+0000 7fb133400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb13406dd10 0x7fb13406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb13406dd10 0x7fb13406e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39800/0 (socket says 172.21.15.146:39800) 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 -- 172.21.15.146:0/3302110313 learned_addr learned my addr 172.21.15.146:0/3302110313 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb132a00640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 0x7fb1340c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 -- 172.21.15.146:0/3302110313 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 msgr2=0x7fb1340c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 0x7fb1340c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 -- 172.21.15.146:0/3302110313 >> v1:172.21.15.203:6789/0 conn(0x7fb13406b520 legacy=0x7fb1340cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb133400640 1 -- 172.21.15.146:0/3302110313 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340c6180 con 0x7fb13406dd10 2024-04-24T23:00:37.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.919+0000 7fb132a00640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 0x7fb1340c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.920+0000 7fb133400640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406dd10 0x7fb13406e1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009e50 tx=0x7fb12c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec73be4293d4cb66 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.920+0000 7fb131600640 1 -- 172.21.15.146:0/3302110313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c036070 con 0x7fb13406dd10 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.920+0000 7fb131600640 1 -- 172.21.15.146:0/3302110313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c031600 con 0x7fb13406dd10 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.920+0000 7fb131600640 1 -- 172.21.15.146:0/3302110313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0319d0 con 0x7fb13406dd10 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 -- 172.21.15.146:0/3302110313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406dd10 msgr2=0x7fb13406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406dd10 0x7fb13406e1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009e50 tx=0x7fb12c02a6d0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 -- 172.21.15.146:0/3302110313 shutdown_connections 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406dd10 0x7fb13406e1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 --2- 172.21.15.146:0/3302110313 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406b140 0x7fb1340c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 -- 172.21.15.146:0/3302110313 >> 172.21.15.146:0/3302110313 conn(0x7fb1340d0b70 msgr2=0x7fb1340d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 -- 172.21.15.146:0/3302110313 shutdown_connections 2024-04-24T23:00:37.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.921+0000 7fb139800640 1 -- 172.21.15.146:0/3302110313 wait complete. 2024-04-24T23:00:37.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.923+0000 7fb139800640 1 Processor -- start 2024-04-24T23:00:37.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.923+0000 7fb139800640 1 -- start start 2024-04-24T23:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb13406b140 0x7fb1340b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406dd10 0x7fb13415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1340cb8d0 con 0x7fb13406b520 2024-04-24T23:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1340c6740 con 0x7fb13406b140 2024-04-24T23:00:37.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb139800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb13406b980 con 0x7fb13406dd10 2024-04-24T23:00:37.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb132000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb132000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39812/0 (socket says 172.21.15.146:39812) 2024-04-24T23:00:37.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.924+0000 7fb132000640 1 -- 172.21.15.146:0/3578241363 learned_addr learned my addr 172.21.15.146:0/3578241363 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 -- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406dd10 msgr2=0x7fb13415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132a00640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb13406b140 0x7fb1340b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb133400640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406dd10 0x7fb13415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406dd10 0x7fb13415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 -- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb13406b140 msgr2=0x7fb1340b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb13406b140 0x7fb1340b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 -- 172.21.15.146:0/3578241363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340b51d0 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb132000640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c430 tx=0x7fb12000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb12aa00640 1 -- 172.21.15.146:0/3578241363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120011790 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb12aa00640 1 -- 172.21.15.146:0/3578241363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb120017070 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb12aa00640 1 -- 172.21.15.146:0/3578241363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120011bb0 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.925+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1340b54b0 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.926+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1340b5a70 con 0x7fb13406b520 2024-04-24T23:00:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.928+0000 7fb12aa00640 1 -- 172.21.15.146:0/3578241363 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb12001c460 con 0x7fb13406b520 2024-04-24T23:00:37.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.929+0000 7fb12aa00640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 0x7fb11406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.929+0000 7fb12aa00640 1 -- 172.21.15.146:0/3578241363 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb12008b130 con 0x7fb13406b520 2024-04-24T23:00:37.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.929+0000 7fb132a00640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 0x7fb11406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.930+0000 7fb13c774740 1 Processor -- start 2024-04-24T23:00:37.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.930+0000 7fb13c774740 1 -- start start 2024-04-24T23:00:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.930+0000 7fb132a00640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 0x7fb11406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb12400b840 tx=0x7fb124008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 0x55c61b869120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b893320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c61b768ed0 con 0x55c61b893860 2024-04-24T23:00:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c61b7cbdf0 con 0x55c61b890ac0 2024-04-24T23:00:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c61b7748d0 con 0x55c61b890ea0 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb133400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb133400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39818/0 (socket says 172.21.15.146:39818) 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb133400640 1 -- 172.21.15.146:0/1653723411 learned_addr learned my addr 172.21.15.146:0/1653723411 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb132000640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b893320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.931+0000 7fb132a00640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 0x55c61b869120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 -- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 msgr2=0x55c61b893320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b893320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 -- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 msgr2=0x55c61b869120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 0x55c61b869120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 -- 172.21.15.146:0/1653723411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61b4e02d0 con 0x55c61b893860 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb132a00640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 0x55c61b869120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb133400640 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009f70 tx=0x7fb12c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ebf370ffc88e58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb11f400640 1 -- 172.21.15.146:0/1653723411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c036040 con 0x55c61b893860 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb11f400640 1 -- 172.21.15.146:0/1653723411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c03c640 con 0x55c61b893860 2024-04-24T23:00:37.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.932+0000 7fb11f400640 1 -- 172.21.15.146:0/1653723411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c03ca30 con 0x55c61b893860 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 -- 172.21.15.146:0/1653723411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 msgr2=0x55c61b8670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009f70 tx=0x7fb12c02e000 comp rx=0 tx=0).stop 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 -- 172.21.15.146:0/1653723411 shutdown_connections 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b893860 0x55c61b8670c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b893320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 --2- 172.21.15.146:0/1653723411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ac0 0x55c61b869120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 -- 172.21.15.146:0/1653723411 >> 172.21.15.146:0/1653723411 conn(0x55c61b865b20 msgr2=0x55c61b8ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 -- 172.21.15.146:0/1653723411 shutdown_connections 2024-04-24T23:00:37.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.933+0000 7fb13c774740 1 -- 172.21.15.146:0/1653723411 wait complete. 2024-04-24T23:00:37.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.934+0000 7fb13c774740 1 -- start start 2024-04-24T23:00:37.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.934+0000 7fb13c774740 1 Processor -- start 2024-04-24T23:00:37.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c61b787d20 con 0x55c61b88f550 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c61b7c7db0 con 0x55c61b893860 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c61b895170 con 0x55c61b890ea0 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb13c774740 10 client.0 _ll_register_callbacks cb 0x55c61b7c2f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb133400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb133400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39824/0 (socket says 172.21.15.146:39824) 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.935+0000 7fb133400640 1 -- 172.21.15.146:0/2365059544 learned_addr learned my addr 172.21.15.146:0/2365059544 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb132000640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb132a00640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 -- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 msgr2=0x55c61b8afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 -- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 msgr2=0x55c61b8affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 -- 172.21.15.146:0/2365059544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61b5aa6b0 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb132a00640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb133400640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb12c003e60 tx=0x7fb12c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0824953313273d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb113e00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c036070 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb12c03ca00 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.936+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb12c03c640 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb12c009af0 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 10 client.4803 fetch_fsmap learned FSMap version 8 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c61b8974e0 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c03c640 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fb12c008050 con 0x55c61b88f550 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 10 client.4803 fetch_fsmap finished waiting for FSMap version 8 2024-04-24T23:00:37.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:00:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 20 client.4803 populate_metadata read hostname 'smithi146' 2024-04-24T23:00:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b896da0 0x55c61b8d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 4 client.4803 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:00:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.937+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 --> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c61b7d9330 con 0x55c61b896da0 2024-04-24T23:00:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.938+0000 7fb132a00640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b896da0 0x55c61b8d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.939+0000 7fb132a00640 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b896da0 0x55c61b8d16a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b7ef3214946c80 server_cookie=af28b5c8f6cd27f6 in_seq=0 out_seq=0 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.939+0000 7fb113e00640 10 client.4803 ms_handle_connect on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb113e00640 1 -- 172.21.15.146:0/2365059544 <== mds.0 v2:172.21.15.203:6835/554633282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c61b7d9330 con 0x55c61b896da0 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb113e00640 10 client.4803 handle_command_reply: tid=0 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 client.4803 shutdown 2024-04-24T23:00:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 msgr2=0x55c61b8ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb12c003e60 tx=0x7fb12c02c000 comp rx=0 tx=0).stop 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 shutdown_connections 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b896da0 0x55c61b8d16a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8ad470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 --2- 172.21.15.146:0/2365059544 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb113e00640 0 client.4803 ms_handle_reset on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 >> 172.21.15.146:0/2365059544 conn(0x55c61b890ac0 msgr2=0x55c61b8670c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 shutdown_connections 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 1 -- 172.21.15.146:0/2365059544 wait complete. 2024-04-24T23:00:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.941+0000 7fb13c774740 20 client.4803 trim_cache size 0 max 16384 2024-04-24T23:00:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.961+0000 7fb13c774740 1 Processor -- start 2024-04-24T23:00:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.961+0000 7fb13c774740 1 -- start start 2024-04-24T23:00:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8aa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341fc7c0 con 0x55c61b88f550 2024-04-24T23:00:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341353d0 con 0x55c61b893860 2024-04-24T23:00:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340d0690 con 0x55c61b890ea0 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39832/0 (socket says 172.21.15.146:39832) 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb132a00640 1 -- 172.21.15.146:0/2670068905 learned_addr learned my addr 172.21.15.146:0/2670068905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb132000640 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.962+0000 7fb133400640 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 -- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 msgr2=0x55c61b8b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 -- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 msgr2=0x55c61b8aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 -- 172.21.15.146:0/2670068905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61b867fb0 con 0x55c61b88f550 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb132a00640 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c61b8968f0 tx=0x7fb124013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dbb5d4d38fef4a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb11ea00640 1 -- 172.21.15.146:0/2670068905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12402b070 con 0x55c61b88f550 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb11ea00640 1 -- 172.21.15.146:0/2670068905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124012bd0 con 0x55c61b88f550 2024-04-24T23:00:37.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.963+0000 7fb11ea00640 1 -- 172.21.15.146:0/2670068905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240251d0 con 0x55c61b88f550 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 -- 172.21.15.146:0/2670068905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 msgr2=0x55c61b8b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c61b8968f0 tx=0x7fb124013000 comp rx=0 tx=0).stop 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 -- 172.21.15.146:0/2670068905 shutdown_connections 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b893860 0x55c61b8aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b890ea0 0x55c61b8b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 --2- 172.21.15.146:0/2670068905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b8b0b70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 -- 172.21.15.146:0/2670068905 >> 172.21.15.146:0/2670068905 conn(0x55c61b890ac0 msgr2=0x55c61b8946d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 -- 172.21.15.146:0/2670068905 shutdown_connections 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.964+0000 7fb13c774740 1 -- 172.21.15.146:0/2670068905 wait complete. 2024-04-24T23:00:37.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.965+0000 7fb13c774740 1 -- start start 2024-04-24T23:00:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.965+0000 7fb13c774740 1 Processor -- start 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 0x55c61b8c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b893860 0x55c61b8689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c61b88fc50 con 0x55c61b88f550 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c61b894de0 con 0x55c61b890ea0 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c61b8ae110 con 0x55c61b893860 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb13c774740 10 client.0 _ll_register_callbacks cb 0x7fb12c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39834/0 (socket says 172.21.15.146:39834) 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.966+0000 7fb132a00640 1 -- 172.21.15.146:0/765676919 learned_addr learned my addr 172.21.15.146:0/765676919 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132000640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 0x55c61b8c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 -- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b893860 msgr2=0x55c61b8689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb133400640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b893860 0x55c61b8689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b893860 0x55c61b8689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 -- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 msgr2=0x55c61b8c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 0x55c61b8c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 -- 172.21.15.146:0/765676919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61b87c9d0 con 0x55c61b88f550 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132000640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 0x55c61b8c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb132a00640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb12400dab0 tx=0x7fb124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845ace69b9e1fa4d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb113e00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12402b070 con 0x55c61b88f550 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb1240255e0 con 0x55c61b88f550 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.967+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb124012bd0 con 0x55c61b88f550 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb124036050 con 0x55c61b88f550 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 10 client.4809 fetch_fsmap learned FSMap version 8 2024-04-24T23:00:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c61b8d72c0 con 0x55c61b88f550 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124012bd0 con 0x55c61b88f550 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fb124039020 con 0x55c61b88f550 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 10 client.4809 fetch_fsmap finished waiting for FSMap version 8 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 20 client.4809 populate_metadata read hostname 'smithi146' 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b863090 0x55c61b8d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 4 client.4809 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:00:37.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.968+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 --> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] -- command(tid 0: {"prefix": "status"}) -- 0x55c61b7d3680 con 0x55c61b863090 2024-04-24T23:00:37.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.969+0000 7fb132000640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b863090 0x55c61b8d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.969+0000 7fb132000640 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b863090 0x55c61b8d56c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe7af3b77a4530b6 server_cookie=ea30865c06cbacf3 in_seq=0 out_seq=0 2024-04-24T23:00:37.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.969+0000 7fb113e00640 10 client.4809 ms_handle_connect on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb113e00640 1 -- 172.21.15.146:0/765676919 <== mds.0 v2:172.21.15.203:6835/554633282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55c61b7d3680 con 0x55c61b863090 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb113e00640 10 client.4809 handle_command_reply: tid=0 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 client.4809 shutdown 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 msgr2=0x55c61b934280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb12400dab0 tx=0x7fb124004730 comp rx=0 tx=0).stop 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 shutdown_connections 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:6835/554633282,v1:172.21.15.203:6837/554633282] conn(0x55c61b863090 0x55c61b8d56c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c61b893860 0x55c61b8689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c61b890ea0 0x55c61b8c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 --2- 172.21.15.146:0/765676919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c61b88f550 0x55c61b934280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb113e00640 0 client.4809 ms_handle_reset on v2:172.21.15.203:6835/554633282 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 >> 172.21.15.146:0/765676919 conn(0x55c61b890ac0 msgr2=0x55c61b863520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.970+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 shutdown_connections 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb13c774740 1 -- 172.21.15.146:0/765676919 wait complete. 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb13c774740 20 client.4809 trim_cache size 0 max 16384 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4273, 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 43.144372652000001, 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 8, 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 29, 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 27, 2024-04-24T23:00:37.976 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 48.224963819000003 2024-04-24T23:00:37.976 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:00:37.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 msgr2=0x7fb11406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 0x7fb11406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb12400b840 tx=0x7fb124008040 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 msgr2=0x7fb13415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c430 tx=0x7fb12000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 shutdown_connections 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb11406be30 0x7fb11406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb13406dd10 0x7fb13415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13406b520 0x7fb13415a3e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 --2- 172.21.15.146:0/3578241363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb13406b140 0x7fb1340b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.971+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 >> 172.21.15.146:0/3578241363 conn(0x7fb1340d0b70 msgr2=0x7fb1340c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.972+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 shutdown_connections 2024-04-24T23:00:37.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:37.972+0000 7fb139800640 1 -- 172.21.15.146:0/3578241363 wait complete. 2024-04-24T23:00:37.991 INFO:teuthology.run_tasks:Running task sequential... 2024-04-24T23:00:38.001 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-24T23:00:38.001 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-24T23:00:38.001 INFO:teuthology.task.print:Enabling mgr modules 2024-04-24T23:00:38.002 INFO:teuthology.run_tasks:Running task kclient... 2024-04-24T23:00:38.014 INFO:tasks.kclient:Mounting kernel clients... 2024-04-24T23:00:38.014 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-24T23:00:38.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.015 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:00:38.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-24T23:00:38.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:38.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-04-24T23:00:38.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.248 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:00:38.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-04-24T23:00:38.409 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-04-24T23:00:38.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:00:38.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.413 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:00:38.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.469 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-24T23:00:38.558 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-24T23:00:38.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:00:38.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.607 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:00:38.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:38.665 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-24T23:00:38.751 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-24T23:00:38.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:00:38.755 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-24T23:00:38.756 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:38.756 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:38.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:38.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.958+0000 7fe049000640 1 Processor -- start 2024-04-24T23:00:38.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.958+0000 7fe049000640 1 -- start start 2024-04-24T23:00:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe049000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe044145640 0x7fe04415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe049000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0440d03a0 0x7fe0440ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe049000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0440cdf70 con 0x7fe0440b2a20 2024-04-24T23:00:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe049000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe04415d360 con 0x7fe0440d03a0 2024-04-24T23:00:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe049000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe044145a20 con 0x7fe044145640 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe042800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0440d03a0 0x7fe0440ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe041400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0440b2a20 0x7fe0440cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46910/0 (socket says 172.21.15.146:46910) 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.960+0000 7fe041400640 1 -- 172.21.15.146:0/684737271 learned_addr learned my addr 172.21.15.146:0/684737271 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.961+0000 7fe041e00640 1 --2- 172.21.15.146:0/684737271 >> v2:172.21.15.203:3300/0 conn(0x7fe044145640 0x7fe04415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.961+0000 7fe042800640 1 -- 172.21.15.146:0/684737271 >> v2:172.21.15.203:3300/0 conn(0x7fe044145640 msgr2=0x7fe04415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.961+0000 7fe042800640 1 --2- 172.21.15.146:0/684737271 >> v2:172.21.15.203:3300/0 conn(0x7fe044145640 0x7fe04415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.961+0000 7fe042800640 1 -- 172.21.15.146:0/684737271 >> v1:172.21.15.146:6789/0 conn(0x7fe0440b2a20 legacy=0x7fe0440cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.961+0000 7fe042800640 1 -- 172.21.15.146:0/684737271 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04406d140 con 0x7fe0440d03a0 2024-04-24T23:00:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.962+0000 7fe042800640 1 --2- 172.21.15.146:0/684737271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe0440ce450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0440cfa20 tx=0x7fe03c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247d4433261c7878 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.962+0000 7fe040a00640 1 -- 172.21.15.146:0/684737271 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c007740 con 0x7fe0440d03a0 2024-04-24T23:00:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.962+0000 7fe040a00640 1 -- 172.21.15.146:0/684737271 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03c0078e0 con 0x7fe0440d03a0 2024-04-24T23:00:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.962+0000 7fe040a00640 1 -- 172.21.15.146:0/684737271 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c007cb0 con 0x7fe0440d03a0 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 -- 172.21.15.146:0/684737271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 msgr2=0x7fe0440ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 --2- 172.21.15.146:0/684737271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe0440ce450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0440cfa20 tx=0x7fe03c02a680 comp rx=0 tx=0).stop 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 -- 172.21.15.146:0/684737271 shutdown_connections 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 --2- 172.21.15.146:0/684737271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe0440ce450 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 --2- 172.21.15.146:0/684737271 >> v2:172.21.15.203:3300/0 conn(0x7fe044145640 0x7fe04415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 -- 172.21.15.146:0/684737271 >> 172.21.15.146:0/684737271 conn(0x7fe04406b320 msgr2=0x7fe04406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 -- 172.21.15.146:0/684737271 shutdown_connections 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.963+0000 7fe049000640 1 -- 172.21.15.146:0/684737271 wait complete. 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.965+0000 7fe049000640 1 Processor -- start 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.965+0000 7fe049000640 1 -- start start 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 0x7fe0441f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe044145640 0x7fe04415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe04406d9e0 con 0x7fe0440d03a0 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe04406d700 con 0x7fe0440b2a20 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe049000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe04406cbc0 con 0x7fe044145640 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe041400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe041400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39864/0 (socket says 172.21.15.146:39864) 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.966+0000 7fe041400640 1 -- 172.21.15.146:0/3809802390 learned_addr learned my addr 172.21.15.146:0/3809802390 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041e00640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 0x7fe0441f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe042800640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe044145640 0x7fe04415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 -- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe044145640 msgr2=0x7fe04415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe044145640 0x7fe04415e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 -- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 msgr2=0x7fe0441f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 0x7fe0441f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 -- 172.21.15.146:0/3809802390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04415f080 con 0x7fe0440d03a0 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041e00640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 0x7fe0441f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe041400640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c400 tx=0x7fe03000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030017070 con 0x7fe0440d03a0 2024-04-24T23:00:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe030005ce0 con 0x7fe0440d03a0 2024-04-24T23:00:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030007310 con 0x7fe0440d03a0 2024-04-24T23:00:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.967+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04415f360 con 0x7fe0440d03a0 2024-04-24T23:00:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.968+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0441f42b0 con 0x7fe0440d03a0 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.969+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0441f47a0 con 0x7fe0440d03a0 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.970+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe03001a070 con 0x7fe0440d03a0 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.971+0000 7fe03a000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 0x7fe02406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.971+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe03008a610 con 0x7fe0440d03a0 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.971+0000 7fe041e00640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 0x7fe02406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.972+0000 7fe041e00640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 0x7fe02406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe034006fd0 tx=0x7fe034008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:38.975+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe030058c50 con 0x7fe0440d03a0 2024-04-24T23:00:39.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.221+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe04415d0e0 con 0x7fe0440d03a0 2024-04-24T23:00:39.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.222+0000 7fe03a000640 1 -- 172.21.15.146:0/3809802390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fe030058550 con 0x7fe0440d03a0 2024-04-24T23:00:39.224 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:39.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 msgr2=0x7fe02406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 0x7fe02406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe034006fd0 tx=0x7fe034008040 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 msgr2=0x7fe044071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c400 tx=0x7fe03000c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 shutdown_connections 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02406be30 0x7fe02406e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe044145640 0x7fe04415e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440d03a0 0x7fe044071ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 --2- 172.21.15.146:0/3809802390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440b2a20 0x7fe0441f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.225+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 >> 172.21.15.146:0/3809802390 conn(0x7fe04406b320 msgr2=0x7fe0440ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.226+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 shutdown_connections 2024-04-24T23:00:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39.226+0000 7fe049000640 1 -- 172.21.15.146:0/3809802390 wait complete. 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:39.245 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:00:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:39.246 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:39.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42596sec preferred_lft 42596sec 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:00:39.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:39.296 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:00:39.296 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:39.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:39.532 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:39.593 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:00:39.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:39.597 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:00:39.640 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:00:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:00:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:00:39.641 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:00:39.642 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:39.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:39.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:39.883 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:00:39.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:39.932 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-04-24T23:00:40.027 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:40.027 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:40.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:40.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-24T23:00:40.027 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:40.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:40.199 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-24T23:00:40.199 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-24T23:00:40.200 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:40.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:40.452 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:40.453 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:40.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:00:40.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:00:40.453 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:40.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:40.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:40.641 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:40.681 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:00:40.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:40.681 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:40.767 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:00:40.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:40.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:40.928 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:40.928 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:41.555 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:41.555 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:41.555 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:00:41.555 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:00:41.555 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:00:41.557 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:00:41.558 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:00:41.558 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:00:41.558 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:00:41.558 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:00:41.562 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:00:41.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:41.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:41.637 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:41.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:41.743 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2024-04-24T23:00:41.743 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:00:41.743 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:41.796 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:41.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:41.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:41.960 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2024-04-24T23:00:41.961 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:42.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:42.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:42.078 INFO:teuthology.orchestra.run.smithi146.stdout:client4511 2024-04-24T23:00:42.078 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a930041-393c-45a0-b3d3-8568bdacde7e.client4511/status') 2024-04-24T23:00:42.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4511 (3)172.21.15.146:0/647440042 2024-04-24T23:00:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2024-04-24T23:00:42.211 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2024-04-24T23:00:42.211 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2024-04-24T23:00:42.211 INFO:teuthology.orchestra.run.smithi146.stderr:70 bytes copied, 7.6349e-05 s, 917 kB/s 2024-04-24T23:00:42.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:42.224 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-24T23:00:42.224 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:42.224 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-24T23:00:42.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.418+0000 7f983e200640 1 Processor -- start 2024-04-24T23:00:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.418+0000 7f983e200640 1 -- start start 2024-04-24T23:00:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983e200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98380d0240 0x7f98380cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f983815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983e200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838070f90 con 0x7f98381561c0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983e200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f98380b4310 con 0x7f98380d0240 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98381565a0 con 0x7f98380709d0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983ce00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f98381561c0 0x7f98380cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46920/0 (socket says 172.21.15.146:46920) 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.420+0000 7f983ce00640 1 -- 172.21.15.146:0/336201886 learned_addr learned my addr 172.21.15.146:0/336201886 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837e00640 1 --2- 172.21.15.146:0/336201886 >> v2:172.21.15.203:3300/0 conn(0x7f98380d0240 0x7f98380cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884497598 0 0) 0x7f9838070f90 con 0x7f98381561c0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9820003520 con 0x7f98381561c0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f983d800640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f983815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1741333975 0 0) 0x7f9820003520 con 0x7f98381561c0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 msgr2=0x7f983815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f983815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 >> v2:172.21.15.203:3300/0 conn(0x7f98380d0240 msgr2=0x7f98380cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 --2- 172.21.15.146:0/336201886 >> v2:172.21.15.203:3300/0 conn(0x7f98380d0240 0x7f98380cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838071270 con 0x7f98381561c0 2024-04-24T23:00:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f982c001670 con 0x7f98381561c0 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 >> v1:172.21.15.146:6789/0 conn(0x7f98381561c0 legacy=0x7f98380cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f98200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9820003f80 0x7f9820004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9820004d40 0x7f98200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98380b4310 con 0x7f9820004d40 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f982000bb50 con 0x7f9820003f80 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.421+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f982000bd20 con 0x7f98380709d0 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9820004d40 0x7f98200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f9837e00640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9820003f80 0x7f9820004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983ce00640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f98200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 -- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 msgr2=0x7f98200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f98200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 -- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9820003f80 msgr2=0x7f9820004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9820003f80 0x7f9820004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983d800640 1 -- 172.21.15.146:0/336201886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9820003520 con 0x7f9820004d40 2024-04-24T23:00:42.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f9837e00640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9820003f80 0x7f9820004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:42.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.422+0000 7f983ce00640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98380709d0 0x7f98200039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.423+0000 7f983d800640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9820004d40 0x7f98200051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9830007360 tx=0x7f9820005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff063c3de8a4fba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.423+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830009be0 con 0x7f9820004d40 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.423+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830036600 con 0x7f9820004d40 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.423+0000 7f9837400640 1 -- 172.21.15.146:0/336201886 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300369d0 con 0x7f9820004d40 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 -- 172.21.15.146:0/336201886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9820004d40 msgr2=0x7f98200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 --2- 172.21.15.146:0/336201886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9820004d40 0x7f98200051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9830007360 tx=0x7f9820005830 comp rx=0 tx=0).stop 2024-04-24T23:00:42.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983d800640 1 -- 172.21.15.146:0/336201886 reap_dead start 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 -- 172.21.15.146:0/336201886 shutdown_connections 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 -- 172.21.15.146:0/336201886 >> 172.21.15.146:0/336201886 conn(0x7f983806b320 msgr2=0x7f983806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 -- 172.21.15.146:0/336201886 shutdown_connections 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.424+0000 7f983e200640 1 -- 172.21.15.146:0/336201886 wait complete. 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.426+0000 7f983e200640 1 Processor -- start 2024-04-24T23:00:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.426+0000 7f983e200640 1 -- start start 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9838148270 0x7f98381565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 0x7f9838152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f983815cb80 con 0x7f9838159de0 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9838071830 con 0x7f9838148270 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f983815cd00 con 0x7f9838148650 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.427+0000 7f983d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39870/0 (socket says 172.21.15.146:39870) 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 -- 172.21.15.146:0/1750485490 learned_addr learned my addr 172.21.15.146:0/1750485490 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983ce00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9838148270 0x7f98381565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f9837e00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 0x7f9838152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 -- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 msgr2=0x7f9838152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 0x7f9838152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 -- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9838148270 msgr2=0x7f98381565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9838148270 0x7f98381565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 -- 172.21.15.146:0/1750485490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838153150 con 0x7f9838159de0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f9837e00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 0x7f9838152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.428+0000 7f983d800640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9830007480 tx=0x7f9830004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.429+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830045070 con 0x7f9838159de0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.429+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830003990 con 0x7f9838159de0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.429+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983806e140 con 0x7f9838159de0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.429+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830009be0 con 0x7f9838159de0 2024-04-24T23:00:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.429+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983806e700 con 0x7f9838159de0 2024-04-24T23:00:42.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.430+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983804f500 con 0x7f9838159de0 2024-04-24T23:00:42.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.431+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9830048070 con 0x7f9838159de0 2024-04-24T23:00:42.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.432+0000 7f9834c00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.432+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f98300ab410 con 0x7f9838159de0 2024-04-24T23:00:42.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.432+0000 7f983ce00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.433+0000 7f983ce00640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 0x7f981806e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f982c000ff0 tx=0x7f982c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.437+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f983003d070 con 0x7f9838159de0 2024-04-24T23:00:42.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.673+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9838160310 con 0x7f9838159de0 2024-04-24T23:00:42.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.674+0000 7f9834c00640 1 -- 172.21.15.146:0/1750485490 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f9830032030 con 0x7f9838159de0 2024-04-24T23:00:42.676 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:42.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 msgr2=0x7f981806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 0x7f981806e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f982c000ff0 tx=0x7f982c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 msgr2=0x7f98380ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9830007480 tx=0x7f9830004ab0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 shutdown_connections 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9838159de0 0x7f98380ad8c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f981806be60 0x7f981806e320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9838148650 0x7f9838152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 --2- 172.21.15.146:0/1750485490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9838148270 0x7f98381565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.676+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 >> 172.21.15.146:0/1750485490 conn(0x7f983806b320 msgr2=0x7f98380cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.677+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 shutdown_connections 2024-04-24T23:00:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42.677+0000 7f983e200640 1 -- 172.21.15.146:0/1750485490 wait complete. 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:42.698 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-24T23:00:42.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:42.699 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:00:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:00:42.754 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:00:42.754 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:42.754 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:00:42.754 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:42.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:42.755 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:00:42.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:42.836 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:00:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:00:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:00:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:00:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:00:42.888 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:42.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:43.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:43.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.099 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:00:43.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:00:43.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.153 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-04-24T23:00:43.201 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-24T23:00:43.202 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:43.202 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:43.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:00:43.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-24T23:00:43.202 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:43.204 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:43.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:43.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:43.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:43.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-24T23:00:43.493 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.493 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 3e:de:d4:ad:2f:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3cde:d4ff:fead:2f39/64 scope link 2024-04-24T23:00:43.494 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-24T23:00:43.580 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:43.580 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:43.580 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 3e:de:d4:ad:2f:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3cde:d4ff:fead:2f39/64 scope link 2024-04-24T23:00:43.581 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.585 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-24T23:00:43.585 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:43.585 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:43.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-24T23:00:43.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:43.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-24T23:00:43.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-24T23:00:43.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-24T23:00:43.586 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:43.868 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:43.868 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:00:43.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2024-04-24T23:00:43.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2024-04-24T23:00:43.868 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:00:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:44.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:44.070 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-24T23:00:44.121 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-24T23:00:44.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:44.121 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-24T23:00:44.167 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-24T23:00:44.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:44.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:44.291 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:44.291 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:00:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 2@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:00:44.326 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:00:44.328 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-24T23:00:44.328 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:00:44.328 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:00:44.328 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:00:44.328 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:00:44.333 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:00:44.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:44.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-24T23:00:44.404 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.515 INFO:teuthology.orchestra.run.smithi146.stdout:client4618 2024-04-24T23:00:44.515 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:00:44.515 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:44.565 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.728 INFO:teuthology.orchestra.run.smithi146.stdout:client4618 2024-04-24T23:00:44.728 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:44.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.840 INFO:teuthology.orchestra.run.smithi146.stdout:client4618 2024-04-24T23:00:44.840 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a930041-393c-45a0-b3d3-8568bdacde7e.client4618/status') 2024-04-24T23:00:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:44.970 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4618 (3)172.21.15.146:0/2809313178 2024-04-24T23:00:44.970 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2024-04-24T23:00:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2024-04-24T23:00:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2024-04-24T23:00:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:71 bytes copied, 7.8056e-05 s, 910 kB/s 2024-04-24T23:00:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.983 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-24T23:00:44.983 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:44.983 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:00:44.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.179+0000 7f4ba1e00640 1 Processor -- start 2024-04-24T23:00:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.179+0000 7f4ba1e00640 1 -- start start 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b9c0d0240 0x7f4b9c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba1e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c070f90 con 0x7f4b9c1561c0 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba1e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c071270 con 0x7f4b9c0709d0 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba1e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c0b4310 con 0x7f4b9c0d0240 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba0a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4b9c1561c0 0x7f4b9c0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46932/0 (socket says 172.21.15.146:46932) 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4b93e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b9c0d0240 0x7f4b9c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.181+0000 7f4ba0a00640 1 -- 172.21.15.146:0/2232552782 learned_addr learned my addr 172.21.15.146:0/2232552782 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:45.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.182+0000 7f4b93e00640 1 -- 172.21.15.146:0/2232552782 >> v1:172.21.15.203:6789/0 conn(0x7f4b9c0709d0 legacy=0x7f4b9c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.182+0000 7f4b93e00640 1 -- 172.21.15.146:0/2232552782 >> v1:172.21.15.146:6789/0 conn(0x7f4b9c1561c0 legacy=0x7f4b9c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.182+0000 7f4b9be00640 1 -- 172.21.15.146:0/2232552782 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262720306 0 0) 0x7f4b9c070f90 con 0x7f4b9c1561c0 2024-04-24T23:00:45.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.182+0000 7f4b93e00640 1 -- 172.21.15.146:0/2232552782 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c071550 con 0x7f4b9c0d0240 2024-04-24T23:00:45.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.183+0000 7f4b93e00640 1 --2- 172.21.15.146:0/2232552782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c0d0240 0x7f4b9c0cdbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097a0 tx=0x7f4b8402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d5d530c9e90cae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:45.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.183+0000 7f4b9be00640 1 -- 172.21.15.146:0/2232552782 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84037070 con 0x7f4b9c0d0240 2024-04-24T23:00:45.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.183+0000 7f4b9be00640 1 -- 172.21.15.146:0/2232552782 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b84032440 con 0x7f4b9c0d0240 2024-04-24T23:00:45.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.183+0000 7f4b9be00640 1 -- 172.21.15.146:0/2232552782 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8402ae60 con 0x7f4b9c0d0240 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 -- 172.21.15.146:0/2232552782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c0d0240 msgr2=0x7f4b9c0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/2232552782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c0d0240 0x7f4b9c0cdbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097a0 tx=0x7f4b8402a110 comp rx=0 tx=0).stop 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 -- 172.21.15.146:0/2232552782 shutdown_connections 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/2232552782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c0d0240 0x7f4b9c0cdbf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 -- 172.21.15.146:0/2232552782 >> 172.21.15.146:0/2232552782 conn(0x7f4b9c06b320 msgr2=0x7f4b9c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 -- 172.21.15.146:0/2232552782 shutdown_connections 2024-04-24T23:00:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.184+0000 7f4ba1e00640 1 -- 172.21.15.146:0/2232552782 wait complete. 2024-04-24T23:00:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.186+0000 7f4ba1e00640 1 Processor -- start 2024-04-24T23:00:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.186+0000 7f4ba1e00640 1 -- start start 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 0x7f4b9c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b9c0d0240 0x7f4b9c0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c15cb80 con 0x7f4b9c1561c0 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c15cd00 con 0x7f4b9c0709d0 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c15ce80 con 0x7f4b9c0d0240 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39894/0 (socket says 172.21.15.146:39894) 2024-04-24T23:00:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1400640 1 -- 172.21.15.146:0/3922267109 learned_addr learned my addr 172.21.15.146:0/3922267109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba0a00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 0x7f4b9c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4ba1400640 1 -- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b9c0d0240 msgr2=0x7f4b9c0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.187+0000 7f4b93e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b9c0d0240 0x7f4b9c0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1400640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b9c0d0240 0x7f4b9c0adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1400640 1 -- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 msgr2=0x7f4b9c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1400640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 0x7f4b9c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1400640 1 -- 172.21.15.146:0/3922267109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c15f020 con 0x7f4b9c1561c0 2024-04-24T23:00:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba0a00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 0x7f4b9c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1400640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c7a0 tx=0x7f4b9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94003b70 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b94003d30 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c06ca30 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400aa90 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.188+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c06cff0 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.189+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c04f500 con 0x7f4b9c1561c0 2024-04-24T23:00:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.190+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b9400ac50 con 0x7f4b9c1561c0 2024-04-24T23:00:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.191+0000 7f4b99600640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.191+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4b9408b120 con 0x7f4b9c1561c0 2024-04-24T23:00:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.192+0000 7f4ba0a00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.193+0000 7f4ba0a00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 0x7f4b7806e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000f60 tx=0x7f4b8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:45.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.196+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4b94059750 con 0x7f4b9c1561c0 2024-04-24T23:00:45.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.436+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4b9c06bb10 con 0x7f4b9c1561c0 2024-04-24T23:00:45.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.437+0000 7f4b99600640 1 -- 172.21.15.146:0/3922267109 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f4b94059050 con 0x7f4b9c1561c0 2024-04-24T23:00:45.439 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.439+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 msgr2=0x7f4b7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.439+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 0x7f4b7806e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000f60 tx=0x7f4b8c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.439+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 msgr2=0x7f4b9c144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.439+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c7a0 tx=0x7f4b9400cc60 comp rx=0 tx=0).stop 2024-04-24T23:00:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 shutdown_connections 2024-04-24T23:00:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9c1561c0 0x7f4b9c144310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b9c0d0240 0x7f4b9c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 --2- 172.21.15.146:0/3922267109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b9c0709d0 0x7f4b9c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 >> 172.21.15.146:0/3922267109 conn(0x7f4b9c06b320 msgr2=0x7f4b9c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 shutdown_connections 2024-04-24T23:00:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:45.440+0000 7f4ba1e00640 1 -- 172.21.15.146:0/3922267109 wait complete. 2024-04-24T23:00:45.459 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:45.460 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:00:45.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:45.460 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-24T23:00:45.518 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-24T23:00:45.519 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42580sec preferred_lft 42580sec 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-24T23:00:45.520 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:45.521 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2024-04-24T23:00:45.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:00:45.522 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:45.633 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:45.996 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:46.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.009 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:46.074 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-24T23:00:46.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.079 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-24T23:00:46.131 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-24T23:00:46.131 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:46.131 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:00:46.131 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:00:46.132 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:00:46.132 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:46.232 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:46.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:46.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.870 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:00:46.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.922 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-04-24T23:00:46.970 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:46.970 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:46.971 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:00:46.971 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-24T23:00:46.971 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:47.070 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:47.142 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:47.151 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-24T23:00:47.152 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:47.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:47.440 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:47.450 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:47.450 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:47.450 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-04-24T23:00:47.450 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:00:47.450 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:47.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:47.641 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:47.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:47.650 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-24T23:00:47.691 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:00:47.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:47.691 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:00:47.781 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-24T23:00:47.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:47.782 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:47.913 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:47.913 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:48.680 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:48.680 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:48.680 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:00:48.680 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with new device syntax: 1@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:00:48.680 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:00:48.684 INFO:teuthology.orchestra.run.smithi203.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-24T23:00:48.684 INFO:teuthology.orchestra.run.smithi203.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:00:48.684 INFO:teuthology.orchestra.run.smithi203.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:00:48.684 INFO:teuthology.orchestra.run.smithi203.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:00:48.684 INFO:teuthology.orchestra.run.smithi203.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:00:48.688 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:00:48.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:48.688 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:00:48.769 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:48.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:48.881 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:48.890 INFO:teuthology.orchestra.run.smithi203.stdout:client4621 2024-04-24T23:00:48.891 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:00:48.891 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:48.943 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:49.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:49.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:49.060 INFO:teuthology.orchestra.run.smithi203.stdout:client4621 2024-04-24T23:00:49.061 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:49.157 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:49.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:49.171 INFO:teuthology.orchestra.run.smithi203.stdout:client4621 2024-04-24T23:00:49.172 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a930041-393c-45a0-b3d3-8568bdacde7e.client4621/status') 2024-04-24T23:00:49.274 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:49.304 INFO:teuthology.orchestra.run.smithi203.stdout:instance: client.4621 (3)192.168.0.1:0/3271301559 2024-04-24T23:00:49.304 INFO:teuthology.orchestra.run.smithi203.stdout:blocklisted: false 2024-04-24T23:00:49.304 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records in 2024-04-24T23:00:49.304 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records out 2024-04-24T23:00:49.304 INFO:teuthology.orchestra.run.smithi203.stderr:69 bytes copied, 0.000107251 s, 643 kB/s 2024-04-24T23:00:49.307 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:49.316 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-24T23:00:49.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:49.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-24T23:00:49.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:49.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.519+0000 7efd53e00640 1 Processor -- start 2024-04-24T23:00:49.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.519+0000 7efd53e00640 1 -- start start 2024-04-24T23:00:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.520+0000 7efd53e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c0b2a20 0x7efd4c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.520+0000 7efd53e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd4c06cbc0 0x7efd4c0d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd53e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4c0cdf70 con 0x7efd4c145640 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd53e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7efd4c145a20 con 0x7efd4c06cbc0 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd53e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c06d140 con 0x7efd4c0b2a20 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd4c06cbc0 0x7efd4c0d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd4c06cbc0 0x7efd4c0d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51208/0 (socket says 172.21.15.146:51208) 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 -- 172.21.15.146:0/2765308756 learned_addr learned my addr 172.21.15.146:0/2765308756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd50a00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c0b2a20 0x7efd4c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 -- 172.21.15.146:0/2765308756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c0b2a20 msgr2=0x7efd4c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c0b2a20 0x7efd4c0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.521+0000 7efd51e00640 1 -- 172.21.15.146:0/2765308756 >> v1:172.21.15.203:6789/0 conn(0x7efd4c145640 legacy=0x7efd4c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.522+0000 7efd51e00640 1 -- 172.21.15.146:0/2765308756 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c06d420 con 0x7efd4c06cbc0 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.523+0000 7efd51e00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c06cbc0 0x7efd4c0d01d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efd44009e50 tx=0x7efd4402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758398c14f36ed38 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.523+0000 7efd4be00640 1 -- 172.21.15.146:0/2765308756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44036070 con 0x7efd4c06cbc0 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.523+0000 7efd4be00640 1 -- 172.21.15.146:0/2765308756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd44031600 con 0x7efd4c06cbc0 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.523+0000 7efd4be00640 1 -- 172.21.15.146:0/2765308756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440319d0 con 0x7efd4c06cbc0 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.523+0000 7efd53e00640 1 -- 172.21.15.146:0/2765308756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c06cbc0 msgr2=0x7efd4c0d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c06cbc0 0x7efd4c0d01d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efd44009e50 tx=0x7efd4402a6c0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 -- 172.21.15.146:0/2765308756 shutdown_connections 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c06cbc0 0x7efd4c0d01d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 --2- 172.21.15.146:0/2765308756 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c0b2a20 0x7efd4c0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 -- 172.21.15.146:0/2765308756 >> 172.21.15.146:0/2765308756 conn(0x7efd4c06b320 msgr2=0x7efd4c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 -- 172.21.15.146:0/2765308756 shutdown_connections 2024-04-24T23:00:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.524+0000 7efd53e00640 1 -- 172.21.15.146:0/2765308756 wait complete. 2024-04-24T23:00:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.525+0000 7efd53e00640 1 Processor -- start 2024-04-24T23:00:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.526+0000 7efd53e00640 1 -- start start 2024-04-24T23:00:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 0x7efd4c1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd4c145640 0x7efd4c143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c0ce450 con 0x7efd4c0b2a20 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c06d9e0 con 0x7efd4c145640 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd53e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c0ce5d0 con 0x7efd4c06cbc0 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51210/0 (socket says 172.21.15.146:51210) 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 -- 172.21.15.146:0/284746622 learned_addr learned my addr 172.21.15.146:0/284746622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd51400640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 0x7efd4c1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 -- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 msgr2=0x7efd4c1f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 0x7efd4c1f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd51e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd4c145640 0x7efd4c143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 -- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd4c145640 msgr2=0x7efd4c143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd4c145640 0x7efd4c143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd50a00640 1 -- 172.21.15.146:0/284746622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c15a4f0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.527+0000 7efd51400640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 0x7efd4c1f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd50a00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd3800d800 tx=0x7efd3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3800b6c0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd38019070 con 0x7efd4c0b2a20 2024-04-24T23:00:49.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3800ba80 con 0x7efd4c0b2a20 2024-04-24T23:00:49.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4c15a7d0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.528+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4c15ad90 con 0x7efd4c0b2a20 2024-04-24T23:00:49.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.529+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4c068190 con 0x7efd4c0b2a20 2024-04-24T23:00:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.530+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd3800bc20 con 0x7efd4c0b2a20 2024-04-24T23:00:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.531+0000 7efd49600640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.531+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7efd3808b6b0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.532+0000 7efd51400640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.533+0000 7efd51400640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 0x7efd2c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd4000a830 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:49.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.536+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efd38059ce0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.781+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd4c0d04d0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.782+0000 7efd49600640 1 -- 172.21.15.146:0/284746622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7efd380595e0 con 0x7efd4c0b2a20 2024-04-24T23:00:49.784 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.785+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 msgr2=0x7efd2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.785+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 0x7efd2c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd4000a830 tx=0x7efd40008040 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.785+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 msgr2=0x7efd4c15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.785+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd3800d800 tx=0x7efd3800dcc0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 shutdown_connections 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd4c145640 0x7efd4c143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd4c0b2a20 0x7efd4c15e040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd2c06be30 0x7efd2c06e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 --2- 172.21.15.146:0/284746622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd4c06cbc0 0x7efd4c1f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 >> 172.21.15.146:0/284746622 conn(0x7efd4c06b320 msgr2=0x7efd4c0b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 shutdown_connections 2024-04-24T23:00:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:49.786+0000 7efd53e00640 1 -- 172.21.15.146:0/284746622 wait complete. 2024-04-24T23:00:49.809 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:00:49.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:49.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-24T23:00:49.809 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-24T23:00:49.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-24T23:00:49.810 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:00:49.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:49.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:49.810 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-24T23:00:49.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:49.811 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-24T23:00:49.868 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:49.868 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:49.869 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-24T23:00:49.870 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-24T23:00:49.870 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:00:49.870 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 76:c0:ad:f5:c7:55 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::1466:7bff:fe70:e4c3/64 scope link 2024-04-24T23:00:49.871 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.872 INFO:teuthology.orchestra.run.smithi203.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:00:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 76:c0:ad:f5:c7:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:00:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::74c0:adff:fef5:c755/64 scope link 2024-04-24T23:00:49.872 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:49.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:49.873 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:49.957 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-24T23:00:49.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:49.963 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-24T23:00:50.012 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-24T23:00:50.012 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:50.012 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:00:50.013 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:00:50.013 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:50.013 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:50.013 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:50.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:00:50.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:00:50.014 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:00:50.014 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:50.115 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:50.217 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:50.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:50.227 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:00:50.276 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:00:50.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:50.277 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-04-24T23:00:50.328 INFO:teuthology.orchestra.run.smithi203.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-24T23:00:50.329 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:50.329 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:50.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-24T23:00:50.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-24T23:00:50.329 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:50.433 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:50.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:50.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:50.514 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-24T23:00:50.586 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:50.586 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:50.586 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5a:32:09:f9:d4:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5832:9ff:fef9:d4b2/64 scope link 2024-04-24T23:00:50.587 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:50.590 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5a:32:09:f9:d4:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.672 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5832:9ff:fef9:d4b2/64 scope link 2024-04-24T23:00:50.673 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:50.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-24T23:00:50.676 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:50.676 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-24T23:00:50.677 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:50.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:50.940 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:50.949 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:50.949 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-24T23:00:50.949 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.1 up 2024-04-24T23:00:50.949 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.1 master ceph-brx 2024-04-24T23:00:50.949 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-24T23:00:51.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:51.143 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:51.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:51.153 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-24T23:00:51.193 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-24T23:00:51.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:51.193 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-24T23:00:51.286 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-24T23:00:51.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:51.287 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:51.417 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:51.417 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:51.454 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:00:51.454 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:00:51.454 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:00:51.454 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with new device syntax: 3@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:00:51.454 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:00:51.458 INFO:teuthology.orchestra.run.smithi203.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-24T23:00:51.458 INFO:teuthology.orchestra.run.smithi203.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:00:51.458 INFO:teuthology.orchestra.run.smithi203.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:00:51.458 INFO:teuthology.orchestra.run.smithi203.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:00:51.458 INFO:teuthology.orchestra.run.smithi203.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:00:51.463 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:00:51.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:51.463 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-24T23:00:51.543 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:51.652 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:51.657 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:51.668 INFO:teuthology.orchestra.run.smithi203.stdout:client4842 2024-04-24T23:00:51.668 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:00:51.668 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:51.716 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:51.868 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:51.872 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:51.882 INFO:teuthology.orchestra.run.smithi203.stdout:client4842 2024-04-24T23:00:51.882 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:00:51.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:51.984 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:51.992 INFO:teuthology.orchestra.run.smithi203.stdout:client4842 2024-04-24T23:00:51.993 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a930041-393c-45a0-b3d3-8568bdacde7e.client4842/status') 2024-04-24T23:00:52.096 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:52.126 INFO:teuthology.orchestra.run.smithi203.stdout:instance: client.4842 (3)172.21.15.203:0/794588461 2024-04-24T23:00:52.126 INFO:teuthology.orchestra.run.smithi203.stdout:blocklisted: false 2024-04-24T23:00:52.126 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records in 2024-04-24T23:00:52.126 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records out 2024-04-24T23:00:52.126 INFO:teuthology.orchestra.run.smithi203.stderr:70 bytes copied, 9.6334e-05 s, 727 kB/s 2024-04-24T23:00:52.129 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-24T23:00:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:52.139 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-24T23:00:52.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.374+0000 7f2625e00640 1 Processor -- start 2024-04-24T23:00:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.374+0000 7f2625e00640 1 -- start start 2024-04-24T23:00:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.375+0000 7f2625e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26201561c0 0x7f26200cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.375+0000 7f2625e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200d0240 0x7f262015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2625e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2620070f90 con 0x7f26200709d0 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2625e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f26200b4310 con 0x7f26201561c0 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2625e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f26201565a0 con 0x7f26200d0240 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26201561c0 0x7f26200cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26201561c0 0x7f26200cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51218/0 (socket says 172.21.15.146:51218) 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f261fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f26200709d0 0x7f26200cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42512/0 (socket says 172.21.15.146:42512) 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 -- 172.21.15.146:0/3968037786 learned_addr learned my addr 172.21.15.146:0/3968037786 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 -- 172.21.15.146:0/3968037786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200d0240 msgr2=0x7f262015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 --2- 172.21.15.146:0/3968037786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200d0240 0x7f262015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 -- 172.21.15.146:0/3968037786 >> v1:172.21.15.146:6789/0 conn(0x7f26200709d0 legacy=0x7f26200cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f2624a00640 1 -- 172.21.15.146:0/3968037786 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2620071270 con 0x7f26201561c0 2024-04-24T23:00:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.376+0000 7f261f400640 1 -- 172.21.15.146:0/3968037786 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121407863 0 0) 0x7f2620070f90 con 0x7f26200709d0 2024-04-24T23:00:52.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.377+0000 7f2624a00640 1 --2- 172.21.15.146:0/3968037786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26201561c0 0x7f26200cdbf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2614009870 tx=0x7f261402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f64d43d6bf3d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f261f400640 1 -- 172.21.15.146:0/3968037786 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614037070 con 0x7f26201561c0 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f261f400640 1 -- 172.21.15.146:0/3968037786 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2614032440 con 0x7f26201561c0 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f261f400640 1 -- 172.21.15.146:0/3968037786 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614032810 con 0x7f26201561c0 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f2625e00640 1 -- 172.21.15.146:0/3968037786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26201561c0 msgr2=0x7f26200cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f2625e00640 1 --2- 172.21.15.146:0/3968037786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26201561c0 0x7f26200cdbf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2614009870 tx=0x7f261402a130 comp rx=0 tx=0).stop 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f2625e00640 1 -- 172.21.15.146:0/3968037786 shutdown_connections 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f2625e00640 1 --2- 172.21.15.146:0/3968037786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200d0240 0x7f262015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.378+0000 7f2625e00640 1 --2- 172.21.15.146:0/3968037786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26201561c0 0x7f26200cdbf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.379+0000 7f2625e00640 1 -- 172.21.15.146:0/3968037786 >> 172.21.15.146:0/3968037786 conn(0x7f262006b320 msgr2=0x7f262006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.379+0000 7f2625e00640 1 -- 172.21.15.146:0/3968037786 shutdown_connections 2024-04-24T23:00:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.379+0000 7f2625e00640 1 -- 172.21.15.146:0/3968037786 wait complete. 2024-04-24T23:00:52.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.380+0000 7f2625e00640 1 Processor -- start 2024-04-24T23:00:52.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.380+0000 7f2625e00640 1 -- start start 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200709d0 0x7f2620144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26201561c0 0x7f2620157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26200b2c20 con 0x7f26200d0240 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2620071830 con 0x7f26201561c0 2024-04-24T23:00:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.381+0000 7f2625e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f26200b2da0 con 0x7f26200709d0 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51224/0 (socket says 172.21.15.146:51224) 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 -- 172.21.15.146:0/435534944 learned_addr learned my addr 172.21.15.146:0/435534944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f2624a00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200709d0 0x7f2620144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 -- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200709d0 msgr2=0x7f2620144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200709d0 0x7f2620144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f2625400640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26201561c0 0x7f2620157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 -- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26201561c0 msgr2=0x7f2620157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26201561c0 0x7f2620157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 -- 172.21.15.146:0/435534944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26201f1c40 con 0x7f26200d0240 2024-04-24T23:00:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.382+0000 7f261fe00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f260c00c4d0 tx=0x7f260c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.383+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c018070 con 0x7f26200d0240 2024-04-24T23:00:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.383+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c007500 con 0x7f26200d0240 2024-04-24T23:00:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.383+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c004a20 con 0x7f26200d0240 2024-04-24T23:00:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.383+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26201f1f20 con 0x7f26200d0240 2024-04-24T23:00:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.383+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26201f24e0 con 0x7f26200d0240 2024-04-24T23:00:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.384+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262004f500 con 0x7f26200d0240 2024-04-24T23:00:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.385+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f260c01b070 con 0x7f26200d0240 2024-04-24T23:00:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.386+0000 7f261cc00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 0x7f260006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.386+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f260c08a560 con 0x7f26200d0240 2024-04-24T23:00:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.387+0000 7f2624a00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 0x7f260006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.388+0000 7f2624a00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 0x7f260006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f261402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.391+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f260c058b90 con 0x7f26200d0240 2024-04-24T23:00:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.592+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2620155680 con 0x7f26200d0240 2024-04-24T23:00:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.594+0000 7f261cc00640 1 -- 172.21.15.146:0/435534944 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7f260c058490 con 0x7f26200d0240 2024-04-24T23:00:52.597 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:52.597 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 msgr2=0x7f260006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 0x7f260006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f261402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 msgr2=0x7f262014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f260c00c4d0 tx=0x7f260c00c990 comp rx=0 tx=0).stop 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 shutdown_connections 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26201561c0 0x7f2620157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26200d0240 0x7f262014ee80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f260006be30 0x7f260006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 --2- 172.21.15.146:0/435534944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26200709d0 0x7f2620144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 >> 172.21.15.146:0/435534944 conn(0x7f262006b320 msgr2=0x7f26200748a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 shutdown_connections 2024-04-24T23:00:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.597+0000 7f2625e00640 1 -- 172.21.15.146:0/435534944 wait complete. 2024-04-24T23:00:52.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:52.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:52.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.822+0000 7f1c2ea00640 1 Processor -- start 2024-04-24T23:00:52.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.822+0000 7f1c2ea00640 1 -- start start 2024-04-24T23:00:52.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.823+0000 7f1c2ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c28155460 0x7f1c2815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.823+0000 7f1c2ea00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1c2806ea40 0x7f1c280713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.823+0000 7f1c2ea00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c280b3250 con 0x7f1c280b2ab0 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.823+0000 7f1c2ea00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1c280b3530 con 0x7f1c28155460 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.823+0000 7f1c2ea00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1c280b3810 con 0x7f1c2806ea40 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c28155460 0x7f1c2815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c28155460 0x7f1c2815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51236/0 (socket says 172.21.15.146:51236) 2024-04-24T23:00:52.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 -- 172.21.15.146:0/3534001501 learned_addr learned my addr 172.21.15.146:0/3534001501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 -- 172.21.15.146:0/3534001501 >> v2:172.21.15.203:3300/0 conn(0x7f1c2806ea40 msgr2=0x7f1c280713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 --2- 172.21.15.146:0/3534001501 >> v2:172.21.15.203:3300/0 conn(0x7f1c2806ea40 0x7f1c280713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 -- 172.21.15.146:0/3534001501 >> v1:172.21.15.203:6789/0 conn(0x7f1c280b2ab0 legacy=0x7f1c2806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.824+0000 7f1c27e00640 1 -- 172.21.15.146:0/3534001501 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c28070ec0 con 0x7f1c28155460 2024-04-24T23:00:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.825+0000 7f1c27e00640 1 --2- 172.21.15.146:0/3534001501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c28155460 0x7f1c2815be40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c28073890 tx=0x7f1c1802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce48f88cf84b63d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.825+0000 7f1c26a00640 1 -- 172.21.15.146:0/3534001501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18036070 con 0x7f1c28155460 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c26a00640 1 -- 172.21.15.146:0/3534001501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18031600 con 0x7f1c28155460 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c26a00640 1 -- 172.21.15.146:0/3534001501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c180319d0 con 0x7f1c28155460 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 -- 172.21.15.146:0/3534001501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c28155460 msgr2=0x7f1c2815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/3534001501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c28155460 0x7f1c2815be40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c28073890 tx=0x7f1c1802a6f0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 -- 172.21.15.146:0/3534001501 shutdown_connections 2024-04-24T23:00:52.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/3534001501 >> v2:172.21.15.203:3300/0 conn(0x7f1c2806ea40 0x7f1c280713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/3534001501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c28155460 0x7f1c2815be40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 -- 172.21.15.146:0/3534001501 >> 172.21.15.146:0/3534001501 conn(0x7f1c280b17b0 msgr2=0x7f1c280b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:52.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 -- 172.21.15.146:0/3534001501 shutdown_connections 2024-04-24T23:00:52.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.826+0000 7f1c2ea00640 1 -- 172.21.15.146:0/3534001501 wait complete. 2024-04-24T23:00:52.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.828+0000 7f1c2ea00640 1 Processor -- start 2024-04-24T23:00:52.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.828+0000 7f1c2ea00640 1 -- start start 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c280b2ab0 0x7f1c28152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c28155460 0x7f1c281f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2815c480 con 0x7f1c2806ea40 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c280b3af0 con 0x7f1c28155460 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c2ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2815c600 con 0x7f1c280b2ab0 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c27e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c27e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51248/0 (socket says 172.21.15.146:51248) 2024-04-24T23:00:52.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.829+0000 7f1c27e00640 1 -- 172.21.15.146:0/1002351326 learned_addr learned my addr 172.21.15.146:0/1002351326 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 -- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c280b2ab0 msgr2=0x7f1c28152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c280b2ab0 0x7f1c28152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 -- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c28155460 msgr2=0x7f1c281f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c2ca00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c28155460 0x7f1c281f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c28155460 0x7f1c281f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 -- 172.21.15.146:0/1002351326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c28151360 con 0x7f1c2806ea40 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c27e00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c18034040 tx=0x7f1c18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18041020 con 0x7f1c2806ea40 2024-04-24T23:00:52.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18007820 con 0x7f1c2806ea40 2024-04-24T23:00:52.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c28151640 con 0x7f1c2806ea40 2024-04-24T23:00:52.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.830+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18036040 con 0x7f1c2806ea40 2024-04-24T23:00:52.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.831+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281509b0 con 0x7f1c2806ea40 2024-04-24T23:00:52.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.832+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2804f5a0 con 0x7f1c2806ea40 2024-04-24T23:00:52.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.833+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c18044020 con 0x7f1c2806ea40 2024-04-24T23:00:52.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.833+0000 7f1c1fe00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 0x7f1c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:52.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.834+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1c180abff0 con 0x7f1c2806ea40 2024-04-24T23:00:52.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.834+0000 7f1c27400640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 0x7f1c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:52.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.835+0000 7f1c27400640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 0x7f1c0806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c280aea30 tx=0x7f1c14007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:52.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:52.838+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1c1804b030 con 0x7f1c2806ea40 2024-04-24T23:00:53.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.036+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c2806dfd0 con 0x7f1c2806ea40 2024-04-24T23:00:53.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.037+0000 7f1c1fe00640 1 -- 172.21.15.146:0/1002351326 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f1c1807a660 con 0x7f1c2806ea40 2024-04-24T23:00:53.039 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.039+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 msgr2=0x7f1c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.039+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 0x7f1c0806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c280aea30 tx=0x7f1c14007990 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.039+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 msgr2=0x7f1c281501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.039+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c18034040 tx=0x7f1c18004a40 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 shutdown_connections 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c28155460 0x7f1c281f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1c0806be30 0x7f1c0806e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c280b2ab0 0x7f1c28152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 --2- 172.21.15.146:0/1002351326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2806ea40 0x7f1c281501d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 >> 172.21.15.146:0/1002351326 conn(0x7f1c280b17b0 msgr2=0x7f1c281543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 shutdown_connections 2024-04-24T23:00:53.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.040+0000 7f1c2ea00640 1 -- 172.21.15.146:0/1002351326 wait complete. 2024-04-24T23:00:53.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.261+0000 7f47c1e00640 1 Processor -- start 2024-04-24T23:00:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.261+0000 7f47c1e00640 1 -- start start 2024-04-24T23:00:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.262+0000 7f47c1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47bc13ef30 0x7f47bc141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.262+0000 7f47c1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc0ce770 0x7f47bc071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.262+0000 7f47c1e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc0ced40 con 0x7f47bc141ab0 2024-04-24T23:00:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.262+0000 7f47c1e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc1423d0 con 0x7f47bc13ef30 2024-04-24T23:00:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.262+0000 7f47c1e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc070f80 con 0x7f47bc0ce770 2024-04-24T23:00:53.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47bc13ef30 0x7f47bc141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47bc13ef30 0x7f47bc141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51260/0 (socket says 172.21.15.146:51260) 2024-04-24T23:00:53.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 -- 172.21.15.146:0/294538082 learned_addr learned my addr 172.21.15.146:0/294538082 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:53.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47bb400640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc0ce770 0x7f47bc071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 -- 172.21.15.146:0/294538082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc0ce770 msgr2=0x7f47bc071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc0ce770 0x7f47bc071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 -- 172.21.15.146:0/294538082 >> v1:172.21.15.203:6789/0 conn(0x7f47bc141ab0 legacy=0x7f47bc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.263+0000 7f47baa00640 1 -- 172.21.15.146:0/294538082 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc0cf020 con 0x7f47bc13ef30 2024-04-24T23:00:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.265+0000 7f47baa00640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc141570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009e50 tx=0x7f47ac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a0628cc6cdbf5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47ba000640 1 -- 172.21.15.146:0/294538082 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac036070 con 0x7f47bc13ef30 2024-04-24T23:00:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47ba000640 1 -- 172.21.15.146:0/294538082 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac031600 con 0x7f47bc13ef30 2024-04-24T23:00:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47ba000640 1 -- 172.21.15.146:0/294538082 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0319d0 con 0x7f47bc13ef30 2024-04-24T23:00:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 -- 172.21.15.146:0/294538082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 msgr2=0x7f47bc141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc141570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009e50 tx=0x7f47ac02a710 comp rx=0 tx=0).stop 2024-04-24T23:00:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 -- 172.21.15.146:0/294538082 shutdown_connections 2024-04-24T23:00:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc0ce770 0x7f47bc071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 --2- 172.21.15.146:0/294538082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc141570 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 -- 172.21.15.146:0/294538082 >> 172.21.15.146:0/294538082 conn(0x7f47bc0b17b0 msgr2=0x7f47bc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 -- 172.21.15.146:0/294538082 shutdown_connections 2024-04-24T23:00:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.266+0000 7f47c1e00640 1 -- 172.21.15.146:0/294538082 wait complete. 2024-04-24T23:00:53.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.269+0000 7f47c1e00640 1 Processor -- start 2024-04-24T23:00:53.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.269+0000 7f47c1e00640 1 -- start start 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47bc0ce770 0x7f47bc0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc141ab0 0x7f47bc1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc071950 con 0x7f47bc13ef30 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc070c10 con 0x7f47bc0ce770 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47c1e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc071ad0 con 0x7f47bc141ab0 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.270+0000 7f47b3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51268/0 (socket says 172.21.15.146:51268) 2024-04-24T23:00:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 -- 172.21.15.146:0/3848857409 learned_addr learned my addr 172.21.15.146:0/3848857409 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47baa00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47bc0ce770 0x7f47bc0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47bb400640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc141ab0 0x7f47bc1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 -- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc141ab0 msgr2=0x7f47bc1f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc141ab0 0x7f47bc1f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 -- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47bc0ce770 msgr2=0x7f47bc0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47bc0ce770 0x7f47bc0b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 -- 172.21.15.146:0/3848857409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc140b60 con 0x7f47bc13ef30 2024-04-24T23:00:53.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.271+0000 7f47b3e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c3f0 tx=0x7f47a400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.272+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a40052d0 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.272+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a4005490 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.272+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4007260 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.272+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc13dcb0 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.272+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc141280 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.273+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc141480 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.274+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47a4007400 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.275+0000 7f47b3400640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 0x7f479806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.275+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f47a408a6d0 con 0x7f47bc13ef30 2024-04-24T23:00:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.275+0000 7f47baa00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 0x7f479806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.276+0000 7f47baa00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 0x7f479806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47ac033000 tx=0x7f47ac009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.280+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47bc141480 con 0x7f47bc13ef30 2024-04-24T23:00:53.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.477+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f47bc1371c0 con 0x7f47bc13ef30 2024-04-24T23:00:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.478+0000 7f47b3400640 1 -- 172.21.15.146:0/3848857409 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f47a4058d00 con 0x7f47bc13ef30 2024-04-24T23:00:53.480 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.480+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 msgr2=0x7f479806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.480+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 0x7f479806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47ac033000 tx=0x7f47ac009000 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.480+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 msgr2=0x7f47bc0b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.480+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c3f0 tx=0x7f47a400c8b0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 shutdown_connections 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f479806be30 0x7f479806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47bc141ab0 0x7f47bc1f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47bc13ef30 0x7f47bc0b2b70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 --2- 172.21.15.146:0/3848857409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47bc0ce770 0x7f47bc0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 >> 172.21.15.146:0/3848857409 conn(0x7f47bc0b17b0 msgr2=0x7f47bc0ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 shutdown_connections 2024-04-24T23:00:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.481+0000 7f47c1e00640 1 -- 172.21.15.146:0/3848857409 wait complete. 2024-04-24T23:00:53.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.707+0000 7f1d54000640 1 Processor -- start 2024-04-24T23:00:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.708+0000 7f1d54000640 1 -- start start 2024-04-24T23:00:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.709+0000 7f1d54000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d4c13ef30 0x7f1d4c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.709+0000 7f1d54000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c141ab0 0x7f1d4c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.709+0000 7f1d54000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c0ced40 con 0x7f1d4c0ce5a0 2024-04-24T23:00:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.709+0000 7f1d54000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c1423d0 con 0x7f1d4c13ef30 2024-04-24T23:00:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.709+0000 7f1d54000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c070f80 con 0x7f1d4c141ab0 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d4c13ef30 0x7f1d4c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d4c13ef30 0x7f1d4c141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51282/0 (socket says 172.21.15.146:51282) 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 -- 172.21.15.146:0/3278927441 learned_addr learned my addr 172.21.15.146:0/3278927441 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d50c00640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c141ab0 0x7f1d4c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 -- 172.21.15.146:0/3278927441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c141ab0 msgr2=0x7f1d4c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c141ab0 0x7f1d4c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 -- 172.21.15.146:0/3278927441 >> v1:172.21.15.203:6789/0 conn(0x7f1d4c0ce5a0 legacy=0x7f1d4c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.710+0000 7f1d51600640 1 -- 172.21.15.146:0/3278927441 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0cf020 con 0x7f1d4c13ef30 2024-04-24T23:00:53.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.712+0000 7f1d51600640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c141570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009870 tx=0x7f1d4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d3b9802720770a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.713+0000 7f1d4be00640 1 -- 172.21.15.146:0/3278927441 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40037070 con 0x7f1d4c13ef30 2024-04-24T23:00:53.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.713+0000 7f1d4be00640 1 -- 172.21.15.146:0/3278927441 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40032440 con 0x7f1d4c13ef30 2024-04-24T23:00:53.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.713+0000 7f1d4be00640 1 -- 172.21.15.146:0/3278927441 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40032810 con 0x7f1d4c13ef30 2024-04-24T23:00:53.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.713+0000 7f1d54000640 1 -- 172.21.15.146:0/3278927441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 msgr2=0x7f1d4c141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.713+0000 7f1d54000640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c141570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009870 tx=0x7f1d4002a270 comp rx=0 tx=0).stop 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 -- 172.21.15.146:0/3278927441 shutdown_connections 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c141ab0 0x7f1d4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 --2- 172.21.15.146:0/3278927441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c141570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 -- 172.21.15.146:0/3278927441 >> 172.21.15.146:0/3278927441 conn(0x7f1d4c0b17b0 msgr2=0x7f1d4c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 -- 172.21.15.146:0/3278927441 shutdown_connections 2024-04-24T23:00:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.714+0000 7f1d54000640 1 -- 172.21.15.146:0/3278927441 wait complete. 2024-04-24T23:00:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.715+0000 7f1d54000640 1 Processor -- start 2024-04-24T23:00:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.716+0000 7f1d54000640 1 -- start start 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.716+0000 7f1d54000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c0ce5a0 0x7f1d4c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.716+0000 7f1d54000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d54000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d4c141ab0 0x7f1d4c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d54000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0cea30 con 0x7f1d4c13ef30 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d54000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c070c10 con 0x7f1d4c141ab0 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d54000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c072420 con 0x7f1d4c0ce5a0 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51296/0 (socket says 172.21.15.146:51296) 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 -- 172.21.15.146:0/1757117878 learned_addr learned my addr 172.21.15.146:0/1757117878 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d51600640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c0ce5a0 0x7f1d4c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 -- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c0ce5a0 msgr2=0x7f1d4c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c0ce5a0 0x7f1d4c0b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d52000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d4c141ab0 0x7f1d4c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 -- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d4c141ab0 msgr2=0x7f1d4c1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d4c141ab0 0x7f1d4c1445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.717+0000 7f1d50c00640 1 -- 172.21.15.146:0/1757117878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0b0100 con 0x7f1d4c13ef30 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d50c00640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e870 tx=0x7f1d3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c017070 con 0x7f1d4c13ef30 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c00c940 con 0x7f1d4c13ef30 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c00cd30 con 0x7f1d4c13ef30 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c0b03e0 con 0x7f1d4c13ef30 2024-04-24T23:00:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.718+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c0b09a0 con 0x7f1d4c13ef30 2024-04-24T23:00:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.719+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c04f5a0 con 0x7f1d4c13ef30 2024-04-24T23:00:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.720+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d3c01a070 con 0x7f1d4c13ef30 2024-04-24T23:00:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.721+0000 7f1d49600640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 0x7f1d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.722+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1d3c08b450 con 0x7f1d4c13ef30 2024-04-24T23:00:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.722+0000 7f1d51600640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 0x7f1d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.723+0000 7f1d51600640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 0x7f1d3006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d4002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.726+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1d3c059a80 con 0x7f1d4c13ef30 2024-04-24T23:00:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.925+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d4c0d0330 con 0x7f1d4c13ef30 2024-04-24T23:00:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.926+0000 7f1d49600640 1 -- 172.21.15.146:0/1757117878 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f1d3c059380 con 0x7f1d4c13ef30 2024-04-24T23:00:53.928 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 msgr2=0x7f1d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 0x7f1d3006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d4002e000 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 msgr2=0x7f1d4c06dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e870 tx=0x7f1d3c00ed30 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 shutdown_connections 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d4c141ab0 0x7f1d4c1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d4c13ef30 0x7f1d4c06dd60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1d3006be30 0x7f1d3006e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 --2- 172.21.15.146:0/1757117878 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1d4c0ce5a0 0x7f1d4c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 >> 172.21.15.146:0/1757117878 conn(0x7f1d4c0b17b0 msgr2=0x7f1d4c140190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.928+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 shutdown_connections 2024-04-24T23:00:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:53.929+0000 7f1d54000640 1 -- 172.21.15.146:0/1757117878 wait complete. 2024-04-24T23:00:53.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:54.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.155+0000 7f46ddc00640 1 Processor -- start 2024-04-24T23:00:54.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.156+0000 7f46ddc00640 1 -- start start 2024-04-24T23:00:54.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.157+0000 7f46ddc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 0x7f46d8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.157+0000 7f46ddc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d80ced40 con 0x7f46d80ce770 2024-04-24T23:00:54.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.157+0000 7f46ddc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d80cf020 con 0x7f46d8141ab0 2024-04-24T23:00:54.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.157+0000 7f46ddc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46d81423d0 con 0x7f46d813ef30 2024-04-24T23:00:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.158+0000 7f46d7400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f46d80ce770 0x7f46d8071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42518/0 (socket says 172.21.15.146:42518) 2024-04-24T23:00:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.158+0000 7f46d7400640 1 -- 172.21.15.146:0/2100139064 learned_addr learned my addr 172.21.15.146:0/2100139064 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.158+0000 7f46d6a00640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 0x7f46d8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.158+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499974391 0 0) 0x7f46d80ced40 con 0x7f46d80ce770 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.158+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46bc003520 con 0x7f46d80ce770 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2960652507 0 0) 0x7f46bc003520 con 0x7f46d80ce770 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 msgr2=0x7f46d8141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 0x7f46d8141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 >> v1:172.21.15.203:6789/0 conn(0x7f46d8141ab0 legacy=0x7f46d80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d80cf300 con 0x7f46d80ce770 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f46d0001670 con 0x7f46d80ce770 2024-04-24T23:00:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 >> v1:172.21.15.146:6789/0 conn(0x7f46d80ce770 legacy=0x7f46d8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc0039e0 0x7f46bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 0x7f46bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46bc004d40 0x7f46bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc00ba70 con 0x7f46bc004d40 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc00bc20 con 0x7f46bc0039e0 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc00be20 con 0x7f46d813ef30 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d7400640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46bc004d40 0x7f46bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.159+0000 7f46d6a00640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc0039e0 0x7f46bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d7400640 1 -- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 msgr2=0x7f46bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d7400640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d813ef30 0x7f46bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d7400640 1 -- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc0039e0 msgr2=0x7f46bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d7400640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc0039e0 0x7f46bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d7400640 1 -- 172.21.15.146:0/2100139064 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc003520 con 0x7f46bc004d40 2024-04-24T23:00:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.160+0000 7f46d6a00640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc0039e0 0x7f46bc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:54.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.161+0000 7f46d7400640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46bc004d40 0x7f46bc0051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c160 tx=0x7f46bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb410bf3aa249c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.161+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0007c60 con 0x7f46bc004d40 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.161+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d0005af0 con 0x7f46bc004d40 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.161+0000 7f46d5600640 1 -- 172.21.15.146:0/2100139064 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0007070 con 0x7f46bc004d40 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 -- 172.21.15.146:0/2100139064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46bc004d40 msgr2=0x7f46bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 --2- 172.21.15.146:0/2100139064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46bc004d40 0x7f46bc0051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c160 tx=0x7f46bc005830 comp rx=0 tx=0).stop 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46d7400640 1 -- 172.21.15.146:0/2100139064 reap_dead start 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 -- 172.21.15.146:0/2100139064 shutdown_connections 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 -- 172.21.15.146:0/2100139064 >> 172.21.15.146:0/2100139064 conn(0x7f46d80b17b0 msgr2=0x7f46d80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 -- 172.21.15.146:0/2100139064 shutdown_connections 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.162+0000 7f46ddc00640 1 -- 172.21.15.146:0/2100139064 wait complete. 2024-04-24T23:00:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.164+0000 7f46ddc00640 1 Processor -- start 2024-04-24T23:00:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.164+0000 7f46ddc00640 1 -- start start 2024-04-24T23:00:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 0x7f46d813b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d8133a50 0x7f46d8133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46d8141570 con 0x7f46d81527f0 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46d8070f80 con 0x7f46bc004d40 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46ddc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46d81416f0 con 0x7f46d8133a50 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51304/0 (socket says 172.21.15.146:51304) 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 -- 172.21.15.146:0/3429284139 learned_addr learned my addr 172.21.15.146:0/3429284139 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6a00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 0x7f46d813b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 -- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d8133a50 msgr2=0x7f46d8133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d8133a50 0x7f46d8133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 -- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 msgr2=0x7f46d813b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 0x7f46d813b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6000640 1 -- 172.21.15.146:0/3429284139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d8136310 con 0x7f46d81527f0 2024-04-24T23:00:54.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.165+0000 7f46d6a00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 0x7f46d813b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46d6000640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c4b0 tx=0x7f46c400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4017070 con 0x7f46d81527f0 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c40052d0 con 0x7f46d81527f0 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4003830 con 0x7f46d81527f0 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d8130720 con 0x7f46d81527f0 2024-04-24T23:00:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.166+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d8152580 con 0x7f46d81527f0 2024-04-24T23:00:54.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.167+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d804f5a0 con 0x7f46d81527f0 2024-04-24T23:00:54.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.168+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46c401a070 con 0x7f46d81527f0 2024-04-24T23:00:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.169+0000 7f46cea00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 0x7f46b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.169+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f46c408a5e0 con 0x7f46d81527f0 2024-04-24T23:00:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.170+0000 7f46d6a00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 0x7f46b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.171+0000 7f46d6a00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 0x7f46b806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46c8007520 tx=0x7f46c800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.174+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f46c4058b80 con 0x7f46d81527f0 2024-04-24T23:00:54.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.377+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f46d8072d30 con 0x7f46d81527f0 2024-04-24T23:00:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.378+0000 7f46cea00640 1 -- 172.21.15.146:0/3429284139 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f46c4058480 con 0x7f46d81527f0 2024-04-24T23:00:54.380 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 msgr2=0x7f46b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 0x7f46b806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46c8007520 tx=0x7f46c800b040 comp rx=0 tx=0).stop 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 msgr2=0x7f46d8152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c4b0 tx=0x7f46c400c970 comp rx=0 tx=0).stop 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 shutdown_connections 2024-04-24T23:00:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f46b806be30 0x7f46b806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46d8133a50 0x7f46d8133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d81527f0 0x7f46d8152040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 --2- 172.21.15.146:0/3429284139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46bc004d40 0x7f46d813b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 >> 172.21.15.146:0/3429284139 conn(0x7f46d80b17b0 msgr2=0x7f46d813fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 shutdown_connections 2024-04-24T23:00:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.381+0000 7f46ddc00640 1 -- 172.21.15.146:0/3429284139 wait complete. 2024-04-24T23:00:54.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:54.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.604+0000 7fe907200640 1 Processor -- start 2024-04-24T23:00:54.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.604+0000 7fe907200640 1 -- start start 2024-04-24T23:00:54.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.605+0000 7fe907200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9080d0240 0x7fe90806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.605+0000 7fe907200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9080ccb10 con 0x7fe90815a980 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.605+0000 7fe907200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90806ddc0 con 0x7fe908071dd0 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.605+0000 7fe907200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe908072240 con 0x7fe9080d0240 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe90815a980 0x7fe9080cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42522/0 (socket says 172.21.15.146:42522) 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905e00640 1 -- 172.21.15.146:0/3036106002 learned_addr learned my addr 172.21.15.146:0/3036106002 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905400640 1 --2- 172.21.15.146:0/3036106002 >> v2:172.21.15.146:3300/0 conn(0x7fe9080d0240 0x7fe90806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905400640 1 -- 172.21.15.146:0/3036106002 >> v1:172.21.15.203:6789/0 conn(0x7fe908071dd0 legacy=0x7fe9080ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:54.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905400640 1 -- 172.21.15.146:0/3036106002 >> v1:172.21.15.146:6789/0 conn(0x7fe90815a980 legacy=0x7fe9080cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.606+0000 7fe905400640 1 -- 172.21.15.146:0/3036106002 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90806e0a0 con 0x7fe9080d0240 2024-04-24T23:00:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.607+0000 7fe905400640 1 --2- 172.21.15.146:0/3036106002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90806d770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d847f3fbd6a9e92f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.607+0000 7fe904a00640 1 -- 172.21.15.146:0/3036106002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4037070 con 0x7fe9080d0240 2024-04-24T23:00:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.607+0000 7fe904a00640 1 -- 172.21.15.146:0/3036106002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f402ae50 con 0x7fe9080d0240 2024-04-24T23:00:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.607+0000 7fe904a00640 1 -- 172.21.15.146:0/3036106002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4032660 con 0x7fe9080d0240 2024-04-24T23:00:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 -- 172.21.15.146:0/3036106002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 msgr2=0x7fe90806d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 --2- 172.21.15.146:0/3036106002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90806d770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a140 comp rx=0 tx=0).stop 2024-04-24T23:00:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 -- 172.21.15.146:0/3036106002 shutdown_connections 2024-04-24T23:00:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 --2- 172.21.15.146:0/3036106002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90806d770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 -- 172.21.15.146:0/3036106002 >> 172.21.15.146:0/3036106002 conn(0x7fe90806b320 msgr2=0x7fe90806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 -- 172.21.15.146:0/3036106002 shutdown_connections 2024-04-24T23:00:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.608+0000 7fe907200640 1 -- 172.21.15.146:0/3036106002 wait complete. 2024-04-24T23:00:54.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.610+0000 7fe907200640 1 Processor -- start 2024-04-24T23:00:54.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.610+0000 7fe907200640 1 -- start start 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe908071dd0 0x7fe90815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 0x7fe9080ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe90806e660 con 0x7fe9080d0240 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9080aede0 con 0x7fe90815a980 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe907200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe90815ad60 con 0x7fe908071dd0 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe905400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe905400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51314/0 (socket says 172.21.15.146:51314) 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.611+0000 7fe905400640 1 -- 172.21.15.146:0/1821868319 learned_addr learned my addr 172.21.15.146:0/1821868319 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe906800640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 0x7fe9080ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 -- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe908071dd0 msgr2=0x7fe90815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe908071dd0 0x7fe90815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 -- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 msgr2=0x7fe9080ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 0x7fe9080ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 -- 172.21.15.146:0/1821868319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90814a900 con 0x7fe9080d0240 2024-04-24T23:00:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe906800640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 0x7fe9080ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe905400640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4000c00 tx=0x7fe8f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4041070 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f403c670 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4037040 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.612+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081e6790 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.613+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081e7030 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.614+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9081e6b80 con 0x7fe9080d0240 2024-04-24T23:00:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.615+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8f4044070 con 0x7fe9080d0240 2024-04-24T23:00:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.615+0000 7fe8fe000640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 0x7fe8e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.616+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe8f40ab810 con 0x7fe9080d0240 2024-04-24T23:00:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.616+0000 7fe905e00640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 0x7fe8e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.617+0000 7fe905e00640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 0x7fe8e806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000f60 tx=0x7fe8f8007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.620+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe90814a900 con 0x7fe9080d0240 2024-04-24T23:00:54.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.816+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9080af100 con 0x7fe9080d0240 2024-04-24T23:00:54.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.819+0000 7fe8fe000640 1 -- 172.21.15.146:0/1821868319 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fe8f4079db0 con 0x7fe9080d0240 2024-04-24T23:00:54.821 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:54.821 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 msgr2=0x7fe8e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 0x7fe8e806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8000f60 tx=0x7fe8f8007a80 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 msgr2=0x7fe90814a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4000c00 tx=0x7fe8f40046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 shutdown_connections 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe90815a980 0x7fe9080ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9080d0240 0x7fe90814a3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8e806be30 0x7fe8e806e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 --2- 172.21.15.146:0/1821868319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe908071dd0 0x7fe90815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.821+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 >> 172.21.15.146:0/1821868319 conn(0x7fe90806b320 msgr2=0x7fe9080cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.822+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 shutdown_connections 2024-04-24T23:00:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:54.822+0000 7fe907200640 1 -- 172.21.15.146:0/1821868319 wait complete. 2024-04-24T23:00:54.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:54.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.041+0000 7f9332600640 1 Processor -- start 2024-04-24T23:00:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.041+0000 7f9332600640 1 -- start start 2024-04-24T23:00:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f9332600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 0x7f932c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f9332600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c0d0a00 0x7f932c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f9332600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f932c162c40 con 0x7f932c0b2a90 2024-04-24T23:00:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f9332600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f932c06dd00 con 0x7f932c0d0a00 2024-04-24T23:00:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f9332600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f932c0b3160 con 0x7f932c0b2360 2024-04-24T23:00:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f932be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c0d0a00 0x7f932c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f932be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c0d0a00 0x7f932c0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51320/0 (socket says 172.21.15.146:51320) 2024-04-24T23:00:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.043+0000 7f932be00640 1 -- 172.21.15.146:0/2676893620 learned_addr learned my addr 172.21.15.146:0/2676893620 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932b400640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 0x7f932c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932be00640 1 -- 172.21.15.146:0/2676893620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 msgr2=0x7f932c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932be00640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 0x7f932c0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932be00640 1 -- 172.21.15.146:0/2676893620 >> v1:172.21.15.203:6789/0 conn(0x7f932c0b2a90 legacy=0x7f932c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932be00640 1 -- 172.21.15.146:0/2676893620 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932c0b3440 con 0x7f932c0d0a00 2024-04-24T23:00:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.044+0000 7f932b400640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 0x7f932c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.045+0000 7f932be00640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0d0a00 0x7f932c0cccd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9324009870 tx=0x7f932402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3415b4a529b75f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.045+0000 7f932a000640 1 -- 172.21.15.146:0/2676893620 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324037070 con 0x7f932c0d0a00 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f932a000640 1 -- 172.21.15.146:0/2676893620 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9324032440 con 0x7f932c0d0a00 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f932a000640 1 -- 172.21.15.146:0/2676893620 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324032810 con 0x7f932c0d0a00 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 -- 172.21.15.146:0/2676893620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0d0a00 msgr2=0x7f932c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0d0a00 0x7f932c0cccd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9324009870 tx=0x7f932402a250 comp rx=0 tx=0).stop 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 -- 172.21.15.146:0/2676893620 shutdown_connections 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0d0a00 0x7f932c0cccd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 --2- 172.21.15.146:0/2676893620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0b2360 0x7f932c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 -- 172.21.15.146:0/2676893620 >> 172.21.15.146:0/2676893620 conn(0x7f932c0b37f0 msgr2=0x7f932c0b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 -- 172.21.15.146:0/2676893620 shutdown_connections 2024-04-24T23:00:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.046+0000 7f9332600640 1 -- 172.21.15.146:0/2676893620 wait complete. 2024-04-24T23:00:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.048+0000 7f9332600640 1 Processor -- start 2024-04-24T23:00:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.048+0000 7f9332600640 1 -- start start 2024-04-24T23:00:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f932c0b2360 0x7f932c1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0d0a00 0x7f932c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f932c0b28c0 con 0x7f932c0b2a90 2024-04-24T23:00:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f932c0b2740 con 0x7f932c0b2360 2024-04-24T23:00:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f9332600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f932c161f90 con 0x7f932c0d0a00 2024-04-24T23:00:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f932aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f932aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51330/0 (socket says 172.21.15.146:51330) 2024-04-24T23:00:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.049+0000 7f932aa00640 1 -- 172.21.15.146:0/3625590009 learned_addr learned my addr 172.21.15.146:0/3625590009 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 -- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0d0a00 msgr2=0x7f932c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0d0a00 0x7f932c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 -- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f932c0b2360 msgr2=0x7f932c1f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f932c0b2360 0x7f932c1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 -- 172.21.15.146:0/3625590009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932c1609a0 con 0x7f932c0b2a90 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f932aa00640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f931800c400 tx=0x7f931800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93180052d0 con 0x7f932c0b2a90 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9318005490 con 0x7f932c0b2a90 2024-04-24T23:00:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318007260 con 0x7f932c0b2a90 2024-04-24T23:00:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.050+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932c160c80 con 0x7f932c0b2a90 2024-04-24T23:00:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.051+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932c161240 con 0x7f932c0b2a90 2024-04-24T23:00:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.052+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f932c04f5a0 con 0x7f932c0b2a90 2024-04-24T23:00:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.053+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9318007400 con 0x7f932c0b2a90 2024-04-24T23:00:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.053+0000 7f9323400640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 0x7f930c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.054+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f931808a7b0 con 0x7f932c0b2a90 2024-04-24T23:00:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.054+0000 7f932b400640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 0x7f930c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.055+0000 7f932b400640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 0x7f930c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f931c008ea0 tx=0x7f931c0083d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.058+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9318058d50 con 0x7f932c0b2a90 2024-04-24T23:00:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.263+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f932c0b7c20 con 0x7f932c0b2a90 2024-04-24T23:00:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.264+0000 7f9323400640 1 -- 172.21.15.146:0/3625590009 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f9318058650 con 0x7f932c0b2a90 2024-04-24T23:00:55.266 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 msgr2=0x7f930c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 0x7f930c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f931c008ea0 tx=0x7f931c0083d0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 msgr2=0x7f932c15ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f931800c400 tx=0x7f931800c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 shutdown_connections 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f930c06be30 0x7f930c06e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f932c0d0a00 0x7f932c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c0b2a90 0x7f932c15ea90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 --2- 172.21.15.146:0/3625590009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f932c0b2360 0x7f932c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 >> 172.21.15.146:0/3625590009 conn(0x7f932c0b37f0 msgr2=0x7f932c0d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 shutdown_connections 2024-04-24T23:00:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.266+0000 7f9332600640 1 -- 172.21.15.146:0/3625590009 wait complete. 2024-04-24T23:00:55.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:55.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.489+0000 7fa265c00640 1 Processor -- start 2024-04-24T23:00:55.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.490+0000 7fa265c00640 1 -- start start 2024-04-24T23:00:55.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa2600b4690 0x7fa2601627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26006e3f0 con 0x7fa260070e60 2024-04-24T23:00:55.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26015cc20 con 0x7fa26015c840 2024-04-24T23:00:55.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa260162d30 con 0x7fa2600b4690 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa260070e60 0x7fa2600cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42528/0 (socket says 172.21.15.146:42528) 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.491+0000 7fa265200640 1 -- 172.21.15.146:0/3419619765 learned_addr learned my addr 172.21.15.146:0/3419619765 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796335439 0 0) 0x7fa26006e3f0 con 0x7fa260070e60 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa257400640 1 --2- 172.21.15.146:0/3419619765 >> v2:172.21.15.203:3300/0 conn(0x7fa2600b4690 0x7fa2601627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa244003520 con 0x7fa260070e60 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 779637924 0 0) 0x7fa244003520 con 0x7fa260070e60 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 >> v2:172.21.15.203:3300/0 conn(0x7fa2600b4690 msgr2=0x7fa2601627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 --2- 172.21.15.146:0/3419619765 >> v2:172.21.15.203:3300/0 conn(0x7fa2600b4690 0x7fa2601627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 >> v1:172.21.15.203:6789/0 conn(0x7fa26015c840 legacy=0x7fa2601664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa260162f60 con 0x7fa260070e60 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fa2580019f0 con 0x7fa260070e60 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 >> v1:172.21.15.146:6789/0 conn(0x7fa260070e60 legacy=0x7fa2600cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa244003a00 0x7fa244003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa24400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa24400c130 con 0x7fa244005210 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa24400c2e0 con 0x7fa244003a00 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.492+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa24400c4e0 con 0x7fa244004800 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa24400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa25fe00640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa244003a00 0x7fa244003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 -- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa244004800 msgr2=0x7fa244004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa257400640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa244004800 0x7fa244004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 -- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa244003a00 msgr2=0x7fa244003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa244003a00 0x7fa244003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.493+0000 7fa265200640 1 -- 172.21.15.146:0/3419619765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa244003520 con 0x7fa244005210 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.494+0000 7fa265200640 1 -- 172.21.15.146:0/3419619765 reap_dead start 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.494+0000 7fa265200640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa24400b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa25800a7b0 tx=0x7fa244005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05684adbeeb2cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.494+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25800a3d0 con 0x7fa244005210 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.494+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25802f070 con 0x7fa244005210 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.494+0000 7fa25f400640 1 -- 172.21.15.146:0/3419619765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25802bc20 con 0x7fa244005210 2024-04-24T23:00:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 -- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 msgr2=0x7fa24400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa24400b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa25800a7b0 tx=0x7fa244005830 comp rx=0 tx=0).stop 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 -- 172.21.15.146:0/3419619765 shutdown_connections 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 --2- 172.21.15.146:0/3419619765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa24400b9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 -- 172.21.15.146:0/3419619765 >> 172.21.15.146:0/3419619765 conn(0x7fa26006b560 msgr2=0x7fa26006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 -- 172.21.15.146:0/3419619765 shutdown_connections 2024-04-24T23:00:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.495+0000 7fa265c00640 1 -- 172.21.15.146:0/3419619765 wait complete. 2024-04-24T23:00:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.497+0000 7fa265c00640 1 Processor -- start 2024-04-24T23:00:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.497+0000 7fa265c00640 1 -- start start 2024-04-24T23:00:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa260163760 0x7fa260163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2600a9540 0x7fa2600a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa260163520 con 0x7fa244005210 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa260166010 con 0x7fa260163760 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa265c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa2601627f0 con 0x7fa2600a9540 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51354/0 (socket says 172.21.15.146:51354) 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.498+0000 7fa25fe00640 1 -- 172.21.15.146:0/3782310522 learned_addr learned my addr 172.21.15.146:0/3782310522 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 -- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2600a9540 msgr2=0x7fa2600a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2600a9540 0x7fa2600a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 -- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa260163760 msgr2=0x7fa260163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa260163760 0x7fa260163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 -- 172.21.15.146:0/3782310522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600ab360 con 0x7fa244005210 2024-04-24T23:00:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25fe00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa25000e470 tx=0x7fa25000e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500052e0 con 0x7fa244005210 2024-04-24T23:00:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250018070 con 0x7fa244005210 2024-04-24T23:00:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250003810 con 0x7fa244005210 2024-04-24T23:00:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2600aa2c0 con 0x7fa244005210 2024-04-24T23:00:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.499+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2600aa880 con 0x7fa244005210 2024-04-24T23:00:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.500+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa260164120 con 0x7fa244005210 2024-04-24T23:00:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.501+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2500039b0 con 0x7fa244005210 2024-04-24T23:00:55.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.502+0000 7fa25cc00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.502+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa25008ae40 con 0x7fa244005210 2024-04-24T23:00:55.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.503+0000 7fa257400640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.504+0000 7fa257400640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 0x7fa23c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa248006a90 tx=0x7fa248006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.507+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa2500593e0 con 0x7fa244005210 2024-04-24T23:00:55.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.704+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa26004f500 con 0x7fa244005210 2024-04-24T23:00:55.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.704+0000 7fa25cc00640 1 -- 172.21.15.146:0/3782310522 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fa250058ce0 con 0x7fa244005210 2024-04-24T23:00:55.706 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 msgr2=0x7fa23c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 0x7fa23c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa248006a90 tx=0x7fa248006a20 comp rx=0 tx=0).stop 2024-04-24T23:00:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 msgr2=0x7fa26014da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa25000e470 tx=0x7fa25000e930 comp rx=0 tx=0).stop 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 shutdown_connections 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be30 0x7fa23c06e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2600a9540 0x7fa2600a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa260163760 0x7fa260163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 --2- 172.21.15.146:0/3782310522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa244005210 0x7fa26014da80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 >> 172.21.15.146:0/3782310522 conn(0x7fa26006b560 msgr2=0x7fa2600b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 shutdown_connections 2024-04-24T23:00:55.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.707+0000 7fa265c00640 1 -- 172.21.15.146:0/3782310522 wait complete. 2024-04-24T23:00:55.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:55.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.922+0000 7f98e8c00640 1 Processor -- start 2024-04-24T23:00:55.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.922+0000 7f98e8c00640 1 -- start start 2024-04-24T23:00:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.924+0000 7f98e8c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 0x7f98e40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.924+0000 7f98e8c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98e40d03d0 0x7f98e415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.924+0000 7f98e8c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e40b4df0 con 0x7f98e415cd60 2024-04-24T23:00:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.924+0000 7f98e8c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f98e415c8d0 con 0x7f98e40d03d0 2024-04-24T23:00:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.924+0000 7f98e8c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98e40b4b10 con 0x7f98e415bcd0 2024-04-24T23:00:55.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 0x7f98e40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98e40d03d0 0x7f98e415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e2a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f98e415cd60 0x7f98e40cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:58672/0 (socket says 172.21.15.146:58672) 2024-04-24T23:00:55.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e2a00640 1 -- 172.21.15.146:0/267931202 learned_addr learned my addr 172.21.15.146:0/267931202 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:55.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3400640 1 -- 172.21.15.146:0/267931202 >> v2:172.21.15.203:3300/0 conn(0x7f98e40d03d0 msgr2=0x7f98e415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3400640 1 --2- 172.21.15.146:0/267931202 >> v2:172.21.15.203:3300/0 conn(0x7f98e40d03d0 0x7f98e415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3400640 1 -- 172.21.15.146:0/267931202 >> v1:172.21.15.203:6789/0 conn(0x7f98e415cd60 legacy=0x7f98e40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.925+0000 7f98e3400640 1 -- 172.21.15.146:0/267931202 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e415c280 con 0x7f98e415bcd0 2024-04-24T23:00:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.927+0000 7f98e3400640 1 --2- 172.21.15.146:0/267931202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 0x7f98e40cc230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98d40097a0 tx=0x7f98d402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b26d736195d31e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.927+0000 7f98e2000640 1 -- 172.21.15.146:0/267931202 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4037070 con 0x7f98e415bcd0 2024-04-24T23:00:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.927+0000 7f98e2000640 1 -- 172.21.15.146:0/267931202 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4032440 con 0x7f98e415bcd0 2024-04-24T23:00:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.927+0000 7f98e2000640 1 -- 172.21.15.146:0/267931202 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4032810 con 0x7f98e415bcd0 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 -- 172.21.15.146:0/267931202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 msgr2=0x7f98e40cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 --2- 172.21.15.146:0/267931202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 0x7f98e40cc230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98d40097a0 tx=0x7f98d402a180 comp rx=0 tx=0).stop 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 -- 172.21.15.146:0/267931202 shutdown_connections 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 --2- 172.21.15.146:0/267931202 >> v2:172.21.15.203:3300/0 conn(0x7f98e40d03d0 0x7f98e415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 --2- 172.21.15.146:0/267931202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e415bcd0 0x7f98e40cc230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 -- 172.21.15.146:0/267931202 >> 172.21.15.146:0/267931202 conn(0x7f98e406b560 msgr2=0x7f98e406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 -- 172.21.15.146:0/267931202 shutdown_connections 2024-04-24T23:00:55.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.928+0000 7f98e8c00640 1 -- 172.21.15.146:0/267931202 wait complete. 2024-04-24T23:00:55.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.930+0000 7f98e8c00640 1 Processor -- start 2024-04-24T23:00:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.930+0000 7f98e8c00640 1 -- start start 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e40d03d0 0x7f98e415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98e415bcd0 0x7f98e4150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98e406e590 con 0x7f98e415cd60 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98e40cc770 con 0x7f98e415bcd0 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e8c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98e40b4790 con 0x7f98e40d03d0 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51358/0 (socket says 172.21.15.146:51358) 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e3e00640 1 -- 172.21.15.146:0/3510787929 learned_addr learned my addr 172.21.15.146:0/3510787929 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e3400640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e40d03d0 0x7f98e415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.931+0000 7f98e2a00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98e415bcd0 0x7f98e4150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 -- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e40d03d0 msgr2=0x7f98e415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e40d03d0 0x7f98e415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 -- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98e415bcd0 msgr2=0x7f98e4150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98e415bcd0 0x7f98e4150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 -- 172.21.15.146:0/3510787929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e4151a00 con 0x7f98e415cd60 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98e3e00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00efc0 tx=0x7f98dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc018020 con 0x7f98e415cd60 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.932+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc014480 con 0x7f98e415cd60 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.933+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e4151ce0 con 0x7f98e415cd60 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.933+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc014870 con 0x7f98e415cd60 2024-04-24T23:00:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.933+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e41522a0 con 0x7f98e415cd60 2024-04-24T23:00:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.934+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e406dcb0 con 0x7f98e415cd60 2024-04-24T23:00:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.935+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98dc005d10 con 0x7f98e415cd60 2024-04-24T23:00:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.936+0000 7f98db400640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.936+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f98dc08c110 con 0x7f98e415cd60 2024-04-24T23:00:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.937+0000 7f98e3400640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:55.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.938+0000 7f98e3400640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98d4034000 tx=0x7f98d402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:55.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:55.940+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98e406dcb0 con 0x7f98e415cd60 2024-04-24T23:00:56.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.140+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f98e40cf030 con 0x7f98e415cd60 2024-04-24T23:00:56.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.142+0000 7f98db400640 1 -- 172.21.15.146:0/3510787929 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f98dc022030 con 0x7f98e415cd60 2024-04-24T23:00:56.144 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.144+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 msgr2=0x7f98c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.144+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 0x7f98c406e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98d4034000 tx=0x7f98d402e000 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.144+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 msgr2=0x7f98e4151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.144+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00efc0 tx=0x7f98dc00c490 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 shutdown_connections 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98e415cd60 0x7f98e4151330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98e415bcd0 0x7f98e4150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98c406be30 0x7f98c406e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 --2- 172.21.15.146:0/3510787929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98e40d03d0 0x7f98e415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 >> 172.21.15.146:0/3510787929 conn(0x7f98e406b560 msgr2=0x7f98e41589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 shutdown_connections 2024-04-24T23:00:56.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.145+0000 7f98e8c00640 1 -- 172.21.15.146:0/3510787929 wait complete. 2024-04-24T23:00:56.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:56.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.370+0000 7f7fc4400640 1 Processor -- start 2024-04-24T23:00:56.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.370+0000 7f7fc4400640 1 -- start start 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7fbc13ef30 0x7f7fbc141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc141ab0 0x7f7fbc0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc1423d0 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc070f80 con 0x7f7fbc13ef30 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc4400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc0ced40 con 0x7f7fbc141ab0 2024-04-24T23:00:56.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51372/0 (socket says 172.21.15.146:51372) 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc2400640 1 -- 172.21.15.146:0/4259503202 learned_addr learned my addr 172.21.15.146:0/4259503202 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc1000640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc141ab0 0x7f7fbc0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.372+0000 7f7fc1a00640 1 --2- 172.21.15.146:0/4259503202 >> v2:172.21.15.203:3300/0 conn(0x7f7fbc13ef30 0x7f7fbc141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.373+0000 7f7fc2400640 1 -- 172.21.15.146:0/4259503202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc141ab0 msgr2=0x7f7fbc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.373+0000 7f7fc2400640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc141ab0 0x7f7fbc0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.373+0000 7f7fc2400640 1 -- 172.21.15.146:0/4259503202 >> v2:172.21.15.203:3300/0 conn(0x7f7fbc13ef30 msgr2=0x7f7fbc141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.373+0000 7f7fc2400640 1 --2- 172.21.15.146:0/4259503202 >> v2:172.21.15.203:3300/0 conn(0x7f7fbc13ef30 0x7f7fbc141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.373+0000 7f7fc2400640 1 -- 172.21.15.146:0/4259503202 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc0cf020 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.374+0000 7f7fc2400640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0707a0 tx=0x7f7fb402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b59e152e682aba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.374+0000 7f7fbbe00640 1 -- 172.21.15.146:0/4259503202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4036070 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.374+0000 7f7fbbe00640 1 -- 172.21.15.146:0/4259503202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4031600 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.374+0000 7f7fbbe00640 1 -- 172.21.15.146:0/4259503202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40319d0 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 -- 172.21.15.146:0/4259503202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc0ce5a0 msgr2=0x7f7fbc15fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0707a0 tx=0x7f7fb402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 -- 172.21.15.146:0/4259503202 shutdown_connections 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc0ce5a0 0x7f7fbc15fa00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 --2- 172.21.15.146:0/4259503202 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc141ab0 0x7f7fbc0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 --2- 172.21.15.146:0/4259503202 >> v2:172.21.15.203:3300/0 conn(0x7f7fbc13ef30 0x7f7fbc141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 -- 172.21.15.146:0/4259503202 >> 172.21.15.146:0/4259503202 conn(0x7f7fbc0b17b0 msgr2=0x7f7fbc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 -- 172.21.15.146:0/4259503202 shutdown_connections 2024-04-24T23:00:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.375+0000 7f7fc4400640 1 -- 172.21.15.146:0/4259503202 wait complete. 2024-04-24T23:00:56.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.377+0000 7f7fc4400640 1 Processor -- start 2024-04-24T23:00:56.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.377+0000 7f7fc4400640 1 -- start start 2024-04-24T23:00:56.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc0ce5a0 0x7f7fbc13b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 0x7f7fbc13cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0cea30 con 0x7f7fbc141ab0 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc070c10 con 0x7f7fbc13ef30 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc4400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc15ff40 con 0x7f7fbc0ce5a0 2024-04-24T23:00:56.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51374/0 (socket says 172.21.15.146:51374) 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 -- 172.21.15.146:0/3321641905 learned_addr learned my addr 172.21.15.146:0/3321641905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc1a00640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc0ce5a0 0x7f7fbc13b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc1000640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 0x7f7fbc13cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 -- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc0ce5a0 msgr2=0x7f7fbc13b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc0ce5a0 0x7f7fbc13b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 -- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 msgr2=0x7f7fbc13cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 0x7f7fbc13cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc2400640 1 -- 172.21.15.146:0/3321641905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc0b2fe0 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.378+0000 7f7fc1000640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 0x7f7fbc13cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fc2400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4034040 tx=0x7f7fb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4041020 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb40077a0 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4036040 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc0b32c0 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.379+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc0b3880 con 0x7f7fbc141ab0 2024-04-24T23:00:56.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.381+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fbc04f5a0 con 0x7f7fbc141ab0 2024-04-24T23:00:56.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.381+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb4044020 con 0x7f7fbc141ab0 2024-04-24T23:00:56.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.382+0000 7f7fb9600640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 0x7f7f9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.382+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7fb40abe60 con 0x7f7fbc141ab0 2024-04-24T23:00:56.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.383+0000 7f7fc1a00640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 0x7f7f9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.384+0000 7f7fc1a00640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 0x7f7f9c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0006fd0 tx=0x7f7fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.387+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7fb404b030 con 0x7f7fbc141ab0 2024-04-24T23:00:56.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.584+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7fbc072d30 con 0x7f7fbc141ab0 2024-04-24T23:00:56.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.585+0000 7f7fb9600640 1 -- 172.21.15.146:0/3321641905 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f7fb407a530 con 0x7f7fbc141ab0 2024-04-24T23:00:56.587 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:56.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 msgr2=0x7f7f9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 0x7f7f9c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0006fd0 tx=0x7f7fb0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:56.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 msgr2=0x7f7fbc13d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4034040 tx=0x7f7fb4004a40 comp rx=0 tx=0).stop 2024-04-24T23:00:56.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 shutdown_connections 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fbc141ab0 0x7f7fbc13d4c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7fbc13ef30 0x7f7fbc13cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f9c06be30 0x7f7f9c06e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 --2- 172.21.15.146:0/3321641905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7fbc0ce5a0 0x7f7fbc13b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 >> 172.21.15.146:0/3321641905 conn(0x7f7fbc0b17b0 msgr2=0x7f7fbc0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 shutdown_connections 2024-04-24T23:00:56.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.588+0000 7f7fc4400640 1 -- 172.21.15.146:0/3321641905 wait complete. 2024-04-24T23:00:56.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.797+0000 7f83b7200640 1 Processor -- start 2024-04-24T23:00:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.797+0000 7f83b7200640 1 -- start start 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83b80b31d0 0x7f83b815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 0x7f83b815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f83b80b2cf0 con 0x7f83b80b31d0 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f83b806cd70 con 0x7f83b815dd50 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83b7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f83b806d050 con 0x7f83b80cec90 2024-04-24T23:00:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83ad400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83b80b31d0 0x7f83b815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83ad400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83b80b31d0 0x7f83b815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51378/0 (socket says 172.21.15.146:51378) 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.799+0000 7f83ad400640 1 -- 172.21.15.146:0/3232426066 learned_addr learned my addr 172.21.15.146:0/3232426066 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83b5e00640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83b6800640 1 --2- 172.21.15.146:0/3232426066 >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 0x7f83b815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83ad400640 1 -- 172.21.15.146:0/3232426066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 msgr2=0x7f83b806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83ad400640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83ad400640 1 -- 172.21.15.146:0/3232426066 >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 msgr2=0x7f83b815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83ad400640 1 --2- 172.21.15.146:0/3232426066 >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 0x7f83b815e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83ad400640 1 -- 172.21.15.146:0/3232426066 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b806d330 con 0x7f83b80b31d0 2024-04-24T23:00:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83b5e00640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.800+0000 7f83b6800640 1 --2- 172.21.15.146:0/3232426066 >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 0x7f83b815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.801+0000 7f83ad400640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b80b31d0 0x7f83b815d810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cc1a0 tx=0x7f83a002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174106b4ff3c312 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b5400640 1 -- 172.21.15.146:0/3232426066 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0037070 con 0x7f83b80b31d0 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b5400640 1 -- 172.21.15.146:0/3232426066 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a0032440 con 0x7f83b80b31d0 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b5400640 1 -- 172.21.15.146:0/3232426066 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0032810 con 0x7f83b80b31d0 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 -- 172.21.15.146:0/3232426066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b80b31d0 msgr2=0x7f83b815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b80b31d0 0x7f83b815d810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cc1a0 tx=0x7f83a002a140 comp rx=0 tx=0).stop 2024-04-24T23:00:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 -- 172.21.15.146:0/3232426066 shutdown_connections 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b80b31d0 0x7f83b815d810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 --2- 172.21.15.146:0/3232426066 >> v2:172.21.15.203:3300/0 conn(0x7f83b815dd50 0x7f83b815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 --2- 172.21.15.146:0/3232426066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 -- 172.21.15.146:0/3232426066 >> 172.21.15.146:0/3232426066 conn(0x7f83b80d1ba0 msgr2=0x7f83b80d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 -- 172.21.15.146:0/3232426066 shutdown_connections 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.802+0000 7f83b7200640 1 -- 172.21.15.146:0/3232426066 wait complete. 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.804+0000 7f83b7200640 1 Processor -- start 2024-04-24T23:00:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.804+0000 7f83b7200640 1 -- start start 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83b80b31d0 0x7f83b8158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b8159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80b15c0 con 0x7f83b815dd50 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80b1440 con 0x7f83b80b31d0 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f83b80b1740 con 0x7f83b80cec90 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51392/0 (socket says 172.21.15.146:51392) 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.805+0000 7f83b6800640 1 -- 172.21.15.146:0/2857007129 learned_addr learned my addr 172.21.15.146:0/2857007129 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 -- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 msgr2=0x7f83b8159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 -- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83b80b31d0 msgr2=0x7f83b8158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83b80b31d0 0x7f83b8158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 -- 172.21.15.146:0/2857007129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b8158990 con 0x7f83b815dd50 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b6800640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83b000cd50 tx=0x7f83b000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000f680 con 0x7f83b815dd50 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b000f840 con 0x7f83b815dd50 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000fc30 con 0x7f83b815dd50 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.806+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b815a1c0 con 0x7f83b815dd50 2024-04-24T23:00:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.807+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b815a780 con 0x7f83b815dd50 2024-04-24T23:00:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.808+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b804f500 con 0x7f83b815dd50 2024-04-24T23:00:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.809+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b000e3e0 con 0x7f83b815dd50 2024-04-24T23:00:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.809+0000 7f83aea00640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 0x7f839406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.810+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f83b008bef0 con 0x7f83b815dd50 2024-04-24T23:00:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.810+0000 7f83b5e00640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 0x7f839406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.811+0000 7f83b5e00640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 0x7f839406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83a800a8b0 tx=0x7f83a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:56.815+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f83b0014030 con 0x7f83b815dd50 2024-04-24T23:00:57.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.012+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83b806f1f0 con 0x7f83b815dd50 2024-04-24T23:00:57.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.014+0000 7f83aea00640 1 -- 172.21.15.146:0/2857007129 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7f83b00152b0 con 0x7f83b815dd50 2024-04-24T23:00:57.017 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:57.017 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 msgr2=0x7f839406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 0x7f839406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83a800a8b0 tx=0x7f83a8008040 comp rx=0 tx=0).stop 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 msgr2=0x7f83b815ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f83b000cd50 tx=0x7f83b000a650 comp rx=0 tx=0).stop 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 shutdown_connections 2024-04-24T23:00:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83b815dd50 0x7f83b815ffc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f839406be60 0x7f839406e320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83b80cec90 0x7f83b8159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 --2- 172.21.15.146:0/2857007129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83b80b31d0 0x7f83b8158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 >> 172.21.15.146:0/2857007129 conn(0x7f83b80d1ba0 msgr2=0x7f83b80b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 shutdown_connections 2024-04-24T23:00:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.017+0000 7f83b7200640 1 -- 172.21.15.146:0/2857007129 wait complete. 2024-04-24T23:00:57.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:57.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.237+0000 7f1034a00640 1 Processor -- start 2024-04-24T23:00:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.237+0000 7f1034a00640 1 -- start start 2024-04-24T23:00:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1034a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f103015bcd0 0x7f10300cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1034a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10300d03d0 0x7f103015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1034a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10300b4df0 con 0x7f103015cd60 2024-04-24T23:00:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1034a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f103015c8d0 con 0x7f103015bcd0 2024-04-24T23:00:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1034a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10300b4b10 con 0x7f10300d03d0 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f102f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f103015bcd0 0x7f10300cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.239+0000 7f1027e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f103015cd60 0x7f10300cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42532/0 (socket says 172.21.15.146:42532) 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f102f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f103015bcd0 0x7f10300cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51402/0 (socket says 172.21.15.146:51402) 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f1027e00640 1 -- 172.21.15.146:0/3526085631 learned_addr learned my addr 172.21.15.146:0/3526085631 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f102f400640 1 -- 172.21.15.146:0/3526085631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10300d03d0 msgr2=0x7f103015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f102f400640 1 --2- 172.21.15.146:0/3526085631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10300d03d0 0x7f103015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f102f400640 1 -- 172.21.15.146:0/3526085631 >> v1:172.21.15.146:6789/0 conn(0x7f103015cd60 legacy=0x7f10300cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.240+0000 7f102f400640 1 -- 172.21.15.146:0/3526085631 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103015c280 con 0x7f103015bcd0 2024-04-24T23:00:57.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.241+0000 7f102f400640 1 --2- 172.21.15.146:0/3526085631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f103015bcd0 0x7f10300cc230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10200097a0 tx=0x7f102002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a2ae8bec5a7b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.241+0000 7f102ea00640 1 -- 172.21.15.146:0/3526085631 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020037070 con 0x7f103015bcd0 2024-04-24T23:00:57.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.241+0000 7f102ea00640 1 -- 172.21.15.146:0/3526085631 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1020032440 con 0x7f103015bcd0 2024-04-24T23:00:57.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.241+0000 7f102ea00640 1 -- 172.21.15.146:0/3526085631 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020032810 con 0x7f103015bcd0 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 -- 172.21.15.146:0/3526085631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f103015bcd0 msgr2=0x7f10300cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 --2- 172.21.15.146:0/3526085631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f103015bcd0 0x7f10300cc230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10200097a0 tx=0x7f102002a180 comp rx=0 tx=0).stop 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 -- 172.21.15.146:0/3526085631 shutdown_connections 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 --2- 172.21.15.146:0/3526085631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10300d03d0 0x7f103015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 --2- 172.21.15.146:0/3526085631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f103015bcd0 0x7f10300cc230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 -- 172.21.15.146:0/3526085631 >> 172.21.15.146:0/3526085631 conn(0x7f103006b560 msgr2=0x7f103006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:57.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 -- 172.21.15.146:0/3526085631 shutdown_connections 2024-04-24T23:00:57.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.242+0000 7f1034a00640 1 -- 172.21.15.146:0/3526085631 wait complete. 2024-04-24T23:00:57.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.244+0000 7f1034a00640 1 Processor -- start 2024-04-24T23:00:57.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.244+0000 7f1034a00640 1 -- start start 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f103015bcd0 0x7f10301e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f103015cd60 0x7f10300ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f103006e590 con 0x7f10300d03d0 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10300cc770 con 0x7f103015cd60 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1034a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10300b4790 con 0x7f103015bcd0 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f102f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f102f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51406/0 (socket says 172.21.15.146:51406) 2024-04-24T23:00:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f102f400640 1 -- 172.21.15.146:0/2597052679 learned_addr learned my addr 172.21.15.146:0/2597052679 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f102f400640 1 -- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f103015bcd0 msgr2=0x7f10301e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f1027e00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f103015bcd0 0x7f10301e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.245+0000 7f102fe00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f103015cd60 0x7f10300ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f102f400640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f103015bcd0 0x7f10301e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f102f400640 1 -- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f103015cd60 msgr2=0x7f10300ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f102f400640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f103015cd60 0x7f10300ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f102f400640 1 -- 172.21.15.146:0/2597052679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1030153390 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f102f400640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f10200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020041070 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102003c930 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020037040 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10301e6070 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.246+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10301e6630 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.248+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1030068c40 con 0x7f10300d03d0 2024-04-24T23:00:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.249+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1020044070 con 0x7f10300d03d0 2024-04-24T23:00:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.249+0000 7f1027400640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 0x7f100c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.250+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f10200ac0b0 con 0x7f10300d03d0 2024-04-24T23:00:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.250+0000 7f1027e00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 0x7f100c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.251+0000 7f1027e00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 0x7f100c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10300cff70 tx=0x7f1018009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.254+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1030068c40 con 0x7f10300d03d0 2024-04-24T23:00:57.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.440+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10301e6800 con 0x7f10300d03d0 2024-04-24T23:00:57.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.441+0000 7f1027400640 1 -- 172.21.15.146:0/2597052679 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f102007a770 con 0x7f10300d03d0 2024-04-24T23:00:57.442 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:57.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 msgr2=0x7f100c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 0x7f100c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10300cff70 tx=0x7f1018009040 comp rx=0 tx=0).stop 2024-04-24T23:00:57.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 msgr2=0x7f10301e5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f10200046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 shutdown_connections 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f103015cd60 0x7f10300ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f100c06be30 0x7f100c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f103015bcd0 0x7f10301e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 --2- 172.21.15.146:0/2597052679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10300d03d0 0x7f10301e5a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 >> 172.21.15.146:0/2597052679 conn(0x7f103006b560 msgr2=0x7f10300cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 shutdown_connections 2024-04-24T23:00:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.443+0000 7f1034a00640 1 -- 172.21.15.146:0/2597052679 wait complete. 2024-04-24T23:00:57.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:57.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.663+0000 7fae2a200640 1 Processor -- start 2024-04-24T23:00:57.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.664+0000 7fae2a200640 1 -- start start 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.665+0000 7fae2a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.665+0000 7fae2a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae240ce5a0 0x7fae24071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.665+0000 7fae2a200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae240ced40 con 0x7fae2413ef30 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.665+0000 7fae2a200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fae241423d0 con 0x7fae240ce5a0 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.665+0000 7fae2a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae24070f80 con 0x7fae24141c80 2024-04-24T23:00:57.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae240ce5a0 0x7fae24071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae240ce5a0 0x7fae24071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51410/0 (socket says 172.21.15.146:51410) 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 -- 172.21.15.146:0/1602215786 learned_addr learned my addr 172.21.15.146:0/1602215786 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae1aa00640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 -- 172.21.15.146:0/1602215786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 msgr2=0x7fae240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae240ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 -- 172.21.15.146:0/1602215786 >> v1:172.21.15.203:6789/0 conn(0x7fae2413ef30 legacy=0x7fae24141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae23e00640 1 -- 172.21.15.146:0/1602215786 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae240cf020 con 0x7fae240ce5a0 2024-04-24T23:00:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.666+0000 7fae1aa00640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.667+0000 7fae23e00640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae24071410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009e50 tx=0x7fae1c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c832434b971b059 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae22a00640 1 -- 172.21.15.146:0/1602215786 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c036070 con 0x7fae240ce5a0 2024-04-24T23:00:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae22a00640 1 -- 172.21.15.146:0/1602215786 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c031600 con 0x7fae240ce5a0 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae22a00640 1 -- 172.21.15.146:0/1602215786 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0319d0 con 0x7fae240ce5a0 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 -- 172.21.15.146:0/1602215786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 msgr2=0x7fae24071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae24071410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009e50 tx=0x7fae1c02a6c0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 -- 172.21.15.146:0/1602215786 shutdown_connections 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae24071410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 --2- 172.21.15.146:0/1602215786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 -- 172.21.15.146:0/1602215786 >> 172.21.15.146:0/1602215786 conn(0x7fae240b17b0 msgr2=0x7fae240b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.668+0000 7fae2a200640 1 -- 172.21.15.146:0/1602215786 shutdown_connections 2024-04-24T23:00:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.669+0000 7fae2a200640 1 -- 172.21.15.146:0/1602215786 wait complete. 2024-04-24T23:00:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.670+0000 7fae2a200640 1 Processor -- start 2024-04-24T23:00:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.670+0000 7fae2a200640 1 -- start start 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae2413ef30 0x7fae24142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae24138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae240cea50 con 0x7fae240ce5a0 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae24070c10 con 0x7fae2413ef30 2024-04-24T23:00:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae2a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae24071950 con 0x7fae24141c80 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.671+0000 7fae23400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51426/0 (socket says 172.21.15.146:51426) 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 -- 172.21.15.146:0/3496154709 learned_addr learned my addr 172.21.15.146:0/3496154709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23e00640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae24138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 -- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 msgr2=0x7fae24138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae1aa00640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae2413ef30 0x7fae24142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae24138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 -- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae2413ef30 msgr2=0x7fae24142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae2413ef30 0x7fae24142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 -- 172.21.15.146:0/3496154709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae241e84f0 con 0x7fae240ce5a0 2024-04-24T23:00:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.672+0000 7fae23400640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c430 tx=0x7fae1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.673+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14011790 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.673+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae14017070 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.673+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14011bb0 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.673+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2413b1d0 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.673+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2413b790 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.674+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2404f5a0 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.675+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae1401c460 con 0x7fae240ce5a0 2024-04-24T23:00:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.676+0000 7fae1be00640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 0x7fae0006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:57.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.676+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fae1408b0c0 con 0x7fae240ce5a0 2024-04-24T23:00:57.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.676+0000 7fae1aa00640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 0x7fae0006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:57.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.677+0000 7fae1aa00640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 0x7fae0006e340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2413ab20 tx=0x7fae0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.680+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae140596e0 con 0x7fae240ce5a0 2024-04-24T23:00:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.881+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae24145950 con 0x7fae240ce5a0 2024-04-24T23:00:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.882+0000 7fae1be00640 1 -- 172.21.15.146:0/3496154709 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fae14058fe0 con 0x7fae240ce5a0 2024-04-24T23:00:57.884 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 msgr2=0x7fae0006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 0x7fae0006e340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2413ab20 tx=0x7fae0c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 msgr2=0x7fae241e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c430 tx=0x7fae1400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 shutdown_connections 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fae0006be80 0x7fae0006e340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae24141c80 0x7fae24138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae2413ef30 0x7fae24142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 --2- 172.21.15.146:0/3496154709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae240ce5a0 0x7fae241e7fb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.884+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 >> 172.21.15.146:0/3496154709 conn(0x7fae240b17b0 msgr2=0x7fae2406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.885+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 shutdown_connections 2024-04-24T23:00:57.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:57.885+0000 7fae2a200640 1 -- 172.21.15.146:0/3496154709 wait complete. 2024-04-24T23:00:57.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.112+0000 7ff2e0000640 1 Processor -- start 2024-04-24T23:00:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.112+0000 7ff2e0000640 1 -- start start 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2e0000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff2d8141c80 0x7ff2d80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2e0000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d80ced40 con 0x7ff2d813ef30 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2e0000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d80cf020 con 0x7ff2d80ce5a0 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2e0000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d81423d0 con 0x7ff2d8141c80 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2dd600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff2d813ef30 0x7ff2d8141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38544/0 (socket says 172.21.15.146:38544) 2024-04-24T23:00:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.114+0000 7ff2dd600640 1 -- 172.21.15.146:0/2430396993 learned_addr learned my addr 172.21.15.146:0/2430396993 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995216679 0 0) 0x7ff2d80ced40 con 0x7ff2d813ef30 2024-04-24T23:00:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c0003520 con 0x7ff2d813ef30 2024-04-24T23:00:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/2430396993 >> v2:172.21.15.203:3300/0 conn(0x7ff2d8141c80 0x7ff2d80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2624194800 0 0) 0x7ff2c0003520 con 0x7ff2d813ef30 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 >> v2:172.21.15.203:3300/0 conn(0x7ff2d8141c80 msgr2=0x7ff2d80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 --2- 172.21.15.146:0/2430396993 >> v2:172.21.15.203:3300/0 conn(0x7ff2d8141c80 0x7ff2d80ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 >> v1:172.21.15.203:6789/0 conn(0x7ff2d80ce5a0 legacy=0x7ff2d8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d80cf300 con 0x7ff2d813ef30 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ff2cc001670 con 0x7ff2d813ef30 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 >> v1:172.21.15.146:6789/0 conn(0x7ff2d813ef30 legacy=0x7ff2d8141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c00039b0 0x7ff2c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c000c0e0 con 0x7ff2c0004800 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c000c290 con 0x7ff2c00039b0 2024-04-24T23:00:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.115+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c000c490 con 0x7ff2c00051c0 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dd600640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c00039b0 0x7ff2c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 -- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c00051c0 msgr2=0x7ff2c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2de000640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 -- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c00039b0 msgr2=0x7ff2c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c00039b0 0x7ff2c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dcc00640 1 -- 172.21.15.146:0/2430396993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c0003520 con 0x7ff2c0004800 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2dd600640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c00039b0 0x7ff2c0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2de000640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.116+0000 7ff2de000640 1 -- 172.21.15.146:0/2430396993 reap_dead start 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.117+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba30 tx=0x7ff2c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6938933a5dec209 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.117+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4030070 con 0x7ff2c0004800 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.117+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c402ade0 con 0x7ff2c0004800 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.117+0000 7ff2d7e00640 1 -- 172.21.15.146:0/2430396993 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400b600 con 0x7ff2c0004800 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 -- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 msgr2=0x7ff2c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba30 tx=0x7ff2c0005830 comp rx=0 tx=0).stop 2024-04-24T23:00:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 -- 172.21.15.146:0/2430396993 shutdown_connections 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 --2- 172.21.15.146:0/2430396993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 -- 172.21.15.146:0/2430396993 >> 172.21.15.146:0/2430396993 conn(0x7ff2d80b17b0 msgr2=0x7ff2d80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 -- 172.21.15.146:0/2430396993 shutdown_connections 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.118+0000 7ff2e0000640 1 -- 172.21.15.146:0/2430396993 wait complete. 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.120+0000 7ff2e0000640 1 Processor -- start 2024-04-24T23:00:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.120+0000 7ff2e0000640 1 -- start start 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d81455a0 0x7ff2d80aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d8142a20 0x7ff2d8142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d80cea30 con 0x7ff2c0004800 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8070f80 con 0x7ff2d8142a20 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2e0000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d80ce060 con 0x7ff2d81455a0 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2dd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2dd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54766/0 (socket says 172.21.15.146:54766) 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.121+0000 7ff2dd600640 1 -- 172.21.15.146:0/814176352 learned_addr learned my addr 172.21.15.146:0/814176352 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d81455a0 0x7ff2d80aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2de000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d8142a20 0x7ff2d8142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 -- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d81455a0 msgr2=0x7ff2d80aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d81455a0 0x7ff2d80aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 -- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d8142a20 msgr2=0x7ff2d8142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d8142a20 0x7ff2d8142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 -- 172.21.15.146:0/814176352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d80ad8c0 con 0x7ff2c0004800 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2dd600640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00d910 tx=0x7ff2cc00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc019070 con 0x7ff2c0004800 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0074e0 con 0x7ff2c0004800 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0049e0 con 0x7ff2c0004800 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d80adba0 con 0x7ff2c0004800 2024-04-24T23:00:58.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.122+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d80ae160 con 0x7ff2c0004800 2024-04-24T23:00:58.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.124+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d804f5a0 con 0x7ff2c0004800 2024-04-24T23:00:58.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.124+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2cc01c070 con 0x7ff2c0004800 2024-04-24T23:00:58.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.125+0000 7ff2d5600640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 0x7ff2b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.125+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff2cc08ae10 con 0x7ff2c0004800 2024-04-24T23:00:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.126+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 0x7ff2b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.127+0000 7ff2dcc00640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 0x7ff2b806e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba00 tx=0x7ff2c4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.130+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff2cc08e030 con 0x7ff2c0004800 2024-04-24T23:00:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.319+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff2d8072d30 con 0x7ff2c0004800 2024-04-24T23:00:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.320+0000 7ff2d5600640 1 -- 172.21.15.146:0/814176352 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff2cc0593b0 con 0x7ff2c0004800 2024-04-24T23:00:58.322 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 msgr2=0x7ff2b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 0x7ff2b806e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba00 tx=0x7ff2c4030000 comp rx=0 tx=0).stop 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 msgr2=0x7ff2d81423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00d910 tx=0x7ff2cc00ddd0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 shutdown_connections 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d8142a20 0x7ff2d8142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff2b806be60 0x7ff2b806e320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d81455a0 0x7ff2d80aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 --2- 172.21.15.146:0/814176352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2c0004800 0x7ff2d81423d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.322+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 >> 172.21.15.146:0/814176352 conn(0x7ff2d80b17b0 msgr2=0x7ff2d815f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.323+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 shutdown_connections 2024-04-24T23:00:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.323+0000 7ff2e0000640 1 -- 172.21.15.146:0/814176352 wait complete. 2024-04-24T23:00:58.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.538+0000 7fb4dc000640 1 Processor -- start 2024-04-24T23:00:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.538+0000 7fb4dc000640 1 -- start start 2024-04-24T23:00:58.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.540+0000 7fb4dc000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4d415e010 0x7fb4d406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.540+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 0x7fb4d40719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.540+0000 7fb4dc000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d415e3f0 con 0x7fb4d406e620 2024-04-24T23:00:58.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.540+0000 7fb4dc000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d406cd20 con 0x7fb4d415e010 2024-04-24T23:00:58.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.540+0000 7fb4dc000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d415f440 con 0x7fb4d4071520 2024-04-24T23:00:58.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4da000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4d406e620 0x7fb4d40b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38560/0 (socket says 172.21.15.146:38560) 2024-04-24T23:00:58.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4da000640 1 -- 172.21.15.146:0/2870526831 learned_addr learned my addr 172.21.15.146:0/2870526831 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:58.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d9600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4d415e010 0x7fb4d406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d8c00640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 0x7fb4d40719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d3e00640 1 -- 172.21.15.146:0/2870526831 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252834807 0 0) 0x7fb4d415e3f0 con 0x7fb4d406e620 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d3e00640 1 -- 172.21.15.146:0/2870526831 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4bc003520 con 0x7fb4d406e620 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d9600640 1 -- 172.21.15.146:0/2870526831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 msgr2=0x7fb4d40719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d9600640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 0x7fb4d40719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d9600640 1 -- 172.21.15.146:0/2870526831 >> v1:172.21.15.146:6789/0 conn(0x7fb4d406e620 legacy=0x7fb4d40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d9600640 1 -- 172.21.15.146:0/2870526831 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d4071fe0 con 0x7fb4d415e010 2024-04-24T23:00:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.541+0000 7fb4d8c00640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 0x7fb4d40719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.542+0000 7fb4d9600640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d415e010 0x7fb4d406dd80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80097a0 tx=0x7fb4c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef42602e207eddd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4d3e00640 1 -- 172.21.15.146:0/2870526831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8037070 con 0x7fb4d415e010 2024-04-24T23:00:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4d3e00640 1 -- 172.21.15.146:0/2870526831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4d415e010 2024-04-24T23:00:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4d3e00640 1 -- 172.21.15.146:0/2870526831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032810 con 0x7fb4d415e010 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 -- 172.21.15.146:0/2870526831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d415e010 msgr2=0x7fb4d406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d415e010 0x7fb4d406dd80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80097a0 tx=0x7fb4c802a180 comp rx=0 tx=0).stop 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 -- 172.21.15.146:0/2870526831 shutdown_connections 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d4071520 0x7fb4d40719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 --2- 172.21.15.146:0/2870526831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d415e010 0x7fb4d406dd80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.543+0000 7fb4dc000640 1 -- 172.21.15.146:0/2870526831 >> 172.21.15.146:0/2870526831 conn(0x7fb4d40b17b0 msgr2=0x7fb4d40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.544+0000 7fb4dc000640 1 -- 172.21.15.146:0/2870526831 shutdown_connections 2024-04-24T23:00:58.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.544+0000 7fb4dc000640 1 -- 172.21.15.146:0/2870526831 wait complete. 2024-04-24T23:00:58.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.545+0000 7fb4dc000640 1 Processor -- start 2024-04-24T23:00:58.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.545+0000 7fb4dc000640 1 -- start start 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4071520 0x7fb4d4149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d415e010 0x7fb4d4157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d406d580 con 0x7fb4d406e620 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d406d2a0 con 0x7fb4d4071520 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4dc000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d406d860 con 0x7fb4d415e010 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.546+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54784/0 (socket says 172.21.15.146:54784) 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 -- 172.21.15.146:0/1445606237 learned_addr learned my addr 172.21.15.146:0/1445606237 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:58.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 -- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d415e010 msgr2=0x7fb4d4157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d415e010 0x7fb4d4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 -- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4071520 msgr2=0x7fb4d4149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4071520 0x7fb4d4149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 -- 172.21.15.146:0/1445606237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d4157f50 con 0x7fb4d406e620 2024-04-24T23:00:58.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d9600640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8035040 tx=0x7fb4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.547+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8037040 con 0x7fb4d406e620 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.548+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8030500 con 0x7fb4d406e620 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.548+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8030910 con 0x7fb4d406e620 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.548+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d4158230 con 0x7fb4d406e620 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.548+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d41587f0 con 0x7fb4d406e620 2024-04-24T23:00:58.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.549+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d404f5a0 con 0x7fb4d406e620 2024-04-24T23:00:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.550+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4c8044020 con 0x7fb4d406e620 2024-04-24T23:00:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.551+0000 7fb4d1600640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 0x7fb4b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.551+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb4c80ab520 con 0x7fb4d406e620 2024-04-24T23:00:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.552+0000 7fb4d8c00640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 0x7fb4b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.553+0000 7fb4d8c00640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 0x7fb4b806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.555+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb4c8079b50 con 0x7fb4d406e620 2024-04-24T23:00:58.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.753+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb4d40b3190 con 0x7fb4d406e620 2024-04-24T23:00:58.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.753+0000 7fb4d1600640 1 -- 172.21.15.146:0/1445606237 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fb4c8079450 con 0x7fb4d406e620 2024-04-24T23:00:58.755 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:00:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 msgr2=0x7fb4b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 0x7fb4b806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4008040 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 msgr2=0x7fb4d4158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8035040 tx=0x7fb4c80046c0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 shutdown_connections 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb4b806be30 0x7fb4b806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4d415e010 0x7fb4d4157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4071520 0x7fb4d4149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 --2- 172.21.15.146:0/1445606237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4d406e620 0x7fb4d4158ff0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.756+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 >> 172.21.15.146:0/1445606237 conn(0x7fb4d40b17b0 msgr2=0x7fb4d40b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.757+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 shutdown_connections 2024-04-24T23:00:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.757+0000 7fb4dc000640 1 -- 172.21.15.146:0/1445606237 wait complete. 2024-04-24T23:00:58.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:58.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.979+0000 7f1ff1800640 1 Processor -- start 2024-04-24T23:00:58.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.980+0000 7f1ff1800640 1 -- start start 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.981+0000 7f1ff1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec072920 0x7f1fec0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.981+0000 7f1ff1800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fec0d0070 0x7f1fec0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.981+0000 7f1ff1800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec15e1b0 con 0x7f1fec15ddd0 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.981+0000 7f1ff1800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0713b0 con 0x7f1fec0d0070 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.981+0000 7f1ff1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec071690 con 0x7f1fec072920 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fec0d0070 0x7f1fec0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fec0d0070 0x7f1fec0b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54788/0 (socket says 172.21.15.146:54788) 2024-04-24T23:00:58.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 -- 172.21.15.146:0/721241785 learned_addr learned my addr 172.21.15.146:0/721241785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:58.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1fe3400640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec072920 0x7f1fec0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 -- 172.21.15.146:0/721241785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec072920 msgr2=0x7f1fec0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec072920 0x7f1fec0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 -- 172.21.15.146:0/721241785 >> v1:172.21.15.203:6789/0 conn(0x7f1fec15ddd0 legacy=0x7f1fec070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:58.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.982+0000 7f1ff0e00640 1 -- 172.21.15.146:0/721241785 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec071970 con 0x7f1fec0d0070 2024-04-24T23:00:58.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.983+0000 7f1ff0e00640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec0d0070 0x7f1fec0b2c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0709d0 tx=0x7f1fe402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7852dcdb2ef9ed9e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.983+0000 7f1feb400640 1 -- 172.21.15.146:0/721241785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4036070 con 0x7f1fec0d0070 2024-04-24T23:00:58.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.983+0000 7f1feb400640 1 -- 172.21.15.146:0/721241785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe4031600 con 0x7f1fec0d0070 2024-04-24T23:00:58.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.983+0000 7f1feb400640 1 -- 172.21.15.146:0/721241785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40319d0 con 0x7f1fec0d0070 2024-04-24T23:00:58.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 -- 172.21.15.146:0/721241785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec0d0070 msgr2=0x7f1fec0b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec0d0070 0x7f1fec0b2c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0709d0 tx=0x7f1fe402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 -- 172.21.15.146:0/721241785 shutdown_connections 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec0d0070 0x7f1fec0b2c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 --2- 172.21.15.146:0/721241785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec072920 0x7f1fec0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 -- 172.21.15.146:0/721241785 >> 172.21.15.146:0/721241785 conn(0x7f1fec06b320 msgr2=0x7f1fec06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 -- 172.21.15.146:0/721241785 shutdown_connections 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.984+0000 7f1ff1800640 1 -- 172.21.15.146:0/721241785 wait complete. 2024-04-24T23:00:58.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.986+0000 7f1ff1800640 1 Processor -- start 2024-04-24T23:00:58.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.986+0000 7f1ff1800640 1 -- start start 2024-04-24T23:00:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fec0d0070 0x7f1fec0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 0x7f1fec0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b32c0 con 0x7f1fec072920 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b3140 con 0x7f1fec0d0070 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b3440 con 0x7f1fec15ddd0 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1febe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1febe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54794/0 (socket says 172.21.15.146:54794) 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1febe00640 1 -- 172.21.15.146:0/3344532429 learned_addr learned my addr 172.21.15.146:0/3344532429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.987+0000 7f1ff0e00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 0x7f1fec0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 -- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 msgr2=0x7f1fec0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 0x7f1fec0cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1fe3400640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fec0d0070 0x7f1fec0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 -- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fec0d0070 msgr2=0x7f1fec0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fec0d0070 0x7f1fec0cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 -- 172.21.15.146:0/3344532429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0ccb40 con 0x7f1fec072920 2024-04-24T23:00:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1ff0e00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 0x7f1fec0cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1febe00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00b3f0 tx=0x7f1fdc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc015020 con 0x7f1fec072920 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc011830 con 0x7f1fec072920 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0cce20 con 0x7f1fec072920 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011c20 con 0x7f1fec072920 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.988+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec0cbe10 con 0x7f1fec072920 2024-04-24T23:00:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.989+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec06e940 con 0x7f1fec072920 2024-04-24T23:00:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.990+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fdc018020 con 0x7f1fec072920 2024-04-24T23:00:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.991+0000 7f1fe8c00640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 0x7f1fc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.991+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1fdc08ade0 con 0x7f1fec072920 2024-04-24T23:00:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.992+0000 7f1fe3400640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 0x7f1fc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.993+0000 7f1fe3400640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 0x7f1fc806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006fd0 tx=0x7f1fd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:58.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:58.996+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fec06e940 con 0x7f1fec072920 2024-04-24T23:00:59.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.180+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fec04f500 con 0x7f1fec072920 2024-04-24T23:00:59.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.182+0000 7f1fe8c00640 1 -- 172.21.15.146:0/3344532429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7f1fdc01f030 con 0x7f1fec072920 2024-04-24T23:00:59.184 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:00:59.184 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 msgr2=0x7f1fc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 0x7f1fc806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4006fd0 tx=0x7f1fd4008040 comp rx=0 tx=0).stop 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 msgr2=0x7f1fec145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00b3f0 tx=0x7f1fdc00b8b0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 shutdown_connections 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1fc806be30 0x7f1fc806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fec15ddd0 0x7f1fec0cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fec0d0070 0x7f1fec0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 --2- 172.21.15.146:0/3344532429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec072920 0x7f1fec145470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 >> 172.21.15.146:0/3344532429 conn(0x7f1fec06b320 msgr2=0x7f1fec0b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 shutdown_connections 2024-04-24T23:00:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.185+0000 7f1ff1800640 1 -- 172.21.15.146:0/3344532429 wait complete. 2024-04-24T23:00:59.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:59.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:59.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.403+0000 7f9055c00640 1 Processor -- start 2024-04-24T23:00:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.404+0000 7f9055c00640 1 -- start start 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f9055c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90500b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f9055c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f90500d0a00 0x7f90500cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f9055c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9050162c40 con 0x7f90500b2360 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f9055c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f905006dd00 con 0x7f90500d0a00 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f9055c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f90500b3160 con 0x7f90500b2a90 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f904ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f90500b2360 0x7f90500cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38574/0 (socket says 172.21.15.146:38574) 2024-04-24T23:00:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.405+0000 7f904ea00640 1 -- 172.21.15.146:0/814420514 learned_addr learned my addr 172.21.15.146:0/814420514 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:00:59.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904f400640 1 --2- 172.21.15.146:0/814420514 >> v2:172.21.15.203:3300/0 conn(0x7f90500d0a00 0x7f90500cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f9046000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90500b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946658948 0 0) 0x7f9050162c40 con 0x7f90500b2360 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9034003520 con 0x7f90500b2360 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2407111730 0 0) 0x7f9034003520 con 0x7f90500b2360 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 msgr2=0x7f90500b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90500b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 >> v2:172.21.15.203:3300/0 conn(0x7f90500d0a00 msgr2=0x7f90500cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 --2- 172.21.15.146:0/814420514 >> v2:172.21.15.203:3300/0 conn(0x7f90500d0a00 0x7f90500cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90500b3440 con 0x7f90500b2360 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9040001670 con 0x7f90500b2360 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f9046000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90500b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 >> v1:172.21.15.146:6789/0 conn(0x7f90500b2360 legacy=0x7f90500cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90340039b0 0x7f9034003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.406+0000 7f904e000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9034004800 0x7f9034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904e000640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90500b3160 con 0x7f90340039b0 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f903400b9c0 con 0x7f9034004800 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f903400bb70 con 0x7f90500b2a90 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90340039b0 0x7f9034003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904f400640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 -- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 msgr2=0x7f90340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 -- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9034004800 msgr2=0x7f9034004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9034004800 0x7f9034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904ea00640 1 -- 172.21.15.146:0/814420514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034003520 con 0x7f90340039b0 2024-04-24T23:00:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.407+0000 7f904f400640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b2a90 0x7f90340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.408+0000 7f904ea00640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90340039b0 0x7f9034003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f904000c190 tx=0x7f9034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf060ae3ef54b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.408+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040007c80 con 0x7f90340039b0 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.408+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040005ad0 con 0x7f90340039b0 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.408+0000 7f904e000640 1 -- 172.21.15.146:0/814420514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040007070 con 0x7f90340039b0 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 -- 172.21.15.146:0/814420514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90340039b0 msgr2=0x7f9034003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 --2- 172.21.15.146:0/814420514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90340039b0 0x7f9034003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f904000c190 tx=0x7f9034005830 comp rx=0 tx=0).stop 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f904f400640 1 -- 172.21.15.146:0/814420514 reap_dead start 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 -- 172.21.15.146:0/814420514 shutdown_connections 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 -- 172.21.15.146:0/814420514 >> 172.21.15.146:0/814420514 conn(0x7f90500b37f0 msgr2=0x7f90500b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 -- 172.21.15.146:0/814420514 shutdown_connections 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.409+0000 7f9055c00640 1 -- 172.21.15.146:0/814420514 wait complete. 2024-04-24T23:00:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.411+0000 7f9055c00640 1 Processor -- start 2024-04-24T23:00:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.411+0000 7f9055c00640 1 -- start start 2024-04-24T23:00:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 0x7f90500b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b6390 0x7f90500b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90500b28c0 con 0x7f90501f7550 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90500b2740 con 0x7f90340039b0 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f9055c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f90500b4310 con 0x7f90500b6390 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f904f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f904f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54808/0 (socket says 172.21.15.146:54808) 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.412+0000 7f904f400640 1 -- 172.21.15.146:0/3326741515 learned_addr learned my addr 172.21.15.146:0/3326741515 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904ea00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 0x7f90500b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f9046000640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b6390 0x7f90500b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 -- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b6390 msgr2=0x7f90500b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b6390 0x7f90500b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 -- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 msgr2=0x7f90500b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 0x7f90500b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 -- 172.21.15.146:0/3326741515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90500af7f0 con 0x7f90501f7550 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904ea00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 0x7f90500b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f904f400640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f90500b4880 tx=0x7f904800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048016420 con 0x7f90501f7550 2024-04-24T23:00:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904801b070 con 0x7f90501f7550 2024-04-24T23:00:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480167e0 con 0x7f90501f7550 2024-04-24T23:00:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.413+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90500b6810 con 0x7f90501f7550 2024-04-24T23:00:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.414+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90500afd70 con 0x7f90501f7550 2024-04-24T23:00:59.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.415+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905006b600 con 0x7f90501f7550 2024-04-24T23:00:59.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.416+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9048005d10 con 0x7f90501f7550 2024-04-24T23:00:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.417+0000 7f9047400640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 0x7f902c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.417+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f904808bd20 con 0x7f90501f7550 2024-04-24T23:00:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.417+0000 7f904ea00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 0x7f902c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.418+0000 7f904ea00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 0x7f902c06e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9040032000 tx=0x7f9040009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.422+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f905006b600 con 0x7f90501f7550 2024-04-24T23:00:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.621+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90500c8b30 con 0x7f90501f7550 2024-04-24T23:00:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.622+0000 7f9047400640 1 -- 172.21.15.146:0/3326741515 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f9048025020 con 0x7f90501f7550 2024-04-24T23:00:59.624 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.624+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 msgr2=0x7f902c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 0x7f902c06e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9040032000 tx=0x7f9040009030 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 msgr2=0x7f90500ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f90500b4880 tx=0x7f904800f520 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 shutdown_connections 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90501f7550 0x7f90500ca5e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f902c06be60 0x7f902c06e320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90500b6390 0x7f90500b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 --2- 172.21.15.146:0/3326741515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90340039b0 0x7f90500b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 >> 172.21.15.146:0/3326741515 conn(0x7f90500b37f0 msgr2=0x7f905006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 shutdown_connections 2024-04-24T23:00:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.625+0000 7f9055c00640 1 -- 172.21.15.146:0/3326741515 wait complete. 2024-04-24T23:00:59.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.853+0000 7f35dfa00640 1 Processor -- start 2024-04-24T23:00:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.853+0000 7f35dfa00640 1 -- start start 2024-04-24T23:00:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dfa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d80ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dfa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35d806eba0 0x7f35d815e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dfa00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d815eca0 con 0x7f35d8071090 2024-04-24T23:00:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dfa00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f35d815ef80 con 0x7f35d806eba0 2024-04-24T23:00:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dfa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f35d815f260 con 0x7f35d806e7c0 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35d7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35d806eba0 0x7f35d815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35d7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35d806eba0 0x7f35d815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54810/0 (socket says 172.21.15.146:54810) 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35d7e00640 1 -- 172.21.15.146:0/2305445291 learned_addr learned my addr 172.21.15.146:0/2305445291 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.855+0000 7f35dda00640 1 --1- 172.21.15.146:0/2305445291 >> v1:172.21.15.146:6789/0 conn(0x7f35d8071090 0x7f35d80cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38584/0 (socket says 172.21.15.146:38584) 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35dd000640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d80ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35d7e00640 1 -- 172.21.15.146:0/2305445291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 msgr2=0x7f35d80ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:59.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35d7e00640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d80ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35d7e00640 1 -- 172.21.15.146:0/2305445291 >> v1:172.21.15.146:6789/0 conn(0x7f35d8071090 legacy=0x7f35d80cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35d7e00640 1 -- 172.21.15.146:0/2305445291 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d80b4080 con 0x7f35d806eba0 2024-04-24T23:00:59.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.856+0000 7f35d7400640 1 -- 172.21.15.146:0/2305445291 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383772976 0 0) 0x7f35d815eca0 con 0x7f35d8071090 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.857+0000 7f35d7e00640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d806eba0 0x7f35d815e670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009870 tx=0x7f35c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4988ca8a4169ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.857+0000 7f35d7400640 1 -- 172.21.15.146:0/2305445291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0037070 con 0x7f35d806eba0 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.857+0000 7f35d7400640 1 -- 172.21.15.146:0/2305445291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c0032440 con 0x7f35d806eba0 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.857+0000 7f35d7400640 1 -- 172.21.15.146:0/2305445291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0032810 con 0x7f35d806eba0 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 -- 172.21.15.146:0/2305445291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d806eba0 msgr2=0x7f35d815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d806eba0 0x7f35d815e670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009870 tx=0x7f35c002a270 comp rx=0 tx=0).stop 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 -- 172.21.15.146:0/2305445291 shutdown_connections 2024-04-24T23:00:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d806eba0 0x7f35d815e670 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 --2- 172.21.15.146:0/2305445291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d80ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 -- 172.21.15.146:0/2305445291 >> 172.21.15.146:0/2305445291 conn(0x7f35d80b1e20 msgr2=0x7f35d80b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 -- 172.21.15.146:0/2305445291 shutdown_connections 2024-04-24T23:00:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.858+0000 7f35dfa00640 1 -- 172.21.15.146:0/2305445291 wait complete. 2024-04-24T23:00:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.860+0000 7f35dfa00640 1 Processor -- start 2024-04-24T23:00:59.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.860+0000 7f35dfa00640 1 -- start start 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d81402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35d806eba0 0x7f35d814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35d80cfc20 con 0x7f35d8071090 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8072ca0 con 0x7f35d806eba0 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dfa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f35d80cfda0 con 0x7f35d806e7c0 2024-04-24T23:00:59.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dda00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dda00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54820/0 (socket says 172.21.15.146:54820) 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.861+0000 7f35dda00640 1 -- 172.21.15.146:0/1379245370 learned_addr learned my addr 172.21.15.146:0/1379245370 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dd000640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d81402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 -- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 msgr2=0x7f35d81402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d81402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 -- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35d806eba0 msgr2=0x7f35d814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35d806eba0 0x7f35d814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:59.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 -- 172.21.15.146:0/1379245370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d8140820 con 0x7f35d8071090 2024-04-24T23:00:59.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dd000640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d81402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:59.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dda00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c730 tx=0x7f35d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0018070 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d000ce40 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d814ef00 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.862+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d000a860 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.863+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d814f4c0 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.864+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d804f5a0 con 0x7f35d8071090 2024-04-24T23:00:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.865+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35d001b070 con 0x7f35d8071090 2024-04-24T23:00:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.866+0000 7f35d4c00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 0x7f35b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.866+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f35d008a760 con 0x7f35d8071090 2024-04-24T23:00:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.866+0000 7f35dd000640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 0x7f35b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.868+0000 7f35dd000640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 0x7f35b406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006fd0 tx=0x7f35c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:00:59.870+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f35d0058d90 con 0x7f35d8071090 2024-04-24T23:01:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.064+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f35d806f8b0 con 0x7f35d8071090 2024-04-24T23:01:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.065+0000 7f35d4c00640 1 -- 172.21.15.146:0/1379245370 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f35d0058690 con 0x7f35d8071090 2024-04-24T23:01:00.067 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.067+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 msgr2=0x7f35b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.067+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 0x7f35b406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006fd0 tx=0x7f35c8008040 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.067+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 msgr2=0x7f35d814e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.067+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c730 tx=0x7f35d000cbf0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 shutdown_connections 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d8071090 0x7f35d814e600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35d806eba0 0x7f35d814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f35b406be30 0x7f35b406e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 --2- 172.21.15.146:0/1379245370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35d806e7c0 0x7f35d81402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 >> 172.21.15.146:0/1379245370 conn(0x7f35d80b1e20 msgr2=0x7f35d8161a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:00.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 shutdown_connections 2024-04-24T23:01:00.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.068+0000 7f35dfa00640 1 -- 172.21.15.146:0/1379245370 wait complete. 2024-04-24T23:01:00.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:00.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.286+0000 7fa92a600640 1 Processor -- start 2024-04-24T23:01:00.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.287+0000 7fa92a600640 1 -- start start 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa92a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa92406b140 0x7fa924072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa92a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa92415e3a0 0x7fa9240cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa92a600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9240d02b0 con 0x7fa9240afd20 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa92a600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa9240ceba0 con 0x7fa92415e3a0 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa92a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240d0080 con 0x7fa92406b140 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.288+0000 7fa923e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa92415e3a0 0x7fa9240cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa92415e3a0 0x7fa9240cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54822/0 (socket says 172.21.15.146:54822) 2024-04-24T23:01:00.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 -- 172.21.15.146:0/316840747 learned_addr learned my addr 172.21.15.146:0/316840747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:00.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa929200640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa92406b140 0x7fa924072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 -- 172.21.15.146:0/316840747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa92406b140 msgr2=0x7fa924072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:00.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa92406b140 0x7fa924072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 -- 172.21.15.146:0/316840747 >> v1:172.21.15.203:6789/0 conn(0x7fa9240afd20 legacy=0x7fa92406b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:00.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.289+0000 7fa923e00640 1 -- 172.21.15.146:0/316840747 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9240d0550 con 0x7fa92415e3a0 2024-04-24T23:01:00.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.290+0000 7fa923e00640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa9240cdfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa910009870 tx=0x7fa91002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7140f7e67ba4588b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.290+0000 7fa923400640 1 -- 172.21.15.146:0/316840747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910037070 con 0x7fa92415e3a0 2024-04-24T23:01:00.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.290+0000 7fa923400640 1 -- 172.21.15.146:0/316840747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910032440 con 0x7fa92415e3a0 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.290+0000 7fa923400640 1 -- 172.21.15.146:0/316840747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910032810 con 0x7fa92415e3a0 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 -- 172.21.15.146:0/316840747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 msgr2=0x7fa9240cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa9240cdfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa910009870 tx=0x7fa91002a210 comp rx=0 tx=0).stop 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 -- 172.21.15.146:0/316840747 shutdown_connections 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa9240cdfb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 --2- 172.21.15.146:0/316840747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa92406b140 0x7fa924072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 -- 172.21.15.146:0/316840747 >> 172.21.15.146:0/316840747 conn(0x7fa9240cd490 msgr2=0x7fa9240cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:00.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 -- 172.21.15.146:0/316840747 shutdown_connections 2024-04-24T23:01:00.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.291+0000 7fa92a600640 1 -- 172.21.15.146:0/316840747 wait complete. 2024-04-24T23:01:00.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.293+0000 7fa92a600640 1 Processor -- start 2024-04-24T23:01:00.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.293+0000 7fa92a600640 1 -- start start 2024-04-24T23:01:00.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 0x7fa9240b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9240afd20 0x7fa92415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa924071eb0 con 0x7fa92415e3a0 2024-04-24T23:01:00.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240718f0 con 0x7fa92406b140 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa92a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240cb060 con 0x7fa9240afd20 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa929c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa929c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54832/0 (socket says 172.21.15.146:54832) 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.294+0000 7fa929c00640 1 -- 172.21.15.146:0/4125320624 learned_addr learned my addr 172.21.15.146:0/4125320624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929200640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 0x7fa9240b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 -- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9240afd20 msgr2=0x7fa92415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9240afd20 0x7fa92415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 -- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 msgr2=0x7fa9240b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 0x7fa9240b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 -- 172.21.15.146:0/4125320624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9240c8a50 con 0x7fa92415e3a0 2024-04-24T23:01:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929200640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 0x7fa9240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa929c00640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c780 tx=0x7fa91c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c004b60 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c004d00 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9240c8cf0 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00aa90 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.295+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9240c92b0 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.296+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa924068190 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.297+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa91c00ac30 con 0x7fa92415e3a0 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.298+0000 7fa920c00640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 0x7fa90406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.298+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa91c08b570 con 0x7fa92415e3a0 2024-04-24T23:01:00.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.299+0000 7fa929200640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 0x7fa90406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.300+0000 7fa929200640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 0x7fa90406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.307+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa924068190 con 0x7fa92415e3a0 2024-04-24T23:01:00.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.508+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa9240cf120 con 0x7fa92415e3a0 2024-04-24T23:01:00.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.509+0000 7fa920c00640 1 -- 172.21.15.146:0/4125320624 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fa9240cf120 con 0x7fa92415e3a0 2024-04-24T23:01:00.511 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 msgr2=0x7fa90406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 0x7fa90406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 msgr2=0x7fa92415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c780 tx=0x7fa91c00cc40 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 shutdown_connections 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92415e3a0 0x7fa92415ecc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa90406be30 0x7fa90406e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9240afd20 0x7fa92415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 --2- 172.21.15.146:0/4125320624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa92406b140 0x7fa9240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.512+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 >> 172.21.15.146:0/4125320624 conn(0x7fa9240cd490 msgr2=0x7fa9240cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.513+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 shutdown_connections 2024-04-24T23:01:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.513+0000 7fa92a600640 1 -- 172.21.15.146:0/4125320624 wait complete. 2024-04-24T23:01:00.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.702+0000 7f9165600640 1 Processor -- start 2024-04-24T23:01:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.702+0000 7f9165600640 1 -- start start 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f9165600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f91600b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f9165600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91600cf7a0 con 0x7f91601619c0 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f9165600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91600b5760 con 0x7f91600d2550 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f9165600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91600b6dc0 con 0x7f91600d29c0 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f915ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f91601619c0 0x7f91600b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38590/0 (socket says 172.21.15.146:38590) 2024-04-24T23:01:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f915ea00640 1 -- 172.21.15.146:0/3591785587 learned_addr learned my addr 172.21.15.146:0/3591785587 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333276717 0 0) 0x7f91600cf7a0 con 0x7f91601619c0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9144003520 con 0x7f91601619c0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.704+0000 7f915f400640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f91600b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077982949 0 0) 0x7f9144003520 con 0x7f91601619c0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 msgr2=0x7f91600b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f91600b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 >> v1:172.21.15.203:6789/0 conn(0x7f91600d2550 legacy=0x7f91600b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91600cfa40 con 0x7f91601619c0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f91500019f0 con 0x7f91601619c0 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 >> v1:172.21.15.146:6789/0 conn(0x7f91601619c0 legacy=0x7f91600b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91440039e0 0x7f9144003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f9144004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144004d90 0x7f9144005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91600b6dc0 con 0x7f9144004d90 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f914400bc40 con 0x7f91440039e0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f914400be40 con 0x7f91600d29c0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.705+0000 7f915f400640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144004d90 0x7f9144005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915e000640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f9144004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915f400640 1 -- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 msgr2=0x7f9144004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915f400640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91600d29c0 0x7f9144004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915ea00640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91440039e0 0x7f9144003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915f400640 1 -- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91440039e0 msgr2=0x7f9144003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915f400640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91440039e0 0x7f9144003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.706+0000 7f915f400640 1 -- 172.21.15.146:0/3591785587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9144003520 con 0x7f9144004d90 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.707+0000 7f915f400640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144004d90 0x7f9144005210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f915800ba00 tx=0x7f9144005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c4c241784a65bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.707+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158030070 con 0x7f9144004d90 2024-04-24T23:01:00.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.707+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915802ad80 con 0x7f9144004d90 2024-04-24T23:01:00.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.707+0000 7f915d600640 1 -- 172.21.15.146:0/3591785587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800b600 con 0x7f9144004d90 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 -- 172.21.15.146:0/3591785587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144004d90 msgr2=0x7f9144005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 --2- 172.21.15.146:0/3591785587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144004d90 0x7f9144005210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f915800ba00 tx=0x7f9144005830 comp rx=0 tx=0).stop 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f915f400640 1 -- 172.21.15.146:0/3591785587 reap_dead start 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 -- 172.21.15.146:0/3591785587 shutdown_connections 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 -- 172.21.15.146:0/3591785587 >> 172.21.15.146:0/3591785587 conn(0x7f91600d3f70 msgr2=0x7f91600d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 -- 172.21.15.146:0/3591785587 shutdown_connections 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.708+0000 7f9165600640 1 -- 172.21.15.146:0/3591785587 wait complete. 2024-04-24T23:01:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.710+0000 7f9165600640 1 Processor -- start 2024-04-24T23:01:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.710+0000 7f9165600640 1 -- start start 2024-04-24T23:01:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 0x7f91600cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9160155110 0x7f916015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91600d2e10 con 0x7f91600cda90 2024-04-24T23:01:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91600b7010 con 0x7f9144004d90 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.711+0000 7f9165600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91600d1f70 con 0x7f9160155110 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54850/0 (socket says 172.21.15.146:54850) 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 -- 172.21.15.146:0/2977554191 learned_addr learned my addr 172.21.15.146:0/2977554191 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915ea00640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 0x7f91600cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915e000640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9160155110 0x7f916015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 -- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9160155110 msgr2=0x7f916015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9160155110 0x7f916015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 -- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 msgr2=0x7f91600cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 0x7f91600cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 -- 172.21.15.146:0/2977554191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91601555a0 con 0x7f91600cda90 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915ea00640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 0x7f91600cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.712+0000 7f915f400640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f915802a870 tx=0x7f9158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.713+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800b600 con 0x7f91600cda90 2024-04-24T23:01:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.713+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915802ab80 con 0x7f91600cda90 2024-04-24T23:01:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.713+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9160155880 con 0x7f91600cda90 2024-04-24T23:01:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.713+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158004260 con 0x7f91600cda90 2024-04-24T23:01:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.713+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9160156120 con 0x7f91600cda90 2024-04-24T23:01:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.714+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9160155a50 con 0x7f91600cda90 2024-04-24T23:01:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.715+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9158047030 con 0x7f91600cda90 2024-04-24T23:01:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.716+0000 7f9156a00640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 0x7f914006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.716+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f91580ab3b0 con 0x7f91600cda90 2024-04-24T23:01:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.716+0000 7f915ea00640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 0x7f914006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:00.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.718+0000 7f915ea00640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 0x7f914006e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9150001b60 tx=0x7f9150009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:00.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.720+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f915804e020 con 0x7f91600cda90 2024-04-24T23:01:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.924+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f91600d2330 con 0x7f91600cda90 2024-04-24T23:01:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.925+0000 7f9156a00640 1 -- 172.21.15.146:0/2977554191 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f915803c3a0 con 0x7f91600cda90 2024-04-24T23:01:00.927 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:00.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 msgr2=0x7f914006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 0x7f914006e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9150001b60 tx=0x7f9150009040 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 msgr2=0x7f916015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f915802a870 tx=0x7f9158004730 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 shutdown_connections 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91600cda90 0x7f916015d1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f914006be60 0x7f914006e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9160155110 0x7f916015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 --2- 172.21.15.146:0/2977554191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9144004d90 0x7f91600cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.927+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 >> 172.21.15.146:0/2977554191 conn(0x7f91600d3f70 msgr2=0x7f91600b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.928+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 shutdown_connections 2024-04-24T23:01:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:00.928+0000 7f9165600640 1 -- 172.21.15.146:0/2977554191 wait complete. 2024-04-24T23:01:00.960 INFO:tasks.cephfs_test_runner:Starting test: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) That when some dentries in the journal but nothing is in 2024-04-24T23:01:00.960 INFO:tasks.cephfs_test_runner:test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-04-24T23:01:00.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:01.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.149+0000 7f95d9200640 1 Processor -- start 2024-04-24T23:01:01.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.149+0000 7f95d9200640 1 -- start start 2024-04-24T23:01:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.150+0000 7f95d9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95d40b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.150+0000 7f95d9200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d40d4bc0 con 0x7f95d40b2dc0 2024-04-24T23:01:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.150+0000 7f95d9200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d40cf5b0 con 0x7f95d415e5b0 2024-04-24T23:01:01.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.150+0000 7f95d9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95d40d48e0 con 0x7f95d40d06e0 2024-04-24T23:01:01.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.151+0000 7f95d2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95d40b2dc0 0x7f95d415dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38596/0 (socket says 172.21.15.146:38596) 2024-04-24T23:01:01.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.151+0000 7f95d2a00640 1 -- 172.21.15.146:0/3522141912 learned_addr learned my addr 172.21.15.146:0/3522141912 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.151+0000 7f95d3400640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95d40b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.151+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796067562 0 0) 0x7f95d40d4bc0 con 0x7f95d40b2dc0 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.151+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b8003520 con 0x7f95d40b2dc0 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702894068 0 0) 0x7f95b8003520 con 0x7f95d40b2dc0 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 msgr2=0x7f95d40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95d40b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 >> v1:172.21.15.203:6789/0 conn(0x7f95d415e5b0 legacy=0x7f95d40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d40cf850 con 0x7f95d40b2dc0 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f95c0001670 con 0x7f95d40b2dc0 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 >> v1:172.21.15.146:6789/0 conn(0x7f95d40b2dc0 legacy=0x7f95d415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b8003f60 0x7f95b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8004d40 0x7f95b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95d40d48e0 con 0x7f95b8003f60 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95b800bb50 con 0x7f95b8004d40 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95b800bd50 con 0x7f95d40d06e0 2024-04-24T23:01:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d2a00640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b8003f60 0x7f95b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.152+0000 7f95d3400640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d3e00640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8004d40 0x7f95b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d2a00640 1 -- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 msgr2=0x7f95b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d2a00640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95d40d06e0 0x7f95b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d2a00640 1 -- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8004d40 msgr2=0x7f95b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d2a00640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8004d40 0x7f95b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.153+0000 7f95d2a00640 1 -- 172.21.15.146:0/3522141912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b8003520 con 0x7f95b8003f60 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.154+0000 7f95d2a00640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b8003f60 0x7f95b8004800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c240 tx=0x7f95b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e91ec90224789f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.154+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0007d10 con 0x7f95b8003f60 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.154+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c0005ad0 con 0x7f95b8003f60 2024-04-24T23:01:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.154+0000 7f95d2000640 1 -- 172.21.15.146:0/3522141912 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0007070 con 0x7f95b8003f60 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 -- 172.21.15.146:0/3522141912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b8003f60 msgr2=0x7f95b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 --2- 172.21.15.146:0/3522141912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b8003f60 0x7f95b8004800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c240 tx=0x7f95b8005830 comp rx=0 tx=0).stop 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d3e00640 1 -- 172.21.15.146:0/3522141912 reap_dead start 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 -- 172.21.15.146:0/3522141912 shutdown_connections 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 -- 172.21.15.146:0/3522141912 >> 172.21.15.146:0/3522141912 conn(0x7f95d40d3d20 msgr2=0x7f95d40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 -- 172.21.15.146:0/3522141912 shutdown_connections 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.155+0000 7f95d9200640 1 -- 172.21.15.146:0/3522141912 wait complete. 2024-04-24T23:01:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.157+0000 7f95d9200640 1 Processor -- start 2024-04-24T23:01:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.157+0000 7f95d9200640 1 -- start start 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95b8003f60 0x7f95d40c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95d41570f0 0x7f95d40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95d40d2e40 con 0x7f95d40c7ec0 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95d40d2cc0 con 0x7f95d41570f0 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95d40d0ac0 con 0x7f95b8003f60 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54878/0 (socket says 172.21.15.146:54878) 2024-04-24T23:01:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 -- 172.21.15.146:0/2075702730 learned_addr learned my addr 172.21.15.146:0/2075702730 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3400640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95b8003f60 0x7f95d40c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d2a00640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95d41570f0 0x7f95d40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 -- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95b8003f60 msgr2=0x7f95d40c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95b8003f60 0x7f95d40c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 -- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95d41570f0 msgr2=0x7f95d40c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95d41570f0 0x7f95d40c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.158+0000 7f95d3e00640 1 -- 172.21.15.146:0/2075702730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d415d510 con 0x7f95d40c7ec0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95d3e00640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95d4067e50 tx=0x7f95cc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc003970 con 0x7f95d40c7ec0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95cc018070 con 0x7f95d40c7ec0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc003d50 con 0x7f95d40c7ec0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d40c84f0 con 0x7f95d40c7ec0 2024-04-24T23:01:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.159+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d40c8ab0 con 0x7f95d40c7ec0 2024-04-24T23:01:01.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.160+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d4068410 con 0x7f95d40c7ec0 2024-04-24T23:01:01.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.162+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95cc0050d0 con 0x7f95d40c7ec0 2024-04-24T23:01:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.163+0000 7f95cb400640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.163+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f95cc08afe0 con 0x7f95d40c7ec0 2024-04-24T23:01:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.164+0000 7f95d3400640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.165+0000 7f95d3400640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009950 tx=0x7f95c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.168+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f95d4068410 con 0x7f95d40c7ec0 2024-04-24T23:01:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.359+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95d4073240 con 0x7f95d40c7ec0 2024-04-24T23:01:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.361+0000 7f95cb400640 1 -- 172.21.15.146:0/2075702730 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7f95d4073240 con 0x7f95d40c7ec0 2024-04-24T23:01:01.363 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:01.363 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 msgr2=0x7f95b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009950 tx=0x7f95c4008040 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 msgr2=0x7f95d40ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95d4067e50 tx=0x7f95cc00ec10 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 shutdown_connections 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d40c7ec0 0x7f95d40ca0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95d41570f0 0x7f95d40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 --2- 172.21.15.146:0/2075702730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95b8003f60 0x7f95d40c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.363+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 >> 172.21.15.146:0/2075702730 conn(0x7f95d40d3d20 msgr2=0x7f95d40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.364+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 shutdown_connections 2024-04-24T23:01:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.364+0000 7f95d9200640 1 -- 172.21.15.146:0/2075702730 wait complete. 2024-04-24T23:01:01.383 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:01.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.569+0000 7f7f6be00640 1 Processor -- start 2024-04-24T23:01:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.569+0000 7f7f6be00640 1 -- start start 2024-04-24T23:01:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6c0d1f10 con 0x7f7f6c15e060 2024-04-24T23:01:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6c0d2510 con 0x7f7f6c0d0d00 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6c0b0950 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54886/0 (socket says 172.21.15.146:54886) 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 -- 172.21.15.146:0/3933659790 learned_addr learned my addr 172.21.15.146:0/3933659790 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 -- 172.21.15.146:0/3933659790 >> v1:172.21.15.203:6789/0 conn(0x7f7f6c0d0d00 legacy=0x7f7f6c0b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 -- 172.21.15.146:0/3933659790 >> v1:172.21.15.146:6789/0 conn(0x7f7f6c15e060 legacy=0x7f7f6c0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.571+0000 7f7f6b400640 1 -- 172.21.15.146:0/3933659790 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c0d27f0 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f6b400640 1 --2- 172.21.15.146:0/3933659790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f6402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dde47f1811212a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f69600640 1 -- 172.21.15.146:0/3933659790 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64036070 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f69600640 1 -- 172.21.15.146:0/3933659790 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f64031600 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f69600640 1 -- 172.21.15.146:0/3933659790 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f640319d0 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f6be00640 1 -- 172.21.15.146:0/3933659790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 msgr2=0x7f7f6c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.573+0000 7f7f6be00640 1 --2- 172.21.15.146:0/3933659790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e50 tx=0x7f7f6402a6d0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.574+0000 7f7f6be00640 1 -- 172.21.15.146:0/3933659790 shutdown_connections 2024-04-24T23:01:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.574+0000 7f7f6be00640 1 --2- 172.21.15.146:0/3933659790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c0b14f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.574+0000 7f7f6be00640 1 -- 172.21.15.146:0/3933659790 >> 172.21.15.146:0/3933659790 conn(0x7f7f6c0d3c50 msgr2=0x7f7f6c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.574+0000 7f7f6be00640 1 -- 172.21.15.146:0/3933659790 shutdown_connections 2024-04-24T23:01:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.574+0000 7f7f6be00640 1 -- 172.21.15.146:0/3933659790 wait complete. 2024-04-24T23:01:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.575+0000 7f7f6be00640 1 Processor -- start 2024-04-24T23:01:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.575+0000 7f7f6be00640 1 -- start start 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 0x7f7f6c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f6c15e060 0x7f7f6c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d2db0 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d21a0 con 0x7f7f6c0d0d00 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.576+0000 7f7f6be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d49a0 con 0x7f7f6c15e060 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54902/0 (socket says 172.21.15.146:54902) 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 -- 172.21.15.146:0/2016297284 learned_addr learned my addr 172.21.15.146:0/2016297284 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6aa00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 0x7f7f6c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 -- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f6c15e060 msgr2=0x7f7f6c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f6c15e060 0x7f7f6c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 -- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 msgr2=0x7f7f6c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 0x7f7f6c151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 -- 172.21.15.146:0/2016297284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c1f4500 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6aa00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 0x7f7f6c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.577+0000 7f7f6a000640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c460 tx=0x7f7f5800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.578+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58016020 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.578+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58012870 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.578+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58012c60 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.578+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c1f4840 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.578+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1f4ac0 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.579+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c04f500 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.580+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f58019020 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.581+0000 7f7f62a00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.581+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7f5808aee0 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.581+0000 7f7f6aa00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.582+0000 7f7f6aa00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c000f60 tx=0x7f7f5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.585+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f58020030 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.784+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7f6c0b2850 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.784+0000 7f7f62a00640 1 -- 172.21.15.146:0/2016297284 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f7f6c1f4840 con 0x7f7f6c0d1ac0 2024-04-24T23:01:01.786 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 msgr2=0x7f7f4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c000f60 tx=0x7f7f5c009040 comp rx=0 tx=0).stop 2024-04-24T23:01:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 msgr2=0x7f7f6c1f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c460 tx=0x7f7f5800c920 comp rx=0 tx=0).stop 2024-04-24T23:01:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 shutdown_connections 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f6c15e060 0x7f7f6c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f6c0d1ac0 0x7f7f6c1f3b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 --2- 172.21.15.146:0/2016297284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f6c0d0d00 0x7f7f6c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 >> 172.21.15.146:0/2016297284 conn(0x7f7f6c0d3c50 msgr2=0x7f7f6c06c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 shutdown_connections 2024-04-24T23:01:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:01.787+0000 7f7f6be00640 1 -- 172.21.15.146:0/2016297284 wait complete. 2024-04-24T23:01:01.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:02.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.005+0000 7f3949600640 1 Processor -- start 2024-04-24T23:01:02.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.005+0000 7f3949600640 1 -- start start 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3949600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f394415cd60 0x7f39440cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3949600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39440d0200 0x7f394415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3949600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39440b4df0 con 0x7f394415bcd0 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3949600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f394415c8d0 con 0x7f39440d0200 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3949600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f39440b4b10 con 0x7f394415cd60 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3948c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39440d0200 0x7f394415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3948c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39440d0200 0x7f394415f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54916/0 (socket says 172.21.15.146:54916) 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f3948c00640 1 -- 172.21.15.146:0/1683425914 learned_addr learned my addr 172.21.15.146:0/1683425914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.007+0000 7f393b400640 1 --2- 172.21.15.146:0/1683425914 >> v2:172.21.15.203:3300/0 conn(0x7f394415cd60 0x7f39440cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.008+0000 7f3948c00640 1 -- 172.21.15.146:0/1683425914 >> v2:172.21.15.203:3300/0 conn(0x7f394415cd60 msgr2=0x7f39440cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.008+0000 7f3948c00640 1 --2- 172.21.15.146:0/1683425914 >> v2:172.21.15.203:3300/0 conn(0x7f394415cd60 0x7f39440cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.008+0000 7f3948c00640 1 -- 172.21.15.146:0/1683425914 >> v1:172.21.15.203:6789/0 conn(0x7f394415bcd0 legacy=0x7f39440cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.008+0000 7f3948c00640 1 -- 172.21.15.146:0/1683425914 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394415c280 con 0x7f39440d0200 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.009+0000 7f3948c00640 1 --2- 172.21.15.146:0/1683425914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39440d0200 0x7f394415f6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39440b3e90 tx=0x7f393c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd40f01c2facd3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.009+0000 7f3943400640 1 -- 172.21.15.146:0/1683425914 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c037070 con 0x7f39440d0200 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.009+0000 7f3943400640 1 -- 172.21.15.146:0/1683425914 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c032440 con 0x7f39440d0200 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.009+0000 7f3943400640 1 -- 172.21.15.146:0/1683425914 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c032810 con 0x7f39440d0200 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 -- 172.21.15.146:0/1683425914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39440d0200 msgr2=0x7f394415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 --2- 172.21.15.146:0/1683425914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39440d0200 0x7f394415f6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39440b3e90 tx=0x7f393c02a230 comp rx=0 tx=0).stop 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 -- 172.21.15.146:0/1683425914 shutdown_connections 2024-04-24T23:01:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 --2- 172.21.15.146:0/1683425914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39440d0200 0x7f394415f6f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 --2- 172.21.15.146:0/1683425914 >> v2:172.21.15.203:3300/0 conn(0x7f394415cd60 0x7f39440cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 -- 172.21.15.146:0/1683425914 >> 172.21.15.146:0/1683425914 conn(0x7f394406b560 msgr2=0x7f394406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 -- 172.21.15.146:0/1683425914 shutdown_connections 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.010+0000 7f3949600640 1 -- 172.21.15.146:0/1683425914 wait complete. 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.011+0000 7f3949600640 1 Processor -- start 2024-04-24T23:01:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 -- start start 2024-04-24T23:01:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39440d0200 0x7f3944145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f394415cd60 0x7f394415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39440b4790 con 0x7f394415bcd0 2024-04-24T23:01:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f394406e590 con 0x7f394415cd60 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.012+0000 7f3949600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f394415fc30 con 0x7f39440d0200 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54926/0 (socket says 172.21.15.146:54926) 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 -- 172.21.15.146:0/281523599 learned_addr learned my addr 172.21.15.146:0/281523599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 -- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39440d0200 msgr2=0x7f3944145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39440d0200 0x7f3944145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 -- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f394415cd60 msgr2=0x7f394415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f3948c00640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f394415cd60 0x7f394415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f394415cd60 0x7f394415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.013+0000 7f393b400640 1 -- 172.21.15.146:0/281523599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39440ae510 con 0x7f394415bcd0 2024-04-24T23:01:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f393b400640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c820 tx=0x7f392c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c015070 con 0x7f394415bcd0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c004020 con 0x7f394415bcd0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0043f0 con 0x7f394415bcd0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39440ae7f0 con 0x7f394415bcd0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.014+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39441457b0 con 0x7f394415bcd0 2024-04-24T23:01:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.015+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394404f500 con 0x7f394415bcd0 2024-04-24T23:01:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.016+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f392c007830 con 0x7f394415bcd0 2024-04-24T23:01:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.017+0000 7f3940c00640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 0x7f392006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.017+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f392c08aff0 con 0x7f394415bcd0 2024-04-24T23:01:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.018+0000 7f3943e00640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 0x7f392006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.019+0000 7f3943e00640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 0x7f392006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39441f6ff0 tx=0x7f3934007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.021+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f392c059640 con 0x7f394415bcd0 2024-04-24T23:01:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.217+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f39440cf030 con 0x7f394415bcd0 2024-04-24T23:01:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.218+0000 7f3940c00640 1 -- 172.21.15.146:0/281523599 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f392c058f40 con 0x7f394415bcd0 2024-04-24T23:01:02.220 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.220+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 msgr2=0x7f392006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.220+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 0x7f392006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39441f6ff0 tx=0x7f3934007d10 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.220+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 msgr2=0x7f394415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.220+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c820 tx=0x7f392c00cce0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 shutdown_connections 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f394415cd60 0x7f394415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f394415bcd0 0x7f394415dc90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f392006be30 0x7f392006e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 --2- 172.21.15.146:0/281523599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39440d0200 0x7f3944145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 >> 172.21.15.146:0/281523599 conn(0x7f394406b560 msgr2=0x7f3944156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 shutdown_connections 2024-04-24T23:01:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.221+0000 7f3949600640 1 -- 172.21.15.146:0/281523599 wait complete. 2024-04-24T23:01:02.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.438+0000 7fa1f5800640 1 Processor -- start 2024-04-24T23:01:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.438+0000 7fa1f5800640 1 -- start start 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.439+0000 7fa1f5800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1f015bcd0 0x7fa1f00cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f5800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 0x7fa1f015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f5800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f00b4df0 con 0x7fa1f015cd60 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f5800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f015c8d0 con 0x7fa1f015bcd0 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f5800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00b4b10 con 0x7fa1f00d03d0 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1f015bcd0 0x7fa1f00cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1f015bcd0 0x7fa1f00cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54934/0 (socket says 172.21.15.146:54934) 2024-04-24T23:01:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 -- 172.21.15.146:0/2767368128 learned_addr learned my addr 172.21.15.146:0/2767368128 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 -- 172.21.15.146:0/2767368128 >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 msgr2=0x7fa1f015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f4e00640 1 --2- 172.21.15.146:0/2767368128 >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 0x7fa1f015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 --2- 172.21.15.146:0/2767368128 >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 0x7fa1f015f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1eea00640 1 -- 172.21.15.146:0/2767368128 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475660699 0 0) 0x7fa1f00b4df0 con 0x7fa1f015cd60 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 -- 172.21.15.146:0/2767368128 >> v1:172.21.15.146:6789/0 conn(0x7fa1f015cd60 legacy=0x7fa1f00cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1efe00640 1 -- 172.21.15.146:0/2767368128 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f015c280 con 0x7fa1f015bcd0 2024-04-24T23:01:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.440+0000 7fa1f4e00640 1 --2- 172.21.15.146:0/2767368128 >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 0x7fa1f015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1efe00640 1 --2- 172.21.15.146:0/2767368128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f015bcd0 0x7fa1f00cc230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bbb943d613d247 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1eea00640 1 -- 172.21.15.146:0/2767368128 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0037070 con 0x7fa1f015bcd0 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1eea00640 1 -- 172.21.15.146:0/2767368128 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e0032440 con 0x7fa1f015bcd0 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1eea00640 1 -- 172.21.15.146:0/2767368128 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0032810 con 0x7fa1f015bcd0 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1f5800640 1 -- 172.21.15.146:0/2767368128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f015bcd0 msgr2=0x7fa1f00cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.442+0000 7fa1f5800640 1 --2- 172.21.15.146:0/2767368128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f015bcd0 0x7fa1f00cc230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002a2a0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 -- 172.21.15.146:0/2767368128 shutdown_connections 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 --2- 172.21.15.146:0/2767368128 >> v2:172.21.15.203:3300/0 conn(0x7fa1f00d03d0 0x7fa1f015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 --2- 172.21.15.146:0/2767368128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f015bcd0 0x7fa1f00cc230 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 -- 172.21.15.146:0/2767368128 >> 172.21.15.146:0/2767368128 conn(0x7fa1f006b560 msgr2=0x7fa1f006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 -- 172.21.15.146:0/2767368128 shutdown_connections 2024-04-24T23:01:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.443+0000 7fa1f5800640 1 -- 172.21.15.146:0/2767368128 wait complete. 2024-04-24T23:01:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.444+0000 7fa1f5800640 1 Processor -- start 2024-04-24T23:01:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.445+0000 7fa1f5800640 1 -- start start 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1f015bcd0 0x7fa1f01432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1f015cd60 0x7fa1f014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f006e590 con 0x7fa1f00d03d0 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f00cc770 con 0x7fa1f015cd60 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1f5800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f00b4790 con 0x7fa1f015bcd0 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54940/0 (socket says 172.21.15.146:54940) 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 -- 172.21.15.146:0/3175044508 learned_addr learned my addr 172.21.15.146:0/3175044508 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 -- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1f015bcd0 msgr2=0x7fa1f01432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1f015bcd0 0x7fa1f01432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 -- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1f015cd60 msgr2=0x7fa1f014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1f015cd60 0x7fa1f014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.446+0000 7fa1efe00640 1 -- 172.21.15.146:0/3175044508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0143800 con 0x7fa1f00d03d0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1efe00640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0041020 con 0x7fa1f00d03d0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e0030970 con 0x7fa1f00d03d0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0037040 con 0x7fa1f00d03d0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f0154800 con 0x7fa1f00d03d0 2024-04-24T23:01:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.447+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f0154dc0 con 0x7fa1f00d03d0 2024-04-24T23:01:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.448+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f004f500 con 0x7fa1f00d03d0 2024-04-24T23:01:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.449+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1e0044020 con 0x7fa1f00d03d0 2024-04-24T23:01:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.450+0000 7fa1e7e00640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 0x7fa1d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.450+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa1e00abc30 con 0x7fa1f00d03d0 2024-04-24T23:01:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.450+0000 7fa1ef400640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 0x7fa1d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.451+0000 7fa1ef400640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 0x7fa1d006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00731b0 tx=0x7fa1dc007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.454+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa1e004b030 con 0x7fa1f00d03d0 2024-04-24T23:01:02.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.638+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa1f015b480 con 0x7fa1f00d03d0 2024-04-24T23:01:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.639+0000 7fa1e7e00640 1 -- 172.21.15.146:0/3175044508 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fa1e007a1d0 con 0x7fa1f00d03d0 2024-04-24T23:01:02.641 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 msgr2=0x7fa1d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 0x7fa1d006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00731b0 tx=0x7fa1dc007950 comp rx=0 tx=0).stop 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 msgr2=0x7fa1f015ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e00046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 shutdown_connections 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1f015cd60 0x7fa1f014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1d006be30 0x7fa1d006e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1f015bcd0 0x7fa1f01432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 --2- 172.21.15.146:0/3175044508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f00d03d0 0x7fa1f015ad30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 >> 172.21.15.146:0/3175044508 conn(0x7fa1f006b560 msgr2=0x7fa1f00ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:02.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 shutdown_connections 2024-04-24T23:01:02.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.642+0000 7fa1f5800640 1 -- 172.21.15.146:0/3175044508 wait complete. 2024-04-24T23:01:02.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.852+0000 7ffa17200640 1 Processor -- start 2024-04-24T23:01:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.853+0000 7ffa17200640 1 -- start start 2024-04-24T23:01:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.854+0000 7ffa17200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ffa18166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.854+0000 7ffa17200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa180b4df0 con 0x7ffa1815cd60 2024-04-24T23:01:02.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.854+0000 7ffa17200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa180b4b10 con 0x7ffa1815bcd0 2024-04-24T23:01:02.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.854+0000 7ffa17200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1815c8d0 con 0x7ffa180d03d0 2024-04-24T23:01:02.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.855+0000 7ffa0d400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffa1815cd60 0x7ffa180cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38616/0 (socket says 172.21.15.146:38616) 2024-04-24T23:01:02.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.855+0000 7ffa0d400640 1 -- 172.21.15.146:0/1993363097 learned_addr learned my addr 172.21.15.146:0/1993363097 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.855+0000 7ffa16800640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ffa18166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.855+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045327983 0 0) 0x7ffa180b4df0 con 0x7ffa1815cd60 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.855+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003520 con 0x7ffa1815cd60 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355239811 0 0) 0x7ff9fc003520 con 0x7ffa1815cd60 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 msgr2=0x7ffa18166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ffa18166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 >> v1:172.21.15.203:6789/0 conn(0x7ffa1815bcd0 legacy=0x7ffa180cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1815c280 con 0x7ffa1815cd60 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ffa00001670 con 0x7ffa1815cd60 2024-04-24T23:01:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 >> v1:172.21.15.146:6789/0 conn(0x7ffa1815cd60 legacy=0x7ffa180cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ff9fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ff9fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9fc004d40 0x7ff9fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1815c8d0 con 0x7ff9fc0039e0 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc00baa0 con 0x7ff9fc004d40 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff9fc00bca0 con 0x7ffa180d03d0 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ff9fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa0d400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ff9fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.856+0000 7ffa15e00640 1 -- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 msgr2=0x7ff9fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa16800640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9fc004d40 0x7ff9fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ff9fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa15e00640 1 -- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9fc004d40 msgr2=0x7ff9fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9fc004d40 0x7ff9fc0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa15e00640 1 -- 172.21.15.146:0/1993363097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc003520 con 0x7ff9fc0039e0 2024-04-24T23:01:02.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.857+0000 7ffa0d400640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa180d03d0 0x7ff9fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ff9fc003e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001720 tx=0x7ff9fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe358e22e33ad602 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08001370 con 0x7ff9fc0039e0 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa080052d0 con 0x7ff9fc0039e0 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa15400640 1 -- 172.21.15.146:0/1993363097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0802abc0 con 0x7ff9fc0039e0 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa17200640 1 -- 172.21.15.146:0/1993363097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 msgr2=0x7ff9fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa17200640 1 --2- 172.21.15.146:0/1993363097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ff9fc003e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001720 tx=0x7ff9fc005830 comp rx=0 tx=0).stop 2024-04-24T23:01:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa16800640 1 -- 172.21.15.146:0/1993363097 reap_dead start 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa17200640 1 -- 172.21.15.146:0/1993363097 shutdown_connections 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.858+0000 7ffa17200640 1 -- 172.21.15.146:0/1993363097 >> 172.21.15.146:0/1993363097 conn(0x7ffa1806b560 msgr2=0x7ffa1806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.859+0000 7ffa17200640 1 -- 172.21.15.146:0/1993363097 shutdown_connections 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.859+0000 7ffa17200640 1 -- 172.21.15.146:0/1993363097 wait complete. 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.860+0000 7ffa17200640 1 Processor -- start 2024-04-24T23:01:02.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.861+0000 7ffa17200640 1 -- start start 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.861+0000 7ffa17200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.861+0000 7ffa17200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa18151a80 0x7ffa181595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa17200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa18143500 0x7ffa18071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa17200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180b4790 con 0x7ff9fc0039e0 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa17200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1806e590 con 0x7ffa18143500 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa17200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffa18164a70 con 0x7ffa18151a80 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54952/0 (socket says 172.21.15.146:54952) 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 -- 172.21.15.146:0/1819300172 learned_addr learned my addr 172.21.15.146:0/1819300172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 -- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa18151a80 msgr2=0x7ffa181595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa18151a80 0x7ffa181595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 -- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa18143500 msgr2=0x7ffa18071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa18143500 0x7ffa18071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.862+0000 7ffa15e00640 1 -- 172.21.15.146:0/1819300172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa18151f10 con 0x7ff9fc0039e0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa15e00640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa08008fd0 tx=0x7ffa08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08037040 con 0x7ff9fc0039e0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08005480 con 0x7ff9fc0039e0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08001370 con 0x7ff9fc0039e0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa181587e0 con 0x7ff9fc0039e0 2024-04-24T23:01:02.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.863+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa18158da0 con 0x7ff9fc0039e0 2024-04-24T23:01:02.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.864+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1804f500 con 0x7ff9fc0039e0 2024-04-24T23:01:02.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.865+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa08044020 con 0x7ff9fc0039e0 2024-04-24T23:01:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.866+0000 7ffa0ea00640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 0x7ff9f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.867+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ffa08007640 con 0x7ff9fc0039e0 2024-04-24T23:01:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.867+0000 7ffa0d400640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 0x7ff9f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.868+0000 7ffa0d400640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 0x7ff9f406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa00001eb0 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:02.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:02.871+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffa08079670 con 0x7ff9fc0039e0 2024-04-24T23:01:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.065+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ffa1806e140 con 0x7ff9fc0039e0 2024-04-24T23:01:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.066+0000 7ffa0ea00640 1 -- 172.21.15.146:0/1819300172 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7ffa08078f70 con 0x7ff9fc0039e0 2024-04-24T23:01:03.068 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 msgr2=0x7ff9f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 0x7ff9f406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa00001eb0 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 msgr2=0x7ffa18152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa08008fd0 tx=0x7ffa08001120 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 shutdown_connections 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa18143500 0x7ffa18071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff9f406be30 0x7ff9f406e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffa18151a80 0x7ffa181595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 --2- 172.21.15.146:0/1819300172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9fc0039e0 0x7ffa18152410 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 >> 172.21.15.146:0/1819300172 conn(0x7ffa1806b560 msgr2=0x7ffa1815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.068+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 shutdown_connections 2024-04-24T23:01:03.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.069+0000 7ffa17200640 1 -- 172.21.15.146:0/1819300172 wait complete. 2024-04-24T23:01:03.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-04-24T23:01:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.288+0000 7fa262a00640 1 Processor -- start 2024-04-24T23:01:03.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.288+0000 7fa262a00640 1 -- start start 2024-04-24T23:01:03.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.288+0000 7fa262a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa25c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa262a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25c1449c0 con 0x7fa25c071320 2024-04-24T23:01:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa262a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25c071820 con 0x7fa25c0728c0 2024-04-24T23:01:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa262a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa25c072430 con 0x7fa25c1445e0 2024-04-24T23:01:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa260a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa25c071320 0x7fa25c0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38628/0 (socket says 172.21.15.146:38628) 2024-04-24T23:01:03.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa260a00640 1 -- 172.21.15.146:0/3113491938 learned_addr learned my addr 172.21.15.146:0/3113491938 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa25be00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa25c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132277688 0 0) 0x7fa25c1449c0 con 0x7fa25c071320 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.289+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa240003520 con 0x7fa25c071320 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316279592 0 0) 0x7fa240003520 con 0x7fa25c071320 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 msgr2=0x7fa25c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa25c0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 >> v1:172.21.15.203:6789/0 conn(0x7fa25c0728c0 legacy=0x7fa25c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c071b00 con 0x7fa25c071320 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fa24c001670 con 0x7fa25c071320 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 >> v1:172.21.15.146:6789/0 conn(0x7fa25c071320 legacy=0x7fa25c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa2400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa240004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240004d40 0x7fa2400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c072430 con 0x7fa240003fb0 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa24000bb00 con 0x7fa240004d40 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa24000df10 con 0x7fa25c1445e0 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25b400640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa240004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.290+0000 7fa25be00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa2400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.291+0000 7fa25b400640 1 -- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 msgr2=0x7fa2400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.291+0000 7fa25b400640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c1445e0 0x7fa2400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.291+0000 7fa25b400640 1 -- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240004d40 msgr2=0x7fa2400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.291+0000 7fa25b400640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa240004d40 0x7fa2400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.291+0000 7fa25b400640 1 -- 172.21.15.146:0/3113491938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa240003520 con 0x7fa240003fb0 2024-04-24T23:01:03.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa25b400640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa240004800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa248001720 tx=0x7fa240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13ee4a1ab30224e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248001370 con 0x7fa240003fb0 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2480052d0 con 0x7fa240003fb0 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa25aa00640 1 -- 172.21.15.146:0/3113491938 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24802ab00 con 0x7fa240003fb0 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa262a00640 1 -- 172.21.15.146:0/3113491938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 msgr2=0x7fa240004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa262a00640 1 --2- 172.21.15.146:0/3113491938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa240004800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa248001720 tx=0x7fa240005830 comp rx=0 tx=0).stop 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa260a00640 1 -- 172.21.15.146:0/3113491938 reap_dead start 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa262a00640 1 -- 172.21.15.146:0/3113491938 shutdown_connections 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.292+0000 7fa262a00640 1 -- 172.21.15.146:0/3113491938 >> 172.21.15.146:0/3113491938 conn(0x7fa25c06b320 msgr2=0x7fa25c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.293+0000 7fa262a00640 1 -- 172.21.15.146:0/3113491938 shutdown_connections 2024-04-24T23:01:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.293+0000 7fa262a00640 1 -- 172.21.15.146:0/3113491938 wait complete. 2024-04-24T23:01:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.294+0000 7fa262a00640 1 Processor -- start 2024-04-24T23:01:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.294+0000 7fa262a00640 1 -- start start 2024-04-24T23:01:03.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 0x7fa25c13b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c13e5a0 0x7fa25c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c0720c0 con 0x7fa240003fb0 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c0b2d70 con 0x7fa25c139bd0 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa262a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa25c0cd5e0 con 0x7fa25c13e5a0 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.295+0000 7fa25be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54980/0 (socket says 172.21.15.146:54980) 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 -- 172.21.15.146:0/3548652042 learned_addr learned my addr 172.21.15.146:0/3548652042 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25b400640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 0x7fa25c13b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 -- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c13e5a0 msgr2=0x7fa25c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c13e5a0 0x7fa25c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 -- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 msgr2=0x7fa25c13b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 0x7fa25c13b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 -- 172.21.15.146:0/3548652042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c13a0b0 con 0x7fa240003fb0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25b400640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 0x7fa25c13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa25be00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa254007f60 tx=0x7fa254007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.296+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25401a020 con 0x7fa240003fb0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.297+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa254016470 con 0x7fa240003fb0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.297+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254016860 con 0x7fa240003fb0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.297+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c13a7b0 con 0x7fa240003fb0 2024-04-24T23:01:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.297+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c13ea50 con 0x7fa240003fb0 2024-04-24T23:01:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.298+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c068190 con 0x7fa240003fb0 2024-04-24T23:01:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.299+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa254005d10 con 0x7fa240003fb0 2024-04-24T23:01:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.299+0000 7fa253e00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 0x7fa23c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.300+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa25408c330 con 0x7fa240003fb0 2024-04-24T23:01:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.300+0000 7fa25b400640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 0x7fa23c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.301+0000 7fa25b400640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 0x7fa23c06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa248032000 tx=0x7fa24802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.304+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa254024030 con 0x7fa240003fb0 2024-04-24T23:01:03.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.574+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) -- 0x7fa25c06eab0 con 0x7fa240003fb0 2024-04-24T23:01:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.736+0000 7fa253e00640 1 -- 172.21.15.146:0/3548652042 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v83) ==== 153+0+0 (secure 0 0 0) 0x7fa25405a960 con 0x7fa240003fb0 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 msgr2=0x7fa23c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 0x7fa23c06e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa248032000 tx=0x7fa24802e000 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 msgr2=0x7fa25c15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa254007f60 tx=0x7fa254007f90 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 shutdown_connections 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa23c06be60 0x7fa23c06e320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa25c13e5a0 0x7fa25c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.739+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa25c139bd0 0x7fa25c13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.740+0000 7fa262a00640 1 --2- 172.21.15.146:0/3548652042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa240003fb0 0x7fa25c15d390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.740+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 >> 172.21.15.146:0/3548652042 conn(0x7fa25c06b320 msgr2=0x7fa25c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.740+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 shutdown_connections 2024-04-24T23:01:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.740+0000 7fa262a00640 1 -- 172.21.15.146:0/3548652042 wait complete. 2024-04-24T23:01:03.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:01:03.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.965+0000 7fed40a00640 1 Processor -- start 2024-04-24T23:01:03.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.965+0000 7fed40a00640 1 -- start start 2024-04-24T23:01:03.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed40a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c070ba0 0x7fed3c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed40a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c142950 con 0x7fed3c0720d0 2024-04-24T23:01:03.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed40a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c071030 con 0x7fed3c142570 2024-04-24T23:01:03.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed40a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c071c40 con 0x7fed3c070ba0 2024-04-24T23:01:03.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed3a800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fed3c0720d0 0x7fed3c15fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38638/0 (socket says 172.21.15.146:38638) 2024-04-24T23:01:03.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed3a800640 1 -- 172.21.15.146:0/3332926076 learned_addr learned my addr 172.21.15.146:0/3332926076 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed31400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c070ba0 0x7fed3c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990458739 0 0) 0x7fed3c142950 con 0x7fed3c0720d0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.967+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed20003520 con 0x7fed3c0720d0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 267092925 0 0) 0x7fed20003520 con 0x7fed3c0720d0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c070ba0 msgr2=0x7fed3c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c070ba0 0x7fed3c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 >> v1:172.21.15.203:6789/0 conn(0x7fed3c142570 legacy=0x7fed3c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c071310 con 0x7fed3c0720d0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fed340019f0 con 0x7fed3c0720d0 2024-04-24T23:01:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 >> v1:172.21.15.146:6789/0 conn(0x7fed3c0720d0 legacy=0x7fed3c15fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed200039e0 0x7fed20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed20004800 0x7fed20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c071c40 con 0x7fed20005180 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed2000bf00 con 0x7fed200039e0 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed2000c0d0 con 0x7fed20004800 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed3a800640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.968+0000 7fed39e00640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed200039e0 0x7fed20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed31400640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed20004800 0x7fed20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed3a800640 1 -- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed20004800 msgr2=0x7fed20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed3a800640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed20004800 0x7fed20004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed3a800640 1 -- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed200039e0 msgr2=0x7fed20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed3a800640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed200039e0 0x7fed20003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.969+0000 7fed3a800640 1 -- 172.21.15.146:0/3332926076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed20003520 con 0x7fed20005180 2024-04-24T23:01:03.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.970+0000 7fed3a800640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed2000b9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fed3400a850 tx=0x7fed20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c700944ad5432a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.970+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3400a4a0 con 0x7fed20005180 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.970+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3402f070 con 0x7fed20005180 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.970+0000 7fed39400640 1 -- 172.21.15.146:0/3332926076 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3402bce0 con 0x7fed20005180 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 -- 172.21.15.146:0/3332926076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 msgr2=0x7fed2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 --2- 172.21.15.146:0/3332926076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed2000b9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fed3400a850 tx=0x7fed20005830 comp rx=0 tx=0).stop 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed3a800640 1 -- 172.21.15.146:0/3332926076 reap_dead start 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 -- 172.21.15.146:0/3332926076 shutdown_connections 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 -- 172.21.15.146:0/3332926076 >> 172.21.15.146:0/3332926076 conn(0x7fed3c06b140 msgr2=0x7fed3c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 -- 172.21.15.146:0/3332926076 shutdown_connections 2024-04-24T23:01:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.971+0000 7fed40a00640 1 -- 172.21.15.146:0/3332926076 wait complete. 2024-04-24T23:01:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.973+0000 7fed40a00640 1 Processor -- start 2024-04-24T23:01:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.973+0000 7fed40a00640 1 -- start start 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c159260 0x7fed3c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c141560 0x7fed3c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c072c60 con 0x7fed20005180 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0718d0 con 0x7fed3c159260 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed40a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c072de0 con 0x7fed3c141560 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55002/0 (socket says 172.21.15.146:55002) 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 -- 172.21.15.146:0/4288518751 learned_addr learned my addr 172.21.15.146:0/4288518751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 -- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c141560 msgr2=0x7fed3c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c141560 0x7fed3c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 -- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c159260 msgr2=0x7fed3c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c159260 0x7fed3c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.974+0000 7fed39e00640 1 -- 172.21.15.146:0/4288518751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c159700 con 0x7fed20005180 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed39e00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e550 tx=0x7fed2c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0052e0 con 0x7fed20005180 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c018070 con 0x7fed20005180 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c003810 con 0x7fed20005180 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c1599e0 con 0x7fed20005180 2024-04-24T23:01:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.975+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c159fa0 con 0x7fed20005180 2024-04-24T23:01:03.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.976+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c04f5a0 con 0x7fed20005180 2024-04-24T23:01:03.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.977+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed2c0039b0 con 0x7fed20005180 2024-04-24T23:01:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.978+0000 7fed32a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 0x7fed1806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.978+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fed2c08ae90 con 0x7fed20005180 2024-04-24T23:01:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.979+0000 7fed31400640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 0x7fed1806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:03.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.980+0000 7fed31400640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 0x7fed1806e320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed24006a90 tx=0x7fed24006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:03.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:03.982+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fed2c059430 con 0x7fed20005180 2024-04-24T23:01:04.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.179+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fed3c06e9a0 con 0x7fed20005180 2024-04-24T23:01:04.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.186+0000 7fed32a00640 1 -- 172.21.15.146:0/4288518751 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fed2c08c020 con 0x7fed20005180 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.188+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 msgr2=0x7fed1806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.188+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 0x7fed1806e320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed24006a90 tx=0x7fed24006a20 comp rx=0 tx=0).stop 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 msgr2=0x7fed3c158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e550 tx=0x7fed2c00ea10 comp rx=0 tx=0).stop 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 shutdown_connections 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed1806be60 0x7fed1806e320 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c141560 0x7fed3c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c159260 0x7fed3c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 --2- 172.21.15.146:0/4288518751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed20005180 0x7fed3c158d20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 >> 172.21.15.146:0/4288518751 conn(0x7fed3c06b140 msgr2=0x7fed3c06db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:04.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 shutdown_connections 2024-04-24T23:01:04.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.189+0000 7fed40a00640 1 -- 172.21.15.146:0/4288518751 wait complete. 2024-04-24T23:01:04.210 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:01:04.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:01:04.308 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:01:04.424 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:01:04.425 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:04.425 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:04.482 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:04.483 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:04.534 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:04.534 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:04.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.788+0000 7f44d3200640 1 Processor -- start 2024-04-24T23:01:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.788+0000 7f44d3200640 1 -- start start 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44d4072560 0x7f44d4163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 0x7f44d4161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d41636d0 con 0x7f44d40cfda0 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f44d4072cc0 con 0x7f44d4072560 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f44d40cf4b0 con 0x7f44d40d0180 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44d4072560 0x7f44d4163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44d4072560 0x7f44d4163190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55006/0 (socket says 172.21.15.146:55006) 2024-04-24T23:01:04.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.790+0000 7f44d1400640 1 -- 172.21.15.146:0/3741508903 learned_addr learned my addr 172.21.15.146:0/3741508903 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d1400640 1 -- 172.21.15.146:0/3741508903 >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 msgr2=0x7f44d4161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d2800640 1 --2- 172.21.15.146:0/3741508903 >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 0x7f44d4161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d1400640 1 --2- 172.21.15.146:0/3741508903 >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 0x7f44d4161be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d1400640 1 -- 172.21.15.146:0/3741508903 >> v1:172.21.15.203:6789/0 conn(0x7f44d40cfda0 legacy=0x7f44d41638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d1400640 1 -- 172.21.15.146:0/3741508903 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d4070b00 con 0x7f44d4072560 2024-04-24T23:01:04.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.791+0000 7f44d2800640 1 --2- 172.21.15.146:0/3741508903 >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 0x7f44d4161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.792+0000 7f44d1400640 1 --2- 172.21.15.146:0/3741508903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d4072560 0x7f44d4163190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f44d4071df0 tx=0x7f44c002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db03fb8e5921e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.792+0000 7f44d0a00640 1 -- 172.21.15.146:0/3741508903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0037070 con 0x7f44d4072560 2024-04-24T23:01:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.792+0000 7f44d0a00640 1 -- 172.21.15.146:0/3741508903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c002ae10 con 0x7f44d4072560 2024-04-24T23:01:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.792+0000 7f44d0a00640 1 -- 172.21.15.146:0/3741508903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0032660 con 0x7f44d4072560 2024-04-24T23:01:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 -- 172.21.15.146:0/3741508903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d4072560 msgr2=0x7f44d4163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 --2- 172.21.15.146:0/3741508903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d4072560 0x7f44d4163190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f44d4071df0 tx=0x7f44c002a100 comp rx=0 tx=0).stop 2024-04-24T23:01:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 -- 172.21.15.146:0/3741508903 shutdown_connections 2024-04-24T23:01:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 --2- 172.21.15.146:0/3741508903 >> v2:172.21.15.203:3300/0 conn(0x7f44d40d0180 0x7f44d4161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 --2- 172.21.15.146:0/3741508903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d4072560 0x7f44d4163190 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 -- 172.21.15.146:0/3741508903 >> 172.21.15.146:0/3741508903 conn(0x7f44d406b320 msgr2=0x7f44d406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 -- 172.21.15.146:0/3741508903 shutdown_connections 2024-04-24T23:01:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.793+0000 7f44d3200640 1 -- 172.21.15.146:0/3741508903 wait complete. 2024-04-24T23:01:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.795+0000 7f44d3200640 1 Processor -- start 2024-04-24T23:01:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.795+0000 7f44d3200640 1 -- start start 2024-04-24T23:01:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44d4072560 0x7f44d415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44d40d0180 0x7f44d40af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4162120 con 0x7f44d40cfda0 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4070da0 con 0x7f44d4072560 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44d41622a0 con 0x7f44d40d0180 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55012/0 (socket says 172.21.15.146:55012) 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d1400640 1 -- 172.21.15.146:0/122868641 learned_addr learned my addr 172.21.15.146:0/122868641 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.796+0000 7f44d1e00640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44d4072560 0x7f44d415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d2800640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44d40d0180 0x7f44d40af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 -- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44d40d0180 msgr2=0x7f44d40af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44d40d0180 0x7f44d40af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 -- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44d4072560 msgr2=0x7f44d415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44d4072560 0x7f44d415b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 -- 172.21.15.146:0/122868641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d415ba80 con 0x7f44d40cfda0 2024-04-24T23:01:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d1400640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0041070 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c003c670 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0037040 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d415bd60 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.797+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d415c320 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.798+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d406ed00 con 0x7f44d40cfda0 2024-04-24T23:01:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.799+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44c0044070 con 0x7f44d40cfda0 2024-04-24T23:01:04.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.800+0000 7f44ca000640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:04.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.800+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f44c00abad0 con 0x7f44d40cfda0 2024-04-24T23:01:04.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.801+0000 7f44d1e00640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:04.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.802+0000 7f44d1e00640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44c4003d90 tx=0x7f44c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:04.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:04.805+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f44d406ed00 con 0x7f44d40cfda0 2024-04-24T23:01:05.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.005+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44d41647b0 con 0x7f44d40cfda0 2024-04-24T23:01:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.007+0000 7f44ca000640 1 -- 172.21.15.146:0/122868641 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7f44d41636d0 con 0x7f44d40cfda0 2024-04-24T23:01:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:05.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 msgr2=0x7f44b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44c4003d90 tx=0x7f44c4009040 comp rx=0 tx=0).stop 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 msgr2=0x7f44d414ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000c00 tx=0x7f44c00046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 shutdown_connections 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44d40d0180 0x7f44d40af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d40cfda0 0x7f44d414ca20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 --2- 172.21.15.146:0/122868641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44d4072560 0x7f44d415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 >> 172.21.15.146:0/122868641 conn(0x7f44d406b320 msgr2=0x7f44d4160010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 shutdown_connections 2024-04-24T23:01:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.010+0000 7f44d3200640 1 -- 172.21.15.146:0/122868641 wait complete. 2024-04-24T23:01:05.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:05.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.233+0000 7f0ff3200640 1 Processor -- start 2024-04-24T23:01:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.233+0000 7f0ff3200640 1 -- start start 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff415e060 0x7f0ff40d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ff40b1df0 0x7f0ff40d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40d2510 con 0x7f0ff40d05f0 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff40d0f90 con 0x7f0ff40b1df0 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40b0950 con 0x7f0ff415e060 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff1400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0ff40d05f0 0x7f0ff40cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38640/0 (socket says 172.21.15.146:38640) 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff1400640 1 -- 172.21.15.146:0/670812645 learned_addr learned my addr 172.21.15.146:0/670812645 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.235+0000 7f0ff2800640 1 --2- 172.21.15.146:0/670812645 >> v2:172.21.15.146:3300/0 conn(0x7f0ff40b1df0 0x7f0ff40d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff1e00640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff415e060 0x7f0ff40d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff0a00640 1 -- 172.21.15.146:0/670812645 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092282181 0 0) 0x7f0ff40d2510 con 0x7f0ff40d05f0 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff0a00640 1 -- 172.21.15.146:0/670812645 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fd8003520 con 0x7f0ff40d05f0 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff2800640 1 -- 172.21.15.146:0/670812645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff415e060 msgr2=0x7f0ff40d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff2800640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff415e060 0x7f0ff40d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff2800640 1 -- 172.21.15.146:0/670812645 >> v1:172.21.15.146:6789/0 conn(0x7f0ff40d05f0 legacy=0x7f0ff40cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.236+0000 7f0ff2800640 1 -- 172.21.15.146:0/670812645 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40d27f0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.237+0000 7f0ff2800640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff40d0a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097a0 tx=0x7f0fec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5f2ba99ade2224 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.237+0000 7f0ff0a00640 1 -- 172.21.15.146:0/670812645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec037070 con 0x7f0ff40b1df0 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.237+0000 7f0ff0a00640 1 -- 172.21.15.146:0/670812645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fec02ae50 con 0x7f0ff40b1df0 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.237+0000 7f0ff0a00640 1 -- 172.21.15.146:0/670812645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec032660 con 0x7f0ff40b1df0 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 -- 172.21.15.146:0/670812645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 msgr2=0x7f0ff40d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff40d0a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097a0 tx=0x7f0fec02a100 comp rx=0 tx=0).stop 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 -- 172.21.15.146:0/670812645 shutdown_connections 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff40d0a50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 --2- 172.21.15.146:0/670812645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff415e060 0x7f0ff40d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 -- 172.21.15.146:0/670812645 >> 172.21.15.146:0/670812645 conn(0x7f0ff40d3c50 msgr2=0x7f0ff40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 -- 172.21.15.146:0/670812645 shutdown_connections 2024-04-24T23:01:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.238+0000 7f0ff3200640 1 -- 172.21.15.146:0/670812645 wait complete. 2024-04-24T23:01:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.240+0000 7f0ff3200640 1 Processor -- start 2024-04-24T23:01:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.240+0000 7f0ff3200640 1 -- start start 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff40d05f0 0x7f0ff40b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ff415e060 0x7f0ff40b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40d2db0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40d21a0 con 0x7f0ff415e060 2024-04-24T23:01:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40d49a0 con 0x7f0ff40d05f0 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55032/0 (socket says 172.21.15.146:55032) 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.241+0000 7f0ff1e00640 1 -- 172.21.15.146:0/481241453 learned_addr learned my addr 172.21.15.146:0/481241453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 -- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff40d05f0 msgr2=0x7f0ff40b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff40d05f0 0x7f0ff40b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 -- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ff415e060 msgr2=0x7f0ff40b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ff415e060 0x7f0ff40b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 -- 172.21.15.146:0/481241453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40b57e0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff1e00640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4007ef0 tx=0x7f0fe400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4014620 con 0x7f0ff40b1df0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe4019070 con 0x7f0ff40b1df0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4014a00 con 0x7f0ff40b1df0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.242+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40b5ac0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.243+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff40b6080 con 0x7f0ff40b1df0 2024-04-24T23:01:05.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.244+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff40d00c0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.245+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fe4014ba0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.245+0000 7f0fea000640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 0x7f0fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.246+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f0fe408bc00 con 0x7f0ff40b1df0 2024-04-24T23:01:05.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.246+0000 7f0ff1400640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 0x7f0fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.247+0000 7f0ff1400640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 0x7f0fd406e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f60 tx=0x7f0fe00078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.253+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0ff40d00c0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.454+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ff404f500 con 0x7f0ff40b1df0 2024-04-24T23:01:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.455+0000 7f0fea000640 1 -- 172.21.15.146:0/481241453 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f0fe405a1a0 con 0x7f0ff40b1df0 2024-04-24T23:01:05.456 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 msgr2=0x7f0fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 0x7f0fd406e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f60 tx=0x7f0fe00078f0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 msgr2=0x7f0ff4157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4007ef0 tx=0x7f0fe400e4b0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 shutdown_connections 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ff415e060 0x7f0ff40b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0fd406be30 0x7f0fd406e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ff40d05f0 0x7f0ff40b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 --2- 172.21.15.146:0/481241453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40b1df0 0x7f0ff4157440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.458+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 >> 172.21.15.146:0/481241453 conn(0x7f0ff40d3c50 msgr2=0x7f0ff40b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.459+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 shutdown_connections 2024-04-24T23:01:05.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.459+0000 7f0ff3200640 1 -- 172.21.15.146:0/481241453 wait complete. 2024-04-24T23:01:05.480 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:05.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.686+0000 7eff94c00640 1 Processor -- start 2024-04-24T23:01:05.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.686+0000 7eff94c00640 1 -- start start 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff94c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a550 0x7eff9015a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff94c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff9015aed0 0x7eff9006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff94c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff900af350 con 0x7eff9015a170 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff94c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7eff900b3460 con 0x7eff9015aed0 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff94c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff900b3720 con 0x7eff9015a550 2024-04-24T23:01:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff8f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7eff9015a170 0x7eff900aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38654/0 (socket says 172.21.15.146:38654) 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.688+0000 7eff8f400640 1 -- 172.21.15.146:0/359373209 learned_addr learned my addr 172.21.15.146:0/359373209 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8fe00640 1 --2- 172.21.15.146:0/359373209 >> v2:172.21.15.146:3300/0 conn(0x7eff9015aed0 0x7eff9006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243326297 0 0) 0x7eff900af350 con 0x7eff9015a170 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff74003520 con 0x7eff9015a170 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff86a00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a550 0x7eff9015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8fe00640 1 -- 172.21.15.146:0/359373209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a550 msgr2=0x7eff9015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:05.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8fe00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a550 0x7eff9015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8fe00640 1 -- 172.21.15.146:0/359373209 >> v1:172.21.15.146:6789/0 conn(0x7eff9015a170 legacy=0x7eff900aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 658604271 0 0) 0x7eff74003520 con 0x7eff9015a170 2024-04-24T23:01:05.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.689+0000 7eff8fe00640 1 -- 172.21.15.146:0/359373209 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9006c7f0 con 0x7eff9015aed0 2024-04-24T23:01:05.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.690+0000 7eff8fe00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff9006cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e74bd8deac0d2b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88037070 con 0x7eff9015aed0 2024-04-24T23:01:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8802ac30 con 0x7eff9015aed0 2024-04-24T23:01:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff8ea00640 1 -- 172.21.15.146:0/359373209 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800019f0 con 0x7eff9015aed0 2024-04-24T23:01:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 -- 172.21.15.146:0/359373209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 msgr2=0x7eff9006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff9006cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff8802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 -- 172.21.15.146:0/359373209 shutdown_connections 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff9006cff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 --2- 172.21.15.146:0/359373209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a550 0x7eff9015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 -- 172.21.15.146:0/359373209 >> 172.21.15.146:0/359373209 conn(0x7eff9006b560 msgr2=0x7eff9006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.691+0000 7eff94c00640 1 -- 172.21.15.146:0/359373209 shutdown_connections 2024-04-24T23:01:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.692+0000 7eff94c00640 1 -- 172.21.15.146:0/359373209 wait complete. 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.693+0000 7eff94c00640 1 Processor -- start 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.693+0000 7eff94c00640 1 -- start start 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a170 0x7eff90152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff9015a550 0x7eff90150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff9015b5b0 con 0x7eff9015aed0 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff900b3a00 con 0x7eff9015a550 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.694+0000 7eff94c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff9014a150 con 0x7eff9015a170 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55044/0 (socket says 172.21.15.146:55044) 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 -- 172.21.15.146:0/3905531431 learned_addr learned my addr 172.21.15.146:0/3905531431 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8f400640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a170 0x7eff90152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 -- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a170 msgr2=0x7eff90152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a170 0x7eff90152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 -- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff9015a550 msgr2=0x7eff90150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff9015a550 0x7eff90150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.695+0000 7eff8fe00640 1 -- 172.21.15.146:0/3905531431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90149540 con 0x7eff9015aed0 2024-04-24T23:01:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff8fe00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88037050 con 0x7eff9015aed0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88043070 con 0x7eff9015aed0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff90149820 con 0x7eff9015aed0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8803ca70 con 0x7eff9015aed0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.696+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9014a630 con 0x7eff9015aed0 2024-04-24T23:01:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.697+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff90149c10 con 0x7eff9015aed0 2024-04-24T23:01:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.698+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff8803cc10 con 0x7eff9015aed0 2024-04-24T23:01:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.700+0000 7eff87e00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 0x7eff6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.700+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7eff880abe50 con 0x7eff9015aed0 2024-04-24T23:01:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.700+0000 7eff8f400640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 0x7eff6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.701+0000 7eff8f400640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 0x7eff6c06e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff80001580 tx=0x7eff80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.704+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff88079da0 con 0x7eff9015aed0 2024-04-24T23:01:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.907+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7eff9004f500 con 0x7eff9015aed0 2024-04-24T23:01:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.907+0000 7eff87e00640 1 -- 172.21.15.146:0/3905531431 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7eff8807e0a0 con 0x7eff9015aed0 2024-04-24T23:01:05.908 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.910+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 msgr2=0x7eff6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.910+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 0x7eff6c06e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff80001580 tx=0x7eff80009040 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.910+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 msgr2=0x7eff901511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.910+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff880046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 shutdown_connections 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff9015aed0 0x7eff901511a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff9015a550 0x7eff90150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff6c06be60 0x7eff6c06e320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 --2- 172.21.15.146:0/3905531431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff9015a170 0x7eff90152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 >> 172.21.15.146:0/3905531431 conn(0x7eff9006b560 msgr2=0x7eff9015db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 shutdown_connections 2024-04-24T23:01:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:05.911+0000 7eff94c00640 1 -- 172.21.15.146:0/3905531431 wait complete. 2024-04-24T23:01:05.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:06.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.140+0000 7f3232000640 1 Processor -- start 2024-04-24T23:01:06.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.140+0000 7f3232000640 1 -- start start 2024-04-24T23:01:06.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.141+0000 7f3232000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f322c15bcd0 0x7f322c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3232000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 0x7f322c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3232000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f322c0d0200 0x7f322c06c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3232000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f322c15c8d0 con 0x7f322c15bcd0 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3232000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f322c0b4df0 con 0x7f322c0d0200 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3232000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f322c0b4b10 con 0x7f322c15cd60 2024-04-24T23:01:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3230c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f322c15bcd0 0x7f322c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3230c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f322c15bcd0 0x7f322c0cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55046/0 (socket says 172.21.15.146:55046) 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3230c00640 1 -- 172.21.15.146:0/3526662128 learned_addr learned my addr 172.21.15.146:0/3526662128 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f3231600640 1 --2- 172.21.15.146:0/3526662128 >> v2:172.21.15.203:3300/0 conn(0x7f322c0d0200 0x7f322c06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.142+0000 7f322be00640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 0x7f322c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f3230c00640 1 -- 172.21.15.146:0/3526662128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 msgr2=0x7f322c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f3230c00640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 0x7f322c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f3230c00640 1 -- 172.21.15.146:0/3526662128 >> v2:172.21.15.203:3300/0 conn(0x7f322c0d0200 msgr2=0x7f322c06c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f3230c00640 1 --2- 172.21.15.146:0/3526662128 >> v2:172.21.15.203:3300/0 conn(0x7f322c0d0200 0x7f322c06c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f3230c00640 1 -- 172.21.15.146:0/3526662128 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c15c280 con 0x7f322c15bcd0 2024-04-24T23:01:06.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.143+0000 7f322be00640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 0x7f322c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:06.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.144+0000 7f3230c00640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15bcd0 0x7f322c0cc230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f322c15d1e0 tx=0x7f322002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c8744e9376764c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.144+0000 7f322b400640 1 -- 172.21.15.146:0/3526662128 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220037070 con 0x7f322c15bcd0 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.144+0000 7f322b400640 1 -- 172.21.15.146:0/3526662128 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3220032440 con 0x7f322c15bcd0 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.144+0000 7f322b400640 1 -- 172.21.15.146:0/3526662128 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220032810 con 0x7f322c15bcd0 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 -- 172.21.15.146:0/3526662128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15bcd0 msgr2=0x7f322c0cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15bcd0 0x7f322c0cc230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f322c15d1e0 tx=0x7f322002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 -- 172.21.15.146:0/3526662128 shutdown_connections 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 --2- 172.21.15.146:0/3526662128 >> v2:172.21.15.203:3300/0 conn(0x7f322c0d0200 0x7f322c06c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15cd60 0x7f322c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 --2- 172.21.15.146:0/3526662128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15bcd0 0x7f322c0cc230 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 -- 172.21.15.146:0/3526662128 >> 172.21.15.146:0/3526662128 conn(0x7f322c06b560 msgr2=0x7f322c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 -- 172.21.15.146:0/3526662128 shutdown_connections 2024-04-24T23:01:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.145+0000 7f3232000640 1 -- 172.21.15.146:0/3526662128 wait complete. 2024-04-24T23:01:06.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.147+0000 7f3232000640 1 Processor -- start 2024-04-24T23:01:06.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.147+0000 7f3232000640 1 -- start start 2024-04-24T23:01:06.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f322c0d0200 0x7f322c0b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15bcd0 0x7f322c14a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f322c06e590 con 0x7f322c15cd60 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f322c0cc770 con 0x7f322c0d0200 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.148+0000 7f3232000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f322c0b4790 con 0x7f322c15bcd0 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55056/0 (socket says 172.21.15.146:55056) 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 -- 172.21.15.146:0/405451300 learned_addr learned my addr 172.21.15.146:0/405451300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f322be00640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15bcd0 0x7f322c14a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3230c00640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f322c0d0200 0x7f322c0b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 -- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15bcd0 msgr2=0x7f322c14a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15bcd0 0x7f322c14a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 -- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f322c0d0200 msgr2=0x7f322c0b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f322c0d0200 0x7f322c0b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.149+0000 7f3231600640 1 -- 172.21.15.146:0/405451300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c0b1ec0 con 0x7f322c15cd60 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3231600640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3224007e40 tx=0x7f322400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224014620 con 0x7f322c15cd60 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3224019070 con 0x7f322c15cd60 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224014a20 con 0x7f322c15cd60 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c0b21a0 con 0x7f322c15cd60 2024-04-24T23:01:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.150+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c0b2760 con 0x7f322c15cd60 2024-04-24T23:01:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.151+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c04f500 con 0x7f322c15cd60 2024-04-24T23:01:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.152+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3224014bc0 con 0x7f322c15cd60 2024-04-24T23:01:06.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.153+0000 7f3228c00640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 0x7f320c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.153+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f322408ba10 con 0x7f322c15cd60 2024-04-24T23:01:06.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.154+0000 7f3230c00640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 0x7f320c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.155+0000 7f3230c00640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 0x7f320c06e340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3220034000 tx=0x7f322002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.158+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f322405a0c0 con 0x7f322c15cd60 2024-04-24T23:01:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.355+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f322c15b220 con 0x7f322c15cd60 2024-04-24T23:01:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.357+0000 7f3228c00640 1 -- 172.21.15.146:0/405451300 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f32240599c0 con 0x7f322c15cd60 2024-04-24T23:01:06.358 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:06.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 msgr2=0x7f320c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 0x7f320c06e340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3220034000 tx=0x7f322002e000 comp rx=0 tx=0).stop 2024-04-24T23:01:06.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 msgr2=0x7f322c0b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3224007e40 tx=0x7f322400e4b0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 shutdown_connections 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15cd60 0x7f322c0b1470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f320c06be80 0x7f320c06e340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f322c15bcd0 0x7f322c14a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 --2- 172.21.15.146:0/405451300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f322c0d0200 0x7f322c0b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 >> 172.21.15.146:0/405451300 conn(0x7f322c06b560 msgr2=0x7f322c06c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 shutdown_connections 2024-04-24T23:01:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.359+0000 7f3232000640 1 -- 172.21.15.146:0/405451300 wait complete. 2024-04-24T23:01:06.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.581+0000 7f99dd600640 1 Processor -- start 2024-04-24T23:01:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.582+0000 7f99dd600640 1 -- start start 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.583+0000 7f99dd600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99d8158300 0x7f99d80cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.583+0000 7f99dd600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f99d815ea20 0x7f99d80d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.583+0000 7f99dd600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d815f070 con 0x7f99d8162580 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.583+0000 7f99dd600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f99d815ee50 con 0x7f99d8158300 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.583+0000 7f99dd600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f99d80b2ae0 con 0x7f99d815ea20 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99d8158300 0x7f99d80cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99d8158300 0x7f99d80cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55072/0 (socket says 172.21.15.146:55072) 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 -- 172.21.15.146:0/2857106304 learned_addr learned my addr 172.21.15.146:0/2857106304 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 -- 172.21.15.146:0/2857106304 >> v2:172.21.15.203:3300/0 conn(0x7f99d815ea20 msgr2=0x7f99d80d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:06.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 --2- 172.21.15.146:0/2857106304 >> v2:172.21.15.203:3300/0 conn(0x7f99d815ea20 0x7f99d80d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 -- 172.21.15.146:0/2857106304 >> v1:172.21.15.203:6789/0 conn(0x7f99d8162580 legacy=0x7f99d815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.584+0000 7f99d7e00640 1 -- 172.21.15.146:0/2857106304 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8161aa0 con 0x7f99d8158300 2024-04-24T23:01:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.585+0000 7f99d7e00640 1 --2- 172.21.15.146:0/2857106304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d80cfcc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99d80728b0 tx=0x7f99c802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2779abbeac0f0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99d7400640 1 -- 172.21.15.146:0/2857106304 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037070 con 0x7f99d8158300 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99d7400640 1 -- 172.21.15.146:0/2857106304 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c8032440 con 0x7f99d8158300 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99d7400640 1 -- 172.21.15.146:0/2857106304 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8032810 con 0x7f99d8158300 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 -- 172.21.15.146:0/2857106304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 msgr2=0x7f99d80cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 --2- 172.21.15.146:0/2857106304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d80cfcc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99d80728b0 tx=0x7f99c802a2c0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 -- 172.21.15.146:0/2857106304 shutdown_connections 2024-04-24T23:01:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 --2- 172.21.15.146:0/2857106304 >> v2:172.21.15.203:3300/0 conn(0x7f99d815ea20 0x7f99d80d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 --2- 172.21.15.146:0/2857106304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d80cfcc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 -- 172.21.15.146:0/2857106304 >> 172.21.15.146:0/2857106304 conn(0x7f99d806b560 msgr2=0x7f99d806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 -- 172.21.15.146:0/2857106304 shutdown_connections 2024-04-24T23:01:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.586+0000 7f99dd600640 1 -- 172.21.15.146:0/2857106304 wait complete. 2024-04-24T23:01:06.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.588+0000 7f99dd600640 1 Processor -- start 2024-04-24T23:01:06.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.588+0000 7f99dd600640 1 -- start start 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 0x7f99d8156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99d8162580 0x7f99d8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81586e0 con 0x7f99d8158300 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8162060 con 0x7f99d815ea20 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99dd600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f99d806cab0 con 0x7f99d8162580 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55084/0 (socket says 172.21.15.146:55084) 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.589+0000 7f99d7e00640 1 -- 172.21.15.146:0/4244869982 learned_addr learned my addr 172.21.15.146:0/4244869982 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 -- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99d8162580 msgr2=0x7f99d8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99d8162580 0x7f99d8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 -- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 msgr2=0x7f99d8156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99cf400640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 0x7f99d8156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 0x7f99d8156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 -- 172.21.15.146:0/4244869982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d81601c0 con 0x7f99d8158300 2024-04-24T23:01:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99cf400640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 0x7f99d8156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d7e00640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000c00 tx=0x7f99c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.590+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8041070 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.591+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c803c870 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.591+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037040 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.591+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d80ccd50 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.591+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d80cd310 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.592+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d804f500 con 0x7f99d8158300 2024-04-24T23:01:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.593+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99c8044070 con 0x7f99d8158300 2024-04-24T23:01:06.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.594+0000 7f99d4c00640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:06.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.594+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f99c80abff0 con 0x7f99d8158300 2024-04-24T23:01:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.594+0000 7f99cf400640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.595+0000 7f99cf400640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 0x7f99b406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99d8151ee0 tx=0x7f99c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.598+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f99c807a680 con 0x7f99d8158300 2024-04-24T23:01:06.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.800+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f99d806c890 con 0x7f99d8158300 2024-04-24T23:01:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.801+0000 7f99d4c00640 1 -- 172.21.15.146:0/4244869982 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f99c8079f80 con 0x7f99d8158300 2024-04-24T23:01:06.802 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 msgr2=0x7f99b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 0x7f99b406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99d8151ee0 tx=0x7f99c0008040 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 msgr2=0x7f99d815fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000c00 tx=0x7f99c80046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 shutdown_connections 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99b406be30 0x7f99b406e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99d8162580 0x7f99d8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d815ea20 0x7f99d8156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 --2- 172.21.15.146:0/4244869982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8158300 0x7f99d815fc80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 >> 172.21.15.146:0/4244869982 conn(0x7f99d806b560 msgr2=0x7f99d80b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 shutdown_connections 2024-04-24T23:01:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:06.804+0000 7f99dd600640 1 -- 172.21.15.146:0/4244869982 wait complete. 2024-04-24T23:01:06.826 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.014+0000 7fd4f6000640 1 Processor -- start 2024-04-24T23:01:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.014+0000 7fd4f6000640 1 -- start start 2024-04-24T23:01:07.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.016+0000 7fd4f6000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd4f0142570 0x7fd4f006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.016+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 0x7fd4f015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.016+0000 7fd4f6000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f0142950 con 0x7fd4f0070ba0 2024-04-24T23:01:07.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.016+0000 7fd4f6000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f0071c40 con 0x7fd4f0142570 2024-04-24T23:01:07.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.016+0000 7fd4f6000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f0071030 con 0x7fd4f00720d0 2024-04-24T23:01:07.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.017+0000 7fd4ef400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd4f0142570 0x7fd4f006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.017+0000 7fd4efe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 0x7fd4f015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.017+0000 7fd4e6a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fd4f0070ba0 0x7fd4f006d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:33698/0 (socket says 172.21.15.146:33698) 2024-04-24T23:01:07.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.017+0000 7fd4e6a00640 1 -- 172.21.15.146:0/2470115545 learned_addr learned my addr 172.21.15.146:0/2470115545 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4eea00640 1 -- 172.21.15.146:0/2470115545 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523890320 0 0) 0x7fd4f0142950 con 0x7fd4f0070ba0 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4eea00640 1 -- 172.21.15.146:0/2470115545 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4d4003520 con 0x7fd4f0070ba0 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4efe00640 1 -- 172.21.15.146:0/2470115545 >> v2:172.21.15.203:3300/0 conn(0x7fd4f0142570 msgr2=0x7fd4f006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4efe00640 1 --2- 172.21.15.146:0/2470115545 >> v2:172.21.15.203:3300/0 conn(0x7fd4f0142570 0x7fd4f006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4efe00640 1 -- 172.21.15.146:0/2470115545 >> v1:172.21.15.203:6789/0 conn(0x7fd4f0070ba0 legacy=0x7fd4f006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.018+0000 7fd4efe00640 1 -- 172.21.15.146:0/2470115545 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f0071310 con 0x7fd4f00720d0 2024-04-24T23:01:07.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.019+0000 7fd4efe00640 1 --2- 172.21.15.146:0/2470115545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 0x7fd4f015fc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097a0 tx=0x7fd4e802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85faa32b7bf4c20c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.020+0000 7fd4eea00640 1 -- 172.21.15.146:0/2470115545 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8037070 con 0x7fd4f00720d0 2024-04-24T23:01:07.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.020+0000 7fd4eea00640 1 -- 172.21.15.146:0/2470115545 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8032440 con 0x7fd4f00720d0 2024-04-24T23:01:07.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.020+0000 7fd4eea00640 1 -- 172.21.15.146:0/2470115545 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8032810 con 0x7fd4f00720d0 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 -- 172.21.15.146:0/2470115545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 msgr2=0x7fd4f015fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 --2- 172.21.15.146:0/2470115545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 0x7fd4f015fc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097a0 tx=0x7fd4e802a180 comp rx=0 tx=0).stop 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 -- 172.21.15.146:0/2470115545 shutdown_connections 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 --2- 172.21.15.146:0/2470115545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f00720d0 0x7fd4f015fc00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 --2- 172.21.15.146:0/2470115545 >> v2:172.21.15.203:3300/0 conn(0x7fd4f0142570 0x7fd4f006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 -- 172.21.15.146:0/2470115545 >> 172.21.15.146:0/2470115545 conn(0x7fd4f006b140 msgr2=0x7fd4f006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 -- 172.21.15.146:0/2470115545 shutdown_connections 2024-04-24T23:01:07.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.021+0000 7fd4f6000640 1 -- 172.21.15.146:0/2470115545 wait complete. 2024-04-24T23:01:07.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.023+0000 7fd4f6000640 1 Processor -- start 2024-04-24T23:01:07.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.023+0000 7fd4f6000640 1 -- start start 2024-04-24T23:01:07.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00720d0 0x7fd4f00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0142570 0x7fd4f01414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0072c60 con 0x7fd4f00c7b20 2024-04-24T23:01:07.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00718d0 con 0x7fd4f00720d0 2024-04-24T23:01:07.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4f6000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f0072de0 con 0x7fd4f0142570 2024-04-24T23:01:07.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55094/0 (socket says 172.21.15.146:55094) 2024-04-24T23:01:07.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.025+0000 7fd4efe00640 1 -- 172.21.15.146:0/4186407367 learned_addr learned my addr 172.21.15.146:0/4186407367 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4ef400640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00720d0 0x7fd4f00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 -- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0142570 msgr2=0x7fd4f01414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0142570 0x7fd4f01414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 -- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00720d0 msgr2=0x7fd4f00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00720d0 0x7fd4f00b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 -- 172.21.15.146:0/4186407367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f00c8070 con 0x7fd4f00c7b20 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4efe00640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80098c0 tx=0x7fd4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.026+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8037050 con 0x7fd4f00c7b20 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.027+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8043070 con 0x7fd4f00c7b20 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.027+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e803cb10 con 0x7fd4f00c7b20 2024-04-24T23:01:07.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.027+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f00c8350 con 0x7fd4f00c7b20 2024-04-24T23:01:07.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.027+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f00c8910 con 0x7fd4f00c7b20 2024-04-24T23:01:07.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.028+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f004f5a0 con 0x7fd4f00c7b20 2024-04-24T23:01:07.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.029+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e803ccb0 con 0x7fd4f00c7b20 2024-04-24T23:01:07.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.030+0000 7fd4e7e00640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 0x7fd4cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.030+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd4e80abe10 con 0x7fd4f00c7b20 2024-04-24T23:01:07.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.030+0000 7fd4ef400640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 0x7fd4cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.031+0000 7fd4ef400640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 0x7fd4cc06e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00073f0 tx=0x7fd4e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.034+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd4e80af030 con 0x7fd4f00c7b20 2024-04-24T23:01:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.245+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4f006e9a0 con 0x7fd4f00c7b20 2024-04-24T23:01:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.246+0000 7fd4e7e00640 1 -- 172.21.15.146:0/4186407367 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fd4e8046360 con 0x7fd4f00c7b20 2024-04-24T23:01:07.247 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:01:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 msgr2=0x7fd4cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 0x7fd4cc06e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00073f0 tx=0x7fd4e000b040 comp rx=0 tx=0).stop 2024-04-24T23:01:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 msgr2=0x7fd4f0157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80098c0 tx=0x7fd4e80046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 shutdown_connections 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4f00c7b20 0x7fd4f0157b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd4cc06be60 0x7fd4cc06e320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0142570 0x7fd4f01414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 --2- 172.21.15.146:0/4186407367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00720d0 0x7fd4f00b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.248+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 >> 172.21.15.146:0/4186407367 conn(0x7fd4f006b140 msgr2=0x7fd4f00c4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.249+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 shutdown_connections 2024-04-24T23:01:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.249+0000 7fd4f6000640 1 -- 172.21.15.146:0/4186407367 wait complete. 2024-04-24T23:01:07.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:01:07.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:07.268 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-24T23:01:07.351 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:01:07.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:07.352 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:01:07.403 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:07.403 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:07.460 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:07.460 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:07.510 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:07.511 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:07.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:07.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.761+0000 7fe045600640 1 Processor -- start 2024-04-24T23:01:07.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.761+0000 7fe045600640 1 -- start start 2024-04-24T23:01:07.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe045600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 0x7fe0400cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe045600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 0x7fe0400d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe045600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0400cdf70 con 0x7fe040145640 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe045600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe040145a20 con 0x7fe04006cbc0 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe045600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe04006d140 con 0x7fe0400b2a20 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe03ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe040145640 0x7fe04015ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38668/0 (socket says 172.21.15.146:38668) 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe03ea00640 1 -- 172.21.15.146:0/7708392 learned_addr learned my addr 172.21.15.146:0/7708392 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe03e000640 1 --2- 172.21.15.146:0/7708392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 0x7fe0400cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.763+0000 7fe03f400640 1 --2- 172.21.15.146:0/7708392 >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 0x7fe0400d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.764+0000 7fe03e000640 1 -- 172.21.15.146:0/7708392 >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 msgr2=0x7fe0400d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.764+0000 7fe03e000640 1 --2- 172.21.15.146:0/7708392 >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 0x7fe0400d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.764+0000 7fe03e000640 1 -- 172.21.15.146:0/7708392 >> v1:172.21.15.146:6789/0 conn(0x7fe040145640 legacy=0x7fe04015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.764+0000 7fe03e000640 1 -- 172.21.15.146:0/7708392 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04006d420 con 0x7fe0400b2a20 2024-04-24T23:01:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.764+0000 7fe03f400640 1 --2- 172.21.15.146:0/7708392 >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 0x7fe0400d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:01:07.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.766+0000 7fe03e000640 1 --2- 172.21.15.146:0/7708392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 0x7fe0400cfc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24bfd280c82b43a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.769+0000 7fe03d600640 1 -- 172.21.15.146:0/7708392 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c037070 con 0x7fe0400b2a20 2024-04-24T23:01:07.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.769+0000 7fe03d600640 1 -- 172.21.15.146:0/7708392 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c032440 con 0x7fe0400b2a20 2024-04-24T23:01:07.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.769+0000 7fe03d600640 1 -- 172.21.15.146:0/7708392 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c032810 con 0x7fe0400b2a20 2024-04-24T23:01:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 -- 172.21.15.146:0/7708392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 msgr2=0x7fe0400cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 --2- 172.21.15.146:0/7708392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 0x7fe0400cfc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a180 comp rx=0 tx=0).stop 2024-04-24T23:01:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 -- 172.21.15.146:0/7708392 shutdown_connections 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 --2- 172.21.15.146:0/7708392 >> v2:172.21.15.203:3300/0 conn(0x7fe04006cbc0 0x7fe0400d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 --2- 172.21.15.146:0/7708392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0400b2a20 0x7fe0400cfc90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 -- 172.21.15.146:0/7708392 >> 172.21.15.146:0/7708392 conn(0x7fe04006b320 msgr2=0x7fe04006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 -- 172.21.15.146:0/7708392 shutdown_connections 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.770+0000 7fe045600640 1 -- 172.21.15.146:0/7708392 wait complete. 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.771+0000 7fe045600640 1 Processor -- start 2024-04-24T23:01:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.772+0000 7fe045600640 1 -- start start 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe04006cbc0 0x7fe0401f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0400b2a20 0x7fe0401f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0400ce450 con 0x7fe040145640 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe04006d9e0 con 0x7fe0400b2a20 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe045600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0400ce5d0 con 0x7fe04006cbc0 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55110/0 (socket says 172.21.15.146:55110) 2024-04-24T23:01:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 -- 172.21.15.146:0/2572463005 learned_addr learned my addr 172.21.15.146:0/2572463005 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03ea00640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe04006cbc0 0x7fe0401f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03e000640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0400b2a20 0x7fe0401f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 -- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe04006cbc0 msgr2=0x7fe0401f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe04006cbc0 0x7fe0401f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 -- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0400b2a20 msgr2=0x7fe0401f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0400b2a20 0x7fe0401f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.773+0000 7fe03f400640 1 -- 172.21.15.146:0/2572463005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0401f7cb0 con 0x7fe040145640 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe03f400640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e960 tx=0x7fe03800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038017070 con 0x7fe040145640 2024-04-24T23:01:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe038004020 con 0x7fe040145640 2024-04-24T23:01:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380043f0 con 0x7fe040145640 2024-04-24T23:01:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0401f7f90 con 0x7fe040145640 2024-04-24T23:01:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.774+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0401f39b0 con 0x7fe040145640 2024-04-24T23:01:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.775+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0401f8160 con 0x7fe040145640 2024-04-24T23:01:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.776+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe03800ca00 con 0x7fe040145640 2024-04-24T23:01:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.777+0000 7fe036a00640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.778+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe03808b440 con 0x7fe040145640 2024-04-24T23:01:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.778+0000 7fe03ea00640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.779+0000 7fe03ea00640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 0x7fe02006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0300012e0 tx=0x7fe030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.782+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0401f8160 con 0x7fe040145640 2024-04-24T23:01:07.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.986+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe040068190 con 0x7fe040145640 2024-04-24T23:01:07.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.989+0000 7fe036a00640 1 -- 172.21.15.146:0/2572463005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fe038059a70 con 0x7fe040145640 2024-04-24T23:01:07.991 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:07.991 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 msgr2=0x7fe02006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 0x7fe02006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0300012e0 tx=0x7fe030009040 comp rx=0 tx=0).stop 2024-04-24T23:01:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 msgr2=0x7fe040159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e960 tx=0x7fe03800ee20 comp rx=0 tx=0).stop 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 shutdown_connections 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040145640 0x7fe040159e50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0400b2a20 0x7fe0401f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 --2- 172.21.15.146:0/2572463005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe04006cbc0 0x7fe0401f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 >> 172.21.15.146:0/2572463005 conn(0x7fe04006b320 msgr2=0x7fe04006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 shutdown_connections 2024-04-24T23:01:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:07.992+0000 7fe045600640 1 -- 172.21.15.146:0/2572463005 wait complete. 2024-04-24T23:01:08.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:08.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.207+0000 7f847a400640 1 Processor -- start 2024-04-24T23:01:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.207+0000 7f847a400640 1 -- start start 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f847a400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f847415bcd0 0x7f84740cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f847a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 0x7f847415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f847a400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84740b4df0 con 0x7f847415cd60 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f847a400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f847415c8d0 con 0x7f847415bcd0 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f847a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f84740b4b10 con 0x7f84740d03d0 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f8473e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f847415cd60 0x7f84740cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34944/0 (socket says 172.21.15.146:34944) 2024-04-24T23:01:08.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.209+0000 7f8473e00640 1 -- 172.21.15.146:0/2456782879 learned_addr learned my addr 172.21.15.146:0/2456782879 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8479000640 1 --2- 172.21.15.146:0/2456782879 >> v2:172.21.15.203:3300/0 conn(0x7f847415bcd0 0x7f84740cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8479a00640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 0x7f847415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230983569 0 0) 0x7f84740b4df0 con 0x7f847415cd60 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f845c003520 con 0x7f847415cd60 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1953660329 0 0) 0x7f845c003520 con 0x7f847415cd60 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 msgr2=0x7f847415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 0x7f847415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 >> v2:172.21.15.203:3300/0 conn(0x7f847415bcd0 msgr2=0x7f84740cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 --2- 172.21.15.146:0/2456782879 >> v2:172.21.15.203:3300/0 conn(0x7f847415bcd0 0x7f84740cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847415c280 con 0x7f847415cd60 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f8460001670 con 0x7f847415cd60 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 >> v1:172.21.15.146:6789/0 conn(0x7f847415cd60 legacy=0x7f84740cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c0039b0 0x7f845c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 0x7f845c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c004d40 0x7f845c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.210+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f847415c8d0 con 0x7f845c0039b0 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84740b4b10 con 0x7f845c004d40 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f845c00b9c0 con 0x7f84740d03d0 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c0039b0 0x7f845c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 -- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 msgr2=0x7f845c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84740d03d0 0x7f845c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 -- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c004d40 msgr2=0x7f845c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c004d40 0x7f845c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.211+0000 7f8479000640 1 -- 172.21.15.146:0/2456782879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c003520 con 0x7f845c0039b0 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.212+0000 7f8479000640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c0039b0 0x7f845c003dd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8468009af0 tx=0x7f845c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7df3b96623d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.212+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468036070 con 0x7f845c0039b0 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.212+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8468031400 con 0x7f845c0039b0 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.212+0000 7f8473400640 1 -- 172.21.15.146:0/2456782879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468009690 con 0x7f845c0039b0 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 -- 172.21.15.146:0/2456782879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c0039b0 msgr2=0x7f845c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 --2- 172.21.15.146:0/2456782879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c0039b0 0x7f845c003dd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8468009af0 tx=0x7f845c005830 comp rx=0 tx=0).stop 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f8479a00640 1 -- 172.21.15.146:0/2456782879 reap_dead start 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 -- 172.21.15.146:0/2456782879 shutdown_connections 2024-04-24T23:01:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 -- 172.21.15.146:0/2456782879 >> 172.21.15.146:0/2456782879 conn(0x7f847406b560 msgr2=0x7f847406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 -- 172.21.15.146:0/2456782879 shutdown_connections 2024-04-24T23:01:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.213+0000 7f847a400640 1 -- 172.21.15.146:0/2456782879 wait complete. 2024-04-24T23:01:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.215+0000 7f847a400640 1 Processor -- start 2024-04-24T23:01:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.215+0000 7f847a400640 1 -- start start 2024-04-24T23:01:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c0039b0 0x7f84741e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8474146df0 0x7f8474147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f847406e590 con 0x7f84741f55d0 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84740cc770 con 0x7f845c0039b0 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f847a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f84740b4790 con 0x7f8474146df0 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f8479a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f8479a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60710/0 (socket says 172.21.15.146:60710) 2024-04-24T23:01:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.216+0000 7f8479a00640 1 -- 172.21.15.146:0/1108008149 learned_addr learned my addr 172.21.15.146:0/1108008149 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8473e00640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8474146df0 0x7f8474147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 -- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8474146df0 msgr2=0x7f8474147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8474146df0 0x7f8474147270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 -- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c0039b0 msgr2=0x7f84741e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479000640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c0039b0 0x7f84741e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c0039b0 0x7f84741e7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 -- 172.21.15.146:0/1108008149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84741f62e0 con 0x7f84741f55d0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8479a00640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8474160780 tx=0x7f846c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c00bae0 con 0x7f84741f55d0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c01a070 con 0x7f84741f55d0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.217+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c014400 con 0x7f84741f55d0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.218+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84740b1490 con 0x7f84741f55d0 2024-04-24T23:01:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.218+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84740b1a50 con 0x7f84741f55d0 2024-04-24T23:01:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.219+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847415b530 con 0x7f84741f55d0 2024-04-24T23:01:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.220+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f846c005d10 con 0x7f84741f55d0 2024-04-24T23:01:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.221+0000 7f8470c00640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.221+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f846c08b500 con 0x7f84741f55d0 2024-04-24T23:01:08.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.221+0000 7f8479000640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.223+0000 7f8479000640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 0x7f845406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8468033000 tx=0x7f8468008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.225+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f847415b530 con 0x7f84741f55d0 2024-04-24T23:01:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.424+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8474160400 con 0x7f84741f55d0 2024-04-24T23:01:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.425+0000 7f8470c00640 1 -- 172.21.15.146:0/1108008149 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f8474160400 con 0x7f84741f55d0 2024-04-24T23:01:08.426 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.427+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 msgr2=0x7f845406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.427+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 0x7f845406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8468033000 tx=0x7f8468008030 comp rx=0 tx=0).stop 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.427+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 msgr2=0x7f84741f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.427+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8474160780 tx=0x7f846c00b480 comp rx=0 tx=0).stop 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 shutdown_connections 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84741f55d0 0x7f84741f5a50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8474146df0 0x7f8474147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 --2- 172.21.15.146:0/1108008149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f845c0039b0 0x7f84741e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 >> 172.21.15.146:0/1108008149 conn(0x7f847406b560 msgr2=0x7f847415ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:08.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 shutdown_connections 2024-04-24T23:01:08.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.428+0000 7f847a400640 1 -- 172.21.15.146:0/1108008149 wait complete. 2024-04-24T23:01:08.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:08.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.653+0000 7fb1cc600640 1 Processor -- start 2024-04-24T23:01:08.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.653+0000 7fb1cc600640 1 -- start start 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1cc600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1c4166d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1cc600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40ced40 con 0x7fb1c413ef30 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1cc600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40cf020 con 0x7fb1c4141c80 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1cc600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c41423d0 con 0x7fb1c4072420 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1c9c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1c413ef30 0x7fb1c4141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34952/0 (socket says 172.21.15.146:34952) 2024-04-24T23:01:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.655+0000 7fb1c9c00640 1 -- 172.21.15.146:0/1705114003 learned_addr learned my addr 172.21.15.146:0/1705114003 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1ca600640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1c4166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338441852 0 0) 0x7fb1c40ced40 con 0x7fb1c413ef30 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac003520 con 0x7fb1c413ef30 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2541608200 0 0) 0x7fb1ac003520 con 0x7fb1c413ef30 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 msgr2=0x7fb1c4166d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1c4166d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 >> v1:172.21.15.203:6789/0 conn(0x7fb1c4141c80 legacy=0x7fb1c40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40cf300 con 0x7fb1c413ef30 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb1b8001670 con 0x7fb1c413ef30 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 >> v1:172.21.15.146:6789/0 conn(0x7fb1c413ef30 legacy=0x7fb1c4141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1ac003f60 0x7fb1ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac004d40 0x7fb1ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac00ba70 con 0x7fb1ac003f60 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac00bc20 con 0x7fb1ac004d40 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.656+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac00be20 con 0x7fb1c4072420 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1ac003f60 0x7fb1ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9c00640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 -- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 msgr2=0x7fb1ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c4072420 0x7fb1ac0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 -- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac004d40 msgr2=0x7fb1ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac004d40 0x7fb1ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.657+0000 7fb1c9200640 1 -- 172.21.15.146:0/1705114003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac003520 con 0x7fb1ac003f60 2024-04-24T23:01:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.658+0000 7fb1c9200640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1ac003f60 0x7fb1ac004800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0001750 tx=0x7fb1ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b70720258d99034 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.658+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0001370 con 0x7fb1ac003f60 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.658+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b00052d0 con 0x7fb1ac003f60 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.658+0000 7fb1c3e00640 1 -- 172.21.15.146:0/1705114003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b002abe0 con 0x7fb1ac003f60 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 -- 172.21.15.146:0/1705114003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1ac003f60 msgr2=0x7fb1ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 --2- 172.21.15.146:0/1705114003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1ac003f60 0x7fb1ac004800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0001750 tx=0x7fb1ac005830 comp rx=0 tx=0).stop 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1ca600640 1 -- 172.21.15.146:0/1705114003 reap_dead start 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 -- 172.21.15.146:0/1705114003 shutdown_connections 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 -- 172.21.15.146:0/1705114003 >> 172.21.15.146:0/1705114003 conn(0x7fb1c40b17b0 msgr2=0x7fb1c40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 -- 172.21.15.146:0/1705114003 shutdown_connections 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.659+0000 7fb1cc600640 1 -- 172.21.15.146:0/1705114003 wait complete. 2024-04-24T23:01:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.661+0000 7fb1cc600640 1 Processor -- start 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.661+0000 7fb1cc600640 1 -- start start 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 0x7fb1c406d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40aea40 0x7fb1c40aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40ce770 con 0x7fb1c41f3b90 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4070f80 con 0x7fb1ac003f60 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1cc600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40ce8f0 con 0x7fb1c40aea40 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1c9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1c9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60738/0 (socket says 172.21.15.146:60738) 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.662+0000 7fb1c9200640 1 -- 172.21.15.146:0/2408928099 learned_addr learned my addr 172.21.15.146:0/2408928099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9c00640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 0x7fb1c406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1ca600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40aea40 0x7fb1c40aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 -- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40aea40 msgr2=0x7fb1c40aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40aea40 0x7fb1c40aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 -- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 msgr2=0x7fb1c406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 0x7fb1c406d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 -- 172.21.15.146:0/2408928099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41f3ff0 con 0x7fb1c41f3b90 2024-04-24T23:01:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9c00640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 0x7fb1c406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c9200640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0008fd0 tx=0x7fb1b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.663+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0040020 con 0x7fb1c41f3b90 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.664+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b0007680 con 0x7fb1c41f3b90 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.664+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0007a30 con 0x7fb1c41f3b90 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.664+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c4138fa0 con 0x7fb1c41f3b90 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.664+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41449b0 con 0x7fb1c41f3b90 2024-04-24T23:01:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.665+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c40af400 con 0x7fb1c41f3b90 2024-04-24T23:01:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.666+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1b0043020 con 0x7fb1c41f3b90 2024-04-24T23:01:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.667+0000 7fb1c1600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 0x7fb1a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.667+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb1b00ab190 con 0x7fb1c41f3b90 2024-04-24T23:01:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.667+0000 7fb1c9c00640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 0x7fb1a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:08.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.668+0000 7fb1c9c00640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 0x7fb1a406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001920 tx=0x7fb1b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:08.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.671+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb1b004a030 con 0x7fb1c41f3b90 2024-04-24T23:01:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.870+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1c40ced40 con 0x7fb1c41f3b90 2024-04-24T23:01:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.871+0000 7fb1c1600640 1 -- 172.21.15.146:0/2408928099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fb1c40ced40 con 0x7fb1c41f3b90 2024-04-24T23:01:08.872 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 msgr2=0x7fb1a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 0x7fb1a406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8001920 tx=0x7fb1b8009040 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 msgr2=0x7fb1c4138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0008fd0 tx=0x7fb1b0001120 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 shutdown_connections 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a406be30 0x7fb1a406e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40aea40 0x7fb1c40aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f3b90 0x7fb1c4138a60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 --2- 172.21.15.146:0/2408928099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1ac003f60 0x7fb1c406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 >> 172.21.15.146:0/2408928099 conn(0x7fb1c40b17b0 msgr2=0x7fb1c40cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 shutdown_connections 2024-04-24T23:01:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:08.874+0000 7fb1cc600640 1 -- 172.21.15.146:0/2408928099 wait complete. 2024-04-24T23:01:08.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:09.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.100+0000 7fcbd4a00640 1 Processor -- start 2024-04-24T23:01:09.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.100+0000 7fcbd4a00640 1 -- start start 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbd4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbd00cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbd4a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b4df0 con 0x7fcbd015bcd0 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbd4a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b4b10 con 0x7fcbd00d0200 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbd4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd015c8d0 con 0x7fcbd015cd60 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbcf400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcbd015bcd0 0x7fcbd00cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34960/0 (socket says 172.21.15.146:34960) 2024-04-24T23:01:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.102+0000 7fcbcf400640 1 -- 172.21.15.146:0/98626369 learned_addr learned my addr 172.21.15.146:0/98626369 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854402235 0 0) 0x7fcbd00b4df0 con 0x7fcbd015bcd0 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbc6a00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbd00cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbb4003520 con 0x7fcbd015bcd0 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2931309599 0 0) 0x7fcbb4003520 con 0x7fcbd015bcd0 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 msgr2=0x7fcbd00cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbd00cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 >> v1:172.21.15.203:6789/0 conn(0x7fcbd00d0200 legacy=0x7fcbd015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd015c280 con 0x7fcbd015bcd0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fcbc0001670 con 0x7fcbd015bcd0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 >> v1:172.21.15.146:6789/0 conn(0x7fcbd015bcd0 legacy=0x7fcbd00cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb40039e0 0x7fcbb4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbb4004800 0x7fcbb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd015c8d0 con 0x7fcbb40039e0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb400baf0 con 0x7fcbb4004800 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.103+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb400bcf0 con 0x7fcbd015cd60 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb40039e0 0x7fcbb4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbc6a00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbb4004800 0x7fcbb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcfe00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 -- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 msgr2=0x7fcbb4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbd015cd60 0x7fcbb4005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 -- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbb4004800 msgr2=0x7fcbb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbb4004800 0x7fcbb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.104+0000 7fcbcf400640 1 -- 172.21.15.146:0/98626369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb4003520 con 0x7fcbb40039e0 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.105+0000 7fcbcf400640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb40039e0 0x7fcbb4003e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c210 tx=0x7fcbb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafdf7ba23312a79 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.105+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0007d30 con 0x7fcbb40039e0 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.105+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0005ad0 con 0x7fcbb40039e0 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.105+0000 7fcbcea00640 1 -- 172.21.15.146:0/98626369 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0007070 con 0x7fcbb40039e0 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 -- 172.21.15.146:0/98626369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb40039e0 msgr2=0x7fcbb4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/98626369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb40039e0 0x7fcbb4003e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c210 tx=0x7fcbb4005830 comp rx=0 tx=0).stop 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbcfe00640 1 -- 172.21.15.146:0/98626369 reap_dead start 2024-04-24T23:01:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 -- 172.21.15.146:0/98626369 shutdown_connections 2024-04-24T23:01:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 -- 172.21.15.146:0/98626369 >> 172.21.15.146:0/98626369 conn(0x7fcbd006b560 msgr2=0x7fcbd006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 -- 172.21.15.146:0/98626369 shutdown_connections 2024-04-24T23:01:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.106+0000 7fcbd4a00640 1 -- 172.21.15.146:0/98626369 wait complete. 2024-04-24T23:01:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.108+0000 7fcbd4a00640 1 Processor -- start 2024-04-24T23:01:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.108+0000 7fcbd4a00640 1 -- start start 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbb40039e0 0x7fcbd0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbd01549b0 0x7fcbd0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd00b4790 con 0x7fcbd01f5600 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd006e590 con 0x7fcbd01549b0 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbd4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd00cfcc0 con 0x7fcbb40039e0 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbc6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbc6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60748/0 (socket says 172.21.15.146:60748) 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.109+0000 7fcbc6a00640 1 -- 172.21.15.146:0/1078685436 learned_addr learned my addr 172.21.15.146:0/1078685436 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 -- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbb40039e0 msgr2=0x7fcbd0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbb40039e0 0x7fcbd0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 -- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbd01549b0 msgr2=0x7fcbd0154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbd01549b0 0x7fcbd0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 -- 172.21.15.146:0/1078685436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd0152580 con 0x7fcbd01f5600 2024-04-24T23:01:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc6a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800f580 tx=0x7fcbb800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8019020 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb8014870 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8014c60 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.110+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd0152860 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.111+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd0152e20 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.112+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd004f500 con 0x7fcbd01f5600 2024-04-24T23:01:09.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.113+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbb801c020 con 0x7fcbd01f5600 2024-04-24T23:01:09.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.114+0000 7fcbc7e00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 0x7fcbac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.114+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fcbb808b950 con 0x7fcbd01f5600 2024-04-24T23:01:09.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.114+0000 7fcbcf400640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 0x7fcbac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.115+0000 7fcbcf400640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 0x7fcbac06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0033000 tx=0x7fcbc0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.118+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcbb8023020 con 0x7fcbd01f5600 2024-04-24T23:01:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.318+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcbd015eef0 con 0x7fcbd01f5600 2024-04-24T23:01:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.319+0000 7fcbc7e00640 1 -- 172.21.15.146:0/1078685436 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fcbb8059fa0 con 0x7fcbd01f5600 2024-04-24T23:01:09.320 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 msgr2=0x7fcbac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 0x7fcbac06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0033000 tx=0x7fcbc0009030 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 msgr2=0x7fcbd01f5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800f580 tx=0x7fcbb800fa40 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 shutdown_connections 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbd01549b0 0x7fcbd0154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd01f5600 0x7fcbd01f5a80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcbac06be30 0x7fcbac06e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 --2- 172.21.15.146:0/1078685436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcbb40039e0 0x7fcbd0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 >> 172.21.15.146:0/1078685436 conn(0x7fcbd006b560 msgr2=0x7fcbd0158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 shutdown_connections 2024-04-24T23:01:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.322+0000 7fcbd4a00640 1 -- 172.21.15.146:0/1078685436 wait complete. 2024-04-24T23:01:09.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.540+0000 7f31b3000640 1 Processor -- start 2024-04-24T23:01:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.541+0000 7f31b3000640 1 -- start start 2024-04-24T23:01:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31b3000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31ac15be70 0x7f31ac0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31b3000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 0x7f31ac0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31b3000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac072040 con 0x7f31ac0729b0 2024-04-24T23:01:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31b3000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f31ac06e3c0 con 0x7f31ac15be70 2024-04-24T23:01:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31b3000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f31ac0b4380 con 0x7f31ac0b3a30 2024-04-24T23:01:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.542+0000 7f31abe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31ac15be70 0x7f31ac0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31ab400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f31ac0729b0 0x7f31ac06e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34974/0 (socket says 172.21.15.146:34974) 2024-04-24T23:01:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31ab400640 1 -- 172.21.15.146:0/1512292834 learned_addr learned my addr 172.21.15.146:0/1512292834 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31b1000640 1 --2- 172.21.15.146:0/1512292834 >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 0x7f31ac0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31abe00640 1 -- 172.21.15.146:0/1512292834 >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 msgr2=0x7f31ac0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31abe00640 1 --2- 172.21.15.146:0/1512292834 >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 0x7f31ac0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31abe00640 1 -- 172.21.15.146:0/1512292834 >> v1:172.21.15.146:6789/0 conn(0x7f31ac0729b0 legacy=0x7f31ac06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31abe00640 1 -- 172.21.15.146:0/1512292834 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac06ddb0 con 0x7f31ac15be70 2024-04-24T23:01:09.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.543+0000 7f31b1000640 1 --2- 172.21.15.146:0/1512292834 >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 0x7f31ac0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.544+0000 7f31abe00640 1 --2- 172.21.15.146:0/1512292834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac15be70 0x7f31ac0cc9a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31ac072210 tx=0x7f319c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3716ef65a923214b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.544+0000 7f31aaa00640 1 -- 172.21.15.146:0/1512292834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c031600 con 0x7f31ac15be70 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.544+0000 7f31aaa00640 1 -- 172.21.15.146:0/1512292834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319c0317a0 con 0x7f31ac15be70 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.544+0000 7f31aaa00640 1 -- 172.21.15.146:0/1512292834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c031b70 con 0x7f31ac15be70 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 -- 172.21.15.146:0/1512292834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac15be70 msgr2=0x7f31ac0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 --2- 172.21.15.146:0/1512292834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac15be70 0x7f31ac0cc9a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31ac072210 tx=0x7f319c02a5d0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 -- 172.21.15.146:0/1512292834 shutdown_connections 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 --2- 172.21.15.146:0/1512292834 >> v2:172.21.15.203:3300/0 conn(0x7f31ac0b3a30 0x7f31ac0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 --2- 172.21.15.146:0/1512292834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac15be70 0x7f31ac0cc9a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 -- 172.21.15.146:0/1512292834 >> 172.21.15.146:0/1512292834 conn(0x7f31ac0b2730 msgr2=0x7f31ac0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 -- 172.21.15.146:0/1512292834 shutdown_connections 2024-04-24T23:01:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.545+0000 7f31b3000640 1 -- 172.21.15.146:0/1512292834 wait complete. 2024-04-24T23:01:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.547+0000 7f31b3000640 1 Processor -- start 2024-04-24T23:01:09.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.547+0000 7f31b3000640 1 -- start start 2024-04-24T23:01:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31ac0729b0 0x7f31ac0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31ac15be70 0x7f31ac0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac06e050 con 0x7f31ac0b3a30 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac0cd0f0 con 0x7f31ac0729b0 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31b3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f31ac15c250 con 0x7f31ac15be70 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.548+0000 7f31ab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60770/0 (socket says 172.21.15.146:60770) 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 -- 172.21.15.146:0/283031457 learned_addr learned my addr 172.21.15.146:0/283031457 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 -- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31ac15be70 msgr2=0x7f31ac0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31b1000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31ac15be70 0x7f31ac0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31abe00640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31ac0729b0 0x7f31ac0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31ac15be70 0x7f31ac0c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 -- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31ac0729b0 msgr2=0x7f31ac0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31ac0729b0 0x7f31ac0c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 -- 172.21.15.146:0/283031457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac0cf8d0 con 0x7f31ac0b3a30 2024-04-24T23:01:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.549+0000 7f31ab400640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f319400c430 tx=0x7f319400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.550+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194017070 con 0x7f31ac0b3a30 2024-04-24T23:01:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.550+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194005ce0 con 0x7f31ac0b3a30 2024-04-24T23:01:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.550+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31940072f0 con 0x7f31ac0b3a30 2024-04-24T23:01:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.550+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac0cfbb0 con 0x7f31ac0b3a30 2024-04-24T23:01:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.550+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ac0d0170 con 0x7f31ac0b3a30 2024-04-24T23:01:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.551+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac0ad990 con 0x7f31ac0b3a30 2024-04-24T23:01:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.552+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f319401a070 con 0x7f31ac0b3a30 2024-04-24T23:01:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.553+0000 7f31a3e00640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.553+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f319408a620 con 0x7f31ac0b3a30 2024-04-24T23:01:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.554+0000 7f31abe00640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.555+0000 7f31abe00640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 0x7f318806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f319c034000 tx=0x7f319c033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.558+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f31ac0ad990 con 0x7f31ac0b3a30 2024-04-24T23:01:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.756+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f31ac04f570 con 0x7f31ac0b3a30 2024-04-24T23:01:09.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.757+0000 7f31a3e00640 1 -- 172.21.15.146:0/283031457 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f3194058bc0 con 0x7f31ac0b3a30 2024-04-24T23:01:09.758 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 msgr2=0x7f318806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 0x7f318806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f319c034000 tx=0x7f319c033040 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 msgr2=0x7f31ac0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f319400c430 tx=0x7f319400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 shutdown_connections 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31ac15be70 0x7f31ac0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ac0b3a30 0x7f31ac0c95a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 --2- 172.21.15.146:0/283031457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31ac0729b0 0x7f31ac0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 >> 172.21.15.146:0/283031457 conn(0x7f31ac0b2730 msgr2=0x7f31ac06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 shutdown_connections 2024-04-24T23:01:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.760+0000 7f31b3000640 1 -- 172.21.15.146:0/283031457 wait complete. 2024-04-24T23:01:09.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.977+0000 7f7972000640 1 Processor -- start 2024-04-24T23:01:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.977+0000 7f7972000640 1 -- start start 2024-04-24T23:01:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 0x7f796c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 0x7f796c070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f796c071370 0x7f796c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f796c0af0a0 con 0x7f796c071370 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f796c071800 con 0x7f796c0709d0 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.978+0000 7f7972000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f796c0b2860 con 0x7f796c15ae50 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f796c071370 0x7f796c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f796c071370 0x7f796c15e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60772/0 (socket says 172.21.15.146:60772) 2024-04-24T23:01:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 -- 172.21.15.146:0/852410759 learned_addr learned my addr 172.21.15.146:0/852410759 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f796be00640 1 --2- 172.21.15.146:0/852410759 >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 0x7f796c070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7970c00640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 0x7f796c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 -- 172.21.15.146:0/852410759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 msgr2=0x7f796c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 0x7f796c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 -- 172.21.15.146:0/852410759 >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 msgr2=0x7f796c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 --2- 172.21.15.146:0/852410759 >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 0x7f796c070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7971600640 1 -- 172.21.15.146:0/852410759 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c06cbe0 con 0x7f796c071370 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f796be00640 1 --2- 172.21.15.146:0/852410759 >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 0x7f796c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.979+0000 7f7970c00640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 0x7f796c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.980+0000 7f7971600640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c15e800 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f796c0d0910 tx=0x7f796402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9728ad6382bb783 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f796b400640 1 -- 172.21.15.146:0/852410759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964036070 con 0x7f796c071370 2024-04-24T23:01:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f796b400640 1 -- 172.21.15.146:0/852410759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964031600 con 0x7f796c071370 2024-04-24T23:01:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f796b400640 1 -- 172.21.15.146:0/852410759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640319d0 con 0x7f796c071370 2024-04-24T23:01:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 -- 172.21.15.146:0/852410759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 msgr2=0x7f796c15e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c15e800 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f796c0d0910 tx=0x7f796402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 -- 172.21.15.146:0/852410759 shutdown_connections 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c15e800 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 --2- 172.21.15.146:0/852410759 >> v2:172.21.15.203:3300/0 conn(0x7f796c0709d0 0x7f796c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 --2- 172.21.15.146:0/852410759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c15ae50 0x7f796c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 -- 172.21.15.146:0/852410759 >> 172.21.15.146:0/852410759 conn(0x7f796c0b1560 msgr2=0x7f796c0b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.981+0000 7f7972000640 1 -- 172.21.15.146:0/852410759 shutdown_connections 2024-04-24T23:01:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.982+0000 7f7972000640 1 -- 172.21.15.146:0/852410759 wait complete. 2024-04-24T23:01:09.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.983+0000 7f7972000640 1 Processor -- start 2024-04-24T23:01:09.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.983+0000 7f7972000640 1 -- start start 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c0709d0 0x7f796c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f796c15ae50 0x7f796c1f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f796c15eec0 con 0x7f796c071370 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f796c15ed40 con 0x7f796c15ae50 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.984+0000 7f7972000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f796c15f040 con 0x7f796c0709d0 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60782/0 (socket says 172.21.15.146:60782) 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 -- 172.21.15.146:0/1178977487 learned_addr learned my addr 172.21.15.146:0/1178977487 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f7970c00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c0709d0 0x7f796c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 -- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c0709d0 msgr2=0x7f796c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c0709d0 0x7f796c1562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 -- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f796c15ae50 msgr2=0x7f796c1f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f796c15ae50 0x7f796c1f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 -- 172.21.15.146:0/1178977487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c0c4e90 con 0x7f796c071370 2024-04-24T23:01:09.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.985+0000 7f796be00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f795800c7c0 tx=0x7f795800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.986+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958015070 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.986+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7958007a30 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.986+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958007e00 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.986+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c1f3bb0 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.986+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1f3e50 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.987+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c04f500 con 0x7f796c071370 2024-04-24T23:01:09.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.988+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7958018070 con 0x7f796c071370 2024-04-24T23:01:09.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.989+0000 7f7968c00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 0x7f794c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:09.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.989+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f795808af70 con 0x7f796c071370 2024-04-24T23:01:09.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.990+0000 7f7970c00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 0x7f794c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:09.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.991+0000 7f7970c00640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 0x7f794c06e340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ae500 tx=0x7f7960008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:09.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:09.994+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7958059720 con 0x7f796c071370 2024-04-24T23:01:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.206+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f796c0b2270 con 0x7f796c071370 2024-04-24T23:01:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.207+0000 7f7968c00640 1 -- 172.21.15.146:0/1178977487 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f7958059020 con 0x7f796c071370 2024-04-24T23:01:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.210+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 msgr2=0x7f794c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.210+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 0x7f794c06e340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ae500 tx=0x7f7960008040 comp rx=0 tx=0).stop 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.210+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 msgr2=0x7f796c0c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.210+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f795800c7c0 tx=0x7f795800cc80 comp rx=0 tx=0).stop 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 shutdown_connections 2024-04-24T23:01:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f796c15ae50 0x7f796c1f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f796c071370 0x7f796c0c47d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f794c06be80 0x7f794c06e340 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 --2- 172.21.15.146:0/1178977487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f796c0709d0 0x7f796c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 >> 172.21.15.146:0/1178977487 conn(0x7f796c0b1560 msgr2=0x7f796c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 shutdown_connections 2024-04-24T23:01:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.211+0000 7f7972000640 1 -- 172.21.15.146:0/1178977487 wait complete. 2024-04-24T23:01:10.232 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-24T23:01:10.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:10.232 DEBUG:teuthology.orchestra.run.smithi203:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-24T23:01:10.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:01:10.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:10.328 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-24T23:01:10.394 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:10.394 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:10.451 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:10.451 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:10.498 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:10.498 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:10.592 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:10.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.791+0000 7fc8f3200640 1 Processor -- start 2024-04-24T23:01:10.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.791+0000 7fc8f3200640 1 -- start start 2024-04-24T23:01:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.792+0000 7fc8f3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8f40d0240 0x7fc8f40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.792+0000 7fc8f3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.792+0000 7fc8f3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f4070f90 con 0x7fc8f41561c0 2024-04-24T23:01:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.792+0000 7fc8f3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f40b4310 con 0x7fc8f40d0240 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.792+0000 7fc8f3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f41565a0 con 0x7fc8f40709d0 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8f1e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc8f41561c0 0x7fc8f40cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34976/0 (socket says 172.21.15.146:34976) 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8f1e00640 1 -- 172.21.15.146:0/406617260 learned_addr learned my addr 172.21.15.146:0/406617260 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8e9400640 1 --2- 172.21.15.146:0/406617260 >> v2:172.21.15.146:3300/0 conn(0x7fc8f40d0240 0x7fc8f40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8f2800640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8f1400640 1 -- 172.21.15.146:0/406617260 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696312059 0 0) 0x7fc8f4070f90 con 0x7fc8f41561c0 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8f1400640 1 -- 172.21.15.146:0/406617260 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d8003520 con 0x7fc8f41561c0 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8e9400640 1 -- 172.21.15.146:0/406617260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 msgr2=0x7fc8f415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8e9400640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8e9400640 1 -- 172.21.15.146:0/406617260 >> v1:172.21.15.146:6789/0 conn(0x7fc8f41561c0 legacy=0x7fc8f40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.793+0000 7fc8e9400640 1 -- 172.21.15.146:0/406617260 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f4071270 con 0x7fc8f40d0240 2024-04-24T23:01:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.794+0000 7fc8e9400640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f40d0240 0x7fc8f40cdbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0097a0 tx=0x7fc8dc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5462058c8d6b274 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f1400640 1 -- 172.21.15.146:0/406617260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc037070 con 0x7fc8f40d0240 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f1400640 1 -- 172.21.15.146:0/406617260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8dc02adb0 con 0x7fc8f40d0240 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f1400640 1 -- 172.21.15.146:0/406617260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc032660 con 0x7fc8f40d0240 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 -- 172.21.15.146:0/406617260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f40d0240 msgr2=0x7fc8f40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f40d0240 0x7fc8f40cdbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0097a0 tx=0x7fc8dc02a060 comp rx=0 tx=0).stop 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 -- 172.21.15.146:0/406617260 shutdown_connections 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 --2- 172.21.15.146:0/406617260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f40d0240 0x7fc8f40cdbf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 -- 172.21.15.146:0/406617260 >> 172.21.15.146:0/406617260 conn(0x7fc8f406b320 msgr2=0x7fc8f406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 -- 172.21.15.146:0/406617260 shutdown_connections 2024-04-24T23:01:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.795+0000 7fc8f3200640 1 -- 172.21.15.146:0/406617260 wait complete. 2024-04-24T23:01:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.797+0000 7fc8f3200640 1 Processor -- start 2024-04-24T23:01:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.797+0000 7fc8f3200640 1 -- start start 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f4158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 0x7fc8f40adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f40b2c20 con 0x7fc8f41561c0 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4071830 con 0x7fc8f40d0240 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.798+0000 7fc8f3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40b2da0 con 0x7fc8f40709d0 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60810/0 (socket says 172.21.15.146:60810) 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 -- 172.21.15.146:0/946402613 learned_addr learned my addr 172.21.15.146:0/946402613 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f1e00640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f4158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8e9400640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 0x7fc8f40adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 -- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 msgr2=0x7fc8f4158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f4158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 -- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 msgr2=0x7fc8f40adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 0x7fc8f40adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 -- 172.21.15.146:0/946402613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f41479f0 con 0x7fc8f41561c0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8e9400640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 0x7fc8f40adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.799+0000 7fc8f2800640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007e40 tx=0x7fc8ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.800+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec014620 con 0x7fc8f41561c0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.800+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec019070 con 0x7fc8f41561c0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.800+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec014a20 con 0x7fc8f41561c0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.800+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4158450 con 0x7fc8f41561c0 2024-04-24T23:01:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.800+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f4158100 con 0x7fc8f41561c0 2024-04-24T23:01:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.801+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f404f500 con 0x7fc8f41561c0 2024-04-24T23:01:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.802+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8ec014bc0 con 0x7fc8f41561c0 2024-04-24T23:01:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.803+0000 7fc8eaa00640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 0x7fc8d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.803+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc8ec08baf0 con 0x7fc8f41561c0 2024-04-24T23:01:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.804+0000 7fc8f1e00640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 0x7fc8d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.805+0000 7fc8f1e00640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 0x7fc8d006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40011e0 tx=0x7fc8e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:10.808+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8ec05a120 con 0x7fc8f41561c0 2024-04-24T23:01:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.007+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f40af0c0 con 0x7fc8f41561c0 2024-04-24T23:01:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.010+0000 7fc8eaa00640 1 -- 172.21.15.146:0/946402613 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fc8ec059a20 con 0x7fc8f41561c0 2024-04-24T23:01:11.012 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:11.012 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 msgr2=0x7fc8d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 0x7fc8d006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40011e0 tx=0x7fc8e4009040 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 msgr2=0x7fc8f4144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007e40 tx=0x7fc8ec00e4b0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 shutdown_connections 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f41561c0 0x7fc8f4144b80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8f40d0240 0x7fc8f40adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc8d006be30 0x7fc8d006e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 --2- 172.21.15.146:0/946402613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8f40709d0 0x7fc8f4158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.013+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 >> 172.21.15.146:0/946402613 conn(0x7fc8f406b320 msgr2=0x7fc8f40af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.014+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 shutdown_connections 2024-04-24T23:01:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.014+0000 7fc8f3200640 1 -- 172.21.15.146:0/946402613 wait complete. 2024-04-24T23:01:11.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:11.035 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.242+0000 7f2a13e00640 1 Processor -- start 2024-04-24T23:01:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.242+0000 7f2a13e00640 1 -- start start 2024-04-24T23:01:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.243+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 0x7f2a0c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.243+0000 7f2a13e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2a0c06ea40 0x7f2a0c0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.243+0000 7f2a13e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c0b3250 con 0x7f2a0c0b2ab0 2024-04-24T23:01:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.243+0000 7f2a13e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c0b3530 con 0x7f2a0c06ea40 2024-04-24T23:01:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.243+0000 7f2a13e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c0b3810 con 0x7f2a0c155460 2024-04-24T23:01:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.244+0000 7f2a11400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 0x7f2a0c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.244+0000 7f2a11e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2a0c06ea40 0x7f2a0c0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.244+0000 7f2a11400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 0x7f2a0c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:44056/0 (socket says 172.21.15.146:44056) 2024-04-24T23:01:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.244+0000 7f2a11400640 1 -- 172.21.15.146:0/3946843034 learned_addr learned my addr 172.21.15.146:0/3946843034 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.245+0000 7f2a11e00640 1 -- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 msgr2=0x7f2a0c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.245+0000 7f2a11e00640 1 --2- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 0x7f2a0c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.245+0000 7f2a11e00640 1 -- 172.21.15.146:0/3946843034 >> v1:172.21.15.203:6789/0 conn(0x7f2a0c0b2ab0 legacy=0x7f2a0c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.245+0000 7f2a11e00640 1 -- 172.21.15.146:0/3946843034 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c070ec0 con 0x7f2a0c06ea40 2024-04-24T23:01:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.247+0000 7f2a11e00640 1 --2- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c06ea40 0x7f2a0c0713e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009d90 tx=0x7f2a0402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d285f216e59d2815 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.247+0000 7f2a0be00640 1 -- 172.21.15.146:0/3946843034 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04007740 con 0x7f2a0c06ea40 2024-04-24T23:01:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.247+0000 7f2a0be00640 1 -- 172.21.15.146:0/3946843034 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a040078e0 con 0x7f2a0c06ea40 2024-04-24T23:01:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.247+0000 7f2a0be00640 1 -- 172.21.15.146:0/3946843034 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04007cb0 con 0x7f2a0c06ea40 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 -- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c06ea40 msgr2=0x7f2a0c0713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 --2- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c06ea40 0x7f2a0c0713e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009d90 tx=0x7f2a0402a660 comp rx=0 tx=0).stop 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 -- 172.21.15.146:0/3946843034 shutdown_connections 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 --2- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c06ea40 0x7f2a0c0713e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 --2- 172.21.15.146:0/3946843034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c155460 0x7f2a0c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 -- 172.21.15.146:0/3946843034 >> 172.21.15.146:0/3946843034 conn(0x7f2a0c0b17b0 msgr2=0x7f2a0c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 -- 172.21.15.146:0/3946843034 shutdown_connections 2024-04-24T23:01:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.248+0000 7f2a13e00640 1 -- 172.21.15.146:0/3946843034 wait complete. 2024-04-24T23:01:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.249+0000 7f2a13e00640 1 Processor -- start 2024-04-24T23:01:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.250+0000 7f2a13e00640 1 -- start start 2024-04-24T23:01:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.250+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c06ea40 0x7f2a0c144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c0b2ab0 0x7f2a0c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a13e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c15c480 con 0x7f2a0c155460 2024-04-24T23:01:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a13e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0b3af0 con 0x7f2a0c0b2ab0 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a13e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c15c600 con 0x7f2a0c06ea40 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60826/0 (socket says 172.21.15.146:60826) 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 -- 172.21.15.146:0/2869835292 learned_addr learned my addr 172.21.15.146:0/2869835292 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11400640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c06ea40 0x7f2a0c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a10a00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c0b2ab0 0x7f2a0c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 -- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c06ea40 msgr2=0x7f2a0c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c06ea40 0x7f2a0c144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 -- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c0b2ab0 msgr2=0x7f2a0c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c0b2ab0 0x7f2a0c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.251+0000 7f2a11e00640 1 -- 172.21.15.146:0/2869835292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c156630 con 0x7f2a0c155460 2024-04-24T23:01:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a11e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009eb0 tx=0x7f2a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04040070 con 0x7f2a0c155460 2024-04-24T23:01:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04031bc0 con 0x7f2a0c155460 2024-04-24T23:01:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04009450 con 0x7f2a0c155460 2024-04-24T23:01:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c156910 con 0x7f2a0c155460 2024-04-24T23:01:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.252+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c157130 con 0x7f2a0c155460 2024-04-24T23:01:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.254+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c04f5a0 con 0x7f2a0c155460 2024-04-24T23:01:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.254+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a04039040 con 0x7f2a0c155460 2024-04-24T23:01:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.255+0000 7f2a09600640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 0x7f29ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.256+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2a040ac9f0 con 0x7f2a0c155460 2024-04-24T23:01:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.256+0000 7f2a11400640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 0x7f29ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.257+0000 7f2a11400640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 0x7f29ec06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009ac0 tx=0x7f2a00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.260+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a0407b0c0 con 0x7f2a0c155460 2024-04-24T23:01:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.460+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a0c06ce50 con 0x7f2a0c155460 2024-04-24T23:01:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.462+0000 7f2a09600640 1 -- 172.21.15.146:0/2869835292 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f2a0407a9c0 con 0x7f2a0c155460 2024-04-24T23:01:11.463 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.464+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 msgr2=0x7f29ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.464+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 0x7f29ec06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009ac0 tx=0x7f2a00008040 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.464+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 msgr2=0x7f2a0c15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.464+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009eb0 tx=0x7f2a04004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 shutdown_connections 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a0c155460 0x7f2a0c15a2d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a0c0b2ab0 0x7f2a0c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29ec06be30 0x7f29ec06e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 --2- 172.21.15.146:0/2869835292 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a0c06ea40 0x7f2a0c144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 >> 172.21.15.146:0/2869835292 conn(0x7f2a0c0b17b0 msgr2=0x7f2a0c14cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 shutdown_connections 2024-04-24T23:01:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.465+0000 7f2a13e00640 1 -- 172.21.15.146:0/2869835292 wait complete. 2024-04-24T23:01:11.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.685+0000 7f75ab200640 1 Processor -- start 2024-04-24T23:01:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.685+0000 7f75ab200640 1 -- start start 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75ab200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75ac0cfcc0 0x7f75ac0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75ab200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac15c1a0 0x7f75ac15c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75ab200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ac071ab0 con 0x7f75ac155120 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75ab200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f75ac0d0660 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75ab200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac155500 con 0x7f75ac15c1a0 2024-04-24T23:01:11.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.687+0000 7f75a9400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75ac0cfcc0 0x7f75ac0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75ac0cfcc0 0x7f75ac0d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:56390/0 (socket says 172.21.15.146:56390) 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 -- 172.21.15.146:0/3852821839 learned_addr learned my addr 172.21.15.146:0/3852821839 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75aa800640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac15c1a0 0x7f75ac15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 -- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac15c1a0 msgr2=0x7f75ac15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac15c1a0 0x7f75ac15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 -- 172.21.15.146:0/3852821839 >> v1:172.21.15.203:6789/0 conn(0x7f75ac155120 legacy=0x7f75ac0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.688+0000 7f75a9400640 1 -- 172.21.15.146:0/3852821839 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac071d90 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.690+0000 7f75a9400640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac0d0120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7598009870 tx=0x7f759802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21bb04337335f5a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.690+0000 7f75a8a00640 1 -- 172.21.15.146:0/3852821839 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598037070 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.690+0000 7f75a8a00640 1 -- 172.21.15.146:0/3852821839 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598032440 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.690+0000 7f75a8a00640 1 -- 172.21.15.146:0/3852821839 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598032810 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 -- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 msgr2=0x7f75ac0d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac0d0120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7598009870 tx=0x7f759802a270 comp rx=0 tx=0).stop 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 -- 172.21.15.146:0/3852821839 shutdown_connections 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac15c1a0 0x7f75ac15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 --2- 172.21.15.146:0/3852821839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac0d0120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 -- 172.21.15.146:0/3852821839 >> 172.21.15.146:0/3852821839 conn(0x7f75ac06b560 msgr2=0x7f75ac06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 -- 172.21.15.146:0/3852821839 shutdown_connections 2024-04-24T23:01:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.691+0000 7f75ab200640 1 -- 172.21.15.146:0/3852821839 wait complete. 2024-04-24T23:01:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.693+0000 7f75ab200640 1 Processor -- start 2024-04-24T23:01:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.693+0000 7f75ab200640 1 -- start start 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac155120 0x7f75ac0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac072630 con 0x7f75ac15c1a0 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac072350 con 0x7f75ac0cfcc0 2024-04-24T23:01:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75ab200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac072b50 con 0x7f75ac155120 2024-04-24T23:01:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.694+0000 7f75aa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60830/0 (socket says 172.21.15.146:60830) 2024-04-24T23:01:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 -- 172.21.15.146:0/3711749788 learned_addr learned my addr 172.21.15.146:0/3711749788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75a9400640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac155120 0x7f75ac0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75a9e00640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 -- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac155120 msgr2=0x7f75ac0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac155120 0x7f75ac0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 -- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 msgr2=0x7f75ac155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 -- 172.21.15.146:0/3711749788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac1573a0 con 0x7f75ac15c1a0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.695+0000 7f75aa800640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009d30 tx=0x7f75a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.696+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4018020 con 0x7f75ac15c1a0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.696+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a4014480 con 0x7f75ac15c1a0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.696+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4014870 con 0x7f75ac15c1a0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.696+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac155d60 con 0x7f75ac15c1a0 2024-04-24T23:01:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.696+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1f43f0 con 0x7f75ac15c1a0 2024-04-24T23:01:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.697+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac04f500 con 0x7f75ac15c1a0 2024-04-24T23:01:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.698+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75a4005d10 con 0x7f75ac15c1a0 2024-04-24T23:01:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.699+0000 7f75a2000640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.699+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f75a408bc30 con 0x7f75ac15c1a0 2024-04-24T23:01:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.700+0000 7f75a9e00640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.701+0000 7f75a9e00640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 0x7f758c06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f759c001640 tx=0x7f759c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:11.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.707+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f75a4022070 con 0x7f75ac15c1a0 2024-04-24T23:01:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.908+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f75ac0cc190 con 0x7f75ac15c1a0 2024-04-24T23:01:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.909+0000 7f75a2000640 1 -- 172.21.15.146:0/3711749788 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f75a4010040 con 0x7f75ac15c1a0 2024-04-24T23:01:11.910 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.911+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 msgr2=0x7f758c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.911+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 0x7f758c06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f759c001640 tx=0x7f759c009040 comp rx=0 tx=0).stop 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.911+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 msgr2=0x7f75ac14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.911+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009d30 tx=0x7f75a400c490 comp rx=0 tx=0).stop 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 shutdown_connections 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac15c1a0 0x7f75ac14bcf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f758c06be30 0x7f758c06e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75ac155120 0x7f75ac0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 --2- 172.21.15.146:0/3711749788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75ac0cfcc0 0x7f75ac155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 >> 172.21.15.146:0/3711749788 conn(0x7f75ac06b560 msgr2=0x7f75ac06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 shutdown_connections 2024-04-24T23:01:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:11.912+0000 7f75ab200640 1 -- 172.21.15.146:0/3711749788 wait complete. 2024-04-24T23:01:11.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.142+0000 7f6ba2e00640 1 Processor -- start 2024-04-24T23:01:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.142+0000 7f6ba2e00640 1 -- start start 2024-04-24T23:01:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.143+0000 7f6ba2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b9c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.143+0000 7f6ba2e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0d2ee0 con 0x7f6b9c161a00 2024-04-24T23:01:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.143+0000 7f6ba2e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0cfcc0 con 0x7f6b9c0d0bd0 2024-04-24T23:01:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.143+0000 7f6ba2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c0cfa70 con 0x7f6b9c161620 2024-04-24T23:01:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6ba1000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6b9c161a00 0x7f6b9c0d04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34992/0 (socket says 172.21.15.146:34992) 2024-04-24T23:01:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6ba1000640 1 -- 172.21.15.146:0/1564952920 learned_addr learned my addr 172.21.15.146:0/1564952920 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b9c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164930335 0 0) 0x7f6b9c0d2ee0 con 0x7f6b9c161a00 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b84003520 con 0x7f6b9c161a00 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2381712404 0 0) 0x7f6b84003520 con 0x7f6b9c161a00 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 msgr2=0x7f6b9c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b9c0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 >> v1:172.21.15.203:6789/0 conn(0x7f6b9c0d0bd0 legacy=0x7f6b9c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0b38e0 con 0x7f6b9c161a00 2024-04-24T23:01:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6b88001670 con 0x7f6b9c161a00 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.144+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 >> v1:172.21.15.146:6789/0 conn(0x7f6b9c161a00 legacy=0x7f6b9c0d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b840039e0 0x7f6b84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b84004d40 0x7f6b840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0cfa70 con 0x7f6b840039e0 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8400bb50 con 0x7f6b84004d40 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8400bd20 con 0x7f6b9c161620 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b840039e0 0x7f6b84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1000640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba2400640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b84004d40 0x7f6b840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 -- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 msgr2=0x7f6b84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 -- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b84004d40 msgr2=0x7f6b840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b84004d40 0x7f6b840051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1a00640 1 -- 172.21.15.146:0/1564952920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b84003520 con 0x7f6b840039e0 2024-04-24T23:01:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.145+0000 7f6ba1000640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b9c161620 0x7f6b84004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b840039e0 0x7f6b84003e20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ba60 tx=0x7f6b84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e90147e703a4eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90030070 con 0x7f6b840039e0 2024-04-24T23:01:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b9002ae00 con 0x7f6b840039e0 2024-04-24T23:01:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6b9be00640 1 -- 172.21.15.146:0/1564952920 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000b600 con 0x7f6b840039e0 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6ba2e00640 1 -- 172.21.15.146:0/1564952920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b840039e0 msgr2=0x7f6b84003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/1564952920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b840039e0 0x7f6b84003e20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ba60 tx=0x7f6b84005830 comp rx=0 tx=0).stop 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.147+0000 7f6ba2400640 1 -- 172.21.15.146:0/1564952920 reap_dead start 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.148+0000 7f6ba2e00640 1 -- 172.21.15.146:0/1564952920 shutdown_connections 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.148+0000 7f6ba2e00640 1 -- 172.21.15.146:0/1564952920 >> 172.21.15.146:0/1564952920 conn(0x7f6b9c0d3d90 msgr2=0x7f6b9c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.148+0000 7f6ba2e00640 1 -- 172.21.15.146:0/1564952920 shutdown_connections 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.148+0000 7f6ba2e00640 1 -- 172.21.15.146:0/1564952920 wait complete. 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.149+0000 7f6ba2e00640 1 Processor -- start 2024-04-24T23:01:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 -- start start 2024-04-24T23:01:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b840039e0 0x7f6b9c150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 0x7f6b9c0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b35d0 con 0x7f6b9c150b20 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b3ea0 con 0x7f6b9c150fa0 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.150+0000 7f6ba2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c0d48b0 con 0x7f6b840039e0 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60842/0 (socket says 172.21.15.146:60842) 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 -- 172.21.15.146:0/2201169705 learned_addr learned my addr 172.21.15.146:0/2201169705 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba2400640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 0x7f6b9c0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b840039e0 0x7f6b9c150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 -- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b840039e0 msgr2=0x7f6b9c150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b840039e0 0x7f6b9c150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 -- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 msgr2=0x7f6b9c0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 0x7f6b9c0b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 -- 172.21.15.146:0/2201169705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0cb070 con 0x7f6b9c150b20 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba2400640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 0x7f6b9c0b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.151+0000 7f6ba1000640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b880017e0 tx=0x7f6b8800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.152+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88019070 con 0x7f6b9c150b20 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.152+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b880074e0 con 0x7f6b9c150b20 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.152+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880049e0 con 0x7f6b9c150b20 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.152+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c0cb350 con 0x7f6b9c150b20 2024-04-24T23:01:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.152+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c15c8b0 con 0x7f6b9c150b20 2024-04-24T23:01:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.153+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c04f500 con 0x7f6b9c150b20 2024-04-24T23:01:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.154+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b88004b80 con 0x7f6b9c150b20 2024-04-24T23:01:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.155+0000 7f6b99600640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.155+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6b8808adb0 con 0x7f6b9c150b20 2024-04-24T23:01:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.156+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.157+0000 7f6ba1a00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ba30 tx=0x7f6b90030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.159+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6b8808f070 con 0x7f6b9c150b20 2024-04-24T23:01:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.357+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6b9c0a1a60 con 0x7f6b9c150b20 2024-04-24T23:01:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.358+0000 7f6b99600640 1 -- 172.21.15.146:0/2201169705 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f6b880592c0 con 0x7f6b9c150b20 2024-04-24T23:01:12.359 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:12.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 msgr2=0x7f6b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ba30 tx=0x7f6b90030000 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 msgr2=0x7f6b9c0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b880017e0 tx=0x7f6b8800dd40 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 shutdown_connections 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b9c150fa0 0x7f6b9c0b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b9c150b20 0x7f6b9c0b73c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6b7c06be30 0x7f6b7c06e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 --2- 172.21.15.146:0/2201169705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b840039e0 0x7f6b9c150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.360+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 >> 172.21.15.146:0/2201169705 conn(0x7f6b9c0d3d90 msgr2=0x7f6b9c0b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:12.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.361+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 shutdown_connections 2024-04-24T23:01:12.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.361+0000 7f6ba2e00640 1 -- 172.21.15.146:0/2201169705 wait complete. 2024-04-24T23:01:12.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:12.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.590+0000 7f1b84000640 1 Processor -- start 2024-04-24T23:01:12.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.590+0000 7f1b84000640 1 -- start start 2024-04-24T23:01:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b84000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c13ef30 0x7f1b7c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b84000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1b7c141ab0 0x7f1b7c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b84000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c0ced40 con 0x7f1b7c0ce5a0 2024-04-24T23:01:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b84000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c1423d0 con 0x7f1b7c141ab0 2024-04-24T23:01:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b84000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c070f80 con 0x7f1b7c13ef30 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b80c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1b7c141ab0 0x7f1b7c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b81600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c13ef30 0x7f1b7c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b80c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1b7c141ab0 0x7f1b7c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:56434/0 (socket says 172.21.15.146:56434) 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.592+0000 7f1b80c00640 1 -- 172.21.15.146:0/2734218668 learned_addr learned my addr 172.21.15.146:0/2734218668 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.593+0000 7f1b80c00640 1 -- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c13ef30 msgr2=0x7f1b7c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.593+0000 7f1b80c00640 1 --2- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c13ef30 0x7f1b7c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.593+0000 7f1b80c00640 1 -- 172.21.15.146:0/2734218668 >> v1:172.21.15.203:6789/0 conn(0x7f1b7c0ce5a0 legacy=0x7f1b7c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.593+0000 7f1b80c00640 1 -- 172.21.15.146:0/2734218668 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c0cf020 con 0x7f1b7c141ab0 2024-04-24T23:01:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.594+0000 7f1b80c00640 1 --2- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c141ab0 0x7f1b7c0ce060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590736bced19eb8d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.595+0000 7f1b7be00640 1 -- 172.21.15.146:0/2734218668 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68037070 con 0x7f1b7c141ab0 2024-04-24T23:01:12.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.595+0000 7f1b7be00640 1 -- 172.21.15.146:0/2734218668 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b68032440 con 0x7f1b7c141ab0 2024-04-24T23:01:12.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.595+0000 7f1b7be00640 1 -- 172.21.15.146:0/2734218668 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68032810 con 0x7f1b7c141ab0 2024-04-24T23:01:12.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 -- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c141ab0 msgr2=0x7f1b7c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 --2- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c141ab0 0x7f1b7c0ce060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6802a270 comp rx=0 tx=0).stop 2024-04-24T23:01:12.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 -- 172.21.15.146:0/2734218668 shutdown_connections 2024-04-24T23:01:12.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 --2- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c141ab0 0x7f1b7c0ce060 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 --2- 172.21.15.146:0/2734218668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c13ef30 0x7f1b7c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 -- 172.21.15.146:0/2734218668 >> 172.21.15.146:0/2734218668 conn(0x7f1b7c0b17b0 msgr2=0x7f1b7c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 -- 172.21.15.146:0/2734218668 shutdown_connections 2024-04-24T23:01:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.596+0000 7f1b84000640 1 -- 172.21.15.146:0/2734218668 wait complete. 2024-04-24T23:01:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.598+0000 7f1b84000640 1 Processor -- start 2024-04-24T23:01:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.598+0000 7f1b84000640 1 -- start start 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 0x7f1b7c1f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c141ab0 0x7f1b7c06e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0cea30 con 0x7f1b7c13ef30 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c070c10 con 0x7f1b7c0ce5a0 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b84000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c072420 con 0x7f1b7c141ab0 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b80c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b80c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60848/0 (socket says 172.21.15.146:60848) 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.599+0000 7f1b80c00640 1 -- 172.21.15.146:0/1113579194 learned_addr learned my addr 172.21.15.146:0/1113579194 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b81600640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 0x7f1b7c1f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b82000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c141ab0 0x7f1b7c06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 -- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c141ab0 msgr2=0x7f1b7c06e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c141ab0 0x7f1b7c06e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 -- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 msgr2=0x7f1b7c1f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 0x7f1b7c1f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 -- 172.21.15.146:0/1113579194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c1f3e60 con 0x7f1b7c13ef30 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b81600640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 0x7f1b7c1f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b80c00640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1b6802a2b0 tx=0x7f1b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68037040 con 0x7f1b7c13ef30 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b68042070 con 0x7f1b7c13ef30 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68030880 con 0x7f1b7c13ef30 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.600+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c1f4140 con 0x7f1b7c13ef30 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.601+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c1f4700 con 0x7f1b7c13ef30 2024-04-24T23:01:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.602+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c04f5a0 con 0x7f1b7c13ef30 2024-04-24T23:01:12.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.603+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b68030a20 con 0x7f1b7c13ef30 2024-04-24T23:01:12.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.604+0000 7f1b79600640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 0x7f1b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:12.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.604+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1b680ab9a0 con 0x7f1b7c13ef30 2024-04-24T23:01:12.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.604+0000 7f1b81600640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 0x7f1b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.605+0000 7f1b81600640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 0x7f1b5c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009ac0 tx=0x7f1b70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:12.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.608+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b6807a070 con 0x7f1b7c13ef30 2024-04-24T23:01:12.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.807+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1b7c072d30 con 0x7f1b7c13ef30 2024-04-24T23:01:12.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.808+0000 7f1b79600640 1 -- 172.21.15.146:0/1113579194 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f1b68079970 con 0x7f1b7c13ef30 2024-04-24T23:01:12.809 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 msgr2=0x7f1b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 0x7f1b5c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009ac0 tx=0x7f1b70008040 comp rx=0 tx=0).stop 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 msgr2=0x7f1b7c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1b6802a2b0 tx=0x7f1b680046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 shutdown_connections 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5c06be30 0x7f1b5c06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7c141ab0 0x7f1b7c06e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7c13ef30 0x7f1b7c06db40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 --2- 172.21.15.146:0/1113579194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7c0ce5a0 0x7f1b7c1f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 >> 172.21.15.146:0/1113579194 conn(0x7f1b7c0b17b0 msgr2=0x7f1b7c13f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 shutdown_connections 2024-04-24T23:01:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:12.811+0000 7f1b84000640 1 -- 172.21.15.146:0/1113579194 wait complete. 2024-04-24T23:01:12.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.029+0000 7f644b000640 1 Processor -- start 2024-04-24T23:01:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.029+0000 7f644b000640 1 -- start start 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f644b000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f644406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f644b000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f644415e8b0 0x7f644415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f644b000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6444071960 con 0x7f644415f1f0 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f644b000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6444071c40 con 0x7f644415e8b0 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f644b000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6444071f20 con 0x7f644415abb0 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f6449000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f644415f1f0 0x7f644415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35004/0 (socket says 172.21.15.146:35004) 2024-04-24T23:01:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.031+0000 7f6449000640 1 -- 172.21.15.146:0/3600161804 learned_addr learned my addr 172.21.15.146:0/3600161804 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443e00640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f644406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903712817 0 0) 0x7f6444071960 con 0x7f644415f1f0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f643b400640 1 --2- 172.21.15.146:0/3600161804 >> v2:172.21.15.203:3300/0 conn(0x7f644415e8b0 0x7f644415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6428003520 con 0x7f644415f1f0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66745571 0 0) 0x7f6428003520 con 0x7f644415f1f0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 msgr2=0x7f644406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f644406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 >> v2:172.21.15.203:3300/0 conn(0x7f644415e8b0 msgr2=0x7f644415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 --2- 172.21.15.146:0/3600161804 >> v2:172.21.15.203:3300/0 conn(0x7f644415e8b0 0x7f644415ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6444072200 con 0x7f644415f1f0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f643c0019f0 con 0x7f644415f1f0 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 >> v1:172.21.15.146:6789/0 conn(0x7f644415f1f0 legacy=0x7f644415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64280039b0 0x7f6428003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f6428004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6428004d40 0x7f64280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6444071c40 con 0x7f6428004d40 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6444071f20 con 0x7f64280039b0 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.032+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f642800b9c0 con 0x7f644415abb0 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f643b400640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f6428004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6428004d40 0x7f64280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6443e00640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64280039b0 0x7f6428003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 -- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 msgr2=0x7f6428004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f644415abb0 0x7f6428004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 -- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64280039b0 msgr2=0x7f6428003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64280039b0 0x7f6428003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.033+0000 7f6449000640 1 -- 172.21.15.146:0/3600161804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6428003520 con 0x7f6428004d40 2024-04-24T23:01:13.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.034+0000 7f6449000640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6428004d40 0x7f64280051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f643c00a920 tx=0x7f6428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3d48d025fc39fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c00a4c0 con 0x7f6428004d40 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c02f070 con 0x7f6428004d40 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f6443400640 1 -- 172.21.15.146:0/3600161804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c02bd00 con 0x7f6428004d40 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f644b000640 1 -- 172.21.15.146:0/3600161804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6428004d40 msgr2=0x7f64280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f644b000640 1 --2- 172.21.15.146:0/3600161804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6428004d40 0x7f64280051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f643c00a920 tx=0x7f6428005830 comp rx=0 tx=0).stop 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f6449000640 1 -- 172.21.15.146:0/3600161804 reap_dead start 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f644b000640 1 -- 172.21.15.146:0/3600161804 shutdown_connections 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.035+0000 7f644b000640 1 -- 172.21.15.146:0/3600161804 >> 172.21.15.146:0/3600161804 conn(0x7f644406b140 msgr2=0x7f644406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.036+0000 7f644b000640 1 -- 172.21.15.146:0/3600161804 shutdown_connections 2024-04-24T23:01:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.036+0000 7f644b000640 1 -- 172.21.15.146:0/3600161804 wait complete. 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.037+0000 7f644b000640 1 Processor -- start 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.037+0000 7f644b000640 1 -- start start 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6428004d40 0x7f644414a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f644415b4d0 0x7f6444157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f644415d7c0 con 0x7f64441f7d30 2024-04-24T23:01:13.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f644415f660 con 0x7f644415b4d0 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.038+0000 7f644b000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f644415d940 con 0x7f6428004d40 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60872/0 (socket says 172.21.15.146:60872) 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 -- 172.21.15.146:0/3813902849 learned_addr learned my addr 172.21.15.146:0/3813902849 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f6443e00640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6428004d40 0x7f644414a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 -- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6428004d40 msgr2=0x7f644414a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f6449000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f644415b4d0 0x7f6444157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6428004d40 0x7f644414a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 -- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f644415b4d0 msgr2=0x7f6444157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f644415b4d0 0x7f6444157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 -- 172.21.15.146:0/3813902849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6444156690 con 0x7f64441f7d30 2024-04-24T23:01:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.039+0000 7f643b400640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f642c011aa0 tx=0x7f642c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.040+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c00fb80 con 0x7f64441f7d30 2024-04-24T23:01:13.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.040+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c00fd20 con 0x7f64441f7d30 2024-04-24T23:01:13.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.040+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c014660 con 0x7f64441f7d30 2024-04-24T23:01:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.040+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6444156970 con 0x7f64441f7d30 2024-04-24T23:01:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.040+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6444153580 con 0x7f64441f7d30 2024-04-24T23:01:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.041+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644404f5a0 con 0x7f64441f7d30 2024-04-24T23:01:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.042+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f642c012040 con 0x7f64441f7d30 2024-04-24T23:01:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.043+0000 7f6440c00640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 0x7f642006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.043+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f642c08b900 con 0x7f64441f7d30 2024-04-24T23:01:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.044+0000 7f6443e00640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 0x7f642006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.045+0000 7f6443e00640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 0x7f642006e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6444156430 tx=0x7f6434008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.047+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f642c019030 con 0x7f64441f7d30 2024-04-24T23:01:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.255+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f644415b8b0 con 0x7f64441f7d30 2024-04-24T23:01:13.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.256+0000 7f6440c00640 1 -- 172.21.15.146:0/3813902849 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f642c059f30 con 0x7f64441f7d30 2024-04-24T23:01:13.257 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:01:13.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 msgr2=0x7f642006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 0x7f642006e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6444156430 tx=0x7f6434008040 comp rx=0 tx=0).stop 2024-04-24T23:01:13.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 msgr2=0x7f644415af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f642c011aa0 tx=0x7f642c011f60 comp rx=0 tx=0).stop 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 shutdown_connections 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f644415b4d0 0x7f6444157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64441f7d30 0x7f644415af90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f642006be60 0x7f642006e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 --2- 172.21.15.146:0/3813902849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6428004d40 0x7f644414a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 >> 172.21.15.146:0/3813902849 conn(0x7f644406b140 msgr2=0x7f64440cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 shutdown_connections 2024-04-24T23:01:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.259+0000 7f644b000640 1 -- 172.21.15.146:0/3813902849 wait complete. 2024-04-24T23:01:13.279 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-24T23:01:13.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:13.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-24T23:01:13.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:01:13.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:13.366 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-24T23:01:13.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:13.413 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:13.413 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:13.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:13.466 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:13.466 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:13.560 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:01:13.560 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:13.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:13.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.870+0000 7fa517c00640 1 Processor -- start 2024-04-24T23:01:13.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.870+0000 7fa517c00640 1 -- start start 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa517c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa510145640 0x7fa51015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa517c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5100d03a0 0x7fa5100ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa517c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5100cdf70 con 0x7fa5100b2a20 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa517c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa51015d360 con 0x7fa5100d03a0 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa517c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa510145a20 con 0x7fa510145640 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa515c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5100d03a0 0x7fa5100ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa515c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5100d03a0 0x7fa5100ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60882/0 (socket says 172.21.15.146:60882) 2024-04-24T23:01:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa515c00640 1 -- 172.21.15.146:0/1158695437 learned_addr learned my addr 172.21.15.146:0/1158695437 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.872+0000 7fa515200640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa510145640 0x7fa51015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.873+0000 7fa515c00640 1 -- 172.21.15.146:0/1158695437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa510145640 msgr2=0x7fa51015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.873+0000 7fa515c00640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa510145640 0x7fa51015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.873+0000 7fa515c00640 1 -- 172.21.15.146:0/1158695437 >> v1:172.21.15.203:6789/0 conn(0x7fa5100b2a20 legacy=0x7fa5100cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.873+0000 7fa515c00640 1 -- 172.21.15.146:0/1158695437 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51006d140 con 0x7fa5100d03a0 2024-04-24T23:01:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.874+0000 7fa515c00640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5100d03a0 0x7fa5100ce450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa51015d540 tx=0x7fa50802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bff4aaabb19d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.874+0000 7fa50f400640 1 -- 172.21.15.146:0/1158695437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508036070 con 0x7fa5100d03a0 2024-04-24T23:01:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.874+0000 7fa50f400640 1 -- 172.21.15.146:0/1158695437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508031600 con 0x7fa5100d03a0 2024-04-24T23:01:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.874+0000 7fa50f400640 1 -- 172.21.15.146:0/1158695437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080319d0 con 0x7fa5100d03a0 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.874+0000 7fa517c00640 1 -- 172.21.15.146:0/1158695437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5100d03a0 msgr2=0x7fa5100ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5100d03a0 0x7fa5100ce450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa51015d540 tx=0x7fa50802a6c0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 -- 172.21.15.146:0/1158695437 shutdown_connections 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5100d03a0 0x7fa5100ce450 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 --2- 172.21.15.146:0/1158695437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa510145640 0x7fa51015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 -- 172.21.15.146:0/1158695437 >> 172.21.15.146:0/1158695437 conn(0x7fa51006b320 msgr2=0x7fa51006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 -- 172.21.15.146:0/1158695437 shutdown_connections 2024-04-24T23:01:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.875+0000 7fa517c00640 1 -- 172.21.15.146:0/1158695437 wait complete. 2024-04-24T23:01:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.876+0000 7fa517c00640 1 Processor -- start 2024-04-24T23:01:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.877+0000 7fa517c00640 1 -- start start 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5100b2a20 0x7fa51015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa5100d03a0 0x7fa5101f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa51006d9e0 con 0x7fa510145640 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa51006d700 con 0x7fa5100b2a20 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa517c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa51006cbc0 con 0x7fa5100d03a0 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60892/0 (socket says 172.21.15.146:60892) 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 -- 172.21.15.146:0/3674478901 learned_addr learned my addr 172.21.15.146:0/3674478901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515200640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5100b2a20 0x7fa51015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa50fe00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa5100d03a0 0x7fa5101f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 -- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa5100d03a0 msgr2=0x7fa5101f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa5100d03a0 0x7fa5101f6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 -- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5100b2a20 msgr2=0x7fa51015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5100b2a20 0x7fa51015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.878+0000 7fa515c00640 1 -- 172.21.15.146:0/3674478901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5101f2730 con 0x7fa510145640 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa515c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa508009f40 tx=0x7fa508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508036050 con 0x7fa510145640 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508042070 con 0x7fa510145640 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5101f2a10 con 0x7fa510145640 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508009510 con 0x7fa510145640 2024-04-24T23:01:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.879+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101f2fd0 con 0x7fa510145640 2024-04-24T23:01:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.880+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5100b4eb0 con 0x7fa510145640 2024-04-24T23:01:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.881+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa508007bd0 con 0x7fa510145640 2024-04-24T23:01:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.883+0000 7fa50cc00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 0x7fa4f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.883+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa5080ac0c0 con 0x7fa510145640 2024-04-24T23:01:13.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.883+0000 7fa515200640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 0x7fa4f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:13.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.884+0000 7fa515200640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 0x7fa4f006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa504006fd0 tx=0x7fa504008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:13.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:13.887+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa5100b4eb0 con 0x7fa510145640 2024-04-24T23:01:14.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.088+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa510068190 con 0x7fa510145640 2024-04-24T23:01:14.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.090+0000 7fa50cc00640 1 -- 172.21.15.146:0/3674478901 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fa508045360 con 0x7fa510145640 2024-04-24T23:01:14.092 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:14.092 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 msgr2=0x7fa4f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 0x7fa4f006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa504006fd0 tx=0x7fa504008040 comp rx=0 tx=0).stop 2024-04-24T23:01:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 msgr2=0x7fa5100ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa508009f40 tx=0x7fa508004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 shutdown_connections 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510145640 0x7fa5100ce5c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa4f006be30 0x7fa4f006e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa5100d03a0 0x7fa5101f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 --2- 172.21.15.146:0/3674478901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5100b2a20 0x7fa51015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 >> 172.21.15.146:0/3674478901 conn(0x7fa51006b320 msgr2=0x7fa5101583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.093+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 shutdown_connections 2024-04-24T23:01:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.094+0000 7fa517c00640 1 -- 172.21.15.146:0/3674478901 wait complete. 2024-04-24T23:01:14.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:14.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.325+0000 7f63ed200640 1 Processor -- start 2024-04-24T23:01:14.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.325+0000 7f63ed200640 1 -- start start 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63ed200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f63e815e120 0x7f63e8161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63ed200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e806b140 0x7f63e806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63ed200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e80cf030 con 0x7f63e80afc90 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63ed200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f63e806baf0 con 0x7f63e806b140 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63ed200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f63e8162140 con 0x7f63e815e120 2024-04-24T23:01:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63e6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e806b140 0x7f63e806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63e6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e806b140 0x7f63e806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60898/0 (socket says 172.21.15.146:60898) 2024-04-24T23:01:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.327+0000 7f63e6800640 1 -- 172.21.15.146:0/1621514921 learned_addr learned my addr 172.21.15.146:0/1621514921 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.328+0000 7f63e5e00640 1 --2- 172.21.15.146:0/1621514921 >> v2:172.21.15.203:3300/0 conn(0x7f63e815e120 0x7f63e8161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.328+0000 7f63e6800640 1 -- 172.21.15.146:0/1621514921 >> v2:172.21.15.203:3300/0 conn(0x7f63e815e120 msgr2=0x7f63e8161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.328+0000 7f63e6800640 1 --2- 172.21.15.146:0/1621514921 >> v2:172.21.15.203:3300/0 conn(0x7f63e815e120 0x7f63e8161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.328+0000 7f63e6800640 1 -- 172.21.15.146:0/1621514921 >> v1:172.21.15.203:6789/0 conn(0x7f63e80afc90 legacy=0x7f63e80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.328+0000 7f63e6800640 1 -- 172.21.15.146:0/1621514921 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e8162420 con 0x7f63e806b140 2024-04-24T23:01:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.329+0000 7f63e6800640 1 --2- 172.21.15.146:0/1621514921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e806b140 0x7f63e806b5b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63e8071880 tx=0x7f63e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943b59d138208ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.329+0000 7f63e5400640 1 -- 172.21.15.146:0/1621514921 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0036070 con 0x7f63e806b140 2024-04-24T23:01:14.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.329+0000 7f63e5400640 1 -- 172.21.15.146:0/1621514921 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e0031600 con 0x7f63e806b140 2024-04-24T23:01:14.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.329+0000 7f63e5400640 1 -- 172.21.15.146:0/1621514921 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e00319d0 con 0x7f63e806b140 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 -- 172.21.15.146:0/1621514921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e806b140 msgr2=0x7f63e806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 --2- 172.21.15.146:0/1621514921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e806b140 0x7f63e806b5b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63e8071880 tx=0x7f63e002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 -- 172.21.15.146:0/1621514921 shutdown_connections 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 --2- 172.21.15.146:0/1621514921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e806b140 0x7f63e806b5b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 --2- 172.21.15.146:0/1621514921 >> v2:172.21.15.203:3300/0 conn(0x7f63e815e120 0x7f63e8161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 -- 172.21.15.146:0/1621514921 >> 172.21.15.146:0/1621514921 conn(0x7f63e80d0b40 msgr2=0x7f63e80d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:14.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 -- 172.21.15.146:0/1621514921 shutdown_connections 2024-04-24T23:01:14.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.330+0000 7f63ed200640 1 -- 172.21.15.146:0/1621514921 wait complete. 2024-04-24T23:01:14.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.332+0000 7f63ed200640 1 Processor -- start 2024-04-24T23:01:14.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.332+0000 7f63ed200640 1 -- start start 2024-04-24T23:01:14.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63e806b140 0x7f63e815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f63e80afc90 0x7f63e80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f63e80d0840 con 0x7f63e815e120 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f63e815e680 con 0x7f63e806b140 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63ed200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f63e81629e0 con 0x7f63e80afc90 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63e6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63e6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60910/0 (socket says 172.21.15.146:60910) 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.333+0000 7f63e6800640 1 -- 172.21.15.146:0/4278171869 learned_addr learned my addr 172.21.15.146:0/4278171869 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e5e00640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63e806b140 0x7f63e815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63dd400640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f63e80afc90 0x7f63e80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 -- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f63e80afc90 msgr2=0x7f63e80b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f63e80afc90 0x7f63e80b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 -- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63e806b140 msgr2=0x7f63e815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63e806b140 0x7f63e815f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 -- 172.21.15.146:0/4278171869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e815fc40 con 0x7f63e815e120 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.334+0000 7f63e6800640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63e0034040 tx=0x7f63e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.335+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0036050 con 0x7f63e815e120 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.335+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e0042070 con 0x7f63e815e120 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.335+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0009510 con 0x7f63e815e120 2024-04-24T23:01:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.335+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e815ff20 con 0x7f63e815e120 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.335+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e81604e0 con 0x7f63e815e120 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.336+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e804f5a0 con 0x7f63e815e120 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.337+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63e0007bf0 con 0x7f63e815e120 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.338+0000 7f63dea00640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 0x7f63c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.338+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f63e00ac130 con 0x7f63e815e120 2024-04-24T23:01:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.339+0000 7f63e5e00640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 0x7f63c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.340+0000 7f63e5e00640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 0x7f63c406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63d8006fd0 tx=0x7f63d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.342+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f63e007a880 con 0x7f63e815e120 2024-04-24T23:01:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.542+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63e8161e00 con 0x7f63e815e120 2024-04-24T23:01:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.543+0000 7f63dea00640 1 -- 172.21.15.146:0/4278171869 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f63e007a180 con 0x7f63e815e120 2024-04-24T23:01:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.545+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 msgr2=0x7f63c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.545+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 0x7f63c406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63d8006fd0 tx=0x7f63d8008040 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 msgr2=0x7f63e8160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63e0034040 tx=0x7f63e0004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 shutdown_connections 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e815e120 0x7f63e8160ce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f63c406be30 0x7f63c406e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f63e80afc90 0x7f63e80b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 --2- 172.21.15.146:0/4278171869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63e806b140 0x7f63e815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 >> 172.21.15.146:0/4278171869 conn(0x7f63e80d0b40 msgr2=0x7f63e80cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 shutdown_connections 2024-04-24T23:01:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.546+0000 7f63ed200640 1 -- 172.21.15.146:0/4278171869 wait complete. 2024-04-24T23:01:14.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.771+0000 7ff1ca800640 1 Processor -- start 2024-04-24T23:01:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.772+0000 7ff1ca800640 1 -- start start 2024-04-24T23:01:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.773+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1ca800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff1c40d0200 0x7ff1c415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1ca800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c40b4df0 con 0x7ff1c415bcd0 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1ca800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c415c8d0 con 0x7ff1c40d0200 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1ca800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40b4b10 con 0x7ff1c415cd60 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1c8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1c9e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff1c40d0200 0x7ff1c415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1c8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:44160/0 (socket says 172.21.15.146:44160) 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.774+0000 7ff1c8a00640 1 -- 172.21.15.146:0/890973865 learned_addr learned my addr 172.21.15.146:0/890973865 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.775+0000 7ff1c8a00640 1 -- 172.21.15.146:0/890973865 >> v2:172.21.15.203:3300/0 conn(0x7ff1c40d0200 msgr2=0x7ff1c415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.775+0000 7ff1c8a00640 1 --2- 172.21.15.146:0/890973865 >> v2:172.21.15.203:3300/0 conn(0x7ff1c40d0200 0x7ff1c415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.775+0000 7ff1c8a00640 1 -- 172.21.15.146:0/890973865 >> v1:172.21.15.203:6789/0 conn(0x7ff1c415bcd0 legacy=0x7ff1c40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.775+0000 7ff1c8a00640 1 -- 172.21.15.146:0/890973865 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c415c280 con 0x7ff1c415cd60 2024-04-24T23:01:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.776+0000 7ff1c8a00640 1 --2- 172.21.15.146:0/890973865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009870 tx=0x7ff1b002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b733d2ec79ecc6f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1c3e00640 1 -- 172.21.15.146:0/890973865 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0037070 con 0x7ff1c415cd60 2024-04-24T23:01:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1c3e00640 1 -- 172.21.15.146:0/890973865 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b0032440 con 0x7ff1c415cd60 2024-04-24T23:01:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1c3e00640 1 -- 172.21.15.146:0/890973865 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0032810 con 0x7ff1c415cd60 2024-04-24T23:01:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1ca800640 1 -- 172.21.15.146:0/890973865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 msgr2=0x7ff1c40cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1ca800640 1 --2- 172.21.15.146:0/890973865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009870 tx=0x7ff1b002a270 comp rx=0 tx=0).stop 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.777+0000 7ff1ca800640 1 -- 172.21.15.146:0/890973865 shutdown_connections 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.778+0000 7ff1ca800640 1 --2- 172.21.15.146:0/890973865 >> v2:172.21.15.203:3300/0 conn(0x7ff1c40d0200 0x7ff1c415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.778+0000 7ff1ca800640 1 --2- 172.21.15.146:0/890973865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c415cd60 0x7ff1c40cfcc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.778+0000 7ff1ca800640 1 -- 172.21.15.146:0/890973865 >> 172.21.15.146:0/890973865 conn(0x7ff1c406b560 msgr2=0x7ff1c406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.778+0000 7ff1ca800640 1 -- 172.21.15.146:0/890973865 shutdown_connections 2024-04-24T23:01:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.778+0000 7ff1ca800640 1 -- 172.21.15.146:0/890973865 wait complete. 2024-04-24T23:01:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.779+0000 7ff1ca800640 1 Processor -- start 2024-04-24T23:01:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.779+0000 7ff1ca800640 1 -- start start 2024-04-24T23:01:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c40d0200 0x7ff1c41462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1c415bcd0 0x7ff1c4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b4790 con 0x7ff1c415cd60 2024-04-24T23:01:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c406e590 con 0x7ff1c415bcd0 2024-04-24T23:01:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.780+0000 7ff1ca800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c415fc30 con 0x7ff1c40d0200 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60926/0 (socket says 172.21.15.146:60926) 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 -- 172.21.15.146:0/3810979923 learned_addr learned my addr 172.21.15.146:0/3810979923 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9400640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c40d0200 0x7ff1c41462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c8a00640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1c415bcd0 0x7ff1c4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 -- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c40d0200 msgr2=0x7ff1c41462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c40d0200 0x7ff1c41462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 -- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1c415bcd0 msgr2=0x7ff1c4153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1c415bcd0 0x7ff1c4153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.781+0000 7ff1c9e00640 1 -- 172.21.15.146:0/3810979923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c4146830 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1c9e00640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00efc0 tx=0x7ff1bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc018020 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc014480 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc014870 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c4153b60 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.782+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c40afa70 con 0x7ff1c415cd60 2024-04-24T23:01:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.784+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c404f500 con 0x7ff1c415cd60 2024-04-24T23:01:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.785+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1bc005d10 con 0x7ff1c415cd60 2024-04-24T23:01:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.786+0000 7ff1c1600640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.786+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff1bc08bbc0 con 0x7ff1c415cd60 2024-04-24T23:01:14.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.786+0000 7ff1c9400640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.787+0000 7ff1c9400640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 0x7ff1a406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8001780 tx=0x7ff1b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.790+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1bc022070 con 0x7ff1c415cd60 2024-04-24T23:01:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:14.999+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1c40cf030 con 0x7ff1c415cd60 2024-04-24T23:01:15.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.000+0000 7ff1c1600640 1 -- 172.21.15.146:0/3810979923 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ff1bc010040 con 0x7ff1c415cd60 2024-04-24T23:01:15.001 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 msgr2=0x7ff1a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 0x7ff1a406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8001780 tx=0x7ff1b8009040 comp rx=0 tx=0).stop 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 msgr2=0x7ff1c40b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00efc0 tx=0x7ff1bc00c490 comp rx=0 tx=0).stop 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 shutdown_connections 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c415cd60 0x7ff1c40b0830 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1c415bcd0 0x7ff1c4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 --2- 172.21.15.146:0/3810979923 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1c40d0200 0x7ff1c41462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 >> 172.21.15.146:0/3810979923 conn(0x7ff1c406b560 msgr2=0x7ff1c4159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 shutdown_connections 2024-04-24T23:01:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.003+0000 7ff1ca800640 1 -- 172.21.15.146:0/3810979923 wait complete. 2024-04-24T23:01:15.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:15.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.218+0000 7f4be9400640 1 Processor -- start 2024-04-24T23:01:15.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.219+0000 7f4be9400640 1 -- start start 2024-04-24T23:01:15.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be9400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4be415e0f0 0x7f4be40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be9400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d48e0 0x7f4be40cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be9400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be415e4d0 con 0x7f4be40d22c0 2024-04-24T23:01:15.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be9400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4be40cede0 con 0x7f4be415e0f0 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be9400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4be40cf0c0 con 0x7f4be40d48e0 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.220+0000 7f4be3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4be415e0f0 0x7f4be40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4be415e0f0 0x7f4be40d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60940/0 (socket says 172.21.15.146:60940) 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 -- 172.21.15.146:0/156603395 learned_addr learned my addr 172.21.15.146:0/156603395 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4bdbe00640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d48e0 0x7f4be40cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 -- 172.21.15.146:0/156603395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d48e0 msgr2=0x7f4be40cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d48e0 0x7f4be40cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 -- 172.21.15.146:0/156603395 >> v1:172.21.15.203:6789/0 conn(0x7f4be40d22c0 legacy=0x7f4be40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.221+0000 7f4be3e00640 1 -- 172.21.15.146:0/156603395 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be40cf3a0 con 0x7f4be415e0f0 2024-04-24T23:01:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.222+0000 7f4be3e00640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be415e0f0 0x7f4be40d0f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009850 tx=0x7f4bd402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcbfc6df3249a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be3400640 1 -- 172.21.15.146:0/156603395 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4004030 con 0x7f4be415e0f0 2024-04-24T23:01:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be3400640 1 -- 172.21.15.146:0/156603395 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd40041d0 con 0x7f4be415e0f0 2024-04-24T23:01:15.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be3400640 1 -- 172.21.15.146:0/156603395 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4003610 con 0x7f4be415e0f0 2024-04-24T23:01:15.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 -- 172.21.15.146:0/156603395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be415e0f0 msgr2=0x7f4be40d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be415e0f0 0x7f4be40d0f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009850 tx=0x7f4bd402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 -- 172.21.15.146:0/156603395 shutdown_connections 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d48e0 0x7f4be40cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 --2- 172.21.15.146:0/156603395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be415e0f0 0x7f4be40d0f70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.223+0000 7f4be9400640 1 -- 172.21.15.146:0/156603395 >> 172.21.15.146:0/156603395 conn(0x7f4be40d3ce0 msgr2=0x7f4be40d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.224+0000 7f4be9400640 1 -- 172.21.15.146:0/156603395 shutdown_connections 2024-04-24T23:01:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.224+0000 7f4be9400640 1 -- 172.21.15.146:0/156603395 wait complete. 2024-04-24T23:01:15.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.225+0000 7f4be9400640 1 Processor -- start 2024-04-24T23:01:15.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.225+0000 7f4be9400640 1 -- start start 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.226+0000 7f4be9400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 0x7f4be4157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.226+0000 7f4be9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.226+0000 7f4be9400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4be415e0f0 0x7f4be40cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be9400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40d14b0 con 0x7f4be40d48e0 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be9400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40cead0 con 0x7f4be415e0f0 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be9400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4be40d00e0 con 0x7f4be40d22c0 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60952/0 (socket says 172.21.15.146:60952) 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 -- 172.21.15.146:0/2485361307 learned_addr learned my addr 172.21.15.146:0/2485361307 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be3e00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 0x7f4be4157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be8a00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4be415e0f0 0x7f4be40cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 -- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 msgr2=0x7f4be4157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 0x7f4be4157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 -- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4be415e0f0 msgr2=0x7f4be40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4be415e0f0 0x7f4be40cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4bdbe00640 1 -- 172.21.15.146:0/2485361307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be40c8770 con 0x7f4be40d48e0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.227+0000 7f4be3e00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 0x7f4be4157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4bdbe00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d7d0 tx=0x7f4bcc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc018020 con 0x7f4be40d48e0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0096c0 con 0x7f4be40d48e0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc009ab0 con 0x7f4be40d48e0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be40c8f40 con 0x7f4be40d48e0 2024-04-24T23:01:15.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.228+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be40c9500 con 0x7f4be40d48e0 2024-04-24T23:01:15.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.229+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be40d3a50 con 0x7f4be40d48e0 2024-04-24T23:01:15.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.230+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bcc01b020 con 0x7f4be40d48e0 2024-04-24T23:01:15.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.231+0000 7f4be0c00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 0x7f4bc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.231+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4bcc08b7e0 con 0x7f4be40d48e0 2024-04-24T23:01:15.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.232+0000 7f4be3e00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 0x7f4bc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.233+0000 7f4be3e00640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 0x7f4bc006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4033000 tx=0x7f4bd402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.236+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4be40d3a50 con 0x7f4be40d48e0 2024-04-24T23:01:15.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.434+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4be404f500 con 0x7f4be40d48e0 2024-04-24T23:01:15.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.435+0000 7f4be0c00640 1 -- 172.21.15.146:0/2485361307 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f4bcc022020 con 0x7f4be40d48e0 2024-04-24T23:01:15.436 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 msgr2=0x7f4bc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 0x7f4bc006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4033000 tx=0x7f4bd402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 msgr2=0x7f4be40b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d7d0 tx=0x7f4bcc00dc90 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 shutdown_connections 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4be415e0f0 0x7f4be40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4be40d48e0 0x7f4be40b6900 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4bc006be30 0x7f4bc006e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 --2- 172.21.15.146:0/2485361307 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4be40d22c0 0x7f4be4157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 >> 172.21.15.146:0/2485361307 conn(0x7f4be40d3ce0 msgr2=0x7f4be40b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:15.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 shutdown_connections 2024-04-24T23:01:15.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.438+0000 7f4be9400640 1 -- 172.21.15.146:0/2485361307 wait complete. 2024-04-24T23:01:15.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.653+0000 7f7b57c00640 1 Processor -- start 2024-04-24T23:01:15.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.654+0000 7f7b57c00640 1 -- start start 2024-04-24T23:01:15.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.655+0000 7f7b57c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b50141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.655+0000 7f7b57c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b500ced40 con 0x7f7b500ce770 2024-04-24T23:01:15.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.655+0000 7f7b57c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b500cf020 con 0x7f7b50141ab0 2024-04-24T23:01:15.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.655+0000 7f7b57c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b501423d0 con 0x7f7b5013ef30 2024-04-24T23:01:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.656+0000 7f7b55c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7b500ce770 0x7f7b50071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35018/0 (socket says 172.21.15.146:35018) 2024-04-24T23:01:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.656+0000 7f7b55c00640 1 -- 172.21.15.146:0/3506686410 learned_addr learned my addr 172.21.15.146:0/3506686410 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.656+0000 7f7b55200640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b50141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.656+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887771419 0 0) 0x7f7b500ced40 con 0x7f7b500ce770 2024-04-24T23:01:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.656+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b38003520 con 0x7f7b500ce770 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945982657 0 0) 0x7f7b500cf020 con 0x7f7b50141ab0 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b500ced40 con 0x7f7b50141ab0 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1962369926 0 0) 0x7f7b38003520 con 0x7f7b500ce770 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 msgr2=0x7f7b50141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b50141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 >> v1:172.21.15.203:6789/0 conn(0x7f7b50141ab0 legacy=0x7f7b500ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b500cf300 con 0x7f7b500ce770 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7b480019f0 con 0x7f7b500ce770 2024-04-24T23:01:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 >> v1:172.21.15.146:6789/0 conn(0x7f7b500ce770 legacy=0x7f7b50071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b38003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b380040d0 0x7f7b38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3800ba70 con 0x7f7b380040d0 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3800bc20 con 0x7f7b38004d40 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3800be20 con 0x7f7b5013ef30 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b380040d0 0x7f7b38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b55c00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.657+0000 7f7b55200640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b38003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 msgr2=0x7f7b38003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b38003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b38004d40 msgr2=0x7f7b380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b38004d40 0x7f7b380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3506686410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38003520 con 0x7f7b380040d0 2024-04-24T23:01:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.658+0000 7f7b55200640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b5013ef30 0x7f7b38003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.659+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b380040d0 0x7f7b38004800 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0018d0 tx=0x7f7b38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6918fbdc2a595fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.659+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0014f0 con 0x7f7b380040d0 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.659+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0052d0 con 0x7f7b380040d0 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.659+0000 7f7b4f400640 1 -- 172.21.15.146:0/3506686410 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c02ac90 con 0x7f7b380040d0 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 -- 172.21.15.146:0/3506686410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b380040d0 msgr2=0x7f7b38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3506686410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b380040d0 0x7f7b38004800 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0018d0 tx=0x7f7b38005830 comp rx=0 tx=0).stop 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b55c00640 1 -- 172.21.15.146:0/3506686410 reap_dead start 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 -- 172.21.15.146:0/3506686410 shutdown_connections 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 -- 172.21.15.146:0/3506686410 >> 172.21.15.146:0/3506686410 conn(0x7f7b500b17b0 msgr2=0x7f7b500b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 -- 172.21.15.146:0/3506686410 shutdown_connections 2024-04-24T23:01:15.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.660+0000 7f7b57c00640 1 -- 172.21.15.146:0/3506686410 wait complete. 2024-04-24T23:01:15.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.662+0000 7f7b57c00640 1 Processor -- start 2024-04-24T23:01:15.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.662+0000 7f7b57c00640 1 -- start start 2024-04-24T23:01:15.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b380040d0 0x7f7b5013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b50142910 0x7f7b50142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50141570 con 0x7f7b5006cf50 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50070f80 con 0x7f7b50142910 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b57c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b501416f0 con 0x7f7b380040d0 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b4fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b4fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60958/0 (socket says 172.21.15.146:60958) 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3002565308 learned_addr learned my addr 172.21.15.146:0/3002565308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b55200640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b380040d0 0x7f7b5013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.663+0000 7f7b55c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b50142910 0x7f7b50142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b380040d0 msgr2=0x7f7b5013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b380040d0 0x7f7b5013fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b50142910 msgr2=0x7f7b50142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b50142910 0x7f7b50142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 -- 172.21.15.146:0/3002565308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b50143da0 con 0x7f7b5006cf50 2024-04-24T23:01:15.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4fe00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0019f0 tx=0x7f7b3c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c03f020 con 0x7f7b5006cf50 2024-04-24T23:01:15.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c006e50 con 0x7f7b5006cf50 2024-04-24T23:01:15.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c037040 con 0x7f7b5006cf50 2024-04-24T23:01:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b50144040 con 0x7f7b5006cf50 2024-04-24T23:01:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.664+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b50151030 con 0x7f7b5006cf50 2024-04-24T23:01:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.666+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5004f5a0 con 0x7f7b5006cf50 2024-04-24T23:01:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.667+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b3c042020 con 0x7f7b5006cf50 2024-04-24T23:01:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.668+0000 7f7b4cc00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 0x7f7b3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.668+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7b3c0aae00 con 0x7f7b5006cf50 2024-04-24T23:01:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.669+0000 7f7b55200640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 0x7f7b3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:15.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.670+0000 7f7b55200640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 0x7f7b3006e320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b440099b0 tx=0x7f7b44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.673+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b3c049030 con 0x7f7b5006cf50 2024-04-24T23:01:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.872+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7b50072d30 con 0x7f7b5006cf50 2024-04-24T23:01:15.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.873+0000 7f7b4cc00640 1 -- 172.21.15.146:0/3002565308 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f7b3c079440 con 0x7f7b5006cf50 2024-04-24T23:01:15.874 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 msgr2=0x7f7b3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 0x7f7b3006e320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b440099b0 tx=0x7f7b44008040 comp rx=0 tx=0).stop 2024-04-24T23:01:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 msgr2=0x7f7b501423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0019f0 tx=0x7f7b3c0012d0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 shutdown_connections 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b50142910 0x7f7b50142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b5006cf50 0x7f7b501423d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7b3006be60 0x7f7b3006e320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 --2- 172.21.15.146:0/3002565308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b380040d0 0x7f7b5013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 >> 172.21.15.146:0/3002565308 conn(0x7f7b500b17b0 msgr2=0x7f7b501408e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 shutdown_connections 2024-04-24T23:01:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:15.876+0000 7f7b57c00640 1 -- 172.21.15.146:0/3002565308 wait complete. 2024-04-24T23:01:15.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:16.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.095+0000 7fbe1ee00640 1 Processor -- start 2024-04-24T23:01:16.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.095+0000 7fbe1ee00640 1 -- start start 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1ee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe1815e010 0x7fbe180b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1ee00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbe180adfd0 0x7fbe1806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1ee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe18070a80 con 0x7fbe18072380 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1ee00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbe180aeb60 con 0x7fbe180adfd0 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1ee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe18071930 con 0x7fbe1815e010 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1d000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe18072380 0x7fbe180ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35034/0 (socket says 172.21.15.146:35034) 2024-04-24T23:01:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.097+0000 7fbe1d000640 1 -- 172.21.15.146:0/4181457773 learned_addr learned my addr 172.21.15.146:0/4181457773 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:16.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281912304 0 0) 0x7fbe18070a80 con 0x7fbe18072380 2024-04-24T23:01:16.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe00003520 con 0x7fbe18072380 2024-04-24T23:01:16.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1952169614 0 0) 0x7fbe00003520 con 0x7fbe18072380 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe1da00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe1815e010 0x7fbe180b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> v2:172.21.15.203:3300/0 conn(0x7fbe180adfd0 0x7fbe1806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe1815e010 msgr2=0x7fbe180b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe1815e010 0x7fbe180b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 >> v2:172.21.15.203:3300/0 conn(0x7fbe180adfd0 msgr2=0x7fbe1806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 --2- 172.21.15.146:0/4181457773 >> v2:172.21.15.203:3300/0 conn(0x7fbe180adfd0 0x7fbe1806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe18070d20 con 0x7fbe18072380 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fbe04001670 con 0x7fbe18072380 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 >> v1:172.21.15.146:6789/0 conn(0x7fbe18072380 legacy=0x7fbe180ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe000039b0 0x7fbe00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00004800 0x7fbe00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe00005210 0x7fbe0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe180aeb60 con 0x7fbe00005210 2024-04-24T23:01:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18071930 con 0x7fbe000039b0 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0000c1a0 con 0x7fbe00004800 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> v2:172.21.15.203:3300/0 conn(0x7fbe180adfd0 0x7fbe1806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.098+0000 7fbe1da00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe1815e010 0x7fbe180b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe00005210 0x7fbe0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1d000640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00004800 0x7fbe00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1da00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe000039b0 0x7fbe00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 -- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00004800 msgr2=0x7fbe00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00004800 0x7fbe00004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 -- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe000039b0 msgr2=0x7fbe00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe000039b0 0x7fbe00003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.099+0000 7fbe1e400640 1 -- 172.21.15.146:0/4181457773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe00003520 con 0x7fbe00005210 2024-04-24T23:01:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.100+0000 7fbe1e400640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe00005210 0x7fbe0000b9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c3e0 tx=0x7fbe00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a5a3156e619b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.100+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10007c00 con 0x7fbe00005210 2024-04-24T23:01:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.100+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe10003b90 con 0x7fbe00005210 2024-04-24T23:01:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.100+0000 7fbe17e00640 1 -- 172.21.15.146:0/4181457773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1002b920 con 0x7fbe00005210 2024-04-24T23:01:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 -- 172.21.15.146:0/4181457773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe00005210 msgr2=0x7fbe0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/4181457773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe00005210 0x7fbe0000b9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c3e0 tx=0x7fbe00005830 comp rx=0 tx=0).stop 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1e400640 1 -- 172.21.15.146:0/4181457773 reap_dead start 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 -- 172.21.15.146:0/4181457773 shutdown_connections 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 -- 172.21.15.146:0/4181457773 >> 172.21.15.146:0/4181457773 conn(0x7fbe180b1560 msgr2=0x7fbe180b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 -- 172.21.15.146:0/4181457773 shutdown_connections 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.101+0000 7fbe1ee00640 1 -- 172.21.15.146:0/4181457773 wait complete. 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.103+0000 7fbe1ee00640 1 Processor -- start 2024-04-24T23:01:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.103+0000 7fbe1ee00640 1 -- start start 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00005210 0x7fbe180b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe18148420 0x7fbe18148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe180715c0 con 0x7fbe1814b190 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe180712e0 con 0x7fbe18148420 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.104+0000 7fbe1ee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe18071dc0 con 0x7fbe00005210 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60988/0 (socket says 172.21.15.146:60988) 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 -- 172.21.15.146:0/3319526853 learned_addr learned my addr 172.21.15.146:0/3319526853 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1e400640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe18148420 0x7fbe18148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1da00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00005210 0x7fbe180b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 -- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00005210 msgr2=0x7fbe180b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00005210 0x7fbe180b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 -- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe18148420 msgr2=0x7fbe18148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe18148420 0x7fbe18148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.105+0000 7fbe1d000640 1 -- 172.21.15.146:0/3319526853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1814c0f0 con 0x7fbe1814b190 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe1d000640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d8e0 tx=0x7fbe0400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04019070 con 0x7fbe1814b190 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe040074e0 con 0x7fbe1814b190 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040049e0 con 0x7fbe1814b190 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1814be10 con 0x7fbe1814b190 2024-04-24T23:01:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.106+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181494f0 con 0x7fbe1814b190 2024-04-24T23:01:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.107+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1804f500 con 0x7fbe1814b190 2024-04-24T23:01:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.108+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe04004b80 con 0x7fbe1814b190 2024-04-24T23:01:16.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.109+0000 7fbe15600640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 0x7fbdf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.109+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbe0408aea0 con 0x7fbe1814b190 2024-04-24T23:01:16.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.110+0000 7fbe1da00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 0x7fbdf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.111+0000 7fbe1da00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 0x7fbdf806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe1806ea60 tx=0x7fbe0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.113+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbe040593b0 con 0x7fbe1814b190 2024-04-24T23:01:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.324+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe180b2270 con 0x7fbe1814b190 2024-04-24T23:01:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.325+0000 7fbe15600640 1 -- 172.21.15.146:0/3319526853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fbe04058cb0 con 0x7fbe1814b190 2024-04-24T23:01:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 msgr2=0x7fbdf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 0x7fbdf806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe1806ea60 tx=0x7fbe0c008040 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 msgr2=0x7fbe1814b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d8e0 tx=0x7fbe0400dda0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 shutdown_connections 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe18148420 0x7fbe18148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe1814b190 0x7fbe1814b5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbdf806be30 0x7fbdf806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 --2- 172.21.15.146:0/3319526853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe00005210 0x7fbe180b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 >> 172.21.15.146:0/3319526853 conn(0x7fbe180b1560 msgr2=0x7fbe1815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 shutdown_connections 2024-04-24T23:01:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.328+0000 7fbe1ee00640 1 -- 172.21.15.146:0/3319526853 wait complete. 2024-04-24T23:01:16.346 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-24T23:01:16.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:16.346 DEBUG:teuthology.orchestra.run.smithi203:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-24T23:01:16.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:01:16.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:16.428 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-24T23:01:16.472 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:01:16.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:16.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.678+0000 7fd6c3200640 1 Processor -- start 2024-04-24T23:01:16.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.678+0000 7fd6c3200640 1 -- start start 2024-04-24T23:01:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.679+0000 7fd6c3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd6c41561c0 0x7fd6c40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6c40d0240 0x7fd6c415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c4070f90 con 0x7fd6c40709d0 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c40b4310 con 0x7fd6c40d0240 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c41565a0 con 0x7fd6c41561c0 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6c40d0240 0x7fd6c415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6c40d0240 0x7fd6c415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32770/0 (socket says 172.21.15.146:32770) 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 -- 172.21.15.146:0/1476884039 learned_addr learned my addr 172.21.15.146:0/1476884039 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c1e00640 1 --2- 172.21.15.146:0/1476884039 >> v2:172.21.15.203:3300/0 conn(0x7fd6c41561c0 0x7fd6c40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 -- 172.21.15.146:0/1476884039 >> v2:172.21.15.203:3300/0 conn(0x7fd6c41561c0 msgr2=0x7fd6c40cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 --2- 172.21.15.146:0/1476884039 >> v2:172.21.15.203:3300/0 conn(0x7fd6c41561c0 0x7fd6c40cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 -- 172.21.15.146:0/1476884039 >> v1:172.21.15.203:6789/0 conn(0x7fd6c40709d0 legacy=0x7fd6c40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.680+0000 7fd6c2800640 1 -- 172.21.15.146:0/1476884039 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4071270 con 0x7fd6c40d0240 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c2800640 1 --2- 172.21.15.146:0/1476884039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c40d0240 0x7fd6c415cb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40706c0 tx=0x7fd6bc02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050b324a3012117 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c0a00640 1 -- 172.21.15.146:0/1476884039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc036070 con 0x7fd6c40d0240 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c0a00640 1 -- 172.21.15.146:0/1476884039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc031600 con 0x7fd6c40d0240 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c0a00640 1 -- 172.21.15.146:0/1476884039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0319d0 con 0x7fd6c40d0240 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c3200640 1 -- 172.21.15.146:0/1476884039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c40d0240 msgr2=0x7fd6c415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.682+0000 7fd6c3200640 1 --2- 172.21.15.146:0/1476884039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c40d0240 0x7fd6c415cb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40706c0 tx=0x7fd6bc02a5d0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 -- 172.21.15.146:0/1476884039 shutdown_connections 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 --2- 172.21.15.146:0/1476884039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c40d0240 0x7fd6c415cb80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 --2- 172.21.15.146:0/1476884039 >> v2:172.21.15.203:3300/0 conn(0x7fd6c41561c0 0x7fd6c40cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 -- 172.21.15.146:0/1476884039 >> 172.21.15.146:0/1476884039 conn(0x7fd6c406b320 msgr2=0x7fd6c406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 -- 172.21.15.146:0/1476884039 shutdown_connections 2024-04-24T23:01:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.683+0000 7fd6c3200640 1 -- 172.21.15.146:0/1476884039 wait complete. 2024-04-24T23:01:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.684+0000 7fd6c3200640 1 Processor -- start 2024-04-24T23:01:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.684+0000 7fd6c3200640 1 -- start start 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6c40709d0 0x7fd6c41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6c40d0240 0x7fd6c4156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c40b2c20 con 0x7fd6c41561c0 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4071830 con 0x7fd6c40709d0 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.685+0000 7fd6c3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c40b2da0 con 0x7fd6c40d0240 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32776/0 (socket says 172.21.15.146:32776) 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 -- 172.21.15.146:0/2814122337 learned_addr learned my addr 172.21.15.146:0/2814122337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c1e00640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6c40709d0 0x7fd6c41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c1400640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6c40d0240 0x7fd6c4156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 -- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6c40d0240 msgr2=0x7fd6c4156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6c40d0240 0x7fd6c4156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 -- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6c40709d0 msgr2=0x7fd6c41522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6c40709d0 0x7fd6c41522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.686+0000 7fd6c2800640 1 -- 172.21.15.146:0/2814122337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4143da0 con 0x7fd6c41561c0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6c2800640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009f40 tx=0x7fd6bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc036050 con 0x7fd6c41561c0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc042070 con 0x7fd6c41561c0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc007bd0 con 0x7fd6c41561c0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c4158f40 con 0x7fd6c41561c0 2024-04-24T23:01:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.687+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c4159500 con 0x7fd6c41561c0 2024-04-24T23:01:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.688+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c40684e0 con 0x7fd6c41561c0 2024-04-24T23:01:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.690+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6bc047460 con 0x7fd6c41561c0 2024-04-24T23:01:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.691+0000 7fd6ba000640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.691+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd6bc0ac190 con 0x7fd6c41561c0 2024-04-24T23:01:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.692+0000 7fd6c1e00640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.693+0000 7fd6c1e00640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 0x7fd6a406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:16.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.696+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd6c40684e0 con 0x7fd6c41561c0 2024-04-24T23:01:16.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.933+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6c404f500 con 0x7fd6c41561c0 2024-04-24T23:01:16.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.935+0000 7fd6ba000640 1 -- 172.21.15.146:0/2814122337 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fd6c4143da0 con 0x7fd6c41561c0 2024-04-24T23:01:16.936 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:16.936 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:01:16.936 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.937+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 msgr2=0x7fd6a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.937+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 0x7fd6a406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4008040 comp rx=0 tx=0).stop 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.937+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 msgr2=0x7fd6c4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.937+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009f40 tx=0x7fd6bc004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 shutdown_connections 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6c41561c0 0x7fd6c4157410 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6c40d0240 0x7fd6c4156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 --2- 172.21.15.146:0/2814122337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6c40709d0 0x7fd6c41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:16.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 >> 172.21.15.146:0/2814122337 conn(0x7fd6c406b320 msgr2=0x7fd6c40b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:16.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 shutdown_connections 2024-04-24T23:01:16.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:16.938+0000 7fd6c3200640 1 -- 172.21.15.146:0/2814122337 wait complete. 2024-04-24T23:01:16.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.156+0000 7fad87a00640 1 Processor -- start 2024-04-24T23:01:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.156+0000 7fad87a00640 1 -- start start 2024-04-24T23:01:17.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad87a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad801445e0 0x7fad800cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad87a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad800728c0 0x7fad800d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad87a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad801449c0 con 0x7fad80070c10 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad87a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fad80072430 con 0x7fad801445e0 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad87a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fad800b2d70 con 0x7fad800728c0 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad85a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad80070c10 0x7fad8015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35040/0 (socket says 172.21.15.146:35040) 2024-04-24T23:01:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad85a00640 1 -- 172.21.15.146:0/3160354934 learned_addr learned my addr 172.21.15.146:0/3160354934 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.158+0000 7fad85000640 1 --2- 172.21.15.146:0/3160354934 >> v2:172.21.15.146:3300/0 conn(0x7fad801445e0 0x7fad800cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad77e00640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad800728c0 0x7fad800d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad7fe00640 1 -- 172.21.15.146:0/3160354934 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554778802 0 0) 0x7fad801449c0 con 0x7fad80070c10 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad7fe00640 1 -- 172.21.15.146:0/3160354934 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad64003520 con 0x7fad80070c10 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad85000640 1 -- 172.21.15.146:0/3160354934 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad800728c0 msgr2=0x7fad800d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad85000640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad800728c0 0x7fad800d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad85000640 1 -- 172.21.15.146:0/3160354934 >> v1:172.21.15.146:6789/0 conn(0x7fad80070c10 legacy=0x7fad8015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.159+0000 7fad85000640 1 -- 172.21.15.146:0/3160354934 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad80071820 con 0x7fad801445e0 2024-04-24T23:01:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.160+0000 7fad85000640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad801445e0 0x7fad800cfc90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fad700097a0 tx=0x7fad7002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b3f307036237a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.160+0000 7fad7fe00640 1 -- 172.21.15.146:0/3160354934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70037070 con 0x7fad801445e0 2024-04-24T23:01:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.160+0000 7fad7fe00640 1 -- 172.21.15.146:0/3160354934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad70032440 con 0x7fad801445e0 2024-04-24T23:01:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.160+0000 7fad7fe00640 1 -- 172.21.15.146:0/3160354934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70032810 con 0x7fad801445e0 2024-04-24T23:01:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 -- 172.21.15.146:0/3160354934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad801445e0 msgr2=0x7fad800cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad801445e0 0x7fad800cfc90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fad700097a0 tx=0x7fad7002a180 comp rx=0 tx=0).stop 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 -- 172.21.15.146:0/3160354934 shutdown_connections 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad800728c0 0x7fad800d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 --2- 172.21.15.146:0/3160354934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad801445e0 0x7fad800cfc90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 -- 172.21.15.146:0/3160354934 >> 172.21.15.146:0/3160354934 conn(0x7fad8006b320 msgr2=0x7fad8006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 -- 172.21.15.146:0/3160354934 shutdown_connections 2024-04-24T23:01:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.161+0000 7fad87a00640 1 -- 172.21.15.146:0/3160354934 wait complete. 2024-04-24T23:01:17.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.163+0000 7fad87a00640 1 Processor -- start 2024-04-24T23:01:17.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.163+0000 7fad87a00640 1 -- start start 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad800728c0 0x7fad80140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad801445e0 0x7fad80140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fad800720c0 con 0x7fad80070c10 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad80071de0 con 0x7fad800728c0 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad87a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fad800710c0 con 0x7fad801445e0 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32792/0 (socket says 172.21.15.146:32792) 2024-04-24T23:01:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 -- 172.21.15.146:0/4008269026 learned_addr learned my addr 172.21.15.146:0/4008269026 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 -- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad801445e0 msgr2=0x7fad80140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad801445e0 0x7fad80140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 -- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad800728c0 msgr2=0x7fad80140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad800728c0 0x7fad80140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.164+0000 7fad85000640 1 -- 172.21.15.146:0/4008269026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8013b490 con 0x7fad80070c10 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad85000640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70041070 con 0x7fad80070c10 2024-04-24T23:01:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7003c870 con 0x7fad80070c10 2024-04-24T23:01:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad800cd920 con 0x7fad80070c10 2024-04-24T23:01:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70037040 con 0x7fad80070c10 2024-04-24T23:01:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.165+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad800cdee0 con 0x7fad80070c10 2024-04-24T23:01:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.166+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad80068190 con 0x7fad80070c10 2024-04-24T23:01:17.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.168+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad70044070 con 0x7fad80070c10 2024-04-24T23:01:17.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.169+0000 7fad7d600640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.169+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fad700abc10 con 0x7fad80070c10 2024-04-24T23:01:17.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.169+0000 7fad77e00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.170+0000 7fad77e00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 0x7fad5c06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad8013bb70 tx=0x7fad68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.173+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fad7007a240 con 0x7fad80070c10 2024-04-24T23:01:17.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.357+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad8013cd60 con 0x7fad80070c10 2024-04-24T23:01:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.359+0000 7fad7d600640 1 -- 172.21.15.146:0/4008269026 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fad70079b40 con 0x7fad80070c10 2024-04-24T23:01:17.361 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:17.361 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 msgr2=0x7fad5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 0x7fad5c06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad8013bb70 tx=0x7fad68008040 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 msgr2=0x7fad80135460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad700046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 shutdown_connections 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad5c06be30 0x7fad5c06e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad801445e0 0x7fad80140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad800728c0 0x7fad80140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 --2- 172.21.15.146:0/4008269026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad80070c10 0x7fad80135460 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 >> 172.21.15.146:0/4008269026 conn(0x7fad8006b320 msgr2=0x7fad800ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 shutdown_connections 2024-04-24T23:01:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.362+0000 7fad87a00640 1 -- 172.21.15.146:0/4008269026 wait complete. 2024-04-24T23:01:17.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T22:59:52.709031+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T22:59:53.249539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T22:59:57.174462+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:01:17.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.572+0000 7f5066000640 1 Processor -- start 2024-04-24T23:01:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.572+0000 7f5066000640 1 -- start start 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f506013ef30 0x7f5060141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 0x7f50600ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 0x7f506015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f50601423d0 con 0x7f506013ef30 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5060070f80 con 0x7f5060141ab0 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f5066000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f50600ced40 con 0x7f50600ce5a0 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f506013ef30 0x7f5060141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f506013ef30 0x7f5060141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32806/0 (socket says 172.21.15.146:32806) 2024-04-24T23:01:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505f400640 1 -- 172.21.15.146:0/1080973355 learned_addr learned my addr 172.21.15.146:0/1080973355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:17.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505ea00640 1 --2- 172.21.15.146:0/1080973355 >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 0x7f50600ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505fe00640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 0x7f506015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505f400640 1 -- 172.21.15.146:0/1080973355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 msgr2=0x7f506015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.574+0000 7f505f400640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 0x7f506015fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505f400640 1 -- 172.21.15.146:0/1080973355 >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 msgr2=0x7f50600ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505f400640 1 --2- 172.21.15.146:0/1080973355 >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 0x7f50600ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505f400640 1 -- 172.21.15.146:0/1080973355 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50600cf020 con 0x7f506013ef30 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505ea00640 1 --2- 172.21.15.146:0/1080973355 >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 0x7f50600ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505fe00640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 0x7f506015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.575+0000 7f505f400640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f5060141570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f50600cddd0 tx=0x7f505002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa96f3f1aea78a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.576+0000 7f505e000640 1 -- 172.21.15.146:0/1080973355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050037070 con 0x7f506013ef30 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.576+0000 7f505e000640 1 -- 172.21.15.146:0/1080973355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050032440 con 0x7f506013ef30 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.576+0000 7f505e000640 1 -- 172.21.15.146:0/1080973355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050032810 con 0x7f506013ef30 2024-04-24T23:01:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.576+0000 7f5066000640 1 -- 172.21.15.146:0/1080973355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 msgr2=0x7f5060141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.576+0000 7f5066000640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f5060141570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f50600cddd0 tx=0x7f505002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 -- 172.21.15.146:0/1080973355 shutdown_connections 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f50600ce5a0 0x7f506015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 --2- 172.21.15.146:0/1080973355 >> v2:172.21.15.203:3300/0 conn(0x7f5060141ab0 0x7f50600ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 --2- 172.21.15.146:0/1080973355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f5060141570 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 -- 172.21.15.146:0/1080973355 >> 172.21.15.146:0/1080973355 conn(0x7f50600b17b0 msgr2=0x7f50600b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 -- 172.21.15.146:0/1080973355 shutdown_connections 2024-04-24T23:01:17.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.577+0000 7f5066000640 1 -- 172.21.15.146:0/1080973355 wait complete. 2024-04-24T23:01:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.579+0000 7f5066000640 1 Processor -- start 2024-04-24T23:01:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.579+0000 7f5066000640 1 -- start start 2024-04-24T23:01:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50600ce5a0 0x7f50601563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5060141ab0 0x7f5060139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50600cea30 con 0x7f506013ef30 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5060070c10 con 0x7f50600ce5a0 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.580+0000 7f5066000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f506015ff40 con 0x7f5060141ab0 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32814/0 (socket says 172.21.15.146:32814) 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 -- 172.21.15.146:0/4000570172 learned_addr learned my addr 172.21.15.146:0/4000570172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 -- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5060141ab0 msgr2=0x7f5060139e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505fe00640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5060141ab0 0x7f5060139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505f400640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50600ce5a0 0x7f50601563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5060141ab0 0x7f5060139e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 -- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50600ce5a0 msgr2=0x7f50601563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50600ce5a0 0x7f50601563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 -- 172.21.15.146:0/4000570172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5060145110 con 0x7f506013ef30 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.581+0000 7f505ea00640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c7f0 tx=0x7f504c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.582+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c015070 con 0x7f506013ef30 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.582+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c007820 con 0x7f506013ef30 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.582+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50600b38a0 con 0x7f506013ef30 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.582+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c007bd0 con 0x7f506013ef30 2024-04-24T23:01:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.582+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50600b3e60 con 0x7f506013ef30 2024-04-24T23:01:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.583+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506004f5a0 con 0x7f506013ef30 2024-04-24T23:01:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.584+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f504c018070 con 0x7f506013ef30 2024-04-24T23:01:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.584+0000 7f5057400640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 0x7f504006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.585+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f504c08b2c0 con 0x7f506013ef30 2024-04-24T23:01:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.585+0000 7f505f400640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 0x7f504006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.586+0000 7f505f400640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 0x7f504006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f505002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:17.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.589+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f504c0598f0 con 0x7f506013ef30 2024-04-24T23:01:17.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.788+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5060072d30 con 0x7f506013ef30 2024-04-24T23:01:17.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.790+0000 7f5057400640 1 -- 172.21.15.146:0/4000570172 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f504c0591f0 con 0x7f506013ef30 2024-04-24T23:01:17.790 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 msgr2=0x7f504006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 0x7f504006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f505002e000 comp rx=0 tx=0).stop 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 msgr2=0x7f50600b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c7f0 tx=0x7f504c00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 shutdown_connections 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f504006be30 0x7f504006e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5060141ab0 0x7f5060139e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f506013ef30 0x7f50600b46e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 --2- 172.21.15.146:0/4000570172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50600ce5a0 0x7f50601563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.792+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 >> 172.21.15.146:0/4000570172 conn(0x7f50600b17b0 msgr2=0x7f50600af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.793+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 shutdown_connections 2024-04-24T23:01:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:17.793+0000 7f5066000640 1 -- 172.21.15.146:0/4000570172 wait complete. 2024-04-24T23:01:17.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:18.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.024+0000 7f4184600640 1 Processor -- start 2024-04-24T23:01:18.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.024+0000 7f4184600640 1 -- start start 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4184600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 0x7f417c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4184600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f417c0ce5a0 0x7f417c071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4184600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f417c0ced40 con 0x7f417c13ef30 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4184600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f417c1423d0 con 0x7f417c0ce5a0 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4184600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f417c070f80 con 0x7f417c141c80 2024-04-24T23:01:18.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4182600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f417c0ce5a0 0x7f417c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4182600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f417c0ce5a0 0x7f417c071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54324/0 (socket says 172.21.15.146:54324) 2024-04-24T23:01:18.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.026+0000 7f4182600640 1 -- 172.21.15.146:0/248980742 learned_addr learned my addr 172.21.15.146:0/248980742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4181200640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 0x7f417c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4182600640 1 -- 172.21.15.146:0/248980742 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 msgr2=0x7f417c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4182600640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 0x7f417c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4182600640 1 -- 172.21.15.146:0/248980742 >> v1:172.21.15.203:6789/0 conn(0x7f417c13ef30 legacy=0x7f417c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4182600640 1 -- 172.21.15.146:0/248980742 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c0cf020 con 0x7f417c0ce5a0 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.027+0000 7f4181200640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 0x7f417c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.028+0000 7f4182600640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c0ce5a0 0x7f417c071410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e50 tx=0x7f417402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03fcd4f58846d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.028+0000 7f417be00640 1 -- 172.21.15.146:0/248980742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174036070 con 0x7f417c0ce5a0 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.028+0000 7f417be00640 1 -- 172.21.15.146:0/248980742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4174031600 con 0x7f417c0ce5a0 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.028+0000 7f417be00640 1 -- 172.21.15.146:0/248980742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740319d0 con 0x7f417c0ce5a0 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 -- 172.21.15.146:0/248980742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c0ce5a0 msgr2=0x7f417c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c0ce5a0 0x7f417c071410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e50 tx=0x7f417402a6c0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 -- 172.21.15.146:0/248980742 shutdown_connections 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c0ce5a0 0x7f417c071410 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 --2- 172.21.15.146:0/248980742 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c141c80 0x7f417c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 -- 172.21.15.146:0/248980742 >> 172.21.15.146:0/248980742 conn(0x7f417c0b17b0 msgr2=0x7f417c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 -- 172.21.15.146:0/248980742 shutdown_connections 2024-04-24T23:01:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.029+0000 7f4184600640 1 -- 172.21.15.146:0/248980742 wait complete. 2024-04-24T23:01:18.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.031+0000 7f4184600640 1 Processor -- start 2024-04-24T23:01:18.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.031+0000 7f4184600640 1 -- start start 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c0ce5a0 0x7f417c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f417c13ef30 0x7f417c1f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f417c0cea50 con 0x7f417c141c80 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f417c070c10 con 0x7f417c13ef30 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4184600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f417c071950 con 0x7f417c0ce5a0 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4182600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4182600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54340/0 (socket says 172.21.15.146:54340) 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.032+0000 7f4182600640 1 -- 172.21.15.146:0/2578685332 learned_addr learned my addr 172.21.15.146:0/2578685332 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4181200640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f417c13ef30 0x7f417c1f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4181c00640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c0ce5a0 0x7f417c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 -- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c0ce5a0 msgr2=0x7f417c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c0ce5a0 0x7f417c0ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 -- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f417c13ef30 msgr2=0x7f417c1f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f417c13ef30 0x7f417c1f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 -- 172.21.15.146:0/2578685332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1e5840 con 0x7f417c141c80 2024-04-24T23:01:18.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4182600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e50 tx=0x7f4174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174041020 con 0x7f417c141c80 2024-04-24T23:01:18.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41740077a0 con 0x7f417c141c80 2024-04-24T23:01:18.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c1f43a0 con 0x7f417c141c80 2024-04-24T23:01:18.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174036040 con 0x7f417c141c80 2024-04-24T23:01:18.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.033+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c0b46a0 con 0x7f417c141c80 2024-04-24T23:01:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.035+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c04f5a0 con 0x7f417c141c80 2024-04-24T23:01:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.036+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4174044020 con 0x7f417c141c80 2024-04-24T23:01:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.037+0000 7f4179600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.037+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f41740ac060 con 0x7f417c141c80 2024-04-24T23:01:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.038+0000 7f4181c00640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.039+0000 7f4181c00640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4170003d90 tx=0x7f4170009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.042+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f417404b030 con 0x7f417c141c80 2024-04-24T23:01:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.236+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f417c141a60 con 0x7f417c141c80 2024-04-24T23:01:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.237+0000 7f4179600640 1 -- 172.21.15.146:0/2578685332 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f417407a690 con 0x7f417c141c80 2024-04-24T23:01:18.238 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 msgr2=0x7f415c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4170003d90 tx=0x7f4170009040 comp rx=0 tx=0).stop 2024-04-24T23:01:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 msgr2=0x7f417c138970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4174009e50 tx=0x7f4174004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 shutdown_connections 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f417c141c80 0x7f417c138970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f417c13ef30 0x7f417c1f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 --2- 172.21.15.146:0/2578685332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f417c0ce5a0 0x7f417c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.239+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 >> 172.21.15.146:0/2578685332 conn(0x7f417c0b17b0 msgr2=0x7f417c06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.240+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 shutdown_connections 2024-04-24T23:01:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.240+0000 7f4184600640 1 -- 172.21.15.146:0/2578685332 wait complete. 2024-04-24T23:01:18.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:18.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.456+0000 7f9176c00640 1 Processor -- start 2024-04-24T23:01:18.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.457+0000 7f9176c00640 1 -- start start 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9176c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f91700cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9176c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91700b4df0 con 0x7f917015bcd0 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9176c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91700b4b10 con 0x7f91700d0200 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9176c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f917015c8d0 con 0x7f917015cd60 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9175800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f917015bcd0 0x7f91700cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45444/0 (socket says 172.21.15.146:45444) 2024-04-24T23:01:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.458+0000 7f9175800640 1 -- 172.21.15.146:0/2103203950 learned_addr learned my addr 172.21.15.146:0/2103203950 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:18.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949289681 0 0) 0x7f91700b4df0 con 0x7f917015bcd0 2024-04-24T23:01:18.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9158003520 con 0x7f917015bcd0 2024-04-24T23:01:18.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f9174e00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f91700cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 9756338 0 0) 0x7f9158003520 con 0x7f917015bcd0 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 msgr2=0x7f91700cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f91700cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 >> v1:172.21.15.203:6789/0 conn(0x7f91700d0200 legacy=0x7f917015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917015c280 con 0x7f917015bcd0 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9164001670 con 0x7f917015bcd0 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 >> v1:172.21.15.146:6789/0 conn(0x7f917015bcd0 legacy=0x7f91700cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91580039e0 0x7f9158003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f9158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f9158005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f917015c8d0 con 0x7f9158004800 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f915800bb50 con 0x7f91580039e0 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f915800bd50 con 0x7f917015cd60 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.459+0000 7f9174e00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f9158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9174e00640 1 -- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 msgr2=0x7f9158005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9175800640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91580039e0 0x7f9158003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9176200640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f9158005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9174e00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f9158005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9174e00640 1 -- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91580039e0 msgr2=0x7f9158003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9174e00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91580039e0 0x7f9158003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9174e00640 1 -- 172.21.15.146:0/2103203950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9158003520 con 0x7f9158004800 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9176200640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f917015cd60 0x7f9158005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.460+0000 7f9175800640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91580039e0 0x7f9158003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:18.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.461+0000 7f9174e00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f9158004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f915c00ba30 tx=0x7f9158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59f0a06421caecf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.461+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c030070 con 0x7f9158004800 2024-04-24T23:01:18.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.461+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915c02ade0 con 0x7f9158004800 2024-04-24T23:01:18.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.461+0000 7f916fe00640 1 -- 172.21.15.146:0/2103203950 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c00b600 con 0x7f9158004800 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 -- 172.21.15.146:0/2103203950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 msgr2=0x7f9158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 --2- 172.21.15.146:0/2103203950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f9158004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f915c00ba30 tx=0x7f9158005830 comp rx=0 tx=0).stop 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176200640 1 -- 172.21.15.146:0/2103203950 reap_dead start 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 -- 172.21.15.146:0/2103203950 shutdown_connections 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 -- 172.21.15.146:0/2103203950 >> 172.21.15.146:0/2103203950 conn(0x7f917006b560 msgr2=0x7f917006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 -- 172.21.15.146:0/2103203950 shutdown_connections 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.462+0000 7f9176c00640 1 -- 172.21.15.146:0/2103203950 wait complete. 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.464+0000 7f9176c00640 1 Processor -- start 2024-04-24T23:01:18.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.464+0000 7f9176c00640 1 -- start start 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9170151020 0x7f91701e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91701e73b0 0x7f9170140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91700b4790 con 0x7f9158004800 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f917006e590 con 0x7f9170151020 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9176c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91700cfcc0 con 0x7f91701e73b0 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54362/0 (socket says 172.21.15.146:54362) 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 -- 172.21.15.146:0/4182303264 learned_addr learned my addr 172.21.15.146:0/4182303264 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 -- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91701e73b0 msgr2=0x7f9170140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91701e73b0 0x7f9170140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 -- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9170151020 msgr2=0x7f91701e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9170151020 0x7f91701e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 -- 172.21.15.146:0/4182303264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9170152b00 con 0x7f9158004800 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.465+0000 7f9175800640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f916400d860 tx=0x7f916400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.466+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164019070 con 0x7f9158004800 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.466+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91640074e0 con 0x7f9158004800 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.466+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164004a00 con 0x7f9158004800 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.466+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9170151520 con 0x7f9158004800 2024-04-24T23:01:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.466+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9170151ae0 con 0x7f9158004800 2024-04-24T23:01:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.467+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917004f500 con 0x7f9158004800 2024-04-24T23:01:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.468+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9164004ba0 con 0x7f9158004800 2024-04-24T23:01:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.469+0000 7f916d600640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.469+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f916408ada0 con 0x7f9158004800 2024-04-24T23:01:18.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.469+0000 7f9174e00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.470+0000 7f9174e00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 0x7f915006e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f915c035000 tx=0x7f915c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.473+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f91640593e0 con 0x7f9158004800 2024-04-24T23:01:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.670+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91700cf030 con 0x7f9158004800 2024-04-24T23:01:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.671+0000 7f916d600640 1 -- 172.21.15.146:0/4182303264 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f9164058ce0 con 0x7f9158004800 2024-04-24T23:01:18.672 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.673+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 msgr2=0x7f915006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.673+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 0x7f915006e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f915c035000 tx=0x7f915c02c000 comp rx=0 tx=0).stop 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 msgr2=0x7f91701525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f916400d860 tx=0x7f916400dd20 comp rx=0 tx=0).stop 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 shutdown_connections 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91701e73b0 0x7f9170140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9170151020 0x7f91701e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 --2- 172.21.15.146:0/4182303264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9158004800 0x7f91701525c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 >> 172.21.15.146:0/4182303264 conn(0x7f917006b560 msgr2=0x7f917015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 shutdown_connections 2024-04-24T23:01:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.674+0000 7f9176c00640 1 -- 172.21.15.146:0/4182303264 wait complete. 2024-04-24T23:01:18.695 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:01:18.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.901+0000 7f431d000640 1 Processor -- start 2024-04-24T23:01:18.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.901+0000 7f431d000640 1 -- start start 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f431d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f431d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43180b4380 0x7f431806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f431d000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43180cf6f0 con 0x7f4318161f00 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f431d000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f431806dc80 con 0x7f43180b4380 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f431d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4318161c60 con 0x7f4318161880 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f4316800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4318161f00 0x7f4318162390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45460/0 (socket says 172.21.15.146:45460) 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f4316800640 1 -- 172.21.15.146:0/632802574 learned_addr learned my addr 172.21.15.146:0/632802574 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.902+0000 7f430d400640 1 --2- 172.21.15.146:0/632802574 >> v2:172.21.15.146:3300/0 conn(0x7f43180b4380 0x7f431806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f4315e00640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f430d400640 1 -- 172.21.15.146:0/632802574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 msgr2=0x7f43180b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:18.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f430d400640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f430d400640 1 -- 172.21.15.146:0/632802574 >> v1:172.21.15.146:6789/0 conn(0x7f4318161f00 legacy=0x7f4318162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f430d400640 1 -- 172.21.15.146:0/632802574 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4318162bd0 con 0x7f43180b4380 2024-04-24T23:01:18.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.903+0000 7f4315e00640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.904+0000 7f430d400640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43180b4380 0x7f431806d740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f43000097a0 tx=0x7f430002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98879dd5fcfa89dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.904+0000 7f4315400640 1 -- 172.21.15.146:0/632802574 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300037070 con 0x7f43180b4380 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.904+0000 7f4315400640 1 -- 172.21.15.146:0/632802574 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430002adb0 con 0x7f43180b4380 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.904+0000 7f4315400640 1 -- 172.21.15.146:0/632802574 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300032660 con 0x7f43180b4380 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 -- 172.21.15.146:0/632802574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43180b4380 msgr2=0x7f431806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43180b4380 0x7f431806d740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f43000097a0 tx=0x7f430002a060 comp rx=0 tx=0).stop 2024-04-24T23:01:18.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 -- 172.21.15.146:0/632802574 shutdown_connections 2024-04-24T23:01:18.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43180b4380 0x7f431806d740 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 --2- 172.21.15.146:0/632802574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 -- 172.21.15.146:0/632802574 >> 172.21.15.146:0/632802574 conn(0x7f43180b3860 msgr2=0x7f43180b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:18.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 -- 172.21.15.146:0/632802574 shutdown_connections 2024-04-24T23:01:18.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.905+0000 7f431d000640 1 -- 172.21.15.146:0/632802574 wait complete. 2024-04-24T23:01:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.907+0000 7f431d000640 1 Processor -- start 2024-04-24T23:01:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.907+0000 7f431d000640 1 -- start start 2024-04-24T23:01:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43180b4380 0x7f431814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43180cc360 con 0x7f4318161f00 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43180b33d0 con 0x7f43180b4380 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f431d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43180cc4e0 con 0x7f4318161880 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f4316800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f4316800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54384/0 (socket says 172.21.15.146:54384) 2024-04-24T23:01:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.908+0000 7f4316800640 1 -- 172.21.15.146:0/2651373176 learned_addr learned my addr 172.21.15.146:0/2651373176 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4315e00640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43180b4380 0x7f431814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f430d400640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 -- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 msgr2=0x7f43180cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 -- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43180b4380 msgr2=0x7f431814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43180b4380 0x7f431814b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 -- 172.21.15.146:0/2651373176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43181f49d0 con 0x7f4318161f00 2024-04-24T23:01:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f4316800640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f431000ca20 tx=0x7f431000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310017070 con 0x7f4318161f00 2024-04-24T23:01:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431000ab70 con 0x7f4318161f00 2024-04-24T23:01:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310012400 con 0x7f4318161f00 2024-04-24T23:01:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43181f4cb0 con 0x7f4318161f00 2024-04-24T23:01:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.909+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43181f5270 con 0x7f4318161f00 2024-04-24T23:01:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.911+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43180b7c90 con 0x7f4318161f00 2024-04-24T23:01:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.911+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f431001a070 con 0x7f4318161f00 2024-04-24T23:01:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.912+0000 7f430ea00640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.912+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f431008af50 con 0x7f4318161f00 2024-04-24T23:01:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.913+0000 7f4315e00640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.914+0000 7f4315e00640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 0x7f42f406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f431814c6d0 tx=0x7f4308008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:18.917+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43100594f0 con 0x7f4318161f00 2024-04-24T23:01:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.114+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f43180d09e0 con 0x7f4318161f00 2024-04-24T23:01:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.115+0000 7f430ea00640 1 -- 172.21.15.146:0/2651373176 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f4310058df0 con 0x7f4318161f00 2024-04-24T23:01:19.116 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 msgr2=0x7f42f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 0x7f42f406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f431814c6d0 tx=0x7f4308008040 comp rx=0 tx=0).stop 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 msgr2=0x7f43180c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f431000ca20 tx=0x7f431000cee0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 shutdown_connections 2024-04-24T23:01:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4318161f00 0x7f43180c9010 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f42f406be30 0x7f42f406e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4318161880 0x7f43180cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 --2- 172.21.15.146:0/2651373176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43180b4380 0x7f431814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 >> 172.21.15.146:0/2651373176 conn(0x7f43180b3860 msgr2=0x7f431806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.118+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 shutdown_connections 2024-04-24T23:01:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.119+0000 7f431d000640 1 -- 172.21.15.146:0/2651373176 wait complete. 2024-04-24T23:01:19.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.331+0000 7f4cb9e00640 1 Processor -- start 2024-04-24T23:01:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.331+0000 7f4cb9e00640 1 -- start start 2024-04-24T23:01:19.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb9e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4cb4145640 0x7f4cb415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb9e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb40b2a20 0x7f4cb40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb9e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb40cdf70 con 0x7f4cb406cbc0 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb9e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb415d360 con 0x7f4cb40b2a20 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb9e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb4145a20 con 0x7f4cb4145640 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb2000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb40b2a20 0x7f4cb40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb2000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb40b2a20 0x7f4cb40cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54386/0 (socket says 172.21.15.146:54386) 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb2000640 1 -- 172.21.15.146:0/3861134333 learned_addr learned my addr 172.21.15.146:0/3861134333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.333+0000 7f4cb2a00640 1 --2- 172.21.15.146:0/3861134333 >> v2:172.21.15.203:3300/0 conn(0x7f4cb4145640 0x7f4cb415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.334+0000 7f4cb2000640 1 -- 172.21.15.146:0/3861134333 >> v2:172.21.15.203:3300/0 conn(0x7f4cb4145640 msgr2=0x7f4cb415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.334+0000 7f4cb2000640 1 --2- 172.21.15.146:0/3861134333 >> v2:172.21.15.203:3300/0 conn(0x7f4cb4145640 0x7f4cb415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.334+0000 7f4cb2000640 1 -- 172.21.15.146:0/3861134333 >> v1:172.21.15.203:6789/0 conn(0x7f4cb406cbc0 legacy=0x7f4cb415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:19.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.334+0000 7f4cb2000640 1 -- 172.21.15.146:0/3861134333 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb406d140 con 0x7f4cb40b2a20 2024-04-24T23:01:19.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.335+0000 7f4cb2000640 1 --2- 172.21.15.146:0/3861134333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb40b2a20 0x7f4cb40cfc90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4072f30 tx=0x7f4ca002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc8c2cbd7b819c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb1600640 1 -- 172.21.15.146:0/3861134333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0037070 con 0x7f4cb40b2a20 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb1600640 1 -- 172.21.15.146:0/3861134333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca0032440 con 0x7f4cb40b2a20 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb1600640 1 -- 172.21.15.146:0/3861134333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0032810 con 0x7f4cb40b2a20 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 -- 172.21.15.146:0/3861134333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb40b2a20 msgr2=0x7f4cb40cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/3861134333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb40b2a20 0x7f4cb40cfc90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4072f30 tx=0x7f4ca002a160 comp rx=0 tx=0).stop 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 -- 172.21.15.146:0/3861134333 shutdown_connections 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/3861134333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb40b2a20 0x7f4cb40cfc90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/3861134333 >> v2:172.21.15.203:3300/0 conn(0x7f4cb4145640 0x7f4cb415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.336+0000 7f4cb9e00640 1 -- 172.21.15.146:0/3861134333 >> 172.21.15.146:0/3861134333 conn(0x7f4cb406b320 msgr2=0x7f4cb406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.337+0000 7f4cb9e00640 1 -- 172.21.15.146:0/3861134333 shutdown_connections 2024-04-24T23:01:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.337+0000 7f4cb9e00640 1 -- 172.21.15.146:0/3861134333 wait complete. 2024-04-24T23:01:19.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.338+0000 7f4cb9e00640 1 Processor -- start 2024-04-24T23:01:19.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.338+0000 7f4cb9e00640 1 -- start start 2024-04-24T23:01:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.339+0000 7f4cb9e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb406cbc0 0x7f4cb413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.339+0000 7f4cb9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 0x7f4cb4138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.339+0000 7f4cb9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb9e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb406d9e0 con 0x7f4cb4145640 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb9e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb406d700 con 0x7f4cb40b2a20 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb9e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb40d01d0 con 0x7f4cb406cbc0 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54400/0 (socket says 172.21.15.146:54400) 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 -- 172.21.15.146:0/410465268 learned_addr learned my addr 172.21.15.146:0/410465268 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb2a00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb406cbc0 0x7f4cb413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb2000640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 0x7f4cb4138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 -- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb406cbc0 msgr2=0x7f4cb413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb406cbc0 0x7f4cb413eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 -- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 msgr2=0x7f4cb4138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 0x7f4cb4138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb3400640 1 -- 172.21.15.146:0/410465268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb41389b0 con 0x7f4cb4145640 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.340+0000 7f4cb2000640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 0x7f4cb4138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cb3400640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c440 tx=0x7f4cac00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac011790 con 0x7f4cb4145640 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac017070 con 0x7f4cb4145640 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac011b70 con 0x7f4cb4145640 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb4143050 con 0x7f4cb4145640 2024-04-24T23:01:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.341+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb4143610 con 0x7f4cb4145640 2024-04-24T23:01:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.342+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb4068190 con 0x7f4cb4145640 2024-04-24T23:01:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.343+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cac011d10 con 0x7f4cb4145640 2024-04-24T23:01:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.344+0000 7f4cab400640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 0x7f4c9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.344+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4cac08af90 con 0x7f4cb4145640 2024-04-24T23:01:19.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.345+0000 7f4cb2a00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 0x7f4c9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.346+0000 7f4cb2a00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 0x7f4c9406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009f60 tx=0x7f4ca400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.348+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4cb41389b0 con 0x7f4cb4145640 2024-04-24T23:01:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.586+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cb4150340 con 0x7f4cb4145640 2024-04-24T23:01:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.588+0000 7f4cab400640 1 -- 172.21.15.146:0/410465268 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f4cac059660 con 0x7f4cb4145640 2024-04-24T23:01:19.589 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:19.589 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:01:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 msgr2=0x7f4c9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 0x7f4c9406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009f60 tx=0x7f4ca400b040 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 msgr2=0x7f4cb414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c440 tx=0x7f4cac00c900 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 shutdown_connections 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb4145640 0x7f4cb414fe00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb40b2a20 0x7f4cb4138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4c9406be30 0x7f4c9406e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 --2- 172.21.15.146:0/410465268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb406cbc0 0x7f4cb413eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 >> 172.21.15.146:0/410465268 conn(0x7f4cb406b320 msgr2=0x7f4cb40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:19.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 shutdown_connections 2024-04-24T23:01:19.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.591+0000 7f4cb9e00640 1 -- 172.21.15.146:0/410465268 wait complete. 2024-04-24T23:01:19.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:19.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.804+0000 7fbb79e00640 1 Processor -- start 2024-04-24T23:01:19.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.804+0000 7fbb79e00640 1 -- start start 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 0x7fbb740b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb740b2cb0 0x7fbb740d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbb740d00f0 con 0x7fbb740b2cb0 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbb740cfe10 con 0x7fbb74161820 2024-04-24T23:01:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.805+0000 7fbb79e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740d2680 con 0x7fbb740d09f0 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb740b2cb0 0x7fbb740d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb740b2cb0 0x7fbb740d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54406/0 (socket says 172.21.15.146:54406) 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 -- 172.21.15.146:0/1299368401 learned_addr learned my addr 172.21.15.146:0/1299368401 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb78a00640 1 --2- 172.21.15.146:0/1299368401 >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 0x7fbb740b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 -- 172.21.15.146:0/1299368401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 msgr2=0x7fbb740cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb79400640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 -- 172.21.15.146:0/1299368401 >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 msgr2=0x7fbb740b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 --2- 172.21.15.146:0/1299368401 >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 0x7fbb740b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb73e00640 1 -- 172.21.15.146:0/1299368401 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb740d2960 con 0x7fbb740b2cb0 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb78a00640 1 --2- 172.21.15.146:0/1299368401 >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 0x7fbb740b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.806+0000 7fbb79400640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.807+0000 7fbb73e00640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb740b2cb0 0x7fbb740d04b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb7408ccd0 tx=0x7fbb6402a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778240c1b2cbc0e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.807+0000 7fbb73400640 1 -- 172.21.15.146:0/1299368401 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64036070 con 0x7fbb740b2cb0 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb73400640 1 -- 172.21.15.146:0/1299368401 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64031600 con 0x7fbb740b2cb0 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb73400640 1 -- 172.21.15.146:0/1299368401 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb640319d0 con 0x7fbb740b2cb0 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 -- 172.21.15.146:0/1299368401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb740b2cb0 msgr2=0x7fbb740d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb740b2cb0 0x7fbb740d04b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb7408ccd0 tx=0x7fbb6402a690 comp rx=0 tx=0).stop 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 -- 172.21.15.146:0/1299368401 shutdown_connections 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb740b2cb0 0x7fbb740d04b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 --2- 172.21.15.146:0/1299368401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 --2- 172.21.15.146:0/1299368401 >> v2:172.21.15.203:3300/0 conn(0x7fbb74161820 0x7fbb740b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 -- 172.21.15.146:0/1299368401 >> 172.21.15.146:0/1299368401 conn(0x7fbb7409cfa0 msgr2=0x7fbb740d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 -- 172.21.15.146:0/1299368401 shutdown_connections 2024-04-24T23:01:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.808+0000 7fbb79e00640 1 -- 172.21.15.146:0/1299368401 wait complete. 2024-04-24T23:01:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.810+0000 7fbb79e00640 1 Processor -- start 2024-04-24T23:01:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.810+0000 7fbb79e00640 1 -- start start 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb740b2cb0 0x7fbb741530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740cf0e0 con 0x7fbb74161820 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740cef60 con 0x7fbb740b2cb0 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.811+0000 7fbb79e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740cf260 con 0x7fbb740d09f0 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54410/0 (socket says 172.21.15.146:54410) 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 -- 172.21.15.146:0/3670426716 learned_addr learned my addr 172.21.15.146:0/3670426716 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb73e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb78a00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb740b2cb0 0x7fbb741530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 -- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 msgr2=0x7fbb740b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 -- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb740b2cb0 msgr2=0x7fbb741530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb740b2cb0 0x7fbb741530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 -- 172.21.15.146:0/3670426716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb740b8310 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.812+0000 7fbb79400640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00c7f0 tx=0x7fbb6c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.813+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c015070 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.813+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6c007820 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.813+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c007c10 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.813+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb740b7550 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.813+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb740b7b10 con 0x7fbb74161820 2024-04-24T23:01:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.814+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7404f500 con 0x7fbb74161820 2024-04-24T23:01:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.815+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb6c018070 con 0x7fbb74161820 2024-04-24T23:01:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.816+0000 7fbb70c00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 0x7fbb5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.816+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbb6c08b260 con 0x7fbb74161820 2024-04-24T23:01:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.817+0000 7fbb78a00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 0x7fbb5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.818+0000 7fbb78a00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 0x7fbb5006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00b840 tx=0x7fbb5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:19.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:19.821+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbb6c0599f0 con 0x7fbb74161820 2024-04-24T23:01:20.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.023+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb740b45d0 con 0x7fbb74161820 2024-04-24T23:01:20.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.025+0000 7fbb70c00640 1 -- 172.21.15.146:0/3670426716 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fbb6c0592f0 con 0x7fbb74161820 2024-04-24T23:01:20.026 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:20.027 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.027+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 msgr2=0x7fbb5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.027+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 0x7fbb5006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00b840 tx=0x7fbb5c008040 comp rx=0 tx=0).stop 2024-04-24T23:01:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.027+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 msgr2=0x7fbb740b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.027+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00c7f0 tx=0x7fbb6c00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 shutdown_connections 2024-04-24T23:01:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb74161820 0x7fbb740b9140 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbb5006be30 0x7fbb5006e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbb740d09f0 0x7fbb740b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 --2- 172.21.15.146:0/3670426716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb740b2cb0 0x7fbb741530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 >> 172.21.15.146:0/3670426716 conn(0x7fbb7409cfa0 msgr2=0x7fbb741609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 shutdown_connections 2024-04-24T23:01:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.028+0000 7fbb79e00640 1 -- 172.21.15.146:0/3670426716 wait complete. 2024-04-24T23:01:20.047 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:01:20.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.248+0000 7f0022e00640 1 Processor -- start 2024-04-24T23:01:20.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.249+0000 7f0022e00640 1 -- start start 2024-04-24T23:01:20.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f001c15ddd0 0x7f001c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f001c072920 0x7f001c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c0d0070 0x7f001c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f001c0d04d0 con 0x7f001c15ddd0 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f001c15e1b0 con 0x7f001c072920 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.250+0000 7f0022e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0713b0 con 0x7f001c0d0070 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f001c15ddd0 0x7f001c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f001c15ddd0 0x7f001c070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54424/0 (socket says 172.21.15.146:54424) 2024-04-24T23:01:20.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 -- 172.21.15.146:0/664563324 learned_addr learned my addr 172.21.15.146:0/664563324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021000640 1 --2- 172.21.15.146:0/664563324 >> v2:172.21.15.203:3300/0 conn(0x7f001c072920 0x7f001c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0022400640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c0d0070 0x7f001c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 -- 172.21.15.146:0/664563324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c0d0070 msgr2=0x7f001c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c0d0070 0x7f001c0ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 -- 172.21.15.146:0/664563324 >> v2:172.21.15.203:3300/0 conn(0x7f001c072920 msgr2=0x7f001c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 --2- 172.21.15.146:0/664563324 >> v2:172.21.15.203:3300/0 conn(0x7f001c072920 0x7f001c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.251+0000 7f0021a00640 1 -- 172.21.15.146:0/664563324 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c071690 con 0x7f001c15ddd0 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.252+0000 7f0021a00640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c15ddd0 0x7f001c070b60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f001c074fb0 tx=0x7f001002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4646d7db90f106a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.252+0000 7f001be00640 1 -- 172.21.15.146:0/664563324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010037070 con 0x7f001c15ddd0 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f001be00640 1 -- 172.21.15.146:0/664563324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010032440 con 0x7f001c15ddd0 2024-04-24T23:01:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f001be00640 1 -- 172.21.15.146:0/664563324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010032810 con 0x7f001c15ddd0 2024-04-24T23:01:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 -- 172.21.15.146:0/664563324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c15ddd0 msgr2=0x7f001c070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c15ddd0 0x7f001c070b60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f001c074fb0 tx=0x7f001002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 -- 172.21.15.146:0/664563324 shutdown_connections 2024-04-24T23:01:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c0d0070 0x7f001c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 --2- 172.21.15.146:0/664563324 >> v2:172.21.15.203:3300/0 conn(0x7f001c072920 0x7f001c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 --2- 172.21.15.146:0/664563324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c15ddd0 0x7f001c070b60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 -- 172.21.15.146:0/664563324 >> 172.21.15.146:0/664563324 conn(0x7f001c06b320 msgr2=0x7f001c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 -- 172.21.15.146:0/664563324 shutdown_connections 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.253+0000 7f0022e00640 1 -- 172.21.15.146:0/664563324 wait complete. 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.255+0000 7f0022e00640 1 Processor -- start 2024-04-24T23:01:20.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.255+0000 7f0022e00640 1 -- start start 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c0d0070 0x7f001c14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c15ddd0 0x7f001c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0710a0 con 0x7f001c072920 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f001c071c50 con 0x7f001c0d0070 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0022e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0ade00 con 0x7f001c15ddd0 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0021a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0021a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54428/0 (socket says 172.21.15.146:54428) 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.256+0000 7f0021a00640 1 -- 172.21.15.146:0/3853481032 learned_addr learned my addr 172.21.15.146:0/3853481032 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 -- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c15ddd0 msgr2=0x7f001c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c15ddd0 0x7f001c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 -- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c0d0070 msgr2=0x7f001c14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c0d0070 0x7f001c14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 -- 172.21.15.146:0/3853481032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c149c80 con 0x7f001c072920 2024-04-24T23:01:20.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0021a00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f001002a220 tx=0x7f00100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010037040 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010042070 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010030bb0 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.257+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c14dd00 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.258+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c14e2c0 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.258+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c04f500 con 0x7f001c072920 2024-04-24T23:01:20.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.259+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0010047460 con 0x7f001c072920 2024-04-24T23:01:20.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.260+0000 7f0019600640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 0x7efffc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.260+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f00100abdd0 con 0x7f001c072920 2024-04-24T23:01:20.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.261+0000 7f0021000640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 0x7efffc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.262+0000 7f0021000640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 0x7efffc06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0008006fd0 tx=0x7f0008008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.265+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f001c149c80 con 0x7f001c072920 2024-04-24T23:01:20.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.500+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f001c073c00 con 0x7f001c072920 2024-04-24T23:01:20.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.501+0000 7f0019600640 1 -- 172.21.15.146:0/3853481032 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f0010045360 con 0x7f001c072920 2024-04-24T23:01:20.503 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:20.503 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:01:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 msgr2=0x7efffc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 0x7efffc06e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0008006fd0 tx=0x7f0008008040 comp rx=0 tx=0).stop 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 msgr2=0x7f001c149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f001002a220 tx=0x7f00100046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 shutdown_connections 2024-04-24T23:01:20.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efffc06be60 0x7efffc06e320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f001c15ddd0 0x7f001c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f001c0d0070 0x7f001c14d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 --2- 172.21.15.146:0/3853481032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001c072920 0x7f001c149740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 >> 172.21.15.146:0/3853481032 conn(0x7f001c06b320 msgr2=0x7f001c06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 shutdown_connections 2024-04-24T23:01:20.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.504+0000 7f0022e00640 1 -- 172.21.15.146:0/3853481032 wait complete. 2024-04-24T23:01:20.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:20.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.725+0000 7f6237000640 1 Processor -- start 2024-04-24T23:01:20.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.725+0000 7f6237000640 1 -- start start 2024-04-24T23:01:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.726+0000 7f6237000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f623006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.726+0000 7f6237000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62300d0240 0x7f62300ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.726+0000 7f6237000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62300ccb10 con 0x7f6230071dd0 2024-04-24T23:01:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.726+0000 7f6237000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6230072230 con 0x7f62300d0240 2024-04-24T23:01:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.726+0000 7f6237000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f62300aede0 con 0x7f623015a980 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62300d0240 0x7f62300ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62300d0240 0x7f62300ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54444/0 (socket says 172.21.15.146:54444) 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 -- 172.21.15.146:0/2310603602 learned_addr learned my addr 172.21.15.146:0/2310603602 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6235c00640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f623006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 -- 172.21.15.146:0/2310603602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 msgr2=0x7f623006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f623006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 -- 172.21.15.146:0/2310603602 >> v1:172.21.15.203:6789/0 conn(0x7f6230071dd0 legacy=0x7f62300cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.727+0000 7f6236600640 1 -- 172.21.15.146:0/2310603602 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623006ddc0 con 0x7f62300d0240 2024-04-24T23:01:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.728+0000 7f6236600640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62300d0240 0x7f62300ccfd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6228009e50 tx=0x7f622802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df07ed7386f5e58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f622fe00640 1 -- 172.21.15.146:0/2310603602 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228036070 con 0x7f62300d0240 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f622fe00640 1 -- 172.21.15.146:0/2310603602 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6228031600 con 0x7f62300d0240 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f622fe00640 1 -- 172.21.15.146:0/2310603602 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62280319d0 con 0x7f62300d0240 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 -- 172.21.15.146:0/2310603602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62300d0240 msgr2=0x7f62300ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62300d0240 0x7f62300ccfd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6228009e50 tx=0x7f622802a630 comp rx=0 tx=0).stop 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 -- 172.21.15.146:0/2310603602 shutdown_connections 2024-04-24T23:01:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62300d0240 0x7f62300ccfd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 --2- 172.21.15.146:0/2310603602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f623006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 -- 172.21.15.146:0/2310603602 >> 172.21.15.146:0/2310603602 conn(0x7f623006b320 msgr2=0x7f623006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 -- 172.21.15.146:0/2310603602 shutdown_connections 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.729+0000 7f6237000640 1 -- 172.21.15.146:0/2310603602 wait complete. 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.731+0000 7f6237000640 1 Processor -- start 2024-04-24T23:01:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.731+0000 7f6237000640 1 -- start start 2024-04-24T23:01:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62300d0240 0x7f6230156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f6230156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f623006e660 con 0x7f6230071dd0 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f623006e380 con 0x7f62300d0240 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6237000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f623015ad60 con 0x7f623015a980 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6235c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6235c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54446/0 (socket says 172.21.15.146:54446) 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.732+0000 7f6235c00640 1 -- 172.21.15.146:0/1761225404 learned_addr learned my addr 172.21.15.146:0/1761225404 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6236600640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f6230156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 -- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 msgr2=0x7f6230156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235200640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62300d0240 0x7f6230156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f6230156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 -- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62300d0240 msgr2=0x7f6230156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62300d0240 0x7f6230156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 -- 172.21.15.146:0/1761225404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62301559f0 con 0x7f6230071dd0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.733+0000 7f6235c00640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f622400d620 tx=0x7f622400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.734+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240125f0 con 0x7f6230071dd0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.734+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224019070 con 0x7f6230071dd0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.734+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240129d0 con 0x7f6230071dd0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.734+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6230155cd0 con 0x7f6230071dd0 2024-04-24T23:01:20.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.734+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6230156290 con 0x7f6230071dd0 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.735+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623004f500 con 0x7f6230071dd0 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.736+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6224012b70 con 0x7f6230071dd0 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.737+0000 7f622d600640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 0x7f621006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.737+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f622408b620 con 0x7f6230071dd0 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.738+0000 7f6235200640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 0x7f621006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.739+0000 7f6235200640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 0x7f621006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f62301f4c10 tx=0x7f621c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:20.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.741+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6224059bc0 con 0x7f6230071dd0 2024-04-24T23:01:20.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.977+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6230073c00 con 0x7f6230071dd0 2024-04-24T23:01:20.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.978+0000 7f622d600640 1 -- 172.21.15.146:0/1761225404 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f62240594c0 con 0x7f6230071dd0 2024-04-24T23:01:20.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:20.979 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/281550318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":281550318},{"type":"v1","addr":"172.21.15.146:6834","nonce":281550318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/4089344708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":4089344708},{"type":"v1","addr":"172.21.15.203:6836","nonce":4089344708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1486486766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1486486766},{"type":"v1","addr":"172.21.15.146:6835","nonce":1486486766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T22:59:54.240496+0000","modified":"2024-04-24T23:00:22.744636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/554633282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":554633282},{"type":"v1","addr":"172.21.15.203:6837","nonce":554633282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-24T23:01:20.980 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 msgr2=0x7f621006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 0x7f621006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f62301f4c10 tx=0x7f621c009040 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 msgr2=0x7f62301550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f622400d620 tx=0x7f622400dae0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 shutdown_connections 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f621006be30 0x7f621006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f623015a980 0x7f6230156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62300d0240 0x7f6230156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 --2- 172.21.15.146:0/1761225404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6230071dd0 0x7f62301550f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:20.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 >> 172.21.15.146:0/1761225404 conn(0x7f623006b320 msgr2=0x7f62300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 shutdown_connections 2024-04-24T23:01:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:20.981+0000 7f6237000640 1 -- 172.21.15.146:0/1761225404 wait complete. 2024-04-24T23:01:21.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.203+0000 7fa49a400640 1 Processor -- start 2024-04-24T23:01:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.203+0000 7fa49a400640 1 -- start start 2024-04-24T23:01:21.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.204+0000 7fa49a400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4940d03a0 0x7fa494070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.204+0000 7fa49a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940728c0 0x7fa494071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.204+0000 7fa49a400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4941449c0 con 0x7fa4941445e0 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.204+0000 7fa49a400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa494072430 con 0x7fa4940d03a0 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.204+0000 7fa49a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa4940b2d70 con 0x7fa4940728c0 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa493400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa4941445e0 0x7fa4940cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45466/0 (socket says 172.21.15.146:45466) 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa493400640 1 -- 172.21.15.146:0/3245336039 learned_addr learned my addr 172.21.15.146:0/3245336039 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492a00640 1 --2- 172.21.15.146:0/3245336039 >> v2:172.21.15.146:3300/0 conn(0x7fa4940d03a0 0x7fa494070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa493e00640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940728c0 0x7fa494071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492000640 1 -- 172.21.15.146:0/3245336039 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761379216 0 0) 0x7fa4941449c0 con 0x7fa4941445e0 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492000640 1 -- 172.21.15.146:0/3245336039 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa474003520 con 0x7fa4941445e0 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492a00640 1 -- 172.21.15.146:0/3245336039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940728c0 msgr2=0x7fa494071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492a00640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940728c0 0x7fa494071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492a00640 1 -- 172.21.15.146:0/3245336039 >> v1:172.21.15.146:6789/0 conn(0x7fa4941445e0 legacy=0x7fa4940cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.205+0000 7fa492a00640 1 -- 172.21.15.146:0/3245336039 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa494071820 con 0x7fa4940d03a0 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.206+0000 7fa492a00640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4940d03a0 0x7fa494070c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009d90 tx=0x7fa47c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a070168bbbf901d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa492000640 1 -- 172.21.15.146:0/3245336039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007740 con 0x7fa4940d03a0 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa492000640 1 -- 172.21.15.146:0/3245336039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c0078e0 con 0x7fa4940d03a0 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa492000640 1 -- 172.21.15.146:0/3245336039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007cb0 con 0x7fa4940d03a0 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 -- 172.21.15.146:0/3245336039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4940d03a0 msgr2=0x7fa494070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4940d03a0 0x7fa494070c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009d90 tx=0x7fa47c02a660 comp rx=0 tx=0).stop 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 -- 172.21.15.146:0/3245336039 shutdown_connections 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940728c0 0x7fa494071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 --2- 172.21.15.146:0/3245336039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4940d03a0 0x7fa494070c10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.207+0000 7fa49a400640 1 -- 172.21.15.146:0/3245336039 >> 172.21.15.146:0/3245336039 conn(0x7fa49406b320 msgr2=0x7fa49406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.208+0000 7fa49a400640 1 -- 172.21.15.146:0/3245336039 shutdown_connections 2024-04-24T23:01:21.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.208+0000 7fa49a400640 1 -- 172.21.15.146:0/3245336039 wait complete. 2024-04-24T23:01:21.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.209+0000 7fa49a400640 1 Processor -- start 2024-04-24T23:01:21.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.209+0000 7fa49a400640 1 -- start start 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 0x7fa4941430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940d03a0 0x7fa4941f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4940720c0 con 0x7fa4941445e0 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa494071de0 con 0x7fa4940728c0 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.210+0000 7fa49a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa49406cbc0 con 0x7fa4940d03a0 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54476/0 (socket says 172.21.15.146:54476) 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 -- 172.21.15.146:0/961870975 learned_addr learned my addr 172.21.15.146:0/961870975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 0x7fa4941430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 -- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940d03a0 msgr2=0x7fa4941f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940d03a0 0x7fa4941f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 -- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 msgr2=0x7fa4941430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 0x7fa4941430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 -- 172.21.15.146:0/961870975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49415b260 con 0x7fa4941445e0 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 0x7fa4941430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.211+0000 7fa493e00640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d830 tx=0x7fa48c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.212+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00b6c0 con 0x7fa4941445e0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.212+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c019070 con 0x7fa4941445e0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.212+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00bac0 con 0x7fa4941445e0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.212+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49415b540 con 0x7fa4941445e0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.212+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49415bb00 con 0x7fa4941445e0 2024-04-24T23:01:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.213+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494068190 con 0x7fa4941445e0 2024-04-24T23:01:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.214+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa48c01e460 con 0x7fa4941445e0 2024-04-24T23:01:21.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.215+0000 7fa48b400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 0x7fa47006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.215+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa48c08b850 con 0x7fa4941445e0 2024-04-24T23:01:21.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.216+0000 7fa493400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 0x7fa47006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.217+0000 7fa493400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 0x7fa47006e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa484005880 tx=0x7fa484009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.219+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa48c059e80 con 0x7fa4941445e0 2024-04-24T23:01:21.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.418+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa49413f2e0 con 0x7fa4941445e0 2024-04-24T23:01:21.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.421+0000 7fa48b400640 1 -- 172.21.15.146:0/961870975 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18638 (secure 0 0 0) 0x7fa48c059780 con 0x7fa4941445e0 2024-04-24T23:01:21.422 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:21.423 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:00:37.377688+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T22:59:52.709031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T22:59:53.249539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T22:59:57.174462+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 msgr2=0x7fa47006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 0x7fa47006e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa484005880 tx=0x7fa484009040 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 msgr2=0x7fa49415c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d830 tx=0x7fa48c00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 shutdown_connections 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4941445e0 0x7fa49415c300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa47006be60 0x7fa47006e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa4940d03a0 0x7fa4941f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 --2- 172.21.15.146:0/961870975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4940728c0 0x7fa4941430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 >> 172.21.15.146:0/961870975 conn(0x7fa49406b320 msgr2=0x7fa49415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:21.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 shutdown_connections 2024-04-24T23:01:21.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.424+0000 7fa49a400640 1 -- 172.21.15.146:0/961870975 wait complete. 2024-04-24T23:01:21.445 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:01:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.650+0000 7f16f3200640 1 Processor -- start 2024-04-24T23:01:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.651+0000 7f16f3200640 1 -- start start 2024-04-24T23:01:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f16f40d08c0 0x7f16f4162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f41625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16f40b4f80 0x7f16f4162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f16f40d2af0 con 0x7f16f40b4f80 2024-04-24T23:01:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f16f40b5540 con 0x7f16f40d08c0 2024-04-24T23:01:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f16f40d2200 con 0x7f16f40d0ca0 2024-04-24T23:01:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.652+0000 7f16f2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16f40b4f80 0x7f16f4162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16f40b4f80 0x7f16f4162af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54482/0 (socket says 172.21.15.146:54482) 2024-04-24T23:01:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 -- 172.21.15.146:0/1358900150 learned_addr learned my addr 172.21.15.146:0/1358900150 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f1400640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f41625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f1e00640 1 --2- 172.21.15.146:0/1358900150 >> v2:172.21.15.203:3300/0 conn(0x7f16f40d08c0 0x7f16f4162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 -- 172.21.15.146:0/1358900150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 msgr2=0x7f16f41625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f41625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 -- 172.21.15.146:0/1358900150 >> v2:172.21.15.203:3300/0 conn(0x7f16f40d08c0 msgr2=0x7f16f4162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 --2- 172.21.15.146:0/1358900150 >> v2:172.21.15.203:3300/0 conn(0x7f16f40d08c0 0x7f16f4162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.653+0000 7f16f2800640 1 -- 172.21.15.146:0/1358900150 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f40d24a0 con 0x7f16f40b4f80 2024-04-24T23:01:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.654+0000 7f16f2800640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40b4f80 0x7f16f4162af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f16f406b8a0 tx=0x7f16ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b126082dab39e59 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f0a00640 1 -- 172.21.15.146:0/1358900150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec037070 con 0x7f16f40b4f80 2024-04-24T23:01:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f0a00640 1 -- 172.21.15.146:0/1358900150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec032440 con 0x7f16f40b4f80 2024-04-24T23:01:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f0a00640 1 -- 172.21.15.146:0/1358900150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec032810 con 0x7f16f40b4f80 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 -- 172.21.15.146:0/1358900150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40b4f80 msgr2=0x7f16f4162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40b4f80 0x7f16f4162af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f16f406b8a0 tx=0x7f16ec02a140 comp rx=0 tx=0).stop 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 -- 172.21.15.146:0/1358900150 shutdown_connections 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40b4f80 0x7f16f4162af0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 --2- 172.21.15.146:0/1358900150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f41625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 --2- 172.21.15.146:0/1358900150 >> v2:172.21.15.203:3300/0 conn(0x7f16f40d08c0 0x7f16f4162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 -- 172.21.15.146:0/1358900150 >> 172.21.15.146:0/1358900150 conn(0x7f16f409d010 msgr2=0x7f16f40d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 -- 172.21.15.146:0/1358900150 shutdown_connections 2024-04-24T23:01:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.655+0000 7f16f3200640 1 -- 172.21.15.146:0/1358900150 wait complete. 2024-04-24T23:01:21.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.657+0000 7f16f3200640 1 Processor -- start 2024-04-24T23:01:21.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.657+0000 7f16f3200640 1 -- start start 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16f40b4f80 0x7f16f4160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f40c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40b3760 con 0x7f16f40d08c0 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40b35e0 con 0x7f16f40b4f80 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f16f40b38e0 con 0x7f16f40d0ca0 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.658+0000 7f16f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54484/0 (socket says 172.21.15.146:54484) 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 -- 172.21.15.146:0/2920514281 learned_addr learned my addr 172.21.15.146:0/2920514281 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:21.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f2800640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f40c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1e00640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16f40b4f80 0x7f16f4160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 -- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 msgr2=0x7f16f40c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f40c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 -- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16f40b4f80 msgr2=0x7f16f4160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16f40b4f80 0x7f16f4160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 -- 172.21.15.146:0/2920514281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f414ee10 con 0x7f16f40d08c0 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f2800640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f40c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.659+0000 7f16f1400640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007e40 tx=0x7f16e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.660+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4014620 con 0x7f16f40d08c0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.660+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e4019070 con 0x7f16f40d08c0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.660+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f414f0f0 con 0x7f16f40d08c0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.660+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4014a00 con 0x7f16f40d08c0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.660+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f414f6b0 con 0x7f16f40d08c0 2024-04-24T23:01:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.661+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f404f500 con 0x7f16f40d08c0 2024-04-24T23:01:21.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.662+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16e4014ba0 con 0x7f16f40d08c0 2024-04-24T23:01:21.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.662+0000 7f16ea000640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 0x7f16d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:21.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.663+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f16e408b9d0 con 0x7f16f40d08c0 2024-04-24T23:01:21.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.663+0000 7f16f1e00640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 0x7f16d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.664+0000 7f16f1e00640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 0x7f16d006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006fd0 tx=0x7f16dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:21.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.668+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f16e405a0a0 con 0x7f16f40d08c0 2024-04-24T23:01:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.909+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f16f415d060 con 0x7f16f40d08c0 2024-04-24T23:01:21.911 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:01:21.910+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:01:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.915+0000 7f16ea000640 1 -- 172.21.15.146:0/2920514281 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f16e40599a0 con 0x7f16f40d08c0 2024-04-24T23:01:21.916 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.917+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 msgr2=0x7f16d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.917+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 0x7f16d006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006fd0 tx=0x7f16dc008040 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.917+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 msgr2=0x7f16f415e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.917+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007e40 tx=0x7f16e400e4b0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 shutdown_connections 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16d006be30 0x7f16d006e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16f40d0ca0 0x7f16f40c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16f40d08c0 0x7f16f415e0f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 --2- 172.21.15.146:0/2920514281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16f40b4f80 0x7f16f4160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 >> 172.21.15.146:0/2920514281 conn(0x7f16f409d010 msgr2=0x7f16f40b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 shutdown_connections 2024-04-24T23:01:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:21.918+0000 7f16f3200640 1 -- 172.21.15.146:0/2920514281 wait complete. 2024-04-24T23:01:21.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:01:21.958 INFO:tasks.ceph.mds.b.smithi203.stderr: -6785> 2024-04-24T22:59:55.744+0000 7f43ea200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:01:22.047 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:01:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.128+0000 7f16f2a00640 1 Processor -- start 2024-04-24T23:01:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.128+0000 7f16f2a00640 1 -- start start 2024-04-24T23:01:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f2a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16ec15ba40 0x7f16ec0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f2a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ec15c340 con 0x7f16ec0d01f0 2024-04-24T23:01:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f2a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ec15c5e0 con 0x7f16ec15be20 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f2a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f16ec0ce1c0 con 0x7f16ec15ba40 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f1600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16ec15ba40 0x7f16ec0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f1600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16ec15ba40 0x7f16ec0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54492/0 (socket says 172.21.15.146:54492) 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.130+0000 7f16f1600640 1 -- 172.21.15.146:0/292648338 learned_addr learned my addr 172.21.15.146:0/292648338 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.131+0000 7f16f1600640 1 -- 172.21.15.146:0/292648338 >> v1:172.21.15.203:6789/0 conn(0x7f16ec15be20 legacy=0x7f16ec0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.131+0000 7f16f1600640 1 -- 172.21.15.146:0/292648338 >> v1:172.21.15.146:6789/0 conn(0x7f16ec0d01f0 legacy=0x7f16ec15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.131+0000 7f16f1600640 1 -- 172.21.15.146:0/292648338 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec15c8c0 con 0x7f16ec15ba40 2024-04-24T23:01:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.132+0000 7f16f1600640 1 --2- 172.21.15.146:0/292648338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec0cdc80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009870 tx=0x7f16d802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a970ed5fc4eb99 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.132+0000 7f16ebe00640 1 -- 172.21.15.146:0/292648338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8037070 con 0x7f16ec15ba40 2024-04-24T23:01:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.132+0000 7f16ebe00640 1 -- 172.21.15.146:0/292648338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8032440 con 0x7f16ec15ba40 2024-04-24T23:01:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.132+0000 7f16ebe00640 1 -- 172.21.15.146:0/292648338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8032810 con 0x7f16ec15ba40 2024-04-24T23:01:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 -- 172.21.15.146:0/292648338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 msgr2=0x7f16ec0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 --2- 172.21.15.146:0/292648338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec0cdc80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009870 tx=0x7f16d802a2a0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 -- 172.21.15.146:0/292648338 shutdown_connections 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 --2- 172.21.15.146:0/292648338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec0cdc80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 -- 172.21.15.146:0/292648338 >> 172.21.15.146:0/292648338 conn(0x7f16ec06b350 msgr2=0x7f16ec06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 -- 172.21.15.146:0/292648338 shutdown_connections 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.133+0000 7f16f2a00640 1 -- 172.21.15.146:0/292648338 wait complete. 2024-04-24T23:01:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.135+0000 7f16f2a00640 1 Processor -- start 2024-04-24T23:01:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.135+0000 7f16f2a00640 1 -- start start 2024-04-24T23:01:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec0d01f0 0x7f16ec143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16ec15be20 0x7f16ec1e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec06e120 con 0x7f16ec15ba40 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec15cf10 con 0x7f16ec0d01f0 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f16ec06e590 con 0x7f16ec15be20 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54498/0 (socket says 172.21.15.146:54498) 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 -- 172.21.15.146:0/1082306571 learned_addr learned my addr 172.21.15.146:0/1082306571 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f1600640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec0d01f0 0x7f16ec143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f2000640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16ec15be20 0x7f16ec1e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 -- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16ec15be20 msgr2=0x7f16ec1e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16ec15be20 0x7f16ec1e5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 -- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec0d01f0 msgr2=0x7f16ec143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec0d01f0 0x7f16ec143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.136+0000 7f16f0c00640 1 -- 172.21.15.146:0/1082306571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec1e5fe0 con 0x7f16ec15ba40 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16f0c00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b3f0 tx=0x7f16e000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0015020 con 0x7f16ec15ba40 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e0011830 con 0x7f16ec15ba40 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0011c20 con 0x7f16ec15ba40 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec1e62c0 con 0x7f16ec15ba40 2024-04-24T23:01:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.137+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec1e6880 con 0x7f16ec15ba40 2024-04-24T23:01:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.138+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ec04f500 con 0x7f16ec15ba40 2024-04-24T23:01:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.139+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16e0018020 con 0x7f16ec15ba40 2024-04-24T23:01:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.140+0000 7f16e9600640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 0x7f16cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.141+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7f16e008afe0 con 0x7f16ec15ba40 2024-04-24T23:01:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.141+0000 7f16f1600640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 0x7f16cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.143+0000 7f16f1600640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 0x7f16cc06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d8034000 tx=0x7f16d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.145+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f16e001f030 con 0x7f16ec15ba40 2024-04-24T23:01:22.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.384+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f16ec15e3b0 con 0x7f16ec15ba40 2024-04-24T23:01:22.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.918+0000 7f16e9600640 1 -- 172.21.15.146:0/1082306571 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f16e00172c0 con 0x7f16ec15ba40 2024-04-24T23:01:22.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.922+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 msgr2=0x7f16cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.922+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 0x7f16cc06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d8034000 tx=0x7f16d802e000 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.922+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 msgr2=0x7f16ec146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.922+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b3f0 tx=0x7f16e000b8b0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 shutdown_connections 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f16cc06be30 0x7f16cc06e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16ec15be20 0x7f16ec1e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec15ba40 0x7f16ec146f80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 --2- 172.21.15.146:0/1082306571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec0d01f0 0x7f16ec143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:22.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 >> 172.21.15.146:0/1082306571 conn(0x7f16ec06b350 msgr2=0x7f16ec070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 shutdown_connections 2024-04-24T23:01:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:22.923+0000 7f16f2a00640 1 -- 172.21.15.146:0/1082306571 wait complete. 2024-04-24T23:01:22.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:01:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.159+0000 7fde8be00640 1 Processor -- start 2024-04-24T23:01:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.159+0000 7fde8be00640 1 -- start start 2024-04-24T23:01:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde8be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fde840d2320 0x7fde840cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde8be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde840cd340 con 0x7fde8415bf80 2024-04-24T23:01:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde8be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde840cd620 con 0x7fde840ccb30 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde8be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fde840c8d50 con 0x7fde840d2320 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde89400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fde8415bf80 0x7fde840d1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45482/0 (socket says 172.21.15.146:45482) 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.161+0000 7fde89400640 1 -- 172.21.15.146:0/3185176363 learned_addr learned my addr 172.21.15.146:0/3185176363 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde88a00640 1 --2- 172.21.15.146:0/3185176363 >> v2:172.21.15.203:3300/0 conn(0x7fde840d2320 0x7fde840cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446024398 0 0) 0x7fde840cd340 con 0x7fde8415bf80 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde68003520 con 0x7fde8415bf80 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554657039 0 0) 0x7fde68003520 con 0x7fde8415bf80 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 >> v2:172.21.15.203:3300/0 conn(0x7fde840d2320 msgr2=0x7fde840cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 --2- 172.21.15.146:0/3185176363 >> v2:172.21.15.203:3300/0 conn(0x7fde840d2320 0x7fde840cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 >> v1:172.21.15.203:6789/0 conn(0x7fde840ccb30 legacy=0x7fde840ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840cd900 con 0x7fde8415bf80 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fde74001670 con 0x7fde8415bf80 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 >> v1:172.21.15.146:6789/0 conn(0x7fde8415bf80 legacy=0x7fde840d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680039b0 0x7fde68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde68004800 0x7fde68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 0x7fde6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde6800c030 con 0x7fde680051c0 2024-04-24T23:01:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde6800c1e0 con 0x7fde680039b0 2024-04-24T23:01:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.162+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fde6800c3e0 con 0x7fde68004800 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 0x7fde6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89400640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680039b0 0x7fde68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde88a00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde68004800 0x7fde68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 -- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde68004800 msgr2=0x7fde68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde68004800 0x7fde68004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 -- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680039b0 msgr2=0x7fde68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680039b0 0x7fde68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.163+0000 7fde89e00640 1 -- 172.21.15.146:0/3185176363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde68003520 con 0x7fde680051c0 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.164+0000 7fde89e00640 1 -- 172.21.15.146:0/3185176363 reap_dead start 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde89e00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 0x7fde6800b9c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001750 tx=0x7fde68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86e54826526d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c001370 con 0x7fde680051c0 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c005310 con 0x7fde680051c0 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde83e00640 1 -- 172.21.15.146:0/3185176363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c02abe0 con 0x7fde680051c0 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde8be00640 1 -- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 msgr2=0x7fde6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde8be00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 0x7fde6800b9c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001750 tx=0x7fde68005830 comp rx=0 tx=0).stop 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde8be00640 1 -- 172.21.15.146:0/3185176363 shutdown_connections 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde8be00640 1 --2- 172.21.15.146:0/3185176363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde680051c0 0x7fde6800b9c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.165+0000 7fde8be00640 1 -- 172.21.15.146:0/3185176363 >> 172.21.15.146:0/3185176363 conn(0x7fde84073220 msgr2=0x7fde8409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.166+0000 7fde8be00640 1 -- 172.21.15.146:0/3185176363 shutdown_connections 2024-04-24T23:01:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.166+0000 7fde8be00640 1 -- 172.21.15.146:0/3185176363 wait complete. 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.167+0000 7fde8be00640 1 Processor -- start 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.167+0000 7fde8be00640 1 -- start start 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680051c0 0x7fde840b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde840b2910 0x7fde8415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde8415c360 con 0x7fde840b0a00 2024-04-24T23:01:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde840cdec0 con 0x7fde680051c0 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.168+0000 7fde8be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fde8415c4e0 con 0x7fde840b2910 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54506/0 (socket says 172.21.15.146:54506) 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 -- 172.21.15.146:0/2983815296 learned_addr learned my addr 172.21.15.146:0/2983815296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89400640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680051c0 0x7fde840b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde88a00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde840b2910 0x7fde8415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 -- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde840b2910 msgr2=0x7fde8415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde840b2910 0x7fde8415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 -- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680051c0 msgr2=0x7fde840b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680051c0 0x7fde840b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.169+0000 7fde89e00640 1 -- 172.21.15.146:0/2983815296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8415ad10 con 0x7fde840b0a00 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde89e00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001870 tx=0x7fde7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c001370 con 0x7fde840b0a00 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c02ae20 con 0x7fde840b0a00 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c007a30 con 0x7fde840b0a00 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde840b0ec0 con 0x7fde840b0a00 2024-04-24T23:01:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.170+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde840b1480 con 0x7fde840b0a00 2024-04-24T23:01:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.171+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde840688a0 con 0x7fde840b0a00 2024-04-24T23:01:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.172+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde7c007030 con 0x7fde840b0a00 2024-04-24T23:01:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.173+0000 7fde81600640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 0x7fde6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.173+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7fde7c0aa4b0 con 0x7fde840b0a00 2024-04-24T23:01:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.174+0000 7fde89400640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 0x7fde6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.175+0000 7fde89400640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 0x7fde6406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde74001050 tx=0x7fde74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:23.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.178+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde7c078a90 con 0x7fde840b0a00 2024-04-24T23:01:23.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.377+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde840cb480 con 0x7fde840b0a00 2024-04-24T23:01:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.931+0000 7fde81600640 1 -- 172.21.15.146:0/2983815296 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fde7c078390 con 0x7fde840b0a00 2024-04-24T23:01:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 msgr2=0x7fde6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 0x7fde6406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde74001050 tx=0x7fde74009040 comp rx=0 tx=0).stop 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 msgr2=0x7fde840b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fde7c001870 tx=0x7fde7c001120 comp rx=0 tx=0).stop 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 shutdown_connections 2024-04-24T23:01:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde840b0a00 0x7fde840b6590 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde6406be30 0x7fde6406e2f0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde74001050 tx=0x7fde74009040 comp rx=0 tx=0).stop 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde840b2910 0x7fde8415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 --2- 172.21.15.146:0/2983815296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde680051c0 0x7fde840b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.935+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 >> 172.21.15.146:0/2983815296 conn(0x7fde84073220 msgr2=0x7fde8406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.936+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 shutdown_connections 2024-04-24T23:01:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:23.937+0000 7fde8be00640 1 -- 172.21.15.146:0/2983815296 wait complete. 2024-04-24T23:01:23.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:01:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.149+0000 7f4180200640 1 Processor -- start 2024-04-24T23:01:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.149+0000 7f4180200640 1 -- start start 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f4180200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f417806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f4180200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41780cf040 con 0x7f417806d0c0 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f4180200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41780cf320 con 0x7f4178145510 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f4180200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4178070c70 con 0x7f41780ceaf0 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f417e200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f417806d0c0 0x7f417815f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45490/0 (socket says 172.21.15.146:45490) 2024-04-24T23:01:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.151+0000 7f417e200640 1 -- 172.21.15.146:0/3444241276 learned_addr learned my addr 172.21.15.146:0/3444241276 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f417ce00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f417806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376500733 0 0) 0x7f41780cf040 con 0x7f417806d0c0 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4160003520 con 0x7f417806d0c0 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1653102858 0 0) 0x7f4160003520 con 0x7f417806d0c0 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 msgr2=0x7f417806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f417806cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 >> v1:172.21.15.203:6789/0 conn(0x7f4178145510 legacy=0x7f41780728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178070f50 con 0x7f417806d0c0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f41700019f0 con 0x7f417806d0c0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 >> v1:172.21.15.146:6789/0 conn(0x7f417806d0c0 legacy=0x7f417815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41600039e0 0x7f4160003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4160004800 0x7f4160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f4160005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4178070c70 con 0x7f41600039e0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f416000bb20 con 0x7f4160004800 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.152+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f416000bd20 con 0x7f41780ceaf0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41600039e0 0x7f4160003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417ce00640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4160004800 0x7f4160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417e200640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f4160005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 -- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 msgr2=0x7f4160005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f4160005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 -- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4160004800 msgr2=0x7f4160004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4160004800 0x7f4160004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417d800640 1 -- 172.21.15.146:0/3444241276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4160003520 con 0x7f41600039e0 2024-04-24T23:01:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.153+0000 7f417e200640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41780ceaf0 0x7f4160005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.155+0000 7f417d800640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41600039e0 0x7f4160003e00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f416c001750 tx=0x7f4160005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7d0a92988f5ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.155+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c001370 con 0x7f41600039e0 2024-04-24T23:01:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.155+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c0052d0 con 0x7f41600039e0 2024-04-24T23:01:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.155+0000 7f4177e00640 1 -- 172.21.15.146:0/3444241276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c02abe0 con 0x7f41600039e0 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 -- 172.21.15.146:0/3444241276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41600039e0 msgr2=0x7f4160003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 --2- 172.21.15.146:0/3444241276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41600039e0 0x7f4160003e00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f416c001750 tx=0x7f4160005830 comp rx=0 tx=0).stop 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f417e200640 1 -- 172.21.15.146:0/3444241276 reap_dead start 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 -- 172.21.15.146:0/3444241276 shutdown_connections 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 -- 172.21.15.146:0/3444241276 >> 172.21.15.146:0/3444241276 conn(0x7f41780b16b0 msgr2=0x7f41780b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 -- 172.21.15.146:0/3444241276 shutdown_connections 2024-04-24T23:01:24.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.156+0000 7f4180200640 1 -- 172.21.15.146:0/3444241276 wait complete. 2024-04-24T23:01:24.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.157+0000 7f4180200640 1 Processor -- start 2024-04-24T23:01:24.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.158+0000 7f4180200640 1 -- start start 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 0x7f4178131ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 0x7f41781336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4178145a70 con 0x7f41780cc300 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41781458f0 con 0x7f4178131650 2024-04-24T23:01:24.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f4180200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4178160100 con 0x7f4178132010 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54520/0 (socket says 172.21.15.146:54520) 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 -- 172.21.15.146:0/100912569 learned_addr learned my addr 172.21.15.146:0/100912569 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417ce00640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 0x7f4178131ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417e200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 0x7f41781336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 -- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 msgr2=0x7f41781336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 0x7f41781336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 -- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 msgr2=0x7f4178131ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 0x7f4178131ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417d800640 1 -- 172.21.15.146:0/100912569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178132490 con 0x7f41780cc300 2024-04-24T23:01:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417e200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 0x7f41781336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.159+0000 7f417ce00640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 0x7f4178131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f417d800640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f416c02a590 tx=0x7f416c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c03f020 con 0x7f41780cc300 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c005480 con 0x7f41780cc300 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c001370 con 0x7f41780cc300 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4178134ce0 con 0x7f41780cc300 2024-04-24T23:01:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.160+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781352a0 con 0x7f41780cc300 2024-04-24T23:01:24.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.161+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4178068190 con 0x7f41780cc300 2024-04-24T23:01:24.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.162+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f416c042020 con 0x7f41780cc300 2024-04-24T23:01:24.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.163+0000 7f4175600640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:24.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.163+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6238+0+0 (secure 0 0 0) 0x7f416c0aae00 con 0x7f41780cc300 2024-04-24T23:01:24.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.164+0000 7f417ce00640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.165+0000 7f417ce00640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4178144c10 tx=0x7f4168008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.168+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f416c049020 con 0x7f41780cc300 2024-04-24T23:01:24.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.369+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f417806e9d0 con 0x7f41780cc300 2024-04-24T23:01:24.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.942+0000 7f4175600640 1 -- 172.21.15.146:0/100912569 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f416c079500 con 0x7f41780cc300 2024-04-24T23:01:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:01:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 msgr2=0x7f415c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4178144c10 tx=0x7f4168008040 comp rx=0 tx=0).stop 2024-04-24T23:01:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 msgr2=0x7f41781330e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f416c02a590 tx=0x7f416c001120 comp rx=0 tx=0).stop 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 shutdown_connections 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f415c06be30 0x7f415c06e2f0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4178144c10 tx=0x7f4168008040 comp rx=0 tx=0).stop 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4178132010 0x7f41781336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4178131650 0x7f4178131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 --2- 172.21.15.146:0/100912569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41780cc300 0x7f41781330e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.948+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 >> 172.21.15.146:0/100912569 conn(0x7f41780b16b0 msgr2=0x7f417815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.951+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 shutdown_connections 2024-04-24T23:01:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:24.952+0000 7f4180200640 1 -- 172.21.15.146:0/100912569 wait complete. 2024-04-24T23:01:24.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-24T23:01:25.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.180+0000 7f3b77800640 1 Processor -- start 2024-04-24T23:01:25.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.180+0000 7f3b77800640 1 -- start start 2024-04-24T23:01:25.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.181+0000 7f3b77800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b700cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.181+0000 7f3b77800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b700b3d60 con 0x7f3b700714f0 2024-04-24T23:01:25.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.181+0000 7f3b77800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b700b4040 con 0x7f3b7015add0 2024-04-24T23:01:25.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.181+0000 7f3b77800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700b4970 con 0x7f3b70072340 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3b700714f0 0x7f3b700ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45506/0 (socket says 172.21.15.146:45506) 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6fe00640 1 -- 172.21.15.146:0/121692187 learned_addr learned my addr 172.21.15.146:0/121692187 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b75800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b700cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203874366 0 0) 0x7f3b700b3d60 con 0x7f3b700714f0 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b58003520 con 0x7f3b700714f0 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3004438075 0 0) 0x7f3b58003520 con 0x7f3b700714f0 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 msgr2=0x7f3b700cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b700cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.182+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 >> v1:172.21.15.203:6789/0 conn(0x7f3b7015add0 legacy=0x7f3b70070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700b4320 con 0x7f3b700714f0 2024-04-24T23:01:25.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f3b5c001670 con 0x7f3b700714f0 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 >> v1:172.21.15.146:6789/0 conn(0x7f3b700714f0 legacy=0x7f3b700ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b580039e0 0x7f3b58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b58004d40 0x7f3b580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700b4970 con 0x7f3b58004d40 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800dc80 con 0x7f3b580039e0 2024-04-24T23:01:25.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5800de50 con 0x7f3b70072340 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b58004d40 0x7f3b580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6fe00640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b74e00640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b580039e0 0x7f3b58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 -- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 msgr2=0x7f3b58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 -- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b580039e0 msgr2=0x7f3b58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b580039e0 0x7f3b58003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b75800640 1 -- 172.21.15.146:0/121692187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b58003520 con 0x7f3b58004d40 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.183+0000 7f3b6fe00640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b70072340 0x7f3b58004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.184+0000 7f3b75800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b58004d40 0x7f3b580051c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e170 tx=0x7f3b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90be3e8d31029bc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68034020 con 0x7f3b58004d40 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b680305f0 con 0x7f3b58004d40 2024-04-24T23:01:25.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b6f400640 1 -- 172.21.15.146:0/121692187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68009c10 con 0x7f3b58004d40 2024-04-24T23:01:25.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 -- 172.21.15.146:0/121692187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b58004d40 msgr2=0x7f3b580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 --2- 172.21.15.146:0/121692187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b58004d40 0x7f3b580051c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e170 tx=0x7f3b58005830 comp rx=0 tx=0).stop 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b75800640 1 -- 172.21.15.146:0/121692187 reap_dead start 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 -- 172.21.15.146:0/121692187 shutdown_connections 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 -- 172.21.15.146:0/121692187 >> 172.21.15.146:0/121692187 conn(0x7f3b700b16b0 msgr2=0x7f3b700b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 -- 172.21.15.146:0/121692187 shutdown_connections 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.185+0000 7f3b77800640 1 -- 172.21.15.146:0/121692187 wait complete. 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.187+0000 7f3b77800640 1 Processor -- start 2024-04-24T23:01:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.187+0000 7f3b77800640 1 -- start start 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 0x7f3b7013f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b701558d0 0x7f3b70155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700b39c0 con 0x7f3b701e2b40 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7015b1b0 con 0x7f3b58004d40 2024-04-24T23:01:25.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b77800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700b3b40 con 0x7f3b701558d0 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.188+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54536/0 (socket says 172.21.15.146:54536) 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 -- 172.21.15.146:0/3030417078 learned_addr learned my addr 172.21.15.146:0/3030417078 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b75800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b701558d0 0x7f3b70155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b74e00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 0x7f3b7013f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 -- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b701558d0 msgr2=0x7f3b70155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b701558d0 0x7f3b70155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 -- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 msgr2=0x7f3b7013f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 0x7f3b7013f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 -- 172.21.15.146:0/3030417078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b70156630 con 0x7f3b701e2b40 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b74e00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 0x7f3b7013f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6fe00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00e840 tx=0x7f3b5c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.189+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00c870 con 0x7f3b701e2b40 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.190+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c018070 con 0x7f3b701e2b40 2024-04-24T23:01:25.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.190+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b701e03b0 con 0x7f3b701e2b40 2024-04-24T23:01:25.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.190+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00cc30 con 0x7f3b701e2b40 2024-04-24T23:01:25.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.190+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701e0970 con 0x7f3b701e2b40 2024-04-24T23:01:25.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.191+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b701e0b70 con 0x7f3b701e2b40 2024-04-24T23:01:25.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.192+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b5c013420 con 0x7f3b701e2b40 2024-04-24T23:01:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.193+0000 7f3b6cc00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 0x7f3b5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.193+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f3b5c08ab70 con 0x7f3b701e2b40 2024-04-24T23:01:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.194+0000 7f3b74e00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 0x7f3b5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.195+0000 7f3b74e00640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 0x7f3b5006e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b64001700 tx=0x7f3b64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.198+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b701e0b70 con 0x7f3b701e2b40 2024-04-24T23:01:25.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.391+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b70068190 con 0x7f3b701e2b40 2024-04-24T23:01:25.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.955+0000 7f3b6cc00640 1 -- 172.21.15.146:0/3030417078 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f3b5c0594c0 con 0x7f3b701e2b40 2024-04-24T23:01:25.957 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' removed 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 msgr2=0x7f3b5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 0x7f3b5006e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b64001700 tx=0x7f3b64009040 comp rx=0 tx=0).stop 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 msgr2=0x7f3b701e2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00e840 tx=0x7f3b5c00ed00 comp rx=0 tx=0).stop 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 shutdown_connections 2024-04-24T23:01:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b5006be60 0x7f3b5006e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b701558d0 0x7f3b70155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b701e2b40 0x7f3b701e2fc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 --2- 172.21.15.146:0/3030417078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b58004d40 0x7f3b7013f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 >> 172.21.15.146:0/3030417078 conn(0x7f3b700b16b0 msgr2=0x7f3b7006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.959+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 shutdown_connections 2024-04-24T23:01:25.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:25.960+0000 7f3b77800640 1 -- 172.21.15.146:0/3030417078 wait complete. 2024-04-24T23:01:25.988 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:01:25.988 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:01:25.988 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:01:25.988 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:01:25.989 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:01:25.989 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:01:25.989 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:01:25.989 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:01:25.989 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:01:25.989 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:01:25.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:01:25.990 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:01:25.990 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:01:25.990 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:01:25.990 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:01:25.990 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:01:26.008 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:01:26.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:01:26.011 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:01:26.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:01:26.013 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:01:26.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:01:26.014 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:01:26.014 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:01:26.058 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:01:26.059 DEBUG:teuthology.parallel:result is None 2024-04-24T23:01:26.062 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:01:26.062 DEBUG:teuthology.parallel:result is None 2024-04-24T23:01:26.064 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:01:26.065 DEBUG:teuthology.parallel:result is None 2024-04-24T23:01:26.068 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:01:26.068 DEBUG:teuthology.parallel:result is None 2024-04-24T23:01:26.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:01:26.202 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:01:26.203 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:01:26.212 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:01:26.212 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:01:26.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.241+0000 7f5cebe00640 1 Processor -- start 2024-04-24T23:01:26.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.241+0000 7f5cebe00640 1 -- start start 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5cebe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cec15e050 0x7f5cec0d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5cebe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 0x7f5cec0d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5cebe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec0d4a50 con 0x7f5cec0d1ac0 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5cebe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec0d4800 con 0x7f5cec15e050 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5cebe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec0b3190 con 0x7f5cec0d0d20 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5ceaa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cec15e050 0x7f5cec0d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5ceaa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cec15e050 0x7f5cec0d2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54568/0 (socket says 172.21.15.146:54568) 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.242+0000 7f5ceaa00640 1 -- 172.21.15.146:0/3908954311 learned_addr learned my addr 172.21.15.146:0/3908954311 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5cea000640 1 --2- 172.21.15.146:0/3908954311 >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 0x7f5cec0d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5ceaa00640 1 -- 172.21.15.146:0/3908954311 >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 msgr2=0x7f5cec0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5ceaa00640 1 --2- 172.21.15.146:0/3908954311 >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 0x7f5cec0d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5ceaa00640 1 -- 172.21.15.146:0/3908954311 >> v1:172.21.15.203:6789/0 conn(0x7f5cec0d1ac0 legacy=0x7f5cec0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5ceaa00640 1 -- 172.21.15.146:0/3908954311 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec0b33e0 con 0x7f5cec15e050 2024-04-24T23:01:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.243+0000 7f5cea000640 1 --2- 172.21.15.146:0/3908954311 >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 0x7f5cec0d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.244+0000 7f5ceaa00640 1 --2- 172.21.15.146:0/3908954311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0d2010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5cec161b90 tx=0x7f5cdc02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deba94ccdc175f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.244+0000 7f5ce9600640 1 -- 172.21.15.146:0/3908954311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc037070 con 0x7f5cec15e050 2024-04-24T23:01:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.244+0000 7f5ce9600640 1 -- 172.21.15.146:0/3908954311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc032440 con 0x7f5cec15e050 2024-04-24T23:01:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.244+0000 7f5ce9600640 1 -- 172.21.15.146:0/3908954311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc032810 con 0x7f5cec15e050 2024-04-24T23:01:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 -- 172.21.15.146:0/3908954311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 msgr2=0x7f5cec0d2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3908954311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0d2010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5cec161b90 tx=0x7f5cdc02a1f0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 -- 172.21.15.146:0/3908954311 shutdown_connections 2024-04-24T23:01:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3908954311 >> v2:172.21.15.203:3300/0 conn(0x7f5cec0d0d20 0x7f5cec0d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3908954311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0d2010 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 -- 172.21.15.146:0/3908954311 >> 172.21.15.146:0/3908954311 conn(0x7f5cec0d3ce0 msgr2=0x7f5cec0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:26.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 -- 172.21.15.146:0/3908954311 shutdown_connections 2024-04-24T23:01:26.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.245+0000 7f5cebe00640 1 -- 172.21.15.146:0/3908954311 wait complete. 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.246+0000 7f5cebe00640 1 Processor -- start 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.247+0000 7f5cebe00640 1 -- start start 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.247+0000 7f5cebe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5cec0d0d20 0x7f5cec0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.247+0000 7f5cebe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cec0d1ac0 0x7f5cec1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.247+0000 7f5cebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5cebe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec0cfa70 con 0x7f5cec15e050 2024-04-24T23:01:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5cebe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec0b3750 con 0x7f5cec0d1ac0 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5cebe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5cec0cfbf0 con 0x7f5cec0d0d20 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5cea000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cec0d1ac0 0x7f5cec1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54582/0 (socket says 172.21.15.146:54582) 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 -- 172.21.15.146:0/3358614053 learned_addr learned my addr 172.21.15.146:0/3358614053 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceaa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5cec0d0d20 0x7f5cec0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 -- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5cec0d0d20 msgr2=0x7f5cec0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5cec0d0d20 0x7f5cec0ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 -- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cec0d1ac0 msgr2=0x7f5cec1f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cec0d1ac0 0x7f5cec1f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 -- 172.21.15.146:0/3358614053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec0cdf20 con 0x7f5cec15e050 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.248+0000 7f5ceb400640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c7a0 tx=0x7f5ce400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.249+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4003b70 con 0x7f5cec15e050 2024-04-24T23:01:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.249+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce4003d30 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.249+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec0cd6e0 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.249+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400aa90 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.249+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec0b71b0 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.250+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec0b73b0 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.251+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ce400ac30 con 0x7f5cec15e050 2024-04-24T23:01:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.252+0000 7f5ce3400640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.252+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7f5ce408aba0 con 0x7f5cec15e050 2024-04-24T23:01:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.252+0000 7f5ceaa00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.253+0000 7f5ceaa00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc034000 tx=0x7f5cdc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.256+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cec0b73b0 con 0x7f5cec15e050 2024-04-24T23:01:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.469+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5cec0c7160 con 0x7f5cec15e050 2024-04-24T23:01:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.982+0000 7f5ce3400640 1 -- 172.21.15.146:0/3358614053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7f5cec0cd6e0 con 0x7f5cec15e050 2024-04-24T23:01:26.983 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 msgr2=0x7f5ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc034000 tx=0x7f5cdc02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 msgr2=0x7f5cec0cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c7a0 tx=0x7f5ce400cc60 comp rx=0 tx=0).stop 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 shutdown_connections 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cec15e050 0x7f5cec0cadb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cec0d1ac0 0x7f5cec1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ccc06be30 0x7f5ccc06e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 --2- 172.21.15.146:0/3358614053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5cec0d0d20 0x7f5cec0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 >> 172.21.15.146:0/3358614053 conn(0x7f5cec0d3ce0 msgr2=0x7f5cec0b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 shutdown_connections 2024-04-24T23:01:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:26.987+0000 7f5cebe00640 1 -- 172.21.15.146:0/3358614053 wait complete. 2024-04-24T23:01:27.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:01:27.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.210+0000 7f2b08200640 1 Processor -- start 2024-04-24T23:01:27.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.210+0000 7f2b08200640 1 -- start start 2024-04-24T23:01:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b08200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2b00145640 0x7f2b0015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b08200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b08200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b000cdf70 con 0x7f2b000b2a20 2024-04-24T23:01:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b08200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2b0015d360 con 0x7f2b00145640 2024-04-24T23:01:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b08200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2b00145a20 con 0x7f2b000d03a0 2024-04-24T23:01:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.212+0000 7f2b06200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b05800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2b00145640 0x7f2b0015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:60934/0 (socket says 172.21.15.146:60934) 2024-04-24T23:01:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 -- 172.21.15.146:0/1466022289 learned_addr learned my addr 172.21.15.146:0/1466022289 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b04e00640 1 --1- 172.21.15.146:0/1466022289 >> v1:172.21.15.203:6789/0 conn(0x7f2b000b2a20 0x7f2b000cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:45230/0 (socket says 172.21.15.146:45230) 2024-04-24T23:01:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 -- 172.21.15.146:0/1466022289 >> v2:172.21.15.203:3300/0 conn(0x7f2b00145640 msgr2=0x7f2b0015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 --2- 172.21.15.146:0/1466022289 >> v2:172.21.15.203:3300/0 conn(0x7f2b00145640 0x7f2b0015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 -- 172.21.15.146:0/1466022289 >> v1:172.21.15.203:6789/0 conn(0x7f2b000b2a20 legacy=0x7f2b000cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.213+0000 7f2b06200640 1 -- 172.21.15.146:0/1466022289 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0006d140 con 0x7f2b000d03a0 2024-04-24T23:01:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.215+0000 7f2b06200640 1 --2- 172.21.15.146:0/1466022289 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9587b6b8abbde167 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.215+0000 7f2affe00640 1 -- 172.21.15.146:0/1466022289 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8036070 con 0x7f2b000d03a0 2024-04-24T23:01:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.215+0000 7f2affe00640 1 -- 172.21.15.146:0/1466022289 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8031600 con 0x7f2b000d03a0 2024-04-24T23:01:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.215+0000 7f2affe00640 1 -- 172.21.15.146:0/1466022289 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80319d0 con 0x7f2b000d03a0 2024-04-24T23:01:27.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 -- 172.21.15.146:0/1466022289 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 msgr2=0x7f2b000ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 --2- 172.21.15.146:0/1466022289 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af802a710 comp rx=0 tx=0).stop 2024-04-24T23:01:27.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 -- 172.21.15.146:0/1466022289 shutdown_connections 2024-04-24T23:01:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 --2- 172.21.15.146:0/1466022289 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b000d03a0 0x7f2b000ce450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 --2- 172.21.15.146:0/1466022289 >> v2:172.21.15.203:3300/0 conn(0x7f2b00145640 0x7f2b0015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 -- 172.21.15.146:0/1466022289 >> 172.21.15.146:0/1466022289 conn(0x7f2b0006b320 msgr2=0x7f2b0006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 -- 172.21.15.146:0/1466022289 shutdown_connections 2024-04-24T23:01:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.216+0000 7f2b08200640 1 -- 172.21.15.146:0/1466022289 wait complete. 2024-04-24T23:01:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.218+0000 7f2b08200640 1 Processor -- start 2024-04-24T23:01:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.218+0000 7f2b08200640 1 -- start start 2024-04-24T23:01:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b000b2a20 0x7f2b001556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 0x7f2b00159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0006d9e0 con 0x7f2b000d03a0 2024-04-24T23:01:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0006d700 con 0x7f2b000b2a20 2024-04-24T23:01:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b08200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0006cbc0 con 0x7f2b00145640 2024-04-24T23:01:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b04e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b04e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54598/0 (socket says 172.21.15.146:54598) 2024-04-24T23:01:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.219+0000 7f2b04e00640 1 -- 172.21.15.146:0/3576891222 learned_addr learned my addr 172.21.15.146:0/3576891222 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:27.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b05800640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b000b2a20 0x7f2b001556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b06200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 0x7f2b00159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 -- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 msgr2=0x7f2b00159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 0x7f2b00159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 -- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b000b2a20 msgr2=0x7f2b001556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b000b2a20 0x7f2b001556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 -- 172.21.15.146:0/3576891222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b00155bf0 con 0x7f2b000d03a0 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b06200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 0x7f2b00159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.220+0000 7f2b04e00640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00c400 tx=0x7f2aec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.221+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0074e0 con 0x7f2b000d03a0 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.221+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec0047e0 con 0x7f2b000d03a0 2024-04-24T23:01:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.221+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec004bd0 con 0x7f2b000d03a0 2024-04-24T23:01:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.221+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0013ed50 con 0x7f2b000d03a0 2024-04-24T23:01:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.221+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0013fb30 con 0x7f2b000d03a0 2024-04-24T23:01:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.222+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b00160710 con 0x7f2b000d03a0 2024-04-24T23:01:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.223+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aec01a020 con 0x7f2b000d03a0 2024-04-24T23:01:27.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.225+0000 7f2afd600640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 0x7f2ae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.225+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2aec08a530 con 0x7f2b000d03a0 2024-04-24T23:01:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.225+0000 7f2b05800640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 0x7f2ae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.227+0000 7f2b05800640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 0x7f2ae006e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009a30 tx=0x7f2af4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.230+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2b00160710 con 0x7f2b000d03a0 2024-04-24T23:01:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.501+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2b00067af0 con 0x7f2b000d03a0 2024-04-24T23:01:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.502+0000 7f2afd600640 1 -- 172.21.15.146:0/3576891222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f2b00067af0 con 0x7f2b000d03a0 2024-04-24T23:01:27.503 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ==", 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.504 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ==", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg==", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg==", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.506 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA==", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ==", 2024-04-24T23:01:27.507 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA==", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg==", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ==", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.509 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q==", 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-04-24T23:01:27.510 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ==", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA==", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw==", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g==", 2024-04-24T23:01:27.512 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw==", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:01:27.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg==", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmFG6LAxAA7YUamq4/Vvt8ibyWUFiI+w==", 2024-04-24T23:01:27.514 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mds", 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmu+9VFRAA8KeWpqFe2OAkgusKjeGQHA==", 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mds" 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mgr", 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmHw1WFRAAWxum3LYT7BlP5iyT0Gm5eg==", 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-osd", 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmkShWFRAAgtnz6eqogyKyrV43WlIZXA==", 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-osd" 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd", 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmaUFWFRAAJyP4f7V9fwPFopWxSEz61g==", 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmOlpWFRAAFHp4+zCxsH0PjloCUH4fzA==", 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rgw", 2024-04-24T23:01:27.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDSjilmsHpWFRAA98/C3H5C3LutnkK4JvHopg==", 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA==", 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:01:27.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg==", 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:01:27.519 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:01:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 msgr2=0x7f2ae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 0x7f2ae006e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009a30 tx=0x7f2af4008040 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 msgr2=0x7f2b00141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00c400 tx=0x7f2aec00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 shutdown_connections 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ae006be30 0x7f2ae006e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2b00145640 0x7f2b00159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b000d03a0 0x7f2b00141d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 --2- 172.21.15.146:0/3576891222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b000b2a20 0x7f2b001556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 >> 172.21.15.146:0/3576891222 conn(0x7f2b0006b320 msgr2=0x7f2b000ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 shutdown_connections 2024-04-24T23:01:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.505+0000 7f2b08200640 1 -- 172.21.15.146:0/3576891222 wait complete. 2024-04-24T23:01:27.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-24T23:01:27.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.727+0000 7f70dea00640 1 Processor -- start 2024-04-24T23:01:27.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.727+0000 7f70dea00640 1 -- start start 2024-04-24T23:01:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.728+0000 7f70dea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70d8070ba0 0x7f70d806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.728+0000 7f70dea00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8142950 con 0x7f70d80720d0 2024-04-24T23:01:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.728+0000 7f70dea00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8071030 con 0x7f70d8142570 2024-04-24T23:01:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.728+0000 7f70dea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70d8071c40 con 0x7f70d8070ba0 2024-04-24T23:01:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.729+0000 7f70dca00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f70d80720d0 0x7f70d815fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45520/0 (socket says 172.21.15.146:45520) 2024-04-24T23:01:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.729+0000 7f70dca00640 1 -- 172.21.15.146:0/3999475193 learned_addr learned my addr 172.21.15.146:0/3999475193 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.729+0000 7f70cf400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70d8070ba0 0x7f70d806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621122727 0 0) 0x7f70d8142950 con 0x7f70d80720d0 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70bc003520 con 0x7f70d80720d0 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711200849 0 0) 0x7f70d8071030 con 0x7f70d8142570 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d8142950 con 0x7f70d8142570 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2315350968 0 0) 0x7f70bc003520 con 0x7f70d80720d0 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70d8070ba0 msgr2=0x7f70d806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70d8070ba0 0x7f70d806d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 >> v1:172.21.15.203:6789/0 conn(0x7f70d8142570 legacy=0x7f70d806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d8071310 con 0x7f70d80720d0 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f70d00019f0 con 0x7f70d80720d0 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 >> v1:172.21.15.146:6789/0 conn(0x7f70d80720d0 legacy=0x7f70d815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc003b70 0x7f70bc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70bc004800 0x7f70bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0051c0 0x7f70bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8071c40 con 0x7f70bc0051c0 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc00bfb0 con 0x7f70bc004800 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc00c1b0 con 0x7f70bc003b70 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70cf400640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70d8070ba0 0x7f70d806d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:01:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.730+0000 7f70dca00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0051c0 0x7f70bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70d7e00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc003b70 0x7f70bc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70dca00640 1 -- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc003b70 msgr2=0x7f70bc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70dca00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc003b70 0x7f70bc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70dca00640 1 -- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70bc004800 msgr2=0x7f70bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70dca00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70bc004800 0x7f70bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.731+0000 7f70dca00640 1 -- 172.21.15.146:0/3999475193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc003520 con 0x7f70bc0051c0 2024-04-24T23:01:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.732+0000 7f70dca00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0051c0 0x7f70bc00b9c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70d000a820 tx=0x7f70bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee345e20a7519d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.732+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d000a450 con 0x7f70bc0051c0 2024-04-24T23:01:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.732+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d002f070 con 0x7f70bc0051c0 2024-04-24T23:01:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.732+0000 7f70d7400640 1 -- 172.21.15.146:0/3999475193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d002bcd0 con 0x7f70bc0051c0 2024-04-24T23:01:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 -- 172.21.15.146:0/3999475193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0051c0 msgr2=0x7f70bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 --2- 172.21.15.146:0/3999475193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70bc0051c0 0x7f70bc00b9c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70d000a820 tx=0x7f70bc005830 comp rx=0 tx=0).stop 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dca00640 1 -- 172.21.15.146:0/3999475193 reap_dead start 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 -- 172.21.15.146:0/3999475193 shutdown_connections 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 -- 172.21.15.146:0/3999475193 >> 172.21.15.146:0/3999475193 conn(0x7f70d806b140 msgr2=0x7f70d806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 -- 172.21.15.146:0/3999475193 shutdown_connections 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.733+0000 7f70dea00640 1 -- 172.21.15.146:0/3999475193 wait complete. 2024-04-24T23:01:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.735+0000 7f70dea00640 1 Processor -- start 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.735+0000 7f70dea00640 1 -- start start 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc0051c0 0x7f70d8140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d813f790 0x7f70d806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8072c60 con 0x7f70d815bae0 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70d80718d0 con 0x7f70d813f790 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70dea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70d8072de0 con 0x7f70bc0051c0 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70cf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70cf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54622/0 (socket says 172.21.15.146:54622) 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.736+0000 7f70cf400640 1 -- 172.21.15.146:0/3234430685 learned_addr learned my addr 172.21.15.146:0/3234430685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70d7e00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc0051c0 0x7f70d8140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 -- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc0051c0 msgr2=0x7f70d8140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70dca00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d813f790 0x7f70d806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc0051c0 0x7f70d8140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 -- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d813f790 msgr2=0x7f70d806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d813f790 0x7f70d806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 -- 172.21.15.146:0/3234430685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d81f8100 con 0x7f70d815bae0 2024-04-24T23:01:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70cf400640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f70c0004790 tx=0x7f70c000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0004030 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c00041d0 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c000c890 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.737+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d81f83e0 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.738+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81f7df0 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.739+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d804f5a0 con 0x7f70d815bae0 2024-04-24T23:01:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.740+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70c000ca30 con 0x7f70d815bae0 2024-04-24T23:01:27.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.741+0000 7f70d4c00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 0x7f70b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:27.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.741+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f70c008b0f0 con 0x7f70d815bae0 2024-04-24T23:01:27.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.742+0000 7f70d7e00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 0x7f70b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.743+0000 7f70d7e00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 0x7f70b406e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70c8007fd0 tx=0x7f70c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:27.746+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f70c0017020 con 0x7f70d815bae0 2024-04-24T23:01:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.020+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f70d8144d80 con 0x7f70d815bae0 2024-04-24T23:01:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.025+0000 7f70d4c00640 1 -- 172.21.15.146:0/3234430685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f70c0059c50 con 0x7f70d815bae0 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.027+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 msgr2=0x7f70b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.027+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 0x7f70b406e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70c8007fd0 tx=0x7f70c8009040 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.027+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 msgr2=0x7f70d81f78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.027+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f70c0004790 tx=0x7f70c000ed60 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 shutdown_connections 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d813f790 0x7f70d806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d815bae0 0x7f70d81f78b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f70b406be60 0x7f70b406e320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 --2- 172.21.15.146:0/3234430685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70bc0051c0 0x7f70d8140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 >> 172.21.15.146:0/3234430685 conn(0x7f70d806b140 msgr2=0x7f70d813afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 shutdown_connections 2024-04-24T23:01:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.028+0000 7f70dea00640 1 -- 172.21.15.146:0/3234430685 wait complete. 2024-04-24T23:01:28.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-24T23:01:28.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.239+0000 7f85d3e00640 1 Processor -- start 2024-04-24T23:01:28.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.239+0000 7f85d3e00640 1 -- start start 2024-04-24T23:01:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f85d40adfd0 0x7f85d40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85d4072380 0x7f85d406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d4070a80 con 0x7f85d415e010 2024-04-24T23:01:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f85d40aeb60 con 0x7f85d4072380 2024-04-24T23:01:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f85d4071930 con 0x7f85d40adfd0 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85d4072380 0x7f85d406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f85d415e010 0x7f85d40ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50974/0 (socket says 172.21.15.146:50974) 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.241+0000 7f85d2a00640 1 -- 172.21.15.146:0/1431084804 learned_addr learned my addr 172.21.15.146:0/1431084804 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.242+0000 7f85d2000640 1 --2- 172.21.15.146:0/1431084804 >> v2:172.21.15.203:3300/0 conn(0x7f85d40adfd0 0x7f85d40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.242+0000 7f85d3400640 1 -- 172.21.15.146:0/1431084804 >> v2:172.21.15.203:3300/0 conn(0x7f85d40adfd0 msgr2=0x7f85d40b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.242+0000 7f85d3400640 1 --2- 172.21.15.146:0/1431084804 >> v2:172.21.15.203:3300/0 conn(0x7f85d40adfd0 0x7f85d40b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.242+0000 7f85d3400640 1 -- 172.21.15.146:0/1431084804 >> v1:172.21.15.146:6789/0 conn(0x7f85d415e010 legacy=0x7f85d40ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.242+0000 7f85d3400640 1 -- 172.21.15.146:0/1431084804 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4070d20 con 0x7f85d4072380 2024-04-24T23:01:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.243+0000 7f85d3400640 1 --2- 172.21.15.146:0/1431084804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d406c9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f85d41619a0 tx=0x7f85cc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7d22c542f8d832 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.243+0000 7f85d1600640 1 -- 172.21.15.146:0/1431084804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc007740 con 0x7f85d4072380 2024-04-24T23:01:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.243+0000 7f85d1600640 1 -- 172.21.15.146:0/1431084804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc0078e0 con 0x7f85d4072380 2024-04-24T23:01:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.243+0000 7f85d1600640 1 -- 172.21.15.146:0/1431084804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc007cb0 con 0x7f85d4072380 2024-04-24T23:01:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 -- 172.21.15.146:0/1431084804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 msgr2=0x7f85d406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1431084804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d406c9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f85d41619a0 tx=0x7f85cc02a710 comp rx=0 tx=0).stop 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 -- 172.21.15.146:0/1431084804 shutdown_connections 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1431084804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d406c9d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1431084804 >> v2:172.21.15.203:3300/0 conn(0x7f85d40adfd0 0x7f85d40b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 -- 172.21.15.146:0/1431084804 >> 172.21.15.146:0/1431084804 conn(0x7f85d40b1560 msgr2=0x7f85d40b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 -- 172.21.15.146:0/1431084804 shutdown_connections 2024-04-24T23:01:28.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.244+0000 7f85d3e00640 1 -- 172.21.15.146:0/1431084804 wait complete. 2024-04-24T23:01:28.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.246+0000 7f85d3e00640 1 Processor -- start 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.246+0000 7f85d3e00640 1 -- start start 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85d40adfd0 0x7f85d41586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85d415e010 0x7f85d4158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40715c0 con 0x7f85d4072380 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40712e0 con 0x7f85d415e010 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f85d4071dc0 con 0x7f85d40adfd0 2024-04-24T23:01:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60124/0 (socket says 172.21.15.146:60124) 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.247+0000 7f85d2a00640 1 -- 172.21.15.146:0/1796072575 learned_addr learned my addr 172.21.15.146:0/1796072575 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2000640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85d40adfd0 0x7f85d41586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 -- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85d40adfd0 msgr2=0x7f85d41586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85d40adfd0 0x7f85d41586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 -- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85d415e010 msgr2=0x7f85d4158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d3400640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85d415e010 0x7f85d4158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85d415e010 0x7f85d4158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 -- 172.21.15.146:0/1796072575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4153960 con 0x7f85d4072380 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d2a00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c3c0 tx=0x7f85c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4017070 con 0x7f85d4072380 2024-04-24T23:01:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4005ce0 con 0x7f85d4072380 2024-04-24T23:01:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d415ea00 con 0x7f85d4072380 2024-04-24T23:01:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c40072f0 con 0x7f85d4072380 2024-04-24T23:01:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.248+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d415efc0 con 0x7f85d4072380 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.250+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d404f500 con 0x7f85d4072380 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.250+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85c401a070 con 0x7f85d4072380 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.251+0000 7f85caa00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.251+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f85c408a0a0 con 0x7f85d4072380 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.252+0000 7f85d2000640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.253+0000 7f85d2000640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 0x7f85b406e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.255+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85d4153960 con 0x7f85d4072380 2024-04-24T23:01:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.522+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f85d40b2270 con 0x7f85d4072380 2024-04-24T23:01:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.527+0000 7f85caa00640 1 -- 172.21.15.146:0/1796072575 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f85c4058b70 con 0x7f85d4072380 2024-04-24T23:01:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 msgr2=0x7f85b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 0x7f85b406e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0008040 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 msgr2=0x7f85d4153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c3c0 tx=0x7f85c400c880 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 shutdown_connections 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85d415e010 0x7f85d4158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85d40adfd0 0x7f85d41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 --2- 172.21.15.146:0/1796072575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d4072380 0x7f85d4153420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 >> 172.21.15.146:0/1796072575 conn(0x7f85d40b1560 msgr2=0x7f85d415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.531+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 shutdown_connections 2024-04-24T23:01:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.532+0000 7f85d3e00640 1 -- 172.21.15.146:0/1796072575 wait complete. 2024-04-24T23:01:28.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-24T23:01:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.749+0000 7fbc5be00640 1 Processor -- start 2024-04-24T23:01:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.750+0000 7fbc5be00640 1 -- start start 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbc5c0b45f0 0x7fbc5c162780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc5c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5c0b5540 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5c0d2af0 con 0x7fbc5c0b45f0 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c0d2200 con 0x7fbc5c0d0ca0 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc5c0d08c0 0x7fbc5c162070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50988/0 (socket says 172.21.15.146:50988) 2024-04-24T23:01:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.751+0000 7fbc5aa00640 1 -- 172.21.15.146:0/1346751109 learned_addr learned my addr 172.21.15.146:0/1346751109 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474492767 0 0) 0x7fbc5c0b5540 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc40003520 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc5b400640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc5c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc5a000640 1 --2- 172.21.15.146:0/1346751109 >> v2:172.21.15.203:3300/0 conn(0x7fbc5c0b45f0 0x7fbc5c162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2862190038 0 0) 0x7fbc40003520 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 msgr2=0x7fbc5c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc5c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 >> v2:172.21.15.203:3300/0 conn(0x7fbc5c0b45f0 msgr2=0x7fbc5c162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 --2- 172.21.15.146:0/1346751109 >> v2:172.21.15.203:3300/0 conn(0x7fbc5c0b45f0 0x7fbc5c162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c0d24a0 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fbc44001670 con 0x7fbc5c0d08c0 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 >> v1:172.21.15.146:6789/0 conn(0x7fbc5c0d08c0 legacy=0x7fbc5c162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc400039b0 0x7fbc40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c0d2af0 con 0x7fbc40004d40 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c0d2200 con 0x7fbc400039b0 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.752+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4000bb80 con 0x7fbc5c0d0ca0 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5a000640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5aa00640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc400039b0 0x7fbc40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 -- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 msgr2=0x7fbc40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c0d0ca0 0x7fbc40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 -- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc400039b0 msgr2=0x7fbc40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc400039b0 0x7fbc40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.753+0000 7fbc5b400640 1 -- 172.21.15.146:0/1346751109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc40003520 con 0x7fbc40004d40 2024-04-24T23:01:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.754+0000 7fbc5b400640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400ba30 tx=0x7fbc40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52db40722595c3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.754+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54030070 con 0x7fbc40004d40 2024-04-24T23:01:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.754+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5402ade0 con 0x7fbc40004d40 2024-04-24T23:01:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.754+0000 7fbc59600640 1 -- 172.21.15.146:0/1346751109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400b600 con 0x7fbc40004d40 2024-04-24T23:01:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 -- 172.21.15.146:0/1346751109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 msgr2=0x7fbc400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 --2- 172.21.15.146:0/1346751109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400ba30 tx=0x7fbc40005830 comp rx=0 tx=0).stop 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5b400640 1 -- 172.21.15.146:0/1346751109 reap_dead start 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 -- 172.21.15.146:0/1346751109 shutdown_connections 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 -- 172.21.15.146:0/1346751109 >> 172.21.15.146:0/1346751109 conn(0x7fbc5c09d010 msgr2=0x7fbc5c0d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 -- 172.21.15.146:0/1346751109 shutdown_connections 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.755+0000 7fbc5be00640 1 -- 172.21.15.146:0/1346751109 wait complete. 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.757+0000 7fbc5be00640 1 Processor -- start 2024-04-24T23:01:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.757+0000 7fbc5be00640 1 -- start start 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc5c0cc7b0 0x7fbc5c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c1f3e00 0x7fbc5c1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c162e40 con 0x7fbc40004d40 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c162cc0 con 0x7fbc5c0cc7b0 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c0b4f80 con 0x7fbc5c1f3e00 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60136/0 (socket says 172.21.15.146:60136) 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.758+0000 7fbc5aa00640 1 -- 172.21.15.146:0/3775642865 learned_addr learned my addr 172.21.15.146:0/3775642865 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5a000640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc5c0cc7b0 0x7fbc5c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5b400640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c1f3e00 0x7fbc5c1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 -- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c1f3e00 msgr2=0x7fbc5c1f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c1f3e00 0x7fbc5c1f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 -- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc5c0cc7b0 msgr2=0x7fbc5c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc5c0cc7b0 0x7fbc5c0cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 -- 172.21.15.146:0/3775642865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c1f4cd0 con 0x7fbc40004d40 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5aa00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400e780 tx=0x7fbc4400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400c870 con 0x7fbc40004d40 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44018070 con 0x7fbc40004d40 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400cc50 con 0x7fbc40004d40 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.759+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c1f47c0 con 0x7fbc40004d40 2024-04-24T23:01:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.760+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c0cd000 con 0x7fbc40004d40 2024-04-24T23:01:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.761+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c04f500 con 0x7fbc40004d40 2024-04-24T23:01:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.761+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4401d460 con 0x7fbc40004d40 2024-04-24T23:01:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.762+0000 7fbc52a00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.762+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fbc4408abd0 con 0x7fbc40004d40 2024-04-24T23:01:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.763+0000 7fbc5a000640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.764+0000 7fbc5a000640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b97c0 tx=0x7fbc4c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:28.769+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc5c1f47c0 con 0x7fbc40004d40 2024-04-24T23:01:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.020+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fbc5c0cc570 con 0x7fbc40004d40 2024-04-24T23:01:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.025+0000 7fbc52a00640 1 -- 172.21.15.146:0/3775642865 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fbc5c1f4cd0 con 0x7fbc40004d40 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 msgr2=0x7fbc3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b97c0 tx=0x7fbc4c00b040 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 msgr2=0x7fbc5c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400e780 tx=0x7fbc4400ec40 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 shutdown_connections 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc5c1f3e00 0x7fbc5c1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc5c0cc7b0 0x7fbc5c0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 --2- 172.21.15.146:0/3775642865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc40004d40 0x7fbc5c15a5e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.028+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 >> 172.21.15.146:0/3775642865 conn(0x7fbc5c09d010 msgr2=0x7fbc5c15d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.029+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 shutdown_connections 2024-04-24T23:01:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.029+0000 7fbc5be00640 1 -- 172.21.15.146:0/3775642865 wait complete. 2024-04-24T23:01:29.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-24T23:01:29.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.237+0000 7f13c7200640 1 Processor -- start 2024-04-24T23:01:29.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.237+0000 7f13c7200640 1 -- start start 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c815e050 0x7f13c80d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 0x7f13c80d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13c80d1ac0 0x7f13c80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f13c80d4800 con 0x7f13c80d1ac0 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f13c80b3190 con 0x7f13c80d0d20 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.238+0000 7f13c7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f13c80b3750 con 0x7f13c815e050 2024-04-24T23:01:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13c80d1ac0 0x7f13c80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13c80d1ac0 0x7f13c80ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60142/0 (socket says 172.21.15.146:60142) 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 -- 172.21.15.146:0/1361699506 learned_addr learned my addr 172.21.15.146:0/1361699506 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c5e00640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c815e050 0x7f13c80d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13bfe00640 1 --2- 172.21.15.146:0/1361699506 >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 0x7f13c80d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 -- 172.21.15.146:0/1361699506 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c815e050 msgr2=0x7f13c80d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c815e050 0x7f13c80d2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 -- 172.21.15.146:0/1361699506 >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 msgr2=0x7f13c80d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 --2- 172.21.15.146:0/1361699506 >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 0x7f13c80d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13c6800640 1 -- 172.21.15.146:0/1361699506 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c80d4a50 con 0x7f13c80d1ac0 2024-04-24T23:01:29.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.239+0000 7f13bfe00640 1 --2- 172.21.15.146:0/1361699506 >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 0x7f13c80d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:29.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.240+0000 7f13c6800640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d1ac0 0x7f13c80ce880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009e50 tx=0x7f13c002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8016e91abfea4017 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.240+0000 7f13c5400640 1 -- 172.21.15.146:0/1361699506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0036070 con 0x7f13c80d1ac0 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.240+0000 7f13c5400640 1 -- 172.21.15.146:0/1361699506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c0031600 con 0x7f13c80d1ac0 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c5400640 1 -- 172.21.15.146:0/1361699506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c00319d0 con 0x7f13c80d1ac0 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 -- 172.21.15.146:0/1361699506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d1ac0 msgr2=0x7f13c80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d1ac0 0x7f13c80ce880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009e50 tx=0x7f13c002a640 comp rx=0 tx=0).stop 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 -- 172.21.15.146:0/1361699506 shutdown_connections 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d1ac0 0x7f13c80ce880 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 --2- 172.21.15.146:0/1361699506 >> v2:172.21.15.203:3300/0 conn(0x7f13c80d0d20 0x7f13c80d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 --2- 172.21.15.146:0/1361699506 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c815e050 0x7f13c80d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 -- 172.21.15.146:0/1361699506 >> 172.21.15.146:0/1361699506 conn(0x7f13c80d3ce0 msgr2=0x7f13c80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:29.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 -- 172.21.15.146:0/1361699506 shutdown_connections 2024-04-24T23:01:29.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.241+0000 7f13c7200640 1 -- 172.21.15.146:0/1361699506 wait complete. 2024-04-24T23:01:29.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.243+0000 7f13c7200640 1 Processor -- start 2024-04-24T23:01:29.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.243+0000 7f13c7200640 1 -- start start 2024-04-24T23:01:29.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c80d1ac0 0x7f13c80a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 0x7f13c80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13c815e5b0 con 0x7f13c80d0d20 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f13c815e430 con 0x7f13c815e050 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f13c80cfa70 con 0x7f13c80d1ac0 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60156/0 (socket says 172.21.15.146:60156) 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.244+0000 7f13c5e00640 1 -- 172.21.15.146:0/3548263691 learned_addr learned my addr 172.21.15.146:0/3548263691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c6800640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 0x7f13c80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13bfe00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c80d1ac0 0x7f13c80a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 -- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c80d1ac0 msgr2=0x7f13c80a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c80d1ac0 0x7f13c80a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 -- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 msgr2=0x7f13c80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 0x7f13c80a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 -- 172.21.15.146:0/3548263691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c80cb990 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c6800640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 0x7f13c80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c5e00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c820 tx=0x7f13b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8015070 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8004240 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c80cbc70 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.245+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800ce10 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.246+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c80cc230 con 0x7f13c80d0d20 2024-04-24T23:01:29.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.247+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8161750 con 0x7f13c80d0d20 2024-04-24T23:01:29.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.248+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13b8007830 con 0x7f13c80d0d20 2024-04-24T23:01:29.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.248+0000 7f13be000640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 0x7f13a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.249+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f13b808abf0 con 0x7f13c80d0d20 2024-04-24T23:01:29.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.249+0000 7f13bfe00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 0x7f13a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.250+0000 7f13bfe00640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 0x7f13a406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f13c806cdd0 tx=0x7f13b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.253+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f13b8059750 con 0x7f13c80d0d20 2024-04-24T23:01:29.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.511+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f13c804f500 con 0x7f13c80d0d20 2024-04-24T23:01:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.516+0000 7f13be000640 1 -- 172.21.15.146:0/3548263691 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f13b8059050 con 0x7f13c80d0d20 2024-04-24T23:01:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.518+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 msgr2=0x7f13a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.518+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 0x7f13a406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f13c806cdd0 tx=0x7f13b0008040 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.518+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 msgr2=0x7f13c815c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.518+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c820 tx=0x7f13b800cce0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 shutdown_connections 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13c815e050 0x7f13c80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13a406be30 0x7f13a406e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13c80d1ac0 0x7f13c80a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 --2- 172.21.15.146:0/3548263691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13c80d0d20 0x7f13c815c920 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 >> 172.21.15.146:0/3548263691 conn(0x7f13c80d3ce0 msgr2=0x7f13c806b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 shutdown_connections 2024-04-24T23:01:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.519+0000 7f13c7200640 1 -- 172.21.15.146:0/3548263691 wait complete. 2024-04-24T23:01:29.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-24T23:01:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.725+0000 7f2983200640 1 Processor -- start 2024-04-24T23:01:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.725+0000 7f2983200640 1 -- start start 2024-04-24T23:01:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f2983200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f297c142570 0x7f297c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f2983200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c15fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f2983200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c142950 con 0x7f297c070ba0 2024-04-24T23:01:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f2983200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f297c071c40 con 0x7f297c142570 2024-04-24T23:01:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f2983200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f297c071030 con 0x7f297c0720d0 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f297be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f297c142570 0x7f297c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f297b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f297c070ba0 0x7f297c06d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51002/0 (socket says 172.21.15.146:51002) 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.727+0000 7f297b400640 1 -- 172.21.15.146:0/2640388276 learned_addr learned my addr 172.21.15.146:0/2640388276 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f2981200640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c15fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297aa00640 1 -- 172.21.15.146:0/2640388276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684827762 0 0) 0x7f297c142950 con 0x7f297c070ba0 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297aa00640 1 -- 172.21.15.146:0/2640388276 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2960003520 con 0x7f297c070ba0 2024-04-24T23:01:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297be00640 1 -- 172.21.15.146:0/2640388276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 msgr2=0x7f297c15fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297be00640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c15fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297be00640 1 -- 172.21.15.146:0/2640388276 >> v1:172.21.15.146:6789/0 conn(0x7f297c070ba0 legacy=0x7f297c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f297be00640 1 -- 172.21.15.146:0/2640388276 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c071310 con 0x7f297c142570 2024-04-24T23:01:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.728+0000 7f2981200640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.729+0000 7f297be00640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c142570 0x7f297c06cbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f296c0097a0 tx=0x7f296c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5dcbfce881d90b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.729+0000 7f297aa00640 1 -- 172.21.15.146:0/2640388276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c037070 con 0x7f297c142570 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.729+0000 7f297aa00640 1 -- 172.21.15.146:0/2640388276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c032440 con 0x7f297c142570 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.729+0000 7f297aa00640 1 -- 172.21.15.146:0/2640388276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c032810 con 0x7f297c142570 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 -- 172.21.15.146:0/2640388276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c142570 msgr2=0x7f297c06cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c142570 0x7f297c06cbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f296c0097a0 tx=0x7f296c02a180 comp rx=0 tx=0).stop 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 -- 172.21.15.146:0/2640388276 shutdown_connections 2024-04-24T23:01:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 --2- 172.21.15.146:0/2640388276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c142570 0x7f297c06cbc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 -- 172.21.15.146:0/2640388276 >> 172.21.15.146:0/2640388276 conn(0x7f297c06b140 msgr2=0x7f297c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 -- 172.21.15.146:0/2640388276 shutdown_connections 2024-04-24T23:01:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.730+0000 7f2983200640 1 -- 172.21.15.146:0/2640388276 wait complete. 2024-04-24T23:01:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.732+0000 7f2983200640 1 Processor -- start 2024-04-24T23:01:29.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.732+0000 7f2983200640 1 -- start start 2024-04-24T23:01:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f297c142570 0x7f297c1411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f297c072c60 con 0x7f297c141710 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f297c0718d0 con 0x7f297c142570 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2983200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f297c072de0 con 0x7f297c0720d0 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2981200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2981200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60174/0 (socket says 172.21.15.146:60174) 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.733+0000 7f2981200640 1 -- 172.21.15.146:0/1493166377 learned_addr learned my addr 172.21.15.146:0/1493166377 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f297be00640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f297b400640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f297c142570 0x7f297c1411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 -- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 msgr2=0x7f297c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 -- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f297c142570 msgr2=0x7f297c1411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f297c142570 0x7f297c1411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 -- 172.21.15.146:0/1493166377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c1f4e40 con 0x7f297c141710 2024-04-24T23:01:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2981200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f297400c7f0 tx=0x7f297400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974015070 con 0x7f297c141710 2024-04-24T23:01:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974007820 con 0x7f297c141710 2024-04-24T23:01:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c0b2b50 con 0x7f297c141710 2024-04-24T23:01:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974007c50 con 0x7f297c141710 2024-04-24T23:01:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.734+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c0b3110 con 0x7f297c141710 2024-04-24T23:01:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.736+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c04f5a0 con 0x7f297c141710 2024-04-24T23:01:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.736+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2974018070 con 0x7f297c141710 2024-04-24T23:01:29.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.738+0000 7f2973e00640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.738+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f297408af20 con 0x7f297c141710 2024-04-24T23:01:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.738+0000 7f297be00640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.739+0000 7f297be00640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 0x7f295c06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f296c034000 tx=0x7f296c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.743+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29740599f0 con 0x7f297c141710 2024-04-24T23:01:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.991+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f297c0cc780 con 0x7f297c141710 2024-04-24T23:01:29.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:29.997+0000 7f2973e00640 1 -- 172.21.15.146:0/1493166377 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f29740592f0 con 0x7f297c141710 2024-04-24T23:01:30.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 msgr2=0x7f295c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 0x7f295c06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f296c034000 tx=0x7f296c02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:30.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 msgr2=0x7f297c1f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f297400c7f0 tx=0x7f297400ccb0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 shutdown_connections 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f297c141710 0x7f297c1f40d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f297c142570 0x7f297c1411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f295c06be30 0x7f295c06e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 --2- 172.21.15.146:0/1493166377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f297c0720d0 0x7f297c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 >> 172.21.15.146:0/1493166377 conn(0x7f297c06b140 msgr2=0x7f297c0cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 shutdown_connections 2024-04-24T23:01:30.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.001+0000 7f2983200640 1 -- 172.21.15.146:0/1493166377 wait complete. 2024-04-24T23:01:30.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-24T23:01:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.217+0000 7eff6a400640 1 Processor -- start 2024-04-24T23:01:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.217+0000 7eff6a400640 1 -- start start 2024-04-24T23:01:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff6a400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff6415abb0 0x7eff6406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff6a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff6a400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff64071960 con 0x7eff6415f1f0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff6a400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7eff64071c40 con 0x7eff6415abb0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff6a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff64071f20 con 0x7eff6415e8b0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff63400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff6415abb0 0x7eff6406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff63e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7eff6415f1f0 0x7eff6415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51006/0 (socket says 172.21.15.146:51006) 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff63400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff6415abb0 0x7eff6406cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60176/0 (socket says 172.21.15.146:60176) 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff63e00640 1 -- 172.21.15.146:0/36542680 learned_addr learned my addr 172.21.15.146:0/36542680 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.219+0000 7eff5aa00640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.220+0000 7eff63400640 1 -- 172.21.15.146:0/36542680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 msgr2=0x7eff6415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.220+0000 7eff63400640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6415ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.220+0000 7eff63400640 1 -- 172.21.15.146:0/36542680 >> v1:172.21.15.146:6789/0 conn(0x7eff6415f1f0 legacy=0x7eff6415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.220+0000 7eff63400640 1 -- 172.21.15.146:0/36542680 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff64072200 con 0x7eff6415abb0 2024-04-24T23:01:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.220+0000 7eff62a00640 1 -- 172.21.15.146:0/36542680 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724463427 0 0) 0x7eff64071960 con 0x7eff6415f1f0 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff63400640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415abb0 0x7eff6406cbc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7eff5400ba40 tx=0x7eff5402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7baf43ce7061a37 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff62a00640 1 -- 172.21.15.146:0/36542680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54032750 con 0x7eff6415abb0 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff62a00640 1 -- 172.21.15.146:0/36542680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54030050 con 0x7eff6415abb0 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff62a00640 1 -- 172.21.15.146:0/36542680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54032b10 con 0x7eff6415abb0 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff6a400640 1 -- 172.21.15.146:0/36542680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415abb0 msgr2=0x7eff6406cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.221+0000 7eff6a400640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415abb0 0x7eff6406cbc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7eff5400ba40 tx=0x7eff5402c850 comp rx=0 tx=0).stop 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 -- 172.21.15.146:0/36542680 shutdown_connections 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 --2- 172.21.15.146:0/36542680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415abb0 0x7eff6406cbc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 -- 172.21.15.146:0/36542680 >> 172.21.15.146:0/36542680 conn(0x7eff6406b140 msgr2=0x7eff6406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 -- 172.21.15.146:0/36542680 shutdown_connections 2024-04-24T23:01:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.222+0000 7eff6a400640 1 -- 172.21.15.146:0/36542680 wait complete. 2024-04-24T23:01:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.223+0000 7eff6a400640 1 Processor -- start 2024-04-24T23:01:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.223+0000 7eff6a400640 1 -- start start 2024-04-24T23:01:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff6415abb0 0x7eff6414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff6415d7c0 con 0x7eff6415f1f0 2024-04-24T23:01:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff6415f660 con 0x7eff6415abb0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.224+0000 7eff6a400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7eff6415d940 con 0x7eff6415e8b0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60190/0 (socket says 172.21.15.146:60190) 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 -- 172.21.15.146:0/1540268452 learned_addr learned my addr 172.21.15.146:0/1540268452 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff6415abb0 0x7eff6414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff5aa00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 -- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 msgr2=0x7eff6414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 -- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff6415abb0 msgr2=0x7eff6414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff6415abb0 0x7eff6414e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff63e00640 1 -- 172.21.15.146:0/1540268452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6414d0a0 con 0x7eff6415f1f0 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.225+0000 7eff5aa00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff63e00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c700 tx=0x7eff5c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c018070 con 0x7eff6415f1f0 2024-04-24T23:01:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c00ce10 con 0x7eff6415f1f0 2024-04-24T23:01:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6414d320 con 0x7eff6415f1f0 2024-04-24T23:01:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00a800 con 0x7eff6415f1f0 2024-04-24T23:01:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.226+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6414d8e0 con 0x7eff6415f1f0 2024-04-24T23:01:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.227+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6404f5a0 con 0x7eff6415f1f0 2024-04-24T23:01:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.228+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff5c01b070 con 0x7eff6415f1f0 2024-04-24T23:01:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.229+0000 7eff5be00640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 0x7eff4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.229+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7eff5c08a250 con 0x7eff6415f1f0 2024-04-24T23:01:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.230+0000 7eff63400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 0x7eff4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.231+0000 7eff63400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 0x7eff4006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff54037000 tx=0x7eff54032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.234+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff6414d0a0 con 0x7eff6415f1f0 2024-04-24T23:01:30.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.505+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7eff6406e1c0 con 0x7eff6415f1f0 2024-04-24T23:01:30.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.510+0000 7eff5be00640 1 -- 172.21.15.146:0/1540268452 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7eff5c058d20 con 0x7eff6415f1f0 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 msgr2=0x7eff4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 0x7eff4006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff54037000 tx=0x7eff54032000 comp rx=0 tx=0).stop 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 msgr2=0x7eff641f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c700 tx=0x7eff5c00cbc0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 shutdown_connections 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff6415f1f0 0x7eff641f4810 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7eff4006be30 0x7eff4006e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7eff6415e8b0 0x7eff6414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 --2- 172.21.15.146:0/1540268452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff6415abb0 0x7eff6414e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 >> 172.21.15.146:0/1540268452 conn(0x7eff6406b140 msgr2=0x7eff640b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 shutdown_connections 2024-04-24T23:01:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.513+0000 7eff6a400640 1 -- 172.21.15.146:0/1540268452 wait complete. 2024-04-24T23:01:30.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:30.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.721+0000 7fce39600640 1 Processor -- start 2024-04-24T23:01:30.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.722+0000 7fce39600640 1 -- start start 2024-04-24T23:01:30.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fce341561c0 0x7fce340cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340709d0 0x7fce3415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce340cfb30 0x7fce340cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fce340b4310 con 0x7fce340cfb30 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fce340d04e0 con 0x7fce341561c0 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.723+0000 7fce39600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fce341565a0 con 0x7fce340709d0 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce340cfb30 0x7fce340cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce340cfb30 0x7fce340cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60196/0 (socket says 172.21.15.146:60196) 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 -- 172.21.15.146:0/2472547063 learned_addr learned my addr 172.21.15.146:0/2472547063 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:30.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce2b400640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340709d0 0x7fce3415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce33e00640 1 --2- 172.21.15.146:0/2472547063 >> v2:172.21.15.203:3300/0 conn(0x7fce341561c0 0x7fce340cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 -- 172.21.15.146:0/2472547063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340709d0 msgr2=0x7fce3415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340709d0 0x7fce3415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 -- 172.21.15.146:0/2472547063 >> v2:172.21.15.203:3300/0 conn(0x7fce341561c0 msgr2=0x7fce340cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 --2- 172.21.15.146:0/2472547063 >> v2:172.21.15.203:3300/0 conn(0x7fce341561c0 0x7fce340cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.724+0000 7fce38c00640 1 -- 172.21.15.146:0/2472547063 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce34070f90 con 0x7fce340cfb30 2024-04-24T23:01:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.725+0000 7fce38c00640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340cfb30 0x7fce340cffa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fce340706c0 tx=0x7fce2c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b494727029e5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce33400640 1 -- 172.21.15.146:0/2472547063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c036070 con 0x7fce340cfb30 2024-04-24T23:01:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce33400640 1 -- 172.21.15.146:0/2472547063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c031600 con 0x7fce340cfb30 2024-04-24T23:01:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce33400640 1 -- 172.21.15.146:0/2472547063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0319d0 con 0x7fce340cfb30 2024-04-24T23:01:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 -- 172.21.15.146:0/2472547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340cfb30 msgr2=0x7fce340cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340cfb30 0x7fce340cffa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fce340706c0 tx=0x7fce2c02a570 comp rx=0 tx=0).stop 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 -- 172.21.15.146:0/2472547063 shutdown_connections 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340cfb30 0x7fce340cffa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 --2- 172.21.15.146:0/2472547063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340709d0 0x7fce3415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 --2- 172.21.15.146:0/2472547063 >> v2:172.21.15.203:3300/0 conn(0x7fce341561c0 0x7fce340cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 -- 172.21.15.146:0/2472547063 >> 172.21.15.146:0/2472547063 conn(0x7fce3406b320 msgr2=0x7fce3406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 -- 172.21.15.146:0/2472547063 shutdown_connections 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.726+0000 7fce39600640 1 -- 172.21.15.146:0/2472547063 wait complete. 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.728+0000 7fce39600640 1 Processor -- start 2024-04-24T23:01:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.728+0000 7fce39600640 1 -- start start 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340cfb30 0x7fce34159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 0x7fce340cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce34071830 con 0x7fce340709d0 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce34071550 con 0x7fce341561c0 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce39600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fce340b2c20 con 0x7fce340cfb30 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce33e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce33e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60208/0 (socket says 172.21.15.146:60208) 2024-04-24T23:01:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.729+0000 7fce33e00640 1 -- 172.21.15.146:0/3488468868 learned_addr learned my addr 172.21.15.146:0/3488468868 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce38c00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 0x7fce340cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 -- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340cfb30 msgr2=0x7fce34159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340cfb30 0x7fce34159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 -- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 msgr2=0x7fce340cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 0x7fce340cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 -- 172.21.15.146:0/3488468868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3415a8f0 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce38c00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 0x7fce340cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce33e00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d5f0 tx=0x7fce2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240125f0 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce24019070 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.730+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240129d0 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.731+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3415abd0 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.731+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3415b190 con 0x7fce340709d0 2024-04-24T23:01:30.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.732+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3404f500 con 0x7fce340709d0 2024-04-24T23:01:30.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.733+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce24012b70 con 0x7fce340709d0 2024-04-24T23:01:30.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.734+0000 7fce30c00640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:30.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.734+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fce2408b120 con 0x7fce340709d0 2024-04-24T23:01:30.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.735+0000 7fce2b400640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:30.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.736+0000 7fce2b400640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fce3415beb0 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:30.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.739+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce24059bf0 con 0x7fce340709d0 2024-04-24T23:01:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.922+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce340aeb70 con 0x7fce340709d0 2024-04-24T23:01:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.924+0000 7fce30c00640 1 -- 172.21.15.146:0/3488468868 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13188 (secure 0 0 0) 0x7fce240594f0 con 0x7fce340709d0 2024-04-24T23:01:30.925 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:30.926 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:26.998885+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 msgr2=0x7fce1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 0x7fce1006e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fce3415beb0 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2024-04-24T23:01:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 msgr2=0x7fce34145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d5f0 tx=0x7fce2400dab0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 shutdown_connections 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce341561c0 0x7fce340cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fce1006be30 0x7fce1006e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce340cfb30 0x7fce34159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 --2- 172.21.15.146:0/3488468868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce340709d0 0x7fce34145300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 >> 172.21.15.146:0/3488468868 conn(0x7fce3406b320 msgr2=0x7fce340b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 shutdown_connections 2024-04-24T23:01:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:30.927+0000 7fce39600640 1 -- 172.21.15.146:0/3488468868 wait complete. 2024-04-24T23:01:30.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:01:30.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.149+0000 7f0bd7200640 1 Processor -- start 2024-04-24T23:01:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.149+0000 7f0bd7200640 1 -- start start 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd7200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bd80d03d0 0x7f0bd815e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd7200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 0x7f0bd815e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd7200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd815f070 con 0x7f0bd8158300 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd7200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd80b2ae0 con 0x7f0bd80d03d0 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd7200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd8161aa0 con 0x7f0bd8162580 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bd80d03d0 0x7f0bd815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd5e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0bd8158300 0x7f0bd80cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51018/0 (socket says 172.21.15.146:51018) 2024-04-24T23:01:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd5e00640 1 -- 172.21.15.146:0/4192138199 learned_addr learned my addr 172.21.15.146:0/4192138199 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.151+0000 7f0bd6800640 1 --2- 172.21.15.146:0/4192138199 >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 0x7f0bd815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd5400640 1 -- 172.21.15.146:0/4192138199 >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 msgr2=0x7f0bd815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd5400640 1 --2- 172.21.15.146:0/4192138199 >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 0x7f0bd815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd5400640 1 -- 172.21.15.146:0/4192138199 >> v1:172.21.15.146:6789/0 conn(0x7f0bd8158300 legacy=0x7f0bd80cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd5400640 1 -- 172.21.15.146:0/4192138199 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd8161d80 con 0x7f0bd80d03d0 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd4a00640 1 -- 172.21.15.146:0/4192138199 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040938209 0 0) 0x7f0bd815f070 con 0x7f0bd8158300 2024-04-24T23:01:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.152+0000 7f0bd6800640 1 --2- 172.21.15.146:0/4192138199 >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 0x7f0bd815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.154+0000 7f0bd5400640 1 --2- 172.21.15.146:0/4192138199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd80d03d0 0x7f0bd815e310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80725d0 tx=0x7f0bc402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768991922943cdaf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.155+0000 7f0bd4a00640 1 -- 172.21.15.146:0/4192138199 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4037070 con 0x7f0bd80d03d0 2024-04-24T23:01:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.155+0000 7f0bd4a00640 1 -- 172.21.15.146:0/4192138199 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc4032440 con 0x7f0bd80d03d0 2024-04-24T23:01:31.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.155+0000 7f0bd4a00640 1 -- 172.21.15.146:0/4192138199 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4032810 con 0x7f0bd80d03d0 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.155+0000 7f0bd7200640 1 -- 172.21.15.146:0/4192138199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd80d03d0 msgr2=0x7f0bd815e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.155+0000 7f0bd7200640 1 --2- 172.21.15.146:0/4192138199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd80d03d0 0x7f0bd815e310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80725d0 tx=0x7f0bc402a230 comp rx=0 tx=0).stop 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 -- 172.21.15.146:0/4192138199 shutdown_connections 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 --2- 172.21.15.146:0/4192138199 >> v2:172.21.15.203:3300/0 conn(0x7f0bd8162580 0x7f0bd815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 --2- 172.21.15.146:0/4192138199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd80d03d0 0x7f0bd815e310 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 -- 172.21.15.146:0/4192138199 >> 172.21.15.146:0/4192138199 conn(0x7f0bd806b560 msgr2=0x7f0bd806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 -- 172.21.15.146:0/4192138199 shutdown_connections 2024-04-24T23:01:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.156+0000 7f0bd7200640 1 -- 172.21.15.146:0/4192138199 wait complete. 2024-04-24T23:01:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.157+0000 7f0bd7200640 1 Processor -- start 2024-04-24T23:01:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.158+0000 7f0bd7200640 1 -- start start 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bd80d03d0 0x7f0bd8142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bd8158300 0x7f0bd8158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81586e0 con 0x7f0bd8162580 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd815ed90 con 0x7f0bd8158300 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd806cab0 con 0x7f0bd80d03d0 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60226/0 (socket says 172.21.15.146:60226) 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 -- 172.21.15.146:0/3450964782 learned_addr learned my addr 172.21.15.146:0/3450964782 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd5e00640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bd80d03d0 0x7f0bd8142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd5400640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bd8158300 0x7f0bd8158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 -- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bd80d03d0 msgr2=0x7f0bd8142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bd80d03d0 0x7f0bd8142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 -- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bd8158300 msgr2=0x7f0bd8158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bd8158300 0x7f0bd8158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.159+0000 7f0bd6800640 1 -- 172.21.15.146:0/3450964782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd81431a0 con 0x7f0bd8162580 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bd6800640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0007e70 tx=0x7f0bd000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd001a070 con 0x7f0bd8162580 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd0003bb0 con 0x7f0bd8162580 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0004030 con 0x7f0bd8162580 2024-04-24T23:01:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd8156910 con 0x7f0bd8162580 2024-04-24T23:01:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.160+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd8156ed0 con 0x7f0bd8162580 2024-04-24T23:01:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.161+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd804f500 con 0x7f0bd8162580 2024-04-24T23:01:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.163+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bd001d070 con 0x7f0bd8162580 2024-04-24T23:01:31.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.163+0000 7f0bce000640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 0x7f0bb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.164+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f0bd008af50 con 0x7f0bd8162580 2024-04-24T23:01:31.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.164+0000 7f0bd5e00640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 0x7f0bb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.165+0000 7f0bd5e00640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 0x7f0bb806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f60 tx=0x7f0bc8007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.168+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0bd0010070 con 0x7f0bd8162580 2024-04-24T23:01:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.369+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0bd80b4dd0 con 0x7f0bd8162580 2024-04-24T23:01:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.370+0000 7f0bce000640 1 -- 172.21.15.146:0/3450964782 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f0bd0059ac0 con 0x7f0bd8162580 2024-04-24T23:01:31.371 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 msgr2=0x7f0bb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 0x7f0bb806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f60 tx=0x7f0bc8007b50 comp rx=0 tx=0).stop 2024-04-24T23:01:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 msgr2=0x7f0bd8158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0007e70 tx=0x7f0bd000d4a0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 shutdown_connections 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bd8162580 0x7f0bd8158da0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bd8158300 0x7f0bd8158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0bb806be30 0x7f0bb806e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 --2- 172.21.15.146:0/3450964782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bd80d03d0 0x7f0bd8142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 >> 172.21.15.146:0/3450964782 conn(0x7f0bd806b560 msgr2=0x7f0bd80709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 shutdown_connections 2024-04-24T23:01:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.373+0000 7f0bd7200640 1 -- 172.21.15.146:0/3450964782 wait complete. 2024-04-24T23:01:31.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:01:31.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.582+0000 7fcf22400640 1 Processor -- start 2024-04-24T23:01:31.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.582+0000 7fcf22400640 1 -- start start 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf1c15e050 0x7fcf1c1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 0x7fcf1c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c0afa20 con 0x7fcf1c15e050 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c0cfd70 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf22400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c0cf760 con 0x7fcf1c06eba0 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.583+0000 7fcf21000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf1c15e050 0x7fcf1c1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf1c15e050 0x7fcf1c1624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60234/0 (socket says 172.21.15.146:60234) 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 -- 172.21.15.146:0/2291477949 learned_addr learned my addr 172.21.15.146:0/2291477949 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21a00640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf1be00640 1 --2- 172.21.15.146:0/2291477949 >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 0x7fcf1c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 -- 172.21.15.146:0/2291477949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 msgr2=0x7fcf1c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 -- 172.21.15.146:0/2291477949 >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 msgr2=0x7fcf1c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:31.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 --2- 172.21.15.146:0/2291477949 >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 0x7fcf1c06e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf21000640 1 -- 172.21.15.146:0/2291477949 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c1629f0 con 0x7fcf1c15e050 2024-04-24T23:01:31.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.584+0000 7fcf1be00640 1 --2- 172.21.15.146:0/2291477949 >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 0x7fcf1c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:31.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.585+0000 7fcf21000640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c15e050 0x7fcf1c1624b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c066f10 tx=0x7fcf0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2e0c2cc18e0cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.585+0000 7fcf1b400640 1 -- 172.21.15.146:0/2291477949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c037070 con 0x7fcf1c15e050 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.585+0000 7fcf1b400640 1 -- 172.21.15.146:0/2291477949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c032440 con 0x7fcf1c15e050 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.585+0000 7fcf1b400640 1 -- 172.21.15.146:0/2291477949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c032810 con 0x7fcf1c15e050 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 -- 172.21.15.146:0/2291477949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c15e050 msgr2=0x7fcf1c1624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c15e050 0x7fcf1c1624b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c066f10 tx=0x7fcf0c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 -- 172.21.15.146:0/2291477949 shutdown_connections 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 --2- 172.21.15.146:0/2291477949 >> v2:172.21.15.203:3300/0 conn(0x7fcf1c0cdd20 0x7fcf1c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 --2- 172.21.15.146:0/2291477949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c15e050 0x7fcf1c1624b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 -- 172.21.15.146:0/2291477949 >> 172.21.15.146:0/2291477949 conn(0x7fcf1c0d0150 msgr2=0x7fcf1c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:31.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 -- 172.21.15.146:0/2291477949 shutdown_connections 2024-04-24T23:01:31.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.586+0000 7fcf22400640 1 -- 172.21.15.146:0/2291477949 wait complete. 2024-04-24T23:01:31.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.588+0000 7fcf22400640 1 Processor -- start 2024-04-24T23:01:31.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.588+0000 7fcf22400640 1 -- start start 2024-04-24T23:01:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf1c15e050 0x7fcf1c0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c0cfa00 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c0af740 con 0x7fcf1c15e050 2024-04-24T23:01:31.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf22400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c06b140 con 0x7fcf1c06eba0 2024-04-24T23:01:31.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.589+0000 7fcf1be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60238/0 (socket says 172.21.15.146:60238) 2024-04-24T23:01:31.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 -- 172.21.15.146:0/3629554352 learned_addr learned my addr 172.21.15.146:0/3629554352 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf21a00640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf1c15e050 0x7fcf1c0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf21000640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 -- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 msgr2=0x7fcf1c1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c1454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 -- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf1c15e050 msgr2=0x7fcf1c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf1c15e050 0x7fcf1c0b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 -- 172.21.15.146:0/3629554352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c0b4680 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.590+0000 7fcf1be00640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400cf90 tx=0x7fcf0400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.591+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0401a070 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.591+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0400d840 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.591+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400dc10 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.591+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c0b4960 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.591+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c0b4f20 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.592+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf1c04f500 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.593+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf0401d070 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.594+0000 7fcf18c00640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 0x7fcef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.594+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fcf0408b510 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.595+0000 7fcf21000640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 0x7fcef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.596+0000 7fcf21000640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 0x7fcef806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c034000 tx=0x7fcf0c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.599+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf04059990 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.801+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcf1c0b50f0 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.802+0000 7fcf18c00640 1 -- 172.21.15.146:0/3629554352 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7fcf0405ee20 con 0x7fcf1c0cdd20 2024-04-24T23:01:31.804 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:31.804 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T23:01:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:01:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T23:01:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T23:01:31.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:01:31.805 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T23:01:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 msgr2=0x7fcef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 0x7fcef806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c034000 tx=0x7fcf0c02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 msgr2=0x7fcf1c0c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400cf90 tx=0x7fcf0400a7d0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 shutdown_connections 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf1c15e050 0x7fcf1c0b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c0cdd20 0x7fcf1c0c4e10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcef806be30 0x7fcef806e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 --2- 172.21.15.146:0/3629554352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf1c06eba0 0x7fcf1c1454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 >> 172.21.15.146:0/3629554352 conn(0x7fcf1c0d0150 msgr2=0x7fcf1c0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 shutdown_connections 2024-04-24T23:01:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:31.805+0000 7fcf22400640 1 -- 172.21.15.146:0/3629554352 wait complete. 2024-04-24T23:01:31.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:01:31.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:01:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.033+0000 7ff5a7000640 1 Processor -- start 2024-04-24T23:01:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.033+0000 7ff5a7000640 1 -- start start 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a0145510 0x7ff5a00728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff5a00ceaf0 0x7ff5a006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5a006d0c0 0x7ff5a015f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a00cf040 con 0x7ff5a006d0c0 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a00cf320 con 0x7ff5a00ceaf0 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a7000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a0070c70 con 0x7ff5a0145510 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a5000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5a006d0c0 0x7ff5a015f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a5000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5a006d0c0 0x7ff5a015f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60244/0 (socket says 172.21.15.146:60244) 2024-04-24T23:01:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.035+0000 7ff5a5000640 1 -- 172.21.15.146:0/226383483 learned_addr learned my addr 172.21.15.146:0/226383483 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.036+0000 7ff5a5000640 1 -- 172.21.15.146:0/226383483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a0145510 msgr2=0x7ff5a00728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.036+0000 7ff5a5000640 1 --2- 172.21.15.146:0/226383483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a0145510 0x7ff5a00728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.036+0000 7ff5a5000640 1 -- 172.21.15.146:0/226383483 >> v2:172.21.15.203:3300/0 conn(0x7ff5a00ceaf0 msgr2=0x7ff5a006cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.036+0000 7ff5a5000640 1 --2- 172.21.15.146:0/226383483 >> v2:172.21.15.203:3300/0 conn(0x7ff5a00ceaf0 0x7ff5a006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.036+0000 7ff5a5000640 1 -- 172.21.15.146:0/226383483 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a0070f50 con 0x7ff5a006d0c0 2024-04-24T23:01:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.037+0000 7ff5a5000640 1 --2- 172.21.15.146:0/226383483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a015f9f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00756e0 tx=0x7ff59802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06be28a141fd23a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.037+0000 7ff59ea00640 1 -- 172.21.15.146:0/226383483 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598037070 con 0x7ff5a006d0c0 2024-04-24T23:01:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.037+0000 7ff59ea00640 1 -- 172.21.15.146:0/226383483 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff598032440 con 0x7ff5a006d0c0 2024-04-24T23:01:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.037+0000 7ff59ea00640 1 -- 172.21.15.146:0/226383483 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598032810 con 0x7ff5a006d0c0 2024-04-24T23:01:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 -- 172.21.15.146:0/226383483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 msgr2=0x7ff5a015f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 --2- 172.21.15.146:0/226383483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a015f9f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00756e0 tx=0x7ff59802a140 comp rx=0 tx=0).stop 2024-04-24T23:01:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 -- 172.21.15.146:0/226383483 shutdown_connections 2024-04-24T23:01:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 --2- 172.21.15.146:0/226383483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a015f9f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 --2- 172.21.15.146:0/226383483 >> v2:172.21.15.203:3300/0 conn(0x7ff5a00ceaf0 0x7ff5a006cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 --2- 172.21.15.146:0/226383483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a0145510 0x7ff5a00728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 -- 172.21.15.146:0/226383483 >> 172.21.15.146:0/226383483 conn(0x7ff5a00b16b0 msgr2=0x7ff5a00b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 -- 172.21.15.146:0/226383483 shutdown_connections 2024-04-24T23:01:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.038+0000 7ff5a7000640 1 -- 172.21.15.146:0/226383483 wait complete. 2024-04-24T23:01:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.040+0000 7ff5a7000640 1 Processor -- start 2024-04-24T23:01:32.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.040+0000 7ff5a7000640 1 -- start start 2024-04-24T23:01:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a00ceaf0 0x7ff5a0134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5a0145510 0x7ff5a015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01458f0 con 0x7ff5a006d0c0 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0072e10 con 0x7ff5a0145510 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff5a7000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a0145a70 con 0x7ff5a00ceaf0 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff59fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff59fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60260/0 (socket says 172.21.15.146:60260) 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.041+0000 7ff59fe00640 1 -- 172.21.15.146:0/167969503 learned_addr learned my addr 172.21.15.146:0/167969503 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 -- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a00ceaf0 msgr2=0x7ff5a0134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a00ceaf0 0x7ff5a0134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 -- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5a0145510 msgr2=0x7ff5a015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5a0145510 0x7ff5a015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 -- 172.21.15.146:0/167969503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a015a3b0 con 0x7ff5a006d0c0 2024-04-24T23:01:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff59fe00640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff59000b4a0 tx=0x7ff59000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590014070 con 0x7ff5a006d0c0 2024-04-24T23:01:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff590010610 con 0x7ff5a006d0c0 2024-04-24T23:01:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590010a00 con 0x7ff5a006d0c0 2024-04-24T23:01:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a01373e0 con 0x7ff5a006d0c0 2024-04-24T23:01:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.042+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a015bcb0 con 0x7ff5a006d0c0 2024-04-24T23:01:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.044+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a0068190 con 0x7ff5a006d0c0 2024-04-24T23:01:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.044+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff590017070 con 0x7ff5a006d0c0 2024-04-24T23:01:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.045+0000 7ff597e00640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 0x7ff57c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.045+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ff59008a670 con 0x7ff5a006d0c0 2024-04-24T23:01:32.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.046+0000 7ff59f400640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 0x7ff57c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.047+0000 7ff59f400640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 0x7ff57c06e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0134330 tx=0x7ff588009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.050+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff590059270 con 0x7ff5a006d0c0 2024-04-24T23:01:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:32.252+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff5a006e9d0 con 0x7ff5a006d0c0 2024-04-24T23:01:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.015+0000 7ff597e00640 1 -- 172.21.15.146:0/167969503 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7ff590058b70 con 0x7ff5a006d0c0 2024-04-24T23:01:33.018 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T23:01:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.018+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 msgr2=0x7ff57c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.018+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 0x7ff57c06e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0134330 tx=0x7ff588009250 comp rx=0 tx=0).stop 2024-04-24T23:01:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 msgr2=0x7ff5a0159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff59000b4a0 tx=0x7ff59000b960 comp rx=0 tx=0).stop 2024-04-24T23:01:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 shutdown_connections 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5a0145510 0x7ff5a015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff57c06be60 0x7ff57c06e320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5a00ceaf0 0x7ff5a0134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 --2- 172.21.15.146:0/167969503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a006d0c0 0x7ff5a0159e70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 >> 172.21.15.146:0/167969503 conn(0x7ff5a00b16b0 msgr2=0x7ff5a00cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 shutdown_connections 2024-04-24T23:01:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.019+0000 7ff5a7000640 1 -- 172.21.15.146:0/167969503 wait complete. 2024-04-24T23:01:33.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:01:33.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.238+0000 7fc73f000640 1 Processor -- start 2024-04-24T23:01:33.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.238+0000 7fc73f000640 1 -- start start 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc73813ef30 0x7fc738141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc738141ab0 0x7fc7380ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7380ce5a0 0x7fc73815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc7381423d0 con 0x7fc738141ab0 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc738070f80 con 0x7fc73813ef30 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc73f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc7380ced40 con 0x7fc7380ce5a0 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc737400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc738141ab0 0x7fc7380ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc737400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc738141ab0 0x7fc7380ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60272/0 (socket says 172.21.15.146:60272) 2024-04-24T23:01:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.240+0000 7fc737400640 1 -- 172.21.15.146:0/603071956 learned_addr learned my addr 172.21.15.146:0/603071956 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc73d000640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7380ce5a0 0x7fc73815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737e00640 1 --2- 172.21.15.146:0/603071956 >> v2:172.21.15.203:3300/0 conn(0x7fc73813ef30 0x7fc738141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737400640 1 -- 172.21.15.146:0/603071956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7380ce5a0 msgr2=0x7fc73815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737400640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7380ce5a0 0x7fc73815fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737400640 1 -- 172.21.15.146:0/603071956 >> v2:172.21.15.203:3300/0 conn(0x7fc73813ef30 msgr2=0x7fc738141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737400640 1 --2- 172.21.15.146:0/603071956 >> v2:172.21.15.203:3300/0 conn(0x7fc73813ef30 0x7fc738141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.241+0000 7fc737400640 1 -- 172.21.15.146:0/603071956 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7380cf020 con 0x7fc738141ab0 2024-04-24T23:01:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.242+0000 7fc737400640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc7380ce060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc7380707a0 tx=0x7fc72402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed1ac47b3c71344 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.242+0000 7fc736a00640 1 -- 172.21.15.146:0/603071956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724037070 con 0x7fc738141ab0 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.242+0000 7fc736a00640 1 -- 172.21.15.146:0/603071956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc724032440 con 0x7fc738141ab0 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.242+0000 7fc736a00640 1 -- 172.21.15.146:0/603071956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724032810 con 0x7fc738141ab0 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 -- 172.21.15.146:0/603071956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 msgr2=0x7fc7380ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc7380ce060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc7380707a0 tx=0x7fc72402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 -- 172.21.15.146:0/603071956 shutdown_connections 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc7380ce060 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 --2- 172.21.15.146:0/603071956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7380ce5a0 0x7fc73815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 --2- 172.21.15.146:0/603071956 >> v2:172.21.15.203:3300/0 conn(0x7fc73813ef30 0x7fc738141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 -- 172.21.15.146:0/603071956 >> 172.21.15.146:0/603071956 conn(0x7fc7380b17b0 msgr2=0x7fc7380b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 -- 172.21.15.146:0/603071956 shutdown_connections 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.243+0000 7fc73f000640 1 -- 172.21.15.146:0/603071956 wait complete. 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.245+0000 7fc73f000640 1 Processor -- start 2024-04-24T23:01:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.245+0000 7fc73f000640 1 -- start start 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7380ce5a0 0x7fc7381f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc73813ef30 0x7fc738144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc7380cea30 con 0x7fc738141ab0 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc738070c10 con 0x7fc7380ce5a0 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc73815ff40 con 0x7fc73813ef30 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60280/0 (socket says 172.21.15.146:60280) 2024-04-24T23:01:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc73d000640 1 -- 172.21.15.146:0/3086947114 learned_addr learned my addr 172.21.15.146:0/3086947114 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc737e00640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7380ce5a0 0x7fc7381f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.246+0000 7fc737400640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc73813ef30 0x7fc738144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 -- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc73813ef30 msgr2=0x7fc738144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc73813ef30 0x7fc738144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 -- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7380ce5a0 msgr2=0x7fc7381f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7380ce5a0 0x7fc7381f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 -- 172.21.15.146:0/3086947114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7380b2dc0 con 0x7fc738141ab0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73d000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc73000cd70 tx=0x7fc73000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc730003b90 con 0x7fc738141ab0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc730003d30 con 0x7fc738141ab0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc730004240 con 0x7fc738141ab0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.247+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7380b30a0 con 0x7fc738141ab0 2024-04-24T23:01:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.248+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7381450b0 con 0x7fc738141ab0 2024-04-24T23:01:33.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.249+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc738072420 con 0x7fc738141ab0 2024-04-24T23:01:33.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.250+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7300043e0 con 0x7fc738141ab0 2024-04-24T23:01:33.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.251+0000 7fc72fe00640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 0x7fc71806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:33.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.251+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7fc73008bdc0 con 0x7fc738141ab0 2024-04-24T23:01:33.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.252+0000 7fc737e00640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 0x7fc71806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:33.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.253+0000 7fc737e00640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 0x7fc71806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc72800aa40 tx=0x7fc728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:33.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.254+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc738072420 con 0x7fc738141ab0 2024-04-24T23:01:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:33.455+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc73804f5a0 con 0x7fc738141ab0 2024-04-24T23:01:34.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.022+0000 7fc72fe00640 1 -- 172.21.15.146:0/3086947114 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7fc73005a7a0 con 0x7fc738141ab0 2024-04-24T23:01:34.024 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T23:01:34.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 msgr2=0x7fc71806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 0x7fc71806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc72800aa40 tx=0x7fc728008040 comp rx=0 tx=0).stop 2024-04-24T23:01:34.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 msgr2=0x7fc738153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc73000cd70 tx=0x7fc73000a660 comp rx=0 tx=0).stop 2024-04-24T23:01:34.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 shutdown_connections 2024-04-24T23:01:34.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc738141ab0 0x7fc738153550 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc71806be30 0x7fc71806e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc73813ef30 0x7fc738144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 --2- 172.21.15.146:0/3086947114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7380ce5a0 0x7fc7381f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.026+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 >> 172.21.15.146:0/3086947114 conn(0x7fc7380b17b0 msgr2=0x7fc738140a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:34.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.027+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 shutdown_connections 2024-04-24T23:01:34.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.028+0000 7fc73f000640 1 -- 172.21.15.146:0/3086947114 wait complete. 2024-04-24T23:01:34.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:01:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.241+0000 7f86d9e00640 1 Processor -- start 2024-04-24T23:01:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.241+0000 7f86d9e00640 1 -- start start 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d9e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f86d4072420 0x7f86d4166d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d9e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d40ced40 con 0x7f86d413ef30 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d9e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d40cf020 con 0x7f86d4141c80 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d9e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f86d41423d0 con 0x7f86d4072420 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f86d413ef30 0x7f86d4141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51020/0 (socket says 172.21.15.146:51020) 2024-04-24T23:01:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.243+0000 7f86d2a00640 1 -- 172.21.15.146:0/3870287398 learned_addr learned my addr 172.21.15.146:0/3870287398 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d3400640 1 --2- 172.21.15.146:0/3870287398 >> v2:172.21.15.203:3300/0 conn(0x7f86d4072420 0x7f86d4166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881516331 0 0) 0x7f86d40ced40 con 0x7f86d413ef30 2024-04-24T23:01:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b8003520 con 0x7f86d413ef30 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1147217190 0 0) 0x7f86b8003520 con 0x7f86d413ef30 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 >> v2:172.21.15.203:3300/0 conn(0x7f86d4072420 msgr2=0x7f86d4166d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 --2- 172.21.15.146:0/3870287398 >> v2:172.21.15.203:3300/0 conn(0x7f86d4072420 0x7f86d4166d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 >> v1:172.21.15.203:6789/0 conn(0x7f86d4141c80 legacy=0x7f86d40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40cf300 con 0x7f86d413ef30 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f86c4001670 con 0x7f86d413ef30 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 >> v1:172.21.15.146:6789/0 conn(0x7f86d413ef30 legacy=0x7f86d4141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 0x7f86b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b8004800 0x7f86b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.244+0000 7f86d1600640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86b80051c0 0x7f86b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86b800c030 con 0x7f86b80039b0 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f86b800c1e0 con 0x7f86b8004800 2024-04-24T23:01:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f86b800c3e0 con 0x7f86b80051c0 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 0x7f86b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 -- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86b80051c0 msgr2=0x7f86b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86b80051c0 0x7f86b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 -- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b8004800 msgr2=0x7f86b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b8004800 0x7f86b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d2a00640 1 -- 172.21.15.146:0/3870287398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b8003520 con 0x7f86b80039b0 2024-04-24T23:01:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.245+0000 7f86d3400640 1 -- 172.21.15.146:0/3870287398 reap_dead start 2024-04-24T23:01:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.246+0000 7f86d2a00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 0x7f86b8003dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c210 tx=0x7f86b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac62339a14f4712 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.246+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4007d30 con 0x7f86b80039b0 2024-04-24T23:01:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.246+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c40058d0 con 0x7f86b80039b0 2024-04-24T23:01:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.246+0000 7f86d1600640 1 -- 172.21.15.146:0/3870287398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4005d20 con 0x7f86b80039b0 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 -- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 msgr2=0x7f86b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 0x7f86b8003dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c210 tx=0x7f86b8005830 comp rx=0 tx=0).stop 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 -- 172.21.15.146:0/3870287398 shutdown_connections 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 --2- 172.21.15.146:0/3870287398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b80039b0 0x7f86b8003dd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 -- 172.21.15.146:0/3870287398 >> 172.21.15.146:0/3870287398 conn(0x7f86d40b17b0 msgr2=0x7f86d40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 -- 172.21.15.146:0/3870287398 shutdown_connections 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.247+0000 7f86d9e00640 1 -- 172.21.15.146:0/3870287398 wait complete. 2024-04-24T23:01:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.249+0000 7f86d9e00640 1 Processor -- start 2024-04-24T23:01:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.249+0000 7f86d9e00640 1 -- start start 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b80039b0 0x7f86d413b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86d4156120 0x7f86d4144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86d4141570 con 0x7f86d413bcf0 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f86d4070f80 con 0x7f86b80039b0 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d9e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f86d41416f0 con 0x7f86d4156120 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.250+0000 7f86d2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60288/0 (socket says 172.21.15.146:60288) 2024-04-24T23:01:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 -- 172.21.15.146:0/662121225 learned_addr learned my addr 172.21.15.146:0/662121225 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d3400640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86d4156120 0x7f86d4144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2a00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b80039b0 0x7f86d413b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 -- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86d4156120 msgr2=0x7f86d4144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86d4156120 0x7f86d4144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 -- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b80039b0 msgr2=0x7f86d413b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b80039b0 0x7f86d413b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 -- 172.21.15.146:0/662121225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d4142570 con 0x7f86d413bcf0 2024-04-24T23:01:34.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.251+0000 7f86d2000640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f86c000c390 tx=0x7f86c000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.252+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00052d0 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.252+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c0005490 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.252+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d4142850 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.252+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0007260 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.252+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d4142e10 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.253+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d404f5a0 con 0x7f86d413bcf0 2024-04-24T23:01:34.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.254+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86c0007400 con 0x7f86d413bcf0 2024-04-24T23:01:34.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.255+0000 7f86cb400640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 0x7f86b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:34.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.255+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f86c008a580 con 0x7f86d413bcf0 2024-04-24T23:01:34.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.256+0000 7f86d2a00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 0x7f86b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:34.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.257+0000 7f86d2a00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 0x7f86b406e320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86c4033000 tx=0x7f86c402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.260+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f86c0058d60 con 0x7f86d413bcf0 2024-04-24T23:01:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:34.501+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86d4072d30 con 0x7f86d413bcf0 2024-04-24T23:01:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.068+0000 7f86cb400640 1 -- 172.21.15.146:0/662121225 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f86c0058660 con 0x7f86d413bcf0 2024-04-24T23:01:35.073 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 5 and data pool 6 2024-04-24T23:01:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.077+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 msgr2=0x7f86b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.077+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 0x7f86b406e320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86c4033000 tx=0x7f86c402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.077+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 msgr2=0x7f86d4155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.077+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f86c000c390 tx=0x7f86c000c850 comp rx=0 tx=0).stop 2024-04-24T23:01:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 shutdown_connections 2024-04-24T23:01:35.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f86b406be60 0x7f86b406e320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86d4156120 0x7f86d4144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86d413bcf0 0x7f86d4155be0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 --2- 172.21.15.146:0/662121225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86b80039b0 0x7f86d413b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.078+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 >> 172.21.15.146:0/662121225 conn(0x7f86d40b17b0 msgr2=0x7f86d40b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.079+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 shutdown_connections 2024-04-24T23:01:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.079+0000 7f86d9e00640 1 -- 172.21.15.146:0/662121225 wait complete. 2024-04-24T23:01:35.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.286+0000 7f1f3c400640 1 Processor -- start 2024-04-24T23:01:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.286+0000 7f1f3c400640 1 -- start start 2024-04-24T23:01:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f3c400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f341445e0 0x7f1f340cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f3c400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f340728c0 0x7f1f340d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f3c400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f341449c0 con 0x7f1f34070c10 2024-04-24T23:01:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f3c400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1f34072430 con 0x7f1f341445e0 2024-04-24T23:01:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f3c400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340b2d70 con 0x7f1f340728c0 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.288+0000 7f1f39a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f341445e0 0x7f1f340cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f341445e0 0x7f1f340cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60306/0 (socket says 172.21.15.146:60306) 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 -- 172.21.15.146:0/3057834181 learned_addr learned my addr 172.21.15.146:0/3057834181 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39000640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f340728c0 0x7f1f340d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 -- 172.21.15.146:0/3057834181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f340728c0 msgr2=0x7f1f340d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f340728c0 0x7f1f340d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 -- 172.21.15.146:0/3057834181 >> v1:172.21.15.203:6789/0 conn(0x7f1f34070c10 legacy=0x7f1f3415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.289+0000 7f1f39a00640 1 -- 172.21.15.146:0/3057834181 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34071820 con 0x7f1f341445e0 2024-04-24T23:01:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.290+0000 7f1f39a00640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f341445e0 0x7f1f340cfc90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009870 tx=0x7f1f2802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bbad89aa10edde server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.290+0000 7f1f33e00640 1 -- 172.21.15.146:0/3057834181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28037070 con 0x7f1f341445e0 2024-04-24T23:01:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.290+0000 7f1f33e00640 1 -- 172.21.15.146:0/3057834181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28032440 con 0x7f1f341445e0 2024-04-24T23:01:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.290+0000 7f1f33e00640 1 -- 172.21.15.146:0/3057834181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28032810 con 0x7f1f341445e0 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 -- 172.21.15.146:0/3057834181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f341445e0 msgr2=0x7f1f340cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f341445e0 0x7f1f340cfc90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009870 tx=0x7f1f2802a210 comp rx=0 tx=0).stop 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 -- 172.21.15.146:0/3057834181 shutdown_connections 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f340728c0 0x7f1f340d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 --2- 172.21.15.146:0/3057834181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f341445e0 0x7f1f340cfc90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 -- 172.21.15.146:0/3057834181 >> 172.21.15.146:0/3057834181 conn(0x7f1f3406b320 msgr2=0x7f1f3406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:35.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 -- 172.21.15.146:0/3057834181 shutdown_connections 2024-04-24T23:01:35.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.291+0000 7f1f3c400640 1 -- 172.21.15.146:0/3057834181 wait complete. 2024-04-24T23:01:35.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.293+0000 7f1f3c400640 1 Processor -- start 2024-04-24T23:01:35.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.293+0000 7f1f3c400640 1 -- start start 2024-04-24T23:01:35.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f34070c10 0x7f1f341319d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 0x7f1f3415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340720c0 con 0x7f1f340728c0 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34071de0 con 0x7f1f34070c10 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.294+0000 7f1f3c400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340710c0 con 0x7f1f341445e0 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60312/0 (socket says 172.21.15.146:60312) 2024-04-24T23:01:35.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 -- 172.21.15.146:0/996014505 learned_addr learned my addr 172.21.15.146:0/996014505 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39a00640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f34070c10 0x7f1f341319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f3a400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 0x7f1f3415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 -- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 msgr2=0x7f1f3415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 0x7f1f3415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 -- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f34070c10 msgr2=0x7f1f341319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f34070c10 0x7f1f341319d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f39000640 1 -- 172.21.15.146:0/996014505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34132090 con 0x7f1f340728c0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.295+0000 7f1f3a400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 0x7f1f3415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f39000640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000d7d0 tx=0x7f1f2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20004020 con 0x7f1f340728c0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f200041e0 con 0x7f1f340728c0 2024-04-24T23:01:35.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f34132370 con 0x7f1f340728c0 2024-04-24T23:01:35.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f200043d0 con 0x7f1f340728c0 2024-04-24T23:01:35.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.296+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f34132930 con 0x7f1f340728c0 2024-04-24T23:01:35.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.297+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f34132d70 con 0x7f1f340728c0 2024-04-24T23:01:35.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.298+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f2001b020 con 0x7f1f340728c0 2024-04-24T23:01:35.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.299+0000 7f1f31600640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.299+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1f2008ae50 con 0x7f1f340728c0 2024-04-24T23:01:35.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.300+0000 7f1f39a00640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.301+0000 7f1f39a00640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 0x7f1f1406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.304+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f20059660 con 0x7f1f340728c0 2024-04-24T23:01:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.500+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f34068190 con 0x7f1f340728c0 2024-04-24T23:01:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.503+0000 7f1f31600640 1 -- 172.21.15.146:0/996014505 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16979 (secure 0 0 0) 0x7f1f20058f60 con 0x7f1f340728c0 2024-04-24T23:01:35.506 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:35.506 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:34.503034+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 msgr2=0x7f1f1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 0x7f1f1406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).stop 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 msgr2=0x7f1f34142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000d7d0 tx=0x7f1f2000dc90 comp rx=0 tx=0).stop 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 shutdown_connections 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1f1406be30 0x7f1f1406e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f341445e0 0x7f1f3415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f340728c0 0x7f1f34142fa0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 --2- 172.21.15.146:0/996014505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f34070c10 0x7f1f341319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 >> 172.21.15.146:0/996014505 conn(0x7f1f3406b320 msgr2=0x7f1f340b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.506+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 shutdown_connections 2024-04-24T23:01:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.507+0000 7f1f3c400640 1 -- 172.21.15.146:0/996014505 wait complete. 2024-04-24T23:01:35.526 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.714+0000 7f6332600640 1 Processor -- start 2024-04-24T23:01:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.714+0000 7f6332600640 1 -- start start 2024-04-24T23:01:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6332600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632c15a410 0x7f632c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6332600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6332600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c06e120 con 0x7f632c15e330 2024-04-24T23:01:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6332600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f632c06e400 con 0x7f632c15a410 2024-04-24T23:01:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6332600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f632c06e6e0 con 0x7f632c06dc50 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.715+0000 7f6331200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632c15a410 0x7f632c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f632c15a410 0x7f632c0aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60320/0 (socket says 172.21.15.146:60320) 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 -- 172.21.15.146:0/2796090691 learned_addr learned my addr 172.21.15.146:0/2796090691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6323e00640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 -- 172.21.15.146:0/2796090691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 msgr2=0x7f632c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c15ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 -- 172.21.15.146:0/2796090691 >> v1:172.21.15.203:6789/0 conn(0x7f632c15e330 legacy=0x7f632c0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.716+0000 7f6331200640 1 -- 172.21.15.146:0/2796090691 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c0af130 con 0x7f632c15a410 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.717+0000 7f6331200640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c0aebf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f631c00aa10 tx=0x7f631c02b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41deb73a82253093 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.717+0000 7f632be00640 1 -- 172.21.15.146:0/2796090691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c00b040 con 0x7f632c15a410 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.717+0000 7f632be00640 1 -- 172.21.15.146:0/2796090691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c030710 con 0x7f632c15a410 2024-04-24T23:01:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.717+0000 7f632be00640 1 -- 172.21.15.146:0/2796090691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c030ae0 con 0x7f632c15a410 2024-04-24T23:01:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 -- 172.21.15.146:0/2796090691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 msgr2=0x7f632c0aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c0aebf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f631c00aa10 tx=0x7f631c02b5d0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 -- 172.21.15.146:0/2796090691 shutdown_connections 2024-04-24T23:01:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 --2- 172.21.15.146:0/2796090691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c0aebf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 -- 172.21.15.146:0/2796090691 >> 172.21.15.146:0/2796090691 conn(0x7f632c06b320 msgr2=0x7f632c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 -- 172.21.15.146:0/2796090691 shutdown_connections 2024-04-24T23:01:35.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.718+0000 7f6332600640 1 -- 172.21.15.146:0/2796090691 wait complete. 2024-04-24T23:01:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.720+0000 7f6332600640 1 Processor -- start 2024-04-24T23:01:35.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.720+0000 7f6332600640 1 -- start start 2024-04-24T23:01:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f632c15e330 0x7f632c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0af320 con 0x7f632c15a410 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0b4140 con 0x7f632c15e330 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6332600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f632c0cfb30 con 0x7f632c06dc50 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6323e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6323e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60336/0 (socket says 172.21.15.146:60336) 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.721+0000 7f6323e00640 1 -- 172.21.15.146:0/413974994 learned_addr learned my addr 172.21.15.146:0/413974994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6331200640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 -- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 msgr2=0x7f632c0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c0c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 -- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f632c15e330 msgr2=0x7f632c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6331c00640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f632c15e330 0x7f632c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f632c15e330 0x7f632c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 -- 172.21.15.146:0/413974994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1f4240 con 0x7f632c15a410 2024-04-24T23:01:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6323e00640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f631400c7f0 tx=0x7f631400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314015070 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6314004220 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314007620 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.722+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c1f4520 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.723+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1f4ae0 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.724+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c04f500 con 0x7f632c15a410 2024-04-24T23:01:35.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.725+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63140079d0 con 0x7f632c15a410 2024-04-24T23:01:35.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.725+0000 7f6329600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 0x7f630806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:35.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.726+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f631408b4c0 con 0x7f632c15a410 2024-04-24T23:01:35.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.726+0000 7f6331200640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 0x7f630806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:35.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.727+0000 7f6331200640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 0x7f630806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f631c035000 tx=0x7f631c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.730+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6314059c40 con 0x7f632c15a410 2024-04-24T23:01:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.914+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f632c06cb00 con 0x7f632c15a410 2024-04-24T23:01:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.918+0000 7f6329600640 1 -- 172.21.15.146:0/413974994 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16979 (secure 0 0 0) 0x7f6314059540 con 0x7f632c15a410 2024-04-24T23:01:35.920 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:35.920 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:34.503034+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 msgr2=0x7f630806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 0x7f630806e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f631c035000 tx=0x7f631c00c040 comp rx=0 tx=0).stop 2024-04-24T23:01:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 msgr2=0x7f632c15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f631400c7f0 tx=0x7f631400ccb0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 shutdown_connections 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f632c15e330 0x7f632c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632c15a410 0x7f632c15bf00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f630806be30 0x7f630806e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 --2- 172.21.15.146:0/413974994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f632c06dc50 0x7f632c0c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 >> 172.21.15.146:0/413974994 conn(0x7f632c06b320 msgr2=0x7f632c1594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 shutdown_connections 2024-04-24T23:01:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:35.920+0000 7f6332600640 1 -- 172.21.15.146:0/413974994 wait complete. 2024-04-24T23:01:35.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:01:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.149+0000 7f98cb200640 1 Processor -- start 2024-04-24T23:01:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.149+0000 7f98cb200640 1 -- start start 2024-04-24T23:01:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98cb200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98c406dd80 0x7f98c406e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98cb200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98c406eb60 0x7f98c40b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98cb200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c415e3f0 con 0x7f98c415e010 2024-04-24T23:01:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98cb200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f98c406ef90 con 0x7f98c406eb60 2024-04-24T23:01:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98cb200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f98c406e230 con 0x7f98c406dd80 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.151+0000 7f98c9200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98c406eb60 0x7f98c40b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98c406eb60 0x7f98c40b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60344/0 (socket says 172.21.15.146:60344) 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 -- 172.21.15.146:0/391289980 learned_addr learned my addr 172.21.15.146:0/391289980 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98bb400640 1 --2- 172.21.15.146:0/391289980 >> v2:172.21.15.203:3300/0 conn(0x7f98c406dd80 0x7f98c406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 -- 172.21.15.146:0/391289980 >> v2:172.21.15.203:3300/0 conn(0x7f98c406dd80 msgr2=0x7f98c406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 --2- 172.21.15.146:0/391289980 >> v2:172.21.15.203:3300/0 conn(0x7f98c406dd80 0x7f98c406e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 -- 172.21.15.146:0/391289980 >> v1:172.21.15.203:6789/0 conn(0x7f98c415e010 legacy=0x7f98c4071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.152+0000 7f98c9200640 1 -- 172.21.15.146:0/391289980 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c406cd20 con 0x7f98c406eb60 2024-04-24T23:01:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.153+0000 7f98c9200640 1 --2- 172.21.15.146:0/391289980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406eb60 0x7f98c40b3810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f98c40d0a90 tx=0x7f98bc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3e6808e3491a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.154+0000 7f98c3400640 1 -- 172.21.15.146:0/391289980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc037070 con 0x7f98c406eb60 2024-04-24T23:01:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.154+0000 7f98c3400640 1 -- 172.21.15.146:0/391289980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc032440 con 0x7f98c406eb60 2024-04-24T23:01:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.154+0000 7f98c3400640 1 -- 172.21.15.146:0/391289980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc032810 con 0x7f98c406eb60 2024-04-24T23:01:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.154+0000 7f98cb200640 1 -- 172.21.15.146:0/391289980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406eb60 msgr2=0x7f98c40b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.154+0000 7f98cb200640 1 --2- 172.21.15.146:0/391289980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406eb60 0x7f98c40b3810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f98c40d0a90 tx=0x7f98bc02a230 comp rx=0 tx=0).stop 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 -- 172.21.15.146:0/391289980 shutdown_connections 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 --2- 172.21.15.146:0/391289980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406eb60 0x7f98c40b3810 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 --2- 172.21.15.146:0/391289980 >> v2:172.21.15.203:3300/0 conn(0x7f98c406dd80 0x7f98c406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 -- 172.21.15.146:0/391289980 >> 172.21.15.146:0/391289980 conn(0x7f98c40b17b0 msgr2=0x7f98c40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 -- 172.21.15.146:0/391289980 shutdown_connections 2024-04-24T23:01:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.155+0000 7f98cb200640 1 -- 172.21.15.146:0/391289980 wait complete. 2024-04-24T23:01:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.156+0000 7f98cb200640 1 Processor -- start 2024-04-24T23:01:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.156+0000 7f98cb200640 1 -- start start 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c406eb60 0x7f98c4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 0x7f98c415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98c406cfc0 con 0x7f98c406dd80 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4071fe0 con 0x7f98c406eb60 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.157+0000 7f98cb200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98c406d2a0 con 0x7f98c415e010 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60348/0 (socket says 172.21.15.146:60348) 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 -- 172.21.15.146:0/3503751637 learned_addr learned my addr 172.21.15.146:0/3503751637 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98bb400640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c406eb60 0x7f98c4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c9200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 0x7f98c415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 -- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 msgr2=0x7f98c415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 0x7f98c415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 -- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c406eb60 msgr2=0x7f98c4155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c406eb60 0x7f98c4155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c3e00640 1 -- 172.21.15.146:0/3503751637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c4153bd0 con 0x7f98c406dd80 2024-04-24T23:01:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.158+0000 7f98c9200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 0x7f98c415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98c3e00640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98b400ba50 tx=0x7f98b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4019070 con 0x7f98c406dd80 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b400cc20 con 0x7f98c406dd80 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014680 con 0x7f98c406dd80 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c41f7ba0 con 0x7f98c406dd80 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.159+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c4148b90 con 0x7f98c406dd80 2024-04-24T23:01:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.160+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c404f5a0 con 0x7f98c406dd80 2024-04-24T23:01:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.161+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98b401c070 con 0x7f98c406dd80 2024-04-24T23:01:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.162+0000 7f98c0c00640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.162+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f98b408ac80 con 0x7f98c406dd80 2024-04-24T23:01:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.163+0000 7f98bb400640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.164+0000 7f98bb400640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 0x7f98a006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f98c415b6a0 tx=0x7f98ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:36.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.166+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98b4058e40 con 0x7f98c406dd80 2024-04-24T23:01:36.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:36.405+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f98c40b3950 con 0x7f98c406dd80 2024-04-24T23:01:37.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.135+0000 7f98c0c00640 1 -- 172.21.15.146:0/3503751637 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f98b405d140 con 0x7f98c406dd80 2024-04-24T23:01:37.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.138+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 msgr2=0x7f98a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:37.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 0x7f98a006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f98c415b6a0 tx=0x7f98ac008040 comp rx=0 tx=0).stop 2024-04-24T23:01:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 msgr2=0x7f98c4152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98b400ba50 tx=0x7f98b400bf10 comp rx=0 tx=0).stop 2024-04-24T23:01:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 shutdown_connections 2024-04-24T23:01:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98a006be60 0x7f98a006e320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98c415e010 0x7f98c415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c406eb60 0x7f98c4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 --2- 172.21.15.146:0/3503751637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98c406dd80 0x7f98c4152d80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 >> 172.21.15.146:0/3503751637 conn(0x7f98c40b17b0 msgr2=0x7f98c40ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 shutdown_connections 2024-04-24T23:01:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.139+0000 7f98cb200640 1 -- 172.21.15.146:0/3503751637 wait complete. 2024-04-24T23:01:37.161 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:01:37.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:01:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.367+0000 7f2adf400640 1 Processor -- start 2024-04-24T23:01:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.367+0000 7f2adf400640 1 -- start start 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adf400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ad8155460 0x7f2ad815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adf400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adf400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad80b3250 con 0x7f2ad806e870 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adf400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad80723f0 con 0x7f2ad8155460 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adf400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad806eca0 con 0x7f2ad80b2ab0 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adca00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ad8155460 0x7f2ad815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adca00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ad8155460 0x7f2ad815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60362/0 (socket says 172.21.15.146:60362) 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.369+0000 7f2adca00640 1 -- 172.21.15.146:0/263631478 learned_addr learned my addr 172.21.15.146:0/263631478 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:37.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.370+0000 7f2ad7e00640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:37.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.370+0000 7f2adca00640 1 -- 172.21.15.146:0/263631478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 msgr2=0x7f2ad806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:37.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.370+0000 7f2adca00640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.370+0000 7f2adca00640 1 -- 172.21.15.146:0/263631478 >> v1:172.21.15.203:6789/0 conn(0x7f2ad806e870 legacy=0x7f2ad815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:37.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.370+0000 7f2adca00640 1 -- 172.21.15.146:0/263631478 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad80b3530 con 0x7f2ad8155460 2024-04-24T23:01:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.371+0000 7f2adca00640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad8155460 0x7f2ad815be40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009870 tx=0x7f2acc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4b93e55a8aa34c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.371+0000 7f2ad7400640 1 -- 172.21.15.146:0/263631478 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc037070 con 0x7f2ad8155460 2024-04-24T23:01:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.371+0000 7f2ad7400640 1 -- 172.21.15.146:0/263631478 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc032440 con 0x7f2ad8155460 2024-04-24T23:01:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.371+0000 7f2ad7400640 1 -- 172.21.15.146:0/263631478 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc032810 con 0x7f2ad8155460 2024-04-24T23:01:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 -- 172.21.15.146:0/263631478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad8155460 msgr2=0x7f2ad815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad8155460 0x7f2ad815be40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009870 tx=0x7f2acc02a210 comp rx=0 tx=0).stop 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 -- 172.21.15.146:0/263631478 shutdown_connections 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 --2- 172.21.15.146:0/263631478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad8155460 0x7f2ad815be40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 -- 172.21.15.146:0/263631478 >> 172.21.15.146:0/263631478 conn(0x7f2ad80b17b0 msgr2=0x7f2ad80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 -- 172.21.15.146:0/263631478 shutdown_connections 2024-04-24T23:01:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.372+0000 7f2adf400640 1 -- 172.21.15.146:0/263631478 wait complete. 2024-04-24T23:01:37.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.374+0000 7f2adf400640 1 Processor -- start 2024-04-24T23:01:37.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.374+0000 7f2adf400640 1 -- start start 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad8154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ad8155460 0x7f2ad8154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad80b2f60 con 0x7f2ad806e870 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8070ec0 con 0x7f2ad8155460 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adf400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad80b3af0 con 0x7f2ad80b2ab0 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60372/0 (socket says 172.21.15.146:60372) 2024-04-24T23:01:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.375+0000 7f2adca00640 1 -- 172.21.15.146:0/684810193 learned_addr learned my addr 172.21.15.146:0/684810193 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 -- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 msgr2=0x7f2ad8154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad8154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 -- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ad8155460 msgr2=0x7f2ad8154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2add400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ad8155460 0x7f2ad8154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ad8155460 0x7f2ad8154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 -- 172.21.15.146:0/684810193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad8158820 con 0x7f2ad806e870 2024-04-24T23:01:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.376+0000 7f2adca00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009870 tx=0x7f2acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.377+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc041020 con 0x7f2ad806e870 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.377+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc0306c0 con 0x7f2ad806e870 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.377+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc037040 con 0x7f2ad806e870 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.377+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad81558e0 con 0x7f2ad806e870 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.377+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad8155ea0 con 0x7f2ad806e870 2024-04-24T23:01:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.378+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad8156680 con 0x7f2ad806e870 2024-04-24T23:01:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.379+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2acc044020 con 0x7f2ad806e870 2024-04-24T23:01:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.380+0000 7f2ad4c00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 0x7f2abc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.380+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2acc0ab7a0 con 0x7f2ad806e870 2024-04-24T23:01:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.380+0000 7f2ad7e00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 0x7f2abc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.381+0000 7f2ad7e00640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 0x7f2abc06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8152870 tx=0x7f2ac8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.384+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2acc04b030 con 0x7f2ad806e870 2024-04-24T23:01:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:37.621+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2ad806ce50 con 0x7f2ad806e870 2024-04-24T23:01:37.999 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:01:37.997+0000 7f041d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:01:38.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.145+0000 7f2ad4c00640 1 -- 172.21.15.146:0/684810193 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f2acc07a050 con 0x7f2ad806e870 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.149+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 msgr2=0x7f2abc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.149+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 0x7f2abc06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8152870 tx=0x7f2ac8008040 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.149+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 msgr2=0x7f2ad814fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.149+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009870 tx=0x7f2acc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 shutdown_connections 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ad8155460 0x7f2ad8154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2abc06be30 0x7f2abc06e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ad80b2ab0 0x7f2ad8154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 --2- 172.21.15.146:0/684810193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ad806e870 0x7f2ad814fbe0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 >> 172.21.15.146:0/684810193 conn(0x7f2ad80b17b0 msgr2=0x7f2ad80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 shutdown_connections 2024-04-24T23:01:38.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.150+0000 7f2adf400640 1 -- 172.21.15.146:0/684810193 wait complete. 2024-04-24T23:01:38.174 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:01:38.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:38.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.377+0000 7f5d07200640 1 Processor -- start 2024-04-24T23:01:38.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.377+0000 7f5d07200640 1 -- start start 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.378+0000 7f5d07200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d0815ddd0 0x7f5d08070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.378+0000 7f5d07200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d08072920 0x7f5d080cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d07200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 0x7f5d080ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d07200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0815e1b0 con 0x7f5d0815ddd0 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d07200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5d080713b0 con 0x7f5d080d0070 2024-04-24T23:01:38.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d07200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d08071690 con 0x7f5d08072920 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d0815ddd0 0x7f5d08070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d0815ddd0 0x7f5d08070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40540/0 (socket says 172.21.15.146:40540) 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 -- 172.21.15.146:0/3366516656 learned_addr learned my addr 172.21.15.146:0/3366516656 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 -- 172.21.15.146:0/3366516656 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d08072920 msgr2=0x7f5d080cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 --2- 172.21.15.146:0/3366516656 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d08072920 0x7f5d080cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 -- 172.21.15.146:0/3366516656 >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 msgr2=0x7f5d080ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d06800640 1 --2- 172.21.15.146:0/3366516656 >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 0x7f5d080ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 --2- 172.21.15.146:0/3366516656 >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 0x7f5d080ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d05e00640 1 -- 172.21.15.146:0/3366516656 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08071970 con 0x7f5d0815ddd0 2024-04-24T23:01:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.379+0000 7f5d06800640 1 --2- 172.21.15.146:0/3366516656 >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 0x7f5d080ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:38.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.380+0000 7f5d05e00640 1 --2- 172.21.15.146:0/3366516656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0815ddd0 0x7f5d08070b60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d080709d0 tx=0x7f5cf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c66e7063e0d779 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.381+0000 7f5d04a00640 1 -- 172.21.15.146:0/3366516656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8037070 con 0x7f5d0815ddd0 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.381+0000 7f5d04a00640 1 -- 172.21.15.146:0/3366516656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf8032440 con 0x7f5d0815ddd0 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.381+0000 7f5d04a00640 1 -- 172.21.15.146:0/3366516656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8032810 con 0x7f5d0815ddd0 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.381+0000 7f5d07200640 1 -- 172.21.15.146:0/3366516656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0815ddd0 msgr2=0x7f5d08070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.381+0000 7f5d07200640 1 --2- 172.21.15.146:0/3366516656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0815ddd0 0x7f5d08070b60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d080709d0 tx=0x7f5cf802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 -- 172.21.15.146:0/3366516656 shutdown_connections 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 --2- 172.21.15.146:0/3366516656 >> v2:172.21.15.203:3300/0 conn(0x7f5d080d0070 0x7f5d080ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 --2- 172.21.15.146:0/3366516656 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d08072920 0x7f5d080cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 --2- 172.21.15.146:0/3366516656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0815ddd0 0x7f5d08070b60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 -- 172.21.15.146:0/3366516656 >> 172.21.15.146:0/3366516656 conn(0x7f5d0806b320 msgr2=0x7f5d0806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 -- 172.21.15.146:0/3366516656 shutdown_connections 2024-04-24T23:01:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.382+0000 7f5d07200640 1 -- 172.21.15.146:0/3366516656 wait complete. 2024-04-24T23:01:38.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.383+0000 7f5d07200640 1 Processor -- start 2024-04-24T23:01:38.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.384+0000 7f5d07200640 1 -- start start 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.384+0000 7f5d07200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d08072920 0x7f5d080ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.384+0000 7f5d07200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d07200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0815ddd0 0x7f5d08154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d07200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080ade00 con 0x7f5d080d0070 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d07200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080710a0 con 0x7f5d08072920 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d07200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080adf80 con 0x7f5d0815ddd0 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40546/0 (socket says 172.21.15.146:40546) 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 -- 172.21.15.146:0/1045788602 learned_addr learned my addr 172.21.15.146:0/1045788602 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05e00640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d08072920 0x7f5d080ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d06800640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0815ddd0 0x7f5d08154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 -- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0815ddd0 msgr2=0x7f5d08154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0815ddd0 0x7f5d08154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 -- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d08072920 msgr2=0x7f5d080ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d08072920 0x7f5d080ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.385+0000 7f5d05400640 1 -- 172.21.15.146:0/1045788602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08155770 con 0x7f5d080d0070 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5d05400640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b4a0 tx=0x7f5cf000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0014070 con 0x7f5d080d0070 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0010610 con 0x7f5d080d0070 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0010a00 con 0x7f5d080d0070 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d08155a50 con 0x7f5d080d0070 2024-04-24T23:01:38.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.386+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d08156010 con 0x7f5d080d0070 2024-04-24T23:01:38.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.387+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0804f500 con 0x7f5d080d0070 2024-04-24T23:01:38.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.388+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf0017070 con 0x7f5d080d0070 2024-04-24T23:01:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.389+0000 7f5cfe000640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 0x7f5ce406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.389+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5cf008aa70 con 0x7f5d080d0070 2024-04-24T23:01:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.390+0000 7f5d05e00640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 0x7f5ce406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.391+0000 7f5d05e00640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 0x7f5ce406e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8034000 tx=0x7f5cf802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.394+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cf0059280 con 0x7f5d080d0070 2024-04-24T23:01:38.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.630+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d081611c0 con 0x7f5d080d0070 2024-04-24T23:01:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.631+0000 7f5cfe000640 1 -- 172.21.15.146:0/1045788602 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7f5cf0058b80 con 0x7f5d080d0070 2024-04-24T23:01:38.633 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:38.633 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:01:37.623540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/784142616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":784142616},{"type":"v1","addr":"172.21.15.146:6835","nonce":784142616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5289,"qdb_cluster":[5289]},"id":2}]} 2024-04-24T23:01:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 16 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 msgr2=0x7f5ce406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 0x7f5ce406e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8034000 tx=0x7f5cf802e000 comp rx=0 tx=0).stop 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 msgr2=0x7f5d081f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b4a0 tx=0x7f5cf000b960 comp rx=0 tx=0).stop 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 shutdown_connections 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce406be60 0x7f5ce406e320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0815ddd0 0x7f5d08154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080d0070 0x7f5d081f4200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 --2- 172.21.15.146:0/1045788602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d08072920 0x7f5d080ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 >> 172.21.15.146:0/1045788602 conn(0x7f5d0806b320 msgr2=0x7f5d080b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:38.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 shutdown_connections 2024-04-24T23:01:38.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.634+0000 7f5d07200640 1 -- 172.21.15.146:0/1045788602 wait complete. 2024-04-24T23:01:38.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:38.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.850+0000 7fadc2400640 1 Processor -- start 2024-04-24T23:01:38.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.850+0000 7fadc2400640 1 -- start start 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.851+0000 7fadc2400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fadbc15ddd0 0x7fadbc070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fadbc0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc2400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc15e1b0 con 0x7fadbc0d0070 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc2400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fadbc0713b0 con 0x7fadbc15ddd0 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fadbc071690 con 0x7fadbc072920 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc1a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fadbc0d0070 0x7fadbc0ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35628/0 (socket says 172.21.15.146:35628) 2024-04-24T23:01:38.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc1a00640 1 -- 172.21.15.146:0/462527810 learned_addr learned my addr 172.21.15.146:0/462527810 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadc1000640 1 --2- 172.21.15.146:0/462527810 >> v2:172.21.15.203:3300/0 conn(0x7fadbc15ddd0 0x7fadbc070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadb3e00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fadbc0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005686332 0 0) 0x7fadbc15e1b0 con 0x7fadbc0d0070 2024-04-24T23:01:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.852+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada0003520 con 0x7fadbc0d0070 2024-04-24T23:01:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1722846083 0 0) 0x7fada0003520 con 0x7fadbc0d0070 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 msgr2=0x7fadbc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fadbc0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 >> v2:172.21.15.203:3300/0 conn(0x7fadbc15ddd0 msgr2=0x7fadbc070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 --2- 172.21.15.146:0/462527810 >> v2:172.21.15.203:3300/0 conn(0x7fadbc15ddd0 0x7fadbc070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc071970 con 0x7fadbc0d0070 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fadb4001a10 con 0x7fadbc0d0070 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 >> v1:172.21.15.146:6789/0 conn(0x7fadbc0d0070 legacy=0x7fadbc0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fada0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fada0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada0004d40 0x7fada00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc0713b0 con 0x7fada00039b0 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc071690 con 0x7fada0004d40 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fada000ba10 con 0x7fadbc072920 2024-04-24T23:01:38.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.853+0000 7fadc1000640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fada0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadb3e00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fada0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1000640 1 -- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 msgr2=0x7fada0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1000640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc072920 0x7fada0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1000640 1 -- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada0004d40 msgr2=0x7fada00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1a00640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada0004d40 0x7fada00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1000640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada0004d40 0x7fada00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.854+0000 7fadc1000640 1 -- 172.21.15.146:0/462527810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada0003520 con 0x7fada00039b0 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.855+0000 7fadc1000640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fada0003dd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fadac009ac0 tx=0x7fada0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608320dd7fba83c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.855+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac036070 con 0x7fada00039b0 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.855+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac031400 con 0x7fada00039b0 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.855+0000 7fadbbe00640 1 -- 172.21.15.146:0/462527810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac009690 con 0x7fada00039b0 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 -- 172.21.15.146:0/462527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 msgr2=0x7fada0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 --2- 172.21.15.146:0/462527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fada0003dd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fadac009ac0 tx=0x7fada0005830 comp rx=0 tx=0).stop 2024-04-24T23:01:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc1a00640 1 -- 172.21.15.146:0/462527810 reap_dead start 2024-04-24T23:01:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 -- 172.21.15.146:0/462527810 shutdown_connections 2024-04-24T23:01:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 -- 172.21.15.146:0/462527810 >> 172.21.15.146:0/462527810 conn(0x7fadbc06b320 msgr2=0x7fadbc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 -- 172.21.15.146:0/462527810 shutdown_connections 2024-04-24T23:01:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.856+0000 7fadc2400640 1 -- 172.21.15.146:0/462527810 wait complete. 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.858+0000 7fadc2400640 1 Processor -- start 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.858+0000 7fadc2400640 1 -- start start 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadbc1f8070 0x7fadbc144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc147740 0x7fadbc147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc0b3c10 con 0x7fada00039b0 2024-04-24T23:01:38.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc0710a0 con 0x7fadbc1f8070 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fadbc0b3d90 con 0x7fadbc147740 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40552/0 (socket says 172.21.15.146:40552) 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc1000640 1 -- 172.21.15.146:0/3457396826 learned_addr learned my addr 172.21.15.146:0/3457396826 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc1000640 1 -- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc147740 msgr2=0x7fadbc147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.859+0000 7fadc1000640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc147740 0x7fadbc147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc1000640 1 -- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadbc1f8070 msgr2=0x7fadbc144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc1000640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadbc1f8070 0x7fadbc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc1000640 1 -- 172.21.15.146:0/3457396826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc0ce230 con 0x7fada00039b0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc1000640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fadac034040 tx=0x7fadac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac040020 con 0x7fada00039b0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac003b40 con 0x7fada00039b0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac036040 con 0x7fada00039b0 2024-04-24T23:01:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc0ce510 con 0x7fada00039b0 2024-04-24T23:01:38.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.860+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadbc0cead0 con 0x7fada00039b0 2024-04-24T23:01:38.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.861+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc070d40 con 0x7fada00039b0 2024-04-24T23:01:38.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.862+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadac043020 con 0x7fada00039b0 2024-04-24T23:01:38.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.863+0000 7fadb9600640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 0x7fad9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:38.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.863+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fadac0ab290 con 0x7fada00039b0 2024-04-24T23:01:38.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.864+0000 7fadb3e00640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 0x7fad9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:38.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.865+0000 7fadb3e00640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 0x7fad9806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fada4006a90 tx=0x7fada4006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:38.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:38.868+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadbc070d40 con 0x7fada00039b0 2024-04-24T23:01:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.068+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadbc04f500 con 0x7fada00039b0 2024-04-24T23:01:39.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.071+0000 7fadb9600640 1 -- 172.21.15.146:0/3457396826 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16966 (secure 0 0 0) 0x7fadac04a070 con 0x7fada00039b0 2024-04-24T23:01:39.074 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:39.074 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":41,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:36.067435+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 msgr2=0x7fad9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 0x7fad9806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fada4006a90 tx=0x7fada4006a20 comp rx=0 tx=0).stop 2024-04-24T23:01:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 msgr2=0x7fadbc0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fadac034040 tx=0x7fadac004730 comp rx=0 tx=0).stop 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 shutdown_connections 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fad9806be30 0x7fad9806e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadbc147740 0x7fadbc147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadbc1f8070 0x7fadbc144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 --2- 172.21.15.146:0/3457396826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada00039b0 0x7fadbc0cd8e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 >> 172.21.15.146:0/3457396826 conn(0x7fadbc06b320 msgr2=0x7fadbc0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 shutdown_connections 2024-04-24T23:01:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.074+0000 7fadc2400640 1 -- 172.21.15.146:0/3457396826 wait complete. 2024-04-24T23:01:39.096 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:01:39.096 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:01:39.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.292+0000 7f8b35a00640 1 Processor -- start 2024-04-24T23:01:39.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.292+0000 7f8b35a00640 1 -- start start 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b300cfda0 0x7f8b301638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 0x7f8b30161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b30163e10 con 0x7f8b30072560 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8b30072cc0 con 0x7f8b300cfda0 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8b300cf4b0 con 0x7f8b300d0180 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b2fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b300cfda0 0x7f8b301638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b27400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8b30072560 0x7f8b30163190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35642/0 (socket says 172.21.15.146:35642) 2024-04-24T23:01:39.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b27400640 1 -- 172.21.15.146:0/1445588468 learned_addr learned my addr 172.21.15.146:0/1445588468 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.294+0000 7f8b35000640 1 --2- 172.21.15.146:0/1445588468 >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 0x7f8b30161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.295+0000 7f8b2fe00640 1 -- 172.21.15.146:0/1445588468 >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 msgr2=0x7f8b30161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.295+0000 7f8b2fe00640 1 --2- 172.21.15.146:0/1445588468 >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 0x7f8b30161be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.295+0000 7f8b2fe00640 1 -- 172.21.15.146:0/1445588468 >> v1:172.21.15.146:6789/0 conn(0x7f8b30072560 legacy=0x7f8b30163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.295+0000 7f8b2fe00640 1 -- 172.21.15.146:0/1445588468 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b30070b00 con 0x7f8b300cfda0 2024-04-24T23:01:39.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.295+0000 7f8b35000640 1 --2- 172.21.15.146:0/1445588468 >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 0x7f8b30161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:39.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.296+0000 7f8b2fe00640 1 --2- 172.21.15.146:0/1445588468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b300cfda0 0x7f8b301638d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8b30071df0 tx=0x7f8b2002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecc2b9c0159362d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.296+0000 7f8b2f400640 1 -- 172.21.15.146:0/1445588468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20037070 con 0x7f8b300cfda0 2024-04-24T23:01:39.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.296+0000 7f8b2f400640 1 -- 172.21.15.146:0/1445588468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2002add0 con 0x7f8b300cfda0 2024-04-24T23:01:39.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.296+0000 7f8b2f400640 1 -- 172.21.15.146:0/1445588468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20032660 con 0x7f8b300cfda0 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 -- 172.21.15.146:0/1445588468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b300cfda0 msgr2=0x7f8b301638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 --2- 172.21.15.146:0/1445588468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b300cfda0 0x7f8b301638d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8b30071df0 tx=0x7f8b2002a080 comp rx=0 tx=0).stop 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 -- 172.21.15.146:0/1445588468 shutdown_connections 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 --2- 172.21.15.146:0/1445588468 >> v2:172.21.15.203:3300/0 conn(0x7f8b300d0180 0x7f8b30161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 --2- 172.21.15.146:0/1445588468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b300cfda0 0x7f8b301638d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 -- 172.21.15.146:0/1445588468 >> 172.21.15.146:0/1445588468 conn(0x7f8b3006b320 msgr2=0x7f8b3006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 -- 172.21.15.146:0/1445588468 shutdown_connections 2024-04-24T23:01:39.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.297+0000 7f8b35a00640 1 -- 172.21.15.146:0/1445588468 wait complete. 2024-04-24T23:01:39.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.299+0000 7f8b35a00640 1 Processor -- start 2024-04-24T23:01:39.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.299+0000 7f8b35a00640 1 -- start start 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b300cfda0 0x7f8b301f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b300d0180 0x7f8b3015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30162120 con 0x7f8b30072560 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30070da0 con 0x7f8b300d0180 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.300+0000 7f8b35a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b301622a0 con 0x7f8b300cfda0 2024-04-24T23:01:39.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40556/0 (socket says 172.21.15.146:40556) 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 -- 172.21.15.146:0/3307152971 learned_addr learned my addr 172.21.15.146:0/3307152971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 -- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b300cfda0 msgr2=0x7f8b301f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b27400640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b300cfda0 0x7f8b301f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b300cfda0 0x7f8b301f92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 -- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b300d0180 msgr2=0x7f8b3015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b300d0180 0x7f8b3015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 -- 172.21.15.146:0/3307152971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3015c990 con 0x7f8b30072560 2024-04-24T23:01:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.301+0000 7f8b2fe00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b20035040 tx=0x7f8b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.302+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20037040 con 0x7f8b30072560 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.302+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2003b430 con 0x7f8b30072560 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.302+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2003b820 con 0x7f8b30072560 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.302+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b30158fc0 con 0x7f8b30072560 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.302+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b30159580 con 0x7f8b30072560 2024-04-24T23:01:39.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.303+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3004f500 con 0x7f8b30072560 2024-04-24T23:01:39.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.304+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b20044020 con 0x7f8b30072560 2024-04-24T23:01:39.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.305+0000 7f8b2cc00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 0x7f8b0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.305+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f8b200ab170 con 0x7f8b30072560 2024-04-24T23:01:39.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.306+0000 7f8b27400640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 0x7f8b0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.307+0000 7f8b27400640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 0x7f8b0c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b3015a9d0 tx=0x7f8b18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.310+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b200798f0 con 0x7f8b30072560 2024-04-24T23:01:39.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.511+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b301574a0 con 0x7f8b0c06be30 2024-04-24T23:01:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.529+0000 7f8b2cc00640 1 -- 172.21.15.146:0/3307152971 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238145 (secure 0 0 0) 0x7f8b18005850 con 0x7f8b0c06be30 2024-04-24T23:01:39.534 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:01:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 msgr2=0x7f8b0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 0x7f8b0c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b3015a9d0 tx=0x7f8b18009040 comp rx=0 tx=0).stop 2024-04-24T23:01:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 msgr2=0x7f8b301f9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b20035040 tx=0x7f8b200046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 shutdown_connections 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b300d0180 0x7f8b3015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b0c06be30 0x7f8b0c06e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b300cfda0 0x7f8b301f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.534+0000 7f8b35a00640 1 --2- 172.21.15.146:0/3307152971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b30072560 0x7f8b301f9930 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.535+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 >> 172.21.15.146:0/3307152971 conn(0x7f8b3006b320 msgr2=0x7f8b301600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.535+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 shutdown_connections 2024-04-24T23:01:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.535+0000 7f8b35a00640 1 -- 172.21.15.146:0/3307152971 wait complete. 2024-04-24T23:01:39.556 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-04-24T23:01:37.623576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220696,"kb_used_data":4476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754024,"statfs":{"total":773094113280,"available":772868120576,"internally_reserved":0,"allocated":4583424,"data_stored":2587557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.604671"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216791+0000","last_change":"2024-04-24T23:01:35.095245+0000","last_active":"2024-04-24T23:01:36.216791+0000","last_peered":"2024-04-24T23:01:36.216791+0000","last_clean":"2024-04-24T23:01:36.216791+0000","last_became_active":"2024-04-24T23:01:35.094968+0000","last_became_peered":"2024-04-24T23:01:35.094968+0000","last_unstale":"2024-04-24T23:01:36.216791+0000","last_undegraded":"2024-04-24T23:01:36.216791+0000","last_fullsized":"2024-04-24T23:01:36.216791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:30.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217136+0000","last_change":"2024-04-24T23:01:35.093372+0000","last_active":"2024-04-24T23:01:36.217136+0000","last_peered":"2024-04-24T23:01:36.217136+0000","last_clean":"2024-04-24T23:01:36.217136+0000","last_became_active":"2024-04-24T23:01:35.093125+0000","last_became_peered":"2024-04-24T23:01:35.093125+0000","last_unstale":"2024-04-24T23:01:36.217136+0000","last_undegraded":"2024-04-24T23:01:36.217136+0000","last_fullsized":"2024-04-24T23:01:36.217136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:29.225136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215773+0000","last_change":"2024-04-24T23:01:34.049786+0000","last_active":"2024-04-24T23:01:36.215773+0000","last_peered":"2024-04-24T23:01:36.215773+0000","last_clean":"2024-04-24T23:01:36.215773+0000","last_became_active":"2024-04-24T23:01:34.049502+0000","last_became_peered":"2024-04-24T23:01:34.049502+0000","last_unstale":"2024-04-24T23:01:36.215773+0000","last_undegraded":"2024-04-24T23:01:36.215773+0000","last_fullsized":"2024-04-24T23:01:36.215773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:05.363580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216028+0000","last_change":"2024-04-24T23:01:34.059174+0000","last_active":"2024-04-24T23:01:36.216028+0000","last_peered":"2024-04-24T23:01:36.216028+0000","last_clean":"2024-04-24T23:01:36.216028+0000","last_became_active":"2024-04-24T23:01:34.058836+0000","last_became_peered":"2024-04-24T23:01:34.058836+0000","last_unstale":"2024-04-24T23:01:36.216028+0000","last_undegraded":"2024-04-24T23:01:36.216028+0000","last_fullsized":"2024-04-24T23:01:36.216028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:15.549788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216326+0000","last_change":"2024-04-24T23:01:35.098269+0000","last_active":"2024-04-24T23:01:36.216326+0000","last_peered":"2024-04-24T23:01:36.216326+0000","last_clean":"2024-04-24T23:01:36.216326+0000","last_became_active":"2024-04-24T23:01:35.097983+0000","last_became_peered":"2024-04-24T23:01:35.097983+0000","last_unstale":"2024-04-24T23:01:36.216326+0000","last_undegraded":"2024-04-24T23:01:36.216326+0000","last_fullsized":"2024-04-24T23:01:36.216326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:19.506894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:34.016342+0000","last_change":"2024-04-24T23:01:34.016342+0000","last_active":"2024-04-24T23:01:34.016342+0000","last_peered":"2024-04-24T23:01:34.016342+0000","last_clean":"2024-04-24T23:01:34.016342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:34.016342+0000","last_undegraded":"2024-04-24T23:01:34.016342+0000","last_fullsized":"2024-04-24T23:01:34.016342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:01:33.002531+0000","last_change":"2024-04-24T23:01:33.002531+0000","last_active":"2024-04-24T23:01:33.002531+0000","last_peered":"2024-04-24T23:01:33.002531+0000","last_clean":"2024-04-24T23:01:33.002531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:01:33.002531+0000","last_undegraded":"2024-04-24T23:01:33.002531+0000","last_fullsized":"2024-04-24T23:01:33.002531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-24T23:01:27.345432+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:01:27.345432+0000","last_peered":"2024-04-24T23:01:27.345432+0000","last_clean":"2024-04-24T23:01:27.345432+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:01:27.345432+0000","last_undegraded":"2024-04-24T23:01:27.345432+0000","last_fullsized":"2024-04-24T23:01:27.345432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":4,"acting":4,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":762806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":172438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":790123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:01:39.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:01:39.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.802+0000 7f181b200640 1 Processor -- start 2024-04-24T23:01:39.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.802+0000 7f181b200640 1 -- start start 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f181b200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f181c06d770 0x7f181c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f181b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c0ccb10 con 0x7f181c0d0240 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f181b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c06ddc0 con 0x7f181c15a980 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f181b200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f181c0aede0 con 0x7f181c06d770 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f1819400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f181c0d0240 0x7f181c0ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35646/0 (socket says 172.21.15.146:35646) 2024-04-24T23:01:39.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.804+0000 7f1819400640 1 -- 172.21.15.146:0/3835912868 learned_addr learned my addr 172.21.15.146:0/3835912868 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f181a800640 1 --2- 172.21.15.146:0/3835912868 >> v2:172.21.15.203:3300/0 conn(0x7f181c06d770 0x7f181c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404711633 0 0) 0x7f1804001490 con 0x7f181c0d0240 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003520 con 0x7f181c0d0240 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2114545530 0 0) 0x7f17fc003520 con 0x7f181c0d0240 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 >> v2:172.21.15.203:3300/0 conn(0x7f181c06d770 msgr2=0x7f181c071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 --2- 172.21.15.146:0/3835912868 >> v2:172.21.15.203:3300/0 conn(0x7f181c06d770 0x7f181c071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 >> v1:172.21.15.203:6789/0 conn(0x7f181c15a980 legacy=0x7f181c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c06e0a0 con 0x7f181c0d0240 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1804001bc0 con 0x7f181c0d0240 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 >> v1:172.21.15.146:6789/0 conn(0x7f181c0d0240 legacy=0x7f181c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 0x7f17fc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc004800 0x7f17fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17fc0052e0 0x7f17fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f181c0aede0 con 0x7f17fc0039b0 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc00c190 con 0x7f17fc0052e0 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc00c390 con 0x7f17fc004800 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.805+0000 7f1819e00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 0x7f17fc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f1819e00640 1 -- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc004800 msgr2=0x7f17fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f1819e00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc004800 0x7f17fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f1819e00640 1 -- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17fc0052e0 msgr2=0x7f17fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:39.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f1819e00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17fc0052e0 0x7f17fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f1819e00640 1 -- 172.21.15.146:0/3835912868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc003520 con 0x7f17fc0039b0 2024-04-24T23:01:39.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.806+0000 7f181a800640 1 -- 172.21.15.146:0/3835912868 reap_dead start 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.807+0000 7f1819e00640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 0x7f17fc003db0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f180c003d80 tx=0x7f17fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bf5925fbefebb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.807+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c037070 con 0x7f17fc0039b0 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.807+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c02a9d0 con 0x7f17fc0039b0 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.807+0000 7f1818a00640 1 -- 172.21.15.146:0/3835912868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c003980 con 0x7f17fc0039b0 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 -- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 msgr2=0x7f17fc003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 0x7f17fc003db0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f180c003d80 tx=0x7f17fc005830 comp rx=0 tx=0).stop 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 -- 172.21.15.146:0/3835912868 shutdown_connections 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 --2- 172.21.15.146:0/3835912868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc0039b0 0x7f17fc003db0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 -- 172.21.15.146:0/3835912868 >> 172.21.15.146:0/3835912868 conn(0x7f181c06b320 msgr2=0x7f181c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 -- 172.21.15.146:0/3835912868 shutdown_connections 2024-04-24T23:01:39.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.808+0000 7f181b200640 1 -- 172.21.15.146:0/3835912868 wait complete. 2024-04-24T23:01:39.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.810+0000 7f181b200640 1 Processor -- start 2024-04-24T23:01:39.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.810+0000 7f181b200640 1 -- start start 2024-04-24T23:01:39.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc0039b0 0x7f181c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181c15c740 0x7f181c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f181c15ad60 con 0x7f181c1493e0 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f181c06e660 con 0x7f181c15c740 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f181c15aee0 con 0x7f17fc0039b0 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40576/0 (socket says 172.21.15.146:40576) 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f181a800640 1 -- 172.21.15.146:0/526013429 learned_addr learned my addr 172.21.15.146:0/526013429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f1819400640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181c15c740 0x7f181c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.811+0000 7f1819e00640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc0039b0 0x7f181c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 -- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc0039b0 msgr2=0x7f181c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc0039b0 0x7f181c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 -- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181c15c740 msgr2=0x7f181c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:39.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181c15c740 0x7f181c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:39.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 -- 172.21.15.146:0/526013429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c15cf30 con 0x7f181c1493e0 2024-04-24T23:01:39.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181a800640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f181c0af4a0 tx=0x7f181400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814004240 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814017070 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814003610 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.812+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c15d210 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.813+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c15d7d0 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.814+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c04f500 con 0x7f181c1493e0 2024-04-24T23:01:39.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.815+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18140037b0 con 0x7f181c1493e0 2024-04-24T23:01:39.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.816+0000 7f1812000640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 0x7f17f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:39.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.816+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f181408aa50 con 0x7f181c1493e0 2024-04-24T23:01:39.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.817+0000 7f1819e00640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 0x7f17f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:39.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.818+0000 7f1819e00640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 0x7f17f806e320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f180c034000 tx=0x7f180c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:39.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:39.821+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1814059260 con 0x7f181c1493e0 2024-04-24T23:01:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.016+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f181c1577c0 con 0x7f17f806be60 2024-04-24T23:01:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.036+0000 7f1812000640 1 -- 172.21.15.146:0/526013429 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f181c1577c0 con 0x7f17f806be60 2024-04-24T23:01:40.042 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 msgr2=0x7f17f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 0x7f17f806e320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f180c034000 tx=0x7f180c02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 msgr2=0x7f181c146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f181c0af4a0 tx=0x7f181400d8a0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 shutdown_connections 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f181c1493e0 0x7f181c146f80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181c15c740 0x7f181c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f17f806be60 0x7f17f806e320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 --2- 172.21.15.146:0/526013429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17fc0039b0 0x7f181c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 >> 172.21.15.146:0/526013429 conn(0x7f181c06b320 msgr2=0x7f181c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 shutdown_connections 2024-04-24T23:01:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.042+0000 7f181b200640 1 -- 172.21.15.146:0/526013429 wait complete. 2024-04-24T23:01:40.065 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-24T23:01:39.624292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2778940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.007056"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080643+0000","last_change":"2024-04-24T23:01:35.089751+0000","last_active":"2024-04-24T23:01:36.080643+0000","last_peered":"2024-04-24T23:01:36.080643+0000","last_clean":"2024-04-24T23:01:36.080643+0000","last_became_active":"2024-04-24T23:01:35.089502+0000","last_became_peered":"2024-04-24T23:01:35.089502+0000","last_unstale":"2024-04-24T23:01:36.080643+0000","last_undegraded":"2024-04-24T23:01:36.080643+0000","last_fullsized":"2024-04-24T23:01:36.080643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:56.543582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217809+0000","last_change":"2024-04-24T23:01:35.092330+0000","last_active":"2024-04-24T23:01:36.217809+0000","last_peered":"2024-04-24T23:01:36.217809+0000","last_clean":"2024-04-24T23:01:36.217809+0000","last_became_active":"2024-04-24T23:01:35.091871+0000","last_became_peered":"2024-04-24T23:01:35.091871+0000","last_unstale":"2024-04-24T23:01:36.217809+0000","last_undegraded":"2024-04-24T23:01:36.217809+0000","last_fullsized":"2024-04-24T23:01:36.217809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:14:04.152158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080177+0000","last_change":"2024-04-24T23:01:35.099083+0000","last_active":"2024-04-24T23:01:36.080177+0000","last_peered":"2024-04-24T23:01:36.080177+0000","last_clean":"2024-04-24T23:01:36.080177+0000","last_became_active":"2024-04-24T23:01:35.097154+0000","last_became_peered":"2024-04-24T23:01:35.097154+0000","last_unstale":"2024-04-24T23:01:36.080177+0000","last_undegraded":"2024-04-24T23:01:36.080177+0000","last_fullsized":"2024-04-24T23:01:36.080177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:40:13.744928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079477+0000","last_change":"2024-04-24T23:01:35.089662+0000","last_active":"2024-04-24T23:01:36.079477+0000","last_peered":"2024-04-24T23:01:36.079477+0000","last_clean":"2024-04-24T23:01:36.079477+0000","last_became_active":"2024-04-24T23:01:35.089190+0000","last_became_peered":"2024-04-24T23:01:35.089190+0000","last_unstale":"2024-04-24T23:01:36.079477+0000","last_undegraded":"2024-04-24T23:01:36.079477+0000","last_fullsized":"2024-04-24T23:01:36.079477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:57.816602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081681+0000","last_change":"2024-04-24T23:01:35.089987+0000","last_active":"2024-04-24T23:01:36.081681+0000","last_peered":"2024-04-24T23:01:36.081681+0000","last_clean":"2024-04-24T23:01:36.081681+0000","last_became_active":"2024-04-24T23:01:35.089713+0000","last_became_peered":"2024-04-24T23:01:35.089713+0000","last_unstale":"2024-04-24T23:01:36.081681+0000","last_undegraded":"2024-04-24T23:01:36.081681+0000","last_fullsized":"2024-04-24T23:01:36.081681+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:41.347387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216347+0000","last_change":"2024-04-24T23:01:35.092621+0000","last_active":"2024-04-24T23:01:36.216347+0000","last_peered":"2024-04-24T23:01:36.216347+0000","last_clean":"2024-04-24T23:01:36.216347+0000","last_became_active":"2024-04-24T23:01:35.089928+0000","last_became_peered":"2024-04-24T23:01:35.089928+0000","last_unstale":"2024-04-24T23:01:36.216347+0000","last_undegraded":"2024-04-24T23:01:36.216347+0000","last_fullsized":"2024-04-24T23:01:36.216347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:05:05.988303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078372+0000","last_change":"2024-04-24T23:01:35.086716+0000","last_active":"2024-04-24T23:01:36.078372+0000","last_peered":"2024-04-24T23:01:36.078372+0000","last_clean":"2024-04-24T23:01:36.078372+0000","last_became_active":"2024-04-24T23:01:35.086423+0000","last_became_peered":"2024-04-24T23:01:35.086423+0000","last_unstale":"2024-04-24T23:01:36.078372+0000","last_undegraded":"2024-04-24T23:01:36.078372+0000","last_fullsized":"2024-04-24T23:01:36.078372+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:41.755127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079371+0000","last_change":"2024-04-24T23:01:35.100607+0000","last_active":"2024-04-24T23:01:36.079371+0000","last_peered":"2024-04-24T23:01:36.079371+0000","last_clean":"2024-04-24T23:01:36.079371+0000","last_became_active":"2024-04-24T23:01:35.099858+0000","last_became_peered":"2024-04-24T23:01:35.099858+0000","last_unstale":"2024-04-24T23:01:36.079371+0000","last_undegraded":"2024-04-24T23:01:36.079371+0000","last_fullsized":"2024-04-24T23:01:36.079371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:24.653632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.082104+0000","last_change":"2024-04-24T23:01:35.095050+0000","last_active":"2024-04-24T23:01:36.082104+0000","last_peered":"2024-04-24T23:01:36.082104+0000","last_clean":"2024-04-24T23:01:36.082104+0000","last_became_active":"2024-04-24T23:01:35.094745+0000","last_became_peered":"2024-04-24T23:01:35.094745+0000","last_unstale":"2024-04-24T23:01:36.082104+0000","last_undegraded":"2024-04-24T23:01:36.082104+0000","last_fullsized":"2024-04-24T23:01:36.082104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:57.539676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079641+0000","last_change":"2024-04-24T23:01:35.079561+0000","last_active":"2024-04-24T23:01:36.079641+0000","last_peered":"2024-04-24T23:01:36.079641+0000","last_clean":"2024-04-24T23:01:36.079641+0000","last_became_active":"2024-04-24T23:01:35.078608+0000","last_became_peered":"2024-04-24T23:01:35.078608+0000","last_unstale":"2024-04-24T23:01:36.079641+0000","last_undegraded":"2024-04-24T23:01:36.079641+0000","last_fullsized":"2024-04-24T23:01:36.079641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:05.729196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095985+0000","last_change":"2024-04-24T23:01:35.098709+0000","last_active":"2024-04-24T23:01:36.095985+0000","last_peered":"2024-04-24T23:01:36.095985+0000","last_clean":"2024-04-24T23:01:36.095985+0000","last_became_active":"2024-04-24T23:01:35.098354+0000","last_became_peered":"2024-04-24T23:01:35.098354+0000","last_unstale":"2024-04-24T23:01:36.095985+0000","last_undegraded":"2024-04-24T23:01:36.095985+0000","last_fullsized":"2024-04-24T23:01:36.095985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:55.951707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.082090+0000","last_change":"2024-04-24T23:01:35.093592+0000","last_active":"2024-04-24T23:01:36.082090+0000","last_peered":"2024-04-24T23:01:36.082090+0000","last_clean":"2024-04-24T23:01:36.082090+0000","last_became_active":"2024-04-24T23:01:35.092089+0000","last_became_peered":"2024-04-24T23:01:35.092089+0000","last_unstale":"2024-04-24T23:01:36.082090+0000","last_undegraded":"2024-04-24T23:01:36.082090+0000","last_fullsized":"2024-04-24T23:01:36.082090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:10.372349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079129+0000","last_change":"2024-04-24T23:01:35.077666+0000","last_active":"2024-04-24T23:01:36.079129+0000","last_peered":"2024-04-24T23:01:36.079129+0000","last_clean":"2024-04-24T23:01:36.079129+0000","last_became_active":"2024-04-24T23:01:35.076643+0000","last_became_peered":"2024-04-24T23:01:35.076643+0000","last_unstale":"2024-04-24T23:01:36.079129+0000","last_undegraded":"2024-04-24T23:01:36.079129+0000","last_fullsized":"2024-04-24T23:01:36.079129+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:01.861694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215287+0000","last_change":"2024-04-24T23:01:35.101956+0000","last_active":"2024-04-24T23:01:36.215287+0000","last_peered":"2024-04-24T23:01:36.215287+0000","last_clean":"2024-04-24T23:01:36.215287+0000","last_became_active":"2024-04-24T23:01:35.101650+0000","last_became_peered":"2024-04-24T23:01:35.101650+0000","last_unstale":"2024-04-24T23:01:36.215287+0000","last_undegraded":"2024-04-24T23:01:36.215287+0000","last_fullsized":"2024-04-24T23:01:36.215287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:36:30.635489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215540+0000","last_change":"2024-04-24T23:01:35.085607+0000","last_active":"2024-04-24T23:01:36.215540+0000","last_peered":"2024-04-24T23:01:36.215540+0000","last_clean":"2024-04-24T23:01:36.215540+0000","last_became_active":"2024-04-24T23:01:35.085238+0000","last_became_peered":"2024-04-24T23:01:35.085238+0000","last_unstale":"2024-04-24T23:01:36.215540+0000","last_undegraded":"2024-04-24T23:01:36.215540+0000","last_fullsized":"2024-04-24T23:01:36.215540+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:49:22.250226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.077926+0000","last_change":"2024-04-24T23:01:35.107443+0000","last_active":"2024-04-24T23:01:36.077926+0000","last_peered":"2024-04-24T23:01:36.077926+0000","last_clean":"2024-04-24T23:01:36.077926+0000","last_became_active":"2024-04-24T23:01:35.105277+0000","last_became_peered":"2024-04-24T23:01:35.105277+0000","last_unstale":"2024-04-24T23:01:36.077926+0000","last_undegraded":"2024-04-24T23:01:36.077926+0000","last_fullsized":"2024-04-24T23:01:36.077926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:51.033079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217418+0000","last_change":"2024-04-24T23:01:35.092047+0000","last_active":"2024-04-24T23:01:36.217418+0000","last_peered":"2024-04-24T23:01:36.217418+0000","last_clean":"2024-04-24T23:01:36.217418+0000","last_became_active":"2024-04-24T23:01:35.091767+0000","last_became_peered":"2024-04-24T23:01:35.091767+0000","last_unstale":"2024-04-24T23:01:36.217418+0000","last_undegraded":"2024-04-24T23:01:36.217418+0000","last_fullsized":"2024-04-24T23:01:36.217418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:00.294819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217811+0000","last_change":"2024-04-24T23:01:35.090117+0000","last_active":"2024-04-24T23:01:36.217811+0000","last_peered":"2024-04-24T23:01:36.217811+0000","last_clean":"2024-04-24T23:01:36.217811+0000","last_became_active":"2024-04-24T23:01:35.089765+0000","last_became_peered":"2024-04-24T23:01:35.089765+0000","last_unstale":"2024-04-24T23:01:36.217811+0000","last_undegraded":"2024-04-24T23:01:36.217811+0000","last_fullsized":"2024-04-24T23:01:36.217811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:37:09.568967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216791+0000","last_change":"2024-04-24T23:01:35.095245+0000","last_active":"2024-04-24T23:01:36.216791+0000","last_peered":"2024-04-24T23:01:36.216791+0000","last_clean":"2024-04-24T23:01:36.216791+0000","last_became_active":"2024-04-24T23:01:35.094968+0000","last_became_peered":"2024-04-24T23:01:35.094968+0000","last_unstale":"2024-04-24T23:01:36.216791+0000","last_undegraded":"2024-04-24T23:01:36.216791+0000","last_fullsized":"2024-04-24T23:01:36.216791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:53:30.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.096275+0000","last_change":"2024-04-24T23:01:35.095641+0000","last_active":"2024-04-24T23:01:36.096275+0000","last_peered":"2024-04-24T23:01:36.096275+0000","last_clean":"2024-04-24T23:01:36.096275+0000","last_became_active":"2024-04-24T23:01:35.095246+0000","last_became_peered":"2024-04-24T23:01:35.095246+0000","last_unstale":"2024-04-24T23:01:36.096275+0000","last_undegraded":"2024-04-24T23:01:36.096275+0000","last_fullsized":"2024-04-24T23:01:36.096275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:42.348082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095137+0000","last_change":"2024-04-24T23:01:35.097664+0000","last_active":"2024-04-24T23:01:36.095137+0000","last_peered":"2024-04-24T23:01:36.095137+0000","last_clean":"2024-04-24T23:01:36.095137+0000","last_became_active":"2024-04-24T23:01:35.097393+0000","last_became_peered":"2024-04-24T23:01:35.097393+0000","last_unstale":"2024-04-24T23:01:36.095137+0000","last_undegraded":"2024-04-24T23:01:36.095137+0000","last_fullsized":"2024-04-24T23:01:36.095137+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.992910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095113+0000","last_change":"2024-04-24T23:01:35.089725+0000","last_active":"2024-04-24T23:01:36.095113+0000","last_peered":"2024-04-24T23:01:36.095113+0000","last_clean":"2024-04-24T23:01:36.095113+0000","last_became_active":"2024-04-24T23:01:35.089089+0000","last_became_peered":"2024-04-24T23:01:35.089089+0000","last_unstale":"2024-04-24T23:01:36.095113+0000","last_undegraded":"2024-04-24T23:01:36.095113+0000","last_fullsized":"2024-04-24T23:01:36.095113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:15:13.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215621+0000","last_change":"2024-04-24T23:01:35.094316+0000","last_active":"2024-04-24T23:01:36.215621+0000","last_peered":"2024-04-24T23:01:36.215621+0000","last_clean":"2024-04-24T23:01:36.215621+0000","last_became_active":"2024-04-24T23:01:35.093945+0000","last_became_peered":"2024-04-24T23:01:35.093945+0000","last_unstale":"2024-04-24T23:01:36.215621+0000","last_undegraded":"2024-04-24T23:01:36.215621+0000","last_fullsized":"2024-04-24T23:01:36.215621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:00.310865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080171+0000","last_change":"2024-04-24T23:01:35.089748+0000","last_active":"2024-04-24T23:01:36.080171+0000","last_peered":"2024-04-24T23:01:36.080171+0000","last_clean":"2024-04-24T23:01:36.080171+0000","last_became_active":"2024-04-24T23:01:35.089463+0000","last_became_peered":"2024-04-24T23:01:35.089463+0000","last_unstale":"2024-04-24T23:01:36.080171+0000","last_undegraded":"2024-04-24T23:01:36.080171+0000","last_fullsized":"2024-04-24T23:01:36.080171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:21.339916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216676+0000","last_change":"2024-04-24T23:01:35.097480+0000","last_active":"2024-04-24T23:01:36.216676+0000","last_peered":"2024-04-24T23:01:36.216676+0000","last_clean":"2024-04-24T23:01:36.216676+0000","last_became_active":"2024-04-24T23:01:35.097161+0000","last_became_peered":"2024-04-24T23:01:35.097161+0000","last_unstale":"2024-04-24T23:01:36.216676+0000","last_undegraded":"2024-04-24T23:01:36.216676+0000","last_fullsized":"2024-04-24T23:01:36.216676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:57.106359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079097+0000","last_change":"2024-04-24T23:01:35.092937+0000","last_active":"2024-04-24T23:01:36.079097+0000","last_peered":"2024-04-24T23:01:36.079097+0000","last_clean":"2024-04-24T23:01:36.079097+0000","last_became_active":"2024-04-24T23:01:35.090459+0000","last_became_peered":"2024-04-24T23:01:35.090459+0000","last_unstale":"2024-04-24T23:01:36.079097+0000","last_undegraded":"2024-04-24T23:01:36.079097+0000","last_fullsized":"2024-04-24T23:01:36.079097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:55.855094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.096113+0000","last_change":"2024-04-24T23:01:35.089918+0000","last_active":"2024-04-24T23:01:36.096113+0000","last_peered":"2024-04-24T23:01:36.096113+0000","last_clean":"2024-04-24T23:01:36.096113+0000","last_became_active":"2024-04-24T23:01:35.089463+0000","last_became_peered":"2024-04-24T23:01:35.089463+0000","last_unstale":"2024-04-24T23:01:36.096113+0000","last_undegraded":"2024-04-24T23:01:36.096113+0000","last_fullsized":"2024-04-24T23:01:36.096113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:13.813067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079402+0000","last_change":"2024-04-24T23:01:35.107290+0000","last_active":"2024-04-24T23:01:36.079402+0000","last_peered":"2024-04-24T23:01:36.079402+0000","last_clean":"2024-04-24T23:01:36.079402+0000","last_became_active":"2024-04-24T23:01:35.105775+0000","last_became_peered":"2024-04-24T23:01:35.105775+0000","last_unstale":"2024-04-24T23:01:36.079402+0000","last_undegraded":"2024-04-24T23:01:36.079402+0000","last_fullsized":"2024-04-24T23:01:36.079402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:41.347387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216036+0000","last_change":"2024-04-24T23:01:35.092812+0000","last_active":"2024-04-24T23:01:36.216036+0000","last_peered":"2024-04-24T23:01:36.216036+0000","last_clean":"2024-04-24T23:01:36.216036+0000","last_became_active":"2024-04-24T23:01:35.092483+0000","last_became_peered":"2024-04-24T23:01:35.092483+0000","last_unstale":"2024-04-24T23:01:36.216036+0000","last_undegraded":"2024-04-24T23:01:36.216036+0000","last_fullsized":"2024-04-24T23:01:36.216036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:30.159002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215949+0000","last_change":"2024-04-24T23:01:35.082232+0000","last_active":"2024-04-24T23:01:36.215949+0000","last_peered":"2024-04-24T23:01:36.215949+0000","last_clean":"2024-04-24T23:01:36.215949+0000","last_became_active":"2024-04-24T23:01:35.081944+0000","last_became_peered":"2024-04-24T23:01:35.081944+0000","last_unstale":"2024-04-24T23:01:36.215949+0000","last_undegraded":"2024-04-24T23:01:36.215949+0000","last_fullsized":"2024-04-24T23:01:36.215949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:39.506464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078441+0000","last_change":"2024-04-24T23:01:35.068679+0000","last_active":"2024-04-24T23:01:36.078441+0000","last_peered":"2024-04-24T23:01:36.078441+0000","last_clean":"2024-04-24T23:01:36.078441+0000","last_became_active":"2024-04-24T23:01:35.068077+0000","last_became_peered":"2024-04-24T23:01:35.068077+0000","last_unstale":"2024-04-24T23:01:36.078441+0000","last_undegraded":"2024-04-24T23:01:36.078441+0000","last_fullsized":"2024-04-24T23:01:36.078441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:46:29.137713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080505+0000","last_change":"2024-04-24T23:01:35.098131+0000","last_active":"2024-04-24T23:01:36.080505+0000","last_peered":"2024-04-24T23:01:36.080505+0000","last_clean":"2024-04-24T23:01:36.080505+0000","last_became_active":"2024-04-24T23:01:35.097880+0000","last_became_peered":"2024-04-24T23:01:35.097880+0000","last_unstale":"2024-04-24T23:01:36.080505+0000","last_undegraded":"2024-04-24T23:01:36.080505+0000","last_fullsized":"2024-04-24T23:01:36.080505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:52:13.120477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216953+0000","last_change":"2024-04-24T23:01:35.090199+0000","last_active":"2024-04-24T23:01:36.216953+0000","last_peered":"2024-04-24T23:01:36.216953+0000","last_clean":"2024-04-24T23:01:36.216953+0000","last_became_active":"2024-04-24T23:01:35.089333+0000","last_became_peered":"2024-04-24T23:01:35.089333+0000","last_unstale":"2024-04-24T23:01:36.216953+0000","last_undegraded":"2024-04-24T23:01:36.216953+0000","last_fullsized":"2024-04-24T23:01:36.216953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:01.512761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217631+0000","last_change":"2024-04-24T23:01:34.041597+0000","last_active":"2024-04-24T23:01:36.217631+0000","last_peered":"2024-04-24T23:01:36.217631+0000","last_clean":"2024-04-24T23:01:36.217631+0000","last_became_active":"2024-04-24T23:01:34.041222+0000","last_became_peered":"2024-04-24T23:01:34.041222+0000","last_unstale":"2024-04-24T23:01:36.217631+0000","last_undegraded":"2024-04-24T23:01:36.217631+0000","last_fullsized":"2024-04-24T23:01:36.217631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:09.358537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217109+0000","last_change":"2024-04-24T23:01:35.086341+0000","last_active":"2024-04-24T23:01:36.217109+0000","last_peered":"2024-04-24T23:01:36.217109+0000","last_clean":"2024-04-24T23:01:36.217109+0000","last_became_active":"2024-04-24T23:01:35.086041+0000","last_became_peered":"2024-04-24T23:01:35.086041+0000","last_unstale":"2024-04-24T23:01:36.217109+0000","last_undegraded":"2024-04-24T23:01:36.217109+0000","last_fullsized":"2024-04-24T23:01:36.217109+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:16.529529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217828+0000","last_change":"2024-04-24T23:01:34.064484+0000","last_active":"2024-04-24T23:01:36.217828+0000","last_peered":"2024-04-24T23:01:36.217828+0000","last_clean":"2024-04-24T23:01:36.217828+0000","last_became_active":"2024-04-24T23:01:34.064168+0000","last_became_peered":"2024-04-24T23:01:34.064168+0000","last_unstale":"2024-04-24T23:01:36.217828+0000","last_undegraded":"2024-04-24T23:01:36.217828+0000","last_fullsized":"2024-04-24T23:01:36.217828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:56.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.218189+0000","last_change":"2024-04-24T23:01:35.096560+0000","last_active":"2024-04-24T23:01:36.218189+0000","last_peered":"2024-04-24T23:01:36.218189+0000","last_clean":"2024-04-24T23:01:36.218189+0000","last_became_active":"2024-04-24T23:01:35.096262+0000","last_became_peered":"2024-04-24T23:01:35.096262+0000","last_unstale":"2024-04-24T23:01:36.218189+0000","last_undegraded":"2024-04-24T23:01:36.218189+0000","last_fullsized":"2024-04-24T23:01:36.218189+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:43.954996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080331+0000","last_change":"2024-04-24T23:01:34.066832+0000","last_active":"2024-04-24T23:01:36.080331+0000","last_peered":"2024-04-24T23:01:36.080331+0000","last_clean":"2024-04-24T23:01:36.080331+0000","last_became_active":"2024-04-24T23:01:34.066571+0000","last_became_peered":"2024-04-24T23:01:34.066571+0000","last_unstale":"2024-04-24T23:01:36.080331+0000","last_undegraded":"2024-04-24T23:01:36.080331+0000","last_fullsized":"2024-04-24T23:01:36.080331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:05:04.974492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217973+0000","last_change":"2024-04-24T23:01:35.086842+0000","last_active":"2024-04-24T23:01:36.217973+0000","last_peered":"2024-04-24T23:01:36.217973+0000","last_clean":"2024-04-24T23:01:36.217973+0000","last_became_active":"2024-04-24T23:01:35.086555+0000","last_became_peered":"2024-04-24T23:01:35.086555+0000","last_unstale":"2024-04-24T23:01:36.217973+0000","last_undegraded":"2024-04-24T23:01:36.217973+0000","last_fullsized":"2024-04-24T23:01:36.217973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:42.072548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216399+0000","last_change":"2024-04-24T23:01:34.058732+0000","last_active":"2024-04-24T23:01:36.216399+0000","last_peered":"2024-04-24T23:01:36.216399+0000","last_clean":"2024-04-24T23:01:36.216399+0000","last_became_active":"2024-04-24T23:01:34.058427+0000","last_became_peered":"2024-04-24T23:01:34.058427+0000","last_unstale":"2024-04-24T23:01:36.216399+0000","last_undegraded":"2024-04-24T23:01:36.216399+0000","last_fullsized":"2024-04-24T23:01:36.216399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:22.052453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080572+0000","last_change":"2024-04-24T23:01:35.089307+0000","last_active":"2024-04-24T23:01:36.080572+0000","last_peered":"2024-04-24T23:01:36.080572+0000","last_clean":"2024-04-24T23:01:36.080572+0000","last_became_active":"2024-04-24T23:01:35.089022+0000","last_became_peered":"2024-04-24T23:01:35.089022+0000","last_unstale":"2024-04-24T23:01:36.080572+0000","last_undegraded":"2024-04-24T23:01:36.080572+0000","last_fullsized":"2024-04-24T23:01:36.080572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:10.364075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216092+0000","last_change":"2024-04-24T23:01:34.059410+0000","last_active":"2024-04-24T23:01:36.216092+0000","last_peered":"2024-04-24T23:01:36.216092+0000","last_clean":"2024-04-24T23:01:36.216092+0000","last_became_active":"2024-04-24T23:01:34.058921+0000","last_became_peered":"2024-04-24T23:01:34.058921+0000","last_unstale":"2024-04-24T23:01:36.216092+0000","last_undegraded":"2024-04-24T23:01:36.216092+0000","last_fullsized":"2024-04-24T23:01:36.216092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:56.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095210+0000","last_change":"2024-04-24T23:01:35.089748+0000","last_active":"2024-04-24T23:01:36.095210+0000","last_peered":"2024-04-24T23:01:36.095210+0000","last_clean":"2024-04-24T23:01:36.095210+0000","last_became_active":"2024-04-24T23:01:35.089482+0000","last_became_peered":"2024-04-24T23:01:35.089482+0000","last_unstale":"2024-04-24T23:01:36.095210+0000","last_undegraded":"2024-04-24T23:01:36.095210+0000","last_fullsized":"2024-04-24T23:01:36.095210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:42:23.403963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078975+0000","last_change":"2024-04-24T23:01:34.065474+0000","last_active":"2024-04-24T23:01:36.078975+0000","last_peered":"2024-04-24T23:01:36.078975+0000","last_clean":"2024-04-24T23:01:36.078975+0000","last_became_active":"2024-04-24T23:01:34.065122+0000","last_became_peered":"2024-04-24T23:01:34.065122+0000","last_unstale":"2024-04-24T23:01:36.078975+0000","last_undegraded":"2024-04-24T23:01:36.078975+0000","last_fullsized":"2024-04-24T23:01:36.078975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:10.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215727+0000","last_change":"2024-04-24T23:01:35.086568+0000","last_active":"2024-04-24T23:01:36.215727+0000","last_peered":"2024-04-24T23:01:36.215727+0000","last_clean":"2024-04-24T23:01:36.215727+0000","last_became_active":"2024-04-24T23:01:35.086239+0000","last_became_peered":"2024-04-24T23:01:35.086239+0000","last_unstale":"2024-04-24T23:01:36.215727+0000","last_undegraded":"2024-04-24T23:01:36.215727+0000","last_fullsized":"2024-04-24T23:01:36.215727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:08.182435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078698+0000","last_change":"2024-04-24T23:01:34.061866+0000","last_active":"2024-04-24T23:01:36.078698+0000","last_peered":"2024-04-24T23:01:36.078698+0000","last_clean":"2024-04-24T23:01:36.078698+0000","last_became_active":"2024-04-24T23:01:34.061600+0000","last_became_peered":"2024-04-24T23:01:34.061600+0000","last_unstale":"2024-04-24T23:01:36.078698+0000","last_undegraded":"2024-04-24T23:01:36.078698+0000","last_fullsized":"2024-04-24T23:01:36.078698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:56.092547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217094+0000","last_change":"2024-04-24T23:01:35.083759+0000","last_active":"2024-04-24T23:01:36.217094+0000","last_peered":"2024-04-24T23:01:36.217094+0000","last_clean":"2024-04-24T23:01:36.217094+0000","last_became_active":"2024-04-24T23:01:35.082628+0000","last_became_peered":"2024-04-24T23:01:35.082628+0000","last_unstale":"2024-04-24T23:01:36.217094+0000","last_undegraded":"2024-04-24T23:01:36.217094+0000","last_fullsized":"2024-04-24T23:01:36.217094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:42:23.403963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078031+0000","last_change":"2024-04-24T23:01:34.056665+0000","last_active":"2024-04-24T23:01:36.078031+0000","last_peered":"2024-04-24T23:01:36.078031+0000","last_clean":"2024-04-24T23:01:36.078031+0000","last_became_active":"2024-04-24T23:01:34.056392+0000","last_became_peered":"2024-04-24T23:01:34.056392+0000","last_unstale":"2024-04-24T23:01:36.078031+0000","last_undegraded":"2024-04-24T23:01:36.078031+0000","last_fullsized":"2024-04-24T23:01:36.078031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:32.515257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079833+0000","last_change":"2024-04-24T23:01:35.101300+0000","last_active":"2024-04-24T23:01:36.079833+0000","last_peered":"2024-04-24T23:01:36.079833+0000","last_clean":"2024-04-24T23:01:36.079833+0000","last_became_active":"2024-04-24T23:01:35.100997+0000","last_became_peered":"2024-04-24T23:01:35.100997+0000","last_unstale":"2024-04-24T23:01:36.079833+0000","last_undegraded":"2024-04-24T23:01:36.079833+0000","last_fullsized":"2024-04-24T23:01:36.079833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:03:01.009619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080838+0000","last_change":"2024-04-24T23:01:34.065336+0000","last_active":"2024-04-24T23:01:36.080838+0000","last_peered":"2024-04-24T23:01:36.080838+0000","last_clean":"2024-04-24T23:01:36.080838+0000","last_became_active":"2024-04-24T23:01:34.065054+0000","last_became_peered":"2024-04-24T23:01:34.065054+0000","last_unstale":"2024-04-24T23:01:36.080838+0000","last_undegraded":"2024-04-24T23:01:36.080838+0000","last_fullsized":"2024-04-24T23:01:36.080838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:54.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216517+0000","last_change":"2024-04-24T23:01:35.102896+0000","last_active":"2024-04-24T23:01:36.216517+0000","last_peered":"2024-04-24T23:01:36.216517+0000","last_clean":"2024-04-24T23:01:36.216517+0000","last_became_active":"2024-04-24T23:01:35.102558+0000","last_became_peered":"2024-04-24T23:01:35.102558+0000","last_unstale":"2024-04-24T23:01:36.216517+0000","last_undegraded":"2024-04-24T23:01:36.216517+0000","last_fullsized":"2024-04-24T23:01:36.216517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:07.316431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217759+0000","last_change":"2024-04-24T23:01:34.064686+0000","last_active":"2024-04-24T23:01:36.217759+0000","last_peered":"2024-04-24T23:01:36.217759+0000","last_clean":"2024-04-24T23:01:36.217759+0000","last_became_active":"2024-04-24T23:01:34.064409+0000","last_became_peered":"2024-04-24T23:01:34.064409+0000","last_unstale":"2024-04-24T23:01:36.217759+0000","last_undegraded":"2024-04-24T23:01:36.217759+0000","last_fullsized":"2024-04-24T23:01:36.217759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:26.995952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079615+0000","last_change":"2024-04-24T23:01:35.097391+0000","last_active":"2024-04-24T23:01:36.079615+0000","last_peered":"2024-04-24T23:01:36.079615+0000","last_clean":"2024-04-24T23:01:36.079615+0000","last_became_active":"2024-04-24T23:01:35.097099+0000","last_became_peered":"2024-04-24T23:01:35.097099+0000","last_unstale":"2024-04-24T23:01:36.079615+0000","last_undegraded":"2024-04-24T23:01:36.079615+0000","last_fullsized":"2024-04-24T23:01:36.079615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:44.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216668+0000","last_change":"2024-04-24T23:01:34.061059+0000","last_active":"2024-04-24T23:01:36.216668+0000","last_peered":"2024-04-24T23:01:36.216668+0000","last_clean":"2024-04-24T23:01:36.216668+0000","last_became_active":"2024-04-24T23:01:34.058994+0000","last_became_peered":"2024-04-24T23:01:34.058994+0000","last_unstale":"2024-04-24T23:01:36.216668+0000","last_undegraded":"2024-04-24T23:01:36.216668+0000","last_fullsized":"2024-04-24T23:01:36.216668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:41.334270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079663+0000","last_change":"2024-04-24T23:01:35.087985+0000","last_active":"2024-04-24T23:01:36.079663+0000","last_peered":"2024-04-24T23:01:36.079663+0000","last_clean":"2024-04-24T23:01:36.079663+0000","last_became_active":"2024-04-24T23:01:35.087723+0000","last_became_peered":"2024-04-24T23:01:35.087723+0000","last_unstale":"2024-04-24T23:01:36.079663+0000","last_undegraded":"2024-04-24T23:01:36.079663+0000","last_fullsized":"2024-04-24T23:01:36.079663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:23.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079997+0000","last_change":"2024-04-24T23:01:34.065348+0000","last_active":"2024-04-24T23:01:36.079997+0000","last_peered":"2024-04-24T23:01:36.079997+0000","last_clean":"2024-04-24T23:01:36.079997+0000","last_became_active":"2024-04-24T23:01:34.064981+0000","last_became_peered":"2024-04-24T23:01:34.064981+0000","last_unstale":"2024-04-24T23:01:36.079997+0000","last_undegraded":"2024-04-24T23:01:36.079997+0000","last_fullsized":"2024-04-24T23:01:36.079997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:22.877445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081003+0000","last_change":"2024-04-24T23:01:35.089143+0000","last_active":"2024-04-24T23:01:36.081003+0000","last_peered":"2024-04-24T23:01:36.081003+0000","last_clean":"2024-04-24T23:01:36.081003+0000","last_became_active":"2024-04-24T23:01:35.085493+0000","last_became_peered":"2024-04-24T23:01:35.085493+0000","last_unstale":"2024-04-24T23:01:36.081003+0000","last_undegraded":"2024-04-24T23:01:36.081003+0000","last_fullsized":"2024-04-24T23:01:36.081003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:36.210494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080515+0000","last_change":"2024-04-24T23:01:34.067400+0000","last_active":"2024-04-24T23:01:36.080515+0000","last_peered":"2024-04-24T23:01:36.080515+0000","last_clean":"2024-04-24T23:01:36.080515+0000","last_became_active":"2024-04-24T23:01:34.067139+0000","last_became_peered":"2024-04-24T23:01:34.067139+0000","last_unstale":"2024-04-24T23:01:36.080515+0000","last_undegraded":"2024-04-24T23:01:36.080515+0000","last_fullsized":"2024-04-24T23:01:36.080515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:44.888701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216584+0000","last_change":"2024-04-24T23:01:35.078984+0000","last_active":"2024-04-24T23:01:36.216584+0000","last_peered":"2024-04-24T23:01:36.216584+0000","last_clean":"2024-04-24T23:01:36.216584+0000","last_became_active":"2024-04-24T23:01:35.078702+0000","last_became_peered":"2024-04-24T23:01:35.078702+0000","last_unstale":"2024-04-24T23:01:36.216584+0000","last_undegraded":"2024-04-24T23:01:36.216584+0000","last_fullsized":"2024-04-24T23:01:36.216584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:23.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216783+0000","last_change":"2024-04-24T23:01:34.060321+0000","last_active":"2024-04-24T23:01:36.216783+0000","last_peered":"2024-04-24T23:01:36.216783+0000","last_clean":"2024-04-24T23:01:36.216783+0000","last_became_active":"2024-04-24T23:01:34.059751+0000","last_became_peered":"2024-04-24T23:01:34.059751+0000","last_unstale":"2024-04-24T23:01:36.216783+0000","last_undegraded":"2024-04-24T23:01:36.216783+0000","last_fullsized":"2024-04-24T23:01:36.216783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:09.358537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095525+0000","last_change":"2024-04-24T23:01:35.092350+0000","last_active":"2024-04-24T23:01:36.095525+0000","last_peered":"2024-04-24T23:01:36.095525+0000","last_clean":"2024-04-24T23:01:36.095525+0000","last_became_active":"2024-04-24T23:01:35.088723+0000","last_became_peered":"2024-04-24T23:01:35.088723+0000","last_unstale":"2024-04-24T23:01:36.095525+0000","last_undegraded":"2024-04-24T23:01:36.095525+0000","last_fullsized":"2024-04-24T23:01:36.095525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:42.072548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215839+0000","last_change":"2024-04-24T23:01:34.046567+0000","last_active":"2024-04-24T23:01:36.215839+0000","last_peered":"2024-04-24T23:01:36.215839+0000","last_clean":"2024-04-24T23:01:36.215839+0000","last_became_active":"2024-04-24T23:01:34.046101+0000","last_became_peered":"2024-04-24T23:01:34.046101+0000","last_unstale":"2024-04-24T23:01:36.215839+0000","last_undegraded":"2024-04-24T23:01:36.215839+0000","last_fullsized":"2024-04-24T23:01:36.215839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:09.979195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081693+0000","last_change":"2024-04-24T23:01:35.091892+0000","last_active":"2024-04-24T23:01:36.081693+0000","last_peered":"2024-04-24T23:01:36.081693+0000","last_clean":"2024-04-24T23:01:36.081693+0000","last_became_active":"2024-04-24T23:01:35.091568+0000","last_became_peered":"2024-04-24T23:01:35.091568+0000","last_unstale":"2024-04-24T23:01:36.081693+0000","last_undegraded":"2024-04-24T23:01:36.081693+0000","last_fullsized":"2024-04-24T23:01:36.081693+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:05.729196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.214948+0000","last_change":"2024-04-24T23:01:34.047187+0000","last_active":"2024-04-24T23:01:36.214948+0000","last_peered":"2024-04-24T23:01:36.214948+0000","last_clean":"2024-04-24T23:01:36.214948+0000","last_became_active":"2024-04-24T23:01:34.045985+0000","last_became_peered":"2024-04-24T23:01:34.045985+0000","last_unstale":"2024-04-24T23:01:36.214948+0000","last_undegraded":"2024-04-24T23:01:36.214948+0000","last_fullsized":"2024-04-24T23:01:36.214948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:04.715385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216870+0000","last_change":"2024-04-24T23:01:35.080864+0000","last_active":"2024-04-24T23:01:36.216870+0000","last_peered":"2024-04-24T23:01:36.216870+0000","last_clean":"2024-04-24T23:01:36.216870+0000","last_became_active":"2024-04-24T23:01:35.080325+0000","last_became_peered":"2024-04-24T23:01:35.080325+0000","last_unstale":"2024-04-24T23:01:36.216870+0000","last_undegraded":"2024-04-24T23:01:36.216870+0000","last_fullsized":"2024-04-24T23:01:36.216870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:15:13.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079538+0000","last_change":"2024-04-24T23:01:34.055369+0000","last_active":"2024-04-24T23:01:36.079538+0000","last_peered":"2024-04-24T23:01:36.079538+0000","last_clean":"2024-04-24T23:01:36.079538+0000","last_became_active":"2024-04-24T23:01:34.055101+0000","last_became_peered":"2024-04-24T23:01:34.055101+0000","last_unstale":"2024-04-24T23:01:36.079538+0000","last_undegraded":"2024-04-24T23:01:36.079538+0000","last_fullsized":"2024-04-24T23:01:36.079538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:23.007137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079948+0000","last_change":"2024-04-24T23:01:35.106314+0000","last_active":"2024-04-24T23:01:36.079948+0000","last_peered":"2024-04-24T23:01:36.079948+0000","last_clean":"2024-04-24T23:01:36.079948+0000","last_became_active":"2024-04-24T23:01:35.106037+0000","last_became_peered":"2024-04-24T23:01:35.106037+0000","last_unstale":"2024-04-24T23:01:36.079948+0000","last_undegraded":"2024-04-24T23:01:36.079948+0000","last_fullsized":"2024-04-24T23:01:36.079948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:57.539676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.218017+0000","last_change":"2024-04-24T23:01:34.057824+0000","last_active":"2024-04-24T23:01:36.218017+0000","last_peered":"2024-04-24T23:01:36.218017+0000","last_clean":"2024-04-24T23:01:36.218017+0000","last_became_active":"2024-04-24T23:01:34.057583+0000","last_became_peered":"2024-04-24T23:01:34.057583+0000","last_unstale":"2024-04-24T23:01:36.218017+0000","last_undegraded":"2024-04-24T23:01:36.218017+0000","last_fullsized":"2024-04-24T23:01:36.218017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:16.308796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079748+0000","last_change":"2024-04-24T23:01:35.069286+0000","last_active":"2024-04-24T23:01:36.079748+0000","last_peered":"2024-04-24T23:01:36.079748+0000","last_clean":"2024-04-24T23:01:36.079748+0000","last_became_active":"2024-04-24T23:01:35.068647+0000","last_became_peered":"2024-04-24T23:01:35.068647+0000","last_unstale":"2024-04-24T23:01:36.079748+0000","last_undegraded":"2024-04-24T23:01:36.079748+0000","last_fullsized":"2024-04-24T23:01:36.079748+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:10.372349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081710+0000","last_change":"2024-04-24T23:01:34.064527+0000","last_active":"2024-04-24T23:01:36.081710+0000","last_peered":"2024-04-24T23:01:36.081710+0000","last_clean":"2024-04-24T23:01:36.081710+0000","last_became_active":"2024-04-24T23:01:34.062979+0000","last_became_peered":"2024-04-24T23:01:34.062979+0000","last_unstale":"2024-04-24T23:01:36.081710+0000","last_undegraded":"2024-04-24T23:01:36.081710+0000","last_fullsized":"2024-04-24T23:01:36.081710+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:12.424729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217136+0000","last_change":"2024-04-24T23:01:35.093372+0000","last_active":"2024-04-24T23:01:36.217136+0000","last_peered":"2024-04-24T23:01:36.217136+0000","last_clean":"2024-04-24T23:01:36.217136+0000","last_became_active":"2024-04-24T23:01:35.093125+0000","last_became_peered":"2024-04-24T23:01:35.093125+0000","last_unstale":"2024-04-24T23:01:36.217136+0000","last_undegraded":"2024-04-24T23:01:36.217136+0000","last_fullsized":"2024-04-24T23:01:36.217136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:17:29.225136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215773+0000","last_change":"2024-04-24T23:01:34.049786+0000","last_active":"2024-04-24T23:01:36.215773+0000","last_peered":"2024-04-24T23:01:36.215773+0000","last_clean":"2024-04-24T23:01:36.215773+0000","last_became_active":"2024-04-24T23:01:34.049502+0000","last_became_peered":"2024-04-24T23:01:34.049502+0000","last_unstale":"2024-04-24T23:01:36.215773+0000","last_undegraded":"2024-04-24T23:01:36.215773+0000","last_fullsized":"2024-04-24T23:01:36.215773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:05.363580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215310+0000","last_change":"2024-04-24T23:01:35.088076+0000","last_active":"2024-04-24T23:01:36.215310+0000","last_peered":"2024-04-24T23:01:36.215310+0000","last_clean":"2024-04-24T23:01:36.215310+0000","last_became_active":"2024-04-24T23:01:35.087708+0000","last_became_peered":"2024-04-24T23:01:35.087708+0000","last_unstale":"2024-04-24T23:01:36.215310+0000","last_undegraded":"2024-04-24T23:01:36.215310+0000","last_fullsized":"2024-04-24T23:01:36.215310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:57:36.210494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216028+0000","last_change":"2024-04-24T23:01:34.059174+0000","last_active":"2024-04-24T23:01:36.216028+0000","last_peered":"2024-04-24T23:01:36.216028+0000","last_clean":"2024-04-24T23:01:36.216028+0000","last_became_active":"2024-04-24T23:01:34.058836+0000","last_became_peered":"2024-04-24T23:01:34.058836+0000","last_unstale":"2024-04-24T23:01:36.216028+0000","last_undegraded":"2024-04-24T23:01:36.216028+0000","last_fullsized":"2024-04-24T23:01:36.216028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:15.549788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078883+0000","last_change":"2024-04-24T23:01:35.098530+0000","last_active":"2024-04-24T23:01:36.078883+0000","last_peered":"2024-04-24T23:01:36.078883+0000","last_clean":"2024-04-24T23:01:36.078883+0000","last_became_active":"2024-04-24T23:01:35.098214+0000","last_became_peered":"2024-04-24T23:01:35.098214+0000","last_unstale":"2024-04-24T23:01:36.078883+0000","last_undegraded":"2024-04-24T23:01:36.078883+0000","last_fullsized":"2024-04-24T23:01:36.078883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:26.103747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216651+0000","last_change":"2024-04-24T23:01:34.060589+0000","last_active":"2024-04-24T23:01:36.216651+0000","last_peered":"2024-04-24T23:01:36.216651+0000","last_clean":"2024-04-24T23:01:36.216651+0000","last_became_active":"2024-04-24T23:01:34.060045+0000","last_became_peered":"2024-04-24T23:01:34.060045+0000","last_unstale":"2024-04-24T23:01:36.216651+0000","last_undegraded":"2024-04-24T23:01:36.216651+0000","last_fullsized":"2024-04-24T23:01:36.216651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:06:04.715385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095443+0000","last_change":"2024-04-24T23:01:35.093028+0000","last_active":"2024-04-24T23:01:36.095443+0000","last_peered":"2024-04-24T23:01:36.095443+0000","last_clean":"2024-04-24T23:01:36.095443+0000","last_became_active":"2024-04-24T23:01:35.092744+0000","last_became_peered":"2024-04-24T23:01:35.092744+0000","last_unstale":"2024-04-24T23:01:36.095443+0000","last_undegraded":"2024-04-24T23:01:36.095443+0000","last_fullsized":"2024-04-24T23:01:36.095443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:14:04.152158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078700+0000","last_change":"2024-04-24T23:01:34.053332+0000","last_active":"2024-04-24T23:01:36.078700+0000","last_peered":"2024-04-24T23:01:36.078700+0000","last_clean":"2024-04-24T23:01:36.078700+0000","last_became_active":"2024-04-24T23:01:34.052996+0000","last_became_peered":"2024-04-24T23:01:34.052996+0000","last_unstale":"2024-04-24T23:01:36.078700+0000","last_undegraded":"2024-04-24T23:01:36.078700+0000","last_fullsized":"2024-04-24T23:01:36.078700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:22:08.430847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080175+0000","last_change":"2024-04-24T23:01:35.099147+0000","last_active":"2024-04-24T23:01:36.080175+0000","last_peered":"2024-04-24T23:01:36.080175+0000","last_clean":"2024-04-24T23:01:36.080175+0000","last_became_active":"2024-04-24T23:01:35.098658+0000","last_became_peered":"2024-04-24T23:01:35.098658+0000","last_unstale":"2024-04-24T23:01:36.080175+0000","last_undegraded":"2024-04-24T23:01:36.080175+0000","last_fullsized":"2024-04-24T23:01:36.080175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:42:23.243473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215862+0000","last_change":"2024-04-24T23:01:34.063742+0000","last_active":"2024-04-24T23:01:36.215862+0000","last_peered":"2024-04-24T23:01:36.215862+0000","last_clean":"2024-04-24T23:01:36.215862+0000","last_became_active":"2024-04-24T23:01:34.061699+0000","last_became_peered":"2024-04-24T23:01:34.061699+0000","last_unstale":"2024-04-24T23:01:36.215862+0000","last_undegraded":"2024-04-24T23:01:36.215862+0000","last_fullsized":"2024-04-24T23:01:36.215862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:22.052453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081767+0000","last_change":"2024-04-24T23:01:35.096246+0000","last_active":"2024-04-24T23:01:36.081767+0000","last_peered":"2024-04-24T23:01:36.081767+0000","last_clean":"2024-04-24T23:01:36.081767+0000","last_became_active":"2024-04-24T23:01:35.095972+0000","last_became_peered":"2024-04-24T23:01:35.095972+0000","last_unstale":"2024-04-24T23:01:36.081767+0000","last_undegraded":"2024-04-24T23:01:36.081767+0000","last_fullsized":"2024-04-24T23:01:36.081767+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:23.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217250+0000","last_change":"2024-04-24T23:01:34.062574+0000","last_active":"2024-04-24T23:01:36.217250+0000","last_peered":"2024-04-24T23:01:36.217250+0000","last_clean":"2024-04-24T23:01:36.217250+0000","last_became_active":"2024-04-24T23:01:34.062238+0000","last_became_peered":"2024-04-24T23:01:34.062238+0000","last_unstale":"2024-04-24T23:01:36.217250+0000","last_undegraded":"2024-04-24T23:01:36.217250+0000","last_fullsized":"2024-04-24T23:01:36.217250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:29.968544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.096364+0000","last_change":"2024-04-24T23:01:35.094533+0000","last_active":"2024-04-24T23:01:36.096364+0000","last_peered":"2024-04-24T23:01:36.096364+0000","last_clean":"2024-04-24T23:01:36.096364+0000","last_became_active":"2024-04-24T23:01:35.092831+0000","last_became_peered":"2024-04-24T23:01:35.092831+0000","last_unstale":"2024-04-24T23:01:36.096364+0000","last_undegraded":"2024-04-24T23:01:36.096364+0000","last_fullsized":"2024-04-24T23:01:36.096364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:10.993006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.093829+0000","last_change":"2024-04-24T23:01:34.061035+0000","last_active":"2024-04-24T23:01:36.093829+0000","last_peered":"2024-04-24T23:01:36.093829+0000","last_clean":"2024-04-24T23:01:36.093829+0000","last_became_active":"2024-04-24T23:01:34.060780+0000","last_became_peered":"2024-04-24T23:01:34.060780+0000","last_unstale":"2024-04-24T23:01:36.093829+0000","last_undegraded":"2024-04-24T23:01:36.093829+0000","last_fullsized":"2024-04-24T23:01:36.093829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:41:33.278085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216326+0000","last_change":"2024-04-24T23:01:35.098269+0000","last_active":"2024-04-24T23:01:36.216326+0000","last_peered":"2024-04-24T23:01:36.216326+0000","last_clean":"2024-04-24T23:01:36.216326+0000","last_became_active":"2024-04-24T23:01:35.097983+0000","last_became_peered":"2024-04-24T23:01:35.097983+0000","last_unstale":"2024-04-24T23:01:36.216326+0000","last_undegraded":"2024-04-24T23:01:36.216326+0000","last_fullsized":"2024-04-24T23:01:36.216326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:19.506894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081995+0000","last_change":"2024-04-24T23:01:34.069468+0000","last_active":"2024-04-24T23:01:36.081995+0000","last_peered":"2024-04-24T23:01:36.081995+0000","last_clean":"2024-04-24T23:01:36.081995+0000","last_became_active":"2024-04-24T23:01:34.069148+0000","last_became_peered":"2024-04-24T23:01:34.069148+0000","last_unstale":"2024-04-24T23:01:36.081995+0000","last_undegraded":"2024-04-24T23:01:36.081995+0000","last_fullsized":"2024-04-24T23:01:36.081995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:04:42.663419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.079076+0000","last_change":"2024-04-24T23:01:35.093903+0000","last_active":"2024-04-24T23:01:36.079076+0000","last_peered":"2024-04-24T23:01:36.079076+0000","last_clean":"2024-04-24T23:01:36.079076+0000","last_became_active":"2024-04-24T23:01:35.093619+0000","last_became_peered":"2024-04-24T23:01:35.093619+0000","last_unstale":"2024-04-24T23:01:36.079076+0000","last_undegraded":"2024-04-24T23:01:36.079076+0000","last_fullsized":"2024-04-24T23:01:36.079076+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:01.861694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.081000+0000","last_change":"2024-04-24T23:01:34.068041+0000","last_active":"2024-04-24T23:01:36.081000+0000","last_peered":"2024-04-24T23:01:36.081000+0000","last_clean":"2024-04-24T23:01:36.081000+0000","last_became_active":"2024-04-24T23:01:34.066189+0000","last_became_peered":"2024-04-24T23:01:34.066189+0000","last_unstale":"2024-04-24T23:01:36.081000+0000","last_undegraded":"2024-04-24T23:01:36.081000+0000","last_fullsized":"2024-04-24T23:01:36.081000+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:36.769814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.216991+0000","last_change":"2024-04-24T23:01:35.075236+0000","last_active":"2024-04-24T23:01:36.216991+0000","last_peered":"2024-04-24T23:01:36.216991+0000","last_clean":"2024-04-24T23:01:36.216991+0000","last_became_active":"2024-04-24T23:01:35.074631+0000","last_became_peered":"2024-04-24T23:01:35.074631+0000","last_unstale":"2024-04-24T23:01:36.216991+0000","last_undegraded":"2024-04-24T23:01:36.216991+0000","last_fullsized":"2024-04-24T23:01:36.216991+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:55.992910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095698+0000","last_change":"2024-04-24T23:01:34.060558+0000","last_active":"2024-04-24T23:01:36.095698+0000","last_peered":"2024-04-24T23:01:36.095698+0000","last_clean":"2024-04-24T23:01:36.095698+0000","last_became_active":"2024-04-24T23:01:34.060172+0000","last_became_peered":"2024-04-24T23:01:34.060172+0000","last_unstale":"2024-04-24T23:01:36.095698+0000","last_undegraded":"2024-04-24T23:01:36.095698+0000","last_fullsized":"2024-04-24T23:01:36.095698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:56.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215886+0000","last_change":"2024-04-24T23:01:35.100342+0000","last_active":"2024-04-24T23:01:36.215886+0000","last_peered":"2024-04-24T23:01:36.215886+0000","last_clean":"2024-04-24T23:01:36.215886+0000","last_became_active":"2024-04-24T23:01:35.100033+0000","last_became_peered":"2024-04-24T23:01:35.100033+0000","last_unstale":"2024-04-24T23:01:36.215886+0000","last_undegraded":"2024-04-24T23:01:36.215886+0000","last_fullsized":"2024-04-24T23:01:36.215886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:12.125140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.215900+0000","last_change":"2024-04-24T23:01:34.061984+0000","last_active":"2024-04-24T23:01:36.215900+0000","last_peered":"2024-04-24T23:01:36.215900+0000","last_clean":"2024-04-24T23:01:36.215900+0000","last_became_active":"2024-04-24T23:01:34.061668+0000","last_became_peered":"2024-04-24T23:01:34.061668+0000","last_unstale":"2024-04-24T23:01:36.215900+0000","last_undegraded":"2024-04-24T23:01:36.215900+0000","last_fullsized":"2024-04-24T23:01:36.215900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:08.569991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.095305+0000","last_change":"2024-04-24T23:01:35.088824+0000","last_active":"2024-04-24T23:01:36.095305+0000","last_peered":"2024-04-24T23:01:36.095305+0000","last_clean":"2024-04-24T23:01:36.095305+0000","last_became_active":"2024-04-24T23:01:35.088466+0000","last_became_peered":"2024-04-24T23:01:35.088466+0000","last_unstale":"2024-04-24T23:01:36.095305+0000","last_undegraded":"2024-04-24T23:01:36.095305+0000","last_fullsized":"2024-04-24T23:01:36.095305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:16.529529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.080770+0000","last_change":"2024-04-24T23:01:34.065700+0000","last_active":"2024-04-24T23:01:36.080770+0000","last_peered":"2024-04-24T23:01:36.080770+0000","last_clean":"2024-04-24T23:01:36.080770+0000","last_became_active":"2024-04-24T23:01:34.065233+0000","last_became_peered":"2024-04-24T23:01:34.065233+0000","last_unstale":"2024-04-24T23:01:36.080770+0000","last_undegraded":"2024-04-24T23:01:36.080770+0000","last_fullsized":"2024-04-24T23:01:36.080770+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:06.302620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.217135+0000","last_change":"2024-04-24T23:01:35.094667+0000","last_active":"2024-04-24T23:01:36.217135+0000","last_peered":"2024-04-24T23:01:36.217135+0000","last_clean":"2024-04-24T23:01:36.217135+0000","last_became_active":"2024-04-24T23:01:35.094021+0000","last_became_peered":"2024-04-24T23:01:35.094021+0000","last_unstale":"2024-04-24T23:01:36.217135+0000","last_undegraded":"2024-04-24T23:01:36.217135+0000","last_fullsized":"2024-04-24T23:01:36.217135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:34.016342+0000","last_clean_scrub_stamp":"2024-04-24T23:01:34.016342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:22.019631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.096143+0000","last_change":"2024-04-24T23:01:34.060997+0000","last_active":"2024-04-24T23:01:36.096143+0000","last_peered":"2024-04-24T23:01:36.096143+0000","last_clean":"2024-04-24T23:01:36.096143+0000","last_became_active":"2024-04-24T23:01:34.060523+0000","last_became_peered":"2024-04-24T23:01:34.060523+0000","last_unstale":"2024-04-24T23:01:36.096143+0000","last_undegraded":"2024-04-24T23:01:36.096143+0000","last_fullsized":"2024-04-24T23:01:36.096143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:01:33.002531+0000","last_clean_scrub_stamp":"2024-04-24T23:01:33.002531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:09.358537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-24T23:01:36.078065+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:01:36.078065+0000","last_peered":"2024-04-24T23:01:36.078065+0000","last_clean":"2024-04-24T23:01:36.078065+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:01:36.078065+0000","last_undegraded":"2024-04-24T23:01:36.078065+0000","last_fullsized":"2024-04-24T23:01:36.078065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":200909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":483328,"data_stored":201367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":789563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":199265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":790123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:01:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:01:40.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:01:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.316+0000 7f9df5400640 1 Processor -- start 2024-04-24T23:01:40.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.317+0000 7f9df5400640 1 -- start start 2024-04-24T23:01:40.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9df01620f0 0x7f9df01624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df00d48b0 0x7f9df01612b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 0x7f9df01617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9df00b5070 con 0x7f9df00d48b0 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9df00d1090 con 0x7f9df01620f0 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.318+0000 7f9df5400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9df00b52c0 con 0x7f9df0162a10 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df00d48b0 0x7f9df01612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df00d48b0 0x7f9df01612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40590/0 (socket says 172.21.15.146:40590) 2024-04-24T23:01:40.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 -- 172.21.15.146:0/204420431 learned_addr learned my addr 172.21.15.146:0/204420431 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9df4a00640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 0x7f9df01617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9defe00640 1 --2- 172.21.15.146:0/204420431 >> v2:172.21.15.203:3300/0 conn(0x7f9df01620f0 0x7f9df01624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 -- 172.21.15.146:0/204420431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 msgr2=0x7f9df01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 0x7f9df01617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 -- 172.21.15.146:0/204420431 >> v2:172.21.15.203:3300/0 conn(0x7f9df01620f0 msgr2=0x7f9df01624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 --2- 172.21.15.146:0/204420431 >> v2:172.21.15.203:3300/0 conn(0x7f9df01620f0 0x7f9df01624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9de7e00640 1 -- 172.21.15.146:0/204420431 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df00b55a0 con 0x7f9df00d48b0 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.319+0000 7f9df4a00640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 0x7f9df01617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.320+0000 7f9de7e00640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df00d48b0 0x7f9df01612b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9df00736f0 tx=0x7f9dd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2068404fb70bea05 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.320+0000 7f9def400640 1 -- 172.21.15.146:0/204420431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8037070 con 0x7f9df00d48b0 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9def400640 1 -- 172.21.15.146:0/204420431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd8032440 con 0x7f9df00d48b0 2024-04-24T23:01:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9def400640 1 -- 172.21.15.146:0/204420431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8032810 con 0x7f9df00d48b0 2024-04-24T23:01:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 -- 172.21.15.146:0/204420431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df00d48b0 msgr2=0x7f9df01612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df00d48b0 0x7f9df01612b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9df00736f0 tx=0x7f9dd802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 -- 172.21.15.146:0/204420431 shutdown_connections 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df00d48b0 0x7f9df01612b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 --2- 172.21.15.146:0/204420431 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df0162a10 0x7f9df01617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 --2- 172.21.15.146:0/204420431 >> v2:172.21.15.203:3300/0 conn(0x7f9df01620f0 0x7f9df01624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 -- 172.21.15.146:0/204420431 >> 172.21.15.146:0/204420431 conn(0x7f9df00d3d90 msgr2=0x7f9df00d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 -- 172.21.15.146:0/204420431 shutdown_connections 2024-04-24T23:01:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.321+0000 7f9df5400640 1 -- 172.21.15.146:0/204420431 wait complete. 2024-04-24T23:01:40.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.324+0000 7f9df5400640 1 Processor -- start 2024-04-24T23:01:40.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.324+0000 7f9df5400640 1 -- start start 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df00d48b0 0x7f9df01f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df0162a10 0x7f9df00b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9df00d1520 con 0x7f9df01620f0 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9df00b2f50 con 0x7f9df0162a10 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.325+0000 7f9df5400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9df01f6ed0 con 0x7f9df00d48b0 2024-04-24T23:01:40.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40596/0 (socket says 172.21.15.146:40596) 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 -- 172.21.15.146:0/2780825380 learned_addr learned my addr 172.21.15.146:0/2780825380 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9defe00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df00d48b0 0x7f9df01f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 -- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df00d48b0 msgr2=0x7f9df01f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df00d48b0 0x7f9df01f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 -- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df0162a10 msgr2=0x7f9df00b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df0162a10 0x7f9df00b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 -- 172.21.15.146:0/2780825380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df01f3df0 con 0x7f9df01620f0 2024-04-24T23:01:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.326+0000 7f9de7e00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8000c00 tx=0x7f9dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.327+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8041020 con 0x7f9df01620f0 2024-04-24T23:01:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.327+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd80306c0 con 0x7f9df01620f0 2024-04-24T23:01:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.327+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8037040 con 0x7f9df01620f0 2024-04-24T23:01:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.327+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df01f40d0 con 0x7f9df01620f0 2024-04-24T23:01:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.327+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df01f4690 con 0x7f9df01620f0 2024-04-24T23:01:40.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.328+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df004f500 con 0x7f9df01620f0 2024-04-24T23:01:40.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.329+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dd8044020 con 0x7f9df01620f0 2024-04-24T23:01:40.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.330+0000 7f9decc00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.330+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f9dd80ab7a0 con 0x7f9df01620f0 2024-04-24T23:01:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.331+0000 7f9defe00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.332+0000 7f9defe00640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.335+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9dd804b030 con 0x7f9df01620f0 2024-04-24T23:01:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.598+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9df00d0440 con 0x7f9df01620f0 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.603+0000 7f9decc00640 1 -- 172.21.15.146:0/2780825380 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f9dd807a050 con 0x7f9df01620f0 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:01:40.605 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.605+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 msgr2=0x7f9dcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.605+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0008040 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.605+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 msgr2=0x7f9df00c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.605+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8000c00 tx=0x7f9dd80046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 shutdown_connections 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df0162a10 0x7f9df00b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df01620f0 0x7f9df00c7480 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 --2- 172.21.15.146:0/2780825380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df00d48b0 0x7f9df01f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 >> 172.21.15.146:0/2780825380 conn(0x7f9df00d3d90 msgr2=0x7f9df00b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 shutdown_connections 2024-04-24T23:01:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.606+0000 7f9df5400640 1 -- 172.21.15.146:0/2780825380 wait complete. 2024-04-24T23:01:40.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:40.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.817+0000 7ffb17200640 1 Processor -- start 2024-04-24T23:01:40.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.817+0000 7ffb17200640 1 -- start start 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.818+0000 7ffb17200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 0x7ffb180cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.818+0000 7ffb17200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb180709d0 0x7ffb1815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb17200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb18070f90 con 0x7ffb180cfb30 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb17200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ffb180b4310 con 0x7ffb180709d0 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb17200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ffb181565a0 con 0x7ffb181561c0 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb16800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffb180cfb30 0x7ffb180cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35656/0 (socket says 172.21.15.146:35656) 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb16800640 1 -- 172.21.15.146:0/2583547277 learned_addr learned my addr 172.21.15.146:0/2583547277 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:40.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2583547277 >> v2:172.21.15.146:3300/0 conn(0x7ffb180709d0 0x7ffb1815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb15e00640 1 --2- 172.21.15.146:0/2583547277 >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 0x7ffb180cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2583547277 >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 msgr2=0x7ffb180cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2583547277 >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 0x7ffb180cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2583547277 >> v1:172.21.15.146:6789/0 conn(0x7ffb180cfb30 legacy=0x7ffb180cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2583547277 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18071270 con 0x7ffb180709d0 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb15400640 1 -- 172.21.15.146:0/2583547277 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255217973 0 0) 0x7ffb18070f90 con 0x7ffb180cfb30 2024-04-24T23:01:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.819+0000 7ffb15e00640 1 --2- 172.21.15.146:0/2583547277 >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 0x7ffb180cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:40.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.820+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2583547277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180709d0 0x7ffb1815cb80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ffb180706c0 tx=0x7ffb0002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df403af06916eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb15400640 1 -- 172.21.15.146:0/2583547277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037070 con 0x7ffb180709d0 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb15400640 1 -- 172.21.15.146:0/2583547277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0002add0 con 0x7ffb180709d0 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb15400640 1 -- 172.21.15.146:0/2583547277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00032660 con 0x7ffb180709d0 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 -- 172.21.15.146:0/2583547277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180709d0 msgr2=0x7ffb1815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 --2- 172.21.15.146:0/2583547277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180709d0 0x7ffb1815cb80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ffb180706c0 tx=0x7ffb0002a080 comp rx=0 tx=0).stop 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 -- 172.21.15.146:0/2583547277 shutdown_connections 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 --2- 172.21.15.146:0/2583547277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180709d0 0x7ffb1815cb80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 --2- 172.21.15.146:0/2583547277 >> v2:172.21.15.203:3300/0 conn(0x7ffb181561c0 0x7ffb180cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.821+0000 7ffb17200640 1 -- 172.21.15.146:0/2583547277 >> 172.21.15.146:0/2583547277 conn(0x7ffb1806b320 msgr2=0x7ffb1806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.822+0000 7ffb17200640 1 -- 172.21.15.146:0/2583547277 shutdown_connections 2024-04-24T23:01:40.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.822+0000 7ffb17200640 1 -- 172.21.15.146:0/2583547277 wait complete. 2024-04-24T23:01:40.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.823+0000 7ffb17200640 1 Processor -- start 2024-04-24T23:01:40.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.823+0000 7ffb17200640 1 -- start start 2024-04-24T23:01:40.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb180709d0 0x7ffb181464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb181561c0 0x7ffb18152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180b2c20 con 0x7ffb180cfb30 2024-04-24T23:01:40.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18071830 con 0x7ffb181561c0 2024-04-24T23:01:40.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.824+0000 7ffb17200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180b2da0 con 0x7ffb180709d0 2024-04-24T23:01:40.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40614/0 (socket says 172.21.15.146:40614) 2024-04-24T23:01:40.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2860506661 learned_addr learned my addr 172.21.15.146:0/2860506661 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb180709d0 msgr2=0x7ffb181464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb180709d0 0x7ffb181464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb181561c0 msgr2=0x7ffb18152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb181561c0 0x7ffb18152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 -- 172.21.15.146:0/2860506661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb181513c0 con 0x7ffb180cfb30 2024-04-24T23:01:40.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0fe00640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009890 tx=0x7ffb000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.825+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037040 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.826+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0003b430 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.826+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0003b820 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.826+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181516a0 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.826+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb18151c60 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.827+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1804f500 con 0x7ffb180cfb30 2024-04-24T23:01:40.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.828+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb00044020 con 0x7ffb180cfb30 2024-04-24T23:01:40.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.828+0000 7ffb0e000640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 0x7ffaf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:40.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.829+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ffb000aaff0 con 0x7ffb180cfb30 2024-04-24T23:01:40.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.829+0000 7ffb15e00640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 0x7ffaf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:40.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.830+0000 7ffb15e00640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 0x7ffaf406e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb08006fd0 tx=0x7ffb08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:40.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:40.833+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb000798a0 con 0x7ffb180cfb30 2024-04-24T23:01:41.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.053+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb180ce750 con 0x7ffb180cfb30 2024-04-24T23:01:41.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.054+0000 7ffb0e000640 1 -- 172.21.15.146:0/2860506661 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5184 (secure 0 0 0) 0x7ffb000791a0 con 0x7ffb180cfb30 2024-04-24T23:01:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:41.056 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:01:37.623540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/784142616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":784142616},{"type":"v1","addr":"172.21.15.146:6835","nonce":784142616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5289,"qdb_cluster":[5289]},"id":2}]} 2024-04-24T23:01:41.056 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 16 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 msgr2=0x7ffaf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 0x7ffaf406e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb08006fd0 tx=0x7ffb08008040 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 msgr2=0x7ffb18145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009890 tx=0x7ffb000046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 shutdown_connections 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb181561c0 0x7ffb18152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.056+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb180cfb30 0x7ffb18145570 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.057+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf406be30 0x7ffaf406e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.057+0000 7ffb17200640 1 --2- 172.21.15.146:0/2860506661 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb180709d0 0x7ffb181464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.057+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 >> 172.21.15.146:0/2860506661 conn(0x7ffb1806b320 msgr2=0x7ffb180af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.057+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 shutdown_connections 2024-04-24T23:01:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.057+0000 7ffb17200640 1 -- 172.21.15.146:0/2860506661 wait complete. 2024-04-24T23:01:41.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:01:34.503652+0000', 'modified': '2024-04-24T23:01:37.623540+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5289}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5289': {'gid': 5289, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6835/784142616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 784142616}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 784142616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5289, 'qdb_cluster': [5289]} 2024-04-24T23:01:41.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:01:41.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:01:41.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.691+0000 7f2f0ae00640 1 Processor -- start 2024-04-24T23:01:41.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.691+0000 7f2f0ae00640 1 -- start start 2024-04-24T23:01:41.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f040aee30 0x7f2f04072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2f040b3550 0x7f2f04071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f04161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2f040af210 con 0x7f2f040aee30 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2f04072c60 con 0x7f2f040b3550 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f0ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2f04071040 con 0x7f2f04072060 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f03e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f040aee30 0x7f2f04072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f03e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f040aee30 0x7f2f04072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40620/0 (socket says 172.21.15.146:40620) 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.693+0000 7f2f03e00640 1 -- 172.21.15.146:0/2018254662 learned_addr learned my addr 172.21.15.146:0/2018254662 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f03e00640 1 -- 172.21.15.146:0/2018254662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 msgr2=0x7f2f04161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2efbe00640 1 --2- 172.21.15.146:0/2018254662 >> v2:172.21.15.203:3300/0 conn(0x7f2f040b3550 0x7f2f04071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f08e00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f04161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f04161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f03e00640 1 -- 172.21.15.146:0/2018254662 >> v2:172.21.15.203:3300/0 conn(0x7f2f040b3550 msgr2=0x7f2f04071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2018254662 >> v2:172.21.15.203:3300/0 conn(0x7f2f040b3550 0x7f2f04071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.694+0000 7f2f03e00640 1 -- 172.21.15.146:0/2018254662 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f04071320 con 0x7f2f040aee30 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.695+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f04072680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2f040af490 tx=0x7f2ef402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec71e2a6a01fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.695+0000 7f2f03400640 1 -- 172.21.15.146:0/2018254662 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4037070 con 0x7f2f040aee30 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.695+0000 7f2f03400640 1 -- 172.21.15.146:0/2018254662 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef4032440 con 0x7f2f040aee30 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.695+0000 7f2f03400640 1 -- 172.21.15.146:0/2018254662 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4032810 con 0x7f2f040aee30 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 -- 172.21.15.146:0/2018254662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 msgr2=0x7f2f04072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f04072680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2f040af490 tx=0x7f2ef402a140 comp rx=0 tx=0).stop 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 -- 172.21.15.146:0/2018254662 shutdown_connections 2024-04-24T23:01:41.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f04161cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/2018254662 >> v2:172.21.15.203:3300/0 conn(0x7f2f040b3550 0x7f2f04071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/2018254662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f04072680 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 -- 172.21.15.146:0/2018254662 >> 172.21.15.146:0/2018254662 conn(0x7f2f0406b140 msgr2=0x7f2f0406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 -- 172.21.15.146:0/2018254662 shutdown_connections 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.696+0000 7f2f0ae00640 1 -- 172.21.15.146:0/2018254662 wait complete. 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.698+0000 7f2f0ae00640 1 Processor -- start 2024-04-24T23:01:41.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.698+0000 7f2f0ae00640 1 -- start start 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f0414b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f040b3550 0x7f2f041f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f040b39c0 con 0x7f2f040aee30 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f041621f0 con 0x7f2f040b3550 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f0ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0414b1c0 con 0x7f2f04072060 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40624/0 (socket says 172.21.15.146:40624) 2024-04-24T23:01:41.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 -- 172.21.15.146:0/3427565718 learned_addr learned my addr 172.21.15.146:0/3427565718 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f03e00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f0414b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2f08e00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f040b3550 0x7f2f041f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 -- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 msgr2=0x7f2f0414b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f0414b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 -- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f040b3550 msgr2=0x7f2f041f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.699+0000 7f2efbe00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f040b3550 0x7f2f041f7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2efbe00640 1 -- 172.21.15.146:0/3427565718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f041f7b20 con 0x7f2f040aee30 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2efbe00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7f0 tx=0x7f2eec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2f00c00640 1 -- 172.21.15.146:0/3427565718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec015070 con 0x7f2f040aee30 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2f00c00640 1 -- 172.21.15.146:0/3427565718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec004220 con 0x7f2f040aee30 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2f00c00640 1 -- 172.21.15.146:0/3427565718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec007620 con 0x7f2f040aee30 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f041f7e00 con 0x7f2f040aee30 2024-04-24T23:01:41.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.700+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0414bee0 con 0x7f2f040aee30 2024-04-24T23:01:41.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.702+0000 7f2f00c00640 1 -- 172.21.15.146:0/3427565718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eec0079d0 con 0x7f2f040aee30 2024-04-24T23:01:41.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.703+0000 7f2f00c00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 0x7f2ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.703+0000 7f2f00c00640 1 -- 172.21.15.146:0/3427565718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2eec08b100 con 0x7f2f040aee30 2024-04-24T23:01:41.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.704+0000 7f2f0dbb8740 1 Processor -- start 2024-04-24T23:01:41.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.704+0000 7f2f03e00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 0x7f2ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.704+0000 7f2f0dbb8740 1 -- start start 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af571f0 0x56111af9d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56111ae56ed0 con 0x56111af9edb0 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56111aeb9df0 con 0x56111af81510 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56111ae628d0 con 0x56111af571f0 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40628/0 (socket says 172.21.15.146:40628) 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2efbe00640 1 -- 172.21.15.146:0/59406272 learned_addr learned my addr 172.21.15.146:0/59406272 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.705+0000 7f2f03e00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 0x7f2ee006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4034000 tx=0x7f2ef402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2f03e00640 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 -- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af571f0 msgr2=0x56111af9d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af571f0 0x56111af9d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 -- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 msgr2=0x56111af818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af818f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 -- 172.21.15.146:0/59406272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56111abce2d0 con 0x56111af9edb0 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2efbe00640 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0555e0 tx=0x7f2eec0599c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d30361ddbd8e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2ef8c00640 1 -- 172.21.15.146:0/59406272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec071030 con 0x56111af9edb0 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2ef8c00640 1 -- 172.21.15.146:0/59406272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec0711d0 con 0x56111af9edb0 2024-04-24T23:01:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.706+0000 7f2ef8c00640 1 -- 172.21.15.146:0/59406272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01e040 con 0x56111af9edb0 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/59406272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 msgr2=0x56111af9f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0555e0 tx=0x7f2eec0599c0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/59406272 shutdown_connections 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af571f0 0x56111af9d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9f300 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/59406272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/59406272 >> 172.21.15.146:0/59406272 conn(0x56111af53b20 msgr2=0x56111af9c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/59406272 shutdown_connections 2024-04-24T23:01:41.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.707+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/59406272 wait complete. 2024-04-24T23:01:41.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.708+0000 7f2f0dbb8740 1 -- start start 2024-04-24T23:01:41.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.708+0000 7f2f0dbb8740 1 Processor -- start 2024-04-24T23:01:41.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af6f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af9d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56111ae75d20 con 0x56111af9edb0 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56111aeb5db0 con 0x56111af81510 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56111af57f90 con 0x56111af6c9a0 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2f0dbb8740 10 client.0 _ll_register_callbacks cb 0x56111aeb0f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40638/0 (socket says 172.21.15.146:40638) 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.709+0000 7f2efbe00640 1 -- 172.21.15.146:0/1158267770 learned_addr learned my addr 172.21.15.146:0/1158267770 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 -- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 msgr2=0x56111af9d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af9d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 -- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 msgr2=0x56111af6f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 -- 172.21.15.146:0/1158267770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111ac986b0 con 0x56111af9edb0 2024-04-24T23:01:41.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7c0 tx=0x7f2eec0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956c15fb0080305e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2ef1600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01e040 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2eec05d170 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eec0711d0 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2eec0585d0 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2f0dbb8740 10 client.5466 fetch_fsmap learned FSMap version 16 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x56111af6fdf0 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.710+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec0711d0 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f2eec058770 con 0x56111af9edb0 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 10 client.5466 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 10 client.5466 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 20 client.5466 populate_metadata read hostname 'smithi146' 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af6dea0 0x56111af6e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 4 client.5466 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:01:41.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 --> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56111aec7330 con 0x56111af6dea0 2024-04-24T23:01:41.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.711+0000 7f2f03e00640 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af6dea0 0x56111af6e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.712+0000 7f2f03e00640 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af6dea0 0x56111af6e280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fbff4f007d5583f server_cookie=c6e94c35617282d7 in_seq=0 out_seq=0 2024-04-24T23:01:41.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.712+0000 7f2ef1600640 10 client.5466 ms_handle_connect on v2:172.21.15.146:6833/784142616 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.712+0000 7f2ef1600640 1 -- 172.21.15.146:0/1158267770 <== mds.0 v2:172.21.15.146:6833/784142616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56111aec7330 con 0x56111af6dea0 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.712+0000 7f2ef1600640 10 client.5466 handle_command_reply: tid=0 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 client.5466 shutdown 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 msgr2=0x56111af9d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7c0 tx=0x7f2eec0045f0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 shutdown_connections 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af6dea0 0x56111af6e280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af9d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af9edb0 0x56111af9d490 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1158267770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af81510 0x56111af6f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 >> 172.21.15.146:0/1158267770 conn(0x56111af571f0 msgr2=0x56111af566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2ef1600640 0 client.5466 ms_handle_reset on v2:172.21.15.146:6833/784142616 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 shutdown_connections 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1158267770 wait complete. 2024-04-24T23:01:41.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.713+0000 7f2f0dbb8740 20 client.5466 trim_cache size 0 max 16384 2024-04-24T23:01:41.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.733+0000 7f2f0dbb8740 1 Processor -- start 2024-04-24T23:01:41.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.733+0000 7f2f0dbb8740 1 -- start start 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af6e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af9edb0 0x56111af80910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f041ffdc0 con 0x56111af81510 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0415dd50 con 0x56111af9edb0 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2f041ff770 con 0x56111af6c9a0 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40642/0 (socket says 172.21.15.146:40642) 2024-04-24T23:01:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.734+0000 7f2efbe00640 1 -- 172.21.15.146:0/1634119170 learned_addr learned my addr 172.21.15.146:0/1634119170 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2f08e00640 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af9edb0 0x56111af80910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2f03e00640 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af6e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 -- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 msgr2=0x56111af6e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af6e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 -- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af9edb0 msgr2=0x56111af80910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af9edb0 0x56111af80910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 -- 172.21.15.146:0/1634119170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56111afac3d0 con 0x56111af81510 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2efbe00640 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2eec061830 tx=0x7f2eec084070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da8d1a5f615b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2ef3e00640 1 -- 172.21.15.146:0/1634119170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01e070 con 0x56111af81510 2024-04-24T23:01:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2ef3e00640 1 -- 172.21.15.146:0/1634119170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec05d170 con 0x56111af81510 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.735+0000 7f2ef3e00640 1 -- 172.21.15.146:0/1634119170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec071040 con 0x56111af81510 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1634119170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 msgr2=0x56111af803d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2eec061830 tx=0x7f2eec084070 comp rx=0 tx=0).stop 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1634119170 shutdown_connections 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af9edb0 0x56111af80910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af803d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/1634119170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af6c9a0 0x56111af6e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1634119170 >> 172.21.15.146:0/1634119170 conn(0x56111af571f0 msgr2=0x56111af575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1634119170 shutdown_connections 2024-04-24T23:01:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.736+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/1634119170 wait complete. 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.737+0000 7f2f0dbb8740 1 -- start start 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.737+0000 7f2f0dbb8740 1 Processor -- start 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af6c9a0 0x56111af9f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af9edb0 0x56111af821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56111ae75d20 con 0x56111af81510 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56111af57f90 con 0x56111af6c9a0 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56111aeb5db0 con 0x56111af9edb0 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2f0dbb8740 10 client.0 _ll_register_callbacks cb 0x7f2eec058b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2efbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40650/0 (socket says 172.21.15.146:40650) 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.738+0000 7f2efbe00640 1 -- 172.21.15.146:0/2887131982 learned_addr learned my addr 172.21.15.146:0/2887131982 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 -- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af9edb0 msgr2=0x56111af821d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2f08e00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af9edb0 0x56111af821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af6c9a0 0x56111af9f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af9edb0 0x56111af821d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 -- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af6c9a0 msgr2=0x56111af9f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af6c9a0 0x56111af9f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 -- 172.21.15.146:0/2887131982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56111af803f0 con 0x56111af81510 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2efbe00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007410 tx=0x7f2eec0554d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c496b74df6f4be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2ef1600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01e040 con 0x56111af81510 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2eec054ed0 con 0x56111af81510 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.739+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eec05d170 con 0x56111af81510 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2eec0550d0 con 0x56111af81510 2024-04-24T23:01:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 10 client.5472 fetch_fsmap learned FSMap version 16 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x56111af803f0 con 0x56111af81510 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec05d170 con 0x56111af81510 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7f2eec06d170 con 0x56111af81510 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 10 client.5472 fetch_fsmap finished waiting for FSMap version 16 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 10 client.5472 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 20 client.5472 populate_metadata read hostname 'smithi146' 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af82710 0x56111af505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 4 client.5472 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 --> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] -- command(tid 0: {"prefix": "status"}) -- 0x56111aec1680 con 0x56111af82710 2024-04-24T23:01:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.740+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af82710 0x56111af505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f03e00640 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af82710 0x56111af505f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01362961110a748 server_cookie=6ebafc7931409fcd in_seq=0 out_seq=0 2024-04-24T23:01:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2ef1600640 10 client.5472 ms_handle_connect on v2:172.21.15.146:6833/784142616 2024-04-24T23:01:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2ef1600640 1 -- 172.21.15.146:0/2887131982 <== mds.0 v2:172.21.15.146:6833/784142616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56111aec1680 con 0x56111af82710 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2ef1600640 10 client.5472 handle_command_reply: tid=0 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 client.5472 shutdown 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 msgr2=0x56111af9f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2eec007410 tx=0x7f2eec0554d0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 shutdown_connections 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:6833/784142616,v1:172.21.15.146:6835/784142616] conn(0x56111af82710 0x56111af505f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56111af9edb0 0x56111af821d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56111af81510 0x56111af9f710 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 --2- 172.21.15.146:0/2887131982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56111af6c9a0 0x56111af9f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2ef1600640 0 client.5472 ms_handle_reset on v2:172.21.15.146:6833/784142616 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 >> 172.21.15.146:0/2887131982 conn(0x56111af571f0 msgr2=0x56111afabe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 shutdown_connections 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.741+0000 7f2f0dbb8740 1 -- 172.21.15.146:0/2887131982 wait complete. 2024-04-24T23:01:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0dbb8740 20 client.5472 trim_cache size 0 max 16384 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5289, 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 6.6701931830000003, 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 16, 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 41, 2024-04-24T23:01:41.747 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 41, 2024-04-24T23:01:41.748 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 15.534390304 2024-04-24T23:01:41.748 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:01:41.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 msgr2=0x7f2ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 0x7f2ee006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4034000 tx=0x7f2ef402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:41.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 msgr2=0x7f2f041486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7f0 tx=0x7f2eec00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 shutdown_connections 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f040b3550 0x7f2f041f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f040aee30 0x7f2f041486f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2ee006be30 0x7f2ee006e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 --2- 172.21.15.146:0/3427565718 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2f04072060 0x7f2f0414b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 >> 172.21.15.146:0/3427565718 conn(0x7f2f0406b140 msgr2=0x7f2f0406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 shutdown_connections 2024-04-24T23:01:41.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.742+0000 7f2f0ae00640 1 -- 172.21.15.146:0/3427565718 wait complete. 2024-04-24T23:01:41.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:01:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.955+0000 7efc00a00640 1 Processor -- start 2024-04-24T23:01:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.955+0000 7efc00a00640 1 -- start start 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efc00a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbfc162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efc00a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efbfc0d03a0 0x7efbfc071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efc00a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbfc162990 con 0x7efbfc0715f0 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efc00a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efbfc158970 con 0x7efbfc0d03a0 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efc00a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc070c10 con 0x7efbfc158590 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efbf1400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efbfc0715f0 0x7efbfc0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35668/0 (socket says 172.21.15.146:35668) 2024-04-24T23:01:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.957+0000 7efbf1400640 1 -- 172.21.15.146:0/3628354353 learned_addr learned my addr 172.21.15.146:0/3628354353 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9e00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbfc162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648523696 0 0) 0x7efbe4001110 con 0x7efbfc0715f0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbfa800640 1 --2- 172.21.15.146:0/3628354353 >> v2:172.21.15.203:3300/0 conn(0x7efbfc0d03a0 0x7efbfc071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe0003520 con 0x7efbfc0715f0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3248526887 0 0) 0x7efbe0003520 con 0x7efbfc0715f0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 msgr2=0x7efbfc162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbfc162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 >> v2:172.21.15.203:3300/0 conn(0x7efbfc0d03a0 msgr2=0x7efbfc071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 --2- 172.21.15.146:0/3628354353 >> v2:172.21.15.203:3300/0 conn(0x7efbfc0d03a0 0x7efbfc071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc070ef0 con 0x7efbfc0715f0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7efbe4001840 con 0x7efbfc0715f0 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbfa800640 1 --2- 172.21.15.146:0/3628354353 >> v2:172.21.15.203:3300/0 conn(0x7efbfc0d03a0 0x7efbfc071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 >> v1:172.21.15.146:6789/0 conn(0x7efbfc0715f0 legacy=0x7efbfc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.958+0000 7efbf9400640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe00039b0 0x7efbe0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9400640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbe0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9400640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbe0004d40 0x7efbe00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc158970 con 0x7efbe00039b0 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc070c10 con 0x7efbe0004d40 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efbe000ba80 con 0x7efbfc158590 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe00039b0 0x7efbe0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf1400640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbe0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbfa800640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbe0004d40 0x7efbe00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 -- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 msgr2=0x7efbe0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbfc158590 0x7efbe0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 -- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbe0004d40 msgr2=0x7efbe00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbe0004d40 0x7efbe00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.959+0000 7efbf9e00640 1 -- 172.21.15.146:0/3628354353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbe0003520 con 0x7efbe00039b0 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.960+0000 7efbf9e00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe00039b0 0x7efbe0003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efbec009ac0 tx=0x7efbe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54da4ee03db3424 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec036070 con 0x7efbe00039b0 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec031400 con 0x7efbe00039b0 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efbf9400640 1 -- 172.21.15.146:0/3628354353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec009690 con 0x7efbe00039b0 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 -- 172.21.15.146:0/3628354353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe00039b0 msgr2=0x7efbe0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 --2- 172.21.15.146:0/3628354353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe00039b0 0x7efbe0003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efbec009ac0 tx=0x7efbe0005830 comp rx=0 tx=0).stop 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efbfa800640 1 -- 172.21.15.146:0/3628354353 reap_dead start 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 -- 172.21.15.146:0/3628354353 shutdown_connections 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 -- 172.21.15.146:0/3628354353 >> 172.21.15.146:0/3628354353 conn(0x7efbfc06b320 msgr2=0x7efbfc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 -- 172.21.15.146:0/3628354353 shutdown_connections 2024-04-24T23:01:41.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.961+0000 7efc00a00640 1 -- 172.21.15.146:0/3628354353 wait complete. 2024-04-24T23:01:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.963+0000 7efc00a00640 1 Processor -- start 2024-04-24T23:01:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.963+0000 7efc00a00640 1 -- start start 2024-04-24T23:01:41.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbe00039b0 0x7efbfc14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbfc1f7190 0x7efbfc1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc161f30 con 0x7efbfc150070 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc161c50 con 0x7efbfc1f7190 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efc00a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc162450 con 0x7efbe00039b0 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efbfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efbfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40664/0 (socket says 172.21.15.146:40664) 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.964+0000 7efbfa800640 1 -- 172.21.15.146:0/1437741077 learned_addr learned my addr 172.21.15.146:0/1437741077 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbf1400640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbfc1f7190 0x7efbfc1f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 -- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbe00039b0 msgr2=0x7efbfc14f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbf9e00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbe00039b0 0x7efbfc14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbe00039b0 0x7efbfc14f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 -- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbfc1f7190 msgr2=0x7efbfc1f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbfc1f7190 0x7efbfc1f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 -- 172.21.15.146:0/1437741077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc150da0 con 0x7efbfc150070 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbfa800640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0d09c0 tx=0x7efbf4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.965+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4019070 con 0x7efbfc150070 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.966+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4007cc0 con 0x7efbfc150070 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.966+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4014640 con 0x7efbfc150070 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.966+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc151080 con 0x7efbfc150070 2024-04-24T23:01:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.966+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc151640 con 0x7efbfc150070 2024-04-24T23:01:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.967+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc068190 con 0x7efbfc150070 2024-04-24T23:01:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.968+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efbf401c070 con 0x7efbfc150070 2024-04-24T23:01:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.969+0000 7efbf2a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 0x7efbd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.969+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7efbf408a8e0 con 0x7efbfc150070 2024-04-24T23:01:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.969+0000 7efbf9e00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 0x7efbd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.970+0000 7efbf9e00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 0x7efbd806e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efbec033000 tx=0x7efbec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:41.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:41.973+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efbf4058b40 con 0x7efbfc150070 2024-04-24T23:01:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.216+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efbfc156ea0 con 0x7efbfc150070 2024-04-24T23:01:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.216+0000 7efbf2a00640 1 -- 172.21.15.146:0/1437741077 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7efbf405ce40 con 0x7efbfc150070 2024-04-24T23:01:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:01:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 msgr2=0x7efbd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 0x7efbd806e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efbec033000 tx=0x7efbec008030 comp rx=0 tx=0).stop 2024-04-24T23:01:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 msgr2=0x7efbfc150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0d09c0 tx=0x7efbf4004840 comp rx=0 tx=0).stop 2024-04-24T23:01:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 shutdown_connections 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbfc150070 0x7efbfc150500 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efbfc1f7190 0x7efbfc1f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efbd806be60 0x7efbd806e320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 --2- 172.21.15.146:0/1437741077 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efbe00039b0 0x7efbfc14f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.219+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 >> 172.21.15.146:0/1437741077 conn(0x7efbfc06b320 msgr2=0x7efbfc15f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.220+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 shutdown_connections 2024-04-24T23:01:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42.220+0000 7efc00a00640 1 -- 172.21.15.146:0/1437741077 wait complete. 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:01:42.241 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:42.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.241 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:01:42.291 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:01:42.291 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:01:42.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:01:42.291 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.291 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:42.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42533sec preferred_lft 42533sec 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:01:42.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:01:42.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:42.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.295 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:01:42.374 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:01:42.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.379 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:01:42.433 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:01:42.433 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:01:42.434 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:01:42.434 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:01:42.434 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:01:42.435 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:01:42.435 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:01:42.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:01:42.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:01:42.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:01:42.436 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:01:42.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:01:42.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:42.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.653 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:01:42.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:01:42.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:01:42.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:42.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:01:42.786 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:01:42.786 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:42.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:01:42.839 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:42.891 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:01:42.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:42.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:43.016 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:43.016 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:01:43.050 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:43.051 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:01:43.051 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:01:43.051 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:01:43.051 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:01:43.053 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:01:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:01:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:01:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:01:43.053 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:01:43.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:01:43.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:43.135 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:01:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:01:43.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:43.264 INFO:teuthology.orchestra.run.smithi146.stdout:client5481 2024-04-24T23:01:43.264 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:43.264 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:43.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.315 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rootfile) 2024-04-24T23:01:43.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.423 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-04-24T23:01:43.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.490 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subdirfile) 2024-04-24T23:01:43.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:43.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:43.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.553 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir linkdir) 2024-04-24T23:01:43.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.645 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link0) 2024-04-24T23:01:43.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.701 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link0) 2024-04-24T23:01:43.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.803 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link0) 2024-04-24T23:01:43.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.859 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link1) 2024-04-24T23:01:43.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.912 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link2) 2024-04-24T23:01:43.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:43.969 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link2) 2024-04-24T23:01:44.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.024 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link2) 2024-04-24T23:01:44.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.082 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link3) 2024-04-24T23:01:44.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.140 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link3) 2024-04-24T23:01:44.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.198 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln rootfile linkdir/link3) 2024-04-24T23:01:44.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.252 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/subsubdir) 2024-04-24T23:01:44.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:44.308 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync) 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-04-24T23:01:44.525 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:01:44.670 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-04-24T23:01:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-24T23:01:44.684 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:01:44.867 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627777 2024-04-24T23:01:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:44.880 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:01:44.880 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:01:44.880 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:01:44.880 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:01:44.881 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir").st_ino) 2024-04-24T23:01:44.881 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:01:45.064 INFO:teuthology.orchestra.run.smithi146.stdout:1099511628279 2024-04-24T23:01:45.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-04-24T23:01:45.077 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:01:45.250 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627778 2024-04-24T23:01:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-04-24T23:01:45.263 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:01:45.435 INFO:teuthology.orchestra.run.smithi146.stdout:1099511628282 2024-04-24T23:01:45.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:45.448 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:45.448 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:45.542 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:45.543 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:45.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:45.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.844+0000 7f7de4000640 1 Processor -- start 2024-04-24T23:01:45.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.845+0000 7f7de4000640 1 -- start start 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de4000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ddc15e490 0x7f7ddc0d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de4000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7ddc0cfac0 0x7f7ddc0d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de4000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0b3930 con 0x7f7ddc0d49e0 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de4000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc0d0f50 con 0x7f7ddc15e490 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de4000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc0d1d40 con 0x7f7ddc0cfac0 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de1600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ddc15e490 0x7f7ddc0d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de1600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ddc15e490 0x7f7ddc0d24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40680/0 (socket says 172.21.15.146:40680) 2024-04-24T23:01:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.846+0000 7f7de1600640 1 -- 172.21.15.146:0/2724861918 learned_addr learned my addr 172.21.15.146:0/2724861918 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.847+0000 7f7de2000640 1 --2- 172.21.15.146:0/2724861918 >> v2:172.21.15.203:3300/0 conn(0x7f7ddc0cfac0 0x7f7ddc0d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.847+0000 7f7de1600640 1 -- 172.21.15.146:0/2724861918 >> v2:172.21.15.203:3300/0 conn(0x7f7ddc0cfac0 msgr2=0x7f7ddc0d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.847+0000 7f7de1600640 1 --2- 172.21.15.146:0/2724861918 >> v2:172.21.15.203:3300/0 conn(0x7f7ddc0cfac0 0x7f7ddc0d29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.847+0000 7f7de1600640 1 -- 172.21.15.146:0/2724861918 >> v1:172.21.15.203:6789/0 conn(0x7f7ddc0d49e0 legacy=0x7f7ddc0b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.847+0000 7f7de1600640 1 -- 172.21.15.146:0/2724861918 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc0d2020 con 0x7f7ddc15e490 2024-04-24T23:01:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7de1600640 1 --2- 172.21.15.146:0/2724861918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc0d24a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc08c240 tx=0x7f7dcc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d8000876782d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7ddbe00640 1 -- 172.21.15.146:0/2724861918 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc037070 con 0x7f7ddc15e490 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7ddbe00640 1 -- 172.21.15.146:0/2724861918 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc032440 con 0x7f7ddc15e490 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7ddbe00640 1 -- 172.21.15.146:0/2724861918 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc032810 con 0x7f7ddc15e490 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7de4000640 1 -- 172.21.15.146:0/2724861918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 msgr2=0x7f7ddc0d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.848+0000 7f7de4000640 1 --2- 172.21.15.146:0/2724861918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc0d24a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc08c240 tx=0x7f7dcc02a230 comp rx=0 tx=0).stop 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 -- 172.21.15.146:0/2724861918 shutdown_connections 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 --2- 172.21.15.146:0/2724861918 >> v2:172.21.15.203:3300/0 conn(0x7f7ddc0cfac0 0x7f7ddc0d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 --2- 172.21.15.146:0/2724861918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc0d24a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 -- 172.21.15.146:0/2724861918 >> 172.21.15.146:0/2724861918 conn(0x7f7ddc0d3ec0 msgr2=0x7f7ddc0d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 -- 172.21.15.146:0/2724861918 shutdown_connections 2024-04-24T23:01:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.849+0000 7f7de4000640 1 -- 172.21.15.146:0/2724861918 wait complete. 2024-04-24T23:01:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.850+0000 7f7de4000640 1 Processor -- start 2024-04-24T23:01:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.851+0000 7f7de4000640 1 -- start start 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.851+0000 7f7de4000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0cfac0 0x7f7ddc1f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.851+0000 7f7de4000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc0d49e0 0x7f7ddc0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.851+0000 7f7de4000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de4000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b4540 con 0x7f7ddc15e490 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de4000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0d11a0 con 0x7f7ddc0d49e0 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de4000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b46c0 con 0x7f7ddc0cfac0 2024-04-24T23:01:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40682/0 (socket says 172.21.15.146:40682) 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 -- 172.21.15.146:0/1999979426 learned_addr learned my addr 172.21.15.146:0/1999979426 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de0c00640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc0d49e0 0x7f7ddc0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de1600640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0cfac0 0x7f7ddc1f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 -- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0cfac0 msgr2=0x7f7ddc1f7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0cfac0 0x7f7ddc1f7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 -- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc0d49e0 msgr2=0x7f7ddc0c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc0d49e0 0x7f7ddc0c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.852+0000 7f7de2000640 1 -- 172.21.15.146:0/1999979426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc0c9a50 con 0x7f7ddc15e490 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7de2000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400cda0 tx=0x7f7dd400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4003b90 con 0x7f7ddc15e490 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4003d30 con 0x7f7ddc15e490 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4004240 con 0x7f7ddc15e490 2024-04-24T23:01:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc0c9d30 con 0x7f7ddc15e490 2024-04-24T23:01:45.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.853+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc0ca2f0 con 0x7f7ddc15e490 2024-04-24T23:01:45.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.854+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc0688a0 con 0x7f7ddc15e490 2024-04-24T23:01:45.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.855+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dd40043e0 con 0x7f7ddc15e490 2024-04-24T23:01:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.856+0000 7f7dd9600640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 0x7f7dbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.856+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f7dd408bc20 con 0x7f7ddc15e490 2024-04-24T23:01:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.857+0000 7f7de1600640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 0x7f7dbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.858+0000 7f7de1600640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 0x7f7dbc06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc034000 tx=0x7f7dcc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:45.861+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7dd401d340 con 0x7f7ddc15e490 2024-04-24T23:01:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.064+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ddc0c75f0 con 0x7f7ddc15e490 2024-04-24T23:01:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.067+0000 7f7dd9600640 1 -- 172.21.15.146:0/1999979426 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16966 (secure 0 0 0) 0x7f7dd405a3a0 con 0x7f7ddc15e490 2024-04-24T23:01:46.070 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:46.070 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":41,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:36.067435+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 msgr2=0x7f7dbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 0x7f7dbc06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc034000 tx=0x7f7dcc02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 msgr2=0x7f7ddc155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400cda0 tx=0x7f7dd400a660 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 shutdown_connections 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ddc15e490 0x7f7ddc155bb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc0d49e0 0x7f7ddc0c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7dbc06be30 0x7f7dbc06e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 --2- 172.21.15.146:0/1999979426 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0cfac0 0x7f7ddc1f7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.070+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 >> 172.21.15.146:0/1999979426 conn(0x7f7ddc0d3ec0 msgr2=0x7f7ddc06cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.071+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 shutdown_connections 2024-04-24T23:01:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.071+0000 7f7de4000640 1 -- 172.21.15.146:0/1999979426 wait complete. 2024-04-24T23:01:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:01:32.305853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:01:33.507733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:01:46.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:46.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.295+0000 7f1efdc00640 1 Processor -- start 2024-04-24T23:01:46.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.295+0000 7f1efdc00640 1 -- start start 2024-04-24T23:01:46.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efdc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1ef8155120 0x7f1ef80b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efdc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef8071ab0 con 0x7f1ef80cfcc0 2024-04-24T23:01:46.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efdc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef8155500 con 0x7f1ef8155120 2024-04-24T23:01:46.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efdc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef815d1b0 con 0x7f1ef80d0120 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.297+0000 7f1efd200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:33694/0 (socket says 172.21.15.146:33694) 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1ef7e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1ef8155120 0x7f1ef80b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 -- 172.21.15.146:0/2280980838 learned_addr learned my addr 172.21.15.146:0/2280980838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 -- 172.21.15.146:0/2280980838 >> v2:172.21.15.203:3300/0 conn(0x7f1ef8155120 msgr2=0x7f1ef80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 --2- 172.21.15.146:0/2280980838 >> v2:172.21.15.203:3300/0 conn(0x7f1ef8155120 0x7f1ef80b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 -- 172.21.15.146:0/2280980838 >> v1:172.21.15.203:6789/0 conn(0x7f1ef80cfcc0 legacy=0x7f1ef806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.298+0000 7f1efd200640 1 -- 172.21.15.146:0/2280980838 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef8071d90 con 0x7f1ef80d0120 2024-04-24T23:01:46.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.300+0000 7f1efd200640 1 --2- 172.21.15.146:0/2280980838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009e50 tx=0x7f1ef002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930ffedbb20c6057 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.300+0000 7f1ef7400640 1 -- 172.21.15.146:0/2280980838 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0036070 con 0x7f1ef80d0120 2024-04-24T23:01:46.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.300+0000 7f1ef7400640 1 -- 172.21.15.146:0/2280980838 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0031600 con 0x7f1ef80d0120 2024-04-24T23:01:46.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.300+0000 7f1ef7400640 1 -- 172.21.15.146:0/2280980838 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00319d0 con 0x7f1ef80d0120 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 -- 172.21.15.146:0/2280980838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 msgr2=0x7f1ef806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 --2- 172.21.15.146:0/2280980838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009e50 tx=0x7f1ef002a710 comp rx=0 tx=0).stop 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 -- 172.21.15.146:0/2280980838 shutdown_connections 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 --2- 172.21.15.146:0/2280980838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef806df70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 --2- 172.21.15.146:0/2280980838 >> v2:172.21.15.203:3300/0 conn(0x7f1ef8155120 0x7f1ef80b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 -- 172.21.15.146:0/2280980838 >> 172.21.15.146:0/2280980838 conn(0x7f1ef806b560 msgr2=0x7f1ef806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:46.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 -- 172.21.15.146:0/2280980838 shutdown_connections 2024-04-24T23:01:46.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.301+0000 7f1efdc00640 1 -- 172.21.15.146:0/2280980838 wait complete. 2024-04-24T23:01:46.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.303+0000 7f1efdc00640 1 Processor -- start 2024-04-24T23:01:46.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.303+0000 7f1efdc00640 1 -- start start 2024-04-24T23:01:46.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef80cfcc0 0x7f1ef8141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef81efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8072630 con 0x7f1ef8155120 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8072350 con 0x7f1ef80cfcc0 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efdc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef80d05b0 con 0x7f1ef80d0120 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40692/0 (socket says 172.21.15.146:40692) 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1efd200640 1 -- 172.21.15.146:0/1468034990 learned_addr learned my addr 172.21.15.146:0/1468034990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1eef400640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef81efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.304+0000 7f1ef7e00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef80cfcc0 0x7f1ef8141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 -- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 msgr2=0x7f1ef81efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef81efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 -- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef80cfcc0 msgr2=0x7f1ef8141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef80cfcc0 0x7f1ef8141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 -- 172.21.15.146:0/1468034990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef81f04c0 con 0x7f1ef8155120 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1efd200640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0034040 tx=0x7f1ef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef003f020 con 0x7f1ef8155120 2024-04-24T23:01:46.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0037040 con 0x7f1ef8155120 2024-04-24T23:01:46.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.305+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0036070 con 0x7f1ef8155120 2024-04-24T23:01:46.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.306+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef81f07a0 con 0x7f1ef8155120 2024-04-24T23:01:46.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.306+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef8141b90 con 0x7f1ef8155120 2024-04-24T23:01:46.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.307+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef804f500 con 0x7f1ef8155120 2024-04-24T23:01:46.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.308+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ef0042020 con 0x7f1ef8155120 2024-04-24T23:01:46.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.309+0000 7f1ef4c00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.309+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f1ef00ab420 con 0x7f1ef8155120 2024-04-24T23:01:46.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.309+0000 7f1ef7e00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.310+0000 7f1ef7e00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 0x7f1ed406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009ad0 tx=0x7f1ee8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.313+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1ef0049030 con 0x7f1ef8155120 2024-04-24T23:01:46.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.510+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ef80cbbf0 con 0x7f1ef8155120 2024-04-24T23:01:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.511+0000 7f1ef4c00640 1 -- 172.21.15.146:0/1468034990 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f1ef0079bb0 con 0x7f1ef8155120 2024-04-24T23:01:46.513 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 msgr2=0x7f1ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 0x7f1ed406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009ad0 tx=0x7f1ee8008040 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 msgr2=0x7f1ef814e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0034040 tx=0x7f1ef0004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 shutdown_connections 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.513+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ef8155120 0x7f1ef814e040 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ef80d0120 0x7f1ef81efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 --2- 172.21.15.146:0/1468034990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef80cfcc0 0x7f1ef8141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 >> 172.21.15.146:0/1468034990 conn(0x7f1ef806b560 msgr2=0x7f1ef815afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 shutdown_connections 2024-04-24T23:01:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.514+0000 7f1efdc00640 1 -- 172.21.15.146:0/1468034990 wait complete. 2024-04-24T23:01:46.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:46.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.731+0000 7f7030a00640 1 Processor -- start 2024-04-24T23:01:46.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.731+0000 7f7030a00640 1 -- start start 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f7030a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f702c0d03d0 0x7f702c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f7030a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c15f070 con 0x7f702c158300 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f7030a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c161aa0 con 0x7f702c162580 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f7030a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f702c0b2ae0 con 0x7f702c0d03d0 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f702c0d03d0 0x7f702c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f702c0d03d0 0x7f702c15e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40702/0 (socket says 172.21.15.146:40702) 2024-04-24T23:01:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 -- 172.21.15.146:0/4119189460 learned_addr learned my addr 172.21.15.146:0/4119189460 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:46.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 -- 172.21.15.146:0/4119189460 >> v1:172.21.15.203:6789/0 conn(0x7f702c162580 legacy=0x7f702c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:46.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 -- 172.21.15.146:0/4119189460 >> v1:172.21.15.146:6789/0 conn(0x7f702c158300 legacy=0x7f702c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.733+0000 7f702aa00640 1 -- 172.21.15.146:0/4119189460 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c161d80 con 0x7f702c0d03d0 2024-04-24T23:01:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f702aa00640 1 --2- 172.21.15.146:0/4119189460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0d03d0 0x7f702c15e310 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f701802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f0b16c0260f928 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f702a000640 1 -- 172.21.15.146:0/4119189460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018037070 con 0x7f702c0d03d0 2024-04-24T23:01:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f702a000640 1 -- 172.21.15.146:0/4119189460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7018032640 con 0x7f702c0d03d0 2024-04-24T23:01:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f702a000640 1 -- 172.21.15.146:0/4119189460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018032a10 con 0x7f702c0d03d0 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f7030a00640 1 -- 172.21.15.146:0/4119189460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0d03d0 msgr2=0x7f702c15e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.735+0000 7f7030a00640 1 --2- 172.21.15.146:0/4119189460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0d03d0 0x7f702c15e310 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f701802a330 comp rx=0 tx=0).stop 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.736+0000 7f7030a00640 1 -- 172.21.15.146:0/4119189460 shutdown_connections 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.736+0000 7f7030a00640 1 --2- 172.21.15.146:0/4119189460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0d03d0 0x7f702c15e310 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.736+0000 7f7030a00640 1 -- 172.21.15.146:0/4119189460 >> 172.21.15.146:0/4119189460 conn(0x7f702c06b560 msgr2=0x7f702c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.736+0000 7f7030a00640 1 -- 172.21.15.146:0/4119189460 shutdown_connections 2024-04-24T23:01:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.736+0000 7f7030a00640 1 -- 172.21.15.146:0/4119189460 wait complete. 2024-04-24T23:01:46.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.737+0000 7f7030a00640 1 Processor -- start 2024-04-24T23:01:46.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.738+0000 7f7030a00640 1 -- start start 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 0x7f702c15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 0x7f702c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f702c06cab0 con 0x7f702c158300 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1586e0 con 0x7f702c0d03d0 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f7030a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f702c06cc30 con 0x7f702c162580 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40710/0 (socket says 172.21.15.146:40710) 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 -- 172.21.15.146:0/1753308052 learned_addr learned my addr 172.21.15.146:0/1753308052 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702b400640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 0x7f702c15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702be00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 0x7f702c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 -- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 msgr2=0x7f702c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 0x7f702c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 -- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 msgr2=0x7f702c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 0x7f702c15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702aa00640 1 -- 172.21.15.146:0/1753308052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c14b1f0 con 0x7f702c158300 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702b400640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 0x7f702c15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.739+0000 7f702be00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 0x7f702c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f702aa00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f70180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018041070 con 0x7f702c158300 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701803c870 con 0x7f702c158300 2024-04-24T23:01:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018037040 con 0x7f702c158300 2024-04-24T23:01:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c15e430 con 0x7f702c158300 2024-04-24T23:01:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.740+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c152140 con 0x7f702c158300 2024-04-24T23:01:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.742+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c04f500 con 0x7f702c158300 2024-04-24T23:01:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.742+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7018044070 con 0x7f702c158300 2024-04-24T23:01:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.743+0000 7f7023400640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 0x7f700c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:46.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.743+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f70180abee0 con 0x7f702c158300 2024-04-24T23:01:46.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.744+0000 7f702b400640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 0x7f700c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:46.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.745+0000 7f702b400640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 0x7f700c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f701c001680 tx=0x7f701c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:46.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.748+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f702c14b1f0 con 0x7f702c158300 2024-04-24T23:01:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.949+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f702c0b4dd0 con 0x7f702c158300 2024-04-24T23:01:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.950+0000 7f7023400640 1 -- 172.21.15.146:0/1753308052 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) ==== 104+0+11 (secure 0 0 0) 0x7f701807a810 con 0x7f702c158300 2024-04-24T23:01:46.952 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 msgr2=0x7f700c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 0x7f700c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f701c001680 tx=0x7f701c009040 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 msgr2=0x7f702c15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f70180046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 shutdown_connections 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700c06be30 0x7f700c06e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c162580 0x7f702c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c158300 0x7f702c15ddc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 --2- 172.21.15.146:0/1753308052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0d03d0 0x7f702c15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 >> 172.21.15.146:0/1753308052 conn(0x7f702c06b560 msgr2=0x7f702c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 shutdown_connections 2024-04-24T23:01:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:46.953+0000 7f7030a00640 1 -- 172.21.15.146:0/1753308052 wait complete. 2024-04-24T23:01:46.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:47.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.181+0000 7faed0c00640 1 Processor -- start 2024-04-24T23:01:47.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.181+0000 7faed0c00640 1 -- start start 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faed0c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7faecc15cd60 0x7faecc0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faed0c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faecc15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faed0c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0b4df0 con 0x7faecc15bcd0 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faed0c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7faecc15c8d0 con 0x7faecc15cd60 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faed0c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0b4b10 con 0x7faecc0d0200 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faecb400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faecc15bcd0 0x7faecc0cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35688/0 (socket says 172.21.15.146:35688) 2024-04-24T23:01:47.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.183+0000 7faecb400640 1 -- 172.21.15.146:0/3450084212 learned_addr learned my addr 172.21.15.146:0/3450084212 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faecaa00640 1 --2- 172.21.15.146:0/3450084212 >> v2:172.21.15.203:3300/0 conn(0x7faecc15cd60 0x7faecc0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521016204 0 0) 0x7faecc0b4df0 con 0x7faecc15bcd0 2024-04-24T23:01:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb0003520 con 0x7faecc15bcd0 2024-04-24T23:01:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faecbe00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faecc15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1361888269 0 0) 0x7faeb0003520 con 0x7faecc15bcd0 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 msgr2=0x7faecc15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faecc15f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 >> v2:172.21.15.203:3300/0 conn(0x7faecc15cd60 msgr2=0x7faecc0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 --2- 172.21.15.146:0/3450084212 >> v2:172.21.15.203:3300/0 conn(0x7faecc15cd60 0x7faecc0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc15c280 con 0x7faecc15bcd0 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7faebc001670 con 0x7faecc15bcd0 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 >> v1:172.21.15.146:6789/0 conn(0x7faecc15bcd0 legacy=0x7faecc0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faeb00039b0 0x7faeb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faeb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faeb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faecc15c8d0 con 0x7faeb0004d40 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0b4b10 con 0x7faeb00039b0 2024-04-24T23:01:47.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faeb000bb20 con 0x7faecc0d0200 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.184+0000 7faecbe00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faeb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecb400640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faeb00039b0 0x7faeb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecbe00640 1 -- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 msgr2=0x7faeb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecaa00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faeb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecbe00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc0d0200 0x7faeb0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecbe00640 1 -- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faeb00039b0 msgr2=0x7faeb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecbe00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faeb00039b0 0x7faeb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecbe00640 1 -- 172.21.15.146:0/3450084212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb0003520 con 0x7faeb0004d40 2024-04-24T23:01:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.185+0000 7faecb400640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faeb00039b0 0x7faeb0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:47.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.186+0000 7faecbe00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faeb00051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faec4007360 tx=0x7faeb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128ba8a953add22c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.186+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4009be0 con 0x7faeb0004d40 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.186+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec4036600 con 0x7faeb0004d40 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.186+0000 7faeca000640 1 -- 172.21.15.146:0/3450084212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec40369d0 con 0x7faeb0004d40 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 -- 172.21.15.146:0/3450084212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 msgr2=0x7faeb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 --2- 172.21.15.146:0/3450084212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faeb00051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faec4007360 tx=0x7faeb0005830 comp rx=0 tx=0).stop 2024-04-24T23:01:47.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faecbe00640 1 -- 172.21.15.146:0/3450084212 reap_dead start 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 -- 172.21.15.146:0/3450084212 shutdown_connections 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 -- 172.21.15.146:0/3450084212 >> 172.21.15.146:0/3450084212 conn(0x7faecc06b560 msgr2=0x7faecc06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 -- 172.21.15.146:0/3450084212 shutdown_connections 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.187+0000 7faed0c00640 1 -- 172.21.15.146:0/3450084212 wait complete. 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.189+0000 7faed0c00640 1 Processor -- start 2024-04-24T23:01:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.189+0000 7faed0c00640 1 -- start start 2024-04-24T23:01:47.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc143190 0x7faecc152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc1435d0 0x7faecc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0b4790 con 0x7faeb0004d40 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faecc06e590 con 0x7faecc143190 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faed0c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faecc15f6f0 con 0x7faecc1435d0 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faecb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faecb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40722/0 (socket says 172.21.15.146:40722) 2024-04-24T23:01:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.190+0000 7faecb400640 1 -- 172.21.15.146:0/636941031 learned_addr learned my addr 172.21.15.146:0/636941031 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 -- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc1435d0 msgr2=0x7faecc1532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc1435d0 0x7faecc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 -- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc143190 msgr2=0x7faecc152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc143190 0x7faecc152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 -- 172.21.15.146:0/636941031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc151330 con 0x7faeb0004d40 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faecb400640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faebc00d8e0 tx=0x7faebc00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc019070 con 0x7faeb0004d40 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc0074e0 con 0x7faeb0004d40 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc004a00 con 0x7faeb0004d40 2024-04-24T23:01:47.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc1f8100 con 0x7faeb0004d40 2024-04-24T23:01:47.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.191+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc1548a0 con 0x7faeb0004d40 2024-04-24T23:01:47.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.193+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc1543d0 con 0x7faeb0004d40 2024-04-24T23:01:47.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.194+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faebc01c070 con 0x7faeb0004d40 2024-04-24T23:01:47.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.194+0000 7faec3400640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 0x7faeac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.194+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7faebc08aba0 con 0x7faeb0004d40 2024-04-24T23:01:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.195+0000 7faecaa00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 0x7faeac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.196+0000 7faecaa00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 0x7faeac06e320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006e80 tx=0x7faeb8006e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.199+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faebc0593b0 con 0x7faeb0004d40 2024-04-24T23:01:47.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.396+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faecc0cf030 con 0x7faeb0004d40 2024-04-24T23:01:47.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.397+0000 7faec3400640 1 -- 172.21.15.146:0/636941031 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) ==== 100+0+11 (secure 0 0 0) 0x7faebc058cb0 con 0x7faeb0004d40 2024-04-24T23:01:47.399 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 msgr2=0x7faeac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 0x7faeac06e320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006e80 tx=0x7faeb8006e10 comp rx=0 tx=0).stop 2024-04-24T23:01:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 msgr2=0x7faecc150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faebc00d8e0 tx=0x7faebc00dda0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 shutdown_connections 2024-04-24T23:01:47.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faeac06be60 0x7faeac06e320 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faecc1435d0 0x7faecc1532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc143190 0x7faecc152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 --2- 172.21.15.146:0/636941031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faeb0004d40 0x7faecc150df0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.399+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 >> 172.21.15.146:0/636941031 conn(0x7faecc06b560 msgr2=0x7faecc0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:47.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.400+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 shutdown_connections 2024-04-24T23:01:47.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.400+0000 7faed0c00640 1 -- 172.21.15.146:0/636941031 wait complete. 2024-04-24T23:01:47.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.621+0000 7f2fc7e00640 1 Processor -- start 2024-04-24T23:01:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.621+0000 7f2fc7e00640 1 -- start start 2024-04-24T23:01:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc7e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 0x7f2fc0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fc0072060 0x7f2fc0161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc7e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc00af210 con 0x7f2fc00aee30 2024-04-24T23:01:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc7e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc0072c60 con 0x7f2fc0072060 2024-04-24T23:01:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc7e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc0071040 con 0x7f2fc0072680 2024-04-24T23:01:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc5400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2fc00aee30 0x7f2fc00b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35702/0 (socket says 172.21.15.146:35702) 2024-04-24T23:01:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc5400640 1 -- 172.21.15.146:0/2629369847 learned_addr learned my addr 172.21.15.146:0/2629369847 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.623+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/2629369847 >> v2:172.21.15.146:3300/0 conn(0x7f2fc0072060 0x7f2fc0161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 0x7f2fc0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc5e00640 1 -- 172.21.15.146:0/2629369847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 msgr2=0x7f2fc0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 0x7f2fc0071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc5e00640 1 -- 172.21.15.146:0/2629369847 >> v1:172.21.15.146:6789/0 conn(0x7f2fc00aee30 legacy=0x7f2fc00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc5e00640 1 -- 172.21.15.146:0/2629369847 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc0071320 con 0x7f2fc0072060 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fbfe00640 1 -- 172.21.15.146:0/2629369847 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527508835 0 0) 0x7f2fc00af210 con 0x7f2fc00aee30 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.624+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 0x7f2fc0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.625+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0072060 0x7f2fc0161cb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009d90 tx=0x7f2fb802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60226eb7e89d9265 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.625+0000 7f2fbfe00640 1 -- 172.21.15.146:0/2629369847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8031600 con 0x7f2fc0072060 2024-04-24T23:01:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.625+0000 7f2fbfe00640 1 -- 172.21.15.146:0/2629369847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb80317a0 con 0x7f2fc0072060 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.625+0000 7f2fbfe00640 1 -- 172.21.15.146:0/2629369847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8031b70 con 0x7f2fc0072060 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 -- 172.21.15.146:0/2629369847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0072060 msgr2=0x7f2fc0161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0072060 0x7f2fc0161cb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009d90 tx=0x7f2fb802a5d0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 -- 172.21.15.146:0/2629369847 shutdown_connections 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0072060 0x7f2fc0161cb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/2629369847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072680 0x7f2fc0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 -- 172.21.15.146:0/2629369847 >> 172.21.15.146:0/2629369847 conn(0x7f2fc006b140 msgr2=0x7f2fc006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 -- 172.21.15.146:0/2629369847 shutdown_connections 2024-04-24T23:01:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.626+0000 7f2fc7e00640 1 -- 172.21.15.146:0/2629369847 wait complete. 2024-04-24T23:01:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.628+0000 7f2fc7e00640 1 Processor -- start 2024-04-24T23:01:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.628+0000 7f2fc7e00640 1 -- start start 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072060 0x7f2fc00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fc0072680 0x7f2fc014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0162370 con 0x7f2fc00aee30 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01621f0 con 0x7f2fc0072680 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc7e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc01624f0 con 0x7f2fc0072060 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40740/0 (socket says 172.21.15.146:40740) 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.629+0000 7f2fc5e00640 1 -- 172.21.15.146:0/1838862333 learned_addr learned my addr 172.21.15.146:0/1838862333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5400640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072060 0x7f2fc00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fc0072680 0x7f2fc014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 -- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072060 msgr2=0x7f2fc00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072060 0x7f2fc00ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 -- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fc0072680 msgr2=0x7f2fc014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fc0072680 0x7f2fc014d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 -- 172.21.15.146:0/1838862333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc015cc30 con 0x7f2fc00aee30 2024-04-24T23:01:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.630+0000 7f2fc5e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009eb0 tx=0x7f2fb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.631+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb803f070 con 0x7f2fc00aee30 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.631+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8030b60 con 0x7f2fc00aee30 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.631+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8044460 con 0x7f2fc00aee30 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.631+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc015cf10 con 0x7f2fc00aee30 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.631+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc015d4d0 con 0x7f2fc00aee30 2024-04-24T23:01:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.632+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc004f5a0 con 0x7f2fc00aee30 2024-04-24T23:01:47.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.633+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fb803b410 con 0x7f2fc00aee30 2024-04-24T23:01:47.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.634+0000 7f2fbd600640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 0x7f2fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:47.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.634+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2fb80ac750 con 0x7f2fc00aee30 2024-04-24T23:01:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.634+0000 7f2fc5400640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 0x7f2fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.635+0000 7f2fc5400640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 0x7f2fa406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000f60 tx=0x7f2fb4007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.638+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2fb807a940 con 0x7f2fc00aee30 2024-04-24T23:01:47.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.856+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2fc00cbb70 con 0x7f2fc00aee30 2024-04-24T23:01:47.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.856+0000 7f2fbd600640 1 -- 172.21.15.146:0/1838862333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f2fb807ec40 con 0x7f2fc00aee30 2024-04-24T23:01:47.859 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:01:47.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 msgr2=0x7f2fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 0x7f2fa406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000f60 tx=0x7f2fb4007c00 comp rx=0 tx=0).stop 2024-04-24T23:01:47.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 msgr2=0x7f2fc014d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009eb0 tx=0x7f2fb8004a40 comp rx=0 tx=0).stop 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 shutdown_connections 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc00aee30 0x7f2fc014d650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fc0072680 0x7f2fc014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fa406be30 0x7f2fa406e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 --2- 172.21.15.146:0/1838862333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fc0072060 0x7f2fc00ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.859+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 >> 172.21.15.146:0/1838862333 conn(0x7f2fc006b140 msgr2=0x7f2fc015e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.860+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 shutdown_connections 2024-04-24T23:01:47.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:47.860+0000 7f2fc7e00640 1 -- 172.21.15.146:0/1838862333 wait complete. 2024-04-24T23:01:47.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:01:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:47.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:48.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:01:48.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:48.004 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:01:48.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:01:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.235+0000 7f3d61a00640 1 Processor -- start 2024-04-24T23:01:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.235+0000 7f3d61a00640 1 -- start start 2024-04-24T23:01:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.236+0000 7f3d61a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3d5c0aee30 0x7f3d5c072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.236+0000 7f3d61a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d5c0b3550 0x7f3d5c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.236+0000 7f3d61a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5c0af210 con 0x7f3d5c072060 2024-04-24T23:01:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.236+0000 7f3d61a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c072c60 con 0x7f3d5c0b3550 2024-04-24T23:01:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.236+0000 7f3d61a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c071040 con 0x7f3d5c0aee30 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d5c0b3550 0x7f3d5c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d5c0b3550 0x7f3d5c071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33690/0 (socket says 172.21.15.146:33690) 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 -- 172.21.15.146:0/3071332684 learned_addr learned my addr 172.21.15.146:0/3071332684 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5aa00640 1 --2- 172.21.15.146:0/3071332684 >> v2:172.21.15.203:3300/0 conn(0x7f3d5c0aee30 0x7f3d5c072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 -- 172.21.15.146:0/3071332684 >> v2:172.21.15.203:3300/0 conn(0x7f3d5c0aee30 msgr2=0x7f3d5c072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 --2- 172.21.15.146:0/3071332684 >> v2:172.21.15.203:3300/0 conn(0x7f3d5c0aee30 0x7f3d5c072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 -- 172.21.15.146:0/3071332684 >> v1:172.21.15.203:6789/0 conn(0x7f3d5c072060 legacy=0x7f3d5c161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.237+0000 7f3d5a000640 1 -- 172.21.15.146:0/3071332684 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c071320 con 0x7f3d5c0b3550 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.238+0000 7f3d5a000640 1 --2- 172.21.15.146:0/3071332684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c0b3550 0x7f3d5c071b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06ec30 tx=0x7f3d4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d092854c4494140c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d59600640 1 -- 172.21.15.146:0/3071332684 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44037070 con 0x7f3d5c0b3550 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d59600640 1 -- 172.21.15.146:0/3071332684 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d44032440 con 0x7f3d5c0b3550 2024-04-24T23:01:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d59600640 1 -- 172.21.15.146:0/3071332684 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44032810 con 0x7f3d5c0b3550 2024-04-24T23:01:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 -- 172.21.15.146:0/3071332684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c0b3550 msgr2=0x7f3d5c071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 --2- 172.21.15.146:0/3071332684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c0b3550 0x7f3d5c071b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06ec30 tx=0x7f3d4402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 -- 172.21.15.146:0/3071332684 shutdown_connections 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 --2- 172.21.15.146:0/3071332684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c0b3550 0x7f3d5c071b20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 --2- 172.21.15.146:0/3071332684 >> v2:172.21.15.203:3300/0 conn(0x7f3d5c0aee30 0x7f3d5c072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 -- 172.21.15.146:0/3071332684 >> 172.21.15.146:0/3071332684 conn(0x7f3d5c06b140 msgr2=0x7f3d5c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 -- 172.21.15.146:0/3071332684 shutdown_connections 2024-04-24T23:01:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.239+0000 7f3d61a00640 1 -- 172.21.15.146:0/3071332684 wait complete. 2024-04-24T23:01:48.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.241+0000 7f3d61a00640 1 Processor -- start 2024-04-24T23:01:48.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.241+0000 7f3d61a00640 1 -- start start 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d5c0aee30 0x7f3d5c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d5c0b3550 0x7f3d5c15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0b39c0 con 0x7f3d5c072060 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c1623c0 con 0x7f3d5c0aee30 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d61a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c158bf0 con 0x7f3d5c0b3550 2024-04-24T23:01:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d5aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d5aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33692/0 (socket says 172.21.15.146:33692) 2024-04-24T23:01:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.242+0000 7f3d5aa00640 1 -- 172.21.15.146:0/1467765695 learned_addr learned my addr 172.21.15.146:0/1467765695 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 -- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d5c0b3550 msgr2=0x7f3d5c15cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d5c0b3550 0x7f3d5c15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 -- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d5c0aee30 msgr2=0x7f3d5c15bf20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d5c0aee30 0x7f3d5c15bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 -- 172.21.15.146:0/1467765695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c158ed0 con 0x7f3d5c072060 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d5aa00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00d800 tx=0x7f3d4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00b6c0 con 0x7f3d5c072060 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c019070 con 0x7f3d5c072060 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00ba80 con 0x7f3d5c072060 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.243+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5c1591b0 con 0x7f3d5c072060 2024-04-24T23:01:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.244+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5c15c460 con 0x7f3d5c072060 2024-04-24T23:01:48.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.245+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5c1596d0 con 0x7f3d5c072060 2024-04-24T23:01:48.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.246+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d4c00bc20 con 0x7f3d5c072060 2024-04-24T23:01:48.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.247+0000 7f3d52a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 0x7f3d3806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.247+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3d4c08b430 con 0x7f3d5c072060 2024-04-24T23:01:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.247+0000 7f3d5a000640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 0x7f3d3806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.248+0000 7f3d5a000640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 0x7f3d3806e340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d44034000 tx=0x7f3d4402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.251+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d5c1596d0 con 0x7f3d5c072060 2024-04-24T23:01:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.480+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3d5c1559d0 con 0x7f3d5c072060 2024-04-24T23:01:48.483 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:01:48.481+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:01:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.485+0000 7f3d52a00640 1 -- 172.21.15.146:0/1467765695 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f3d4c059cc0 con 0x7f3d5c072060 2024-04-24T23:01:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:01:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 msgr2=0x7f3d3806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 0x7f3d3806e340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d44034000 tx=0x7f3d4402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 msgr2=0x7f3d5c147550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00d800 tx=0x7f3d4c00dcc0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 shutdown_connections 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d3806be80 0x7f3d3806e340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d5c0b3550 0x7f3d5c15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d5c0aee30 0x7f3d5c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 --2- 172.21.15.146:0/1467765695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d5c072060 0x7f3d5c147550 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 >> 172.21.15.146:0/1467765695 conn(0x7f3d5c06b140 msgr2=0x7f3d5c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 shutdown_connections 2024-04-24T23:01:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.488+0000 7f3d61a00640 1 -- 172.21.15.146:0/1467765695 wait complete. 2024-04-24T23:01:48.510 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-04-24T23:01:48.523 INFO:tasks.ceph.mds.c.smithi146.stderr: -8747> 2024-04-24T23:01:37.997+0000 7f041d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:01:48.598 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:01:48.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.604+0000 7f4ee0325f40 1 Processor -- start 2024-04-24T23:01:48.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.604+0000 7f4ee0325f40 1 -- start start 2024-04-24T23:01:48.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c2630 0x559392a30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559392a4d5f0 0x559392a33d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55939291d640 con 0x5593929c1710 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559392921680 con 0x559392a4d5f0 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5593929bf620 con 0x5593929c2630 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4edca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4edca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33738/0 (socket says 172.21.15.146:33738) 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.605+0000 7f4edca00640 1 -- 172.21.15.146:0/1387012748 learned_addr learned my addr 172.21.15.146:0/1387012748 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 -- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c2630 msgr2=0x559392a30760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c2630 0x559392a30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 -- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559392a4d5f0 msgr2=0x559392a33d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559392a4d5f0 0x559392a33d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 -- 172.21.15.146:0/1387012748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559392a321f0 con 0x5593929c1710 2024-04-24T23:01:48.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4edca00640 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000b2c0 tx=0x7f4ed000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c38b4908cf5032 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4ed6a00640 1 -- 172.21.15.146:0/1387012748 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0008070 con 0x5593929c1710 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4ed6a00640 1 -- 172.21.15.146:0/1387012748 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed000d500 con 0x5593929c1710 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.606+0000 7f4ed6a00640 1 -- 172.21.15.146:0/1387012748 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000d8d0 con 0x5593929c1710 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1387012748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 msgr2=0x559392a494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000b2c0 tx=0x7f4ed000b780 comp rx=0 tx=0).stop 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1387012748 shutdown_connections 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559392a4d5f0 0x559392a33d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c2630 0x559392a30760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1387012748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593929c1710 0x559392a494f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1387012748 >> 172.21.15.146:0/1387012748 conn(0x5593929a5a20 msgr2=0x5593929a8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1387012748 shutdown_connections 2024-04-24T23:01:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1387012748 wait complete. 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.607+0000 7f4ee0325f40 1 Processor -- start 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.608+0000 7f4ee0325f40 1 -- start start 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.608+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c1710 0x559392a4f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.608+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593929c2630 0x559392a4f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4ee0325f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 0x559392a41e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559392a32490 con 0x559392a4d5f0 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559392a32770 con 0x5593929c2630 2024-04-24T23:01:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4ee0325f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5593929a5540 con 0x5593929c1710 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 0x559392a41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 0x559392a41e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33750/0 (socket says 172.21.15.146:33750) 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 -- 172.21.15.146:0/1782299295 learned_addr learned my addr 172.21.15.146:0/1782299295 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edca00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c1710 0x559392a4f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4ed7e00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593929c2630 0x559392a4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 -- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c1710 msgr2=0x559392a4f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c1710 0x559392a4f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 -- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593929c2630 msgr2=0x559392a4f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593929c2630 0x559392a4f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edd400640 1 -- 172.21.15.146:0/1782299295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559392a4e580 con 0x559392a4d5f0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.609+0000 7f4edca00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5593929c1710 0x559392a4f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4edd400640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 0x559392a41e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8006fc0 tx=0x7f4ed800b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4ed5600640 1 -- 172.21.15.146:0/1782299295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011620 con 0x559392a4d5f0 2024-04-24T23:01:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4ed5600640 1 -- 172.21.15.146:0/1782299295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed8016070 con 0x559392a4d5f0 2024-04-24T23:01:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5593929a9940 con 0x559392a4d5f0 2024-04-24T23:01:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4ed5600640 1 -- 172.21.15.146:0/1782299295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011a60 con 0x559392a4d5f0 2024-04-24T23:01:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.610+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559392a48ee0 con 0x559392a4d5f0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.612+0000 7f4ed5600640 1 -- 172.21.15.146:0/1782299295 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ed8011c00 con 0x559392a4d5f0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.613+0000 7f4ed5600640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ebc06a810 0x7f4ebc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.613+0000 7f4ed5600640 1 -- 172.21.15.146:0/1782299295 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f4ed80899f0 con 0x559392a4d5f0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.613+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x559392a4b390 0x559392a4b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.613+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x559392a2f2c0 con 0x559392a4b390 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.613+0000 7f4edca00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ebc06a810 0x7f4ebc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.614+0000 7f4ed7e00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x559392a4b390 0x559392a4b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.614+0000 7f4ed7e00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x559392a4b390 0x559392a4b770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.614+0000 7f4ed7e00640 1 -- 172.21.15.146:0/1782299295 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f4ec80534e0 con 0x559392a4b390 2024-04-24T23:01:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:error getting omap key set cephfs_metadata2024-04-24T23:01:48.614+0000 7f4edca00640 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ebc06a810 0x7f4ebc06ccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000b2c0 tx=0x7f4ed0008000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:/10000000001.00000000: (2) No such file or directory 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x559392a4b390 msgr2=0x559392a4b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x559392a4b390 0x559392a4b770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ebc06a810 msgr2=0x7f4ebc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ebc06a810 0x7f4ebc06ccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000b2c0 tx=0x7f4ed0008000 comp rx=0 tx=0).stop 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 msgr2=0x559392a41e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 --2- 172.21.15.146:0/1782299295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559392a4d5f0 0x559392a41e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8006fc0 tx=0x7f4ed800b4b0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4edd400640 1 -- 172.21.15.146:0/1782299295 reap_dead start 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 shutdown_connections 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 >> 172.21.15.146:0/1782299295 conn(0x5593929a5a20 msgr2=0x5593929a6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 shutdown_connections 2024-04-24T23:01:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.615+0000 7f4ee0325f40 1 -- 172.21.15.146:0/1782299295 wait complete. 2024-04-24T23:01:48.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:01:48.621 ERROR:tasks.cephfs.filesystem:Command failed on smithi146 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000' 2024-04-24T23:01:48.621 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-04-24T23:01:48.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.751+0000 7f2319f16f40 1 Processor -- start 2024-04-24T23:01:48.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.751+0000 7f2319f16f40 1 -- start start 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa7ba910 0x55f0fa7ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa896300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0fa808230 con 0x55f0fa878860 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0fa762640 con 0x55f0fa7ee020 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2319f16f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f0fa807310 con 0x55f0fa7ba910 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33768/0 (socket says 172.21.15.146:33768) 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 -- 172.21.15.146:0/3505646646 learned_addr learned my addr 172.21.15.146:0/3505646646 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2316800640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa896300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317200640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa7ba910 0x55f0fa7ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 -- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa7ba910 msgr2=0x55f0fa7ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa7ba910 0x55f0fa7ffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 -- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 msgr2=0x55f0fa896300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.752+0000 7f2317c00640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa896300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2317c00640 1 -- 172.21.15.146:0/3505646646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0fa6e7b30 con 0x55f0fa878860 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2316800640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa896300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2317c00640 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2310025d40 tx=0x7f2310051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e5b9a94a6a262f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2315400640 1 -- 172.21.15.146:0/3505646646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310053720 con 0x55f0fa878860 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2315400640 1 -- 172.21.15.146:0/3505646646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23100538c0 con 0x55f0fa878860 2024-04-24T23:01:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.753+0000 7f2315400640 1 -- 172.21.15.146:0/3505646646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310053cb0 con 0x55f0fa878860 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 -- 172.21.15.146:0/3505646646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 msgr2=0x55f0fa891150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2310025d40 tx=0x7f2310051000 comp rx=0 tx=0).stop 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 -- 172.21.15.146:0/3505646646 shutdown_connections 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa878860 0x55f0fa891150 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa896300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 --2- 172.21.15.146:0/3505646646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa7ba910 0x55f0fa7ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 -- 172.21.15.146:0/3505646646 >> 172.21.15.146:0/3505646646 conn(0x55f0fa808c30 msgr2=0x55f0fa893370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 -- 172.21.15.146:0/3505646646 shutdown_connections 2024-04-24T23:01:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.754+0000 7f2319f16f40 1 -- 172.21.15.146:0/3505646646 wait complete. 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.755+0000 7f2319f16f40 1 Processor -- start 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.755+0000 7f2319f16f40 1 -- start start 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 0x55f0fa7ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa8907c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa878860 0x55f0fa88ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0fa892050 con 0x55f0fa7ba910 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0fa894e40 con 0x55f0fa7ee020 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2319f16f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f0fa8922f0 con 0x55f0fa878860 2024-04-24T23:01:48.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 0x55f0fa7ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 0x55f0fa7ffd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33778/0 (socket says 172.21.15.146:33778) 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 -- 172.21.15.146:0/2865505624 learned_addr learned my addr 172.21.15.146:0/2865505624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 -- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa878860 msgr2=0x55f0fa88ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f0fa878860 0x55f0fa88ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2316800640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa8907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 -- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 msgr2=0x55f0fa8907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0fa7ee020 0x55f0fa8907c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.756+0000 7f2317200640 1 -- 172.21.15.146:0/2865505624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0fa800390 con 0x55f0fa7ba910 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f2317200640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 0x55f0fa7ffd40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f23080091a0 tx=0x7f2308009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f230fe00640 1 -- 172.21.15.146:0/2865505624 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308014020 con 0x55f0fa7ba910 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f230fe00640 1 -- 172.21.15.146:0/2865505624 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2308010820 con 0x55f0fa7ba910 2024-04-24T23:01:48.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0fa800670 con 0x55f0fa7ba910 2024-04-24T23:01:48.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f230fe00640 1 -- 172.21.15.146:0/2865505624 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308010c10 con 0x55f0fa7ba910 2024-04-24T23:01:48.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.757+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0fa88e330 con 0x55f0fa7ba910 2024-04-24T23:01:48.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.759+0000 7f230fe00640 1 -- 172.21.15.146:0/2865505624 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2308017020 con 0x55f0fa7ba910 2024-04-24T23:01:48.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f230fe00640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f22f806a810 0x7f22f806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f230fe00640 1 -- 172.21.15.146:0/2865505624 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f2308089ee0 con 0x55f0fa7ba910 2024-04-24T23:01:48.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f2319f16f40 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55f0fa802850 0x55f0fa802cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:1 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55f0fa803200 con 0x55f0fa802850 2024-04-24T23:01:48.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f2316800640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f22f806a810 0x7f22f806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.760+0000 7f2317c00640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55f0fa802850 0x55f0fa802cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.761+0000 7f2317c00640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55f0fa802850 0x55f0fa802cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.761+0000 7f2316800640 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f22f806a810 0x7f22f806ccd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2304005610 tx=0x7f2304005520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2317c00640 1 -- 172.21.15.146:0/2865505624 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7f23100535a0 con 0x55f0fa802850 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55f0fa802850 msgr2=0x55f0fa802cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55f0fa802850 0x55f0fa802cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f22f806a810 msgr2=0x7f22f806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f22f806a810 0x7f22f806ccd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2304005610 tx=0x7f2304005520 comp rx=0 tx=0).stop 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 msgr2=0x55f0fa7ffd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 --2- 172.21.15.146:0/2865505624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0fa7ba910 0x55f0fa7ffd40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f23080091a0 tx=0x7f2308009660 comp rx=0 tx=0).stop 2024-04-24T23:01:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2317c00640 1 -- 172.21.15.146:0/2865505624 reap_dead start 2024-04-24T23:01:48.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 shutdown_connections 2024-04-24T23:01:48.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 >> 172.21.15.146:0/2865505624 conn(0x55f0fa808c30 msgr2=0x55f0fa8775c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 shutdown_connections 2024-04-24T23:01:48.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.764+0000 7f2319f16f40 1 -- 172.21.15.146:0/2865505624 wait complete. 2024-04-24T23:01:48.773 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2024-04-24T23:01:48.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.869+0000 7f6a5727a280 1 -- start start 2024-04-24T23:01:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.869+0000 7f6a5727a280 1 Processor -- start 2024-04-24T23:01:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae3a0000 0x5562ad641080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 0x5562ad640b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5562ae342600 con 0x5562ae49a000 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5562ae342780 con 0x5562ae3a0000 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.870+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5562ae342900 con 0x5562ae3a1c00 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33824/0 (socket says 172.21.15.146:33824) 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 -- 172.21.15.146:0/1116173047 learned_addr learned my addr 172.21.15.146:0/1116173047 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55400640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae3a0000 0x5562ad641080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 0x5562ad640b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 -- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 msgr2=0x5562ad640b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 0x5562ad640b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 -- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae3a0000 msgr2=0x5562ad641080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae3a0000 0x5562ad641080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a55e00640 1 -- 172.21.15.146:0/1116173047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ad608780 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.871+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 0x5562ad640b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a55e00640 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x5562ae4055c0 tx=0x5562ae368240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b540f2b0a1119c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a52200640 1 -- 172.21.15.146:0/1116173047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fad00 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a52200640 1 -- 172.21.15.146:0/1116173047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5562ad600fc0 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a52200640 1 -- 172.21.15.146:0/1116173047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fa9c0 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ad608000 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5562ad609680 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a5727a280 4 waiting for MDS map... 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a52200640 1 -- 172.21.15.146:0/1116173047 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x5562ae4aa600 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a52200640 1 -- 172.21.15.146:0/1116173047 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 17) ==== 2885+0+0 (secure 0 0 0) 0x5562ad62f180 con 0x5562ae49a000 2024-04-24T23:01:48.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.872+0000 7f6a5727a280 4 Got MDS map 17 2024-04-24T23:01:48.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.873+0000 7f6a5727a280 10 main: JournalTool::main 2024-04-24T23:01:48.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.873+0000 7f6a5727a280 4 main: JournalTool: connecting to RADOS... 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.873+0000 7f6a5727a280 1 Processor -- start 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.873+0000 7f6a5727a280 1 -- start start 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5562ad636180 con 0x5562ae49ac00 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5562ae343080 con 0x5562ae49b000 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5562ae343200 con 0x5562ae49a800 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a55400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a55400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33834/0 (socket says 172.21.15.146:33834) 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.874+0000 7f6a55400640 1 -- 172.21.15.146:0/1105115938 learned_addr learned my addr 172.21.15.146:0/1105115938 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 -- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49a800 msgr2=0x5562ad642100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 -- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 msgr2=0x5562ad642c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 -- 172.21.15.146:0/1105115938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ad609860 con 0x5562ae49ac00 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a55400640 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5562ae4048a0 tx=0x5562ae366780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ed42e1780495e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a4fa00640 1 -- 172.21.15.146:0/1105115938 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fab60 con 0x5562ae49ac00 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a4fa00640 1 -- 172.21.15.146:0/1105115938 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5562ad600700 con 0x5562ae49ac00 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.875+0000 7f6a4fa00640 1 -- 172.21.15.146:0/1105115938 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fa820 con 0x5562ae49ac00 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 -- 172.21.15.146:0/1105115938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 msgr2=0x5562ad642680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5562ae4048a0 tx=0x5562ae366780 comp rx=0 tx=0).stop 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 -- 172.21.15.146:0/1105115938 shutdown_connections 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1105115938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 -- 172.21.15.146:0/1105115938 >> 172.21.15.146:0/1105115938 conn(0x5562ae49a400 msgr2=0x5562ad6bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 -- 172.21.15.146:0/1105115938 shutdown_connections 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.876+0000 7f6a5727a280 1 -- 172.21.15.146:0/1105115938 wait complete. 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.877+0000 7f6a5727a280 1 Processor -- start 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.877+0000 7f6a5727a280 1 -- start start 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5562ae343500 con 0x5562ae49a800 2024-04-24T23:01:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5562ae343380 con 0x5562ae49b000 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a5727a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5562ae343680 con 0x5562ae49ac00 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33850/0 (socket says 172.21.15.146:33850) 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 learned_addr learned my addr 172.21.15.146:0/1373854914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49ac00 msgr2=0x5562ad642680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae49ac00 0x5562ad642680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 msgr2=0x5562ad642c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae49b000 0x5562ad642c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ad6094a0 con 0x5562ae49a800 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.878+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x5562ae3b71a0 tx=0x5562ae4bf800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a4dc00640 1 -- 172.21.15.146:0/1373854914 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fab60 con 0x5562ae49a800 2024-04-24T23:01:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a4dc00640 1 -- 172.21.15.146:0/1373854914 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5562ad600700 con 0x5562ae49a800 2024-04-24T23:01:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a4dc00640 1 -- 172.21.15.146:0/1373854914 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5562ad5fa820 con 0x5562ae49a800 2024-04-24T23:01:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562ad608960 con 0x5562ae49a800 2024-04-24T23:01:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ad6083c0 con 0x5562ae49a800 2024-04-24T23:01:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.879+0000 7f6a5727a280 4 main: JournalTool: resolving pool 5 2024-04-24T23:01:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.880+0000 7f6a4dc00640 1 -- 172.21.15.146:0/1373854914 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5562ae330c00 con 0x5562ae49a800 2024-04-24T23:01:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a4dc00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 0x5562ad944000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a4dc00640 1 -- 172.21.15.146:0/1373854914 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x5562ae338600 con 0x5562ae49a800 2024-04-24T23:01:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a5727a280 4 main: JournalTool: creating IoCtx.. 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a5727a280 4 main: Executing for rank 0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5562ae51b000 0x5562ad643180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 5.f 5:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ae51b000 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.881+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5562ae51b000 0x5562ad643180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.882+0000 7f6a55400640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 0x5562ad944000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.882+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5562ae51b000 0x5562ad643180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5562ae356000 con 0x5562ae51b000 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a5727a280 4 Pointer 400.00000000 is readable 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a5727a280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5562ae51b800 0x5562ad643700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:2 5.14 5:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ae51b800 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a55400640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 0x5562ad944000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5562ae4048a0 tx=0x5562ae366ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.883+0000 7f6a55e00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5562ae51b800 0x5562ad643700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.884+0000 7f6a55e00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5562ae51b800 0x5562ad643700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.885+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.885+0000 7f6a5727a280 10 Header 0x400000 0x400000 0x400000 2024-04-24T23:01:48.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.885+0000 7f6a5727a280 10 Starting journal scan from offset 0x400000 2024-04-24T23:01:48.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.885+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 5.14 5:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ae51b800 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(3 200.00000001 [read 0~59737 out=59737b] v0'0 uv14 ondisk = 0) ==== 156+0+59737 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 4 Read 0xe959 bytes from 200.00000001 gap=0 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Parsing data, 0xe959 bytes available 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x400000 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x30 bytes 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x400000 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x400030 2024-04-24T23:01:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x37c bytes 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x400030 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x4003ac 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x102 bytes 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x4003ac 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x4004ae 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xac bytes 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x4004ae 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40055a 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x32f bytes 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40055a 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x400889 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x6ef bytes 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x400889 2024-04-24T23:01:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x400f78 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x80b bytes 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x400f78 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x401783 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x826 bytes 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x401783 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x401fa9 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x81c bytes 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x401fa9 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x4027c5 2024-04-24T23:01:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x472 bytes 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x4027c5 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x402c37 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x822 bytes 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x402c37 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x403459 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xd06 bytes 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x403459 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40415f 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x805 bytes 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40415f 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x404964 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc3d bytes 2024-04-24T23:01:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x404964 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x4055a1 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc3d bytes 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x4055a1 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x4061de 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc3d bytes 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x4061de 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x406e1b 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc40 bytes 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x406e1b 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x407a5b 2024-04-24T23:01:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x822 bytes 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x407a5b 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40827d 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc4b bytes 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40827d 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x408ec8 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc40 bytes 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x408ec8 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x409b08 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xaf6 bytes 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x409b08 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40a5fe 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x953 bytes 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40a5fe 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40af51 2024-04-24T23:01:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x82f bytes 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40af51 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40b780 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x88f bytes 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40b780 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40c00f 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x73a bytes 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40c00f 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40c749 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xad bytes 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40c749 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40c7f6 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xc84 bytes 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40c7f6 2024-04-24T23:01:48.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40d47a 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0xafc bytes 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40d47a 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40df76 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x997 bytes 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40df76 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Attempting decode at 0x40e90d 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Consumed 0x4c bytes 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 10 Valid entry at 0x40e90d 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5562ad958400 0x5562ad944580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 5.1b 5:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.887+0000 7f6a55400640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5562ad958400 0x5562ad944580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a55400640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5562ad958400 0x5562ad944580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 Reached end of journal objects 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 Scanned objects, 0 missing, 1 valid 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 Events scanned, 0 gaps 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 Found 30 valid events 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 Selected 30 events events for processing 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:5 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958c00 con 0x5562ad958400 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.888+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:6 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958400 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.889+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.889+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100.00000000 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.889+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:7 5.13 5:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 3 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a5727a280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:8 5.13 5:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 4 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.890+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:9 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.891+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 5 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.891+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.891+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.891+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 2 2024-04-24T23:01:48.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.891+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:10 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ae51b800 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.894+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 6 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v42'16 uv16 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.894+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.894+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:11 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.895+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.895+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.895+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.895+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:12 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(12 1.00000000 [omap-set-header] v42'5 uv5 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958c00 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-04-24T23:01:48.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.897+0000 7f6a5727a280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.898+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:14 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=608b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.901+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v42'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.901+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.901+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.901+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:15 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ae51b800 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.901+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 7 ==== osd_op_reply(15 1.00000000.inode [read 0~582 out=582b] v0'0 uv16 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.902+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.902+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.902+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 3 2024-04-24T23:01:48.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.902+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:16 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ae51b800 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 8 ==== osd_op_reply(16 1.00000000.inode [writefull 0~582] v42'17 uv17 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:17 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958400 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 8 ==== osd_op_reply(17 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2024-04-24T23:01:48.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.905+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:18 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958400 2024-04-24T23:01:48.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.908+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 9 ==== osd_op_reply(18 1.00000000 [omap-set-header] v42'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.908+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:19 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:48.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.909+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 10 ==== osd_op_reply(19 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.909+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:48.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.909+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:48.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.909+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:48.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.909+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:20 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=568b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.912+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 11 ==== osd_op_reply(20 1.00000000 [omap-set-vals] v42'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.912+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.912+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5562ad958c00 0x5562ad944b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.912+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:21 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.912+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5562ad958c00 0x5562ad944b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.913+0000 7f6a54a00640 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5562ad958c00 0x5562ad944b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.913+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(21 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.913+0000 7f6a5727a280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2024-04-24T23:01:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.913+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.913+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958c00 2024-04-24T23:01:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 10000000001.00000000 [omap-set-header] v42'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:48.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:48.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:48.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.917+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:24 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ae51b800 2024-04-24T23:01:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.918+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 9 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv17 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.918+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.918+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.918+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 4 2024-04-24T23:01:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.918+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:25 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ae51b800 2024-04-24T23:01:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 10 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v42'18 uv18 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958400 2024-04-24T23:01:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 12 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v7 2024-04-24T23:01:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.922+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:27 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958400 2024-04-24T23:01:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.926+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 13 ==== osd_op_reply(27 1.00000000 [omap-set-header] v42'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.926+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:28 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958400 2024-04-24T23:01:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.926+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 14 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=568b] v0'0 uv9 ondisk = 0) ==== 154+0+568 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-04-24T23:01:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.927+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=568b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958400 2024-04-24T23:01:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.930+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 15 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v42'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.930+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.930+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:30 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.931+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 4 ==== osd_op_reply(30 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.931+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2024-04-24T23:01:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.931+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.931+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:31 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.934+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 5 ==== osd_op_reply(31 10000000001.00000000 [omap-set-header] v42'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.934+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:32 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.934+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 6 ==== osd_op_reply(32 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.935+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.935+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.935+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.935+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:33 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=610b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958c00 2024-04-24T23:01:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.938+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 7 ==== osd_op_reply(33 10000000001.00000000 [omap-set-vals] v42'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.938+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.938+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:34 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.939+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 16 ==== osd_op_reply(34 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.939+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v7 vs new v9 2024-04-24T23:01:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.939+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.939+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:35 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:48.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.942+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 17 ==== osd_op_reply(35 1.00000000 [omap-set-header] v42'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.942+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:36 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958400 2024-04-24T23:01:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.943+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 18 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.943+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.943+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.943+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.943+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:37 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958400 2024-04-24T23:01:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.947+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 19 ==== osd_op_reply(37 1.00000000 [omap-set-vals] v42'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.947+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.947+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:38 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958c00 2024-04-24T23:01:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.948+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 8 ==== osd_op_reply(38 100000001f7.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.948+0000 7f6a5727a280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001f7.00000000 (2) No such file or directory 2024-04-24T23:01:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.948+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.948+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:39 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958c00 2024-04-24T23:01:48.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.952+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 9 ==== osd_op_reply(39 100000001f7.00000000 [omap-set-header] v42'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.952+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:40 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958c00 2024-04-24T23:01:48.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.953+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 10 ==== osd_op_reply(40 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.953+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.953+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.953+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:41 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ae51b800 2024-04-24T23:01:48.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.954+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 11 ==== osd_op_reply(41 1.00000000.inode [read 0~582 out=582b] v0'0 uv18 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.954+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:48.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.954+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:48.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.954+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 5 2024-04-24T23:01:48.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.954+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:42 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ae51b800 2024-04-24T23:01:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.958+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 12 ==== osd_op_reply(42 1.00000000.inode [writefull 0~582] v42'19 uv19 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.958+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.958+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:43 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.959+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 20 ==== osd_op_reply(43 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.959+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v9 vs new v10 2024-04-24T23:01:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.959+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.959+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:44 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958400 2024-04-24T23:01:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.963+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 21 ==== osd_op_reply(44 1.00000000 [omap-set-header] v42'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.963+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:45 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958400 2024-04-24T23:01:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.964+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 22 ==== osd_op_reply(45 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.964+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.964+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.964+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:46 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ae51b800 2024-04-24T23:01:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.965+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 13 ==== osd_op_reply(46 1.00000000.inode [read 0~582 out=582b] v0'0 uv19 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.965+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.965+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.965+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 6 2024-04-24T23:01:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.965+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:47 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ae51b800 2024-04-24T23:01:48.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.969+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 14 ==== osd_op_reply(47 1.00000000.inode [writefull 0~582] v42'20 uv20 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:48.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.969+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.969+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:48 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:48.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.970+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 23 ==== osd_op_reply(48 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.970+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v10 vs new v12 2024-04-24T23:01:48.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.970+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.970+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:49 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:48.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.974+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 24 ==== osd_op_reply(49 1.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.974+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:50 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958400 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 25 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=569b] v0'0 uv14 ondisk = 0) ==== 154+0+569 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 11 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.975+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:51 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958400 2024-04-24T23:01:48.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.979+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 26 ==== osd_op_reply(51 1.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.979+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:48.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.979+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:52 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:48.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.980+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 11 ==== osd_op_reply(52 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.980+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v1 vs new v3 2024-04-24T23:01:48.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.980+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.980+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:53 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958c00 2024-04-24T23:01:48.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.983+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 12 ==== osd_op_reply(53 100000001f7.00000000 [omap-set-header] v42'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.984+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:54 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958c00 2024-04-24T23:01:48.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.985+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 13 ==== osd_op_reply(54 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.985+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link0 2024-04-24T23:01:48.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.985+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:48.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.985+0000 7f6a5727a280 4 recover_dentries: writing I dentry link0_head into frag 100000001f7.00000000 2024-04-24T23:01:48.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.985+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:55 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.989+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 14 ==== osd_op_reply(55 100000001f7.00000000 [omap-set-vals] v42'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.989+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.989+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:56 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.990+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 27 ==== osd_op_reply(56 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.990+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v12 vs new v14 2024-04-24T23:01:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.990+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.990+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:57 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958400 2024-04-24T23:01:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.994+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 28 ==== osd_op_reply(57 1.00000000 [omap-set-header] v42'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.994+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:58 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 29 ==== osd_op_reply(58 1.00000000 [omap-get-vals-by-keys out=569b] v0'0 uv16 ondisk = 0) ==== 154+0+569 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 11 vs fullbit version 13 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.995+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:59 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958400 2024-04-24T23:01:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.998+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 30 ==== osd_op_reply(59 1.00000000 [omap-set-vals] v42'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.998+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100.00000000 2024-04-24T23:01:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:48.998+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:60 5.13 5:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ae51b800 2024-04-24T23:01:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.000+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 15 ==== osd_op_reply(60 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.000+0000 7f6a5727a280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2024-04-24T23:01:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.000+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.000+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:61 5.13 5:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ae51b800 2024-04-24T23:01:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.004+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 16 ==== osd_op_reply(61 100.00000000 [omap-set-header] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.004+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:62 5.13 5:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ae51b800 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 17 ==== osd_op_reply(62 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 4 recover_dentries: dentry stray2_head existed already 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2024-04-24T23:01:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.005+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:63 5.13 5:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ae51b800 2024-04-24T23:01:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.009+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 18 ==== osd_op_reply(63 100.00000000 [omap-set-vals] v42'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.009+0000 7f6a5727a280 4 recover_dentries: inspecting lump 602.00000000 2024-04-24T23:01:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.009+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:64 5.10 5:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.010+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 31 ==== osd_op_reply(64 602.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.010+0000 7f6a5727a280 4 recover_dentries: frag 602.00000000 fnode old v1 vs new v4 2024-04-24T23:01:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.010+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.010+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:65 5.10 5:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.014+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 32 ==== osd_op_reply(65 602.00000000 [omap-set-header] v42'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.014+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:66 5.10 5:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958400 2024-04-24T23:01:49.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.015+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 33 ==== osd_op_reply(66 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.015+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 602.00000000/100000001f8 2024-04-24T23:01:49.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.015+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.015+0000 7f6a5727a280 4 recover_dentries: writing I dentry 100000001f8_head into frag 602.00000000 2024-04-24T23:01:49.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.015+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:67 5.10 5:0bd6d154:::602.00000000:head [omap-set-vals in=625b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958400 2024-04-24T23:01:49.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.019+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 34 ==== osd_op_reply(67 602.00000000 [omap-set-vals] v42'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.019+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.019+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:68 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958c00 2024-04-24T23:01:49.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.020+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 15 ==== osd_op_reply(68 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.020+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v3 vs new v5 2024-04-24T23:01:49.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.020+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.020+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:69 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958c00 2024-04-24T23:01:49.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.024+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 16 ==== osd_op_reply(69 100000001f7.00000000 [omap-set-header] v42'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.024+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:70 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958c00 2024-04-24T23:01:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.025+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 17 ==== osd_op_reply(70 100000001f7.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv4 ondisk = 0) ==== 164+0+605 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.025+0000 7f6a5727a280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link0 2024-04-24T23:01:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.025+0000 7f6a5727a280 4 recover_dentries: dentry exists, will remove 2024-04-24T23:01:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.025+0000 7f6a5727a280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn 'link0' with lump fnode version 5vs existing fnode version 3 2024-04-24T23:01:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.025+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:71 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.029+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 18 ==== osd_op_reply(71 100000001f7.00000000 [omap-rm-keys] v42'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.029+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100.00000000 2024-04-24T23:01:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.029+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:72 5.13 5:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ae51b800 2024-04-24T23:01:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.030+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 19 ==== osd_op_reply(72 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.030+0000 7f6a5727a280 4 recover_dentries: frag 100.00000000 fnode old v3 vs new v5 2024-04-24T23:01:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.030+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.030+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:73 5.13 5:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ae51b800 2024-04-24T23:01:49.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.034+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 20 ==== osd_op_reply(73 100.00000000 [omap-set-header] v42'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.034+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:74 5.13 5:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ae51b800 2024-04-24T23:01:49.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 21 ==== osd_op_reply(74 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv5 ondisk = 0) ==== 156+0+507 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-04-24T23:01:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 4 recover_dentries: dentry stray2_head existed already 2024-04-24T23:01:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-04-24T23:01:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2024-04-24T23:01:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.035+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:75 5.13 5:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ae51b800 2024-04-24T23:01:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.040+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 22 ==== osd_op_reply(75 100.00000000 [omap-set-vals] v42'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ae356500 con 0x5562ae51b800 2024-04-24T23:01:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.040+0000 7f6a5727a280 4 recover_dentries: inspecting lump 602.00000000 2024-04-24T23:01:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.040+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:76 5.10 5:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958400 2024-04-24T23:01:49.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.041+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 35 ==== osd_op_reply(76 602.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.041+0000 7f6a5727a280 4 recover_dentries: frag 602.00000000 fnode old v4 vs new v6 2024-04-24T23:01:49.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.041+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.041+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:77 5.10 5:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958400 2024-04-24T23:01:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.045+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 36 ==== osd_op_reply(77 602.00000000 [omap-set-header] v42'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.046+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:78 5.10 5:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958400 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 37 ==== osd_op_reply(78 602.00000000 [omap-get-vals-by-keys out=625b] v0'0 uv11 ondisk = 0) ==== 156+0+625 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 602.00000000/100000001f8 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 4 recover_dentries: dentry 100000001f8_head existed already 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 3 vs fullbit version 5 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 4 recover_dentries: writing I dentry 100000001f8_head into frag 602.00000000 2024-04-24T23:01:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.047+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:79 5.10 5:0bd6d154:::602.00000000:head [omap-set-vals in=633b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.050+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 38 ==== osd_op_reply(79 602.00000000 [omap-set-vals] v42'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.050+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.050+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:80 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.051+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 39 ==== osd_op_reply(80 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.051+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v14 vs new v18 2024-04-24T23:01:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.051+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.051+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:81 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958400 2024-04-24T23:01:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.057+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 40 ==== osd_op_reply(81 1.00000000 [omap-set-header] v42'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.058+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:82 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 41 ==== osd_op_reply(82 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv18 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 13 vs fullbit version 15 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 17 2024-04-24T23:01:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.059+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:83 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958400 2024-04-24T23:01:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.062+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 42 ==== osd_op_reply(83 1.00000000 [omap-set-vals] v42'19 uv19 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.062+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.062+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:84 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958c00 2024-04-24T23:01:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.063+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 19 ==== osd_op_reply(84 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.063+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v5 vs new v7 2024-04-24T23:01:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.063+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.064+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:85 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.068+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 20 ==== osd_op_reply(85 100000001f7.00000000 [omap-set-header] v42'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.068+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:86 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958c00 2024-04-24T23:01:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.069+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 21 ==== osd_op_reply(86 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.069+0000 7f6a5727a280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link0 2024-04-24T23:01:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.069+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.069+0000 7f6a5727a280 4 recover_dentries: writing L dentry link0_head into frag 100000001f7.00000000 2024-04-24T23:01:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.069+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:87 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.073+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 22 ==== osd_op_reply(87 100000001f7.00000000 [omap-set-vals] v42'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.073+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.073+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:88 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958c00 2024-04-24T23:01:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.074+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 23 ==== osd_op_reply(88 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.074+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2024-04-24T23:01:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.074+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.074+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:89 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:49.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.078+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 24 ==== osd_op_reply(89 10000000001.00000000 [omap-set-header] v42'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.078+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:90 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 25 ==== osd_op_reply(90 10000000001.00000000 [omap-get-vals-by-keys out=610b] v0'0 uv6 ondisk = 0) ==== 164+0+610 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-04-24T23:01:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.079+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:91 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=688b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:49.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.083+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 26 ==== osd_op_reply(91 10000000001.00000000 [omap-set-vals] v42'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.083+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.083+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:92 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958400 2024-04-24T23:01:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.084+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 43 ==== osd_op_reply(92 1.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.084+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v18 vs new v22 2024-04-24T23:01:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.084+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.084+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:93 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958400 2024-04-24T23:01:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.088+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 44 ==== osd_op_reply(93 1.00000000 [omap-set-header] v42'20 uv20 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.088+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:94 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958400 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.089+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 45 ==== osd_op_reply(94 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv20 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 15 vs fullbit version 19 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 17 vs fullbit version 21 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.090+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:95 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.094+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 46 ==== osd_op_reply(95 1.00000000 [omap-set-vals] v42'21 uv21 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.094+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.094+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:96 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958c00 2024-04-24T23:01:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.095+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 27 ==== osd_op_reply(96 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.095+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v7 vs new v9 2024-04-24T23:01:49.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.095+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.095+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:97 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958c00 2024-04-24T23:01:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.099+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 28 ==== osd_op_reply(97 100000001f7.00000000 [omap-set-header] v42'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.099+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:98 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958c00 2024-04-24T23:01:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.100+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 29 ==== osd_op_reply(98 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.100+0000 7f6a5727a280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link1 2024-04-24T23:01:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.100+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.100+0000 7f6a5727a280 4 recover_dentries: writing L dentry link1_head into frag 100000001f7.00000000 2024-04-24T23:01:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.100+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:99 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958c00 2024-04-24T23:01:49.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.104+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 30 ==== osd_op_reply(99 100000001f7.00000000 [omap-set-vals] v42'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.104+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.104+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:100 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958c00 2024-04-24T23:01:49.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.105+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 31 ==== osd_op_reply(100 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.105+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2024-04-24T23:01:49.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.105+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.105+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:101 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.109+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 32 ==== osd_op_reply(101 10000000001.00000000 [omap-set-header] v42'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.109+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:102 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 33 ==== osd_op_reply(102 10000000001.00000000 [omap-get-vals-by-keys out=688b] v0'0 uv8 ondisk = 0) ==== 164+0+688 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.110+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:103 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=688b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958c00 2024-04-24T23:01:49.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.114+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 34 ==== osd_op_reply(103 10000000001.00000000 [omap-set-vals] v42'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.114+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.114+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:104 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958400 2024-04-24T23:01:49.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.115+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 47 ==== osd_op_reply(104 1.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.115+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v22 vs new v26 2024-04-24T23:01:49.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.115+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.115+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:105 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958400 2024-04-24T23:01:49.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.119+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 48 ==== osd_op_reply(105 1.00000000 [omap-set-header] v42'22 uv22 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.119+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:106 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958400 2024-04-24T23:01:49.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.120+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 49 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv22 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 19 vs fullbit version 23 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 21 vs fullbit version 25 2024-04-24T23:01:49.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.121+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:107 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958400 2024-04-24T23:01:49.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.125+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 50 ==== osd_op_reply(107 1.00000000 [omap-set-vals] v42'23 uv23 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.125+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.125+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:108 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:49.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.126+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 35 ==== osd_op_reply(108 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.126+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v9 vs new v11 2024-04-24T23:01:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.126+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.126+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:109 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.130+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 36 ==== osd_op_reply(109 100000001f7.00000000 [omap-set-header] v42'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.130+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:110 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:49.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.131+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 37 ==== osd_op_reply(110 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.131+0000 7f6a5727a280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link2 2024-04-24T23:01:49.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.131+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.131+0000 7f6a5727a280 4 recover_dentries: writing L dentry link2_head into frag 100000001f7.00000000 2024-04-24T23:01:49.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.131+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:111 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958c00 2024-04-24T23:01:49.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.134+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 38 ==== osd_op_reply(111 100000001f7.00000000 [omap-set-vals] v42'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.135+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.135+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:112 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:49.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.135+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 39 ==== osd_op_reply(112 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.136+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2024-04-24T23:01:49.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.136+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.136+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:113 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958c00 2024-04-24T23:01:49.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.139+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 40 ==== osd_op_reply(113 10000000001.00000000 [omap-set-header] v42'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.139+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:114 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.140+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 41 ==== osd_op_reply(114 10000000001.00000000 [omap-get-vals-by-keys out=688b] v0'0 uv10 ondisk = 0) ==== 164+0+688 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.140+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.140+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.140+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.141+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.141+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.141+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:115 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=688b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.145+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 42 ==== osd_op_reply(115 10000000001.00000000 [omap-set-vals] v42'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.145+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.145+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:116 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958400 2024-04-24T23:01:49.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.146+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 51 ==== osd_op_reply(116 1.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.146+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v26 vs new v30 2024-04-24T23:01:49.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.146+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.146+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:117 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958400 2024-04-24T23:01:49.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.150+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 52 ==== osd_op_reply(117 1.00000000 [omap-set-header] v42'24 uv24 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.150+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:118 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 53 ==== osd_op_reply(118 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv24 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 23 vs fullbit version 27 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 25 vs fullbit version 29 2024-04-24T23:01:49.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.151+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:119 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958400 2024-04-24T23:01:49.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.156+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 54 ==== osd_op_reply(119 1.00000000 [omap-set-vals] v42'25 uv25 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.156+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.156+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:120 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958c00 2024-04-24T23:01:49.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.157+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 43 ==== osd_op_reply(120 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.157+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v11 2024-04-24T23:01:49.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.157+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.157+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:121 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958c00 2024-04-24T23:01:49.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.161+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 44 ==== osd_op_reply(121 10000000001.00000000 [omap-set-header] v42'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.161+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:122 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958c00 2024-04-24T23:01:49.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 45 ==== osd_op_reply(122 10000000001.00000000 [omap-get-vals-by-keys out=688b] v0'0 uv12 ondisk = 0) ==== 164+0+688 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 10 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.162+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:123 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=702b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.166+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 46 ==== osd_op_reply(123 10000000001.00000000 [omap-set-vals] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.166+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.166+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:124 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.167+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 47 ==== osd_op_reply(124 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.167+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v11 vs new v13 2024-04-24T23:01:49.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.167+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.167+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:125 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958c00 2024-04-24T23:01:49.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.171+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 48 ==== osd_op_reply(125 100000001f7.00000000 [omap-set-header] v42'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.171+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:126 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958c00 2024-04-24T23:01:49.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.172+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 49 ==== osd_op_reply(126 100000001f7.00000000 [omap-get-vals-by-keys out=40b] v0'0 uv12 ondisk = 0) ==== 164+0+40 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.172+0000 7f6a5727a280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link2 2024-04-24T23:01:49.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.172+0000 7f6a5727a280 4 recover_dentries: dentry exists, will remove 2024-04-24T23:01:49.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.172+0000 7f6a5727a280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link2' with lump fnode version 13vs existing fnode version 11 2024-04-24T23:01:49.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.172+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:127 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958c00 2024-04-24T23:01:49.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.176+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 50 ==== osd_op_reply(127 100000001f7.00000000 [omap-rm-keys] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.176+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.176+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:128 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958400 2024-04-24T23:01:49.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.177+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 55 ==== osd_op_reply(128 1.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.177+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v30 vs new v32 2024-04-24T23:01:49.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.177+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.177+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:129 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958400 2024-04-24T23:01:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.181+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 56 ==== osd_op_reply(129 1.00000000 [omap-set-header] v42'26 uv26 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.181+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:130 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958400 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 57 ==== osd_op_reply(130 1.00000000 [omap-get-vals-by-keys out=569b] v0'0 uv26 ondisk = 0) ==== 154+0+569 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 27 vs fullbit version 31 2024-04-24T23:01:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.182+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:131 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.186+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 58 ==== osd_op_reply(131 1.00000000 [omap-set-vals] v42'27 uv27 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.186+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.186+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:132 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958c00 2024-04-24T23:01:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.187+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 51 ==== osd_op_reply(132 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.187+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v13 vs new v15 2024-04-24T23:01:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.187+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.187+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:133 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958c00 2024-04-24T23:01:49.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.191+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 52 ==== osd_op_reply(133 100000001f7.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.192+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:134 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.192+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 53 ==== osd_op_reply(134 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.193+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-04-24T23:01:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.193+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.193+0000 7f6a5727a280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2024-04-24T23:01:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.193+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:135 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.197+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 54 ==== osd_op_reply(135 100000001f7.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.197+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.197+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:136 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:49.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.198+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 59 ==== osd_op_reply(136 1.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.198+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v32 vs new v36 2024-04-24T23:01:49.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.198+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.198+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:137 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958400 2024-04-24T23:01:49.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.203+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 60 ==== osd_op_reply(137 1.00000000 [omap-set-header] v42'28 uv28 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.203+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:138 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958400 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 61 ==== osd_op_reply(138 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv28 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 31 vs fullbit version 33 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 29 vs fullbit version 35 2024-04-24T23:01:49.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.204+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:139 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958400 2024-04-24T23:01:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.208+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 62 ==== osd_op_reply(139 1.00000000 [omap-set-vals] v42'29 uv29 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.208+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.208+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:140 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.209+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 55 ==== osd_op_reply(140 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.209+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v15 vs new v17 2024-04-24T23:01:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.209+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.209+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:141 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958c00 2024-04-24T23:01:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.213+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 56 ==== osd_op_reply(141 100000001f7.00000000 [omap-set-header] v42'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.213+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:142 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.214+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 57 ==== osd_op_reply(142 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.214+0000 7f6a5727a280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-04-24T23:01:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.214+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.214+0000 7f6a5727a280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-04-24T23:01:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.214+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:143 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958c00 2024-04-24T23:01:49.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.218+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 58 ==== osd_op_reply(143 100000001f7.00000000 [omap-set-vals] v42'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.218+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.218+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:144 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958c00 2024-04-24T23:01:49.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.219+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 59 ==== osd_op_reply(144 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.219+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v11 vs new v13 2024-04-24T23:01:49.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.219+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.219+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:145 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ad958c00 2024-04-24T23:01:49.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.224+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 60 ==== osd_op_reply(145 10000000001.00000000 [omap-set-header] v42'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.224+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:146 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ad958c00 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 61 ==== osd_op_reply(146 10000000001.00000000 [omap-get-vals-by-keys out=702b] v0'0 uv14 ondisk = 0) ==== 164+0+702 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 10 vs fullbit version 12 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.225+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:147 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=702b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958c00 2024-04-24T23:01:49.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.228+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 62 ==== osd_op_reply(147 10000000001.00000000 [omap-set-vals] v42'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.228+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.229+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:148 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958400 2024-04-24T23:01:49.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.229+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 63 ==== osd_op_reply(148 1.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.230+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v36 vs new v40 2024-04-24T23:01:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.230+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.230+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:149 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.234+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 64 ==== osd_op_reply(149 1.00000000 [omap-set-header] v42'30 uv30 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.234+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:150 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958400 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 65 ==== osd_op_reply(150 1.00000000 [omap-get-vals-by-keys out=1133b] v0'0 uv30 ondisk = 0) ==== 154+0+1133 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 33 vs fullbit version 37 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 35 vs fullbit version 39 2024-04-24T23:01:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.235+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:151 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1133b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958400 2024-04-24T23:01:49.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.238+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 66 ==== osd_op_reply(151 1.00000000 [omap-set-vals] v42'31 uv31 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.238+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.238+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:152 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.239+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 63 ==== osd_op_reply(152 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.240+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2024-04-24T23:01:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.240+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.240+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:153 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958c00 2024-04-24T23:01:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.243+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 64 ==== osd_op_reply(153 10000000001.00000000 [omap-set-header] v42'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.243+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:154 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958c00 2024-04-24T23:01:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 65 ==== osd_op_reply(154 10000000001.00000000 [omap-get-vals-by-keys out=702b] v0'0 uv16 ondisk = 0) ==== 164+0+702 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 12 vs fullbit version 14 2024-04-24T23:01:49.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.244+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:155 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=702b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.249+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 66 ==== osd_op_reply(155 10000000001.00000000 [omap-set-vals] v42'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.249+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.249+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:156 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:49.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.250+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 67 ==== osd_op_reply(156 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.250+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v17 vs new v19 2024-04-24T23:01:49.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.250+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.250+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:157 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:49.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.254+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 68 ==== osd_op_reply(157 100000001f7.00000000 [omap-set-header] v42'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.254+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:158 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.255+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 69 ==== osd_op_reply(158 100000001f7.00000000 [omap-get-vals-by-keys out=40b] v0'0 uv18 ondisk = 0) ==== 164+0+40 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.255+0000 7f6a5727a280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link3 2024-04-24T23:01:49.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.255+0000 7f6a5727a280 4 recover_dentries: dentry exists, will remove 2024-04-24T23:01:49.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.255+0000 7f6a5727a280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link3' with lump fnode version 19vs existing fnode version 17 2024-04-24T23:01:49.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.255+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:159 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958c00 2024-04-24T23:01:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.259+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 70 ==== osd_op_reply(159 100000001f7.00000000 [omap-rm-keys] v42'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.259+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.259+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:160 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.260+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 67 ==== osd_op_reply(160 1.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.260+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v40 vs new v44 2024-04-24T23:01:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.260+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.260+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:161 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958400 2024-04-24T23:01:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.264+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 68 ==== osd_op_reply(161 1.00000000 [omap-set-header] v42'32 uv32 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.264+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:162 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=37b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958400 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 69 ==== osd_op_reply(162 1.00000000 [omap-get-vals-by-keys out=1173b] v0'0 uv32 ondisk = 0) ==== 154+0+1173 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 37 vs fullbit version 42 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-04-24T23:01:49.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: dentry rootfile_head existed already 2024-04-24T23:01:49.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 41 2024-04-24T23:01:49.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2024-04-24T23:01:49.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.265+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:163 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=1251b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.269+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 70 ==== osd_op_reply(163 1.00000000 [omap-set-vals] v42'33 uv33 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.269+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.269+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:164 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958c00 2024-04-24T23:01:49.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.270+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 71 ==== osd_op_reply(164 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.270+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v19 vs new v21 2024-04-24T23:01:49.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.270+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.270+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:165 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ad958c00 2024-04-24T23:01:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.274+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 72 ==== osd_op_reply(165 100000001f7.00000000 [omap-set-header] v42'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.274+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:166 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ad958c00 2024-04-24T23:01:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.275+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 73 ==== osd_op_reply(166 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.275+0000 7f6a5727a280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-04-24T23:01:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.275+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.275+0000 7f6a5727a280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-04-24T23:01:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.275+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:167 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ad958c00 2024-04-24T23:01:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.279+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 74 ==== osd_op_reply(167 100000001f7.00000000 [omap-set-vals] v42'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.279+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.279+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.279+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:168 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ae51b800 2024-04-24T23:01:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.281+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 23 ==== osd_op_reply(168 1.00000000.inode [read 0~582 out=582b] v0'0 uv20 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.281+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.281+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.281+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 7 2024-04-24T23:01:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.281+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:169 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ae51b800 2024-04-24T23:01:49.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.285+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 24 ==== osd_op_reply(169 1.00000000.inode [writefull 0~582] v42'21 uv21 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.285+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.285+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:170 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958400 2024-04-24T23:01:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.286+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 71 ==== osd_op_reply(170 1.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.286+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v44 vs new v46 2024-04-24T23:01:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.286+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.286+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:171 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958400 2024-04-24T23:01:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.290+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 72 ==== osd_op_reply(171 1.00000000 [omap-set-header] v42'34 uv34 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.290+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:172 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958400 2024-04-24T23:01:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 73 ==== osd_op_reply(172 1.00000000 [omap-get-vals-by-keys out=568b] v0'0 uv34 ondisk = 0) ==== 154+0+568 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 39 vs fullbit version 45 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.292+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:173 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=568b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958400 2024-04-24T23:01:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.296+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 74 ==== osd_op_reply(173 1.00000000 [omap-set-vals] v42'35 uv35 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.296+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.296+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:174 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ad958c00 2024-04-24T23:01:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.297+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 75 ==== osd_op_reply(174 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.297+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2024-04-24T23:01:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.297+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.297+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:175 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.301+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 76 ==== osd_op_reply(175 10000000001.00000000 [omap-set-header] v42'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.301+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:176 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=22b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.302+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 77 ==== osd_op_reply(176 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.302+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subsubdir 2024-04-24T23:01:49.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.302+0000 7f6a5727a280 4 recover_dentries: dentry did not already exist, will create 2024-04-24T23:01:49.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.302+0000 7f6a5727a280 4 recover_dentries: writing I dentry subsubdir_head into frag 10000000001.00000000 2024-04-24T23:01:49.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.302+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:177 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=571b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958c00 2024-04-24T23:01:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.306+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 78 ==== osd_op_reply(177 10000000001.00000000 [omap-set-vals] v42'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.306+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001fa.00000000 2024-04-24T23:01:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.306+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:178 5.1f 5:feb1c803:::100000001fa.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958400 2024-04-24T23:01:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.306+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 75 ==== osd_op_reply(178 100000001fa.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.307+0000 7f6a5727a280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001fa.00000000 (2) No such file or directory 2024-04-24T23:01:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.307+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.307+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:179 5.1f 5:feb1c803:::100000001fa.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8000 con 0x5562ad958400 2024-04-24T23:01:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.311+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 76 ==== osd_op_reply(179 100000001fa.00000000 [omap-set-header] v42'36 uv36 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.311+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:180 5.1f 5:feb1c803:::100000001fa.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8400 con 0x5562ad958400 2024-04-24T23:01:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.312+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 77 ==== osd_op_reply(180 100000001fa.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.312+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.312+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:181 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8800 con 0x5562ad958400 2024-04-24T23:01:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.313+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 78 ==== osd_op_reply(181 1.00000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.313+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v46 vs new v48 2024-04-24T23:01:49.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.313+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.313+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:182 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8c00 con 0x5562ad958400 2024-04-24T23:01:49.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.317+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 79 ==== osd_op_reply(182 1.00000000 [omap-set-header] v42'37 uv37 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.317+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:183 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9000 con 0x5562ad958400 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 80 ==== osd_op_reply(183 1.00000000 [omap-get-vals-by-keys out=569b] v0'0 uv37 ondisk = 0) ==== 154+0+569 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 42 vs fullbit version 47 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.318+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:184 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9400 con 0x5562ad958400 2024-04-24T23:01:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.322+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 81 ==== osd_op_reply(184 1.00000000 [omap-set-vals] v42'38 uv38 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.322+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.322+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:185 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9800 con 0x5562ad958c00 2024-04-24T23:01:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.323+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 79 ==== osd_op_reply(185 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.323+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v21 vs new v23 2024-04-24T23:01:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.323+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.323+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:186 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9c00 con 0x5562ad958c00 2024-04-24T23:01:49.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.327+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 80 ==== osd_op_reply(186 100000001f7.00000000 [omap-set-header] v42'22 uv22 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.327+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:187 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8000 con 0x5562ad958c00 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 81 ==== osd_op_reply(187 100000001f7.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv22 ondisk = 0) ==== 164+0+605 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 4 recover_dentries: dentry link2_head existed already 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 22 2024-04-24T23:01:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2024-04-24T23:01:49.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.328+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:188 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8400 con 0x5562ad958c00 2024-04-24T23:01:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.332+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 82 ==== osd_op_reply(188 100000001f7.00000000 [omap-set-vals] v42'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.332+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.333+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:189 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8800 con 0x5562ad958400 2024-04-24T23:01:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.333+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 82 ==== osd_op_reply(189 1.00000000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.333+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v48 vs new v50 2024-04-24T23:01:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.333+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.333+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:190 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8c00 con 0x5562ad958400 2024-04-24T23:01:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.337+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 83 ==== osd_op_reply(190 1.00000000 [omap-set-header] v42'39 uv39 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.337+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:191 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958400 2024-04-24T23:01:49.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.338+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 84 ==== osd_op_reply(191 1.00000000 [omap-get-vals-by-keys out=568b] v0'0 uv39 ondisk = 0) ==== 154+0+568 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 45 vs fullbit version 49 2024-04-24T23:01:49.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.339+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:192 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=568b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958400 2024-04-24T23:01:49.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.343+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 85 ==== osd_op_reply(192 1.00000000 [omap-set-vals] v42'40 uv40 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.343+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.343+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:193 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958c00 2024-04-24T23:01:49.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.344+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 83 ==== osd_op_reply(193 10000000001.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.344+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v19 2024-04-24T23:01:49.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.344+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.344+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:194 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c000 con 0x5562ad958c00 2024-04-24T23:01:49.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.348+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 84 ==== osd_op_reply(194 10000000001.00000000 [omap-set-header] v42'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.349+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:195 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51bc00 con 0x5562ad958c00 2024-04-24T23:01:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.349+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 85 ==== osd_op_reply(195 10000000001.00000000 [omap-get-vals-by-keys out=702b] v0'0 uv20 ondisk = 0) ==== 164+0+702 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 18 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.350+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:196 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=710b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51a800 con 0x5562ad958c00 2024-04-24T23:01:49.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.353+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 86 ==== osd_op_reply(196 10000000001.00000000 [omap-set-vals] v42'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.353+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.353+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:197 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:49.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.354+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 86 ==== osd_op_reply(197 1.00000000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.354+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v50 vs new v52 2024-04-24T23:01:49.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.354+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.354+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:198 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ad958400 2024-04-24T23:01:49.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.358+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 87 ==== osd_op_reply(198 1.00000000 [omap-set-header] v42'41 uv41 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.358+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:199 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ad958400 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 88 ==== osd_op_reply(199 1.00000000 [omap-get-vals-by-keys out=686b] v0'0 uv41 ondisk = 0) ==== 154+0+686 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 4 recover_dentries: dentry rootfile_head existed already 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 41 vs fullbit version 51 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2024-04-24T23:01:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.359+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:200 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=694b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.363+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 89 ==== osd_op_reply(200 1.00000000 [omap-set-vals] v42'42 uv42 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.363+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.363+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.363+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:201 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98cc00 con 0x5562ae51b800 2024-04-24T23:01:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.364+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 25 ==== osd_op_reply(201 1.00000000.inode [read 0~582 out=582b] v0'0 uv21 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.364+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.364+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.364+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 8 2024-04-24T23:01:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.364+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:202 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d400 con 0x5562ae51b800 2024-04-24T23:01:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.368+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 26 ==== osd_op_reply(202 1.00000000.inode [writefull 0~582] v42'22 uv22 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.368+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.368+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:203 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958400 2024-04-24T23:01:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.369+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 90 ==== osd_op_reply(203 1.00000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.369+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v52 vs new v54 2024-04-24T23:01:49.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.369+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.369+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:204 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.373+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 91 ==== osd_op_reply(204 1.00000000 [omap-set-header] v42'43 uv43 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.374+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:205 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9800 con 0x5562ad958400 2024-04-24T23:01:49.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 92 ==== osd_op_reply(205 1.00000000 [omap-get-vals-by-keys out=569b] v0'0 uv43 ondisk = 0) ==== 154+0+569 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 4 recover_dentries: dentry linkdir_head existed already 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 47 vs fullbit version 53 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2024-04-24T23:01:49.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.375+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:206 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=569b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9c00 con 0x5562ad958400 2024-04-24T23:01:49.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.378+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 93 ==== osd_op_reply(206 1.00000000 [omap-set-vals] v42'44 uv44 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.378+0000 7f6a5727a280 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-04-24T23:01:49.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.378+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:207 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8000 con 0x5562ad958c00 2024-04-24T23:01:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.379+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 87 ==== osd_op_reply(207 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.379+0000 7f6a5727a280 4 recover_dentries: frag 100000001f7.00000000 fnode old v23 vs new v25 2024-04-24T23:01:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.379+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.379+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:208 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8400 con 0x5562ad958c00 2024-04-24T23:01:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.383+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 88 ==== osd_op_reply(208 100000001f7.00000000 [omap-set-header] v42'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.383+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:209 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1400 con 0x5562ad958c00 2024-04-24T23:01:49.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 89 ==== osd_op_reply(209 100000001f7.00000000 [omap-get-vals-by-keys out=613b] v0'0 uv24 ondisk = 0) ==== 164+0+613 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-04-24T23:01:49.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: dentry link2_head existed already 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 22 vs fullbit version 24 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: dentry link2_head existed already 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 22 vs fullbit version 24 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2024-04-24T23:01:49.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.384+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:210 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=575b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ae3a1800 con 0x5562ad958c00 2024-04-24T23:01:49.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.388+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 90 ==== osd_op_reply(210 100000001f7.00000000 [omap-set-vals] v42'25 uv25 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.388+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:49.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.388+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:49.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.388+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:211 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ae51b400 con 0x5562ae51b800 2024-04-24T23:01:49.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.389+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 27 ==== osd_op_reply(211 1.00000000.inode [read 0~582 out=582b] v0'0 uv22 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.390+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:49.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.390+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:49.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.390+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 9 2024-04-24T23:01:49.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.390+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:212 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959400 con 0x5562ae51b800 2024-04-24T23:01:49.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.394+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 28 ==== osd_op_reply(212 1.00000000.inode [writefull 0~582] v42'23 uv23 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.394+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.394+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:213 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9000 con 0x5562ad958400 2024-04-24T23:01:49.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.395+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 94 ==== osd_op_reply(213 1.00000000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.395+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v54 vs new v56 2024-04-24T23:01:49.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.395+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.395+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:214 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9400 con 0x5562ad958400 2024-04-24T23:01:49.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.399+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 95 ==== osd_op_reply(214 1.00000000 [omap-set-header] v42'45 uv45 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.399+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:215 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8800 con 0x5562ad958400 2024-04-24T23:01:49.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 96 ==== osd_op_reply(215 1.00000000 [omap-get-vals-by-keys out=568b] v0'0 uv45 ondisk = 0) ==== 154+0+568 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 4 recover_dentries: dentry subdir_head existed already 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 49 vs fullbit version 55 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2024-04-24T23:01:49.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.400+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:216 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=568b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e8c00 con 0x5562ad958400 2024-04-24T23:01:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.404+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 97 ==== osd_op_reply(216 1.00000000 [omap-set-vals] v42'46 uv46 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.404+0000 7f6a5727a280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-04-24T23:01:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.404+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:217 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9800 con 0x5562ad958c00 2024-04-24T23:01:49.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.405+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 91 ==== osd_op_reply(217 10000000001.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.405+0000 7f6a5727a280 4 recover_dentries: frag 10000000001.00000000 fnode old v19 vs new v21 2024-04-24T23:01:49.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.405+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.405+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:218 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad9e9c00 con 0x5562ad958c00 2024-04-24T23:01:49.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.409+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 92 ==== osd_op_reply(218 10000000001.00000000 [omap-set-header] v42'22 uv22 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.409+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:219 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d800 con 0x5562ad958c00 2024-04-24T23:01:49.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 93 ==== osd_op_reply(219 10000000001.00000000 [omap-get-vals-by-keys out=710b] v0'0 uv22 ondisk = 0) ==== 164+0+710 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 18 vs fullbit version 20 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: dentry subdirfile_head existed already 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 18 vs fullbit version 20 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2024-04-24T23:01:49.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.410+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:220 5.7 5:e2e07930:::10000000001.00000000:head [omap-set-vals in=672b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98dc00 con 0x5562ad958c00 2024-04-24T23:01:49.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.414+0000 7f6a54a00640 1 -- 172.21.15.146:0/1373854914 <== osd.3 v2:172.21.15.146:6808/1724749641 94 ==== osd_op_reply(220 10000000001.00000000 [omap-set-vals] v42'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5562ae356000 con 0x5562ad958c00 2024-04-24T23:01:49.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.415+0000 7f6a5727a280 4 recover_dentries: inspecting lump 1.00000000 2024-04-24T23:01:49.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.415+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:221 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c800 con 0x5562ad958400 2024-04-24T23:01:49.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.415+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 98 ==== osd_op_reply(221 1.00000000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.416+0000 7f6a5727a280 4 recover_dentries: frag 1.00000000 fnode old v56 vs new v58 2024-04-24T23:01:49.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.416+0000 7f6a5727a280 4 recover_dentries: writing fnode to omap header 2024-04-24T23:01:49.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.416+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:222 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98d000 con 0x5562ad958400 2024-04-24T23:01:49.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.419+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 99 ==== osd_op_reply(222 1.00000000 [omap-set-header] v42'47 uv47 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.419+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:223 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad98c400 con 0x5562ad958400 2024-04-24T23:01:49.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 100 ==== osd_op_reply(223 1.00000000 [omap-get-vals-by-keys out=694b] v0'0 uv47 ondisk = 0) ==== 154+0+694 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: dentry rootfile_head existed already 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 51 vs fullbit version 57 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: dentry rootfile_head existed already 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: dentry exists, checking versions... 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: decoded embedded inode version 51 vs fullbit version 57 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2024-04-24T23:01:49.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.420+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:224 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=656b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959800 con 0x5562ad958400 2024-04-24T23:01:49.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.424+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 <== osd.2 v2:172.21.15.146:6809/29852179 101 ==== osd_op_reply(224 1.00000000 [omap-set-vals] v42'48 uv48 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5562ad97d400 con 0x5562ad958400 2024-04-24T23:01:49.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.424+0000 7f6a5727a280 4 recover_dentries: updating root 0x0x1 2024-04-24T23:01:49.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.424+0000 7f6a5727a280 4 recover_dentries: object id 1.00000000.inode 2024-04-24T23:01:49.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.424+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:225 5.14 5:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959c00 con 0x5562ae51b800 2024-04-24T23:01:49.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.426+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 29 ==== osd_op_reply(225 1.00000000.inode [read 0~582 out=582b] v0'0 uv23 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.426+0000 7f6a5727a280 4 recover_dentries: root exists, will modify (582) 2024-04-24T23:01:49.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.426+0000 7f6a5727a280 4 recover_dentries: magic ok 2024-04-24T23:01:49.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.426+0000 7f6a5727a280 4 recover_dentries: writing root ino 1.00000000.inode version 10 2024-04-24T23:01:49.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.426+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:226 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad959000 con 0x5562ae51b800 2024-04-24T23:01:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.430+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 30 ==== osd_op_reply(226 1.00000000.inode [writefull 0~582] v42'24 uv24 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.430+0000 7f6a5727a280 4 main_event: consumed 8 inodes 2024-04-24T23:01:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.430+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:227 5.13 5:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958800 con 0x5562ae51b800 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 31 ==== osd_op_reply(227 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x10000000000 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x10000000001 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x10000000002 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x100000001f7 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x100000001f8 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x100000001f9 requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: Used ino 0x0x100000001fa requires inotable update 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 4 consume_inos: writing modified inotable version 1 2024-04-24T23:01:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.432+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:228 5.13 5:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5562ad958000 con 0x5562ae51b800 2024-04-24T23:01:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:0.000000 0x400000 LID: () 2024-04-24T23:01:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:35.082132+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:01:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.043346+0000 0x4003ac SESSION: () 2024-04-24T23:01:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.130793+0000 0x4004ae OPEN: () 2024-04-24T23:01:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.131015+0000 0x40055a UPDATE: (setattr) 2024-04-24T23:01:49.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.436+0000 7f6a55e00640 1 -- 172.21.15.146:0/1373854914 <== osd.4 v2:172.21.15.203:6810/306347931 32 ==== osd_op_reply(228 mds0_inotable [writefull 0~50] v42'7 uv7 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5562ad97c780 con 0x5562ae51b800 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout: / 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.414505+0000 0x400889 UPDATE: (openc) 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout: rootfile 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.488091+0000 0x400f78 UPDATE: (mkdir) 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout: subdir 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.550814+0000 0x401783 UPDATE: (openc) 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.643315+0000 0x401fa9 UPDATE: (mkdir) 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.697053+0000 0x4027c5 UPDATE: (scatter_writebehind) 2024-04-24T23:01:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.699828+0000 0x402c37 UPDATE: (openc) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link0 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.800762+0000 0x403459 UPDATE: (unlink_local) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: stray2/100000001f8 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link0 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.801083+0000 0x40415f UPDATE: (cap update) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: stray2/100000001f8 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.857218+0000 0x404964 UPDATE: (link_local) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link0 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.909999+0000 0x4055a1 UPDATE: (link_local) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link1 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:43.967316+0000 0x4061de UPDATE: (link_local) 2024-04-24T23:01:49.441 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.022576+0000 0x406e1b UPDATE: (unlink_local) 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.080026+0000 0x407a5b UPDATE: (openc) 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.138562+0000 0x40827d UPDATE: (link_local) 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link3 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.196066+0000 0x408ec8 UPDATE: (unlink_local) 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link3 2024-04-24T23:01:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.250143+0000 0x409b08 UPDATE: (link_local) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: rootfile 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link3 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.305557+0000 0x40a5fe UPDATE: (mkdir) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subsubdir 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.377017+0000 0x40af51 UPDATE: (cap update) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.377859+0000 0x40b780 UPDATE: (cap update) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:44.378261+0000 0x40c00f UPDATE: (cap update) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: rootfile 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:47.963791+0000 0x40c749 SESSION: () 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:47.982217+0000 0x40c7f6 UPDATE: (check_inode_max_size) 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.443 INFO:teuthology.orchestra.run.smithi146.stdout: linkdir/link2 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:47.982901+0000 0x40d47a UPDATE: (check_inode_max_size) 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout: subdir/subdirfile 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout:2024-04-24T23:01:47.983432+0000 0x40df76 UPDATE: (check_inode_max_size) 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout: rootfile 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout: rootfile 2024-04-24T23:01:49.444 INFO:teuthology.orchestra.run.smithi146.stdout:0.000000 0x40e90d PURGED: () 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 4 30 events 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5562ae51b000 msgr2=0x5562ad643180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5562ae51b000 0x5562ad643180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5562ad958400 msgr2=0x5562ad944580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5562ad958400 0x5562ad944580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5562ad958c00 msgr2=0x5562ad944b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5562ad958c00 0x5562ad944b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5562ae51b800 msgr2=0x5562ad643700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5562ae51b800 0x5562ad643700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a55400640 1 -- 172.21.15.146:0/1373854914 reap_dead start 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 msgr2=0x5562ad944000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.437+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 0x5562ad944000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5562ae4048a0 tx=0x5562ae366ae0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 msgr2=0x5562ad642100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x5562ae3b71a0 tx=0x5562ae4bf800 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 shutdown_connections 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5562ae51ac00 0x5562ad944000 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1373854914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a800 0x5562ad642100 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 >> 172.21.15.146:0/1373854914 conn(0x5562ae49a400 msgr2=0x5562ad6bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 shutdown_connections 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.438+0000 7f6a5727a280 1 -- 172.21.15.146:0/1373854914 wait complete. 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.439+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 msgr2=0x5562ad640580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.439+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x5562ae4055c0 tx=0x5562ae368240 comp rx=0 tx=0).stop 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 shutdown_connections 2024-04-24T23:01:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5562ae49a000 0x5562ad640580 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5562ae3a1c00 0x5562ad640b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 --2- 172.21.15.146:0/1116173047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5562ae3a0000 0x5562ad641080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 >> 172.21.15.146:0/1116173047 conn(0x5562ad5d5000 msgr2=0x5562ad6bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 shutdown_connections 2024-04-24T23:01:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.440+0000 7f6a5727a280 1 -- 172.21.15.146:0/1116173047 wait complete. 2024-04-24T23:01:49.453 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:00.680232, result: 0.000000 0x400000 LID: () 2024-04-24T23:01:35.082132+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:01:43.043346+0000 0x4003ac SESSION: () 2024-04-24T23:01:43.130793+0000 0x4004ae OPEN: () 2024-04-24T23:01:43.131015+0000 0x40055a UPDATE: (setattr) / 2024-04-24T23:01:43.414505+0000 0x400889 UPDATE: (openc) rootfile 2024-04-24T23:01:43.488091+0000 0x400f78 UPDATE: (mkdir) subdir 2024-04-24T23:01:43.550814+0000 0x401783 UPDATE: (openc) subdir/subdirfile 2024-04-24T23:01:43.643315+0000 0x401fa9 UPDATE: (mkdir) linkdir 2024-04-24T23:01:43.697053+0000 0x4027c5 UPDATE: (scatter_writebehind) 2024-04-24T23:01:43.699828+0000 0x402c37 UPDATE: (openc) linkdir/link0 2024-04-24T23:01:43.800762+0000 0x403459 UPDATE: (unlink_local) stray2/100000001f8 linkdir/link0 2024-04-24T23:01:43.801083+0000 0x40415f UPDATE: (cap update) stray2/100000001f8 2024-04-24T23:01:43.857218+0000 0x404964 UPDATE: (link_local) subdir/subdirfile linkdir/link0 2024-04-24T23:01:43.909999+0000 0x4055a1 UPDATE: (link_local) subdir/subdirfile linkdir/link1 2024-04-24T23:01:43.967316+0000 0x4061de UPDATE: (link_local) subdir/subdirfile linkdir/link2 2024-04-24T23:01:44.022576+0000 0x406e1b UPDATE: (unlink_local) subdir/subdirfile linkdir/link2 2024-04-24T23:01:44.080026+0000 0x407a5b UPDATE: (openc) linkdir/link2 2024-04-24T23:01:44.138562+0000 0x40827d UPDATE: (link_local) subdir/subdirfile linkdir/link3 2024-04-24T23:01:44.196066+0000 0x408ec8 UPDATE: (unlink_local) subdir/subdirfile linkdir/link3 2024-04-24T23:01:44.250143+0000 0x409b08 UPDATE: (link_local) rootfile linkdir/link3 2024-04-24T23:01:44.305557+0000 0x40a5fe UPDATE: (mkdir) subdir/subsubdir 2024-04-24T23:01:44.377017+0000 0x40af51 UPDATE: (cap update) linkdir/link2 2024-04-24T23:01:44.377859+0000 0x40b780 UPDATE: (cap update) subdir/subdirfile 2024-04-24T23:01:44.378261+0000 0x40c00f UPDATE: (cap update) rootfile 2024-04-24T23:01:47.963791+0000 0x40c749 SESSION: () 2024-04-24T23:01:47.982217+0000 0x40c7f6 UPDATE: (check_inode_max_size) linkdir/link2 linkdir/link2 2024-04-24T23:01:47.982901+0000 0x40d47a UPDATE: (check_inode_max_size) subdir/subdirfile subdir/subdirfile 2024-04-24T23:01:47.983432+0000 0x40df76 UPDATE: (check_inode_max_size) rootfile rootfile 0.000000 0x40e90d PURGED: () 2024-04-24T23:01:49.453 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-04-24T23:01:49.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.601+0000 7f2453397f40 1 Processor -- start 2024-04-24T23:01:49.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.601+0000 7f2453397f40 1 -- start start 2024-04-24T23:01:49.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a1796a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a178ca560 0x558a1789d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558a1789a780 con 0x558a17972740 2024-04-24T23:01:49.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558a17842640 con 0x558a178ca560 2024-04-24T23:01:49.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.602+0000 7f2453397f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x558a1789aa20 con 0x558a1789e1c0 2024-04-24T23:01:49.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33878/0 (socket says 172.21.15.146:33878) 2024-04-24T23:01:49.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 -- 172.21.15.146:0/2788509104 learned_addr learned my addr 172.21.15.146:0/2788509104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f244fc00640 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a178ca560 0x558a1789d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 -- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 msgr2=0x558a1796a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2450600640 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a1796a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a1796a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 -- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a178ca560 msgr2=0x558a1789d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a178ca560 0x558a1789d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 -- 172.21.15.146:0/2788509104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a177c7b30 con 0x558a17972740 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.603+0000 7f2451000640 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f244800a460 tx=0x7f244800a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9e61bc4fcd70ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f244e800640 1 -- 172.21.15.146:0/2788509104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244800f7b0 con 0x558a17972740 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f244e800640 1 -- 172.21.15.146:0/2788509104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2448015070 con 0x558a17972740 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f244e800640 1 -- 172.21.15.146:0/2788509104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244800fb90 con 0x558a17972740 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 -- 172.21.15.146:0/2788509104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 msgr2=0x558a1789da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f244800a460 tx=0x7f244800a920 comp rx=0 tx=0).stop 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 -- 172.21.15.146:0/2788509104 shutdown_connections 2024-04-24T23:01:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a17972740 0x558a1789da00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a178ca560 0x558a1789d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 --2- 172.21.15.146:0/2788509104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a1796a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 -- 172.21.15.146:0/2788509104 >> 172.21.15.146:0/2788509104 conn(0x558a178e69c0 msgr2=0x558a178c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 -- 172.21.15.146:0/2788509104 shutdown_connections 2024-04-24T23:01:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.604+0000 7f2453397f40 1 -- 172.21.15.146:0/2788509104 wait complete. 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.605+0000 7f2453397f40 1 Processor -- start 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.605+0000 7f2453397f40 1 -- start start 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a17966c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 0x558a1789b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a17972740 0x558a1789bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558a178e6f20 con 0x558a178ca560 2024-04-24T23:01:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558a178e5ee0 con 0x558a17972740 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.606+0000 7f2453397f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x558a178e5440 con 0x558a1789e1c0 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 0x558a1789b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 0x558a1789b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33892/0 (socket says 172.21.15.146:33892) 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 -- 172.21.15.146:0/4089752801 learned_addr learned my addr 172.21.15.146:0/4089752801 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f2451000640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a17972740 0x558a1789bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f2450600640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a17966c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 -- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 msgr2=0x558a17966c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558a1789e1c0 0x558a17966c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 -- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a17972740 msgr2=0x558a1789bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558a17972740 0x558a1789bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.607+0000 7f244fc00640 1 -- 172.21.15.146:0/4089752801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a17969630 con 0x558a178ca560 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f244fc00640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 0x558a1789b630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f243c00be10 tx=0x7f243c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f244d400640 1 -- 172.21.15.146:0/4089752801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c019070 con 0x558a178ca560 2024-04-24T23:01:49.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f244d400640 1 -- 172.21.15.146:0/4089752801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c007b50 con 0x558a178ca560 2024-04-24T23:01:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f244d400640 1 -- 172.21.15.146:0/4089752801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c014410 con 0x558a178ca560 2024-04-24T23:01:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a17969140 con 0x558a178ca560 2024-04-24T23:01:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.608+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a17967140 con 0x558a178ca560 2024-04-24T23:01:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.610+0000 7f244d400640 1 -- 172.21.15.146:0/4089752801 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f243c01c070 con 0x558a178ca560 2024-04-24T23:01:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.611+0000 7f244d400640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f243006a810 0x7f243006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.611+0000 7f244d400640 1 -- 172.21.15.146:0/4089752801 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f243c088d80 con 0x558a178ca560 2024-04-24T23:01:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.612+0000 7f2453397f40 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x558a17a095f0 0x558a17a099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.612+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:1 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x558a17a09f10 con 0x558a17a095f0 2024-04-24T23:01:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.612+0000 7f2450600640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f243006a810 0x7f243006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.612+0000 7f2451000640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x558a17a095f0 0x558a17a099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2451000640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x558a17a095f0 0x558a17a099d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2451000640 1 -- 172.21.15.146:0/4089752801 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=53b] v0'0 uv48 ondisk = 0) ==== 154+0+53 (crc 0 0 0) 0x7f244800e070 con 0x558a17a095f0 2024-04-24T23:01:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:linkdir_head 2024-04-24T23:01:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:rootfile_head 2024-04-24T23:01:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:subdir_head 2024-04-24T23:01:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x558a17a095f0 msgr2=0x558a17a099d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x558a17a095f0 0x558a17a099d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2450600640 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f243006a810 0x7f243006ccd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2440057000 tx=0x7f2440052000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f243006a810 msgr2=0x7f243006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f243006a810 0x7f243006ccd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2440057000 tx=0x7f2440052000 comp rx=0 tx=0).stop 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 msgr2=0x558a1789b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.613+0000 7f2453397f40 1 --2- 172.21.15.146:0/4089752801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558a178ca560 0x558a1789b630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f243c00be10 tx=0x7f243c00bf00 comp rx=0 tx=0).stop 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.614+0000 7f2451000640 1 -- 172.21.15.146:0/4089752801 reap_dead start 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.614+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 shutdown_connections 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.614+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 >> 172.21.15.146:0/4089752801 conn(0x558a178e69c0 msgr2=0x558a179758b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.614+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 shutdown_connections 2024-04-24T23:01:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.614+0000 7f2453397f40 1 -- 172.21.15.146:0/4089752801 wait complete. 2024-04-24T23:01:49.620 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-04-24T23:01:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.703+0000 7f8d58f20f40 1 Processor -- start 2024-04-24T23:01:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.703+0000 7f8d58f20f40 1 -- start start 2024-04-24T23:01:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6d6d40 0x55c4ce746b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce747210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c4ce6d8230 con 0x55c4ce6be560 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c4ce632640 con 0x55c4ce6d6d40 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c4ce6be970 con 0x55c4ce748860 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33908/0 (socket says 172.21.15.146:33908) 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 -- 172.21.15.146:0/553527657 learned_addr learned my addr 172.21.15.146:0/553527657 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 -- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 msgr2=0x55c4ce747210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce747210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d54e00640 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6d6d40 0x55c4ce746b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.704+0000 7f8d55800640 1 -- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6d6d40 msgr2=0x55c4ce746b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d55800640 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6d6d40 0x55c4ce746b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d55800640 1 -- 172.21.15.146:0/553527657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ce5b7b30 con 0x55c4ce6be560 2024-04-24T23:01:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d55800640 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800a770 tx=0x7f8d4800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42072c07419b9959 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d4f400640 1 -- 172.21.15.146:0/553527657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48019070 con 0x55c4ce6be560 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d4f400640 1 -- 172.21.15.146:0/553527657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d48007600 con 0x55c4ce6be560 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.705+0000 7f8d4f400640 1 -- 172.21.15.146:0/553527657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48007a10 con 0x55c4ce6be560 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 -- 172.21.15.146:0/553527657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 msgr2=0x55c4ce75d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800a770 tx=0x7f8d4800a860 comp rx=0 tx=0).stop 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 -- 172.21.15.146:0/553527657 shutdown_connections 2024-04-24T23:01:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce747210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6d6d40 0x55c4ce746b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/553527657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6be560 0x55c4ce75d6e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 -- 172.21.15.146:0/553527657 >> 172.21.15.146:0/553527657 conn(0x55c4ce6d8c30 msgr2=0x55c4ce7631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 -- 172.21.15.146:0/553527657 shutdown_connections 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.706+0000 7f8d58f20f40 1 -- 172.21.15.146:0/553527657 wait complete. 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.707+0000 7f8d58f20f40 1 Processor -- start 2024-04-24T23:01:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.707+0000 7f8d58f20f40 1 -- start start 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6be560 0x55c4ce75c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 0x55c4ce75d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce6d5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c4ce761ea0 con 0x55c4ce6d6d40 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c4ce6bd350 con 0x55c4ce6be560 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d58f20f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c4ce766ed0 con 0x55c4ce748860 2024-04-24T23:01:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 0x55c4ce75d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 0x55c4ce75d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33918/0 (socket says 172.21.15.146:33918) 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 -- 172.21.15.146:0/691725079 learned_addr learned my addr 172.21.15.146:0/691725079 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d56200640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce6d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d55800640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6be560 0x55c4ce75c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 -- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 msgr2=0x55c4ce6d5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce6d5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 -- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6be560 msgr2=0x55c4ce75c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6be560 0x55c4ce75c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.708+0000 7f8d54e00640 1 -- 172.21.15.146:0/691725079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ce6bbe30 con 0x55c4ce6d6d40 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d56200640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c4ce748860 0x55c4ce6d5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d55800640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c4ce6be560 0x55c4ce75c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d54e00640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 0x55c4ce75d140 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d4e000640 1 -- 172.21.15.146:0/691725079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44009750 con 0x55c4ce6d6d40 2024-04-24T23:01:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d4e000640 1 -- 172.21.15.146:0/691725079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d44063070 con 0x55c4ce6d6d40 2024-04-24T23:01:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d4e000640 1 -- 172.21.15.146:0/691725079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44009af0 con 0x55c4ce6d6d40 2024-04-24T23:01:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4ce75fe60 con 0x55c4ce6d6d40 2024-04-24T23:01:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.709+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ce760420 con 0x55c4ce6d6d40 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.711+0000 7f8d4e000640 1 -- 172.21.15.146:0/691725079 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d44009c90 con 0x55c4ce6d6d40 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.712+0000 7f8d4e000640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d3806a840 0x7f8d3806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.712+0000 7f8d4e000640 1 -- 172.21.15.146:0/691725079 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f8d440ce620 con 0x55c4ce6d6d40 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.713+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55c4ce7f9040 0x55c4ce7f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.713+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55c4ce7f99f0 con 0x55c4ce7f9040 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.713+0000 7f8d56200640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55c4ce7f9040 0x55c4ce7f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.713+0000 7f8d55800640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d3806a840 0x7f8d3806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.713+0000 7f8d56200640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55c4ce7f9040 0x55c4ce7f94b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d56200640 1 -- 172.21.15.146:0/691725079 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys out=42b] v0'0 uv23 ondisk = 0) ==== 164+0+42 (crc 0 0 0) 0x7f8d50001730 con 0x55c4ce7f9040 2024-04-24T23:01:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:subdirfile_head 2024-04-24T23:01:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:subsubdir_head 2024-04-24T23:01:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55c4ce7f9040 msgr2=0x55c4ce7f94b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55c4ce7f9040 0x55c4ce7f94b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d55800640 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d3806a840 0x7f8d3806cd00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d48017040 tx=0x7f8d4800c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d3806a840 msgr2=0x7f8d3806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d3806a840 0x7f8d3806cd00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d48017040 tx=0x7f8d4800c000 comp rx=0 tx=0).stop 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 msgr2=0x55c4ce75d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 --2- 172.21.15.146:0/691725079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4ce6d6d40 0x55c4ce75d140 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d44002fb0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d56200640 1 -- 172.21.15.146:0/691725079 reap_dead start 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 shutdown_connections 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 >> 172.21.15.146:0/691725079 conn(0x55c4ce6d8c30 msgr2=0x55c4ce6bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 shutdown_connections 2024-04-24T23:01:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.714+0000 7f8d58f20f40 1 -- 172.21.15.146:0/691725079 wait complete. 2024-04-24T23:01:49.721 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100000001f7.00000000 2024-04-24T23:01:49.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.804+0000 7f6eecd5bf40 1 Processor -- start 2024-04-24T23:01:49.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.804+0000 7f6eecd5bf40 1 -- start start 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6175730 0x55b4b616f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b618dd40 0x55b4b61738e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b4b618f230 con 0x55b4b6218e90 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b4b60e9640 con 0x55b4b6175730 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b4b618e310 con 0x55b4b618dd40 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33928/0 (socket says 172.21.15.146:33928) 2024-04-24T23:01:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 -- 172.21.15.146:0/357374681 learned_addr learned my addr 172.21.15.146:0/357374681 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 -- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b618dd40 msgr2=0x55b4b61738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b618dd40 0x55b4b61738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 -- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6175730 msgr2=0x55b4b616f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.805+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6175730 0x55b4b616f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.806+0000 7f6eeaa00640 1 -- 172.21.15.146:0/357374681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b606eb30 con 0x55b4b6218e90 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.806+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009920 tx=0x7f6ee4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d40b355d0b1826 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.806+0000 7f6ee3e00640 1 -- 172.21.15.146:0/357374681 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40088f0 con 0x55b4b6218e90 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.806+0000 7f6ee3e00640 1 -- 172.21.15.146:0/357374681 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee4008a90 con 0x55b4b6218e90 2024-04-24T23:01:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.806+0000 7f6ee3e00640 1 -- 172.21.15.146:0/357374681 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4013420 con 0x55b4b6218e90 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/357374681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 msgr2=0x55b4b6217320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009920 tx=0x7f6ee4005a00 comp rx=0 tx=0).stop 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/357374681 shutdown_connections 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b6218e90 0x55b4b6217320 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b618dd40 0x55b4b61738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/357374681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6175730 0x55b4b616f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/357374681 >> 172.21.15.146:0/357374681 conn(0x55b4b618fc30 msgr2=0x55b4b6174590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/357374681 shutdown_connections 2024-04-24T23:01:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.807+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/357374681 wait complete. 2024-04-24T23:01:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.808+0000 7f6eecd5bf40 1 Processor -- start 2024-04-24T23:01:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.808+0000 7f6eecd5bf40 1 -- start start 2024-04-24T23:01:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b6175730 0x55b4b6174450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 0x55b4b6201af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6218e90 0x55b4b6202030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b4b618bf00 con 0x55b4b618dd40 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b4b621def0 con 0x55b4b6218e90 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eecd5bf40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b4b6202b90 con 0x55b4b6175730 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 0x55b4b6201af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 0x55b4b6201af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33934/0 (socket says 172.21.15.146:33934) 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 -- 172.21.15.146:0/3060806296 learned_addr learned my addr 172.21.15.146:0/3060806296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eea000640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b6175730 0x55b4b6174450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 -- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b6175730 msgr2=0x55b4b6174450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6218e90 0x55b4b6202030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b4b6175730 0x55b4b6174450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 -- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6218e90 msgr2=0x55b4b6202030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b4b6218e90 0x55b4b6202030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.809+0000 7f6ee9600640 1 -- 172.21.15.146:0/3060806296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b61feb20 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6ee9600640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 0x55b4b6201af0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400bab0 tx=0x7f6ed400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6ee2a00640 1 -- 172.21.15.146:0/3060806296 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4014030 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6ee2a00640 1 -- 172.21.15.146:0/3060806296 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed4009a70 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6ee2a00640 1 -- 172.21.15.146:0/3060806296 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4009e60 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b6202de0 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.810+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b6219510 con 0x55b4b618dd40 2024-04-24T23:01:49.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.812+0000 7f6ee2a00640 1 -- 172.21.15.146:0/3060806296 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ed4017070 con 0x55b4b618dd40 2024-04-24T23:01:49.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.813+0000 7f6ee2a00640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ec806a810 0x7f6ec806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.813+0000 7f6ee2a00640 1 -- 172.21.15.146:0/3060806296 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f6ed4089250 con 0x55b4b618dd40 2024-04-24T23:01:49.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.814+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55b4b6174990 0x55b4b6211320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.814+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:1 5.16 5:6fe38dc2:::100000001f7.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x55b4b61fdbf0 con 0x55b4b6174990 2024-04-24T23:01:49.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.814+0000 7f6eea000640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ec806a810 0x7f6ec806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.814+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55b4b6174990 0x55b4b6211320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.814+0000 7f6eeaa00640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55b4b6174990 0x55b4b6211320 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eeaa00640 1 -- 172.21.15.146:0/3060806296 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(1 100000001f7.00000000 [omap-get-keys out=61b] v0'0 uv25 ondisk = 0) ==== 164+0+61 (crc 0 0 0) 0x7f6ee4008c40 con 0x55b4b6174990 2024-04-24T23:01:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:link0_head 2024-04-24T23:01:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:link1_head 2024-04-24T23:01:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:link2_head 2024-04-24T23:01:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:link3_head 2024-04-24T23:01:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eea000640 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ec806a810 0x7f6ec806ccd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6edc056000 tx=0x7f6edc050000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55b4b6174990 msgr2=0x55b4b6211320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55b4b6174990 0x55b4b6211320 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ec806a810 msgr2=0x7f6ec806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6ec806a810 0x7f6ec806ccd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6edc056000 tx=0x7f6edc050000 comp rx=0 tx=0).stop 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 msgr2=0x55b4b6201af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 --2- 172.21.15.146:0/3060806296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4b618dd40 0x55b4b6201af0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400bab0 tx=0x7f6ed400beb0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eeaa00640 1 -- 172.21.15.146:0/3060806296 reap_dead start 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 shutdown_connections 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 >> 172.21.15.146:0/3060806296 conn(0x55b4b618fc30 msgr2=0x55b4b6190010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 shutdown_connections 2024-04-24T23:01:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.815+0000 7f6eecd5bf40 1 -- 172.21.15.146:0/3060806296 wait complete. 2024-04-24T23:01:49.822 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-24T23:01:49.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.904+0000 7f74c9d67280 1 -- start start 2024-04-24T23:01:49.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.904+0000 7f74c9d67280 1 Processor -- start 2024-04-24T23:01:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d8f6ec00 0x5652d8fda580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d8f6fc00 0x5652d8fdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd2600 con 0x5652d8f6f800 2024-04-24T23:01:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd2480 con 0x5652d8f6ec00 2024-04-24T23:01:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5652d9cd2300 con 0x5652d8f6fc00 2024-04-24T23:01:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.905+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33944/0 (socket says 172.21.15.146:33944) 2024-04-24T23:01:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 -- 172.21.15.146:0/2039948143 learned_addr learned my addr 172.21.15.146:0/2039948143 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 -- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d8f6fc00 msgr2=0x5652d8fdb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d8f6fc00 0x5652d8fdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d8f6ec00 0x5652d8fda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 -- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d8f6ec00 msgr2=0x5652d8fda580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d8f6ec00 0x5652d8fda580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 -- 172.21.15.146:0/2039948143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d8fa2780 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c7400640 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5652d9d8eba0 tx=0x5652d9d02cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b1b0a6eac38d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c4c00640 1 -- 172.21.15.146:0/2039948143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f94680 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c4c00640 1 -- 172.21.15.146:0/2039948143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5652d8f9ae00 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c4c00640 1 -- 172.21.15.146:0/2039948143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f949c0 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.906+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d8fa3680 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5652d8fa2000 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c9d67280 4 waiting for MDS map... 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c4c00640 1 -- 172.21.15.146:0/2039948143 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x5652d9e40400 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c4c00640 1 -- 172.21.15.146:0/2039948143 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 18) ==== 3490+0+0 (secure 0 0 0) 0x5652d8fc9180 con 0x5652d8f6f800 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c9d67280 4 Got MDS map 18 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c9d67280 10 main: JournalTool::main 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.907+0000 7f74c9d67280 4 main: JournalTool: connecting to RADOS... 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.908+0000 7f74c9d67280 1 Processor -- start 2024-04-24T23:01:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.908+0000 7f74c9d67280 1 -- start start 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c800 0x5652d8fdc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd2180 con 0x5652d9e9c000 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5652d8fd0480 con 0x5652d9e9c800 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5652d8fd0900 con 0x5652d9e9c400 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33950/0 (socket says 172.21.15.146:33950) 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 -- 172.21.15.146:0/636989816 learned_addr learned my addr 172.21.15.146:0/636989816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 -- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 msgr2=0x5652d8fdbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 -- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c800 msgr2=0x5652d8fdc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c800 0x5652d8fdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.909+0000 7f74c8800640 1 -- 172.21.15.146:0/636989816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d8fa23c0 con 0x5652d9e9c000 2024-04-24T23:01:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c8800640 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5652d9d6e600 tx=0x5652d9e54d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941552a9b77a8ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c2400640 1 -- 172.21.15.146:0/636989816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f94680 con 0x5652d9e9c000 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c2400640 1 -- 172.21.15.146:0/636989816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5652d8f9a1c0 con 0x5652d9e9c000 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c2400640 1 -- 172.21.15.146:0/636989816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f949c0 con 0x5652d9e9c000 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c9d67280 1 -- 172.21.15.146:0/636989816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 msgr2=0x5652d8fdb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.910+0000 7f74c9d67280 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5652d9d6e600 tx=0x5652d9e54d20 comp rx=0 tx=0).stop 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 -- 172.21.15.146:0/636989816 shutdown_connections 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c800 0x5652d8fdc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 --2- 172.21.15.146:0/636989816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c000 0x5652d8fdb600 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 -- 172.21.15.146:0/636989816 >> 172.21.15.146:0/636989816 conn(0x5652d9d55c00 msgr2=0x5652d9079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 -- 172.21.15.146:0/636989816 shutdown_connections 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 -- 172.21.15.146:0/636989816 wait complete. 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.911+0000 7f74c9d67280 1 Processor -- start 2024-04-24T23:01:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 -- start start 2024-04-24T23:01:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c000 0x5652d8fdd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd3380 con 0x5652d9e9c800 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd2180 con 0x5652d9e9c000 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.912+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5652d9cd2c00 con 0x5652d9e9c400 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33960/0 (socket says 172.21.15.146:33960) 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 -- 172.21.15.146:0/2905947029 learned_addr learned my addr 172.21.15.146:0/2905947029 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c8800640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c000 0x5652d8fdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 -- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 msgr2=0x5652d8fdcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 -- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c000 msgr2=0x5652d8fdd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c000 0x5652d8fdd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 -- 172.21.15.146:0/2905947029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d8fa2960 con 0x5652d9e9c800 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.913+0000 7f74c7400640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5652d9cf0900 tx=0x5652d9d02d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c0600640 1 -- 172.21.15.146:0/2905947029 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f94680 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c0600640 1 -- 172.21.15.146:0/2905947029 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5652d8f9ac40 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c0600640 1 -- 172.21.15.146:0/2905947029 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d8f949c0 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652d8fa3860 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d8fa3a40 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.914+0000 7f74c9d67280 4 main: JournalTool: resolving pool 5 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.915+0000 7f74c0600640 1 -- 172.21.15.146:0/2905947029 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5652d9eacc00 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.916+0000 7f74c0600640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 0x5652d8fdd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.916+0000 7f74c0600640 1 -- 172.21.15.146:0/2905947029 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x5652d9055c00 con 0x5652d9e9c800 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.916+0000 7f74c9d67280 4 main: JournalTool: creating IoCtx.. 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.916+0000 7f74c9d67280 4 main: Executing for rank 0 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.917+0000 7f74c8800640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 0x5652d8fdd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.917+0000 7f74c9d67280 1 -- start start 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.917+0000 7f74c9d67280 1 Processor -- start 2024-04-24T23:01:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c8800640 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 0x5652d8fdd700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5652d9d6e600 tx=0x5652d9e54c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9d000 0x5652d8fdc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 0x5652d8fdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9eb1800 0x5652d8fdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd2900 con 0x5652d9eb1400 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5652d9cd3680 con 0x5652d9e9d000 2024-04-24T23:01:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.918+0000 7f74c9d67280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5652d8fd0900 con 0x5652d9eb1800 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 0x5652d8fdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 0x5652d8fdbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33968/0 (socket says 172.21.15.146:33968) 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 learned_addr learned my addr 172.21.15.146:0/2984183807 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7400640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9eb1800 0x5652d8fdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9d000 0x5652d8fdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9eb1800 msgr2=0x5652d8fdb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9eb1800 0x5652d8fdb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9d000 msgr2=0x5652d8fdc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9d000 0x5652d8fdc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d8fa3c20 con 0x5652d9eb1400 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9d000 0x5652d8fdc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 0x5652d8fdbb80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5652d9295710 tx=0x5652d92db8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78089c4c9a7a16fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.919+0000 7f74bca00640 1 -- 172.21.15.146:0/2984183807 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d9ed6000 con 0x5652d9eb1400 2024-04-24T23:01:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74bca00640 1 -- 172.21.15.146:0/2984183807 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5652d8f9a700 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74bca00640 1 -- 172.21.15.146:0/2984183807 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5652d9ee3520 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d8fa2780 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5652d8fa3680 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 4 waiting for MDS map... 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74bca00640 1 -- 172.21.15.146:0/2984183807 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x5652d9333200 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74bca00640 1 -- 172.21.15.146:0/2984183807 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 18) ==== 3490+0+0 (secure 0 0 0) 0x5652d8fc9500 con 0x5652d9eb1400 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 4 Got MDS map 18 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5652d9eb1c00 0x5652d9352000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.920+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 5.f 5:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5652d9356000 con 0x5652d9eb1c00 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.921+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5652d9eb1c00 0x5652d9352000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.921+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5652d9eb1c00 0x5652d9352000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=c6555d340361e8f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.921+0000 7f74c8800640 1 -- 172.21.15.146:0/2984183807 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5652d906a000 con 0x5652d9eb1c00 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.922+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5652d9356400 0x5652d9352580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.922+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:2 5.14 5:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) -- 0x5652d9356800 con 0x5652d9356400 2024-04-24T23:01:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.922+0000 7f74c7400640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5652d9356400 0x5652d9352580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.923+0000 7f74c7400640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5652d9356400 0x5652d9352580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=4396e3e4403cd7d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.924+0000 7f74c7400640 1 -- 172.21.15.146:0/2984183807 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv3 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5652d906a500 con 0x5652d9356400 2024-04-24T23:01:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.924+0000 7f74bac00640 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 5.14 5:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42) -- 0x5652d9357c00 con 0x5652d9356400 2024-04-24T23:01:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.925+0000 7f74c7400640 1 -- 172.21.15.146:0/2984183807 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5652d906a500 con 0x5652d9356400 2024-04-24T23:01:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:old journal was 4194304~59737 2024-04-24T23:01:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:new journal start will be 8388608 (4134567 bytes past old end) 2024-04-24T23:01:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:writing journal head 2024-04-24T23:01:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.925+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 5.14 5:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d9356c00 con 0x5652d9356400 2024-04-24T23:01:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c7400640 1 -- 172.21.15.146:0/2984183807 <== osd.4 v2:172.21.15.203:6810/306347931 3 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v42'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5652d906a500 con 0x5652d9356400 2024-04-24T23:01:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:writing EResetJournal entry 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5652d9357000 0x5652d9352b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:5 5.1b 5:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d9357400 con 0x5652d9357000 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5652d9357800 0x5652d9353080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 5.b 5:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d936e000 con 0x5652d9357800 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:7 5.1f 5:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d936e400 con 0x5652d9357000 2024-04-24T23:01:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:8 5.1a 5:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d936e800 con 0x5652d9eb1c00 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5652d936ec00 0x5652d9353600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 5.1e 5:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d936f000 con 0x5652d936ec00 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:10 5.1d 5:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d936f400 con 0x5652d9356400 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.928+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5652d9357000 0x5652d9352b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.929+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5652d9357800 0x5652d9353080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.929+0000 7f74c7400640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5652d936ec00 0x5652d9353600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.929+0000 7f74c8800640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5652d9357000 0x5652d9352b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=9299f116a6e095ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.930+0000 7f74c7400640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5652d936ec00 0x5652d9353600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=a918e878a02d629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.930+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5652d9357800 0x5652d9353080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=bf7d4693f556f464 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.932+0000 7f74c8800640 1 -- 172.21.15.146:0/2984183807 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(5 200.00000002 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a000 con 0x5652d9357000 2024-04-24T23:01:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.933+0000 7f74c8800640 1 -- 172.21.15.146:0/2984183807 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(8 200.00000005 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a000 con 0x5652d9eb1c00 2024-04-24T23:01:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.933+0000 7f74c7400640 1 -- 172.21.15.146:0/2984183807 <== osd.4 v2:172.21.15.203:6810/306347931 4 ==== osd_op_reply(10 200.00000007 [delete] v42'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a500 con 0x5652d9356400 2024-04-24T23:01:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.934+0000 7f74c8800640 1 -- 172.21.15.146:0/2984183807 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(7 200.00000004 [delete] v42'49 uv48 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a000 con 0x5652d9357000 2024-04-24T23:01:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.934+0000 7f74c7400640 1 -- 172.21.15.146:0/2984183807 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 200.00000006 [delete] v42'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a500 con 0x5652d936ec00 2024-04-24T23:01:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.935+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(6 200.00000003 [delete] v42'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5652d906a780 con 0x5652d9357800 2024-04-24T23:01:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.935+0000 7f74bac00640 1 -- 172.21.15.146:0/2984183807 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:11 5.1b 5:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) -- 0x5652d9e9dc00 con 0x5652d9357000 2024-04-24T23:01:49.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c8800640 1 -- 172.21.15.146:0/2984183807 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(11 200.00000002 [write 0~48] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5652d906a000 con 0x5652d9357000 2024-04-24T23:01:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-04-24T23:01:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5652d9eb1c00 msgr2=0x5652d9352000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5652d9eb1c00 0x5652d9352000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5652d9357000 msgr2=0x5652d9352b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5652d9357000 0x5652d9352b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5652d9356400 msgr2=0x5652d9352580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5652d9356400 0x5652d9352580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5652d9357800 msgr2=0x5652d9353080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5652d9357800 0x5652d9353080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5652d936ec00 msgr2=0x5652d9353600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5652d936ec00 0x5652d9353600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 reap_dead start 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 reap_dead start 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 msgr2=0x5652d8fdbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2984183807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9eb1400 0x5652d8fdbb80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5652d9295710 tx=0x5652d92db8c0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c7e00640 1 -- 172.21.15.146:0/2984183807 reap_dead start 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 shutdown_connections 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.939+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 >> 172.21.15.146:0/2984183807 conn(0x5652d9e9cc00 msgr2=0x5652d907b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 shutdown_connections 2024-04-24T23:01:49.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2984183807 wait complete. 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 msgr2=0x5652d8fdd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 0x5652d8fdd700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5652d9d6e600 tx=0x5652d9e54c00 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 msgr2=0x5652d8fdc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5652d9cf0900 tx=0x5652d9d02d80 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 shutdown_connections 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d9e9c800 0x5652d8fdc680 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5652d9eb1000 0x5652d8fdd700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d9e9c400 0x5652d8fdcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2905947029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d9e9c000 0x5652d8fdd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 >> 172.21.15.146:0/2905947029 conn(0x5652d9d55c00 msgr2=0x5652d9079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 shutdown_connections 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.940+0000 7f74c9d67280 1 -- 172.21.15.146:0/2905947029 wait complete. 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 msgr2=0x5652d8fdab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5652d9d8eba0 tx=0x5652d9d02cc0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 shutdown_connections 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5652d8f6fc00 0x5652d8fdb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652d8f6f800 0x5652d8fdab00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 --2- 172.21.15.146:0/2039948143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5652d8f6ec00 0x5652d8fda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 >> 172.21.15.146:0/2039948143 conn(0x5652d8f6f000 msgr2=0x5652d9079000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 shutdown_connections 2024-04-24T23:01:49.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:49.941+0000 7f74c9d67280 1 -- 172.21.15.146:0/2039948143 wait complete. 2024-04-24T23:01:49.948 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.126772, result: old journal was 4194304~59737 new journal start will be 8388608 (4134567 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-24T23:01:49.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-24T23:01:50.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.150+0000 7fba73000640 1 Processor -- start 2024-04-24T23:01:50.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.150+0000 7fba73000640 1 -- start start 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.151+0000 7fba73000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba6c13ef30 0x7fba6c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba73000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba6c141ab0 0x7fba6c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba73000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0ced40 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba73000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fba6c1423d0 con 0x7fba6c141ab0 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba73000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fba6c070f80 con 0x7fba6c13ef30 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba6c141ab0 0x7fba6c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba71000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fba6c0ce5a0 0x7fba6c15fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50046/0 (socket says 172.21.15.146:50046) 2024-04-24T23:01:50.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba71000640 1 -- 172.21.15.146:0/2626517090 learned_addr learned my addr 172.21.15.146:0/2626517090 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6be00640 1 --2- 172.21.15.146:0/2626517090 >> v2:172.21.15.203:3300/0 conn(0x7fba6c13ef30 0x7fba6c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6b400640 1 -- 172.21.15.146:0/2626517090 >> v2:172.21.15.203:3300/0 conn(0x7fba6c13ef30 msgr2=0x7fba6c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6b400640 1 --2- 172.21.15.146:0/2626517090 >> v2:172.21.15.203:3300/0 conn(0x7fba6c13ef30 0x7fba6c141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6b400640 1 -- 172.21.15.146:0/2626517090 >> v1:172.21.15.146:6789/0 conn(0x7fba6c0ce5a0 legacy=0x7fba6c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6b400640 1 -- 172.21.15.146:0/2626517090 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0cf020 con 0x7fba6c141ab0 2024-04-24T23:01:50.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.152+0000 7fba6aa00640 1 -- 172.21.15.146:0/2626517090 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029022331 0 0) 0x7fba6c0ced40 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba6b400640 1 --2- 172.21.15.146:0/2626517090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c141ab0 0x7fba6c0ce060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0707a0 tx=0x7fba5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2849d802eee2a67e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba6aa00640 1 -- 172.21.15.146:0/2626517090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54037070 con 0x7fba6c141ab0 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba6aa00640 1 -- 172.21.15.146:0/2626517090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba54032440 con 0x7fba6c141ab0 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba6aa00640 1 -- 172.21.15.146:0/2626517090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54032810 con 0x7fba6c141ab0 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba73000640 1 -- 172.21.15.146:0/2626517090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c141ab0 msgr2=0x7fba6c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.154+0000 7fba73000640 1 --2- 172.21.15.146:0/2626517090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c141ab0 0x7fba6c0ce060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0707a0 tx=0x7fba5402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 -- 172.21.15.146:0/2626517090 shutdown_connections 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 --2- 172.21.15.146:0/2626517090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c141ab0 0x7fba6c0ce060 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 --2- 172.21.15.146:0/2626517090 >> v2:172.21.15.203:3300/0 conn(0x7fba6c13ef30 0x7fba6c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 -- 172.21.15.146:0/2626517090 >> 172.21.15.146:0/2626517090 conn(0x7fba6c0b17b0 msgr2=0x7fba6c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 -- 172.21.15.146:0/2626517090 shutdown_connections 2024-04-24T23:01:50.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.155+0000 7fba73000640 1 -- 172.21.15.146:0/2626517090 wait complete. 2024-04-24T23:01:50.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.156+0000 7fba73000640 1 Processor -- start 2024-04-24T23:01:50.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 -- start start 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba6c13ef30 0x7fba6c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba6c141ab0 0x7fba6c1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0cea30 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c070c10 con 0x7fba6c141ab0 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.157+0000 7fba73000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c072420 con 0x7fba6c13ef30 2024-04-24T23:01:50.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33994/0 (socket says 172.21.15.146:33994) 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 -- 172.21.15.146:0/1087870446 learned_addr learned my addr 172.21.15.146:0/1087870446 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 -- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba6c13ef30 msgr2=0x7fba6c06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6b400640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba6c13ef30 0x7fba6c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba71000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba6c141ab0 0x7fba6c1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba6c13ef30 0x7fba6c06d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 -- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba6c141ab0 msgr2=0x7fba6c1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba6c141ab0 0x7fba6c1f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.158+0000 7fba6be00640 1 -- 172.21.15.146:0/1087870446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c15d010 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba6be00640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00ce10 tx=0x7fba5c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c003b90 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c003d30 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c004240 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c15cd30 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.159+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c159180 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.160+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c04f5a0 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.161+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba5c0043e0 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.162+0000 7fba63e00640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 0x7fba4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.162+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fba5c08bb20 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.163+0000 7fba6b400640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 0x7fba4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.164+0000 7fba6b400640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 0x7fba4806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba54034000 tx=0x7fba5402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.166+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba5c01d340 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.409+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fba6c072d30 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.499+0000 7fba63e00640 1 -- 172.21.15.146:0/1087870446 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v19) ==== 162+0+0 (secure 0 0 0) 0x7fba5c05a2f0 con 0x7fba6c0ce5a0 2024-04-24T23:01:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-24T23:01:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 msgr2=0x7fba4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 0x7fba4806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba54034000 tx=0x7fba5402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 msgr2=0x7fba6c15c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00ce10 tx=0x7fba5c00a660 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 shutdown_connections 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba6c141ab0 0x7fba6c1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba4806be30 0x7fba4806e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba6c13ef30 0x7fba6c06d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 --2- 172.21.15.146:0/1087870446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c0ce5a0 0x7fba6c15c220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 >> 172.21.15.146:0/1087870446 conn(0x7fba6c0b17b0 msgr2=0x7fba6c06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 shutdown_connections 2024-04-24T23:01:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.502+0000 7fba73000640 1 -- 172.21.15.146:0/1087870446 wait complete. 2024-04-24T23:01:50.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.702+0000 7f6029c00640 1 Processor -- start 2024-04-24T23:01:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.702+0000 7f6029c00640 1 -- start start 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6029c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6024071320 0x7f6024165c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6029c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60241449c0 con 0x7f60240d03a0 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6029c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6024071820 con 0x7f60241445e0 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6029c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6024072430 con 0x7f6024071320 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6023400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6024071320 0x7f6024165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6022000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f60240d03a0 0x7f6024070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50052/0 (socket says 172.21.15.146:50052) 2024-04-24T23:01:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.704+0000 7f6022000640 1 -- 172.21.15.146:0/1089595381 learned_addr learned my addr 172.21.15.146:0/1089595381 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:50.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.705+0000 7f6023400640 1 -- 172.21.15.146:0/1089595381 >> v1:172.21.15.203:6789/0 conn(0x7f60241445e0 legacy=0x7f60240cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.705+0000 7f6023400640 1 -- 172.21.15.146:0/1089595381 >> v1:172.21.15.146:6789/0 conn(0x7f60240d03a0 legacy=0x7f6024070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.705+0000 7f6023400640 1 -- 172.21.15.146:0/1089595381 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6024071b00 con 0x7f6024071320 2024-04-24T23:01:50.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.705+0000 7f6021600640 1 -- 172.21.15.146:0/1089595381 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76861672 0 0) 0x7f60241449c0 con 0x7f60240d03a0 2024-04-24T23:01:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.706+0000 7f6023400640 1 --2- 172.21.15.146:0/1089595381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f6024165c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9109fdaa09e6364 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.706+0000 7f6021600640 1 -- 172.21.15.146:0/1089595381 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c007740 con 0x7f6024071320 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.706+0000 7f6021600640 1 -- 172.21.15.146:0/1089595381 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c0078e0 con 0x7f6024071320 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.706+0000 7f6021600640 1 -- 172.21.15.146:0/1089595381 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c007cb0 con 0x7f6024071320 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 -- 172.21.15.146:0/1089595381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 msgr2=0x7f6024165c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 --2- 172.21.15.146:0/1089595381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f6024165c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c02a6f0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 -- 172.21.15.146:0/1089595381 shutdown_connections 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 --2- 172.21.15.146:0/1089595381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f6024165c40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 -- 172.21.15.146:0/1089595381 >> 172.21.15.146:0/1089595381 conn(0x7f602406b320 msgr2=0x7f602406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 -- 172.21.15.146:0/1089595381 shutdown_connections 2024-04-24T23:01:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.707+0000 7f6029c00640 1 -- 172.21.15.146:0/1089595381 wait complete. 2024-04-24T23:01:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.708+0000 7f6029c00640 1 Processor -- start 2024-04-24T23:01:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.709+0000 7f6029c00640 1 -- start start 2024-04-24T23:01:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.709+0000 7f6029c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6029c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 0x7f6024159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6029c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60241445e0 0x7f60240ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6029c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f60240720c0 con 0x7f6024071320 2024-04-24T23:01:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6029c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60240b2d70 con 0x7f60240d03a0 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6029c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f60240728c0 con 0x7f60241445e0 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34002/0 (socket says 172.21.15.146:34002) 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 -- 172.21.15.146:0/310737403 learned_addr learned my addr 172.21.15.146:0/310737403 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022000640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 0x7f6024159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 -- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60241445e0 msgr2=0x7f60240ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60241445e0 0x7f60240ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 -- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 msgr2=0x7f6024159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 0x7f6024159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022a00640 1 -- 172.21.15.146:0/310737403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602415dfb0 con 0x7f6024071320 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.710+0000 7f6022000640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 0x7f6024159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f6022a00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c400 tx=0x7f600c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c017070 con 0x7f6024071320 2024-04-24T23:01:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c0052d0 con 0x7f6024071320 2024-04-24T23:01:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c003830 con 0x7f6024071320 2024-04-24T23:01:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60241590c0 con 0x7f6024071320 2024-04-24T23:01:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.711+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6024159680 con 0x7f6024071320 2024-04-24T23:01:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.712+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6024068190 con 0x7f6024071320 2024-04-24T23:01:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.713+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f600c01a070 con 0x7f6024071320 2024-04-24T23:01:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.714+0000 7f601aa00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 0x7f600006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.714+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f600c08a420 con 0x7f6024071320 2024-04-24T23:01:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.715+0000 7f6022000640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 0x7f600006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:50.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.716+0000 7f6022000640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 0x7f600006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60240ad020 tx=0x7f6014009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.718+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f600c058b50 con 0x7f6024071320 2024-04-24T23:01:50.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.949+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6024070e60 con 0x7f6024071320 2024-04-24T23:01:50.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.951+0000 7f601aa00640 1 -- 172.21.15.146:0/310737403 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5181 (secure 0 0 0) 0x7f600c058450 con 0x7f6024071320 2024-04-24T23:01:50.953 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:01:50.506895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-24T23:01:50.953 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 20 2024-04-24T23:01:50.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 msgr2=0x7f600006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 0x7f600006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60240ad020 tx=0x7f6014009040 comp rx=0 tx=0).stop 2024-04-24T23:01:50.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 msgr2=0x7f602415d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:50.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c400 tx=0x7f600c00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 shutdown_connections 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f600006be30 0x7f600006e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60241445e0 0x7f60240ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60240d03a0 0x7f6024159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 --2- 172.21.15.146:0/310737403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6024071320 0x7f602415d8b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 >> 172.21.15.146:0/310737403 conn(0x7f602406b320 msgr2=0x7f602406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.953+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 shutdown_connections 2024-04-24T23:01:50.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:50.954+0000 7f6029c00640 1 -- 172.21.15.146:0/310737403 wait complete. 2024-04-24T23:01:51.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:01:34.503652+0000', 'modified': '2024-04-24T23:01:50.506895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5532': {'gid': 5532, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/4112366095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 4112366095}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 4112366095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-24T23:01:51.375 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5532:up:replay 2024-04-24T23:01:52.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.585+0000 7feec2200640 1 Processor -- start 2024-04-24T23:01:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.585+0000 7feec2200640 1 -- start start 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feec2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feebc145640 0x7feebc15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feec2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 0x7feebc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feec2200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc0cdf70 con 0x7feebc06cbc0 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feec2200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7feebc15d360 con 0x7feebc145640 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feec2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feebc145a20 con 0x7feebc0b2a20 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.586+0000 7feebb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feebc145640 0x7feebc15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebbe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feebc06cbc0 0x7feebc15f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50058/0 (socket says 172.21.15.146:50058) 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebbe00640 1 -- 172.21.15.146:0/2029668389 learned_addr learned my addr 172.21.15.146:0/2029668389 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feeb3e00640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 0x7feebc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebb400640 1 -- 172.21.15.146:0/2029668389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 msgr2=0x7feebc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebb400640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 0x7feebc0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebb400640 1 -- 172.21.15.146:0/2029668389 >> v1:172.21.15.146:6789/0 conn(0x7feebc06cbc0 legacy=0x7feebc15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feebb400640 1 -- 172.21.15.146:0/2029668389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc06d140 con 0x7feebc145640 2024-04-24T23:01:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.587+0000 7feeb3e00640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 0x7feebc0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.588+0000 7feebb400640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc145640 0x7feebc15ce20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097a0 tx=0x7feeac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcc8d76bd86e6cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.588+0000 7feebaa00640 1 -- 172.21.15.146:0/2029668389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac037070 con 0x7feebc145640 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.588+0000 7feebaa00640 1 -- 172.21.15.146:0/2029668389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac032440 con 0x7feebc145640 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.588+0000 7feebaa00640 1 -- 172.21.15.146:0/2029668389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac032810 con 0x7feebc145640 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 -- 172.21.15.146:0/2029668389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc145640 msgr2=0x7feebc15ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc145640 0x7feebc15ce20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097a0 tx=0x7feeac02a180 comp rx=0 tx=0).stop 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 -- 172.21.15.146:0/2029668389 shutdown_connections 2024-04-24T23:01:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc0b2a20 0x7feebc0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 --2- 172.21.15.146:0/2029668389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc145640 0x7feebc15ce20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 -- 172.21.15.146:0/2029668389 >> 172.21.15.146:0/2029668389 conn(0x7feebc06b320 msgr2=0x7feebc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 -- 172.21.15.146:0/2029668389 shutdown_connections 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.589+0000 7feec2200640 1 -- 172.21.15.146:0/2029668389 wait complete. 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.591+0000 7feec2200640 1 Processor -- start 2024-04-24T23:01:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.591+0000 7feec2200640 1 -- start start 2024-04-24T23:01:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc06cbc0 0x7feebc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feebc145640 0x7feebc14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feebc06d9e0 con 0x7feebc0b2a20 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feebc06d700 con 0x7feebc145640 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feec2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feebc0d01d0 con 0x7feebc06cbc0 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34016/0 (socket says 172.21.15.146:34016) 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 -- 172.21.15.146:0/3667387728 learned_addr learned my addr 172.21.15.146:0/3667387728 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feebbe00640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feebc145640 0x7feebc14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feebb400640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc06cbc0 0x7feebc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 -- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc06cbc0 msgr2=0x7feebc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc06cbc0 0x7feebc14cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 -- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feebc145640 msgr2=0x7feebc14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feebc145640 0x7feebc14b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.592+0000 7feeb3e00640 1 -- 172.21.15.146:0/3667387728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc14bac0 con 0x7feebc0b2a20 2024-04-24T23:01:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feeb3e00640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feea400c7f0 tx=0x7feea400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4015070 con 0x7feebc0b2a20 2024-04-24T23:01:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4007a30 con 0x7feebc0b2a20 2024-04-24T23:01:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4007e00 con 0x7feebc0b2a20 2024-04-24T23:01:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc14bda0 con 0x7feebc0b2a20 2024-04-24T23:01:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.593+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc14c360 con 0x7feebc0b2a20 2024-04-24T23:01:52.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.594+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feebc15d180 con 0x7feebc0b2a20 2024-04-24T23:01:52.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.595+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feea4018070 con 0x7feebc0b2a20 2024-04-24T23:01:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.596+0000 7feeb3400640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 0x7fee9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.596+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7feea408afe0 con 0x7feebc0b2a20 2024-04-24T23:01:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.597+0000 7feebb400640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 0x7fee9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.598+0000 7feebb400640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 0x7fee9806e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.601+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7feebc15d180 con 0x7feebc0b2a20 2024-04-24T23:01:52.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.836+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feebc0d05a0 con 0x7feebc0b2a20 2024-04-24T23:01:52.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.837+0000 7feeb3400640 1 -- 172.21.15.146:0/3667387728 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5181 (secure 0 0 0) 0x7feea4059730 con 0x7feebc0b2a20 2024-04-24T23:01:52.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:52.839 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:01:51.518863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-24T23:01:52.839 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.839+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 msgr2=0x7fee9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 0x7fee9806e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeac034000 tx=0x7feeac02e000 comp rx=0 tx=0).stop 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 msgr2=0x7feebc13b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feea400c7f0 tx=0x7feea400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 shutdown_connections 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feebc145640 0x7feebc14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feebc0b2a20 0x7feebc13b5c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fee9806be60 0x7fee9806e320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 --2- 172.21.15.146:0/3667387728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feebc06cbc0 0x7feebc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:52.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 >> 172.21.15.146:0/3667387728 conn(0x7feebc06b320 msgr2=0x7feebc0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:52.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 shutdown_connections 2024-04-24T23:01:52.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:52.840+0000 7feec2200640 1 -- 172.21.15.146:0/3667387728 wait complete. 2024-04-24T23:01:53.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:01:34.503652+0000', 'modified': '2024-04-24T23:01:51.518863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5532': {'gid': 5532, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.146:6835/4112366095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 4112366095}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 4112366095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-24T23:01:53.265 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5532:up:rejoin 2024-04-24T23:01:54.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:01:54.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.475+0000 7fcb59a00640 1 Processor -- start 2024-04-24T23:01:54.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.476+0000 7fcb59a00640 1 -- start start 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.477+0000 7fcb59a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb541616a0 0x7fcb540d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.477+0000 7fcb59a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 0x7fcb540d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb59a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb540d4be0 con 0x7fcb540d0770 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb59a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcb540b6bd0 con 0x7fcb541616a0 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb59a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb540cfe10 con 0x7fcb540cf9a0 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb541616a0 0x7fcb540d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb541616a0 0x7fcb540d46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34018/0 (socket says 172.21.15.146:34018) 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 -- 172.21.15.146:0/3947509990 learned_addr learned my addr 172.21.15.146:0/3947509990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 -- 172.21.15.146:0/3947509990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 msgr2=0x7fcb540d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb59000640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 0x7fcb540d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 0x7fcb540d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 -- 172.21.15.146:0/3947509990 >> v1:172.21.15.203:6789/0 conn(0x7fcb540d0770 legacy=0x7fcb540b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb53e00640 1 -- 172.21.15.146:0/3947509990 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb54161a80 con 0x7fcb541616a0 2024-04-24T23:01:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.478+0000 7fcb59000640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 0x7fcb540d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.479+0000 7fcb53e00640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541616a0 0x7fcb540d46a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb5408c330 tx=0x7fcb4402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a8d877df98ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.480+0000 7fcb52a00640 1 -- 172.21.15.146:0/3947509990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44036070 con 0x7fcb541616a0 2024-04-24T23:01:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.480+0000 7fcb52a00640 1 -- 172.21.15.146:0/3947509990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44031600 con 0x7fcb541616a0 2024-04-24T23:01:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.480+0000 7fcb52a00640 1 -- 172.21.15.146:0/3947509990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb440319d0 con 0x7fcb541616a0 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.480+0000 7fcb59a00640 1 -- 172.21.15.146:0/3947509990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541616a0 msgr2=0x7fcb540d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.480+0000 7fcb59a00640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541616a0 0x7fcb540d46a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb5408c330 tx=0x7fcb4402a570 comp rx=0 tx=0).stop 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 -- 172.21.15.146:0/3947509990 shutdown_connections 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb540cf9a0 0x7fcb540d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 --2- 172.21.15.146:0/3947509990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541616a0 0x7fcb540d46a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 -- 172.21.15.146:0/3947509990 >> 172.21.15.146:0/3947509990 conn(0x7fcb5409d000 msgr2=0x7fcb540d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 -- 172.21.15.146:0/3947509990 shutdown_connections 2024-04-24T23:01:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.481+0000 7fcb59a00640 1 -- 172.21.15.146:0/3947509990 wait complete. 2024-04-24T23:01:54.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.482+0000 7fcb59a00640 1 Processor -- start 2024-04-24T23:01:54.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.482+0000 7fcb59a00640 1 -- start start 2024-04-24T23:01:54.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb540cf9a0 0x7fcb5415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb541616a0 0x7fcb5409da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb540d2920 con 0x7fcb540d0770 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb540d2640 con 0x7fcb540cf9a0 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.483+0000 7fcb59a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb540d2c00 con 0x7fcb541616a0 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34034/0 (socket says 172.21.15.146:34034) 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 -- 172.21.15.146:0/2509979179 learned_addr learned my addr 172.21.15.146:0/2509979179 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53e00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb540cf9a0 0x7fcb5415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb59000640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb541616a0 0x7fcb5409da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 -- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb541616a0 msgr2=0x7fcb5409da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb541616a0 0x7fcb5409da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 -- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb540cf9a0 msgr2=0x7fcb5415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb540cf9a0 0x7fcb5415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 -- 172.21.15.146:0/2509979179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb540cc3c0 con 0x7fcb540d0770 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.484+0000 7fcb53400640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c430 tx=0x7fcb3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.485+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c011790 con 0x7fcb540d0770 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.485+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c017070 con 0x7fcb540d0770 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.485+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb540cc6a0 con 0x7fcb540d0770 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.485+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c011bb0 con 0x7fcb540d0770 2024-04-24T23:01:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.485+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb540cc0d0 con 0x7fcb540d0770 2024-04-24T23:01:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.486+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb540cc870 con 0x7fcb540d0770 2024-04-24T23:01:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.487+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb3c01c460 con 0x7fcb540d0770 2024-04-24T23:01:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.488+0000 7fcb4be00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 0x7fcb3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.488+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fcb3c08afa0 con 0x7fcb540d0770 2024-04-24T23:01:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.489+0000 7fcb53e00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 0x7fcb3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.490+0000 7fcb53e00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 0x7fcb3006e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb44033000 tx=0x7fcb44009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:54.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.492+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb3c0596d0 con 0x7fcb540d0770 2024-04-24T23:01:54.506 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:01:54.505+0000 7f7ae2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:01:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.733+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb54160ae0 con 0x7fcb540d0770 2024-04-24T23:01:54.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.734+0000 7fcb4be00640 1 -- 172.21.15.146:0/2509979179 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5188 (secure 0 0 0) 0x7fcb3c058fd0 con 0x7fcb540d0770 2024-04-24T23:01:54.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:54.736 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:01:53.530705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5532,"qdb_cluster":[5532]},"id":2}]} 2024-04-24T23:01:54.736 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 23 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 msgr2=0x7fcb3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 0x7fcb3006e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb44033000 tx=0x7fcb44009000 comp rx=0 tx=0).stop 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 msgr2=0x7fcb540c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c430 tx=0x7fcb3c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 shutdown_connections 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb3006be30 0x7fcb3006e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb541616a0 0x7fcb5409da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb540d0770 0x7fcb540c8280 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 --2- 172.21.15.146:0/2509979179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb540cf9a0 0x7fcb5415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 >> 172.21.15.146:0/2509979179 conn(0x7fcb5409d000 msgr2=0x7fcb540b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 shutdown_connections 2024-04-24T23:01:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:54.737+0000 7fcb59a00640 1 -- 172.21.15.146:0/2509979179 wait complete. 2024-04-24T23:01:55.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:01:34.503652+0000', 'modified': '2024-04-24T23:01:53.530705+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5532': {'gid': 5532, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6835/4112366095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 4112366095}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 4112366095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5532, 'qdb_cluster': [5532]} 2024-04-24T23:01:55.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:01:55.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:01:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.363+0000 7f478ae00640 1 Processor -- start 2024-04-24T23:01:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.363+0000 7f478ae00640 1 -- start start 2024-04-24T23:01:55.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.365+0000 7f478ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f478406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.365+0000 7f478ae00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4784142950 con 0x7f47840720d0 2024-04-24T23:01:55.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.365+0000 7f478ae00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4784071030 con 0x7f4784070ba0 2024-04-24T23:01:55.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.365+0000 7f478ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4784071c40 con 0x7f4784142570 2024-04-24T23:01:55.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.366+0000 7f4788e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f47840720d0 0x7f478415fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50062/0 (socket says 172.21.15.146:50062) 2024-04-24T23:01:55.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.366+0000 7f4788e00640 1 -- 172.21.15.146:0/415308912 learned_addr learned my addr 172.21.15.146:0/415308912 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:55.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.366+0000 7f4783e00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f478406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.366+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698101537 0 0) 0x7f4784142950 con 0x7f47840720d0 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.366+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4768003520 con 0x7f47840720d0 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1661686515 0 0) 0x7f4768003520 con 0x7f47840720d0 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 msgr2=0x7f478406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f478406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 >> v1:172.21.15.203:6789/0 conn(0x7f4784070ba0 legacy=0x7f478406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4784071310 con 0x7f47840720d0 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f477c0019f0 con 0x7f47840720d0 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 >> v1:172.21.15.146:6789/0 conn(0x7f47840720d0 legacy=0x7f478415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f47680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4768003f60 0x7f4768004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768004d40 0x7f47680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4784071c40 con 0x7f4768003f60 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f476800baa0 con 0x7f4768004d40 2024-04-24T23:01:55.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f476800bca0 con 0x7f4784142570 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4768003f60 0x7f4768004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783e00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f47680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4788e00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768004d40 0x7f47680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 -- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 msgr2=0x7f47680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f47680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 -- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768004d40 msgr2=0x7f47680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768004d40 0x7f47680051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.367+0000 7f4783400640 1 -- 172.21.15.146:0/415308912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4768003520 con 0x7f4768003f60 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.368+0000 7f4783e00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4784142570 0x7f47680039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f4783400640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4768003f60 0x7f4768004800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4770001750 tx=0x7f4768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4ca13802a9139a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770001370 con 0x7f4768003f60 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47700052d0 con 0x7f4768003f60 2024-04-24T23:01:55.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f4782a00640 1 -- 172.21.15.146:0/415308912 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477002abe0 con 0x7f4768003f60 2024-04-24T23:01:55.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f478ae00640 1 -- 172.21.15.146:0/415308912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4768003f60 msgr2=0x7f4768004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f478ae00640 1 --2- 172.21.15.146:0/415308912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4768003f60 0x7f4768004800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4770001750 tx=0x7f4768005830 comp rx=0 tx=0).stop 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f4788e00640 1 -- 172.21.15.146:0/415308912 reap_dead start 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f478ae00640 1 -- 172.21.15.146:0/415308912 shutdown_connections 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f478ae00640 1 -- 172.21.15.146:0/415308912 >> 172.21.15.146:0/415308912 conn(0x7f478406b140 msgr2=0x7f478406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.369+0000 7f478ae00640 1 -- 172.21.15.146:0/415308912 shutdown_connections 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.370+0000 7f478ae00640 1 -- 172.21.15.146:0/415308912 wait complete. 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.371+0000 7f478ae00640 1 Processor -- start 2024-04-24T23:01:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.371+0000 7f478ae00640 1 -- start start 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768003f60 0x7f47841f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 0x7f47840c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4784072c60 con 0x7f478413d3b0 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47840718d0 con 0x7f4768003f60 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.372+0000 7f478ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4784072de0 con 0x7f47840ca990 2024-04-24T23:01:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34042/0 (socket says 172.21.15.146:34042) 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 -- 172.21.15.146:0/3712133299 learned_addr learned my addr 172.21.15.146:0/3712133299 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4783e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768003f60 0x7f47841f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4783400640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 0x7f47840c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 -- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 msgr2=0x7f47840c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 0x7f47840c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 -- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768003f60 msgr2=0x7f47841f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768003f60 0x7f47841f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 -- 172.21.15.146:0/3712133299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47840c9630 con 0x7f478413d3b0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4783400640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 0x7f47840c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.373+0000 7f4788e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4784070960 tx=0x7f477c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.374+0000 7f477be00640 1 -- 172.21.15.146:0/3712133299 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c004d60 con 0x7f478413d3b0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.374+0000 7f477be00640 1 -- 172.21.15.146:0/3712133299 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c00bb80 con 0x7f478413d3b0 2024-04-24T23:01:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.374+0000 7f477be00640 1 -- 172.21.15.146:0/3712133299 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c007110 con 0x7f478413d3b0 2024-04-24T23:01:55.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.374+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47840c9910 con 0x7f478413d3b0 2024-04-24T23:01:55.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.374+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47840c9ed0 con 0x7f478413d3b0 2024-04-24T23:01:55.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.376+0000 7f477be00640 1 -- 172.21.15.146:0/3712133299 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f477c01b020 con 0x7f478413d3b0 2024-04-24T23:01:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.378+0000 7f477be00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 0x7f476406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.378+0000 7f477be00640 1 -- 172.21.15.146:0/3712133299 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f477c08b1b0 con 0x7f478413d3b0 2024-04-24T23:01:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.378+0000 7f478dc0e740 1 Processor -- start 2024-04-24T23:01:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.378+0000 7f4783e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 0x7f476406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 -- start start 2024-04-24T23:01:55.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db612300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5ca1f0 0x5598db610470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5598db4c9ed0 con 0x5598db5f4510 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5598db52cdf0 con 0x5598db5ca1f0 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.379+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5598db4d58d0 con 0x5598db611db0 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34044/0 (socket says 172.21.15.146:34044) 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 -- 172.21.15.146:0/3494945019 learned_addr learned my addr 172.21.15.146:0/3494945019 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783400640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db612300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4788e00640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5ca1f0 0x5598db610470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 -- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 msgr2=0x5598db612300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db612300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 -- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5ca1f0 msgr2=0x5598db610470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5ca1f0 0x5598db610470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 -- 172.21.15.146:0/3494945019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598db2412d0 con 0x5598db5f4510 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783400640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db612300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 0x7f476406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f47841f76f0 tx=0x7f4774008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.380+0000 7f4783e00640 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4774012c80 tx=0x7f477401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8739402b6264e3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.381+0000 7f4778c00640 1 -- 172.21.15.146:0/3494945019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477400f040 con 0x5598db5f4510 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.381+0000 7f4778c00640 1 -- 172.21.15.146:0/3494945019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774027070 con 0x5598db5f4510 2024-04-24T23:01:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.381+0000 7f4778c00640 1 -- 172.21.15.146:0/3494945019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774022440 con 0x5598db5f4510 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.381+0000 7f478dc0e740 1 -- 172.21.15.146:0/3494945019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 msgr2=0x5598db5f48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.381+0000 7f478dc0e740 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4774012c80 tx=0x7f477401d000 comp rx=0 tx=0).stop 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 -- 172.21.15.146:0/3494945019 shutdown_connections 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5ca1f0 0x5598db610470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db612300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 --2- 172.21.15.146:0/3494945019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db5f48f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 -- 172.21.15.146:0/3494945019 >> 172.21.15.146:0/3494945019 conn(0x5598db5c6b20 msgr2=0x5598db60f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 -- 172.21.15.146:0/3494945019 shutdown_connections 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 -- 172.21.15.146:0/3494945019 wait complete. 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.382+0000 7f478dc0e740 1 -- start start 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.383+0000 7f478dc0e740 1 Processor -- start 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db5f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db61fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5598db4e8d20 con 0x5598db611db0 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5598db528db0 con 0x5598db5f4510 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5598db5caf90 con 0x5598db61f650 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f478dc0e740 10 client.0 _ll_register_callbacks cb 0x5598db523f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34054/0 (socket says 172.21.15.146:34054) 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 -- 172.21.15.146:0/1292333315 learned_addr learned my addr 172.21.15.146:0/1292333315 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783e00640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db5f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4788e00640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db61fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 -- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 msgr2=0x5598db61fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db61fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 -- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 msgr2=0x5598db5f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db5f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.384+0000 7f4783400640 1 -- 172.21.15.146:0/1292333315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598db30b6b0 con 0x5598db611db0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f4783400640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4770001840 tx=0x7f4770001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67610b0a8ae2e84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f476d600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770040020 con 0x5598db611db0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f477002aba0 con 0x5598db611db0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4774027070 con 0x5598db611db0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f477004a050 con 0x5598db611db0 2024-04-24T23:01:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f478dc0e740 10 client.5649 fetch_fsmap learned FSMap version 23 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.385+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5598db5c3fc0 con 0x5598db611db0 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774027070 con 0x5598db611db0 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) ==== 3494+0+0 (secure 0 0 0) 0x7f477004d020 con 0x5598db611db0 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 10 client.5649 fetch_fsmap finished waiting for FSMap version 23 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 10 client.5649 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 20 client.5649 populate_metadata read hostname 'smithi146' 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db6233e0 0x5598db62e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 4 client.5649 mds_command: new command op to 5532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 --> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598db53a330 con 0x5598db6233e0 2024-04-24T23:01:55.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.386+0000 7f4783e00640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db6233e0 0x5598db62e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.387+0000 7f4783e00640 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db6233e0 0x5598db62e0b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e111ffd5454550c server_cookie=f3fe12298ac0cc4 in_seq=0 out_seq=0 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.387+0000 7f476d600640 10 client.5649 ms_handle_connect on v2:172.21.15.146:6833/4112366095 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f476d600640 1 -- 172.21.15.146:0/1292333315 <== mds.0 v2:172.21.15.146:6833/4112366095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5598db53a330 con 0x5598db6233e0 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f476d600640 10 client.5649 handle_command_reply: tid=0 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 client.5649 shutdown 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 msgr2=0x5598db5c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4770001840 tx=0x7f4770001190 comp rx=0 tx=0).stop 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 shutdown_connections 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db6233e0 0x5598db62e0b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db61fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db611db0 0x5598db5c3a80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 --2- 172.21.15.146:0/1292333315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db5f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f476d600640 0 client.5649 ms_handle_reset on v2:172.21.15.146:6833/4112366095 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 >> 172.21.15.146:0/1292333315 conn(0x5598db5ca1f0 msgr2=0x5598db60ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 shutdown_connections 2024-04-24T23:01:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 1 -- 172.21.15.146:0/1292333315 wait complete. 2024-04-24T23:01:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.388+0000 7f478dc0e740 20 client.5649 trim_cache size 0 max 16384 2024-04-24T23:01:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.408+0000 7f478dc0e740 1 Processor -- start 2024-04-24T23:01:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.408+0000 7f478dc0e740 1 -- start start 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db611db0 0x5598db612450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db612990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4784200530 con 0x5598db5f4510 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47841ff9e0 con 0x5598db611db0 2024-04-24T23:01:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.409+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f47841ffee0 con 0x5598db61f650 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34058/0 (socket says 172.21.15.146:34058) 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 -- 172.21.15.146:0/2808687747 learned_addr learned my addr 172.21.15.146:0/2808687747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783400640 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db611db0 0x5598db612450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4788e00640 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db612990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 -- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 msgr2=0x5598db612990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db612990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 -- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db611db0 msgr2=0x5598db612450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db611db0 0x5598db612450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 -- 172.21.15.146:0/2808687747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598db606200 con 0x5598db5f4510 2024-04-24T23:01:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.410+0000 7f4783e00640 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4774012640 tx=0x7f4774019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc335665ec2397e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f476fe00640 1 -- 172.21.15.146:0/2808687747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774034dc0 con 0x5598db5f4510 2024-04-24T23:01:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f476fe00640 1 -- 172.21.15.146:0/2808687747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774034070 con 0x5598db5f4510 2024-04-24T23:01:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f476fe00640 1 -- 172.21.15.146:0/2808687747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774034420 con 0x5598db5f4510 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 -- 172.21.15.146:0/2808687747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 msgr2=0x5598db604cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4774012640 tx=0x7f4774019040 comp rx=0 tx=0).stop 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 -- 172.21.15.146:0/2808687747 shutdown_connections 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db61f650 0x5598db612990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db611db0 0x5598db612450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 --2- 172.21.15.146:0/2808687747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db5f4510 0x5598db604cb0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 -- 172.21.15.146:0/2808687747 >> 172.21.15.146:0/2808687747 conn(0x5598db5ca1f0 msgr2=0x5598db5ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 -- 172.21.15.146:0/2808687747 shutdown_connections 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.411+0000 7f478dc0e740 1 -- 172.21.15.146:0/2808687747 wait complete. 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.412+0000 7f478dc0e740 1 -- start start 2024-04-24T23:01:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.412+0000 7f478dc0e740 1 Processor -- start 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db689e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db68dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5598db5f5940 con 0x5598db61f650 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5598db5f52e0 con 0x5598db5f4510 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5598db5e1f40 con 0x5598db611db0 2024-04-24T23:01:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f478dc0e740 10 client.0 _ll_register_callbacks cb 0x7f47680036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34066/0 (socket says 172.21.15.146:34066) 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 -- 172.21.15.146:0/4139257162 learned_addr learned my addr 172.21.15.146:0/4139257162 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4783400640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db68dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 -- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 msgr2=0x5598db68dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db68dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 -- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 msgr2=0x5598db689e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db689e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.414+0000 7f4788e00640 1 -- 172.21.15.146:0/4139257162 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598db604f00 con 0x5598db61f650 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f4788e00640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f477c059200 tx=0x7f477c058bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e369993d45f43e09 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c05d620 con 0x5598db61f650 2024-04-24T23:01:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f477c0594d0 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4774034070 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f477c061e50 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 10 client.5655 fetch_fsmap learned FSMap version 23 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5598db5c4d80 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4774034070 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) ==== 3494+0+0 (secure 0 0 0) 0x7f477c0619c0 con 0x5598db61f650 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 10 client.5655 fetch_fsmap finished waiting for FSMap version 23 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 10 client.5655 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.415+0000 7f478dc0e740 20 client.5655 populate_metadata read hostname 'smithi146' 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db5f79d0 0x5598db5f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f478dc0e740 4 client.5655 mds_command: new command op to 5532 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 --> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] -- command(tid 0: {"prefix": "status"}) -- 0x5598db534680 con 0x5598db5f79d0 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f4783e00640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db5f79d0 0x5598db5f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f4783e00640 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db5f79d0 0x5598db5f7db0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eacff9b4cce94eab server_cookie=943334ad0ac42491 in_seq=0 out_seq=0 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.416+0000 7f476d600640 10 client.5655 ms_handle_connect on v2:172.21.15.146:6833/4112366095 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f476d600640 1 -- 172.21.15.146:0/4139257162 <== mds.0 v2:172.21.15.146:6833/4112366095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5598db534680 con 0x5598db5f79d0 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f476d600640 10 client.5655 handle_command_reply: tid=0 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 client.5655 shutdown 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 msgr2=0x5598db612450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f477c059200 tx=0x7f477c058bd0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 shutdown_connections 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:6833/4112366095,v1:172.21.15.146:6835/4112366095] conn(0x5598db5f79d0 0x5598db5f7db0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5598db61f650 0x5598db612450 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5598db611db0 0x5598db68dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 --2- 172.21.15.146:0/4139257162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5598db5f4510 0x5598db689e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f476d600640 0 client.5655 ms_handle_reset on v2:172.21.15.146:6833/4112366095 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 >> 172.21.15.146:0/4139257162 conn(0x5598db5ca1f0 msgr2=0x5598db5cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 shutdown_connections 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 1 -- 172.21.15.146:0/4139257162 wait complete. 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.417+0000 7f478dc0e740 20 client.5655 trim_cache size 0 max 16384 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5532, 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:01:55.423 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.9072238029999999, 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 23, 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 42, 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 42, 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 6.8156395930000002 2024-04-24T23:01:55.424 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 msgr2=0x7f476406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 0x7f476406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f47841f76f0 tx=0x7f4774008040 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 msgr2=0x7f478413d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4784070960 tx=0x7f477c00b4a0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 shutdown_connections 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f478413d3b0 0x7f478413d860 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f476406be60 0x7f476406e320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f47840ca990 0x7f47840c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 --2- 172.21.15.146:0/3712133299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768003f60 0x7f47841f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 >> 172.21.15.146:0/3712133299 conn(0x7f478406b140 msgr2=0x7f4784142950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 shutdown_connections 2024-04-24T23:01:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.418+0000 7f478ae00640 1 -- 172.21.15.146:0/3712133299 wait complete. 2024-04-24T23:01:55.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:01:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.628+0000 7ff86da00640 1 Processor -- start 2024-04-24T23:01:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.628+0000 7ff86da00640 1 -- start start 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff86da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8680b2a20 0x7ff8680cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff86da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 0x7ff8680d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff86da00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8680cdf70 con 0x7ff868145640 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff86da00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff868145a20 con 0x7ff8680b2a20 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff86da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff86806d140 con 0x7ff86806cbc0 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff866000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8680b2a20 0x7ff8680cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff866000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8680b2a20 0x7ff8680cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34082/0 (socket says 172.21.15.146:34082) 2024-04-24T23:01:55.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.630+0000 7ff866000640 1 -- 172.21.15.146:0/3143975303 learned_addr learned my addr 172.21.15.146:0/3143975303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff867400640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 0x7ff8680d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff865600640 1 -- 172.21.15.146:0/3143975303 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486413906 0 0) 0x7ff8680cdf70 con 0x7ff868145640 2024-04-24T23:01:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff865600640 1 -- 172.21.15.146:0/3143975303 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff84c003520 con 0x7ff868145640 2024-04-24T23:01:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff866000640 1 -- 172.21.15.146:0/3143975303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 msgr2=0x7ff8680d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff866000640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 0x7ff8680d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.631+0000 7ff866000640 1 -- 172.21.15.146:0/3143975303 >> v1:172.21.15.203:6789/0 conn(0x7ff868145640 legacy=0x7ff86815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.632+0000 7ff866000640 1 -- 172.21.15.146:0/3143975303 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86806d420 con 0x7ff8680b2a20 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.632+0000 7ff867400640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 0x7ff8680d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff866000640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8680b2a20 0x7ff8680cfc90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345ed0cba8413657 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff865600640 1 -- 172.21.15.146:0/3143975303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854037070 con 0x7ff8680b2a20 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff865600640 1 -- 172.21.15.146:0/3143975303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff854032440 con 0x7ff8680b2a20 2024-04-24T23:01:55.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff865600640 1 -- 172.21.15.146:0/3143975303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540327f0 con 0x7ff8680b2a20 2024-04-24T23:01:55.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff86da00640 1 -- 172.21.15.146:0/3143975303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8680b2a20 msgr2=0x7ff8680cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.633+0000 7ff86da00640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8680b2a20 0x7ff8680cfc90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85402a250 comp rx=0 tx=0).stop 2024-04-24T23:01:55.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 -- 172.21.15.146:0/3143975303 shutdown_connections 2024-04-24T23:01:55.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff86806cbc0 0x7ff8680d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 --2- 172.21.15.146:0/3143975303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8680b2a20 0x7ff8680cfc90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 -- 172.21.15.146:0/3143975303 >> 172.21.15.146:0/3143975303 conn(0x7ff86806b320 msgr2=0x7ff86806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 -- 172.21.15.146:0/3143975303 shutdown_connections 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.634+0000 7ff86da00640 1 -- 172.21.15.146:0/3143975303 wait complete. 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.635+0000 7ff86da00640 1 Processor -- start 2024-04-24T23:01:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.636+0000 7ff86da00640 1 -- start start 2024-04-24T23:01:55.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8680b2a20 0x7ff86813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff868145640 0x7ff8681f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8680ce450 con 0x7ff86806cbc0 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff86806d9e0 con 0x7ff8680b2a20 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff86da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff8680ce5d0 con 0x7ff868145640 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34094/0 (socket says 172.21.15.146:34094) 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 -- 172.21.15.146:0/993130418 learned_addr learned my addr 172.21.15.146:0/993130418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866000640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8680b2a20 0x7ff86813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff867400640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff868145640 0x7ff8681f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 -- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff868145640 msgr2=0x7ff8681f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff868145640 0x7ff8681f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 -- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8680b2a20 msgr2=0x7ff86813ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.637+0000 7ff866a00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8680b2a20 0x7ff86813ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff866a00640 1 -- 172.21.15.146:0/993130418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff868139da0 con 0x7ff86806cbc0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff866a00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c430 tx=0x7ff85800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858017070 con 0x7ff86806cbc0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8580052f0 con 0x7ff86806cbc0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858003830 con 0x7ff86806cbc0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86813a080 con 0x7ff86806cbc0 2024-04-24T23:01:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.638+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86813a640 con 0x7ff86806cbc0 2024-04-24T23:01:55.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.640+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff868068190 con 0x7ff86806cbc0 2024-04-24T23:01:55.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.640+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff85801a070 con 0x7ff86806cbc0 2024-04-24T23:01:55.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.641+0000 7ff85ea00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 0x7ff84806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:55.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.641+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7ff85808a460 con 0x7ff86806cbc0 2024-04-24T23:01:55.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.642+0000 7ff866000640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 0x7ff84806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:55.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.643+0000 7ff866000640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 0x7ff84806e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff854034000 tx=0x7ff85402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.646+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff858058ce0 con 0x7ff86806cbc0 2024-04-24T23:01:55.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.885+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff86815b6d0 con 0x7ff86806cbc0 2024-04-24T23:01:55.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.886+0000 7ff85ea00640 1 -- 172.21.15.146:0/993130418 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7ff8580585e0 con 0x7ff86806cbc0 2024-04-24T23:01:55.888 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:01:55.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 msgr2=0x7ff84806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 0x7ff84806e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff854034000 tx=0x7ff85402e000 comp rx=0 tx=0).stop 2024-04-24T23:01:55.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 msgr2=0x7ff868159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:55.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c430 tx=0x7ff85800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 shutdown_connections 2024-04-24T23:01:55.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff84806be30 0x7ff84806e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff868145640 0x7ff8681f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8680b2a20 0x7ff86813ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 --2- 172.21.15.146:0/993130418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86806cbc0 0x7ff868159630 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:55.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 >> 172.21.15.146:0/993130418 conn(0x7ff86806b320 msgr2=0x7ff8680ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:55.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 shutdown_connections 2024-04-24T23:01:55.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:55.889+0000 7ff86da00640 1 -- 172.21.15.146:0/993130418 wait complete. 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:01:55.910 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:55.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:55.911 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:01:55.964 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:55.965 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:55.966 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42520sec preferred_lft 42520sec 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.967 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:01:55.968 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:01:55.969 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:01:55.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:55.969 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:01:56.048 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:01:56.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:56.052 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:01:56.101 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:01:56.101 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:01:56.102 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:01:56.102 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:01:56.102 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:01:56.102 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:01:56.102 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:01:56.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:01:56.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:01:56.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:01:56.103 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:01:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:01:56.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:56.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:56.317 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:01:56.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:01:56.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:01:56.363 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:56.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:56.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:01:56.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:01:56.496 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:56.549 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:01:56.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:01:56.550 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:56.604 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:01:56.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:56.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:56.731 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:56.731 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:01:56.769 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:01:56.769 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:01:56.769 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:01:56.769 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:01:56.770 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:01:56.771 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:01:56.772 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:01:56.772 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:01:56.772 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:01:56.772 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:01:56.778 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:01:56.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:56.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:56.853 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:01:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:01:56.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:01:56.965 INFO:teuthology.orchestra.run.smithi146.stdout:client4957 2024-04-24T23:01:56.965 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:56.965 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:57.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:57.018 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-04-24T23:01:57.118 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:01:57.117+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-04-24T23:01:57.126 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:01:57.124+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-04-24T23:01:57.127 INFO:teuthology.orchestra.run.smithi146.stdout:.: 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:linkdir 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:rootfile 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:subdir 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:./linkdir: 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:link2 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:link3 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:./subdir: 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:subdirfile 2024-04-24T23:01:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:subsubdir 2024-04-24T23:01:57.129 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:57.129 INFO:teuthology.orchestra.run.smithi146.stdout:./subdir/subsubdir: 2024-04-24T23:01:57.130 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:57.130 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:57.180 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:01:57.180 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:01:57.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:01:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.475+0000 7f0ab0a00640 1 Processor -- start 2024-04-24T23:01:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.475+0000 7f0ab0a00640 1 -- start start 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0ab0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0aac071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0ab0a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac0ccb10 con 0x7f0aac0d0240 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0ab0a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac06ddc0 con 0x7f0aac15a980 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0ab0a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac0aede0 con 0x7f0aac06d770 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0aa2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0aac0d0240 0x7f0aac0ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50074/0 (socket says 172.21.15.146:50074) 2024-04-24T23:01:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.477+0000 7f0aa2a00640 1 -- 172.21.15.146:0/3831374886 learned_addr learned my addr 172.21.15.146:0/3831374886 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344056170 0 0) 0x7f0a94001110 con 0x7f0aac0d0240 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aabe00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0aac071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a90005730 con 0x7f0aac0d0240 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054385023 0 0) 0x7f0a90005730 con 0x7f0aac0d0240 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 msgr2=0x7f0aac071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0aac071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 >> v1:172.21.15.203:6789/0 conn(0x7f0aac15a980 legacy=0x7f0aac0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac06e0a0 con 0x7f0aac0d0240 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f0a94001840 con 0x7f0aac0d0240 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 >> v1:172.21.15.146:6789/0 conn(0x7f0aac0d0240 legacy=0x7f0aac0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a90005bf0 0x7f0a90006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0a90006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a90006f50 0x7f0a900073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0aede0 con 0x7f0a90006f50 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9000de80 con 0x7f0a90005bf0 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.478+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9000e080 con 0x7f0aac06d770 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a90006f50 0x7f0a900073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aa2a00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0a90006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aab400640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a90005bf0 0x7f0a90006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 -- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 msgr2=0x7f0a90006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac06d770 0x7f0a90006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 -- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a90005bf0 msgr2=0x7f0a90006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a90005bf0 0x7f0a90006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.479+0000 7f0aabe00640 1 -- 172.21.15.146:0/3831374886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a90005730 con 0x7f0a90006f50 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.480+0000 7f0aabe00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a90006f50 0x7f0a900073d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400ba30 tx=0x7f0a90007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaa9ecd3697e1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.480+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4030070 con 0x7f0a90006f50 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.480+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa402ade0 con 0x7f0a90006f50 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0aaaa00640 1 -- 172.21.15.146:0/3831374886 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400b600 con 0x7f0a90006f50 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 -- 172.21.15.146:0/3831374886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a90006f50 msgr2=0x7f0a900073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/3831374886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a90006f50 0x7f0a900073d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400ba30 tx=0x7f0a90007a40 comp rx=0 tx=0).stop 2024-04-24T23:01:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0aabe00640 1 -- 172.21.15.146:0/3831374886 reap_dead start 2024-04-24T23:01:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 -- 172.21.15.146:0/3831374886 shutdown_connections 2024-04-24T23:01:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 -- 172.21.15.146:0/3831374886 >> 172.21.15.146:0/3831374886 conn(0x7f0aac06b320 msgr2=0x7f0aac06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 -- 172.21.15.146:0/3831374886 shutdown_connections 2024-04-24T23:01:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.481+0000 7f0ab0a00640 1 -- 172.21.15.146:0/3831374886 wait complete. 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.483+0000 7f0ab0a00640 1 Processor -- start 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.483+0000 7f0ab0a00640 1 -- start start 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac1f3e90 0x7f0aac1f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 0x7f0aac15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac15ad60 con 0x7f0aac148730 2024-04-24T23:01:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac06e660 con 0x7f0aac1f3710 2024-04-24T23:01:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0ab0a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac15aee0 con 0x7f0aac1f3e90 2024-04-24T23:01:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0aab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0aab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34112/0 (socket says 172.21.15.146:34112) 2024-04-24T23:01:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.484+0000 7f0aab400640 1 -- 172.21.15.146:0/2498741995 learned_addr learned my addr 172.21.15.146:0/2498741995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aa2a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac1f3e90 0x7f0aac1f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aabe00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 0x7f0aac15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 -- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac1f3e90 msgr2=0x7f0aac1f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac1f3e90 0x7f0aac1f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 -- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 msgr2=0x7f0aac15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 0x7f0aac15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 -- 172.21.15.146:0/2498741995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac15dd30 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aabe00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 0x7f0aac15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aab400640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e870 tx=0x7f0a9c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003b80 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c018070 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0050d0 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.485+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac15d490 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.486+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac15da50 con 0x7f0aac148730 2024-04-24T23:01:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.487+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac1f3b20 con 0x7f0aac148730 2024-04-24T23:01:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.488+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a9c005270 con 0x7f0aac148730 2024-04-24T23:01:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.489+0000 7f0aa3e00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 0x7f0a8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.489+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f0a9c08b040 con 0x7f0aac148730 2024-04-24T23:01:57.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.489+0000 7f0aa2a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 0x7f0a8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.490+0000 7f0aa2a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 0x7f0a8806e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a940012b0 tx=0x7f0a94004800 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.494+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0aac1f3b20 con 0x7f0aac148730 2024-04-24T23:01:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.698+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aac0aeb90 con 0x7f0aac148730 2024-04-24T23:01:57.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.701+0000 7f0aa3e00640 1 -- 172.21.15.146:0/2498741995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17095 (secure 0 0 0) 0x7f0a9c059810 con 0x7f0aac148730 2024-04-24T23:01:57.703 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:01:57.704 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:48.482746+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 msgr2=0x7f0a8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 0x7f0a8806e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a940012b0 tx=0x7f0a94004800 comp rx=0 tx=0).stop 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 msgr2=0x7f0aac0a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e870 tx=0x7f0a9c00ed30 comp rx=0 tx=0).stop 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 shutdown_connections 2024-04-24T23:01:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aac1f3710 0x7f0aac15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a8806be30 0x7f0a8806e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0aac1f3e90 0x7f0aac1f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 --2- 172.21.15.146:0/2498741995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac148730 0x7f0aac0a94b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 >> 172.21.15.146:0/2498741995 conn(0x7f0aac06b320 msgr2=0x7f0aac159080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 shutdown_connections 2024-04-24T23:01:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.704+0000 7f0ab0a00640 1 -- 172.21.15.146:0/2498741995 wait complete. 2024-04-24T23:01:57.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:01:32.305853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:01:33.507733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:01:57.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:01:57.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.929+0000 7f2346800640 1 Processor -- start 2024-04-24T23:01:57.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.929+0000 7f2346800640 1 -- start start 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2346800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f234015cd60 0x7f23400cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2346800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400b4df0 con 0x7f234015bcd0 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2346800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400b4b10 con 0x7f23400d0200 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2346800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f234015c8d0 con 0x7f234015cd60 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2345400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f234015bcd0 0x7f23400cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53912/0 (socket says 172.21.15.146:53912) 2024-04-24T23:01:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.931+0000 7f2345400640 1 -- 172.21.15.146:0/3670548809 learned_addr learned my addr 172.21.15.146:0/3670548809 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:57.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058391166 0 0) 0x7f23400b4df0 con 0x7f234015bcd0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f2344a00640 1 --2- 172.21.15.146:0/3670548809 >> v2:172.21.15.203:3300/0 conn(0x7f234015cd60 0x7f23400cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2328003520 con 0x7f234015bcd0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2563957766 0 0) 0x7f2328003520 con 0x7f234015bcd0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 >> v2:172.21.15.203:3300/0 conn(0x7f234015cd60 msgr2=0x7f23400cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 --2- 172.21.15.146:0/3670548809 >> v2:172.21.15.203:3300/0 conn(0x7f234015cd60 0x7f23400cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 >> v1:172.21.15.203:6789/0 conn(0x7f23400d0200 legacy=0x7f234015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234015c280 con 0x7f234015bcd0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f2334001670 con 0x7f234015bcd0 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 >> v1:172.21.15.146:6789/0 conn(0x7f234015bcd0 legacy=0x7f23400cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.932+0000 7f233fe00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 0x7f2328003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f233fe00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2328004800 0x7f2328004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f233fe00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23280051c0 0x7f232800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f234015c8d0 con 0x7f2328003a00 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f232800c0c0 con 0x7f23280051c0 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f232800c2c0 con 0x7f2328004800 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 0x7f2328003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2344a00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2328004800 0x7f2328004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345e00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23280051c0 0x7f232800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 -- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2328004800 msgr2=0x7f2328004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2328004800 0x7f2328004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 -- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23280051c0 msgr2=0x7f232800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23280051c0 0x7f232800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345400640 1 -- 172.21.15.146:0/3670548809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2328003520 con 0x7f2328003a00 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345e00640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23280051c0 0x7f232800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.933+0000 7f2345e00640 1 -- 172.21.15.146:0/3670548809 reap_dead start 2024-04-24T23:01:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.935+0000 7f2345400640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 0x7f2328003e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f233400c190 tx=0x7f2328005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9f78063484c8ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.935+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334007c60 con 0x7f2328003a00 2024-04-24T23:01:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.935+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2334005af0 con 0x7f2328003a00 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.935+0000 7f233fe00640 1 -- 172.21.15.146:0/3670548809 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334007070 con 0x7f2328003a00 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 -- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 msgr2=0x7f2328003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 0x7f2328003e20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f233400c190 tx=0x7f2328005830 comp rx=0 tx=0).stop 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 -- 172.21.15.146:0/3670548809 shutdown_connections 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 --2- 172.21.15.146:0/3670548809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2328003a00 0x7f2328003e20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 -- 172.21.15.146:0/3670548809 >> 172.21.15.146:0/3670548809 conn(0x7f234006b560 msgr2=0x7f234006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 -- 172.21.15.146:0/3670548809 shutdown_connections 2024-04-24T23:01:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.936+0000 7f2346800640 1 -- 172.21.15.146:0/3670548809 wait complete. 2024-04-24T23:01:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.938+0000 7f2346800640 1 Processor -- start 2024-04-24T23:01:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.938+0000 7f2346800640 1 -- start start 2024-04-24T23:01:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2328003a00 0x7f23401f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23401431b0 0x7f234015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23400b4790 con 0x7f234015e740 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f234006e590 con 0x7f2328003a00 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2346800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f23400cfcc0 con 0x7f23401431b0 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2345e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2345e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40352/0 (socket says 172.21.15.146:40352) 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.939+0000 7f2345e00640 1 -- 172.21.15.146:0/2459688987 learned_addr learned my addr 172.21.15.146:0/2459688987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345400640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2328003a00 0x7f23401f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2344a00640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23401431b0 0x7f234015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 -- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23401431b0 msgr2=0x7f234015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23401431b0 0x7f234015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 -- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2328003a00 msgr2=0x7f23401f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2328003a00 0x7f23401f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 -- 172.21.15.146:0/2459688987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234015ec80 con 0x7f234015e740 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2345e00640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2340160780 tx=0x7f233800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338018070 con 0x7f234015e740 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2338003da0 con 0x7f234015e740 2024-04-24T23:01:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23380052b0 con 0x7f234015e740 2024-04-24T23:01:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.940+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23401f5400 con 0x7f234015e740 2024-04-24T23:01:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.941+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234015ef60 con 0x7f234015e740 2024-04-24T23:01:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.942+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234004f500 con 0x7f234015e740 2024-04-24T23:01:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.943+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f233801b070 con 0x7f234015e740 2024-04-24T23:01:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.944+0000 7f233d600640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.944+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f233808a610 con 0x7f234015e740 2024-04-24T23:01:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.944+0000 7f2345400640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:57.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.945+0000 7f2345400640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f233400c160 tx=0x7f2334009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:57.949+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2338058e70 con 0x7f234015e740 2024-04-24T23:01:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.150+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f234006e140 con 0x7f234015e740 2024-04-24T23:01:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.151+0000 7f233d600640 1 -- 172.21.15.146:0/2459688987 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f2338058770 con 0x7f234015e740 2024-04-24T23:01:58.153 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 msgr2=0x7f232006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f233400c160 tx=0x7f2334009030 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 msgr2=0x7f234015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2340160780 tx=0x7f233800d9d0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 shutdown_connections 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.153+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f234015e740 0x7f234015a690 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f23401431b0 0x7f234015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 --2- 172.21.15.146:0/2459688987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2328003a00 0x7f23401f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 >> 172.21.15.146:0/2459688987 conn(0x7f234006b560 msgr2=0x7f2340158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 shutdown_connections 2024-04-24T23:01:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.154+0000 7f2346800640 1 -- 172.21.15.146:0/2459688987 wait complete. 2024-04-24T23:01:58.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:01:58.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.378+0000 7f6694200640 1 Processor -- start 2024-04-24T23:01:58.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.379+0000 7f6694200640 1 -- start start 2024-04-24T23:01:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.380+0000 7f6694200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f668c0729b0 0x7f668c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.380+0000 7f6694200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f668c0b3a30 0x7f668c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.380+0000 7f6694200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668c072040 con 0x7f668c15be70 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.380+0000 7f6694200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f668c06e3c0 con 0x7f668c0729b0 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.380+0000 7f6694200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f668c0b4380 con 0x7f668c0b3a30 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6691800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f668c15be70 0x7f668c06e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53914/0 (socket says 172.21.15.146:53914) 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6691800640 1 -- 172.21.15.146:0/4042799471 learned_addr learned my addr 172.21.15.146:0/4042799471 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6690e00640 1 --2- 172.21.15.146:0/4042799471 >> v2:172.21.15.146:3300/0 conn(0x7f668c0729b0 0x7f668c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6692200640 1 --2- 172.21.15.146:0/4042799471 >> v2:172.21.15.203:3300/0 conn(0x7f668c0b3a30 0x7f668c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f668be00640 1 -- 172.21.15.146:0/4042799471 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592732212 0 0) 0x7f668c072040 con 0x7f668c15be70 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f668be00640 1 -- 172.21.15.146:0/4042799471 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674003520 con 0x7f668c15be70 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6690e00640 1 -- 172.21.15.146:0/4042799471 >> v2:172.21.15.203:3300/0 conn(0x7f668c0b3a30 msgr2=0x7f668c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6690e00640 1 --2- 172.21.15.146:0/4042799471 >> v2:172.21.15.203:3300/0 conn(0x7f668c0b3a30 0x7f668c0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6690e00640 1 -- 172.21.15.146:0/4042799471 >> v1:172.21.15.146:6789/0 conn(0x7f668c15be70 legacy=0x7f668c06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.381+0000 7f6690e00640 1 -- 172.21.15.146:0/4042799471 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c06ddb0 con 0x7f668c0729b0 2024-04-24T23:01:58.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.382+0000 7f6690e00640 1 --2- 172.21.15.146:0/4042799471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0729b0 0x7f668c0cc9a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f668c072210 tx=0x7f667802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9026ed3696a5d4a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f668be00640 1 -- 172.21.15.146:0/4042799471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678037070 con 0x7f668c0729b0 2024-04-24T23:01:58.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f668be00640 1 -- 172.21.15.146:0/4042799471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6678032440 con 0x7f668c0729b0 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f668be00640 1 -- 172.21.15.146:0/4042799471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667802ae60 con 0x7f668c0729b0 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 -- 172.21.15.146:0/4042799471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0729b0 msgr2=0x7f668c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 --2- 172.21.15.146:0/4042799471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0729b0 0x7f668c0cc9a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f668c072210 tx=0x7f667802a110 comp rx=0 tx=0).stop 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 -- 172.21.15.146:0/4042799471 shutdown_connections 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 --2- 172.21.15.146:0/4042799471 >> v2:172.21.15.203:3300/0 conn(0x7f668c0b3a30 0x7f668c0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 --2- 172.21.15.146:0/4042799471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0729b0 0x7f668c0cc9a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 -- 172.21.15.146:0/4042799471 >> 172.21.15.146:0/4042799471 conn(0x7f668c0b2730 msgr2=0x7f668c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 -- 172.21.15.146:0/4042799471 shutdown_connections 2024-04-24T23:01:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.383+0000 7f6694200640 1 -- 172.21.15.146:0/4042799471 wait complete. 2024-04-24T23:01:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.385+0000 7f6694200640 1 Processor -- start 2024-04-24T23:01:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.385+0000 7f6694200640 1 -- start start 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f668c0729b0 0x7f668c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f668c15be70 0x7f668c1f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f668c06e050 con 0x7f668c0b3a30 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f668c0cd0f0 con 0x7f668c0729b0 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.386+0000 7f6694200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f668c15c250 con 0x7f668c15be70 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40370/0 (socket says 172.21.15.146:40370) 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 -- 172.21.15.146:0/1166526745 learned_addr learned my addr 172.21.15.146:0/1166526745 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 -- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f668c15be70 msgr2=0x7f668c1f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f668c15be70 0x7f668c1f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 -- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f668c0729b0 msgr2=0x7f668c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f668c0729b0 0x7f668c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 -- 172.21.15.146:0/1166526745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c0c8340 con 0x7f668c0b3a30 2024-04-24T23:01:58.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6690e00640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6678000c00 tx=0x7f66780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678037040 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.387+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6678042070 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.388+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678030920 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.388+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c0ce8e0 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.388+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c0ceea0 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.389+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668c04f570 con 0x7f668c0b3a30 2024-04-24T23:01:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.390+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6678030ac0 con 0x7f668c0b3a30 2024-04-24T23:01:58.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.390+0000 7f6689600640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 0x7f666c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.391+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f66780ab920 con 0x7f668c0b3a30 2024-04-24T23:01:58.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.391+0000 7f6691800640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 0x7f666c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.392+0000 7f6691800640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 0x7f666c06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f60 tx=0x7f66800078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.395+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f667807a200 con 0x7f668c0b3a30 2024-04-24T23:01:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.577+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f668c15ae00 con 0x7f668c0b3a30 2024-04-24T23:01:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.578+0000 7f6689600640 1 -- 172.21.15.146:0/1166526745 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f6678079b00 con 0x7f668c0b3a30 2024-04-24T23:01:58.580 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 msgr2=0x7f666c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 0x7f666c06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f60 tx=0x7f66800078f0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 msgr2=0x7f668c1f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6678000c00 tx=0x7f66780046c0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 shutdown_connections 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.580+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f666c06be30 0x7f666c06e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f668c15be70 0x7f668c1f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f668c0b3a30 0x7f668c1f4840 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 --2- 172.21.15.146:0/1166526745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f668c0729b0 0x7f668c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 >> 172.21.15.146:0/1166526745 conn(0x7f668c0b2730 msgr2=0x7f668c0b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 shutdown_connections 2024-04-24T23:01:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.581+0000 7f6694200640 1 -- 172.21.15.146:0/1166526745 wait complete. 2024-04-24T23:01:58.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:01:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.789+0000 7f0141400640 1 Processor -- start 2024-04-24T23:01:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.789+0000 7f0141400640 1 -- start start 2024-04-24T23:01:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f0141400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c06dd80 0x7f013c06e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f0141400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f013c06eb60 0x7f013c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f0141400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013c15e3f0 con 0x7f013c15e010 2024-04-24T23:01:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f0141400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f013c06cd20 con 0x7f013c06eb60 2024-04-24T23:01:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f0141400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f013c06e200 con 0x7f013c06dd80 2024-04-24T23:01:58.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f013b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f013c06eb60 0x7f013c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.791+0000 7f013b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f013c06eb60 0x7f013c0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40380/0 (socket says 172.21.15.146:40380) 2024-04-24T23:01:58.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.792+0000 7f013b200640 1 -- 172.21.15.146:0/3240516324 learned_addr learned my addr 172.21.15.146:0/3240516324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:58.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.792+0000 7f013b200640 1 -- 172.21.15.146:0/3240516324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c06dd80 msgr2=0x7f013c06e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:58.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.792+0000 7f013b200640 1 --2- 172.21.15.146:0/3240516324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c06dd80 0x7f013c06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.792+0000 7f013b200640 1 -- 172.21.15.146:0/3240516324 >> v1:172.21.15.203:6789/0 conn(0x7f013c15e010 legacy=0x7f013c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:58.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.792+0000 7f013b200640 1 -- 172.21.15.146:0/3240516324 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c15f440 con 0x7f013c06eb60 2024-04-24T23:01:58.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.793+0000 7f013b200640 1 --2- 172.21.15.146:0/3240516324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c0b3810 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0134009e50 tx=0x7f013402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0321facf4b51edf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.793+0000 7f0139e00640 1 -- 172.21.15.146:0/3240516324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134036070 con 0x7f013c06eb60 2024-04-24T23:01:58.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0139e00640 1 -- 172.21.15.146:0/3240516324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0134031600 con 0x7f013c06eb60 2024-04-24T23:01:58.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0139e00640 1 -- 172.21.15.146:0/3240516324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01340319d0 con 0x7f013c06eb60 2024-04-24T23:01:58.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 -- 172.21.15.146:0/3240516324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 msgr2=0x7f013c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 --2- 172.21.15.146:0/3240516324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c0b3810 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0134009e50 tx=0x7f013402a6c0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 -- 172.21.15.146:0/3240516324 shutdown_connections 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 --2- 172.21.15.146:0/3240516324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c0b3810 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 --2- 172.21.15.146:0/3240516324 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c06dd80 0x7f013c06e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 -- 172.21.15.146:0/3240516324 >> 172.21.15.146:0/3240516324 conn(0x7f013c0b17b0 msgr2=0x7f013c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 -- 172.21.15.146:0/3240516324 shutdown_connections 2024-04-24T23:01:58.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.794+0000 7f0141400640 1 -- 172.21.15.146:0/3240516324 wait complete. 2024-04-24T23:01:58.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.796+0000 7f0141400640 1 Processor -- start 2024-04-24T23:01:58.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.796+0000 7f0141400640 1 -- start start 2024-04-24T23:01:58.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 0x7f013c1e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 0x7f013c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f013c06d2a0 con 0x7f013c06eb60 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f013c06cfc0 con 0x7f013c06dd80 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.797+0000 7f0141400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f013c06d580 con 0x7f013c15e010 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40382/0 (socket says 172.21.15.146:40382) 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 -- 172.21.15.146:0/997248418 learned_addr learned my addr 172.21.15.146:0/997248418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f013b200640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 0x7f013c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f013a800640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 0x7f013c1e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 -- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 msgr2=0x7f013c1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 0x7f013c1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 -- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 msgr2=0x7f013c1e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 0x7f013c1e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:58.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 -- 172.21.15.146:0/997248418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c0cd1c0 con 0x7f013c06eb60 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f013a800640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 0x7f013c1e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f013b200640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 0x7f013c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.798+0000 7f0131e00640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f012400b410 tx=0x7f012400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.799+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124015020 con 0x7f013c06eb60 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.799+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0124011850 con 0x7f013c06eb60 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.799+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124011c40 con 0x7f013c06eb60 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.799+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c1e8390 con 0x7f013c06eb60 2024-04-24T23:01:58.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.799+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c0cd460 con 0x7f013c06eb60 2024-04-24T23:01:58.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.800+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c04f5a0 con 0x7f013c06eb60 2024-04-24T23:01:58.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.801+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0124018020 con 0x7f013c06eb60 2024-04-24T23:01:58.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.802+0000 7f0133400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 0x7f011806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:58.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.802+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f012408aef0 con 0x7f013c06eb60 2024-04-24T23:01:58.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.803+0000 7f013a800640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 0x7f011806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:58.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.804+0000 7f013a800640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 0x7f011806e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f012c007fd0 tx=0x7f012c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:58.807+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f012401f020 con 0x7f013c06eb60 2024-04-24T23:01:59.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.005+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f013c0b1520 con 0x7f013c06eb60 2024-04-24T23:01:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.005+0000 7f0133400640 1 -- 172.21.15.146:0/997248418 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7f01240172c0 con 0x7f013c06eb60 2024-04-24T23:01:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 msgr2=0x7f011806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 0x7f011806e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f012c007fd0 tx=0x7f012c009040 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 msgr2=0x7f013c159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f012400b410 tx=0x7f012400b8d0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 shutdown_connections 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f011806be60 0x7f011806e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f013c15e010 0x7f013c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f013c06eb60 0x7f013c159640 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 --2- 172.21.15.146:0/997248418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f013c06dd80 0x7f013c1e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 >> 172.21.15.146:0/997248418 conn(0x7f013c0b17b0 msgr2=0x7f013c0cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 shutdown_connections 2024-04-24T23:01:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.008+0000 7f0141400640 1 -- 172.21.15.146:0/997248418 wait complete. 2024-04-24T23:01:59.029 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:01:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.233+0000 7fb37be00640 1 Processor -- start 2024-04-24T23:01:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.233+0000 7fb37be00640 1 -- start start 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb37be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb37415abb0 0x7fb37406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb37be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb374071960 con 0x7fb37415e8b0 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb37be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb374071c40 con 0x7fb37415f3f0 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb37be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb374071f20 con 0x7fb37415abb0 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb379400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb37415abb0 0x7fb37406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb378a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb37415e8b0 0x7fb37415ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53916/0 (socket says 172.21.15.146:53916) 2024-04-24T23:01:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb378a00640 1 -- 172.21.15.146:0/3868855887 learned_addr learned my addr 172.21.15.146:0/3868855887 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:59.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb379400640 1 -- 172.21.15.146:0/3868855887 >> v1:172.21.15.203:6789/0 conn(0x7fb37415f3f0 legacy=0x7fb37415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:59.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb379400640 1 -- 172.21.15.146:0/3868855887 >> v1:172.21.15.146:6789/0 conn(0x7fb37415e8b0 legacy=0x7fb37415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.235+0000 7fb379400640 1 -- 172.21.15.146:0/3868855887 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb374072200 con 0x7fb37415abb0 2024-04-24T23:01:59.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.237+0000 7fb379400640 1 --2- 172.21.15.146:0/3868855887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415abb0 0x7fb37406cbc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb3600097a0 tx=0x7fb36002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91db11894387bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.237+0000 7fb373e00640 1 -- 172.21.15.146:0/3868855887 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360037070 con 0x7fb37415abb0 2024-04-24T23:01:59.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.237+0000 7fb373e00640 1 -- 172.21.15.146:0/3868855887 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360032440 con 0x7fb37415abb0 2024-04-24T23:01:59.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.237+0000 7fb373e00640 1 -- 172.21.15.146:0/3868855887 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360032810 con 0x7fb37415abb0 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 -- 172.21.15.146:0/3868855887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415abb0 msgr2=0x7fb37406cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 --2- 172.21.15.146:0/3868855887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415abb0 0x7fb37406cbc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb3600097a0 tx=0x7fb36002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 -- 172.21.15.146:0/3868855887 shutdown_connections 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 --2- 172.21.15.146:0/3868855887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415abb0 0x7fb37406cbc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 -- 172.21.15.146:0/3868855887 >> 172.21.15.146:0/3868855887 conn(0x7fb37406b140 msgr2=0x7fb37406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 -- 172.21.15.146:0/3868855887 shutdown_connections 2024-04-24T23:01:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.238+0000 7fb37be00640 1 -- 172.21.15.146:0/3868855887 wait complete. 2024-04-24T23:01:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.240+0000 7fb37be00640 1 Processor -- start 2024-04-24T23:01:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.240+0000 7fb37be00640 1 -- start start 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb37415abb0 0x7fb374157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb37415f3f0 0x7fb37414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb37415c120 con 0x7fb37415e8b0 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb37415bfa0 con 0x7fb37415abb0 2024-04-24T23:01:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb37be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb37415cec0 con 0x7fb37415f3f0 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40404/0 (socket says 172.21.15.146:40404) 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 -- 172.21.15.146:0/1575284083 learned_addr learned my addr 172.21.15.146:0/1575284083 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 -- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb37415f3f0 msgr2=0x7fb37414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb37415f3f0 0x7fb37414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 -- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb37415abb0 msgr2=0x7fb374157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb37415abb0 0x7fb374157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.241+0000 7fb378a00640 1 -- 172.21.15.146:0/1575284083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3741517c0 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb378a00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb36800cb10 tx=0x7fb36800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368017070 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36800ac70 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368012620 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb374151f70 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.242+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb374152530 con 0x7fb37415e8b0 2024-04-24T23:01:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.243+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37404f5a0 con 0x7fb37415e8b0 2024-04-24T23:01:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.244+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb36801a070 con 0x7fb37415e8b0 2024-04-24T23:01:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.245+0000 7fb371600640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 0x7fb35406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.245+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fb36808adc0 con 0x7fb37415e8b0 2024-04-24T23:01:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.246+0000 7fb379400640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 0x7fb35406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.247+0000 7fb379400640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 0x7fb35406e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.249+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb368059590 con 0x7fb37415e8b0 2024-04-24T23:01:59.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.460+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb3740cdfd0 con 0x7fb37415e8b0 2024-04-24T23:01:59.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.461+0000 7fb371600640 1 -- 172.21.15.146:0/1575284083 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+122 (secure 0 0 0) 0x7fb368058e90 con 0x7fb37415e8b0 2024-04-24T23:01:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6835/784142616 2024-04-25T23:01:48.482719+0000 2024-04-24T23:01:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6833/784142616 2024-04-25T23:01:48.482719+0000 2024-04-24T23:01:59.464 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-04-24T23:01:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 msgr2=0x7fb35406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 0x7fb35406e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002c000 comp rx=0 tx=0).stop 2024-04-24T23:01:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 msgr2=0x7fb37414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb36800cb10 tx=0x7fb36800a060 comp rx=0 tx=0).stop 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 shutdown_connections 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb35406be60 0x7fb35406e320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb37415f3f0 0x7fb37414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb37415e8b0 0x7fb37414f5e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 --2- 172.21.15.146:0/1575284083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb37415abb0 0x7fb374157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.464+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 >> 172.21.15.146:0/1575284083 conn(0x7fb37406b140 msgr2=0x7fb37406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.465+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 shutdown_connections 2024-04-24T23:01:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.465+0000 7fb37be00640 1 -- 172.21.15.146:0/1575284083 wait complete. 2024-04-24T23:01:59.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:01:59.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:59.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:01:59.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:01:59.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:01:59.572 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:01:59.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:01:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.865+0000 7fc99a600640 1 Processor -- start 2024-04-24T23:01:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.865+0000 7fc99a600640 1 -- start start 2024-04-24T23:01:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc99a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc994154f50 0x7fc9940ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc99a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc99415ec00 0x7fc9940d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc99a600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99415f250 con 0x7fc9940cfd30 2024-04-24T23:01:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc99a600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc9940adad0 con 0x7fc994154f50 2024-04-24T23:01:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc99a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc9940addb0 con 0x7fc99415ec00 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc992a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc9940cfd30 0x7fc99415e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53928/0 (socket says 172.21.15.146:53928) 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc992a00640 1 -- 172.21.15.146:0/1874878637 learned_addr learned my addr 172.21.15.146:0/1874878637 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc993400640 1 --2- 172.21.15.146:0/1874878637 >> v2:172.21.15.146:3300/0 conn(0x7fc994154f50 0x7fc9940ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.867+0000 7fc993e00640 1 --2- 172.21.15.146:0/1874878637 >> v2:172.21.15.203:3300/0 conn(0x7fc99415ec00 0x7fc9940d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc992000640 1 -- 172.21.15.146:0/1874878637 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891809947 0 0) 0x7fc99415f250 con 0x7fc9940cfd30 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc992000640 1 -- 172.21.15.146:0/1874878637 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc978003520 con 0x7fc9940cfd30 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc993400640 1 -- 172.21.15.146:0/1874878637 >> v2:172.21.15.203:3300/0 conn(0x7fc99415ec00 msgr2=0x7fc9940d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc993400640 1 --2- 172.21.15.146:0/1874878637 >> v2:172.21.15.203:3300/0 conn(0x7fc99415ec00 0x7fc9940d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc993400640 1 -- 172.21.15.146:0/1874878637 >> v1:172.21.15.146:6789/0 conn(0x7fc9940cfd30 legacy=0x7fc99415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.868+0000 7fc993400640 1 -- 172.21.15.146:0/1874878637 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9940ae090 con 0x7fc994154f50 2024-04-24T23:01:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.869+0000 7fc993400640 1 --2- 172.21.15.146:0/1874878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc994154f50 0x7fc9940ae5b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc98402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2203f5d5dbf1f667 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.869+0000 7fc992000640 1 -- 172.21.15.146:0/1874878637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984007740 con 0x7fc994154f50 2024-04-24T23:01:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.869+0000 7fc992000640 1 -- 172.21.15.146:0/1874878637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9840078e0 con 0x7fc994154f50 2024-04-24T23:01:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.869+0000 7fc992000640 1 -- 172.21.15.146:0/1874878637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984007cb0 con 0x7fc994154f50 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 -- 172.21.15.146:0/1874878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc994154f50 msgr2=0x7fc9940ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 --2- 172.21.15.146:0/1874878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc994154f50 0x7fc9940ae5b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc98402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 -- 172.21.15.146:0/1874878637 shutdown_connections 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 --2- 172.21.15.146:0/1874878637 >> v2:172.21.15.203:3300/0 conn(0x7fc99415ec00 0x7fc9940d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 --2- 172.21.15.146:0/1874878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc994154f50 0x7fc9940ae5b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 -- 172.21.15.146:0/1874878637 >> 172.21.15.146:0/1874878637 conn(0x7fc99406b140 msgr2=0x7fc99406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 -- 172.21.15.146:0/1874878637 shutdown_connections 2024-04-24T23:01:59.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.870+0000 7fc99a600640 1 -- 172.21.15.146:0/1874878637 wait complete. 2024-04-24T23:01:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.872+0000 7fc99a600640 1 Processor -- start 2024-04-24T23:01:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.872+0000 7fc99a600640 1 -- start start 2024-04-24T23:01:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc994154f50 0x7fc9941f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc99415ec00 0x7fc9940b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc994070d90 con 0x7fc9940cfd30 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc994070c10 con 0x7fc99415ec00 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc99a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc994070f10 con 0x7fc994154f50 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc993400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc993400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40414/0 (socket says 172.21.15.146:40414) 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.873+0000 7fc993400640 1 -- 172.21.15.146:0/162691443 learned_addr learned my addr 172.21.15.146:0/162691443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 -- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc994154f50 msgr2=0x7fc9941f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc994154f50 0x7fc9941f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 -- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc99415ec00 msgr2=0x7fc9940b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc99415ec00 0x7fc9940b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 -- 172.21.15.146:0/162691443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9941f7600 con 0x7fc9940cfd30 2024-04-24T23:01:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc993400640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc984004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984040070 con 0x7fc9940cfd30 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc984031c40 con 0x7fc9940cfd30 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9941f78e0 con 0x7fc9940cfd30 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984009450 con 0x7fc9940cfd30 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.874+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99415c3f0 con 0x7fc9940cfd30 2024-04-24T23:01:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.875+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc994068190 con 0x7fc9940cfd30 2024-04-24T23:01:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.876+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc984039040 con 0x7fc9940cfd30 2024-04-24T23:01:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.877+0000 7fc98b400640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:01:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.877+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fc9840ac950 con 0x7fc9940cfd30 2024-04-24T23:01:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.878+0000 7fc992a00640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:01:59.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.879+0000 7fc992a00640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 0x7fc97406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc980000f60 tx=0x7fc9800078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:01:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:01:59.881+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc98407aac0 con 0x7fc9940cfd30 2024-04-24T23:02:00.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.122+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc994154860 con 0x7fc9940cfd30 2024-04-24T23:02:00.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.123+0000 7fc98b400640 1 -- 172.21.15.146:0/162691443 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7fc98407edc0 con 0x7fc9940cfd30 2024-04-24T23:02:00.125 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:02:00.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 msgr2=0x7fc97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:00.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 0x7fc97406e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc980000f60 tx=0x7fc9800078f0 comp rx=0 tx=0).stop 2024-04-24T23:02:00.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 msgr2=0x7fc994146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:00.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc984009d90 tx=0x7fc984004a40 comp rx=0 tx=0).stop 2024-04-24T23:02:00.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 shutdown_connections 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc99415ec00 0x7fc9940b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc97406be30 0x7fc97406e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc994154f50 0x7fc9941f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 --2- 172.21.15.146:0/162691443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9940cfd30 0x7fc994146bc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 >> 172.21.15.146:0/162691443 conn(0x7fc99406b140 msgr2=0x7fc9940b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 shutdown_connections 2024-04-24T23:02:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00.126+0000 7fc99a600640 1 -- 172.21.15.146:0/162691443 wait complete. 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:02:00.148 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:00.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.149 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:02:00.198 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:02:00.199 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42515sec preferred_lft 42515sec 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:02:00.200 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:02:00.201 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:00.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.202 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:02:00.281 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:02:00.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.285 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:02:00.334 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:02:00.334 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:02:00.334 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:02:00.334 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:02:00.334 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:02:00.335 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:02:00.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:02:00.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:00.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.548 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:02:00.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:02:00.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:02:00.597 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:00.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:02:00.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:02:00.681 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:00.704 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:02:00.702+0000 7fc7bc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-24T23:02:00.732 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:00.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:02:00.733 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:00.827 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:02:00.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:00.958 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:00.958 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:02:00.992 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:00.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:02:00.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:02:00.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:02:00.992 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:02:00.994 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:02:00.994 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:02:00.995 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:02:00.995 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:02:00.995 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:02:00.998 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:02:00.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:00.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:01.076 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:02:01.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:02:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:01.193 INFO:teuthology.orchestra.run.smithi146.stdout:client5709 2024-04-24T23:02:01.194 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:01.194 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:01.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:01.244 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:.: 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:linkdir 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:rootfile 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:subdir 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:./linkdir: 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:link0 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:link1 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:link2 2024-04-24T23:02:01.300 INFO:teuthology.orchestra.run.smithi146.stdout:link3 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout:./subdir: 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout:subdirfile 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout:subsubdir 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:01.301 INFO:teuthology.orchestra.run.smithi146.stdout:./subdir/subsubdir: 2024-04-24T23:02:01.302 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:01.302 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:01.303 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:01.303 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:01.303 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-04-24T23:02:01.303 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:01.446 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-04-24T23:02:01.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:01.460 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:01.461 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:01.461 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:01.461 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:01.461 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-24T23:02:01.461 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:01.645 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627777 2024-04-24T23:02:01.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:01.661 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:01.661 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:01.661 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:01.662 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:01.662 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-04-24T23:02:01.662 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:01.844 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627778 2024-04-24T23:02:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:01.859 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:01.859 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:01.860 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:01.860 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:01.860 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-04-24T23:02:01.860 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:02.042 INFO:teuthology.orchestra.run.smithi146.stdout:1099511628282 2024-04-24T23:02:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link0").st_ino) 2024-04-24T23:02:02.057 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:02.242 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627778 2024-04-24T23:02:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link1").st_ino) 2024-04-24T23:02:02.256 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:02.440 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627778 2024-04-24T23:02:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link2").st_ino) 2024-04-24T23:02:02.454 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:02.638 INFO:teuthology.orchestra.run.smithi146.stdout:1099511628281 2024-04-24T23:02:02.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:02.652 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:02.652 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:02.652 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:02.653 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:02.653 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link3").st_ino) 2024-04-24T23:02:02.653 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:02.840 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-04-24T23:02:02.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:02.854 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch afterwards) 2024-04-24T23:02:02.956 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:02:02.957 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:02:02.957 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-04-24T23:02:02.957 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:02:02.957 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/afterwards").st_ino) 2024-04-24T23:02:02.957 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:02:03.100 INFO:teuthology.orchestra.run.smithi146.stdout:1099521627779 2024-04-24T23:02:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:03.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:03.114 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subsubdir/subsubdirfile) 2024-04-24T23:02:03.213 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:02:03.211+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-04-24T23:02:03.218 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:02:03.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:02:03.326 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:02:03.449 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:02:03.450 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:02:03.450 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:03.450 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:03.508 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:03.508 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:03.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:03.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.769+0000 7f7dc2800640 1 Processor -- start 2024-04-24T23:02:03.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.769+0000 7f7dc2800640 1 -- start start 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.770+0000 7f7dc2800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 0x7f7dbc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.770+0000 7f7dc2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7dbc0728c0 0x7f7dbc0d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.770+0000 7f7dc2800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc1449c0 con 0x7f7dbc070c10 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.770+0000 7f7dc2800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc072430 con 0x7f7dbc0728c0 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.770+0000 7f7dc2800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc0b2d70 con 0x7f7dbc1445e0 2024-04-24T23:02:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbaa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7dbc0728c0 0x7f7dbc0d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbbe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7dbc070c10 0x7f7dbc15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53930/0 (socket says 172.21.15.146:53930) 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbbe00640 1 -- 172.21.15.146:0/1373385065 learned_addr learned my addr 172.21.15.146:0/1373385065 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbb400640 1 --2- 172.21.15.146:0/1373385065 >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 0x7f7dbc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1373385065 >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 msgr2=0x7f7dbc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbaa00640 1 --2- 172.21.15.146:0/1373385065 >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 0x7f7dbc0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1373385065 >> v1:172.21.15.146:6789/0 conn(0x7f7dbc070c10 legacy=0x7f7dbc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1373385065 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc071820 con 0x7f7dbc0728c0 2024-04-24T23:02:03.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.771+0000 7f7dbb400640 1 --2- 172.21.15.146:0/1373385065 >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 0x7f7dbc0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:03.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.772+0000 7f7dbaa00640 1 --2- 172.21.15.146:0/1373385065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0d01d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d08a0 tx=0x7f7da802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a0cb0bd2622e55 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:03.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dba000640 1 -- 172.21.15.146:0/1373385065 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8032770 con 0x7f7dbc0728c0 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dba000640 1 -- 172.21.15.146:0/1373385065 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8038070 con 0x7f7dbc0728c0 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dba000640 1 -- 172.21.15.146:0/1373385065 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8032b30 con 0x7f7dbc0728c0 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 -- 172.21.15.146:0/1373385065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 msgr2=0x7f7dbc0d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1373385065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0d01d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d08a0 tx=0x7f7da802c870 comp rx=0 tx=0).stop 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 -- 172.21.15.146:0/1373385065 shutdown_connections 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1373385065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0d01d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1373385065 >> v2:172.21.15.203:3300/0 conn(0x7f7dbc1445e0 0x7f7dbc0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 -- 172.21.15.146:0/1373385065 >> 172.21.15.146:0/1373385065 conn(0x7f7dbc06b320 msgr2=0x7f7dbc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 -- 172.21.15.146:0/1373385065 shutdown_connections 2024-04-24T23:02:03.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.773+0000 7f7dc2800640 1 -- 172.21.15.146:0/1373385065 wait complete. 2024-04-24T23:02:03.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.775+0000 7f7dc2800640 1 Processor -- start 2024-04-24T23:02:03.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.775+0000 7f7dc2800640 1 -- start start 2024-04-24T23:02:03.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7dbc070c10 0x7f7dbc15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dbc1445e0 0x7f7dbc0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0720c0 con 0x7f7dbc0728c0 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc071de0 con 0x7f7dbc1445e0 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dc2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc071080 con 0x7f7dbc070c10 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.776+0000 7f7dbaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40436/0 (socket says 172.21.15.146:40436) 2024-04-24T23:02:03.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1630251570 learned_addr learned my addr 172.21.15.146:0/1630251570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7dbc070c10 msgr2=0x7f7dbc15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7dbc070c10 0x7f7dbc15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dbc1445e0 msgr2=0x7f7dbc0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dbc1445e0 0x7f7dbc0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 -- 172.21.15.146:0/1630251570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0c6510 con 0x7f7dbc0728c0 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.777+0000 7f7dbaa00640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7da8035040 tx=0x7f7da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.778+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8033c40 con 0x7f7dbc0728c0 2024-04-24T23:02:03.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.778+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8032e50 con 0x7f7dbc0728c0 2024-04-24T23:02:03.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.778+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8046410 con 0x7f7dbc0728c0 2024-04-24T23:02:03.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.778+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc0c67f0 con 0x7f7dbc0728c0 2024-04-24T23:02:03.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.778+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc0c6db0 con 0x7f7dbc0728c0 2024-04-24T23:02:03.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.779+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc0af160 con 0x7f7dbc0728c0 2024-04-24T23:02:03.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.780+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7da8044020 con 0x7f7dbc0728c0 2024-04-24T23:02:03.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.781+0000 7f7db3400640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:03.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.781+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f7da80abf40 con 0x7f7dbc0728c0 2024-04-24T23:02:03.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.781+0000 7f7dbb400640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:03.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.783+0000 7f7dbb400640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:03.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.786+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7dbc0af160 con 0x7f7dbc0728c0 2024-04-24T23:02:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.988+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dbc068190 con 0x7f7dbc0728c0 2024-04-24T23:02:03.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.990+0000 7f7db3400640 1 -- 172.21.15.146:0/1630251570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17095 (secure 0 0 0) 0x7f7da807a5e0 con 0x7f7dbc0728c0 2024-04-24T23:02:03.993 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:48.482746+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 msgr2=0x7f7d9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 msgr2=0x7f7dbc0c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7da8035040 tx=0x7f7da8004730 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 shutdown_connections 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dbc1445e0 0x7f7dbc0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0728c0 0x7f7dbc0c5a30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.993+0000 7f7dc2800640 1 --2- 172.21.15.146:0/1630251570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7dbc070c10 0x7f7dbc15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.994+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 >> 172.21.15.146:0/1630251570 conn(0x7f7dbc06b320 msgr2=0x7f7dbc0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.994+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 shutdown_connections 2024-04-24T23:02:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:03.994+0000 7f7dc2800640 1 -- 172.21.15.146:0/1630251570 wait complete. 2024-04-24T23:02:04.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:01:32.305853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:01:33.507733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:02:04.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:02:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.217+0000 7ff060400640 1 Processor -- start 2024-04-24T23:02:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.217+0000 7ff060400640 1 -- start start 2024-04-24T23:02:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff05813ef30 0x7ff058141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff058141ab0 0x7ff0580ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff0580ce5a0 0x7ff05815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff0581423d0 con 0x7ff05813ef30 2024-04-24T23:02:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff058070f80 con 0x7ff0580ce5a0 2024-04-24T23:02:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff060400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff0580ced40 con 0x7ff058141ab0 2024-04-24T23:02:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff05da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff05813ef30 0x7ff058141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff05da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff05813ef30 0x7ff058141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40438/0 (socket says 172.21.15.146:40438) 2024-04-24T23:02:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.219+0000 7ff05da00640 1 -- 172.21.15.146:0/1205100109 learned_addr learned my addr 172.21.15.146:0/1205100109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05da00640 1 -- 172.21.15.146:0/1205100109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff058141ab0 msgr2=0x7ff0580ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05e400640 1 --2- 172.21.15.146:0/1205100109 >> v2:172.21.15.203:3300/0 conn(0x7ff0580ce5a0 0x7ff05815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05da00640 1 --2- 172.21.15.146:0/1205100109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff058141ab0 0x7ff0580ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05da00640 1 -- 172.21.15.146:0/1205100109 >> v2:172.21.15.203:3300/0 conn(0x7ff0580ce5a0 msgr2=0x7ff05815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05da00640 1 --2- 172.21.15.146:0/1205100109 >> v2:172.21.15.203:3300/0 conn(0x7ff0580ce5a0 0x7ff05815fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.220+0000 7ff05da00640 1 -- 172.21.15.146:0/1205100109 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0580cf020 con 0x7ff05813ef30 2024-04-24T23:02:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.221+0000 7ff05da00640 1 --2- 172.21.15.146:0/1205100109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05813ef30 0x7ff058141570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff0580d0a90 tx=0x7ff04c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab8d5440e903130 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.221+0000 7ff057e00640 1 -- 172.21.15.146:0/1205100109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c037070 con 0x7ff05813ef30 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.221+0000 7ff057e00640 1 -- 172.21.15.146:0/1205100109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c032440 con 0x7ff05813ef30 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.221+0000 7ff057e00640 1 -- 172.21.15.146:0/1205100109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c032810 con 0x7ff05813ef30 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 -- 172.21.15.146:0/1205100109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05813ef30 msgr2=0x7ff058141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 --2- 172.21.15.146:0/1205100109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05813ef30 0x7ff058141570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff0580d0a90 tx=0x7ff04c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 -- 172.21.15.146:0/1205100109 shutdown_connections 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 --2- 172.21.15.146:0/1205100109 >> v2:172.21.15.203:3300/0 conn(0x7ff0580ce5a0 0x7ff05815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 --2- 172.21.15.146:0/1205100109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff058141ab0 0x7ff0580ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 --2- 172.21.15.146:0/1205100109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05813ef30 0x7ff058141570 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 -- 172.21.15.146:0/1205100109 >> 172.21.15.146:0/1205100109 conn(0x7ff0580b17b0 msgr2=0x7ff0580b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 -- 172.21.15.146:0/1205100109 shutdown_connections 2024-04-24T23:02:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.222+0000 7ff060400640 1 -- 172.21.15.146:0/1205100109 wait complete. 2024-04-24T23:02:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.224+0000 7ff060400640 1 Processor -- start 2024-04-24T23:02:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.224+0000 7ff060400640 1 -- start start 2024-04-24T23:02:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0580ce5a0 0x7ff058071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 0x7ff058071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0580cea30 con 0x7ff058141ab0 2024-04-24T23:02:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff058070c10 con 0x7ff05813ef30 2024-04-24T23:02:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff060400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff05815ff40 con 0x7ff0580ce5a0 2024-04-24T23:02:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff05e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff05e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40448/0 (socket says 172.21.15.146:40448) 2024-04-24T23:02:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.225+0000 7ff05e400640 1 -- 172.21.15.146:0/1250182186 learned_addr learned my addr 172.21.15.146:0/1250182186 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05da00640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0580ce5a0 0x7ff058071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05d000640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 0x7ff058071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 -- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0580ce5a0 msgr2=0x7ff058071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0580ce5a0 0x7ff058071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 -- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 msgr2=0x7ff058071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 0x7ff058071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 -- 172.21.15.146:0/1250182186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05813b160 con 0x7ff058141ab0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05d000640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 0x7ff058071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.226+0000 7ff05e400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff05000cd70 tx=0x7ff05000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.227+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050003b90 con 0x7ff058141ab0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.227+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff050003d30 con 0x7ff058141ab0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.227+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05813b440 con 0x7ff058141ab0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.227+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050004240 con 0x7ff058141ab0 2024-04-24T23:02:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.227+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff058143210 con 0x7ff058141ab0 2024-04-24T23:02:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.228+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05804f5a0 con 0x7ff058141ab0 2024-04-24T23:02:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.229+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0500043e0 con 0x7ff058141ab0 2024-04-24T23:02:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.230+0000 7ff055600640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 0x7ff03806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.230+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7ff05008bb60 con 0x7ff058141ab0 2024-04-24T23:02:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.231+0000 7ff05da00640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 0x7ff03806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.232+0000 7ff05da00640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 0x7ff03806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.234+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff05001d340 con 0x7ff058141ab0 2024-04-24T23:02:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.435+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff05815f3d0 con 0x7ff058141ab0 2024-04-24T23:02:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.436+0000 7ff055600640 1 -- 172.21.15.146:0/1250182186 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7ff05005a330 con 0x7ff058141ab0 2024-04-24T23:02:04.438 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 msgr2=0x7ff03806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 0x7ff03806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c02e000 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 msgr2=0x7ff05813d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff05000cd70 tx=0x7ff05000a660 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 shutdown_connections 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058141ab0 0x7ff05813d190 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff05813ef30 0x7ff058071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff03806be30 0x7ff03806e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 --2- 172.21.15.146:0/1250182186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0580ce5a0 0x7ff058071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.438+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 >> 172.21.15.146:0/1250182186 conn(0x7ff0580b17b0 msgr2=0x7ff05813dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.439+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 shutdown_connections 2024-04-24T23:02:04.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.439+0000 7ff060400640 1 -- 172.21.15.146:0/1250182186 wait complete. 2024-04-24T23:02:04.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:02:04.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.660+0000 7f05e9600640 1 Processor -- start 2024-04-24T23:02:04.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.660+0000 7f05e9600640 1 -- start start 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.661+0000 7f05e9600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05e40cfcc0 0x7f05e40d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05e9600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e4071ab0 con 0x7f05e4155120 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05e9600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e4071d90 con 0x7f05e415c1a0 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05e9600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40d0660 con 0x7f05e40cfcc0 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05e3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f05e4155120 0x7f05e40b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53946/0 (socket says 172.21.15.146:53946) 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05e3e00640 1 -- 172.21.15.146:0/1983925004 learned_addr learned my addr 172.21.15.146:0/1983925004 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05db400640 1 --2- 172.21.15.146:0/1983925004 >> v2:172.21.15.146:3300/0 conn(0x7f05e40cfcc0 0x7f05e40d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05db400640 1 -- 172.21.15.146:0/1983925004 >> v1:172.21.15.203:6789/0 conn(0x7f05e415c1a0 legacy=0x7f05e415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:04.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05db400640 1 -- 172.21.15.146:0/1983925004 >> v1:172.21.15.146:6789/0 conn(0x7f05e4155120 legacy=0x7f05e40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.662+0000 7f05db400640 1 -- 172.21.15.146:0/1983925004 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4072070 con 0x7f05e40cfcc0 2024-04-24T23:02:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.663+0000 7f05db400640 1 --2- 172.21.15.146:0/1983925004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e40d0120 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0097a0 tx=0x7f05cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f996b1904281879 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e3400640 1 -- 172.21.15.146:0/1983925004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc037070 con 0x7f05e40cfcc0 2024-04-24T23:02:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e3400640 1 -- 172.21.15.146:0/1983925004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc032440 con 0x7f05e40cfcc0 2024-04-24T23:02:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e3400640 1 -- 172.21.15.146:0/1983925004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032810 con 0x7f05e40cfcc0 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e9600640 1 -- 172.21.15.146:0/1983925004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 msgr2=0x7f05e40d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e9600640 1 --2- 172.21.15.146:0/1983925004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e40d0120 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0097a0 tx=0x7f05cc02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e9600640 1 -- 172.21.15.146:0/1983925004 shutdown_connections 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e9600640 1 --2- 172.21.15.146:0/1983925004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e40d0120 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.664+0000 7f05e9600640 1 -- 172.21.15.146:0/1983925004 >> 172.21.15.146:0/1983925004 conn(0x7f05e406b560 msgr2=0x7f05e406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.665+0000 7f05e9600640 1 -- 172.21.15.146:0/1983925004 shutdown_connections 2024-04-24T23:02:04.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.665+0000 7f05e9600640 1 -- 172.21.15.146:0/1983925004 wait complete. 2024-04-24T23:02:04.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.666+0000 7f05e9600640 1 Processor -- start 2024-04-24T23:02:04.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.666+0000 7f05e9600640 1 -- start start 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e4155120 0x7f05e414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e415c1a0 0x7f05e40b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4072630 con 0x7f05e40cfcc0 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4155500 con 0x7f05e415c1a0 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.667+0000 7f05e9600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f05e4072b50 con 0x7f05e4155120 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40478/0 (socket says 172.21.15.146:40478) 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 -- 172.21.15.146:0/1269993096 learned_addr learned my addr 172.21.15.146:0/1269993096 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05db400640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e4155120 0x7f05e414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e8c00640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e415c1a0 0x7f05e40b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 -- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e4155120 msgr2=0x7f05e414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e4155120 0x7f05e414cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 -- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e415c1a0 msgr2=0x7f05e40b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e415c1a0 0x7f05e40b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 -- 172.21.15.146:0/1269993096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4158060 con 0x7f05e40cfcc0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.668+0000 7f05e3e00640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c430 tx=0x7f05d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.669+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4017070 con 0x7f05e40cfcc0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.669+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4005ce0 con 0x7f05e40cfcc0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.669+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e4158340 con 0x7f05e40cfcc0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.669+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40072f0 con 0x7f05e40cfcc0 2024-04-24T23:02:04.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.669+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e40b0e30 con 0x7f05e40cfcc0 2024-04-24T23:02:04.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.670+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e4068c40 con 0x7f05e40cfcc0 2024-04-24T23:02:04.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.671+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d401a070 con 0x7f05e40cfcc0 2024-04-24T23:02:04.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.672+0000 7f05e0c00640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:04.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.673+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f05d408a4e0 con 0x7f05e40cfcc0 2024-04-24T23:02:04.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.673+0000 7f05db400640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:04.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.674+0000 7f05db400640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f05cc034000 tx=0x7f05cc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:04.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.677+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f05e4068c40 con 0x7f05e40cfcc0 2024-04-24T23:02:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.877+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05e404f500 con 0x7f05e40cfcc0 2024-04-24T23:02:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.878+0000 7f05e0c00640 1 -- 172.21.15.146:0/1269993096 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f05d4058c10 con 0x7f05e40cfcc0 2024-04-24T23:02:04.880 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 msgr2=0x7f05c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f05cc034000 tx=0x7f05cc02e000 comp rx=0 tx=0).stop 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 msgr2=0x7f05e4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c430 tx=0x7f05d400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 shutdown_connections 2024-04-24T23:02:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e415c1a0 0x7f05e40b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e4155120 0x7f05e414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 --2- 172.21.15.146:0/1269993096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e40cfcc0 0x7f05e4157080 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 >> 172.21.15.146:0/1269993096 conn(0x7f05e406b560 msgr2=0x7f05e40b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 shutdown_connections 2024-04-24T23:02:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:04.881+0000 7f05e9600640 1 -- 172.21.15.146:0/1269993096 wait complete. 2024-04-24T23:02:04.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:02:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.107+0000 7fcc6f200640 1 Processor -- start 2024-04-24T23:02:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.107+0000 7fcc6f200640 1 -- start start 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc70166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6f200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc700b4df0 con 0x7fcc7015cd60 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc700b4b10 con 0x7fcc7015bcd0 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7015c8d0 con 0x7fcc700d03d0 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6d400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcc7015cd60 0x7fcc700cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53950/0 (socket says 172.21.15.146:53950) 2024-04-24T23:02:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6d400640 1 -- 172.21.15.146:0/567954947 learned_addr learned my addr 172.21.15.146:0/567954947 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:05.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.109+0000 7fcc6e800640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc70166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437046422 0 0) 0x7fcc700b4df0 con 0x7fcc7015cd60 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc54003520 con 0x7fcc7015cd60 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2329753973 0 0) 0x7fcc54003520 con 0x7fcc7015cd60 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 msgr2=0x7fcc70166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc70166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 >> v1:172.21.15.203:6789/0 conn(0x7fcc7015bcd0 legacy=0x7fcc700cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7015c280 con 0x7fcc7015cd60 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fcc5c001670 con 0x7fcc7015cd60 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 >> v1:172.21.15.146:6789/0 conn(0x7fcc7015cd60 legacy=0x7fcc700cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc540039e0 0x7fcc54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54004d40 0x7fcc540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7015c8d0 con 0x7fcc54004d40 2024-04-24T23:02:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5400baa0 con 0x7fcc540039e0 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.110+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5400bca0 con 0x7fcc700d03d0 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54004d40 0x7fcc540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6de00640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc540039e0 0x7fcc54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6d400640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 -- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 msgr2=0x7fcc54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700d03d0 0x7fcc54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 -- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc540039e0 msgr2=0x7fcc54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc540039e0 0x7fcc54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.111+0000 7fcc6e800640 1 -- 172.21.15.146:0/567954947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc54003520 con 0x7fcc54004d40 2024-04-24T23:02:05.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.112+0000 7fcc6e800640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54004d40 0x7fcc540051c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcc700d0900 tx=0x7fcc54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efae7b1d91737704 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.112+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68037070 con 0x7fcc54004d40 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.112+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6802e050 con 0x7fcc54004d40 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.112+0000 7fcc6ca00640 1 -- 172.21.15.146:0/567954947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68009c10 con 0x7fcc54004d40 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 -- 172.21.15.146:0/567954947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54004d40 msgr2=0x7fcc540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 --2- 172.21.15.146:0/567954947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54004d40 0x7fcc540051c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcc700d0900 tx=0x7fcc54005830 comp rx=0 tx=0).stop 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6e800640 1 -- 172.21.15.146:0/567954947 reap_dead start 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 -- 172.21.15.146:0/567954947 shutdown_connections 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 -- 172.21.15.146:0/567954947 >> 172.21.15.146:0/567954947 conn(0x7fcc7006b560 msgr2=0x7fcc7006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 -- 172.21.15.146:0/567954947 shutdown_connections 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.113+0000 7fcc6f200640 1 -- 172.21.15.146:0/567954947 wait complete. 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.115+0000 7fcc6f200640 1 Processor -- start 2024-04-24T23:02:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.115+0000 7fcc6f200640 1 -- start start 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 0x7fcc700aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700713b0 0x7fcc70144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc700b4790 con 0x7fcc70146ba0 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7006e590 con 0x7fcc54004d40 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc70164a70 con 0x7fcc700713b0 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40508/0 (socket says 172.21.15.146:40508) 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.116+0000 7fcc6e800640 1 -- 172.21.15.146:0/4061238536 learned_addr learned my addr 172.21.15.146:0/4061238536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6de00640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 0x7fcc700aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6d400640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700713b0 0x7fcc70144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 -- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700713b0 msgr2=0x7fcc70144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700713b0 0x7fcc70144280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 -- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 msgr2=0x7fcc700aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 0x7fcc700aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 -- 172.21.15.146:0/4061238536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc70071bc0 con 0x7fcc70146ba0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6de00640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 0x7fcc700aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6e800640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e230 tx=0x7fcc68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68037070 con 0x7fcc70146ba0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc68042070 con 0x7fcc70146ba0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68009c10 con 0x7fcc70146ba0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.117+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc70071ea0 con 0x7fcc70146ba0 2024-04-24T23:02:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.118+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc70162e30 con 0x7fcc70146ba0 2024-04-24T23:02:05.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.119+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7006e800 con 0x7fcc70146ba0 2024-04-24T23:02:05.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.120+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc6803ca50 con 0x7fcc70146ba0 2024-04-24T23:02:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.121+0000 7fcc66000640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.121+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fcc680ab910 con 0x7fcc70146ba0 2024-04-24T23:02:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.121+0000 7fcc6de00640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.123+0000 7fcc6de00640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcc600016b0 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.127+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc7006e800 con 0x7fcc70146ba0 2024-04-24T23:02:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.316+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcc70162c20 con 0x7fcc70146ba0 2024-04-24T23:02:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.317+0000 7fcc66000640 1 -- 172.21.15.146:0/4061238536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7fcc6804c020 con 0x7fcc70146ba0 2024-04-24T23:02:05.319 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:02:05.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 msgr2=0x7fcc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcc600016b0 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 msgr2=0x7fcc70147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e230 tx=0x7fcc68009750 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 shutdown_connections 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc70146ba0 0x7fcc70147020 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc700713b0 0x7fcc70144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 --2- 172.21.15.146:0/4061238536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc54004d40 0x7fcc700aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 >> 172.21.15.146:0/4061238536 conn(0x7fcc7006b560 msgr2=0x7fcc700cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 shutdown_connections 2024-04-24T23:02:05.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.319+0000 7fcc6f200640 1 -- 172.21.15.146:0/4061238536 wait complete. 2024-04-24T23:02:05.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:02:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.537+0000 7f7708c00640 1 Processor -- start 2024-04-24T23:02:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.537+0000 7f7708c00640 1 -- start start 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7708c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f77040b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7708c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7704072380 0x7f77040ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7708c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7704070a80 con 0x7f77040ade00 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7708c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f77040aeb60 con 0x7f7704072380 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7708c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7704071930 con 0x7f770415e010 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7702a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7704072380 0x7f77040ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7702a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7704072380 0x7f77040ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40514/0 (socket says 172.21.15.146:40514) 2024-04-24T23:02:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7702a00640 1 -- 172.21.15.146:0/168066925 learned_addr learned my addr 172.21.15.146:0/168066925 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.539+0000 7f7703400640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f77040b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.540+0000 7f7702a00640 1 -- 172.21.15.146:0/168066925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 msgr2=0x7f77040b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.540+0000 7f7702a00640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f77040b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.540+0000 7f7702a00640 1 -- 172.21.15.146:0/168066925 >> v1:172.21.15.203:6789/0 conn(0x7f77040ade00 legacy=0x7f7704161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.540+0000 7f7702a00640 1 -- 172.21.15.146:0/168066925 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7704070d20 con 0x7f7704072380 2024-04-24T23:02:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.541+0000 7f7702a00640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7704072380 0x7f77040ad8c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1ac53686ababa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7702000640 1 -- 172.21.15.146:0/168066925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0037070 con 0x7f7704072380 2024-04-24T23:02:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7702000640 1 -- 172.21.15.146:0/168066925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f002ae50 con 0x7f7704072380 2024-04-24T23:02:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7702000640 1 -- 172.21.15.146:0/168066925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0032860 con 0x7f7704072380 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7708c00640 1 -- 172.21.15.146:0/168066925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7704072380 msgr2=0x7f77040ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7708c00640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7704072380 0x7f77040ad8c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002a300 comp rx=0 tx=0).stop 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.542+0000 7f7708c00640 1 -- 172.21.15.146:0/168066925 shutdown_connections 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.543+0000 7f7708c00640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7704072380 0x7f77040ad8c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.543+0000 7f7708c00640 1 --2- 172.21.15.146:0/168066925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f77040b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.543+0000 7f7708c00640 1 -- 172.21.15.146:0/168066925 >> 172.21.15.146:0/168066925 conn(0x7f77040b1560 msgr2=0x7f77040b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.543+0000 7f7708c00640 1 -- 172.21.15.146:0/168066925 shutdown_connections 2024-04-24T23:02:05.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.543+0000 7f7708c00640 1 -- 172.21.15.146:0/168066925 wait complete. 2024-04-24T23:02:05.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.544+0000 7f7708c00640 1 Processor -- start 2024-04-24T23:02:05.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.544+0000 7f7708c00640 1 -- start start 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7704072380 0x7f7704148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f770415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f77040715c0 con 0x7f77040ade00 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f77040712e0 con 0x7f7704072380 2024-04-24T23:02:05.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.545+0000 7f7708c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7704071dc0 con 0x7f770415e010 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40524/0 (socket says 172.21.15.146:40524) 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 -- 172.21.15.146:0/2608130894 learned_addr learned my addr 172.21.15.146:0/2608130894 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7703400640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7704072380 0x7f7704148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 -- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 msgr2=0x7f770415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f770415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 -- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7704072380 msgr2=0x7f7704148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7704072380 0x7f7704148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 -- 172.21.15.146:0/2608130894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770414b6e0 con 0x7f77040ade00 2024-04-24T23:02:05.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.546+0000 7f7702a00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f76f0000c00 tx=0x7f76f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.547+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0041070 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.547+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f003c660 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.547+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770414b9c0 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.547+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0037040 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.547+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7704148df0 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.548+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770404f500 con 0x7f77040ade00 2024-04-24T23:02:05.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.549+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76f0044070 con 0x7f77040ade00 2024-04-24T23:02:05.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.550+0000 7f76fb400640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:05.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.550+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f76f00abba0 con 0x7f77040ade00 2024-04-24T23:02:05.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.551+0000 7f7703400640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:05.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.552+0000 7f7703400640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009970 tx=0x7f76f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:05.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.555+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f76f007a3f0 con 0x7f77040ade00 2024-04-24T23:02:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.749+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f77040b2270 con 0x7f77040ade00 2024-04-24T23:02:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.750+0000 7f76fb400640 1 -- 172.21.15.146:0/2608130894 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v42) ==== 80+0+122 (secure 0 0 0) 0x7f76f0079cf0 con 0x7f77040ade00 2024-04-24T23:02:05.752 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6835/784142616 2024-04-25T23:01:48.482719+0000 2024-04-24T23:02:05.752 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6833/784142616 2024-04-25T23:01:48.482719+0000 2024-04-24T23:02:05.753 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-04-24T23:02:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.752+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 msgr2=0x7f76e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.752+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009970 tx=0x7f76f4008040 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.752+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 msgr2=0x7f770414ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.752+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f76f0000c00 tx=0x7f76f00046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 shutdown_connections 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f770415e010 0x7f770415ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77040ade00 0x7f770414ade0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 --2- 172.21.15.146:0/2608130894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7704072380 0x7f7704148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 >> 172.21.15.146:0/2608130894 conn(0x7f77040b1560 msgr2=0x7f77040b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 shutdown_connections 2024-04-24T23:02:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:05.753+0000 7f7708c00640 1 -- 172.21.15.146:0/2608130894 wait complete. 2024-04-24T23:02:05.773 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:02:05.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:05.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:05.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:02:05.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:05.894 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:02:05.954 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:02:05.954 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:02:05.955 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:05.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:02:05.996 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:02:05.996 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:05.996 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:06.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:02:06.033 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:02:06.033 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:02:06.033 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:06.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:02:06.085 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:06.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.265+0000 7faf09400640 1 Processor -- start 2024-04-24T23:02:06.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.265+0000 7faf09400640 1 -- start start 2024-04-24T23:02:06.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf09400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf041561c0 0x7faf040cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf09400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf040709d0 0x7faf0415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf09400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf04070f90 con 0x7faf040cfb30 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf09400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faf040b4310 con 0x7faf040709d0 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf09400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf041565a0 con 0x7faf041561c0 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf03400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf040709d0 0x7faf0415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf08a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faf040cfb30 0x7faf040b2c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53952/0 (socket says 172.21.15.146:53952) 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.267+0000 7faf08a00640 1 -- 172.21.15.146:0/1136841169 learned_addr learned my addr 172.21.15.146:0/1136841169 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf03e00640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf041561c0 0x7faf040cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf03400640 1 -- 172.21.15.146:0/1136841169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf041561c0 msgr2=0x7faf040cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf03400640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf041561c0 0x7faf040cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf03400640 1 -- 172.21.15.146:0/1136841169 >> v1:172.21.15.146:6789/0 conn(0x7faf040cfb30 legacy=0x7faf040b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf03400640 1 -- 172.21.15.146:0/1136841169 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf04071270 con 0x7faf040709d0 2024-04-24T23:02:06.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.268+0000 7faf02a00640 1 -- 172.21.15.146:0/1136841169 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457741900 0 0) 0x7faf04070f90 con 0x7faf040cfb30 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.269+0000 7faf03400640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf040709d0 0x7faf0415cb80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faef00097a0 tx=0x7faef002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44593ff76d892f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.269+0000 7faf02a00640 1 -- 172.21.15.146:0/1136841169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0037070 con 0x7faf040709d0 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.269+0000 7faf02a00640 1 -- 172.21.15.146:0/1136841169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef002adb0 con 0x7faf040709d0 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.269+0000 7faf02a00640 1 -- 172.21.15.146:0/1136841169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0032660 con 0x7faf040709d0 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 -- 172.21.15.146:0/1136841169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf040709d0 msgr2=0x7faf0415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf040709d0 0x7faf0415cb80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faef00097a0 tx=0x7faef002a060 comp rx=0 tx=0).stop 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 -- 172.21.15.146:0/1136841169 shutdown_connections 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf040709d0 0x7faf0415cb80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 --2- 172.21.15.146:0/1136841169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf041561c0 0x7faf040cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 -- 172.21.15.146:0/1136841169 >> 172.21.15.146:0/1136841169 conn(0x7faf0406b320 msgr2=0x7faf0406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 -- 172.21.15.146:0/1136841169 shutdown_connections 2024-04-24T23:02:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.270+0000 7faf09400640 1 -- 172.21.15.146:0/1136841169 wait complete. 2024-04-24T23:02:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.272+0000 7faf09400640 1 Processor -- start 2024-04-24T23:02:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.272+0000 7faf09400640 1 -- start start 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf040709d0 0x7faf041515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf040cfb30 0x7faf04152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf040cffa0 con 0x7faf041561c0 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf04071830 con 0x7faf040cfb30 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf09400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf040d0120 con 0x7faf040709d0 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40542/0 (socket says 172.21.15.146:40542) 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 -- 172.21.15.146:0/148243422 learned_addr learned my addr 172.21.15.146:0/148243422 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf03e00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf040709d0 0x7faf041515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 -- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf040709d0 msgr2=0x7faf041515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf040709d0 0x7faf041515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf03400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf040cfb30 0x7faf04152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 -- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf040cfb30 msgr2=0x7faf04152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf040cfb30 0x7faf04152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.273+0000 7faf08a00640 1 -- 172.21.15.146:0/148243422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf04151cd0 con 0x7faf041561c0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faf08a00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c7a0 tx=0x7faefc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc018070 con 0x7faf041561c0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc00a640 con 0x7faf041561c0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc00aa70 con 0x7faf041561c0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf04151fb0 con 0x7faf041561c0 2024-04-24T23:02:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.274+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf04152570 con 0x7faf041561c0 2024-04-24T23:02:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.275+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0404f500 con 0x7faf041561c0 2024-04-24T23:02:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.276+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faefc00ac10 con 0x7faf041561c0 2024-04-24T23:02:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.277+0000 7faefbe00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 0x7faee406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.277+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7faefc08a7e0 con 0x7faf041561c0 2024-04-24T23:02:06.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.277+0000 7faf03e00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 0x7faee406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.279+0000 7faf03e00640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 0x7faee406e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.281+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faefc058e80 con 0x7faf041561c0 2024-04-24T23:02:06.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.501+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf04153ae0 con 0x7faf041561c0 2024-04-24T23:02:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.502+0000 7faefbe00640 1 -- 172.21.15.146:0/148243422 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5188 (secure 0 0 0) 0x7faefc058780 con 0x7faf041561c0 2024-04-24T23:02:06.504 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:06.504 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:02:00.535735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5532,"qdb_cluster":[5532]},"id":2}]} 2024-04-24T23:02:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.504+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 msgr2=0x7faee406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.504+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 0x7faee406e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.504+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 msgr2=0x7faf041432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.504+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c7a0 tx=0x7faefc00cc60 comp rx=0 tx=0).stop 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 shutdown_connections 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf041561c0 0x7faf041432c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf040cfb30 0x7faf04152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faee406be30 0x7faee406e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 --2- 172.21.15.146:0/148243422 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf040709d0 0x7faf041515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 >> 172.21.15.146:0/148243422 conn(0x7faf0406b320 msgr2=0x7faf041553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 shutdown_connections 2024-04-24T23:02:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.505+0000 7faf09400640 1 -- 172.21.15.146:0/148243422 wait complete. 2024-04-24T23:02:06.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:06.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.722+0000 7faa9b200640 1 Processor -- start 2024-04-24T23:02:06.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.722+0000 7faa9b200640 1 -- start start 2024-04-24T23:02:06.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.723+0000 7faa9b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 0x7faa9c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa9c0d0240 0x7faa9c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9c0ccb10 con 0x7faa9c071dd0 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9b200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faa9c072230 con 0x7faa9c0d0240 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c0aede0 con 0x7faa9c15a980 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa9c0d0240 0x7faa9c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa9c0d0240 0x7faa9c0ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40558/0 (socket says 172.21.15.146:40558) 2024-04-24T23:02:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 -- 172.21.15.146:0/3855018889 learned_addr learned my addr 172.21.15.146:0/3855018889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa99e00640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 0x7faa9c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 -- 172.21.15.146:0/3855018889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 msgr2=0x7faa9c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 0x7faa9c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 -- 172.21.15.146:0/3855018889 >> v1:172.21.15.203:6789/0 conn(0x7faa9c071dd0 legacy=0x7faa9c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa9a800640 1 -- 172.21.15.146:0/3855018889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c06ddc0 con 0x7faa9c0d0240 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.724+0000 7faa99e00640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 0x7faa9c06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.725+0000 7faa9a800640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c0ccfd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faa94009e50 tx=0x7faa9402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39de19b9615e1ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.726+0000 7faa99400640 1 -- 172.21.15.146:0/3855018889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94036070 con 0x7faa9c0d0240 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.726+0000 7faa99400640 1 -- 172.21.15.146:0/3855018889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa94031600 con 0x7faa9c0d0240 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.726+0000 7faa99400640 1 -- 172.21.15.146:0/3855018889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940319d0 con 0x7faa9c0d0240 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.726+0000 7faa9b200640 1 -- 172.21.15.146:0/3855018889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 msgr2=0x7faa9c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.726+0000 7faa9b200640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c0ccfd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faa94009e50 tx=0x7faa9402a630 comp rx=0 tx=0).stop 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 -- 172.21.15.146:0/3855018889 shutdown_connections 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c0ccfd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 --2- 172.21.15.146:0/3855018889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c15a980 0x7faa9c06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 -- 172.21.15.146:0/3855018889 >> 172.21.15.146:0/3855018889 conn(0x7faa9c06b320 msgr2=0x7faa9c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 -- 172.21.15.146:0/3855018889 shutdown_connections 2024-04-24T23:02:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.727+0000 7faa9b200640 1 -- 172.21.15.146:0/3855018889 wait complete. 2024-04-24T23:02:06.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.728+0000 7faa9b200640 1 Processor -- start 2024-04-24T23:02:06.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.729+0000 7faa9b200640 1 -- start start 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c071dd0 0x7faa9c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9c15a980 0x7faa9c159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c06e660 con 0x7faa9c0d0240 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c06e380 con 0x7faa9c15a980 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c15ad60 con 0x7faa9c071dd0 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40564/0 (socket says 172.21.15.146:40564) 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 -- 172.21.15.146:0/2484965226 learned_addr learned my addr 172.21.15.146:0/2484965226 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa99e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c071dd0 0x7faa9c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa9a800640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9c15a980 0x7faa9c159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 -- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c071dd0 msgr2=0x7faa9c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c071dd0 0x7faa9c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 -- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9c15a980 msgr2=0x7faa9c159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9c15a980 0x7faa9c159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.730+0000 7faa93e00640 1 -- 172.21.15.146:0/2484965226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c1593d0 con 0x7faa9c0d0240 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa93e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b3e0 tx=0x7faa8400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84015020 con 0x7faa9c0d0240 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa84011850 con 0x7faa9c0d0240 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c155060 con 0x7faa9c0d0240 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84011c40 con 0x7faa9c0d0240 2024-04-24T23:02:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.731+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c155620 con 0x7faa9c0d0240 2024-04-24T23:02:06.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.732+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c159ec0 con 0x7faa9c0d0240 2024-04-24T23:02:06.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.733+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa84018020 con 0x7faa9c0d0240 2024-04-24T23:02:06.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.734+0000 7faa92000640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:06.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.734+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7faa8408b060 con 0x7faa9c0d0240 2024-04-24T23:02:06.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.735+0000 7faa99e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:06.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.736+0000 7faa99e00640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00a990 tx=0x7faa8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:06.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.738+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa8401f020 con 0x7faa9c0d0240 2024-04-24T23:02:06.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.936+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa9c04f500 con 0x7faa9c0d0240 2024-04-24T23:02:06.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.940+0000 7faa92000640 1 -- 172.21.15.146:0/2484965226 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17095 (secure 0 0 0) 0x7faa840172c0 con 0x7faa9c0d0240 2024-04-24T23:02:06.942 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:06.942 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:48.482746+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.942+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 msgr2=0x7faa7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.942+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00a990 tx=0x7faa8c008040 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.942+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 msgr2=0x7faa9c14b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.942+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b3e0 tx=0x7faa8400b8a0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 shutdown_connections 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9c15a980 0x7faa9c159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c0d0240 0x7faa9c14b360 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 --2- 172.21.15.146:0/2484965226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa9c071dd0 0x7faa9c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 >> 172.21.15.146:0/2484965226 conn(0x7faa9c06b320 msgr2=0x7faa9c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:06.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 shutdown_connections 2024-04-24T23:02:06.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:06.943+0000 7faa9b200640 1 -- 172.21.15.146:0/2484965226 wait complete. 2024-04-24T23:02:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:01:32.305853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:01:33.507733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:02:06.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:02:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.165+0000 7f780ec00640 1 Processor -- start 2024-04-24T23:02:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.166+0000 7f780ec00640 1 -- start start 2024-04-24T23:02:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.167+0000 7f780ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.167+0000 7f780ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 0x7f78080713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.167+0000 7f780ec00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78080b3250 con 0x7f7808155460 2024-04-24T23:02:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.167+0000 7f780ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f78080b3530 con 0x7f780806ea40 2024-04-24T23:02:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.167+0000 7f780ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f78080b3810 con 0x7f78080b2ab0 2024-04-24T23:02:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.168+0000 7f77ff400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.168+0000 7f780cc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 0x7f78080713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.168+0000 7f77ff400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:46332/0 (socket says 172.21.15.146:46332) 2024-04-24T23:02:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.168+0000 7f77ff400640 1 -- 172.21.15.146:0/3236190192 learned_addr learned my addr 172.21.15.146:0/3236190192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:07.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.169+0000 7f780cc00640 1 -- 172.21.15.146:0/3236190192 >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 msgr2=0x7f780815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:07.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.169+0000 7f780cc00640 1 --2- 172.21.15.146:0/3236190192 >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.169+0000 7f780cc00640 1 -- 172.21.15.146:0/3236190192 >> v1:172.21.15.203:6789/0 conn(0x7f7808155460 legacy=0x7f780806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.169+0000 7f780cc00640 1 -- 172.21.15.146:0/3236190192 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7808070ec0 con 0x7f78080b2ab0 2024-04-24T23:02:07.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.169+0000 7f77ff400640 1 --2- 172.21.15.146:0/3236190192 >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:02:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.171+0000 7f780cc00640 1 --2- 172.21.15.146:0/3236190192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 0x7f78080713e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7800009d90 tx=0x7f780002c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e388118c665371fe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.171+0000 7f7807400640 1 -- 172.21.15.146:0/3236190192 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800032770 con 0x7f78080b2ab0 2024-04-24T23:02:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.171+0000 7f7807400640 1 -- 172.21.15.146:0/3236190192 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7800038070 con 0x7f78080b2ab0 2024-04-24T23:02:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.171+0000 7f7807400640 1 -- 172.21.15.146:0/3236190192 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800032b30 con 0x7f78080b2ab0 2024-04-24T23:02:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 -- 172.21.15.146:0/3236190192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 msgr2=0x7f78080713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 --2- 172.21.15.146:0/3236190192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 0x7f78080713e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7800009d90 tx=0x7f780002c870 comp rx=0 tx=0).stop 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 -- 172.21.15.146:0/3236190192 shutdown_connections 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 --2- 172.21.15.146:0/3236190192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78080b2ab0 0x7f78080713e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 --2- 172.21.15.146:0/3236190192 >> v2:172.21.15.203:3300/0 conn(0x7f780806ea40 0x7f780815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 -- 172.21.15.146:0/3236190192 >> 172.21.15.146:0/3236190192 conn(0x7f78080b17b0 msgr2=0x7f78080b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 -- 172.21.15.146:0/3236190192 shutdown_connections 2024-04-24T23:02:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.172+0000 7f780ec00640 1 -- 172.21.15.146:0/3236190192 wait complete. 2024-04-24T23:02:07.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.173+0000 7f780ec00640 1 Processor -- start 2024-04-24T23:02:07.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.174+0000 7f780ec00640 1 -- start start 2024-04-24T23:02:07.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.174+0000 7f780ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.174+0000 7f780ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 0x7f780814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.174+0000 7f780ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7808155460 0x7f780814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f780ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f780815c480 con 0x7f780806ea40 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f780ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f78080b3af0 con 0x7f78080b2ab0 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f780ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f780815c600 con 0x7f7808155460 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40580/0 (socket says 172.21.15.146:40580) 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 -- 172.21.15.146:0/3723512842 learned_addr learned my addr 172.21.15.146:0/3723512842 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f77ff400640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 0x7f780814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f780cc00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7808155460 0x7f780814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 -- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7808155460 msgr2=0x7f780814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7808155460 0x7f780814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 -- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 msgr2=0x7f780814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 0x7f780814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f7807e00640 1 -- 172.21.15.146:0/3723512842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780814f300 con 0x7f780806ea40 2024-04-24T23:02:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.175+0000 7f77ff400640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 0x7f780814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f7807e00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c3f0 tx=0x7f77f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80052d0 con 0x7f780806ea40 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f8005490 con 0x7f780806ea40 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8007260 con 0x7f780806ea40 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780814f5e0 con 0x7f780806ea40 2024-04-24T23:02:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.176+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780814fba0 con 0x7f780806ea40 2024-04-24T23:02:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.177+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780804f5a0 con 0x7f780806ea40 2024-04-24T23:02:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.178+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77f8007400 con 0x7f780806ea40 2024-04-24T23:02:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.179+0000 7f7804c00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 0x7f77e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.179+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f77f808a530 con 0x7f780806ea40 2024-04-24T23:02:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.180+0000 7f77ff400640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 0x7f77e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.181+0000 7f77ff400640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 0x7f77e406e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009630 tx=0x7f77f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.184+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77f8058d00 con 0x7f780806ea40 2024-04-24T23:02:07.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.378+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f780806ce50 con 0x7f780806ea40 2024-04-24T23:02:07.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.379+0000 7f7804c00640 1 -- 172.21.15.146:0/3723512842 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f77f8058600 con 0x7f780806ea40 2024-04-24T23:02:07.382 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.381+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 msgr2=0x7f77e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.381+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 0x7f77e406e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009630 tx=0x7f77f0008040 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.381+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 msgr2=0x7f780815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.381+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c3f0 tx=0x7f77f800c8b0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 shutdown_connections 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f77e406be30 0x7f77e406e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7808155460 0x7f780814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78080b2ab0 0x7f780814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 --2- 172.21.15.146:0/3723512842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780806ea40 0x7f780815d610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 >> 172.21.15.146:0/3723512842 conn(0x7f78080b17b0 msgr2=0x7f78081546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:07.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 shutdown_connections 2024-04-24T23:02:07.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.382+0000 7f780ec00640 1 -- 172.21.15.146:0/3723512842 wait complete. 2024-04-24T23:02:07.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:02:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.606+0000 7fa09e800640 1 Processor -- start 2024-04-24T23:02:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.607+0000 7fa09e800640 1 -- start start 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa0980cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09e800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0980b4df0 con 0x7fa0980d03d0 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09e800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0980b4b10 con 0x7fa09815cd60 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa09815c8d0 con 0x7fa09815bcd0 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0980d03d0 0x7fa09815f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53968/0 (socket says 172.21.15.146:53968) 2024-04-24T23:02:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.608+0000 7fa09de00640 1 -- 172.21.15.146:0/296967889 learned_addr learned my addr 172.21.15.146:0/296967889 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105125182 0 0) 0x7fa0980b4df0 con 0x7fa0980d03d0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa09d400640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa0980cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa07c003520 con 0x7fa0980d03d0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360634450 0 0) 0x7fa07c003520 con 0x7fa0980d03d0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 msgr2=0x7fa0980cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa0980cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 >> v1:172.21.15.203:6789/0 conn(0x7fa09815cd60 legacy=0x7fa0980cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09815c280 con 0x7fa0980d03d0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fa0900019f0 con 0x7fa0980d03d0 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 >> v1:172.21.15.146:6789/0 conn(0x7fa0980d03d0 legacy=0x7fa09815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c0039e0 0x7fa07c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa07c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa07c004d40 0x7fa07c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa09815c8d0 con 0x7fa07c004d40 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c00bb50 con 0x7fa07c0039e0 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.609+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa07c00bd20 con 0x7fa09815bcd0 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa07c004d40 0x7fa07c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09d400640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c0039e0 0x7fa07c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09ca00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa07c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 -- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 msgr2=0x7fa07c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815bcd0 0x7fa07c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 -- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c0039e0 msgr2=0x7fa07c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c0039e0 0x7fa07c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.610+0000 7fa09de00640 1 -- 172.21.15.146:0/296967889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c003520 con 0x7fa07c004d40 2024-04-24T23:02:07.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.611+0000 7fa09de00640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa07c004d40 0x7fa07c0051c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa09000a850 tx=0x7fa07c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340c6f6e689e7a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09000a4a0 con 0x7fa07c004d40 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09002f070 con 0x7fa07c004d40 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa097e00640 1 -- 172.21.15.146:0/296967889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09002bca0 con 0x7fa07c004d40 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 -- 172.21.15.146:0/296967889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa07c004d40 msgr2=0x7fa07c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 --2- 172.21.15.146:0/296967889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa07c004d40 0x7fa07c0051c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa09000a850 tx=0x7fa07c005830 comp rx=0 tx=0).stop 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09de00640 1 -- 172.21.15.146:0/296967889 reap_dead start 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 -- 172.21.15.146:0/296967889 shutdown_connections 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 -- 172.21.15.146:0/296967889 >> 172.21.15.146:0/296967889 conn(0x7fa09806b560 msgr2=0x7fa09806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 -- 172.21.15.146:0/296967889 shutdown_connections 2024-04-24T23:02:07.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.612+0000 7fa09e800640 1 -- 172.21.15.146:0/296967889 wait complete. 2024-04-24T23:02:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.614+0000 7fa09e800640 1 Processor -- start 2024-04-24T23:02:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.614+0000 7fa09e800640 1 -- start start 2024-04-24T23:02:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c004d40 0x7fa098148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815ab80 0x7fa09815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa0980b4790 con 0x7fa09814fe30 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa09806e590 con 0x7fa07c004d40 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa0980cc230 con 0x7fa09815ab80 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.615+0000 7fa09ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40608/0 (socket says 172.21.15.146:40608) 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 -- 172.21.15.146:0/4017833144 learned_addr learned my addr 172.21.15.146:0/4017833144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 -- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815ab80 msgr2=0x7fa09815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815ab80 0x7fa09815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 -- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c004d40 msgr2=0x7fa098148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c004d40 0x7fa098148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 -- 172.21.15.146:0/4017833144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0981502b0 con 0x7fa09814fe30 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09ca00640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa08400e550 tx=0x7fa08400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840052e0 con 0x7fa09814fe30 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084018070 con 0x7fa09814fe30 2024-04-24T23:02:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084003810 con 0x7fa09814fe30 2024-04-24T23:02:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.616+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09814d740 con 0x7fa09814fe30 2024-04-24T23:02:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.617+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09814dcc0 con 0x7fa09814fe30 2024-04-24T23:02:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.618+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09804f500 con 0x7fa09814fe30 2024-04-24T23:02:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.619+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0840039b0 con 0x7fa09814fe30 2024-04-24T23:02:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.620+0000 7fa095600640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 0x7fa07806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.620+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fa08408ac80 con 0x7fa09814fe30 2024-04-24T23:02:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.621+0000 7fa09d400640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 0x7fa07806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:07.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.622+0000 7fa09d400640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 0x7fa07806e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa088006fd0 tx=0x7fa08800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.625+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa0981502b0 con 0x7fa09814fe30 2024-04-24T23:02:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.826+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa0980cf030 con 0x7fa09814fe30 2024-04-24T23:02:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.827+0000 7fa095600640 1 -- 172.21.15.146:0/4017833144 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7fa084059450 con 0x7fa09814fe30 2024-04-24T23:02:07.829 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:02:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.830+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 msgr2=0x7fa07806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.830+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 0x7fa07806e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa088006fd0 tx=0x7fa08800b2e0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.830+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 msgr2=0x7fa09814d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.830+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa08400e550 tx=0x7fa08400ea10 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 shutdown_connections 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa07806be60 0x7fa07806e320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa09815ab80 0x7fa09815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09814fe30 0x7fa09814d200 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 --2- 172.21.15.146:0/4017833144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa07c004d40 0x7fa098148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 >> 172.21.15.146:0/4017833144 conn(0x7fa09806b560 msgr2=0x7fa0981566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 shutdown_connections 2024-04-24T23:02:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:07.831+0000 7fa09e800640 1 -- 172.21.15.146:0/4017833144 wait complete. 2024-04-24T23:02:07.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:02:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.051+0000 7fbc75400640 1 Processor -- start 2024-04-24T23:02:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.051+0000 7fbc75400640 1 -- start start 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc75400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015bcd0 0x7fbc700cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc75400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc700d03d0 0x7fbc7015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc75400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc700b4df0 con 0x7fbc7015cd60 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc75400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbc7015c8d0 con 0x7fbc700d03d0 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc75400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700b4b10 con 0x7fbc7015bcd0 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc74a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc700d03d0 0x7fbc7015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc74a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc700d03d0 0x7fbc7015f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37882/0 (socket says 172.21.15.146:37882) 2024-04-24T23:02:08.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc74a00640 1 -- 172.21.15.146:0/916391382 learned_addr learned my addr 172.21.15.146:0/916391382 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:08.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.053+0000 7fbc6fe00640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015bcd0 0x7fbc700cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.054+0000 7fbc74a00640 1 -- 172.21.15.146:0/916391382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015bcd0 msgr2=0x7fbc700cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.054+0000 7fbc74a00640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015bcd0 0x7fbc700cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.054+0000 7fbc74a00640 1 -- 172.21.15.146:0/916391382 >> v1:172.21.15.203:6789/0 conn(0x7fbc7015cd60 legacy=0x7fbc700cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.054+0000 7fbc74a00640 1 -- 172.21.15.146:0/916391382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7015c280 con 0x7fbc700d03d0 2024-04-24T23:02:08.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.055+0000 7fbc74a00640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc700d03d0 0x7fbc7015f6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009e50 tx=0x7fbc6802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c90b73eb2d3ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.055+0000 7fbc6f400640 1 -- 172.21.15.146:0/916391382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68036070 con 0x7fbc700d03d0 2024-04-24T23:02:08.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.055+0000 7fbc6f400640 1 -- 172.21.15.146:0/916391382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc68031600 con 0x7fbc700d03d0 2024-04-24T23:02:08.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.055+0000 7fbc6f400640 1 -- 172.21.15.146:0/916391382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc680319d0 con 0x7fbc700d03d0 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 -- 172.21.15.146:0/916391382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc700d03d0 msgr2=0x7fbc7015f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc700d03d0 0x7fbc7015f6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009e50 tx=0x7fbc6802a6c0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 -- 172.21.15.146:0/916391382 shutdown_connections 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc700d03d0 0x7fbc7015f6f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 --2- 172.21.15.146:0/916391382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015bcd0 0x7fbc700cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 -- 172.21.15.146:0/916391382 >> 172.21.15.146:0/916391382 conn(0x7fbc7006b560 msgr2=0x7fbc7006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:08.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 -- 172.21.15.146:0/916391382 shutdown_connections 2024-04-24T23:02:08.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.056+0000 7fbc75400640 1 -- 172.21.15.146:0/916391382 wait complete. 2024-04-24T23:02:08.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.058+0000 7fbc75400640 1 Processor -- start 2024-04-24T23:02:08.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.058+0000 7fbc75400640 1 -- start start 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 0x7fbc701525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015cd60 0x7fbc701f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7006e590 con 0x7fbc7015bcd0 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc700cc770 con 0x7fbc700d03d0 2024-04-24T23:02:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc75400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700b4790 con 0x7fbc7015cd60 2024-04-24T23:02:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.059+0000 7fbc67400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37894/0 (socket says 172.21.15.146:37894) 2024-04-24T23:02:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 -- 172.21.15.146:0/1258822386 learned_addr learned my addr 172.21.15.146:0/1258822386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc6fe00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 0x7fbc701525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc74a00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015cd60 0x7fbc701f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 -- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015cd60 msgr2=0x7fbc701f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015cd60 0x7fbc701f74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 -- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 msgr2=0x7fbc701525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 0x7fbc701525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 -- 172.21.15.146:0/1258822386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc700c9180 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc6fe00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 0x7fbc701525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.060+0000 7fbc67400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800b3f0 tx=0x7fbc5800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.061+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58015020 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.061+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc58011830 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.061+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58011c20 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.061+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc700c8ea0 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.061+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc70155070 con 0x7fbc7015bcd0 2024-04-24T23:02:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.062+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7004f500 con 0x7fbc7015bcd0 2024-04-24T23:02:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.063+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc58018020 con 0x7fbc7015bcd0 2024-04-24T23:02:08.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.064+0000 7fbc6cc00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 0x7fbc4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.065+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fbc5808ad20 con 0x7fbc7015bcd0 2024-04-24T23:02:08.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.065+0000 7fbc6fe00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 0x7fbc4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.066+0000 7fbc6fe00640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 0x7fbc4c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006fd0 tx=0x7fbc60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.070+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc5801f030 con 0x7fbc7015bcd0 2024-04-24T23:02:08.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.271+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbc700cf030 con 0x7fbc7015bcd0 2024-04-24T23:02:08.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.272+0000 7fbc6cc00640 1 -- 172.21.15.146:0/1258822386 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7fbc58059450 con 0x7fbc7015bcd0 2024-04-24T23:02:08.274 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.274+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 msgr2=0x7fbc4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.274+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 0x7fbc4c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc60006fd0 tx=0x7fbc60008040 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 msgr2=0x7fbc70145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800b3f0 tx=0x7fbc5800b8b0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 shutdown_connections 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc4c06be30 0x7fbc4c06e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc7015cd60 0x7fbc701f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc7015bcd0 0x7fbc70145520 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 --2- 172.21.15.146:0/1258822386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc700d03d0 0x7fbc701525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 >> 172.21.15.146:0/1258822386 conn(0x7fbc7006b560 msgr2=0x7fbc700ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:08.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 shutdown_connections 2024-04-24T23:02:08.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.275+0000 7fbc75400640 1 -- 172.21.15.146:0/1258822386 wait complete. 2024-04-24T23:02:08.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:08.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.489+0000 7f8afbe00640 1 Processor -- start 2024-04-24T23:02:08.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.489+0000 7f8afbe00640 1 -- start start 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afbe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8afc0d0240 0x7f8afc0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8afc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc070f90 con 0x7f8afc1561c0 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afbe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8afc0b4310 con 0x7f8afc0d0240 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc1565a0 con 0x7f8afc0709d0 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afaa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8afc1561c0 0x7f8afc0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36176/0 (socket says 172.21.15.146:36176) 2024-04-24T23:02:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afaa00640 1 -- 172.21.15.146:0/457507516 learned_addr learned my addr 172.21.15.146:0/457507516 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8af3e00640 1 --2- 172.21.15.146:0/457507516 >> v2:172.21.15.203:3300/0 conn(0x7f8afc0d0240 0x7f8afc0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afb400640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8afc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.491+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006775794 0 0) 0x7f8afc070f90 con 0x7f8afc1561c0 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae0003520 con 0x7f8afc1561c0 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450349913 0 0) 0x7f8ae0003520 con 0x7f8afc1561c0 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 msgr2=0x7f8afc15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8afc15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 >> v2:172.21.15.203:3300/0 conn(0x7f8afc0d0240 msgr2=0x7f8afc0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 --2- 172.21.15.146:0/457507516 >> v2:172.21.15.203:3300/0 conn(0x7f8afc0d0240 0x7f8afc0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc071270 con 0x7f8afc1561c0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f8aec001670 con 0x7f8afc1561c0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 >> v1:172.21.15.146:6789/0 conn(0x7f8afc1561c0 legacy=0x7f8afc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae00039b0 0x7f8ae0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8ae0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae0004d40 0x7f8ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0b4310 con 0x7f8ae00039b0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae000baa0 con 0x7f8ae0004d40 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae000bca0 con 0x7f8afc0709d0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.492+0000 7f8afaa00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae00039b0 0x7f8ae0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afb400640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae0004d40 0x7f8ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8af3e00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8ae0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afaa00640 1 -- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 msgr2=0x7f8ae0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afaa00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8afc0709d0 0x7f8ae0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afaa00640 1 -- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae0004d40 msgr2=0x7f8ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afaa00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae0004d40 0x7f8ae00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.493+0000 7f8afaa00640 1 -- 172.21.15.146:0/457507516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0003520 con 0x7f8ae00039b0 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.494+0000 7f8afaa00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae00039b0 0x7f8ae0003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c240 tx=0x7f8ae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3087efc716fed99a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.494+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec02e070 con 0x7f8ae00039b0 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.494+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec005af0 con 0x7f8ae00039b0 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.494+0000 7f8afa000640 1 -- 172.21.15.146:0/457507516 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec007d30 con 0x7f8ae00039b0 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 -- 172.21.15.146:0/457507516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae00039b0 msgr2=0x7f8ae0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 --2- 172.21.15.146:0/457507516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae00039b0 0x7f8ae0003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c240 tx=0x7f8ae0005830 comp rx=0 tx=0).stop 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afb400640 1 -- 172.21.15.146:0/457507516 reap_dead start 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 -- 172.21.15.146:0/457507516 shutdown_connections 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 -- 172.21.15.146:0/457507516 >> 172.21.15.146:0/457507516 conn(0x7f8afc06b320 msgr2=0x7f8afc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 -- 172.21.15.146:0/457507516 shutdown_connections 2024-04-24T23:02:08.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.495+0000 7f8afbe00640 1 -- 172.21.15.146:0/457507516 wait complete. 2024-04-24T23:02:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.497+0000 7f8afbe00640 1 Processor -- start 2024-04-24T23:02:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.497+0000 7f8afbe00640 1 -- start start 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 0x7f8afc1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 0x7f8afc156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc15cb80 con 0x7f8afc1483f0 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc071830 con 0x7f8afc158e20 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8afc15cd00 con 0x7f8ae00039b0 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8af3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8af3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37922/0 (socket says 172.21.15.146:37922) 2024-04-24T23:02:08.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8af3e00640 1 -- 172.21.15.146:0/3269798713 learned_addr learned my addr 172.21.15.146:0/3269798713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.498+0000 7f8afaa00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 0x7f8afc1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8afb400640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 0x7f8afc156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 -- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 msgr2=0x7f8afc1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 0x7f8afc1509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 -- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 msgr2=0x7f8afc156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 0x7f8afc156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 -- 172.21.15.146:0/3269798713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc0b07b0 con 0x7f8afc1483f0 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8afaa00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 0x7f8afc1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8afb400640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 0x7f8afc156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3e00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40108e0 tx=0x7f8ae4010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae400f040 con 0x7f8afc1483f0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae400eb00 con 0x7f8afc1483f0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc0b0a90 con 0x7f8afc1483f0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.499+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae401c400 con 0x7f8afc1483f0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.500+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1592a0 con 0x7f8afc1483f0 2024-04-24T23:02:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.501+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc04f500 con 0x7f8afc1483f0 2024-04-24T23:02:08.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.502+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ae401c5a0 con 0x7f8afc1483f0 2024-04-24T23:02:08.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.503+0000 7f8af3400640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 0x7f8ad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.503+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f8ae408b680 con 0x7f8afc1483f0 2024-04-24T23:02:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.503+0000 7f8afaa00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 0x7f8ad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.504+0000 7f8afaa00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 0x7f8ad806e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8aec033000 tx=0x7f8aec009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.507+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8ae4018030 con 0x7f8afc1483f0 2024-04-24T23:02:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.746+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8afc0b0c60 con 0x7f8afc1483f0 2024-04-24T23:02:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.747+0000 7f8af3400640 1 -- 172.21.15.146:0/3269798713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5188 (secure 0 0 0) 0x7f8ae4059db0 con 0x7f8afc1483f0 2024-04-24T23:02:08.750 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:08.750 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:02:00.535735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5532,"qdb_cluster":[5532]},"id":2}]} 2024-04-24T23:02:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2024-04-24T23:02:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 msgr2=0x7f8ad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 0x7f8ad806e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8aec033000 tx=0x7f8aec009030 comp rx=0 tx=0).stop 2024-04-24T23:02:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 msgr2=0x7f8afc1f3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40108e0 tx=0x7f8ae4010da0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 shutdown_connections 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8afc158e20 0x7f8afc156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8afc1483f0 0x7f8afc1f3920 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8ad806be30 0x7f8ad806e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 --2- 172.21.15.146:0/3269798713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8ae00039b0 0x7f8afc1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 >> 172.21.15.146:0/3269798713 conn(0x7f8afc06b320 msgr2=0x7f8afc0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.750+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 shutdown_connections 2024-04-24T23:02:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.751+0000 7f8afbe00640 1 -- 172.21.15.146:0/3269798713 wait complete. 2024-04-24T23:02:08.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.965+0000 7f7cb9200640 1 Processor -- start 2024-04-24T23:02:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.965+0000 7f7cb9200640 1 -- start start 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb9200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7cb4161530 0x7f7cb40d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7cb40d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb9200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb40b36c0 con 0x7f7cb40d0740 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb9200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb40d0bb0 con 0x7f7cb4161530 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb40cf7d0 con 0x7f7cb4161910 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7cb40d0740 0x7f7cb40d1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36192/0 (socket says 172.21.15.146:36192) 2024-04-24T23:02:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.967+0000 7f7cb3e00640 1 -- 172.21.15.146:0/231102388 learned_addr learned my addr 172.21.15.146:0/231102388 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb3400640 1 --2- 172.21.15.146:0/231102388 >> v2:172.21.15.203:3300/0 conn(0x7f7cb4161530 0x7f7cb40d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2a00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7cb40d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378993863 0 0) 0x7f7cb40b36c0 con 0x7f7cb40d0740 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c98003520 con 0x7f7cb40d0740 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4091229937 0 0) 0x7f7c98003520 con 0x7f7cb40d0740 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 msgr2=0x7f7cb40d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7cb40d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 >> v2:172.21.15.203:3300/0 conn(0x7f7cb4161530 msgr2=0x7f7cb40d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 --2- 172.21.15.146:0/231102388 >> v2:172.21.15.203:3300/0 conn(0x7f7cb4161530 0x7f7cb40d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb40cfab0 con 0x7f7cb40d0740 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7cac001a10 con 0x7f7cb40d0740 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 >> v1:172.21.15.146:6789/0 conn(0x7f7cb40d0740 legacy=0x7f7cb40d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.968+0000 7f7cb2000640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7c980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2000640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c98003f80 0x7f7c98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2000640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c98004d40 0x7f7c980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb40d0bb0 con 0x7f7c98004d40 2024-04-24T23:02:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb40cf7d0 con 0x7f7c98003f80 2024-04-24T23:02:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9800ba40 con 0x7f7cb4161910 2024-04-24T23:02:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c98004d40 0x7f7c980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3400640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7c980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb2a00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c98003f80 0x7f7c98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 -- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 msgr2=0x7f7c980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7cb4161910 0x7f7c980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 -- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c98003f80 msgr2=0x7f7c98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c98003f80 0x7f7c98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.969+0000 7f7cb3e00640 1 -- 172.21.15.146:0/231102388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c98003520 con 0x7f7c98004d40 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.970+0000 7f7cb3e00640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c98004d40 0x7f7c980051c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a7a0 tx=0x7f7c98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952ad8960b39c1e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00a3f0 con 0x7f7c98004d40 2024-04-24T23:02:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cac02f070 con 0x7f7c98004d40 2024-04-24T23:02:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb2000640 1 -- 172.21.15.146:0/231102388 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac02bbe0 con 0x7f7c98004d40 2024-04-24T23:02:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 -- 172.21.15.146:0/231102388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c98004d40 msgr2=0x7f7c980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 --2- 172.21.15.146:0/231102388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c98004d40 0x7f7c980051c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a7a0 tx=0x7f7c98005830 comp rx=0 tx=0).stop 2024-04-24T23:02:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb3e00640 1 -- 172.21.15.146:0/231102388 reap_dead start 2024-04-24T23:02:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 -- 172.21.15.146:0/231102388 shutdown_connections 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 -- 172.21.15.146:0/231102388 >> 172.21.15.146:0/231102388 conn(0x7f7cb40d3cc0 msgr2=0x7f7cb40d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 -- 172.21.15.146:0/231102388 shutdown_connections 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.971+0000 7f7cb9200640 1 -- 172.21.15.146:0/231102388 wait complete. 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.973+0000 7f7cb9200640 1 Processor -- start 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.973+0000 7f7cb9200640 1 -- start start 2024-04-24T23:02:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c98004d40 0x7f7cb4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7cb41566f0 0x7f7cb40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb40d0f30 con 0x7f7cb41543f0 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb40cfd90 con 0x7f7cb41566f0 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.974+0000 7f7cb9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb40d10b0 con 0x7f7c98004d40 2024-04-24T23:02:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37952/0 (socket says 172.21.15.146:37952) 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 -- 172.21.15.146:0/3412730039 learned_addr learned my addr 172.21.15.146:0/3412730039 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb3400640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c98004d40 0x7f7cb4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 -- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c98004d40 msgr2=0x7f7cb4158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c98004d40 0x7f7cb4158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 -- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7cb41566f0 msgr2=0x7f7cb40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb3e00640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7cb41566f0 0x7f7cb40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7cb41566f0 0x7f7cb40ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 -- 172.21.15.146:0/3412730039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb4157100 con 0x7f7cb41543f0 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.975+0000 7f7cb2a00640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c011560 tx=0x7f7c9c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.976+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c015930 con 0x7f7cb41543f0 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.976+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c015ad0 con 0x7f7cb41543f0 2024-04-24T23:02:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.976+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c01d400 con 0x7f7cb41543f0 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.976+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb40caf10 con 0x7f7cb41543f0 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.976+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb4156b80 con 0x7f7cb41543f0 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.977+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb404f500 con 0x7f7cb41543f0 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.978+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c9c01d5a0 con 0x7f7cb41543f0 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.979+0000 7f7cab400640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.979+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f7c9c08b8b0 con 0x7f7cb41543f0 2024-04-24T23:02:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.980+0000 7f7cb3400640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.981+0000 7f7cb3400640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 0x7f7c9006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40099b0 tx=0x7f7ca4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:08.983+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7c9c019030 con 0x7f7cb41543f0 2024-04-24T23:02:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.179+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cb4156e40 con 0x7f7cb41543f0 2024-04-24T23:02:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.181+0000 7f7cab400640 1 -- 172.21.15.146:0/3412730039 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17095 (secure 0 0 0) 0x7f7c9c059a20 con 0x7f7cb41543f0 2024-04-24T23:02:09.184 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:09.184 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:48.482746+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 msgr2=0x7f7c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 0x7f7c9006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40099b0 tx=0x7f7ca4008040 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 msgr2=0x7f7cb4153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c011560 tx=0x7f7c9c009f90 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 shutdown_connections 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7cb41566f0 0x7f7cb40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb41543f0 0x7f7cb4153c60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 --2- 172.21.15.146:0/3412730039 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c98004d40 0x7f7cb4158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.184+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 >> 172.21.15.146:0/3412730039 conn(0x7f7cb40d3cc0 msgr2=0x7f7cb415f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.185+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 shutdown_connections 2024-04-24T23:02:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.185+0000 7f7cb9200640 1 -- 172.21.15.146:0/3412730039 wait complete. 2024-04-24T23:02:09.206 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:02:09.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.402+0000 7f3523e00640 1 Processor -- start 2024-04-24T23:02:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.402+0000 7f3523e00640 1 -- start start 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.403+0000 7f3523e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35240d0240 0x7f352406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.403+0000 7f3523e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35240ccb10 con 0x7f3524071dd0 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.403+0000 7f3523e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352406ddc0 con 0x7f352415a980 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.403+0000 7f3523e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3524072240 con 0x7f35240d0240 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f3523400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3524071dd0 0x7f35240ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36198/0 (socket says 172.21.15.146:36198) 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f3523400640 1 -- 172.21.15.146:0/3850538472 learned_addr learned my addr 172.21.15.146:0/3850538472 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f351a000640 1 --2- 172.21.15.146:0/3850538472 >> v2:172.21.15.146:3300/0 conn(0x7f35240d0240 0x7f352406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f351a000640 1 -- 172.21.15.146:0/3850538472 >> v1:172.21.15.203:6789/0 conn(0x7f352415a980 legacy=0x7f35240cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f351a000640 1 -- 172.21.15.146:0/3850538472 >> v1:172.21.15.146:6789/0 conn(0x7f3524071dd0 legacy=0x7f35240ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f3522000640 1 -- 172.21.15.146:0/3850538472 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516924969 0 0) 0x7f351c001110 con 0x7f3524071dd0 2024-04-24T23:02:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.404+0000 7f351a000640 1 -- 172.21.15.146:0/3850538472 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352406e0a0 con 0x7f35240d0240 2024-04-24T23:02:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.406+0000 7f351a000640 1 --2- 172.21.15.146:0/3850538472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35240d0240 0x7f352406d770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097a0 tx=0x7f350c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0c349e1a7618ce server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.406+0000 7f3522000640 1 -- 172.21.15.146:0/3850538472 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c037070 con 0x7f35240d0240 2024-04-24T23:02:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.406+0000 7f3522000640 1 -- 172.21.15.146:0/3850538472 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c032440 con 0x7f35240d0240 2024-04-24T23:02:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.406+0000 7f3522000640 1 -- 172.21.15.146:0/3850538472 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c032810 con 0x7f35240d0240 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 -- 172.21.15.146:0/3850538472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35240d0240 msgr2=0x7f352406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 --2- 172.21.15.146:0/3850538472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35240d0240 0x7f352406d770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097a0 tx=0x7f350c02a1a0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 -- 172.21.15.146:0/3850538472 shutdown_connections 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 --2- 172.21.15.146:0/3850538472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35240d0240 0x7f352406d770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 -- 172.21.15.146:0/3850538472 >> 172.21.15.146:0/3850538472 conn(0x7f352406b320 msgr2=0x7f352406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 -- 172.21.15.146:0/3850538472 shutdown_connections 2024-04-24T23:02:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.407+0000 7f3523e00640 1 -- 172.21.15.146:0/3850538472 wait complete. 2024-04-24T23:02:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.409+0000 7f3523e00640 1 Processor -- start 2024-04-24T23:02:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.409+0000 7f3523e00640 1 -- start start 2024-04-24T23:02:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35240d0240 0x7f3524145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f352415a980 0x7f35240ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f352406e660 con 0x7f3524071dd0 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35240aede0 con 0x7f35240d0240 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3523e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f352415ad60 con 0x7f352415a980 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37974/0 (socket says 172.21.15.146:37974) 2024-04-24T23:02:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 -- 172.21.15.146:0/1456882110 learned_addr learned my addr 172.21.15.146:0/1456882110 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f351a000640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35240d0240 0x7f3524145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 -- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f352415a980 msgr2=0x7f35240ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f352415a980 0x7f35240ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 -- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35240d0240 msgr2=0x7f3524145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35240d0240 0x7f3524145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.410+0000 7f3522a00640 1 -- 172.21.15.146:0/1456882110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3524145890 con 0x7f3524071dd0 2024-04-24T23:02:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f3522a00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f351400c870 tx=0x7f351400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514003b70 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3514003d30 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351400aa90 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35241594d0 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.411+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3524159a90 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.412+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f352404f500 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.413+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f351400ac30 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.414+0000 7f351b400640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 0x7f350006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.414+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f351408b0b0 con 0x7f3524071dd0 2024-04-24T23:02:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.415+0000 7f351a000640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 0x7f350006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.416+0000 7f351a000640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 0x7f350006e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f350c034000 tx=0x7f350c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.419+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f35140597e0 con 0x7f3524071dd0 2024-04-24T23:02:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.656+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35240af090 con 0x7f3524071dd0 2024-04-24T23:02:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.659+0000 7f351b400640 1 -- 172.21.15.146:0/1456882110 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5188 (secure 0 0 0) 0x7f35140590e0 con 0x7f3524071dd0 2024-04-24T23:02:09.661 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:02:00.535735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5532,"qdb_cluster":[5532]},"id":2}]} 2024-04-24T23:02:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2024-04-24T23:02:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 msgr2=0x7f350006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 0x7f350006e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f350c034000 tx=0x7f350c02e000 comp rx=0 tx=0).stop 2024-04-24T23:02:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 msgr2=0x7f35241f4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f351400c870 tx=0x7f351400cd30 comp rx=0 tx=0).stop 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 shutdown_connections 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f350006be30 0x7f350006e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f352415a980 0x7f35240ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35240d0240 0x7f3524145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 --2- 172.21.15.146:0/1456882110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3524071dd0 0x7f35241f4650 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 >> 172.21.15.146:0/1456882110 conn(0x7f352406b320 msgr2=0x7f352406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 shutdown_connections 2024-04-24T23:02:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.662+0000 7f3523e00640 1 -- 172.21.15.146:0/1456882110 wait complete. 2024-04-24T23:02:09.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.878+0000 7f3839800640 1 Processor -- start 2024-04-24T23:02:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.878+0000 7f3839800640 1 -- start start 2024-04-24T23:02:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3839800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38340715f0 0x7f3834071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3839800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 0x7f38340d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3839800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3834158970 con 0x7f3834158590 2024-04-24T23:02:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3839800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f38340d0640 con 0x7f38340715f0 2024-04-24T23:02:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3839800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3834070c10 con 0x7f38340cfc90 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f382be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38340715f0 0x7f3834071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3832a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3834158590 0x7f3834162450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36206/0 (socket says 172.21.15.146:36206) 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f382be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38340715f0 0x7f3834071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37988/0 (socket says 172.21.15.146:37988) 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.880+0000 7f3832a00640 1 -- 172.21.15.146:0/1843190198 learned_addr learned my addr 172.21.15.146:0/1843190198 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f3833400640 1 --2- 172.21.15.146:0/1843190198 >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 0x7f38340d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f382be00640 1 -- 172.21.15.146:0/1843190198 >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 msgr2=0x7f38340d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f382be00640 1 --2- 172.21.15.146:0/1843190198 >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 0x7f38340d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f382be00640 1 -- 172.21.15.146:0/1843190198 >> v1:172.21.15.146:6789/0 conn(0x7f3834158590 legacy=0x7f3834162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f382be00640 1 -- 172.21.15.146:0/1843190198 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3834070ef0 con 0x7f38340715f0 2024-04-24T23:02:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.881+0000 7f3833400640 1 --2- 172.21.15.146:0/1843190198 >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 0x7f38340d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.882+0000 7f382be00640 1 --2- 172.21.15.146:0/1843190198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340715f0 0x7f3834071a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f38340aed30 tx=0x7f381c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ab280478f695ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.882+0000 7f3832000640 1 -- 172.21.15.146:0/1843190198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f38340715f0 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.882+0000 7f3832000640 1 -- 172.21.15.146:0/1843190198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c032440 con 0x7f38340715f0 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.882+0000 7f3832000640 1 -- 172.21.15.146:0/1843190198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c032810 con 0x7f38340715f0 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 -- 172.21.15.146:0/1843190198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340715f0 msgr2=0x7f3834071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 --2- 172.21.15.146:0/1843190198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340715f0 0x7f3834071a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f38340aed30 tx=0x7f381c02a250 comp rx=0 tx=0).stop 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 -- 172.21.15.146:0/1843190198 shutdown_connections 2024-04-24T23:02:09.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 --2- 172.21.15.146:0/1843190198 >> v2:172.21.15.203:3300/0 conn(0x7f38340cfc90 0x7f38340d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 --2- 172.21.15.146:0/1843190198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340715f0 0x7f3834071a70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 -- 172.21.15.146:0/1843190198 >> 172.21.15.146:0/1843190198 conn(0x7f383406b320 msgr2=0x7f383406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:09.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 -- 172.21.15.146:0/1843190198 shutdown_connections 2024-04-24T23:02:09.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.883+0000 7f3839800640 1 -- 172.21.15.146:0/1843190198 wait complete. 2024-04-24T23:02:09.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.885+0000 7f3839800640 1 Processor -- start 2024-04-24T23:02:09.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.885+0000 7f3839800640 1 -- start start 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.886+0000 7f3839800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 0x7f3834158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.886+0000 7f3839800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.886+0000 7f3839800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3834158590 0x7f38340af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.886+0000 7f3839800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3834161f30 con 0x7f38340cfc90 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.886+0000 7f3839800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3834161c50 con 0x7f38340715f0 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f3839800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f383415e4e0 con 0x7f3834158590 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38002/0 (socket says 172.21.15.146:38002) 2024-04-24T23:02:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 -- 172.21.15.146:0/2345991156 learned_addr learned my addr 172.21.15.146:0/2345991156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f3832a00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 0x7f3834158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 -- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3834158590 msgr2=0x7f38340af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3834158590 0x7f38340af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 -- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 msgr2=0x7f3834158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 0x7f3834158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f382be00640 1 -- 172.21.15.146:0/2345991156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38340b00e0 con 0x7f38340cfc90 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.887+0000 7f3832a00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 0x7f3834158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f382be00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f381c009890 tx=0x7f381c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037040 con 0x7f38340cfc90 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c042070 con 0x7f38340cfc90 2024-04-24T23:02:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383415f700 con 0x7f38340cfc90 2024-04-24T23:02:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c030a50 con 0x7f38340cfc90 2024-04-24T23:02:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.888+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38340b03c0 con 0x7f38340cfc90 2024-04-24T23:02:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.889+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3834068190 con 0x7f38340cfc90 2024-04-24T23:02:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.890+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f381c030bf0 con 0x7f38340cfc90 2024-04-24T23:02:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.891+0000 7f382aa00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 0x7f381006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.891+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f381c0abb30 con 0x7f38340cfc90 2024-04-24T23:02:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.892+0000 7f3832a00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 0x7f381006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.893+0000 7f3832a00640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 0x7f381006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3824000f60 tx=0x7f3824009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:09.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:09.896+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f381c045360 con 0x7f38340cfc90 2024-04-24T23:02:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.130+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38340ced50 con 0x7f38340cfc90 2024-04-24T23:02:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.131+0000 7f382aa00640 1 -- 172.21.15.146:0/2345991156 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5188 (secure 0 0 0) 0x7f381c07a260 con 0x7f38340cfc90 2024-04-24T23:02:10.133 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:10.133 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:01:34.503652+0000","modified":"2024-04-24T23:02:00.535735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5532":{"gid":5532,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.146:6835/4112366095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":4112366095},{"type":"v1","addr":"172.21.15.146:6835","nonce":4112366095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5532,"qdb_cluster":[5532]},"id":2}]} 2024-04-24T23:02:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.133+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 msgr2=0x7f381006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.133+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 0x7f381006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3824000f60 tx=0x7f3824009040 comp rx=0 tx=0).stop 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.133+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 msgr2=0x7f38341553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.133+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f381c009890 tx=0x7f381c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 shutdown_connections 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f381006be60 0x7f381006e320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3834158590 0x7f38340af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38340cfc90 0x7f38341553f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 --2- 172.21.15.146:0/2345991156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340715f0 0x7f3834158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 >> 172.21.15.146:0/2345991156 conn(0x7f383406b320 msgr2=0x7f3834157830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 shutdown_connections 2024-04-24T23:02:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.134+0000 7f3839800640 1 -- 172.21.15.146:0/2345991156 wait complete. 2024-04-24T23:02:10.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.355+0000 7fbe6f400640 1 Processor -- start 2024-04-24T23:02:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.355+0000 7fbe6f400640 1 -- start start 2024-04-24T23:02:10.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe6806c460 0x7fbe680b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe680b6210 0x7fbe680b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6f400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe680b27b0 con 0x7fbe680d00a0 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6f400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbe6806cc60 con 0x7fbe680b6210 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6f400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe680b5d80 con 0x7fbe6806c460 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe680b6210 0x7fbe680b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe680b6210 0x7fbe680b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38004/0 (socket says 172.21.15.146:38004) 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe6d400640 1 -- 172.21.15.146:0/1527289301 learned_addr learned my addr 172.21.15.146:0/1527289301 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.358+0000 7fbe5fe00640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe6806c460 0x7fbe680b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.359+0000 7fbe6d400640 1 -- 172.21.15.146:0/1527289301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe6806c460 msgr2=0x7fbe680b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.359+0000 7fbe6d400640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe6806c460 0x7fbe680b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.359+0000 7fbe6d400640 1 -- 172.21.15.146:0/1527289301 >> v1:172.21.15.203:6789/0 conn(0x7fbe680d00a0 legacy=0x7fbe680d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.359+0000 7fbe6d400640 1 -- 172.21.15.146:0/1527289301 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6806ceb0 con 0x7fbe680b6210 2024-04-24T23:02:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.360+0000 7fbe6d400640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680b6210 0x7fbe680b66a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009e50 tx=0x7fbe6002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8377fcbf67071e9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.360+0000 7fbe67e00640 1 -- 172.21.15.146:0/1527289301 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60036070 con 0x7fbe680b6210 2024-04-24T23:02:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.360+0000 7fbe67e00640 1 -- 172.21.15.146:0/1527289301 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe60031600 con 0x7fbe680b6210 2024-04-24T23:02:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.360+0000 7fbe67e00640 1 -- 172.21.15.146:0/1527289301 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe600319d0 con 0x7fbe680b6210 2024-04-24T23:02:10.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 -- 172.21.15.146:0/1527289301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680b6210 msgr2=0x7fbe680b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680b6210 0x7fbe680b66a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009e50 tx=0x7fbe6002a5b0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 -- 172.21.15.146:0/1527289301 shutdown_connections 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680b6210 0x7fbe680b66a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 --2- 172.21.15.146:0/1527289301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe6806c460 0x7fbe680b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 -- 172.21.15.146:0/1527289301 >> 172.21.15.146:0/1527289301 conn(0x7fbe680b3860 msgr2=0x7fbe680b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 -- 172.21.15.146:0/1527289301 shutdown_connections 2024-04-24T23:02:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.361+0000 7fbe6f400640 1 -- 172.21.15.146:0/1527289301 wait complete. 2024-04-24T23:02:10.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.363+0000 7fbe6f400640 1 Processor -- start 2024-04-24T23:02:10.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.363+0000 7fbe6f400640 1 -- start start 2024-04-24T23:02:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 0x7fbe681e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe680b6210 0x7fbe681f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe680b3130 con 0x7fbe680d00a0 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6806d470 con 0x7fbe6806c460 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6f400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe680b32b0 con 0x7fbe680b6210 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.364+0000 7fbe6d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38006/0 (socket says 172.21.15.146:38006) 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 -- 172.21.15.146:0/215427226 learned_addr learned my addr 172.21.15.146:0/215427226 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6ca00640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 0x7fbe681e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe5fe00640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe680b6210 0x7fbe681f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 -- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe680b6210 msgr2=0x7fbe681f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe680b6210 0x7fbe681f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 -- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 msgr2=0x7fbe681e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 0x7fbe681e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 -- 172.21.15.146:0/215427226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe680c8410 con 0x7fbe680d00a0 2024-04-24T23:02:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6ca00640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 0x7fbe681e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:02:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.365+0000 7fbe6d400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbe60034040 tx=0x7fbe60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.366+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60036050 con 0x7fbe680d00a0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.366+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe60042070 con 0x7fbe680d00a0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.366+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60009510 con 0x7fbe680d00a0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.366+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6815f520 con 0x7fbe680d00a0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.366+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6815fae0 con 0x7fbe680d00a0 2024-04-24T23:02:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.367+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe68075220 con 0x7fbe680d00a0 2024-04-24T23:02:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.368+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe60007bd0 con 0x7fbe680d00a0 2024-04-24T23:02:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.370+0000 7fbe65600640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.370+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fbe600abf20 con 0x7fbe680d00a0 2024-04-24T23:02:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.370+0000 7fbe6ca00640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.371+0000 7fbe6ca00640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 0x7fbe4406e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbe58003eb0 tx=0x7fbe58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.375+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbe60045360 con 0x7fbe680d00a0 2024-04-24T23:02:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.573+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe6806ca40 con 0x7fbe680d00a0 2024-04-24T23:02:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.576+0000 7fbe65600640 1 -- 172.21.15.146:0/215427226 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+17095 (secure 0 0 0) 0x7fbe6007a6f0 con 0x7fbe680d00a0 2024-04-24T23:02:10.579 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:10.579 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:01:48.482746+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:01:32.305853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-24T23:01:33.507733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 msgr2=0x7fbe4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 0x7fbe4406e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbe58003eb0 tx=0x7fbe58009040 comp rx=0 tx=0).stop 2024-04-24T23:02:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 msgr2=0x7fbe681f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbe60034040 tx=0x7fbe60004a40 comp rx=0 tx=0).stop 2024-04-24T23:02:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 shutdown_connections 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe680d00a0 0x7fbe681f3750 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe680b6210 0x7fbe681f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 --2- 172.21.15.146:0/215427226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6806c460 0x7fbe681e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 >> 172.21.15.146:0/215427226 conn(0x7fbe680b3860 msgr2=0x7fbe680b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 shutdown_connections 2024-04-24T23:02:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.580+0000 7fbe6f400640 1 -- 172.21.15.146:0/215427226 wait complete. 2024-04-24T23:02:10.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:02:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.802+0000 7fca25400640 1 Processor -- start 2024-04-24T23:02:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.802+0000 7fca25400640 1 -- start start 2024-04-24T23:02:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca25400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fca200b5570 0x7fca20160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca25400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca2006cd60 0x7fca2006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca25400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2015d340 con 0x7fca20072e10 2024-04-24T23:02:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca25400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fca200b5950 con 0x7fca200b5570 2024-04-24T23:02:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca25400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fca2015cd80 con 0x7fca2006cd60 2024-04-24T23:02:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca1fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fca200b5570 0x7fca20160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.804+0000 7fca24a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca2006cd60 0x7fca2006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fca200b5570 0x7fca20160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41456/0 (socket says 172.21.15.146:41456) 2024-04-24T23:02:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 -- 172.21.15.146:0/1148040357 learned_addr learned my addr 172.21.15.146:0/1148040357 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 -- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca2006cd60 msgr2=0x7fca2006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 --2- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca2006cd60 0x7fca2006d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 -- 172.21.15.146:0/1148040357 >> v1:172.21.15.203:6789/0 conn(0x7fca20072e10 legacy=0x7fca2015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.805+0000 7fca1fe00640 1 -- 172.21.15.146:0/1148040357 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2015d060 con 0x7fca200b5570 2024-04-24T23:02:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.807+0000 7fca1fe00640 1 --2- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca200b5570 0x7fca20160270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca10009870 tx=0x7fca1002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70a30271f98a937 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.807+0000 7fca1ea00640 1 -- 172.21.15.146:0/1148040357 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10037070 con 0x7fca200b5570 2024-04-24T23:02:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.807+0000 7fca1ea00640 1 -- 172.21.15.146:0/1148040357 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10032440 con 0x7fca200b5570 2024-04-24T23:02:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.807+0000 7fca1ea00640 1 -- 172.21.15.146:0/1148040357 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10032810 con 0x7fca200b5570 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 -- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca200b5570 msgr2=0x7fca20160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 --2- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca200b5570 0x7fca20160270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca10009870 tx=0x7fca1002a270 comp rx=0 tx=0).stop 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 -- 172.21.15.146:0/1148040357 shutdown_connections 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 --2- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca2006cd60 0x7fca2006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 --2- 172.21.15.146:0/1148040357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca200b5570 0x7fca20160270 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 -- 172.21.15.146:0/1148040357 >> 172.21.15.146:0/1148040357 conn(0x7fca200cfda0 msgr2=0x7fca200d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 -- 172.21.15.146:0/1148040357 shutdown_connections 2024-04-24T23:02:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.808+0000 7fca25400640 1 -- 172.21.15.146:0/1148040357 wait complete. 2024-04-24T23:02:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.810+0000 7fca25400640 1 Processor -- start 2024-04-24T23:02:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.810+0000 7fca25400640 1 -- start start 2024-04-24T23:02:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2006cd60 0x7fca200c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca200b5570 0x7fca200c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fca2015ca80 con 0x7fca20072e10 2024-04-24T23:02:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca2015fd50 con 0x7fca2006cd60 2024-04-24T23:02:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca25400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fca201607b0 con 0x7fca200b5570 2024-04-24T23:02:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38018/0 (socket says 172.21.15.146:38018) 2024-04-24T23:02:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 -- 172.21.15.146:0/1239248396 learned_addr learned my addr 172.21.15.146:0/1239248396 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1fe00640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2006cd60 0x7fca200c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca24a00640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca200b5570 0x7fca200c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 -- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca200b5570 msgr2=0x7fca200c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca200b5570 0x7fca200c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 -- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2006cd60 msgr2=0x7fca200c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.811+0000 7fca1f400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2006cd60 0x7fca200c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca1f400640 1 -- 172.21.15.146:0/1239248396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca20158000 con 0x7fca20072e10 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca1f400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c400 tx=0x7fca0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0052d0 con 0x7fca20072e10 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c005490 con 0x7fca20072e10 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c007260 con 0x7fca20072e10 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201582e0 con 0x7fca20072e10 2024-04-24T23:02:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.812+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201588a0 con 0x7fca20072e10 2024-04-24T23:02:10.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.813+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2015e690 con 0x7fca20072e10 2024-04-24T23:02:10.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.814+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca0c007400 con 0x7fca20072e10 2024-04-24T23:02:10.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.815+0000 7fca17e00640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:10.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.815+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7fca0c08a590 con 0x7fca20072e10 2024-04-24T23:02:10.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.816+0000 7fca1fe00640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:10.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.817+0000 7fca1fe00640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 0x7fca0006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca10034000 tx=0x7fca1002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:10.820+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fca2015e690 con 0x7fca20072e10 2024-04-24T23:02:11.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.060+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fca2004f500 con 0x7fca20072e10 2024-04-24T23:02:11.064 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:02:11.062+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:02:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.066+0000 7fca17e00640 1 -- 172.21.15.146:0/1239248396 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7fca0c058d50 con 0x7fca20072e10 2024-04-24T23:02:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:02:11.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.069+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 msgr2=0x7fca0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 0x7fca0006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca10034000 tx=0x7fca1002e000 comp rx=0 tx=0).stop 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 msgr2=0x7fca200c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c400 tx=0x7fca0c00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 shutdown_connections 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca200b5570 0x7fca200c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20072e10 0x7fca200c3890 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 --2- 172.21.15.146:0/1239248396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca2006cd60 0x7fca200c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 >> 172.21.15.146:0/1239248396 conn(0x7fca200cfda0 msgr2=0x7fca200d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.070+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 shutdown_connections 2024-04-24T23:02:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.071+0000 7fca25400640 1 -- 172.21.15.146:0/1239248396 wait complete. 2024-04-24T23:02:11.086 INFO:tasks.ceph.mds.c.smithi146.stderr: -5310> 2024-04-24T23:01:54.505+0000 7f7ae2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:02:11.086 INFO:tasks.ceph.mds.c.smithi146.stderr: -4828> 2024-04-24T23:01:57.117+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-04-24T23:02:11.087 INFO:tasks.ceph.mds.c.smithi146.stderr: -4440> 2024-04-24T23:01:57.124+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-04-24T23:02:11.090 INFO:tasks.ceph.mds.c.smithi146.stderr: -2223> 2024-04-24T23:02:03.211+0000 7f7add600640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-04-24T23:02:11.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:02:11.141 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:02:11.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.272+0000 7fb7d3c00640 1 Processor -- start 2024-04-24T23:02:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.272+0000 7fb7d3c00640 1 -- start start 2024-04-24T23:02:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.273+0000 7fb7d3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc155460 0x7fb7cc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.273+0000 7fb7d3c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7cc06ea40 0x7fb7cc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.273+0000 7fb7d3c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc0b3250 con 0x7fb7cc0b2ab0 2024-04-24T23:02:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.273+0000 7fb7d3c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0b3530 con 0x7fb7cc06ea40 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.273+0000 7fb7d3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b3810 con 0x7fb7cc155460 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7cbe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb7cc0b2ab0 0x7fb7cc06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36220/0 (socket says 172.21.15.146:36220) 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7cbe00640 1 -- 172.21.15.146:0/1388055518 learned_addr learned my addr 172.21.15.146:0/1388055518 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/1388055518 >> v2:172.21.15.146:3300/0 conn(0x7fb7cc06ea40 0x7fb7cc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1200640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc155460 0x7fb7cc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7cb400640 1 -- 172.21.15.146:0/1388055518 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430186135 0 0) 0x7fb7cc0b3250 con 0x7fb7cc0b2ab0 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7cb400640 1 -- 172.21.15.146:0/1388055518 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7b0003520 con 0x7fb7cc0b2ab0 2024-04-24T23:02:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1c00640 1 -- 172.21.15.146:0/1388055518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc155460 msgr2=0x7fb7cc15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc155460 0x7fb7cc15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1c00640 1 -- 172.21.15.146:0/1388055518 >> v1:172.21.15.146:6789/0 conn(0x7fb7cc0b2ab0 legacy=0x7fb7cc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.274+0000 7fb7d1c00640 1 -- 172.21.15.146:0/1388055518 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc070ec0 con 0x7fb7cc06ea40 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.275+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc06ea40 0x7fb7cc0713e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeae09e48d6189eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7cb400640 1 -- 172.21.15.146:0/1388055518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4037070 con 0x7fb7cc06ea40 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7cb400640 1 -- 172.21.15.146:0/1388055518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4032440 con 0x7fb7cc06ea40 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7cb400640 1 -- 172.21.15.146:0/1388055518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4032810 con 0x7fb7cc06ea40 2024-04-24T23:02:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 -- 172.21.15.146:0/1388055518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc06ea40 msgr2=0x7fb7cc0713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc06ea40 0x7fb7cc0713e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c402a180 comp rx=0 tx=0).stop 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 -- 172.21.15.146:0/1388055518 shutdown_connections 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc06ea40 0x7fb7cc0713e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/1388055518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc155460 0x7fb7cc15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.276+0000 7fb7d3c00640 1 -- 172.21.15.146:0/1388055518 >> 172.21.15.146:0/1388055518 conn(0x7fb7cc0b17b0 msgr2=0x7fb7cc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.277+0000 7fb7d3c00640 1 -- 172.21.15.146:0/1388055518 shutdown_connections 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.277+0000 7fb7d3c00640 1 -- 172.21.15.146:0/1388055518 wait complete. 2024-04-24T23:02:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.278+0000 7fb7d3c00640 1 Processor -- start 2024-04-24T23:02:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.278+0000 7fb7d3c00640 1 -- start start 2024-04-24T23:02:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc06ea40 0x7fb7cc1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7cc0b2ab0 0x7fb7cc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b3030 con 0x7fb7cc155460 2024-04-24T23:02:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b2eb0 con 0x7fb7cc0b2ab0 2024-04-24T23:02:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.279+0000 7fb7d3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc15c480 con 0x7fb7cc06ea40 2024-04-24T23:02:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38028/0 (socket says 172.21.15.146:38028) 2024-04-24T23:02:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 -- 172.21.15.146:0/793176975 learned_addr learned my addr 172.21.15.146:0/793176975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1200640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc06ea40 0x7fb7cc1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7cbe00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7cc0b2ab0 0x7fb7cc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 -- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc06ea40 msgr2=0x7fb7cc1491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc06ea40 0x7fb7cc1491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 -- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7cc0b2ab0 msgr2=0x7fb7cc1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7cc0b2ab0 0x7fb7cc1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 -- 172.21.15.146:0/793176975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc15a570 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.280+0000 7fb7d1c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.281+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4037040 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.281+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4042070 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.281+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4030860 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.281+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc15a850 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.281+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc0b0780 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.282+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc04f5a0 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.283+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7c4030a00 con 0x7fb7cc155460 2024-04-24T23:02:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.284+0000 7fb7c8c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 0x7fb7a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.284+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6273+0+0 (secure 0 0 0) 0x7fb7c40aba50 con 0x7fb7cc155460 2024-04-24T23:02:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.285+0000 7fb7d1200640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 0x7fb7a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.286+0000 7fb7d1200640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 0x7fb7a806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc152c30 tx=0x7fb7bc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.288+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb7c407a120 con 0x7fb7cc155460 2024-04-24T23:02:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:11.517+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb7cc06ce50 con 0x7fb7cc155460 2024-04-24T23:02:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.069+0000 7fb7c8c00640 1 -- 172.21.15.146:0/793176975 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7fb7c4079a20 con 0x7fb7cc155460 2024-04-24T23:02:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 msgr2=0x7fb7a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 0x7fb7a806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc152c30 tx=0x7fb7bc00b040 comp rx=0 tx=0).stop 2024-04-24T23:02:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 msgr2=0x7fb7cc06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40097a0 tx=0x7fb7c40046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 shutdown_connections 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc155460 0x7fb7cc06d450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7cc0b2ab0 0x7fb7cc1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb7a806be30 0x7fb7a806e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 --2- 172.21.15.146:0/793176975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7cc06ea40 0x7fb7cc1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.073+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 >> 172.21.15.146:0/793176975 conn(0x7fb7cc0b17b0 msgr2=0x7fb7cc152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.074+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 shutdown_connections 2024-04-24T23:02:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.074+0000 7fb7d3c00640 1 -- 172.21.15.146:0/793176975 wait complete. 2024-04-24T23:02:12.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:02:12.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.343+0000 7f5faf400640 1 Processor -- start 2024-04-24T23:02:12.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.343+0000 7f5faf400640 1 -- start start 2024-04-24T23:02:12.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.346+0000 7f5faf400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5fa815eed0 0x7f5fa80cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.346+0000 7f5faf400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.346+0000 7f5faf400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa806f5e0 con 0x7f5fa806bb50 2024-04-24T23:02:12.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.346+0000 7f5faf400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa806f020 con 0x7f5fa815eed0 2024-04-24T23:02:12.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.346+0000 7f5faf400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa806f300 con 0x7f5fa806e540 2024-04-24T23:02:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5faca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5fa815eed0 0x7f5fa80cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:59796/0 (socket says 172.21.15.146:59796) 2024-04-24T23:02:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 -- 172.21.15.146:0/559812771 learned_addr learned my addr 172.21.15.146:0/559812771 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:12.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 -- 172.21.15.146:0/559812771 >> v2:172.21.15.203:3300/0 conn(0x7f5fa815eed0 msgr2=0x7f5fa80cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:12.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 --2- 172.21.15.146:0/559812771 >> v2:172.21.15.203:3300/0 conn(0x7f5fa815eed0 0x7f5fa80cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 -- 172.21.15.146:0/559812771 >> v1:172.21.15.203:6789/0 conn(0x7f5fa806bb50 legacy=0x7f5fa80b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.347+0000 7f5f9fe00640 1 -- 172.21.15.146:0/559812771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80ccc70 con 0x7f5fa806e540 2024-04-24T23:02:12.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.348+0000 7f5f9fe00640 1 --2- 172.21.15.146:0/559812771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c1b3b5caf5d291 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.349+0000 7f5fa7e00640 1 -- 172.21.15.146:0/559812771 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98037070 con 0x7f5fa806e540 2024-04-24T23:02:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.349+0000 7f5fa7e00640 1 -- 172.21.15.146:0/559812771 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f98032440 con 0x7f5fa806e540 2024-04-24T23:02:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.349+0000 7f5fa7e00640 1 -- 172.21.15.146:0/559812771 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98032810 con 0x7f5fa806e540 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 -- 172.21.15.146:0/559812771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 msgr2=0x7f5fa806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 --2- 172.21.15.146:0/559812771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802a250 comp rx=0 tx=0).stop 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 -- 172.21.15.146:0/559812771 shutdown_connections 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 --2- 172.21.15.146:0/559812771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa806e540 0x7f5fa806e9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 --2- 172.21.15.146:0/559812771 >> v2:172.21.15.203:3300/0 conn(0x7f5fa815eed0 0x7f5fa80cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 -- 172.21.15.146:0/559812771 >> 172.21.15.146:0/559812771 conn(0x7f5fa8072880 msgr2=0x7f5fa8072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 -- 172.21.15.146:0/559812771 shutdown_connections 2024-04-24T23:02:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.350+0000 7f5faf400640 1 -- 172.21.15.146:0/559812771 wait complete. 2024-04-24T23:02:12.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.352+0000 7f5faf400640 1 Processor -- start 2024-04-24T23:02:12.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.352+0000 7f5faf400640 1 -- start start 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fa806e540 0x7f5fa80c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa815eed0 0x7f5fa8153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa815e550 con 0x7f5fa806bb50 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa815e3d0 con 0x7f5fa806e540 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faf400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa80cd9b0 con 0x7f5fa815eed0 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38042/0 (socket says 172.21.15.146:38042) 2024-04-24T23:02:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5faca00640 1 -- 172.21.15.146:0/2179652955 learned_addr learned my addr 172.21.15.146:0/2179652955 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:12.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5fad400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa815eed0 0x7f5fa8153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.353+0000 7f5f9fe00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fa806e540 0x7f5fa80c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 -- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa815eed0 msgr2=0x7f5fa8153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa815eed0 0x7f5fa8153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 -- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fa806e540 msgr2=0x7f5fa80c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fa806e540 0x7f5fa80c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 -- 172.21.15.146:0/2179652955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80c7dc0 con 0x7f5fa806bb50 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faca00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000e8a0 tx=0x7f5f9000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90017070 con 0x7f5fa806bb50 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9000c940 con 0x7f5fa806bb50 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000cd30 con 0x7f5fa806bb50 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa80c80a0 con 0x7f5fa806bb50 2024-04-24T23:02:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.354+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa80c8660 con 0x7f5fa806bb50 2024-04-24T23:02:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.356+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa806d530 con 0x7f5fa806bb50 2024-04-24T23:02:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.357+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f9001a070 con 0x7f5fa806bb50 2024-04-24T23:02:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.357+0000 7f5fa5600640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 0x7f5f8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.358+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6273+0+0 (secure 0 0 0) 0x7f5f9008b2f0 con 0x7f5fa806bb50 2024-04-24T23:02:12.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.358+0000 7f5f9fe00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 0x7f5f8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:12.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.359+0000 7f5f9fe00640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 0x7f5f8406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:12.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.362+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5fa806d530 con 0x7f5fa806bb50 2024-04-24T23:02:12.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:12.560+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5fa8068190 con 0x7f5fa806bb50 2024-04-24T23:02:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.082+0000 7f5fa5600640 1 -- 172.21.15.146:0/2179652955 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7f5f90059a60 con 0x7f5fa806bb50 2024-04-24T23:02:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 msgr2=0x7f5f8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 0x7f5f8406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009870 tx=0x7f5f9802e000 comp rx=0 tx=0).stop 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 msgr2=0x7f5fa80c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000e8a0 tx=0x7f5f9000ed60 comp rx=0 tx=0).stop 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 shutdown_connections 2024-04-24T23:02:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5f8406be30 0x7f5f8406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fa815eed0 0x7f5fa8153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fa806e540 0x7f5fa80c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 --2- 172.21.15.146:0/2179652955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa806bb50 0x7f5fa80c9140 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.085+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 >> 172.21.15.146:0/2179652955 conn(0x7f5fa8072880 msgr2=0x7f5fa80ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.087+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 shutdown_connections 2024-04-24T23:02:13.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.087+0000 7f5faf400640 1 -- 172.21.15.146:0/2179652955 wait complete. 2024-04-24T23:02:13.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:02:13.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.307+0000 7fb5ce600640 1 Processor -- start 2024-04-24T23:02:13.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.307+0000 7fb5ce600640 1 -- start start 2024-04-24T23:02:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5ce600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb5c815bb50 0x7fb5c8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5ce600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5c806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5ce600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c80ad960 con 0x7fb5c806e910 2024-04-24T23:02:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5ce600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c8072480 con 0x7fb5c815bb50 2024-04-24T23:02:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5ce600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c815bf30 con 0x7fb5c8072020 2024-04-24T23:02:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5c7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb5c806e910 0x7fb5c8161ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36230/0 (socket says 172.21.15.146:36230) 2024-04-24T23:02:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.309+0000 7fb5c7e00640 1 -- 172.21.15.146:0/2912287383 learned_addr learned my addr 172.21.15.146:0/2912287383 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c7400640 1 --2- 172.21.15.146:0/2912287383 >> v2:172.21.15.203:3300/0 conn(0x7fb5c815bb50 0x7fb5c8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6a00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5c806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451941846 0 0) 0x7fb5c80ad960 con 0x7fb5c806e910 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ac003520 con 0x7fb5c806e910 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 12855297 0 0) 0x7fb5ac003520 con 0x7fb5c806e910 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 msgr2=0x7fb5c806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5c806e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 >> v2:172.21.15.203:3300/0 conn(0x7fb5c815bb50 msgr2=0x7fb5c8071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 --2- 172.21.15.146:0/2912287383 >> v2:172.21.15.203:3300/0 conn(0x7fb5c815bb50 0x7fb5c8071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c806ed60 con 0x7fb5c806e910 2024-04-24T23:02:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb5c0001670 con 0x7fb5c806e910 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 >> v1:172.21.15.146:6789/0 conn(0x7fb5c806e910 legacy=0x7fb5c8161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac0039b0 0x7fb5ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.310+0000 7fb5c6000640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c6000640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c815bf30 con 0x7fb5ac004d40 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac00ba70 con 0x7fb5ac0039b0 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac00bc20 con 0x7fb5c8072020 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c6a00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7400640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac0039b0 0x7fb5ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 -- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 msgr2=0x7fb5ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c8072020 0x7fb5ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 -- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac0039b0 msgr2=0x7fb5ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac0039b0 0x7fb5ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7e00640 1 -- 172.21.15.146:0/2912287383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac003520 con 0x7fb5ac004d40 2024-04-24T23:02:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.311+0000 7fb5c7400640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ac0039b0 0x7fb5ac003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.312+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5ac0051c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c210 tx=0x7fb5ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f87b16a8d05791d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0007d50 con 0x7fb5ac004d40 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c002e070 con 0x7fb5ac004d40 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5c6000640 1 -- 172.21.15.146:0/2912287383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0005d30 con 0x7fb5ac004d40 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 -- 172.21.15.146:0/2912287383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 msgr2=0x7fb5ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 --2- 172.21.15.146:0/2912287383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5ac0051c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c210 tx=0x7fb5ac005830 comp rx=0 tx=0).stop 2024-04-24T23:02:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5c7e00640 1 -- 172.21.15.146:0/2912287383 reap_dead start 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 -- 172.21.15.146:0/2912287383 shutdown_connections 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 -- 172.21.15.146:0/2912287383 >> 172.21.15.146:0/2912287383 conn(0x7fb5c80b1cb0 msgr2=0x7fb5c80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 -- 172.21.15.146:0/2912287383 shutdown_connections 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.313+0000 7fb5ce600640 1 -- 172.21.15.146:0/2912287383 wait complete. 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.315+0000 7fb5ce600640 1 Processor -- start 2024-04-24T23:02:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.315+0000 7fb5ce600640 1 -- start start 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c80b1790 0x7fb5c80b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 0x7fb5c8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c806f5e0 con 0x7fb5ac004d40 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c806f300 con 0x7fb5c80b1790 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.316+0000 7fb5ce600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c806f8c0 con 0x7fb5c81607f0 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38056/0 (socket says 172.21.15.146:38056) 2024-04-24T23:02:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 -- 172.21.15.146:0/3435367028 learned_addr learned my addr 172.21.15.146:0/3435367028 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 0x7fb5c8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c6a00640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c80b1790 0x7fb5c80b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 -- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 msgr2=0x7fb5c8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 0x7fb5c8160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 -- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c80b1790 msgr2=0x7fb5c80b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c80b1790 0x7fb5c80b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7400640 1 -- 172.21.15.146:0/3435367028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c80b4590 con 0x7fb5ac004d40 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.317+0000 7fb5c7e00640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 0x7fb5c8160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5c7400640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800f180 tx=0x7fb5b800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8018020 con 0x7fb5ac004d40 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8014800 con 0x7fb5ac004d40 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c80b4870 con 0x7fb5ac004d40 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8014bb0 con 0x7fb5ac004d40 2024-04-24T23:02:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.318+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c8151e80 con 0x7fb5ac004d40 2024-04-24T23:02:13.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.319+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c8068190 con 0x7fb5ac004d40 2024-04-24T23:02:13.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.320+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5b801b020 con 0x7fb5ac004d40 2024-04-24T23:02:13.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.321+0000 7fb5bf400640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 0x7fb5a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:13.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.322+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5835+0+0 (secure 0 0 0) 0x7fb5b808bb50 con 0x7fb5ac004d40 2024-04-24T23:02:13.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.322+0000 7fb5c6a00640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 0x7fb5a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.323+0000 7fb5c6a00640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 0x7fb5a406e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81f7070 tx=0x7fb5b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:13.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.326+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb5b8022020 con 0x7fb5ac004d40 2024-04-24T23:02:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:13.522+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5c80af680 con 0x7fb5ac004d40 2024-04-24T23:02:13.682 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:13.690 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.095+0000 7fb5bf400640 1 -- 172.21.15.146:0/3435367028 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7fb5b805a510 con 0x7fb5ac004d40 2024-04-24T23:02:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:02:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 msgr2=0x7fb5a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 0x7fb5a406e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81f7070 tx=0x7fb5b0008040 comp rx=0 tx=0).stop 2024-04-24T23:02:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 msgr2=0x7fb5c814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800f180 tx=0x7fb5b800f640 comp rx=0 tx=0).stop 2024-04-24T23:02:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 shutdown_connections 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb5a406be60 0x7fb5a406e320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5c81607f0 0x7fb5c8160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c80b1790 0x7fb5c80b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 --2- 172.21.15.146:0/3435367028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ac004d40 0x7fb5c814f990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 >> 172.21.15.146:0/3435367028 conn(0x7fb5c80b1cb0 msgr2=0x7fb5c815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.099+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 shutdown_connections 2024-04-24T23:02:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.100+0000 7fb5ce600640 1 -- 172.21.15.146:0/3435367028 wait complete. 2024-04-24T23:02:14.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:02:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.310+0000 7fa2ac200640 1 Processor -- start 2024-04-24T23:02:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.310+0000 7fa2ac200640 1 -- start start 2024-04-24T23:02:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.311+0000 7fa2ac200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa2a413ef30 0x7fa2a4141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.311+0000 7fa2ac200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa2a40ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.311+0000 7fa2ac200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40ced40 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.311+0000 7fa2ac200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a41423d0 con 0x7fa2a413ef30 2024-04-24T23:02:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.311+0000 7fa2ac200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a4070f80 con 0x7fa2a4141ab0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.312+0000 7fa2aa200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa2a40ce5a0 0x7fa2a415fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36244/0 (socket says 172.21.15.146:36244) 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.312+0000 7fa2aa200640 1 -- 172.21.15.146:0/857947531 learned_addr learned my addr 172.21.15.146:0/857947531 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.312+0000 7fa2a8e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa2a40ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.312+0000 7fa2a9800640 1 --2- 172.21.15.146:0/857947531 >> v2:172.21.15.203:3300/0 conn(0x7fa2a413ef30 0x7fa2a4141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.312+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1252913975 0 0) 0x7fa2a40ced40 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa28c003520 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507529481 0 0) 0x7fa28c003520 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 msgr2=0x7fa2a40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa2a40ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 >> v2:172.21.15.203:3300/0 conn(0x7fa2a413ef30 msgr2=0x7fa2a4141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 --2- 172.21.15.146:0/857947531 >> v2:172.21.15.203:3300/0 conn(0x7fa2a413ef30 0x7fa2a4141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40cf020 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fa29c0019f0 con 0x7fa2a40ce5a0 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 >> v1:172.21.15.146:6789/0 conn(0x7fa2a40ce5a0 legacy=0x7fa2a415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa28c0039b0 0x7fa28c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa28c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa28c004d40 0x7fa28c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4070f80 con 0x7fa28c004d40 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c00b9c0 con 0x7fa28c0039b0 2024-04-24T23:02:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.313+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c00bb40 con 0x7fa2a4141ab0 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa28c004d40 0x7fa28c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2a9800640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa28c0039b0 0x7fa28c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2a8e00640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa28c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 -- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 msgr2=0x7fa28c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa2a4141ab0 0x7fa28c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 -- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa28c0039b0 msgr2=0x7fa28c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa28c0039b0 0x7fa28c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.314+0000 7fa2aa200640 1 -- 172.21.15.146:0/857947531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c003520 con 0x7fa28c004d40 2024-04-24T23:02:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.315+0000 7fa2aa200640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa28c004d40 0x7fa28c0051c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00a8a0 tx=0x7fa28c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d498ffd6bf2863b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00a4c0 con 0x7fa28c004d40 2024-04-24T23:02:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29c02f070 con 0x7fa28c004d40 2024-04-24T23:02:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2a3e00640 1 -- 172.21.15.146:0/857947531 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c02bd30 con 0x7fa28c004d40 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2ac200640 1 -- 172.21.15.146:0/857947531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa28c004d40 msgr2=0x7fa28c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2ac200640 1 --2- 172.21.15.146:0/857947531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa28c004d40 0x7fa28c0051c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00a8a0 tx=0x7fa28c005830 comp rx=0 tx=0).stop 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2aa200640 1 -- 172.21.15.146:0/857947531 reap_dead start 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2ac200640 1 -- 172.21.15.146:0/857947531 shutdown_connections 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.316+0000 7fa2ac200640 1 -- 172.21.15.146:0/857947531 >> 172.21.15.146:0/857947531 conn(0x7fa2a40b17b0 msgr2=0x7fa2a40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.317+0000 7fa2ac200640 1 -- 172.21.15.146:0/857947531 shutdown_connections 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.317+0000 7fa2ac200640 1 -- 172.21.15.146:0/857947531 wait complete. 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.318+0000 7fa2ac200640 1 Processor -- start 2024-04-24T23:02:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.318+0000 7fa2ac200640 1 -- start start 2024-04-24T23:02:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 0x7fa2a40b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 0x7fa2a413b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a40cea30 con 0x7fa2a4159f20 2024-04-24T23:02:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4070c10 con 0x7fa2a413a670 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.319+0000 7fa2ac200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a4072420 con 0x7fa28c004d40 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38060/0 (socket says 172.21.15.146:38060) 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 -- 172.21.15.146:0/3734169105 learned_addr learned my addr 172.21.15.146:0/3734169105 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2a8e00640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 0x7fa2a413b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2a9800640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 0x7fa2a40b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 -- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 msgr2=0x7fa2a40b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 0x7fa2a40b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 -- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 msgr2=0x7fa2a413b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 0x7fa2a413b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2aa200640 1 -- 172.21.15.146:0/3734169105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a413b810 con 0x7fa2a4159f20 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2a8e00640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 0x7fa2a413b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.320+0000 7fa2a9800640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 0x7fa2a40b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:14.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2aa200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa29c001cf0 tx=0x7fa29c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c044070 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29c034470 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00a4c0 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a413d930 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.321+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a413def0 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.322+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a404f5a0 con 0x7fa2a4159f20 2024-04-24T23:02:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.323+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa29c034820 con 0x7fa2a4159f20 2024-04-24T23:02:14.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.324+0000 7fa2a1600640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 0x7fa28406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.325+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fa29c0aaf90 con 0x7fa2a4159f20 2024-04-24T23:02:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.325+0000 7fa2a9800640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 0x7fa28406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.326+0000 7fa2a9800640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 0x7fa28406e230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa290009a00 tx=0x7fa290008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.329+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa29c0799c0 con 0x7fa2a4159f20 2024-04-24T23:02:14.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.532+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa2a40cdba0 con 0x7fa2a4159f20 2024-04-24T23:02:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.539+0000 7fa2a1600640 1 -- 172.21.15.146:0/3734169105 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fa29c0792c0 con 0x7fa2a4159f20 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 msgr2=0x7fa28406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 0x7fa28406e230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa290009a00 tx=0x7fa290008040 comp rx=0 tx=0).stop 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 msgr2=0x7fa2a415a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa29c001cf0 tx=0x7fa29c001dc0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 shutdown_connections 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2a4159f20 0x7fa2a415a3a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2a413a670 0x7fa2a413b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa28406bd70 0x7fa28406e230 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 --2- 172.21.15.146:0/3734169105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa28c004d40 0x7fa2a40b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 >> 172.21.15.146:0/3734169105 conn(0x7fa2a40b17b0 msgr2=0x7fa2a415f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 shutdown_connections 2024-04-24T23:02:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.542+0000 7fa2ac200640 1 -- 172.21.15.146:0/3734169105 wait complete. 2024-04-24T23:02:14.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-04-24T23:02:14.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.768+0000 7f365ae00640 1 Processor -- start 2024-04-24T23:02:14.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.768+0000 7f365ae00640 1 -- start start 2024-04-24T23:02:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f365ae00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f365415ddd0 0x7f3654070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f365ae00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 0x7f36540b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f365ae00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365415e1b0 con 0x7f3654072920 2024-04-24T23:02:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f365ae00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f36540713b0 con 0x7f365415ddd0 2024-04-24T23:02:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f365ae00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3654071690 con 0x7f36540d0240 2024-04-24T23:02:14.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f3659a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f365415ddd0 0x7f3654070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f3659a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f365415ddd0 0x7f3654070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38068/0 (socket says 172.21.15.146:38068) 2024-04-24T23:02:14.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.770+0000 7f3659a00640 1 -- 172.21.15.146:0/3894954030 learned_addr learned my addr 172.21.15.146:0/3894954030 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f3659a00640 1 -- 172.21.15.146:0/3894954030 >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 msgr2=0x7f36540b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f365a400640 1 --2- 172.21.15.146:0/3894954030 >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 0x7f36540b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f3659a00640 1 --2- 172.21.15.146:0/3894954030 >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 0x7f36540b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f3659a00640 1 -- 172.21.15.146:0/3894954030 >> v1:172.21.15.203:6789/0 conn(0x7f3654072920 legacy=0x7f36540cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f3659a00640 1 -- 172.21.15.146:0/3894954030 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654071970 con 0x7f365415ddd0 2024-04-24T23:02:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.771+0000 7f365a400640 1 --2- 172.21.15.146:0/3894954030 >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 0x7f36540b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:14.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.772+0000 7f3659a00640 1 --2- 172.21.15.146:0/3894954030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365415ddd0 0x7f3654070b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f36540d06d0 tx=0x7f364802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc59fa9b1d4e6c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.773+0000 7f3653e00640 1 -- 172.21.15.146:0/3894954030 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648037070 con 0x7f365415ddd0 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.773+0000 7f3653e00640 1 -- 172.21.15.146:0/3894954030 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648032440 con 0x7f365415ddd0 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.773+0000 7f3653e00640 1 -- 172.21.15.146:0/3894954030 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648032810 con 0x7f365415ddd0 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.773+0000 7f365ae00640 1 -- 172.21.15.146:0/3894954030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365415ddd0 msgr2=0x7f3654070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.773+0000 7f365ae00640 1 --2- 172.21.15.146:0/3894954030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365415ddd0 0x7f3654070b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f36540d06d0 tx=0x7f364802a200 comp rx=0 tx=0).stop 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 -- 172.21.15.146:0/3894954030 shutdown_connections 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 --2- 172.21.15.146:0/3894954030 >> v2:172.21.15.203:3300/0 conn(0x7f36540d0240 0x7f36540b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 --2- 172.21.15.146:0/3894954030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365415ddd0 0x7f3654070b60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 -- 172.21.15.146:0/3894954030 >> 172.21.15.146:0/3894954030 conn(0x7f365406b320 msgr2=0x7f365406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 -- 172.21.15.146:0/3894954030 shutdown_connections 2024-04-24T23:02:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.774+0000 7f365ae00640 1 -- 172.21.15.146:0/3894954030 wait complete. 2024-04-24T23:02:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.775+0000 7f365ae00640 1 Processor -- start 2024-04-24T23:02:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 -- start start 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654072920 0x7f365414b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 0x7f36540cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36540b3140 con 0x7f36540d0240 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36540710a0 con 0x7f365415ddd0 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.776+0000 7f365ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36540b32c0 con 0x7f3654072920 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38082/0 (socket says 172.21.15.146:38082) 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 -- 172.21.15.146:0/942559108 learned_addr learned my addr 172.21.15.146:0/942559108 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f365a400640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 0x7f36540cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659a00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654072920 0x7f365414b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 -- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654072920 msgr2=0x7f365414b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654072920 0x7f365414b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 -- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 msgr2=0x7f36540cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 0x7f36540cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f3659000640 1 -- 172.21.15.146:0/942559108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654157c70 con 0x7f36540d0240 2024-04-24T23:02:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.777+0000 7f365a400640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 0x7f36540cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f3659000640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f364400c460 tx=0x7f364400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644011790 con 0x7f36540d0240 2024-04-24T23:02:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644017070 con 0x7f36540d0240 2024-04-24T23:02:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644011bb0 con 0x7f36540d0240 2024-04-24T23:02:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540ce610 con 0x7f36540d0240 2024-04-24T23:02:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.778+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36540cebd0 con 0x7f36540d0240 2024-04-24T23:02:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.779+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365404f500 con 0x7f36540d0240 2024-04-24T23:02:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.780+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f364401c460 con 0x7f36540d0240 2024-04-24T23:02:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.781+0000 7f3651600640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 0x7f363806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.781+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f364408acb0 con 0x7f36540d0240 2024-04-24T23:02:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.782+0000 7f3659a00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 0x7f363806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.783+0000 7f3659a00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 0x7f363806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3648034000 tx=0x7f364802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:14.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:14.786+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3644059650 con 0x7f36540d0240 2024-04-24T23:02:15.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.068+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) -- 0x7f365406cee0 con 0x7f36540d0240 2024-04-24T23:02:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.098+0000 7f3651600640 1 -- 172.21.15.146:0/942559108 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v150) ==== 150+0+0 (secure 0 0 0) 0x7f3644058f50 con 0x7f36540d0240 2024-04-24T23:02:15.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 msgr2=0x7f363806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 0x7f363806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3648034000 tx=0x7f364802e000 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 msgr2=0x7f36540cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f364400c460 tx=0x7f364400c920 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 shutdown_connections 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f365415ddd0 0x7f36540cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36540d0240 0x7f36540cbb00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f363806be30 0x7f363806e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 --2- 172.21.15.146:0/942559108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654072920 0x7f365414b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 >> 172.21.15.146:0/942559108 conn(0x7f365406b320 msgr2=0x7f365415cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 shutdown_connections 2024-04-24T23:02:15.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.101+0000 7f365ae00640 1 -- 172.21.15.146:0/942559108 wait complete. 2024-04-24T23:02:15.121 INFO:tasks.cephfs_test_runner:That when some dentries in the journal but nothing is in ... ok 2024-04-24T23:02:15.121 INFO:tasks.cephfs_test_runner:Starting test: test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-04-24T23:02:15.122 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.320+0000 7f618d800640 1 Processor -- start 2024-04-24T23:02:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.320+0000 7f618d800640 1 -- start start 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f618d800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6188145640 0x7f618815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f618d800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61880b2a20 0x7f61880cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f618d800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61880cdf70 con 0x7f618806cbc0 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f618d800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f618815d360 con 0x7f61880b2a20 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f618d800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6188145a20 con 0x7f6188145640 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f6186000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61880b2a20 0x7f61880cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f6186000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61880b2a20 0x7f61880cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38092/0 (socket says 172.21.15.146:38092) 2024-04-24T23:02:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f6186000640 1 -- 172.21.15.146:0/1967120903 learned_addr learned my addr 172.21.15.146:0/1967120903 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.322+0000 7f6186a00640 1 --2- 172.21.15.146:0/1967120903 >> v2:172.21.15.203:3300/0 conn(0x7f6188145640 0x7f618815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.323+0000 7f6186000640 1 -- 172.21.15.146:0/1967120903 >> v2:172.21.15.203:3300/0 conn(0x7f6188145640 msgr2=0x7f618815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.323+0000 7f6186000640 1 --2- 172.21.15.146:0/1967120903 >> v2:172.21.15.203:3300/0 conn(0x7f6188145640 0x7f618815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.323+0000 7f6186000640 1 -- 172.21.15.146:0/1967120903 >> v1:172.21.15.203:6789/0 conn(0x7f618806cbc0 legacy=0x7f618815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.323+0000 7f6186000640 1 -- 172.21.15.146:0/1967120903 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618806d140 con 0x7f61880b2a20 2024-04-24T23:02:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.324+0000 7f6186000640 1 --2- 172.21.15.146:0/1967120903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61880b2a20 0x7f61880cfc90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6188072f30 tx=0x7f617402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c7a4e9811ad697 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.324+0000 7f6185600640 1 -- 172.21.15.146:0/1967120903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f61880b2a20 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.324+0000 7f6185600640 1 -- 172.21.15.146:0/1967120903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6174032440 con 0x7f61880b2a20 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.324+0000 7f6185600640 1 -- 172.21.15.146:0/1967120903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174032810 con 0x7f61880b2a20 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 -- 172.21.15.146:0/1967120903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61880b2a20 msgr2=0x7f61880cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 --2- 172.21.15.146:0/1967120903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61880b2a20 0x7f61880cfc90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6188072f30 tx=0x7f617402a160 comp rx=0 tx=0).stop 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 -- 172.21.15.146:0/1967120903 shutdown_connections 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 --2- 172.21.15.146:0/1967120903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61880b2a20 0x7f61880cfc90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 --2- 172.21.15.146:0/1967120903 >> v2:172.21.15.203:3300/0 conn(0x7f6188145640 0x7f618815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 -- 172.21.15.146:0/1967120903 >> 172.21.15.146:0/1967120903 conn(0x7f618806b320 msgr2=0x7f618806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 -- 172.21.15.146:0/1967120903 shutdown_connections 2024-04-24T23:02:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.325+0000 7f618d800640 1 -- 172.21.15.146:0/1967120903 wait complete. 2024-04-24T23:02:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.327+0000 7f618d800640 1 Processor -- start 2024-04-24T23:02:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.327+0000 7f618d800640 1 -- start start 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618806cbc0 0x7f61881f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 0x7f6188137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f618806d9e0 con 0x7f6188145640 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f618806d700 con 0x7f61880b2a20 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f618d800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f61880d01d0 con 0x7f618806cbc0 2024-04-24T23:02:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f6187400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f6187400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38102/0 (socket says 172.21.15.146:38102) 2024-04-24T23:02:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.328+0000 7f6187400640 1 -- 172.21.15.146:0/899070765 learned_addr learned my addr 172.21.15.146:0/899070765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6186a00640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618806cbc0 0x7f61881f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6186000640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 0x7f6188137d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 -- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618806cbc0 msgr2=0x7f61881f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618806cbc0 0x7f61881f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 -- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 msgr2=0x7f6188137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 0x7f6188137d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 -- 172.21.15.146:0/899070765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618815df50 con 0x7f6188145640 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6186000640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 0x7f6188137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f6187400640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f618000c780 tx=0x7f618000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180004b60 con 0x7f6188145640 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180004d00 con 0x7f6188145640 2024-04-24T23:02:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000aa90 con 0x7f6188145640 2024-04-24T23:02:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.329+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618815e230 con 0x7f6188145640 2024-04-24T23:02:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.330+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618815f480 con 0x7f6188145640 2024-04-24T23:02:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.331+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6188068190 con 0x7f6188145640 2024-04-24T23:02:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.332+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f618000ac30 con 0x7f6188145640 2024-04-24T23:02:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.333+0000 7f617ea00640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 0x7f616806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.333+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f618008b080 con 0x7f6188145640 2024-04-24T23:02:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.334+0000 7f6186a00640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 0x7f616806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.335+0000 7f6186a00640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 0x7f616806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.338+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6180020070 con 0x7f6188145640 2024-04-24T23:02:15.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.539+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61880af160 con 0x7f6188145640 2024-04-24T23:02:15.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.541+0000 7f617ea00640 1 -- 172.21.15.146:0/899070765 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13449 (secure 0 0 0) 0x7f6180059b50 con 0x7f6188145640 2024-04-24T23:02:15.543 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:15.543 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":45,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:14.082829+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/4112366095":"2024-04-25T23:02:11.063006+0000","172.21.15.146:6833/4112366095":"2024-04-25T23:02:11.063006+0000","172.21.15.146:6835/784142616":"2024-04-25T23:01:48.482719+0000","172.21.15.146:6833/784142616":"2024-04-25T23:01:48.482719+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 msgr2=0x7f616806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 0x7f616806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 msgr2=0x7f618815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f618000c780 tx=0x7f618000cc40 comp rx=0 tx=0).stop 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 shutdown_connections 2024-04-24T23:02:15.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6188145640 0x7f618815d570 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61880b2a20 0x7f6188137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f616806be30 0x7f616806e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 --2- 172.21.15.146:0/899070765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f618806cbc0 0x7f61881f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 >> 172.21.15.146:0/899070765 conn(0x7f618806b320 msgr2=0x7f61880b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 shutdown_connections 2024-04-24T23:02:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.544+0000 7f618d800640 1 -- 172.21.15.146:0/899070765 wait complete. 2024-04-24T23:02:15.563 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:02:15.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:02:15.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.761+0000 7fca3d200640 1 Processor -- start 2024-04-24T23:02:15.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.761+0000 7fca3d200640 1 -- start start 2024-04-24T23:02:15.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca3d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fca3813ef30 0x7fca38141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca3d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca380ce770 0x7fca38071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca3d200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca380ced40 con 0x7fca38141ab0 2024-04-24T23:02:15.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca3d200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fca381423d0 con 0x7fca380ce770 2024-04-24T23:02:15.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca3d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fca38070f80 con 0x7fca3813ef30 2024-04-24T23:02:15.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca36800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca380ce770 0x7fca38071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca36800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca380ce770 0x7fca38071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38104/0 (socket says 172.21.15.146:38104) 2024-04-24T23:02:15.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.763+0000 7fca36800640 1 -- 172.21.15.146:0/327803200 learned_addr learned my addr 172.21.15.146:0/327803200 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:15.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.764+0000 7fca35e00640 1 --2- 172.21.15.146:0/327803200 >> v2:172.21.15.203:3300/0 conn(0x7fca3813ef30 0x7fca38141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.764+0000 7fca36800640 1 -- 172.21.15.146:0/327803200 >> v2:172.21.15.203:3300/0 conn(0x7fca3813ef30 msgr2=0x7fca38141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:15.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.764+0000 7fca36800640 1 --2- 172.21.15.146:0/327803200 >> v2:172.21.15.203:3300/0 conn(0x7fca3813ef30 0x7fca38141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.764+0000 7fca36800640 1 -- 172.21.15.146:0/327803200 >> v1:172.21.15.203:6789/0 conn(0x7fca38141ab0 legacy=0x7fca380ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:15.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.764+0000 7fca36800640 1 -- 172.21.15.146:0/327803200 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca380cf020 con 0x7fca380ce770 2024-04-24T23:02:15.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.765+0000 7fca36800640 1 --2- 172.21.15.146:0/327803200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38071410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fca380707a0 tx=0x7fca3002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb906c5cff36ada6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.765+0000 7fca35400640 1 -- 172.21.15.146:0/327803200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30036070 con 0x7fca380ce770 2024-04-24T23:02:15.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.765+0000 7fca35400640 1 -- 172.21.15.146:0/327803200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30031600 con 0x7fca380ce770 2024-04-24T23:02:15.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.765+0000 7fca35400640 1 -- 172.21.15.146:0/327803200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca300319d0 con 0x7fca380ce770 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 -- 172.21.15.146:0/327803200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 msgr2=0x7fca38071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 --2- 172.21.15.146:0/327803200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38071410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fca380707a0 tx=0x7fca3002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 -- 172.21.15.146:0/327803200 shutdown_connections 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 --2- 172.21.15.146:0/327803200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38071410 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 --2- 172.21.15.146:0/327803200 >> v2:172.21.15.203:3300/0 conn(0x7fca3813ef30 0x7fca38141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.766+0000 7fca3d200640 1 -- 172.21.15.146:0/327803200 >> 172.21.15.146:0/327803200 conn(0x7fca380b17b0 msgr2=0x7fca380b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.767+0000 7fca3d200640 1 -- 172.21.15.146:0/327803200 shutdown_connections 2024-04-24T23:02:15.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.767+0000 7fca3d200640 1 -- 172.21.15.146:0/327803200 wait complete. 2024-04-24T23:02:15.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.769+0000 7fca3d200640 1 Processor -- start 2024-04-24T23:02:15.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.769+0000 7fca3d200640 1 -- start start 2024-04-24T23:02:15.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca3813ef30 0x7fca38140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca38141ab0 0x7fca38140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fca38071950 con 0x7fca380ce770 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca38070c10 con 0x7fca3813ef30 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.770+0000 7fca3d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fca38071ad0 con 0x7fca38141ab0 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38114/0 (socket says 172.21.15.146:38114) 2024-04-24T23:02:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 -- 172.21.15.146:0/1663304051 learned_addr learned my addr 172.21.15.146:0/1663304051 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca36800640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca38141ab0 0x7fca38140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca2fe00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca3813ef30 0x7fca38140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 -- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca38141ab0 msgr2=0x7fca38140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca38141ab0 0x7fca38140ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 -- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca3813ef30 msgr2=0x7fca38140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca3813ef30 0x7fca38140570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.771+0000 7fca35e00640 1 -- 172.21.15.146:0/1663304051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca38145640 con 0x7fca380ce770 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca35e00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fca2800d830 tx=0x7fca2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2800b6c0 con 0x7fca380ce770 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28019070 con 0x7fca380ce770 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2800ba80 con 0x7fca380ce770 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca38157690 con 0x7fca380ce770 2024-04-24T23:02:15.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.772+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca38142690 con 0x7fca380ce770 2024-04-24T23:02:15.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.773+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3804f5a0 con 0x7fca380ce770 2024-04-24T23:02:15.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.775+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca2801e460 con 0x7fca380ce770 2024-04-24T23:02:15.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.776+0000 7fca2e000640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:15.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.776+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fca2808b430 con 0x7fca380ce770 2024-04-24T23:02:15.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.777+0000 7fca2fe00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:15.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.778+0000 7fca2fe00640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 0x7fca1406e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca38158030 tx=0x7fca20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.780+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fca28059ef0 con 0x7fca380ce770 2024-04-24T23:02:15.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.980+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca38072d30 con 0x7fca380ce770 2024-04-24T23:02:15.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.981+0000 7fca2e000640 1 -- 172.21.15.146:0/1663304051 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7fca280597f0 con 0x7fca380ce770 2024-04-24T23:02:15.982 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 msgr2=0x7fca1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 0x7fca1406e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca38158030 tx=0x7fca20008040 comp rx=0 tx=0).stop 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 msgr2=0x7fca38157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fca2800d830 tx=0x7fca2800dcf0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 shutdown_connections 2024-04-24T23:02:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fca38141ab0 0x7fca38140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca3813ef30 0x7fca38140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 --2- 172.21.15.146:0/1663304051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380ce770 0x7fca38157150 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 >> 172.21.15.146:0/1663304051 conn(0x7fca380b17b0 msgr2=0x7fca3806d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 shutdown_connections 2024-04-24T23:02:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:15.984+0000 7fca3d200640 1 -- 172.21.15.146:0/1663304051 wait complete. 2024-04-24T23:02:16.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-04-24T23:02:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.208+0000 7f26cee00640 1 Processor -- start 2024-04-24T23:02:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.208+0000 7f26cee00640 1 -- start start 2024-04-24T23:02:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cee00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26c806d770 0x7f26c8071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c80ccb10 con 0x7f26c815a980 2024-04-24T23:02:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cee00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c806ddc0 con 0x7f26c80d0240 2024-04-24T23:02:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cee00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f26c80aede0 con 0x7f26c806d770 2024-04-24T23:02:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cda00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f26c815a980 0x7f26c80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36250/0 (socket says 172.21.15.146:36250) 2024-04-24T23:02:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26cda00640 1 -- 172.21.15.146:0/4069658086 learned_addr learned my addr 172.21.15.146:0/4069658086 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.210+0000 7f26ce400640 1 --2- 172.21.15.146:0/4069658086 >> v2:172.21.15.146:3300/0 conn(0x7f26c806d770 0x7f26c8071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.211+0000 7f26c7e00640 1 -- 172.21.15.146:0/4069658086 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1050817769 0 0) 0x7f26bc001110 con 0x7f26c815a980 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.211+0000 7f26c7e00640 1 -- 172.21.15.146:0/4069658086 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b0005730 con 0x7f26c815a980 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.211+0000 7f26ce400640 1 -- 172.21.15.146:0/4069658086 >> v1:172.21.15.203:6789/0 conn(0x7f26c80d0240 legacy=0x7f26c80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.211+0000 7f26ce400640 1 -- 172.21.15.146:0/4069658086 >> v1:172.21.15.146:6789/0 conn(0x7f26c815a980 legacy=0x7f26c80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.211+0000 7f26ce400640 1 -- 172.21.15.146:0/4069658086 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c806e0a0 con 0x7f26c806d770 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.212+0000 7f26ce400640 1 --2- 172.21.15.146:0/4069658086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c806d770 0x7f26c8071dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009d90 tx=0x7f26c002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf635aefca5c999 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.212+0000 7f26c7e00640 1 -- 172.21.15.146:0/4069658086 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0031600 con 0x7f26c806d770 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.212+0000 7f26c7e00640 1 -- 172.21.15.146:0/4069658086 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00317a0 con 0x7f26c806d770 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.212+0000 7f26c7e00640 1 -- 172.21.15.146:0/4069658086 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0031b70 con 0x7f26c806d770 2024-04-24T23:02:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 -- 172.21.15.146:0/4069658086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c806d770 msgr2=0x7f26c8071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 --2- 172.21.15.146:0/4069658086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c806d770 0x7f26c8071dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009d90 tx=0x7f26c002a610 comp rx=0 tx=0).stop 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 -- 172.21.15.146:0/4069658086 shutdown_connections 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 --2- 172.21.15.146:0/4069658086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c806d770 0x7f26c8071dd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 -- 172.21.15.146:0/4069658086 >> 172.21.15.146:0/4069658086 conn(0x7f26c806b320 msgr2=0x7f26c806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 -- 172.21.15.146:0/4069658086 shutdown_connections 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.213+0000 7f26cee00640 1 -- 172.21.15.146:0/4069658086 wait complete. 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.215+0000 7f26cee00640 1 Processor -- start 2024-04-24T23:02:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.215+0000 7f26cee00640 1 -- start start 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c806d770 0x7f26c80b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26c815a980 0x7f26c815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26c815ad60 con 0x7f26c80d0240 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f26c806e660 con 0x7f26c806d770 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f26c815aee0 con 0x7f26c815a980 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38126/0 (socket says 172.21.15.146:38126) 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 -- 172.21.15.146:0/2589794605 learned_addr learned my addr 172.21.15.146:0/2589794605 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cda00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c806d770 0x7f26c80b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26ce400640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26c815a980 0x7f26c815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 -- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26c815a980 msgr2=0x7f26c815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26c815a980 0x7f26c815cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 -- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c806d770 msgr2=0x7f26c80b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c806d770 0x7f26c80b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.216+0000 7f26cd000640 1 -- 172.21.15.146:0/2589794605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c815baa0 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26cd000640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c430 tx=0x7f26b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011790 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b4017070 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011bb0 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c815bd80 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.217+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c815c340 con 0x7f26c80d0240 2024-04-24T23:02:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.218+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c804f500 con 0x7f26c80d0240 2024-04-24T23:02:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.219+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26b401c460 con 0x7f26c80d0240 2024-04-24T23:02:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.220+0000 7f26c5600640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 0x7f26a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.221+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f26b408ac60 con 0x7f26c80d0240 2024-04-24T23:02:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.221+0000 7f26cda00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 0x7f26a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.222+0000 7f26cda00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 0x7f26a806e320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26bc007fd0 tx=0x7f26bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.225+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f26b4059690 con 0x7f26c80d0240 2024-04-24T23:02:16.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:16.497+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) -- 0x7f26c8159650 con 0x7f26c80d0240 2024-04-24T23:02:17.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.110+0000 7f26c5600640 1 -- 172.21.15.146:0/2589794605 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v152) ==== 151+0+0 (secure 0 0 0) 0x7f26b4058f90 con 0x7f26c80d0240 2024-04-24T23:02:17.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 msgr2=0x7f26a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 0x7f26a806e320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26bc007fd0 tx=0x7f26bc009040 comp rx=0 tx=0).stop 2024-04-24T23:02:17.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 msgr2=0x7f26c8145370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c430 tx=0x7f26b400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 shutdown_connections 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f26a806be60 0x7f26a806e320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26c815a980 0x7f26c815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26c80d0240 0x7f26c8145370 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 --2- 172.21.15.146:0/2589794605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c806d770 0x7f26c80b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 >> 172.21.15.146:0/2589794605 conn(0x7f26c806b320 msgr2=0x7f26c80cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 shutdown_connections 2024-04-24T23:02:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.114+0000 7f26cee00640 1 -- 172.21.15.146:0/2589794605 wait complete. 2024-04-24T23:02:17.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:02:17.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.331+0000 7f96b6400640 1 Processor -- start 2024-04-24T23:02:17.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.331+0000 7f96b6400640 1 -- start start 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96b6400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96b00712b0 0x7f96b0072a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96b6400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b014c0e0 con 0x7f96b014b2d0 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96b6400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b006d770 con 0x7f96b00b3ac0 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96b6400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f96b014b6b0 con 0x7f96b00712b0 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96af400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f96b014b2d0 0x7f96b0070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36256/0 (socket says 172.21.15.146:36256) 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96af400640 1 -- 172.21.15.146:0/2944542839 learned_addr learned my addr 172.21.15.146:0/2944542839 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.333+0000 7f96aea00640 1 --2- 172.21.15.146:0/2944542839 >> v2:172.21.15.146:3300/0 conn(0x7f96b00712b0 0x7f96b0072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:17.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.334+0000 7f96ae000640 1 -- 172.21.15.146:0/2944542839 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774827302 0 0) 0x7f96b014c0e0 con 0x7f96b014b2d0 2024-04-24T23:02:17.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.334+0000 7f96ae000640 1 -- 172.21.15.146:0/2944542839 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9694003520 con 0x7f96b014b2d0 2024-04-24T23:02:17.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.334+0000 7f96aea00640 1 -- 172.21.15.146:0/2944542839 >> v1:172.21.15.203:6789/0 conn(0x7f96b00b3ac0 legacy=0x7f96b016c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:17.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.334+0000 7f96aea00640 1 -- 172.21.15.146:0/2944542839 >> v1:172.21.15.146:6789/0 conn(0x7f96b014b2d0 legacy=0x7f96b0070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.334+0000 7f96aea00640 1 -- 172.21.15.146:0/2944542839 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b006da50 con 0x7f96b00712b0 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.335+0000 7f96aea00640 1 --2- 172.21.15.146:0/2944542839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b00712b0 0x7f96b0072a10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a652fdec8f5def server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.335+0000 7f96ae000640 1 -- 172.21.15.146:0/2944542839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c037070 con 0x7f96b00712b0 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.335+0000 7f96ae000640 1 -- 172.21.15.146:0/2944542839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c032440 con 0x7f96b00712b0 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.335+0000 7f96ae000640 1 -- 172.21.15.146:0/2944542839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0327f0 con 0x7f96b00712b0 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 -- 172.21.15.146:0/2944542839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b00712b0 msgr2=0x7f96b0072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 --2- 172.21.15.146:0/2944542839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b00712b0 0x7f96b0072a10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 -- 172.21.15.146:0/2944542839 shutdown_connections 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 --2- 172.21.15.146:0/2944542839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b00712b0 0x7f96b0072a10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 -- 172.21.15.146:0/2944542839 >> 172.21.15.146:0/2944542839 conn(0x7f96b006b140 msgr2=0x7f96b006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 -- 172.21.15.146:0/2944542839 shutdown_connections 2024-04-24T23:02:17.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.336+0000 7f96b6400640 1 -- 172.21.15.146:0/2944542839 wait complete. 2024-04-24T23:02:17.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.338+0000 7f96b6400640 1 Processor -- start 2024-04-24T23:02:17.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.338+0000 7f96b6400640 1 -- start start 2024-04-24T23:02:17.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96b00712b0 0x7f96b01f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:17.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 0x7f96b015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:17.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:17.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f96b006e010 con 0x7f96b014b2d0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96b006e380 con 0x7f96b00b3ac0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96b6400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f96b014b870 con 0x7f96b00712b0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38136/0 (socket says 172.21.15.146:38136) 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96afe00640 1 -- 172.21.15.146:0/2723040001 learned_addr learned my addr 172.21.15.146:0/2723040001 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.339+0000 7f96af400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96b00712b0 0x7f96b01f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96aea00640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 0x7f96b015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 -- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96b00712b0 msgr2=0x7f96b01f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96b00712b0 0x7f96b01f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 -- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 msgr2=0x7f96b015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 0x7f96b015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 -- 172.21.15.146:0/2723040001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b01e9ff0 con 0x7f96b014b2d0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96aea00640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 0x7f96b015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96afe00640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c780 tx=0x7f96a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8004b60 con 0x7f96b014b2d0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8004d00 con 0x7f96b014b2d0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b01ea2d0 con 0x7f96b014b2d0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.340+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a800aa90 con 0x7f96b014b2d0 2024-04-24T23:02:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.341+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b01ea890 con 0x7f96b014b2d0 2024-04-24T23:02:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.342+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b004f5a0 con 0x7f96b014b2d0 2024-04-24T23:02:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.342+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96a800ac30 con 0x7f96b014b2d0 2024-04-24T23:02:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.343+0000 7f96a7400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 0x7f969006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.344+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f96a808aff0 con 0x7f96b014b2d0 2024-04-24T23:02:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.344+0000 7f96af400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 0x7f969006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.345+0000 7f96af400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 0x7f969006e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f96a0005880 tx=0x7f96a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.348+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f96a8020070 con 0x7f96b014b2d0 2024-04-24T23:02:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.545+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f96b0072d50 con 0x7f96b014b2d0 2024-04-24T23:02:17.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.550+0000 7f96a7400640 1 -- 172.21.15.146:0/2723040001 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f96a8059b10 con 0x7f96b014b2d0 2024-04-24T23:02:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 msgr2=0x7f969006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 0x7f969006e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f96a0005880 tx=0x7f96a0009040 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 msgr2=0x7f96b01e9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c780 tx=0x7f96a800cc40 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 shutdown_connections 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b014b2d0 0x7f96b01e9530 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96b00b3ac0 0x7f96b015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f969006be30 0x7f969006e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 --2- 172.21.15.146:0/2723040001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96b00712b0 0x7f96b01f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.553+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 >> 172.21.15.146:0/2723040001 conn(0x7f96b006b140 msgr2=0x7f96b0148510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.554+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 shutdown_connections 2024-04-24T23:02:17.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:17.554+0000 7f96b6400640 1 -- 172.21.15.146:0/2723040001 wait complete. 2024-04-24T23:02:17.574 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:02:17.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:02:17.689 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:02:17.797 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:02:17.797 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:17.797 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:17.856 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:02:17.856 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:02:17.856 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:17.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:02:17.913 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:17.914 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:17.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:02:17.971 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:02:17.971 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:18.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:02:18.027 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:02:18.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.236+0000 7fbc92600640 1 Processor -- start 2024-04-24T23:02:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.236+0000 7fbc92600640 1 -- start start 2024-04-24T23:02:18.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc92600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c06cb60 0x7fbc8c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc92600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8c0d2870 0x7fbc8c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc92600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8c0d4b60 con 0x7fbc8c161800 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc92600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8c0d4e40 con 0x7fbc8c0d2870 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc92600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8c0b1b70 con 0x7fbc8c06cb60 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc8b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc8c161800 0x7fbc8c0d2160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56796/0 (socket says 172.21.15.146:56796) 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc8b400640 1 -- 172.21.15.146:0/113434293 learned_addr learned my addr 172.21.15.146:0/113434293 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.238+0000 7fbc8be00640 1 --2- 172.21.15.146:0/113434293 >> v2:172.21.15.146:3300/0 conn(0x7fbc8c0d2870 0x7fbc8c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc82a00640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c06cb60 0x7fbc8c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc8aa00640 1 -- 172.21.15.146:0/113434293 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773968098 0 0) 0x7fbc8c0d4b60 con 0x7fbc8c161800 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc8be00640 1 -- 172.21.15.146:0/113434293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c06cb60 msgr2=0x7fbc8c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc8be00640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c06cb60 0x7fbc8c06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc8be00640 1 -- 172.21.15.146:0/113434293 >> v1:172.21.15.146:6789/0 conn(0x7fbc8c161800 legacy=0x7fbc8c0d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.239+0000 7fbc8be00640 1 -- 172.21.15.146:0/113434293 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c0b1800 con 0x7fbc8c0d2870 2024-04-24T23:02:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.240+0000 7fbc8be00640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0b2000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009d90 tx=0x7fbc8402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b4b36f8c12fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.240+0000 7fbc8aa00640 1 -- 172.21.15.146:0/113434293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84007740 con 0x7fbc8c0d2870 2024-04-24T23:02:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.240+0000 7fbc8aa00640 1 -- 172.21.15.146:0/113434293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc840078e0 con 0x7fbc8c0d2870 2024-04-24T23:02:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.240+0000 7fbc8aa00640 1 -- 172.21.15.146:0/113434293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84007cb0 con 0x7fbc8c0d2870 2024-04-24T23:02:18.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 -- 172.21.15.146:0/113434293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0d2870 msgr2=0x7fbc8c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0b2000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009d90 tx=0x7fbc8402a6f0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 -- 172.21.15.146:0/113434293 shutdown_connections 2024-04-24T23:02:18.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0b2000 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 --2- 172.21.15.146:0/113434293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c06cb60 0x7fbc8c06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 -- 172.21.15.146:0/113434293 >> 172.21.15.146:0/113434293 conn(0x7fbc8c0d3ea0 msgr2=0x7fbc8c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 -- 172.21.15.146:0/113434293 shutdown_connections 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.241+0000 7fbc92600640 1 -- 172.21.15.146:0/113434293 wait complete. 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.243+0000 7fbc92600640 1 Processor -- start 2024-04-24T23:02:18.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.243+0000 7fbc92600640 1 -- start start 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c161800 0x7fbc8c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c06d130 con 0x7fbc8c06cb60 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c06cfb0 con 0x7fbc8c0d2870 2024-04-24T23:02:18.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc92600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8c0b2540 con 0x7fbc8c161800 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50672/0 (socket says 172.21.15.146:50672) 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 -- 172.21.15.146:0/967809135 learned_addr learned my addr 172.21.15.146:0/967809135 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8be00640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c161800 0x7fbc8c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc82a00640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 -- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c161800 msgr2=0x7fbc8c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c161800 0x7fbc8c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 -- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc8c0d2870 msgr2=0x7fbc8c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.244+0000 7fbc8b400640 1 -- 172.21.15.146:0/967809135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c0cd6d0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc8b400640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c430 tx=0x7fbc7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0074e0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0047e0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c004bd0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c0cd9b0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.245+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c0cdf70 con 0x7fbc8c06cb60 2024-04-24T23:02:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.247+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8c068190 con 0x7fbc8c06cb60 2024-04-24T23:02:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.248+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc7c011070 con 0x7fbc8c06cb60 2024-04-24T23:02:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.248+0000 7fbc83e00640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 0x7fbc6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.249+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7fbc7c08ab10 con 0x7fbc8c06cb60 2024-04-24T23:02:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.249+0000 7fbc82a00640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 0x7fbc6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.250+0000 7fbc82a00640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 0x7fbc6806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c15ea00 tx=0x7fbc74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.253+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc7c0594b0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.494+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc8c09dd60 con 0x7fbc8c06cb60 2024-04-24T23:02:18.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.495+0000 7fbc83e00640 1 -- 172.21.15.146:0/967809135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3875 (secure 0 0 0) 0x7fbc7c058db0 con 0x7fbc8c06cb60 2024-04-24T23:02:18.496 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:18.497 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2190163715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2190163715},{"type":"v1","addr":"172.21.15.203:6836","nonce":2190163715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/394289749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":394289749},{"type":"v1","addr":"172.21.15.203:6837","nonce":394289749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/627972046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":627972046},{"type":"v1","addr":"172.21.15.146:6834","nonce":627972046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5817,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2569777656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2569777656},{"type":"v1","addr":"172.21.15.146:6835","nonce":2569777656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-04-24T23:02:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 26 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 msgr2=0x7fbc6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 0x7fbc6806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c15ea00 tx=0x7fbc74008040 comp rx=0 tx=0).stop 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 msgr2=0x7fbc8c14f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c430 tx=0x7fbc7c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 shutdown_connections 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbc6806be30 0x7fbc6806e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc8c161800 0x7fbc8c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc8c0d2870 0x7fbc8c0ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 --2- 172.21.15.146:0/967809135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c06cb60 0x7fbc8c14f360 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.498+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 >> 172.21.15.146:0/967809135 conn(0x7fbc8c0d3ea0 msgr2=0x7fbc8c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:18.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.499+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 shutdown_connections 2024-04-24T23:02:18.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.499+0000 7fbc92600640 1 -- 172.21.15.146:0/967809135 wait complete. 2024-04-24T23:02:18.518 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:02:18.518 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:02:18.518 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:02:18.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:02:18.519 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:02:18.519 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:02:18.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:02:18.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:02:18.519 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:02:18.519 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:02:18.520 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:02:18.520 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:02:18.520 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:02:18.520 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:02:18.520 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:02:18.520 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:02:18.535 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:02:18.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:02:18.537 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:02:18.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:02:18.544 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:02:18.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:02:18.545 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:02:18.545 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:02:18.582 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:02:18.582 DEBUG:teuthology.parallel:result is None 2024-04-24T23:02:18.586 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:02:18.586 DEBUG:teuthology.parallel:result is None 2024-04-24T23:02:18.591 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:02:18.591 DEBUG:teuthology.parallel:result is None 2024-04-24T23:02:18.596 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:02:18.596 DEBUG:teuthology.parallel:result is None 2024-04-24T23:02:18.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:02:18.729 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:02:18.729 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:02:18.744 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:02:18.747 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:02:18.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.776+0000 7f7f92a00640 1 Processor -- start 2024-04-24T23:02:18.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.777+0000 7f7f92a00640 1 -- start start 2024-04-24T23:02:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f92a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7f8c15abb0 0x7f7f8c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f92a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f92a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8c071960 con 0x7f7f8c15f1f0 2024-04-24T23:02:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f92a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8c071c40 con 0x7f7f8c15abb0 2024-04-24T23:02:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f92a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c071f20 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f83400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f90a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f7f8c15f1f0 0x7f7f8c15af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:44816/0 (socket says 172.21.15.146:44816) 2024-04-24T23:02:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.778+0000 7f7f8be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7f8c15abb0 0x7f7f8c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f83400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:49784/0 (socket says 172.21.15.146:49784) 2024-04-24T23:02:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f90a00640 1 -- 172.21.15.146:0/1176388819 learned_addr learned my addr 172.21.15.146:0/1176388819 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f83400640 1 -- 172.21.15.146:0/1176388819 >> v2:172.21.15.203:3300/0 conn(0x7f7f8c15abb0 msgr2=0x7f7f8c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f83400640 1 --2- 172.21.15.146:0/1176388819 >> v2:172.21.15.203:3300/0 conn(0x7f7f8c15abb0 0x7f7f8c06cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f83400640 1 -- 172.21.15.146:0/1176388819 >> v1:172.21.15.203:6789/0 conn(0x7f7f8c15f1f0 legacy=0x7f7f8c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.779+0000 7f7f83400640 1 -- 172.21.15.146:0/1176388819 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c072200 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.780+0000 7f7f83400640 1 --2- 172.21.15.146:0/1176388819 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097a0 tx=0x7f7f7402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a6ba504b8c2240 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.780+0000 7f7f8b400640 1 -- 172.21.15.146:0/1176388819 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74037070 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f8b400640 1 -- 172.21.15.146:0/1176388819 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74032440 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f8b400640 1 -- 172.21.15.146:0/1176388819 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032810 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 -- 172.21.15.146:0/1176388819 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 msgr2=0x7f7f8c15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 --2- 172.21.15.146:0/1176388819 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097a0 tx=0x7f7f7402a180 comp rx=0 tx=0).stop 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 -- 172.21.15.146:0/1176388819 shutdown_connections 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 --2- 172.21.15.146:0/1176388819 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15e8b0 0x7f7f8c15ecb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 --2- 172.21.15.146:0/1176388819 >> v2:172.21.15.203:3300/0 conn(0x7f7f8c15abb0 0x7f7f8c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 -- 172.21.15.146:0/1176388819 >> 172.21.15.146:0/1176388819 conn(0x7f7f8c06b140 msgr2=0x7f7f8c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 -- 172.21.15.146:0/1176388819 shutdown_connections 2024-04-24T23:02:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.781+0000 7f7f92a00640 1 -- 172.21.15.146:0/1176388819 wait complete. 2024-04-24T23:02:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.783+0000 7f7f92a00640 1 Processor -- start 2024-04-24T23:02:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.783+0000 7f7f92a00640 1 -- start start 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 0x7f7f8c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f8c15e8b0 0x7f7f8c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 0x7f7f8c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c15d7c0 con 0x7f7f8c15f1f0 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c15f660 con 0x7f7f8c15e8b0 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f92a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c15d940 con 0x7f7f8c15abb0 2024-04-24T23:02:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f90a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 0x7f7f8c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f8be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 0x7f7f8c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f90a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 0x7f7f8c14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50710/0 (socket says 172.21.15.146:50710) 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f90a00640 1 -- 172.21.15.146:0/3879819464 learned_addr learned my addr 172.21.15.146:0/3879819464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.784+0000 7f7f83400640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f8c15e8b0 0x7f7f8c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 -- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f8c15e8b0 msgr2=0x7f7f8c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f8c15e8b0 0x7f7f8c151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 -- 172.21.15.146:0/3879819464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 msgr2=0x7f7f8c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 0x7f7f8c14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 -- 172.21.15.146:0/3879819464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c150ac0 con 0x7f7f8c15abb0 2024-04-24T23:02:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f8be00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 0x7f7f8c0b4580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c010df0 tx=0x7f7f7c00e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.785+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c01e070 con 0x7f7f8c15abb0 2024-04-24T23:02:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.786+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c011860 con 0x7f7f8c15abb0 2024-04-24T23:02:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.786+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c153d30 con 0x7f7f8c15abb0 2024-04-24T23:02:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.786+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c011c50 con 0x7f7f8c15abb0 2024-04-24T23:02:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.786+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c151a70 con 0x7f7f8c15abb0 2024-04-24T23:02:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.787+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c151170 con 0x7f7f8c15abb0 2024-04-24T23:02:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.788+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f7c021070 con 0x7f7f8c15abb0 2024-04-24T23:02:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.789+0000 7f7f88c00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.789+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 5421+0+0 (secure 0 0 0) 0x7f7f7c08d7d0 con 0x7f7f8c15abb0 2024-04-24T23:02:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.789+0000 7f7f83400640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.790+0000 7f7f83400640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 0x7f7f6806e320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f74034000 tx=0x7f7f7402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:18.796+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f7c05bc40 con 0x7f7f8c15abb0 2024-04-24T23:02:19.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:19.000+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7f8c06bda0 con 0x7f7f8c15abb0 2024-04-24T23:02:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.155+0000 7f7f88c00640 1 -- 172.21.15.146:0/3879819464 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) ==== 97+0+0 (secure 0 0 0) 0x7f7f7c05ff40 con 0x7f7f8c15abb0 2024-04-24T23:02:20.157 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 msgr2=0x7f7f6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 0x7f7f6806e320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f74034000 tx=0x7f7f7402e000 comp rx=0 tx=0).stop 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 msgr2=0x7f7f8c0b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 0x7f7f8c0b4580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c010df0 tx=0x7f7f7c00e730 comp rx=0 tx=0).stop 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 shutdown_connections 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8c15f1f0 0x7f7f8c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f8c15e8b0 0x7f7f8c151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7f6806be60 0x7f7f6806e320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 --2- 172.21.15.146:0/3879819464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7f8c15abb0 0x7f7f8c0b4580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 >> 172.21.15.146:0/3879819464 conn(0x7f7f8c06b140 msgr2=0x7f7f8c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:20.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 shutdown_connections 2024-04-24T23:02:20.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.159+0000 7f7f92a00640 1 -- 172.21.15.146:0/3879819464 wait complete. 2024-04-24T23:02:20.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:02:20.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.380+0000 7f24dd800640 1 Processor -- start 2024-04-24T23:02:20.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.380+0000 7f24dd800640 1 -- start start 2024-04-24T23:02:20.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24dd800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24d8072920 0x7f24d80cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24dd800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f24d80d0070 0x7f24d80b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24dd800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d815e1b0 con 0x7f24d815ddd0 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24dd800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80d04d0 con 0x7f24d8072920 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24dd800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80713b0 con 0x7f24d80d0070 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24d7400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24d8072920 0x7f24d80cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24d7400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24d8072920 0x7f24d80cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50720/0 (socket says 172.21.15.146:50720) 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.382+0000 7f24d7400640 1 -- 172.21.15.146:0/3843009858 learned_addr learned my addr 172.21.15.146:0/3843009858 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.383+0000 7f24dce00640 1 --2- 172.21.15.146:0/3843009858 >> v2:172.21.15.203:3300/0 conn(0x7f24d80d0070 0x7f24d80b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.383+0000 7f24d7400640 1 -- 172.21.15.146:0/3843009858 >> v2:172.21.15.203:3300/0 conn(0x7f24d80d0070 msgr2=0x7f24d80b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.383+0000 7f24d7400640 1 --2- 172.21.15.146:0/3843009858 >> v2:172.21.15.203:3300/0 conn(0x7f24d80d0070 0x7f24d80b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.383+0000 7f24d7400640 1 -- 172.21.15.146:0/3843009858 >> v1:172.21.15.203:6789/0 conn(0x7f24d815ddd0 legacy=0x7f24d8070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:20.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.383+0000 7f24d7400640 1 -- 172.21.15.146:0/3843009858 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8071690 con 0x7f24d8072920 2024-04-24T23:02:20.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.384+0000 7f24d7400640 1 --2- 172.21.15.146:0/3843009858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8072920 0x7f24d80cfb30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f24d80728a0 tx=0x7f24c402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96b4766fe902ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.384+0000 7f24d6a00640 1 -- 172.21.15.146:0/3843009858 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4037070 con 0x7f24d8072920 2024-04-24T23:02:20.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.384+0000 7f24d6a00640 1 -- 172.21.15.146:0/3843009858 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4032440 con 0x7f24d8072920 2024-04-24T23:02:20.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.384+0000 7f24d6a00640 1 -- 172.21.15.146:0/3843009858 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4032810 con 0x7f24d8072920 2024-04-24T23:02:20.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 -- 172.21.15.146:0/3843009858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8072920 msgr2=0x7f24d80cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 --2- 172.21.15.146:0/3843009858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8072920 0x7f24d80cfb30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f24d80728a0 tx=0x7f24c402a230 comp rx=0 tx=0).stop 2024-04-24T23:02:20.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 -- 172.21.15.146:0/3843009858 shutdown_connections 2024-04-24T23:02:20.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 --2- 172.21.15.146:0/3843009858 >> v2:172.21.15.203:3300/0 conn(0x7f24d80d0070 0x7f24d80b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 --2- 172.21.15.146:0/3843009858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8072920 0x7f24d80cfb30 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 -- 172.21.15.146:0/3843009858 >> 172.21.15.146:0/3843009858 conn(0x7f24d806b320 msgr2=0x7f24d806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:20.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 -- 172.21.15.146:0/3843009858 shutdown_connections 2024-04-24T23:02:20.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.385+0000 7f24dd800640 1 -- 172.21.15.146:0/3843009858 wait complete. 2024-04-24T23:02:20.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.387+0000 7f24dd800640 1 Processor -- start 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.387+0000 7f24dd800640 1 -- start start 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d8072920 0x7f24d81554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d815ddd0 0x7f24d80b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24d80b3140 con 0x7f24d80d0070 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8071c50 con 0x7f24d8072920 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24dd800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80b32c0 con 0x7f24d815ddd0 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50732/0 (socket says 172.21.15.146:50732) 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24d7400640 1 -- 172.21.15.146:0/3524279115 learned_addr learned my addr 172.21.15.146:0/3524279115 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.388+0000 7f24d7e00640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d8072920 0x7f24d81554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24dce00640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d815ddd0 0x7f24d80b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 -- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d815ddd0 msgr2=0x7f24d80b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d815ddd0 0x7f24d80b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 -- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d8072920 msgr2=0x7f24d81554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d8072920 0x7f24d81554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 -- 172.21.15.146:0/3524279115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d80c47d0 con 0x7f24d80d0070 2024-04-24T23:02:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24d7400640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f24c402a270 tx=0x7f24c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4041020 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c40306c0 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4037040 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.389+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d80ce6d0 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.390+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d80cec90 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.391+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d804f500 con 0x7f24d80d0070 2024-04-24T23:02:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.391+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24c4044020 con 0x7f24d80d0070 2024-04-24T23:02:20.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.392+0000 7f24cfe00640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.392+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f24c40ab530 con 0x7f24d80d0070 2024-04-24T23:02:20.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.393+0000 7f24d7e00640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.394+0000 7f24d7e00640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 0x7f24b806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006fd0 tx=0x7f24c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.397+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f24c404b030 con 0x7f24d80d0070 2024-04-24T23:02:20.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.646+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f24d806cdc0 con 0x7f24d80d0070 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.647+0000 7f24cfe00640 1 -- 172.21.15.146:0/3524279115 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7f24c407a090 con 0x7f24d80d0070 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.648 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ==", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ==", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.649 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg==", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:02:20.650 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg==", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.651 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA==", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ==", 2024-04-24T23:02:20.652 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA==", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg==", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ==", 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q==", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.655 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ==", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA==", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:02:20.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw==", 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.657 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g==", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw==", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg==", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmFG6LAxAA7YUamq4/Vvt8ibyWUFiI+w==", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA==", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:02:20.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg==", 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:20.661 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:02:20.662 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:02:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 msgr2=0x7f24b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 0x7f24b806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006fd0 tx=0x7f24c8008040 comp rx=0 tx=0).stop 2024-04-24T23:02:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 msgr2=0x7f24d80cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f24c402a270 tx=0x7f24c40046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 shutdown_connections 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d815ddd0 0x7f24d80b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d80d0070 0x7f24d80cbb00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 --2- 172.21.15.146:0/3524279115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d8072920 0x7f24d81554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 >> 172.21.15.146:0/3524279115 conn(0x7f24d806b320 msgr2=0x7f24d80ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 shutdown_connections 2024-04-24T23:02:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.650+0000 7f24dd800640 1 -- 172.21.15.146:0/3524279115 wait complete. 2024-04-24T23:02:20.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.861+0000 7f40d1200640 1 Processor -- start 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.862+0000 7f40d1200640 1 -- start start 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.863+0000 7f40d1200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40cc0b2a20 0x7f40cc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.863+0000 7f40d1200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.863+0000 7f40d1200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40cc0cdf70 con 0x7f40cc145640 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.863+0000 7f40d1200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f40cc145a20 con 0x7f40cc0b2a20 2024-04-24T23:02:20.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.863+0000 7f40d1200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc06d140 con 0x7f40cc06cbc0 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.864+0000 7f40ca800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.864+0000 7f40ca800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:49812/0 (socket says 172.21.15.146:49812) 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.864+0000 7f40ca800640 1 -- 172.21.15.146:0/1761630201 learned_addr learned my addr 172.21.15.146:0/1761630201 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.864+0000 7f40c1400640 1 --2- 172.21.15.146:0/1761630201 >> v2:172.21.15.203:3300/0 conn(0x7f40cc0b2a20 0x7f40cc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.865+0000 7f40ca800640 1 -- 172.21.15.146:0/1761630201 >> v2:172.21.15.203:3300/0 conn(0x7f40cc0b2a20 msgr2=0x7f40cc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.865+0000 7f40ca800640 1 --2- 172.21.15.146:0/1761630201 >> v2:172.21.15.203:3300/0 conn(0x7f40cc0b2a20 0x7f40cc0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.865+0000 7f40ca800640 1 -- 172.21.15.146:0/1761630201 >> v1:172.21.15.203:6789/0 conn(0x7f40cc145640 legacy=0x7f40cc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.865+0000 7f40ca800640 1 -- 172.21.15.146:0/1761630201 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc06d420 con 0x7f40cc06cbc0 2024-04-24T23:02:20.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.866+0000 7f40ca800640 1 --2- 172.21.15.146:0/1761630201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e50 tx=0x7f40c402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c288c9343d0efc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40c9400640 1 -- 172.21.15.146:0/1761630201 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4036070 con 0x7f40cc06cbc0 2024-04-24T23:02:20.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40c9400640 1 -- 172.21.15.146:0/1761630201 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4031600 con 0x7f40cc06cbc0 2024-04-24T23:02:20.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40c9400640 1 -- 172.21.15.146:0/1761630201 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c40319d0 con 0x7f40cc06cbc0 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 -- 172.21.15.146:0/1761630201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 msgr2=0x7f40cc0d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 --2- 172.21.15.146:0/1761630201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009e50 tx=0x7f40c402a710 comp rx=0 tx=0).stop 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 -- 172.21.15.146:0/1761630201 shutdown_connections 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 --2- 172.21.15.146:0/1761630201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc06cbc0 0x7f40cc0d01d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 --2- 172.21.15.146:0/1761630201 >> v2:172.21.15.203:3300/0 conn(0x7f40cc0b2a20 0x7f40cc0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 -- 172.21.15.146:0/1761630201 >> 172.21.15.146:0/1761630201 conn(0x7f40cc06b320 msgr2=0x7f40cc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 -- 172.21.15.146:0/1761630201 shutdown_connections 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.867+0000 7f40d1200640 1 -- 172.21.15.146:0/1761630201 wait complete. 2024-04-24T23:02:20.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.869+0000 7f40d1200640 1 Processor -- start 2024-04-24T23:02:20.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.869+0000 7f40d1200640 1 -- start start 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc0b2a20 0x7f40cc1e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc145640 0x7f40cc15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc0ce450 con 0x7f40cc06cbc0 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc06d9e0 con 0x7f40cc0b2a20 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.870+0000 7f40d1200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc0ce5d0 con 0x7f40cc145640 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50740/0 (socket says 172.21.15.146:50740) 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 -- 172.21.15.146:0/651648763 learned_addr learned my addr 172.21.15.146:0/651648763 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40ca800640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc145640 0x7f40cc15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 -- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc145640 msgr2=0x7f40cc15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc145640 0x7f40cc15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c1400640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc0b2a20 0x7f40cc1e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 -- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc0b2a20 msgr2=0x7f40cc1e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc0b2a20 0x7f40cc1e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.871+0000 7f40c9e00640 1 -- 172.21.15.146:0/651648763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc1f1a90 con 0x7f40cc06cbc0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40c9e00640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c340 tx=0x7f40bc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc017070 con 0x7f40cc06cbc0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40bc0052d0 con 0x7f40cc06cbc0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc1e61e0 con 0x7f40cc06cbc0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc003850 con 0x7f40cc06cbc0 2024-04-24T23:02:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.872+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc1e67a0 con 0x7f40cc06cbc0 2024-04-24T23:02:20.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.873+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc068190 con 0x7f40cc06cbc0 2024-04-24T23:02:20.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.874+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40bc01a070 con 0x7f40cc06cbc0 2024-04-24T23:02:20.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.875+0000 7f40c2a00640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 0x7f40a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:20.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.875+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f40bc089f70 con 0x7f40cc06cbc0 2024-04-24T23:02:20.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.876+0000 7f40c1400640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 0x7f40a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:20.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.877+0000 7f40c1400640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 0x7f40a806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40cc159d50 tx=0x7f40b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:20.879+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40cc1f1a90 con 0x7f40cc06cbc0 2024-04-24T23:02:21.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.078+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40cc06bb10 con 0x7f40cc06cbc0 2024-04-24T23:02:21.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.080+0000 7f40c2a00640 1 -- 172.21.15.146:0/651648763 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13188 (secure 0 0 0) 0x7f40bc058b70 con 0x7f40cc06cbc0 2024-04-24T23:02:21.081 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:21.082 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":50,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:20.146673+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 msgr2=0x7f40a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 0x7f40a806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40cc159d50 tx=0x7f40b4008040 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 msgr2=0x7f40cc1f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c340 tx=0x7f40bc00c800 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 shutdown_connections 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f40a806be30 0x7f40a806e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc145640 0x7f40cc15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc0b2a20 0x7f40cc1e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 --2- 172.21.15.146:0/651648763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06cbc0 0x7f40cc1f1550 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 >> 172.21.15.146:0/651648763 conn(0x7f40cc06b320 msgr2=0x7f40cc15f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:21.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.083+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 shutdown_connections 2024-04-24T23:02:21.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.084+0000 7f40d1200640 1 -- 172.21.15.146:0/651648763 wait complete. 2024-04-24T23:02:21.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:02:21.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:02:21.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.304+0000 7f9dfb000640 1 Processor -- start 2024-04-24T23:02:21.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.305+0000 7f9dfb000640 1 -- start start 2024-04-24T23:02:21.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 0x7f9df406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df4071520 0x7f9df40719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 0x7f9df406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9df415e3f0 con 0x7f9df4071520 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9df406cd20 con 0x7f9df406e620 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.306+0000 7f9dfb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9df415f440 con 0x7f9df415e010 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df4071520 0x7f9df40719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9df4071520 0x7f9df40719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50756/0 (socket says 172.21.15.146:50756) 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 -- 172.21.15.146:0/2150477386 learned_addr learned my addr 172.21.15.146:0/2150477386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3e00640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 0x7f9df406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df9000640 1 --2- 172.21.15.146:0/2150477386 >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 0x7f9df406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 -- 172.21.15.146:0/2150477386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 msgr2=0x7f9df406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 0x7f9df406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 -- 172.21.15.146:0/2150477386 >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 msgr2=0x7f9df406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 --2- 172.21.15.146:0/2150477386 >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 0x7f9df406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3400640 1 -- 172.21.15.146:0/2150477386 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df4071fe0 con 0x7f9df4071520 2024-04-24T23:02:21.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df3e00640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 0x7f9df406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:21.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.307+0000 7f9df9000640 1 --2- 172.21.15.146:0/2150477386 >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 0x7f9df406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.308+0000 7f9df3400640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df4071520 0x7f9df40719a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9df4071ee0 tx=0x7f9ddc02a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa9481c94d733cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9df2a00640 1 -- 172.21.15.146:0/2150477386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc036070 con 0x7f9df4071520 2024-04-24T23:02:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9df2a00640 1 -- 172.21.15.146:0/2150477386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc031600 con 0x7f9df4071520 2024-04-24T23:02:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9df2a00640 1 -- 172.21.15.146:0/2150477386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0319d0 con 0x7f9df4071520 2024-04-24T23:02:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 -- 172.21.15.146:0/2150477386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df4071520 msgr2=0x7f9df40719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df4071520 0x7f9df40719a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9df4071ee0 tx=0x7f9ddc02a690 comp rx=0 tx=0).stop 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 -- 172.21.15.146:0/2150477386 shutdown_connections 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df4071520 0x7f9df40719a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 --2- 172.21.15.146:0/2150477386 >> v2:172.21.15.203:3300/0 conn(0x7f9df406e620 0x7f9df406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 --2- 172.21.15.146:0/2150477386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df415e010 0x7f9df406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 -- 172.21.15.146:0/2150477386 >> 172.21.15.146:0/2150477386 conn(0x7f9df40b17b0 msgr2=0x7f9df40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.309+0000 7f9dfb000640 1 -- 172.21.15.146:0/2150477386 shutdown_connections 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.310+0000 7f9dfb000640 1 -- 172.21.15.146:0/2150477386 wait complete. 2024-04-24T23:02:21.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.311+0000 7f9dfb000640 1 Processor -- start 2024-04-24T23:02:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.311+0000 7f9dfb000640 1 -- start start 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df4071520 0x7f9df4159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df415e010 0x7f9df4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9df406d580 con 0x7f9df406e620 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9df406d2a0 con 0x7f9df415e010 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.312+0000 7f9dfb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9df406d860 con 0x7f9df4071520 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50764/0 (socket says 172.21.15.146:50764) 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 -- 172.21.15.146:0/421171926 learned_addr learned my addr 172.21.15.146:0/421171926 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:21.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3400640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df4071520 0x7f9df4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df9000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df415e010 0x7f9df4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 -- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df4071520 msgr2=0x7f9df4159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df4071520 0x7f9df4159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 -- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df415e010 msgr2=0x7f9df4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df415e010 0x7f9df4156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 -- 172.21.15.146:0/421171926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df4157fe0 con 0x7f9df406e620 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.313+0000 7f9df3e00640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c7f0 tx=0x7f9de400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.314+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4015070 con 0x7f9df406e620 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.314+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4007a30 con 0x7f9df406e620 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.314+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df41582c0 con 0x7f9df406e620 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.314+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4007e00 con 0x7f9df406e620 2024-04-24T23:02:21.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.314+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df4158880 con 0x7f9df406e620 2024-04-24T23:02:21.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.315+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df404f5a0 con 0x7f9df406e620 2024-04-24T23:02:21.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.316+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9de4018070 con 0x7f9df406e620 2024-04-24T23:02:21.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.317+0000 7f9debe00640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 0x7f9dd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.317+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f9de408ac90 con 0x7f9df406e620 2024-04-24T23:02:21.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.318+0000 7f9df3400640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 0x7f9dd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.319+0000 7f9df3400640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 0x7f9dd006e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc033000 tx=0x7f9ddc009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.321+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9de4059800 con 0x7f9df406e620 2024-04-24T23:02:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.525+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9df40b3190 con 0x7f9df406e620 2024-04-24T23:02:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.526+0000 7f9debe00640 1 -- 172.21.15.146:0/421171926 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f9de4059100 con 0x7f9df406e620 2024-04-24T23:02:21.527 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:02:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.528+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 msgr2=0x7f9dd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.528+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 0x7f9dd006e320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc033000 tx=0x7f9ddc009000 comp rx=0 tx=0).stop 2024-04-24T23:02:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 msgr2=0x7f9df4146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c7f0 tx=0x7f9de400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 shutdown_connections 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9df415e010 0x7f9df4156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dd006be60 0x7f9dd006e320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9df4071520 0x7f9df4159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 --2- 172.21.15.146:0/421171926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9df406e620 0x7f9df4146580 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 >> 172.21.15.146:0/421171926 conn(0x7f9df40b17b0 msgr2=0x7f9df40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 shutdown_connections 2024-04-24T23:02:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.529+0000 7f9dfb000640 1 -- 172.21.15.146:0/421171926 wait complete. 2024-04-24T23:02:21.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:02:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.752+0000 7f9603200640 1 Processor -- start 2024-04-24T23:02:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.752+0000 7f9603200640 1 -- start start 2024-04-24T23:02:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9603200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95fc0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9603200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f95fc0d0070 0x7f95fc0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9603200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95fc15e1b0 con 0x7f95fc15ddd0 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9603200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f95fc0713b0 con 0x7f95fc0d0070 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9603200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc071690 con 0x7f95fc072920 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9601e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95fc15ddd0 0x7f95fc070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56802/0 (socket says 172.21.15.146:56802) 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9601e00640 1 -- 172.21.15.146:0/1007635244 learned_addr learned my addr 172.21.15.146:0/1007635244 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9601400640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95fc0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9602800640 1 --2- 172.21.15.146:0/1007635244 >> v2:172.21.15.203:3300/0 conn(0x7f95fc0d0070 0x7f95fc0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146106373 0 0) 0x7f95fc15e1b0 con 0x7f95fc15ddd0 2024-04-24T23:02:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.754+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95e4003520 con 0x7f95fc15ddd0 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543814218 0 0) 0x7f95e4003520 con 0x7f95fc15ddd0 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 msgr2=0x7f95fc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95fc0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 >> v2:172.21.15.203:3300/0 conn(0x7f95fc0d0070 msgr2=0x7f95fc0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 --2- 172.21.15.146:0/1007635244 >> v2:172.21.15.203:3300/0 conn(0x7f95fc0d0070 0x7f95fc0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc071970 con 0x7f95fc15ddd0 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f95f0001690 con 0x7f95fc15ddd0 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 >> v1:172.21.15.146:6789/0 conn(0x7f95fc15ddd0 legacy=0x7f95fc070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e4003f80 0x7f95e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0713b0 con 0x7f95e4004d40 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc071690 con 0x7f95e4003f80 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95e400b9c0 con 0x7f95fc072920 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.755+0000 7f9602800640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9601e00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9601400640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e4003f80 0x7f95e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9602800640 1 -- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 msgr2=0x7f95e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9602800640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9602800640 1 -- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e4003f80 msgr2=0x7f95e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9602800640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e4003f80 0x7f95e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9602800640 1 -- 172.21.15.146:0/1007635244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e4003520 con 0x7f95e4004d40 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9601e00640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc072920 0x7f95e40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.756+0000 7f9601400640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e4003f80 0x7f95e4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:21.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.757+0000 7f9602800640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95e40051c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e170 tx=0x7f95e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573eda4461dd8564 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.757+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8034020 con 0x7f95e4004d40 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.757+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f8030430 con 0x7f95e4004d40 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.757+0000 7f9600a00640 1 -- 172.21.15.146:0/1007635244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8009c10 con 0x7f95e4004d40 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 -- 172.21.15.146:0/1007635244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 msgr2=0x7f95e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 --2- 172.21.15.146:0/1007635244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95e40051c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e170 tx=0x7f95e4005830 comp rx=0 tx=0).stop 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9602800640 1 -- 172.21.15.146:0/1007635244 reap_dead start 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 -- 172.21.15.146:0/1007635244 shutdown_connections 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 -- 172.21.15.146:0/1007635244 >> 172.21.15.146:0/1007635244 conn(0x7f95fc06b320 msgr2=0x7f95fc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 -- 172.21.15.146:0/1007635244 shutdown_connections 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.758+0000 7f9603200640 1 -- 172.21.15.146:0/1007635244 wait complete. 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.760+0000 7f9603200640 1 Processor -- start 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.760+0000 7f9603200640 1 -- start start 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 0x7f95fc149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc0cdc00 0x7f95fc149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0cfcb0 con 0x7f95e4004d40 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0cfb30 con 0x7f95fc0cd780 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9603200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0cfe30 con 0x7f95fc0cdc00 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9601e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9601e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50786/0 (socket says 172.21.15.146:50786) 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9601e00640 1 -- 172.21.15.146:0/949371597 learned_addr learned my addr 172.21.15.146:0/949371597 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9601400640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 0x7f95fc149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9601e00640 1 -- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc0cdc00 msgr2=0x7f95fc149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.761+0000 7f9602800640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc0cdc00 0x7f95fc149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601e00640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc0cdc00 0x7f95fc149550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601e00640 1 -- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 msgr2=0x7f95fc149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601e00640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 0x7f95fc149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601e00640 1 -- 172.21.15.146:0/949371597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0cc6e0 con 0x7f95e4004d40 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601400640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 0x7f95fc149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9601e00640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f95f000d800 tx=0x7f95f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0019070 con 0x7f95e4004d40 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f00074e0 con 0x7f95e4004d40 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc0cc9c0 con 0x7f95e4004d40 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004a20 con 0x7f95e4004d40 2024-04-24T23:02:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.762+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc0ccf80 con 0x7f95e4004d40 2024-04-24T23:02:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.763+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc0aea10 con 0x7f95e4004d40 2024-04-24T23:02:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.764+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95f001c070 con 0x7f95e4004d40 2024-04-24T23:02:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.765+0000 7f95f6000640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 0x7f95e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.765+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f95f008a830 con 0x7f95e4004d40 2024-04-24T23:02:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.766+0000 7f9601400640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 0x7f95e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.767+0000 7f9601400640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 0x7f95e006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f95fc157eb0 tx=0x7f95ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.770+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f95fc0aea10 con 0x7f95e4004d40 2024-04-24T23:02:21.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.968+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f95fc04f500 con 0x7f95e4004d40 2024-04-24T23:02:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.969+0000 7f95f6000640 1 -- 172.21.15.146:0/949371597 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7f95f0059300 con 0x7f95e4004d40 2024-04-24T23:02:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:21.970 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T23:02:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:02:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T23:02:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T23:02:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:02:21.971 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T23:02:21.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 msgr2=0x7f95e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 0x7f95e006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f95fc157eb0 tx=0x7f95ec008040 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 msgr2=0x7f95fc145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f95f000d800 tx=0x7f95f000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 shutdown_connections 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f95e006be30 0x7f95e006e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95fc0cdc00 0x7f95fc149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95fc0cd780 0x7f95fc149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 --2- 172.21.15.146:0/949371597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e4004d40 0x7f95fc145300 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 >> 172.21.15.146:0/949371597 conn(0x7f95fc06b320 msgr2=0x7f95fc0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 shutdown_connections 2024-04-24T23:02:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:21.972+0000 7f9603200640 1 -- 172.21.15.146:0/949371597 wait complete. 2024-04-24T23:02:21.993 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:02:21.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:02:22.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.193+0000 7f7031600640 1 Processor -- start 2024-04-24T23:02:22.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.193+0000 7f7031600640 1 -- start start 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f7031600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f702c0728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f7031600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c0cf040 con 0x7f702c0ceaf0 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f7031600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c0cf320 con 0x7f702c15f9f0 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f7031600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f702c070c70 con 0x7f702c145510 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f702a000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f702c0ceaf0 0x7f702c06cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56806/0 (socket says 172.21.15.146:56806) 2024-04-24T23:02:22.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f702a000640 1 -- 172.21.15.146:0/3858463245 learned_addr learned my addr 172.21.15.146:0/3858463245 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:22.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.195+0000 7f702aa00640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f702c0728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379124917 0 0) 0x7f702c0cf040 con 0x7f702c0ceaf0 2024-04-24T23:02:22.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7010003520 con 0x7f702c0ceaf0 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2359064813 0 0) 0x7f7010003520 con 0x7f702c0ceaf0 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 msgr2=0x7f702c0728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f702c0728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 >> v1:172.21.15.203:6789/0 conn(0x7f702c15f9f0 legacy=0x7f702c071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c070f50 con 0x7f702c0ceaf0 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7014001670 con 0x7f702c0ceaf0 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 >> v1:172.21.15.146:6789/0 conn(0x7f702c0ceaf0 legacy=0x7f702c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70100039e0 0x7f7010003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7010004800 0x7f7010004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f7010005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f702c070c70 con 0x7f7010004800 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f701000baf0 con 0x7f70100039e0 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.196+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f701000bcf0 con 0x7f702c145510 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7010004800 0x7f7010004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702aa00640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70100039e0 0x7f7010003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702b400640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f7010005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 -- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 msgr2=0x7f7010005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f7010005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 -- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70100039e0 msgr2=0x7f7010003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70100039e0 0x7f7010003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702a000640 1 -- 172.21.15.146:0/3858463245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010003520 con 0x7f7010004800 2024-04-24T23:02:22.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.197+0000 7f702b400640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f702c145510 0x7f7010005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.198+0000 7f702a000640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7010004800 0x7f7010004c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f701400c240 tx=0x7f7010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a973df414a5d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.198+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014007d10 con 0x7f7010004800 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.198+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7014005ad0 con 0x7f7010004800 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.198+0000 7f7029600640 1 -- 172.21.15.146:0/3858463245 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014007070 con 0x7f7010004800 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 -- 172.21.15.146:0/3858463245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7010004800 msgr2=0x7f7010004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:22.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 --2- 172.21.15.146:0/3858463245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7010004800 0x7f7010004c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f701400c240 tx=0x7f7010005830 comp rx=0 tx=0).stop 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f702b400640 1 -- 172.21.15.146:0/3858463245 reap_dead start 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 -- 172.21.15.146:0/3858463245 shutdown_connections 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 -- 172.21.15.146:0/3858463245 >> 172.21.15.146:0/3858463245 conn(0x7f702c0b16b0 msgr2=0x7f702c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 -- 172.21.15.146:0/3858463245 shutdown_connections 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.199+0000 7f7031600640 1 -- 172.21.15.146:0/3858463245 wait complete. 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.201+0000 7f7031600640 1 Processor -- start 2024-04-24T23:02:22.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.201+0000 7f7031600640 1 -- start start 2024-04-24T23:02:22.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 0x7f702c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0b3ef0 0x7f702c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1458f0 con 0x7f702c0b2ab0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f702c06d290 con 0x7f702c0b3ef0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f7031600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f702c145a70 con 0x7f7010004800 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f702b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f702b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50798/0 (socket says 172.21.15.146:50798) 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.202+0000 7f702b400640 1 -- 172.21.15.146:0/2992512323 learned_addr learned my addr 172.21.15.146:0/2992512323 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702aa00640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 0x7f702c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 -- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 msgr2=0x7f702c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 0x7f702c0ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 -- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0b3ef0 msgr2=0x7f702c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702a000640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0b3ef0 0x7f702c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0b3ef0 0x7f702c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 -- 172.21.15.146:0/2992512323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c13fd50 con 0x7f702c0b2ab0 2024-04-24T23:02:22.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702aa00640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 0x7f702c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f702b400640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f702c0cef50 tx=0x7f702400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024006d50 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024003970 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024003d60 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.203+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c0ae8b0 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.204+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c0aee70 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.205+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c067af0 con 0x7f702c0b2ab0 2024-04-24T23:02:22.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.206+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f702401b020 con 0x7f702c0b2ab0 2024-04-24T23:02:22.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.207+0000 7f7022a00640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 0x7f700806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:22.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.207+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f702408a950 con 0x7f702c0b2ab0 2024-04-24T23:02:22.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.207+0000 7f702aa00640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 0x7f700806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:22.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.209+0000 7f702aa00640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 0x7f700806e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f701c009a00 tx=0x7f701c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.211+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f702c067af0 con 0x7f702c0b2ab0 2024-04-24T23:02:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:22.409+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f702c068190 con 0x7f702c0b2ab0 2024-04-24T23:02:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.179+0000 7f7022a00640 1 -- 172.21.15.146:0/2992512323 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7f702401ce40 con 0x7f702c0b2ab0 2024-04-24T23:02:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T23:02:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.182+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 msgr2=0x7f700806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.182+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 0x7f700806e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f701c009a00 tx=0x7f701c008040 comp rx=0 tx=0).stop 2024-04-24T23:02:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.182+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 msgr2=0x7f702c0b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.182+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f702c0cef50 tx=0x7f702400dc00 comp rx=0 tx=0).stop 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 shutdown_connections 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f702c0b2ab0 0x7f702c0b2f30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f702c0b3ef0 0x7f702c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f700806be30 0x7f700806e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 --2- 172.21.15.146:0/2992512323 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7010004800 0x7f702c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 >> 172.21.15.146:0/2992512323 conn(0x7f702c0b16b0 msgr2=0x7f702c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 shutdown_connections 2024-04-24T23:02:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.183+0000 7f7031600640 1 -- 172.21.15.146:0/2992512323 wait complete. 2024-04-24T23:02:23.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:02:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.401+0000 7fba3f200640 1 Processor -- start 2024-04-24T23:02:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.402+0000 7fba3f200640 1 -- start start 2024-04-24T23:02:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.403+0000 7fba3f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba40154dc0 0x7fba4006b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.403+0000 7fba3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 0x7fba400ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.403+0000 7fba3f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba40071b90 con 0x7fba4006baa0 2024-04-24T23:02:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.403+0000 7fba3f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fba4006bf10 con 0x7fba40154dc0 2024-04-24T23:02:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.403+0000 7fba3f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba40070dd0 con 0x7fba4015edf0 2024-04-24T23:02:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.404+0000 7fba3e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 0x7fba400ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.404+0000 7fba37e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fba4006baa0 0x7fba4015e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:44840/0 (socket says 172.21.15.146:44840) 2024-04-24T23:02:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.404+0000 7fba37e00640 1 -- 172.21.15.146:0/2992350838 learned_addr learned my addr 172.21.15.146:0/2992350838 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.404+0000 7fba3de00640 1 --2- 172.21.15.146:0/2992350838 >> v2:172.21.15.203:3300/0 conn(0x7fba40154dc0 0x7fba4006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3de00640 1 -- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 msgr2=0x7fba400ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3de00640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 0x7fba400ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3de00640 1 -- 172.21.15.146:0/2992350838 >> v1:172.21.15.203:6789/0 conn(0x7fba4006baa0 legacy=0x7fba4015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3de00640 1 -- 172.21.15.146:0/2992350838 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba400710b0 con 0x7fba40154dc0 2024-04-24T23:02:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3d400640 1 -- 172.21.15.146:0/2992350838 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001638138 0 0) 0x7fba40071b90 con 0x7fba4006baa0 2024-04-24T23:02:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.405+0000 7fba3e800640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 0x7fba400ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:02:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.407+0000 7fba3de00640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba4006b560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba300097a0 tx=0x7fba3002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f3f6410d8ca5d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.407+0000 7fba3d400640 1 -- 172.21.15.146:0/2992350838 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30037070 con 0x7fba40154dc0 2024-04-24T23:02:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.407+0000 7fba3d400640 1 -- 172.21.15.146:0/2992350838 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba30032440 con 0x7fba40154dc0 2024-04-24T23:02:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.407+0000 7fba3d400640 1 -- 172.21.15.146:0/2992350838 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30032810 con 0x7fba40154dc0 2024-04-24T23:02:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 -- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 msgr2=0x7fba4006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba4006b560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba300097a0 tx=0x7fba3002a210 comp rx=0 tx=0).stop 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 -- 172.21.15.146:0/2992350838 shutdown_connections 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4015edf0 0x7fba400ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 --2- 172.21.15.146:0/2992350838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba4006b560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 -- 172.21.15.146:0/2992350838 >> 172.21.15.146:0/2992350838 conn(0x7fba400b19c0 msgr2=0x7fba400b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 -- 172.21.15.146:0/2992350838 shutdown_connections 2024-04-24T23:02:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.408+0000 7fba3f200640 1 -- 172.21.15.146:0/2992350838 wait complete. 2024-04-24T23:02:23.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.410+0000 7fba3f200640 1 Processor -- start 2024-04-24T23:02:23.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.410+0000 7fba3f200640 1 -- start start 2024-04-24T23:02:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4006baa0 0x7fba401526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba40155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba401551a0 con 0x7fba4015edf0 2024-04-24T23:02:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba40071670 con 0x7fba40154dc0 2024-04-24T23:02:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba400b2ae0 con 0x7fba4006baa0 2024-04-24T23:02:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50804/0 (socket says 172.21.15.146:50804) 2024-04-24T23:02:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.411+0000 7fba3e800640 1 -- 172.21.15.146:0/3197803230 learned_addr learned my addr 172.21.15.146:0/3197803230 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3de00640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4006baa0 0x7fba401526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba37e00640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba40155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 -- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4006baa0 msgr2=0x7fba401526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4006baa0 0x7fba401526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 -- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 msgr2=0x7fba40155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba40155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 -- 172.21.15.146:0/3197803230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba400cd320 con 0x7fba4015edf0 2024-04-24T23:02:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba3e800640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fba38009e60 tx=0x7fba3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38018030 con 0x7fba4015edf0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.412+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3800cdf0 con 0x7fba4015edf0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.413+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba40155d00 con 0x7fba4015edf0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.413+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38003bb0 con 0x7fba4015edf0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.413+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba401562c0 con 0x7fba4015edf0 2024-04-24T23:02:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.414+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4004f500 con 0x7fba4015edf0 2024-04-24T23:02:23.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.415+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba38005d10 con 0x7fba4015edf0 2024-04-24T23:02:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.416+0000 7fba36000640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.416+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5619+0+0 (secure 0 0 0) 0x7fba3808bf80 con 0x7fba4015edf0 2024-04-24T23:02:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.417+0000 7fba3de00640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.418+0000 7fba3de00640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 0x7fba1c06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fba30034000 tx=0x7fba3002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.420+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba38022070 con 0x7fba4015edf0 2024-04-24T23:02:23.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:23.619+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fba40158730 con 0x7fba4015edf0 2024-04-24T23:02:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.193+0000 7fba36000640 1 -- 172.21.15.146:0/3197803230 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7fba38010040 con 0x7fba4015edf0 2024-04-24T23:02:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T23:02:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.197+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 msgr2=0x7fba1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:24.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.197+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 0x7fba1c06e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fba30034000 tx=0x7fba3002e000 comp rx=0 tx=0).stop 2024-04-24T23:02:24.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.197+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 msgr2=0x7fba4006cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:24.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.197+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fba38009e60 tx=0x7fba3800c490 comp rx=0 tx=0).stop 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 shutdown_connections 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4015edf0 0x7fba4006cec0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40154dc0 0x7fba40155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fba1c06be30 0x7fba1c06e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 --2- 172.21.15.146:0/3197803230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4006baa0 0x7fba401526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 >> 172.21.15.146:0/3197803230 conn(0x7fba400b19c0 msgr2=0x7fba400cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 shutdown_connections 2024-04-24T23:02:24.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.198+0000 7fba3f200640 1 -- 172.21.15.146:0/3197803230 wait complete. 2024-04-24T23:02:24.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:02:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.412+0000 7fd8caa00640 1 Processor -- start 2024-04-24T23:02:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.412+0000 7fd8caa00640 1 -- start start 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8caa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd8c415e010 0x7fd8c406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8caa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8c4071520 0x7fd8c40719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8caa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c415e3f0 con 0x7fd8c406e620 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8caa00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c406cd20 con 0x7fd8c4071520 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8caa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c415f440 con 0x7fd8c415e010 2024-04-24T23:02:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8bb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8c4071520 0x7fd8c40719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8bb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8c4071520 0x7fd8c40719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50810/0 (socket says 172.21.15.146:50810) 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.414+0000 7fd8bb400640 1 -- 172.21.15.146:0/519374418 learned_addr learned my addr 172.21.15.146:0/519374418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.415+0000 7fd8bb400640 1 -- 172.21.15.146:0/519374418 >> v2:172.21.15.203:3300/0 conn(0x7fd8c415e010 msgr2=0x7fd8c406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.415+0000 7fd8bb400640 1 --2- 172.21.15.146:0/519374418 >> v2:172.21.15.203:3300/0 conn(0x7fd8c415e010 0x7fd8c406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.415+0000 7fd8bb400640 1 -- 172.21.15.146:0/519374418 >> v1:172.21.15.203:6789/0 conn(0x7fd8c406e620 legacy=0x7fd8c40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.415+0000 7fd8bb400640 1 -- 172.21.15.146:0/519374418 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c4071fe0 con 0x7fd8c4071520 2024-04-24T23:02:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.416+0000 7fd8bb400640 1 --2- 172.21.15.146:0/519374418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c40719d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009870 tx=0x7fd8ac02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a1f08b0aea12c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.416+0000 7fd8c3400640 1 -- 172.21.15.146:0/519374418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac037070 con 0x7fd8c4071520 2024-04-24T23:02:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.416+0000 7fd8c3400640 1 -- 172.21.15.146:0/519374418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac032440 con 0x7fd8c4071520 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.416+0000 7fd8c3400640 1 -- 172.21.15.146:0/519374418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac032810 con 0x7fd8c4071520 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 -- 172.21.15.146:0/519374418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 msgr2=0x7fd8c40719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 --2- 172.21.15.146:0/519374418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c40719d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009870 tx=0x7fd8ac02a250 comp rx=0 tx=0).stop 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 -- 172.21.15.146:0/519374418 shutdown_connections 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 --2- 172.21.15.146:0/519374418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c40719d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 --2- 172.21.15.146:0/519374418 >> v2:172.21.15.203:3300/0 conn(0x7fd8c415e010 0x7fd8c406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 -- 172.21.15.146:0/519374418 >> 172.21.15.146:0/519374418 conn(0x7fd8c40b17b0 msgr2=0x7fd8c40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 -- 172.21.15.146:0/519374418 shutdown_connections 2024-04-24T23:02:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.417+0000 7fd8caa00640 1 -- 172.21.15.146:0/519374418 wait complete. 2024-04-24T23:02:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.419+0000 7fd8caa00640 1 Processor -- start 2024-04-24T23:02:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.419+0000 7fd8caa00640 1 -- start start 2024-04-24T23:02:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8c406e620 0x7fd8c414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8c415e010 0x7fd8c415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c406d580 con 0x7fd8c4071520 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c406d2a0 con 0x7fd8c415e010 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8caa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c406d860 con 0x7fd8c406e620 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50822/0 (socket says 172.21.15.146:50822) 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 -- 172.21.15.146:0/1925637093 learned_addr learned my addr 172.21.15.146:0/1925637093 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 -- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8c406e620 msgr2=0x7fd8c414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8c406e620 0x7fd8c414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 -- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8c415e010 msgr2=0x7fd8c415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8c415e010 0x7fd8c415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.420+0000 7fd8bb400640 1 -- 172.21.15.146:0/1925637093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c40c50e0 con 0x7fd8c4071520 2024-04-24T23:02:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8bb400640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac037040 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac004230 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c41e8770 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac03c670 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.421+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c40c5880 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.422+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c404f5a0 con 0x7fd8c4071520 2024-04-24T23:02:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.423+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8ac03a070 con 0x7fd8c4071520 2024-04-24T23:02:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.424+0000 7fd8c0c00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.424+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6001+0+0 (secure 0 0 0) 0x7fd8ac0ab930 con 0x7fd8c4071520 2024-04-24T23:02:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.425+0000 7fd8c3e00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.426+0000 7fd8c3e00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009710 tx=0x7fd8b4006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.429+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd8ac041020 con 0x7fd8c4071520 2024-04-24T23:02:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:24.668+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd8c40ae0b0 con 0x7fd8c4071520 2024-04-24T23:02:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.197+0000 7fd8c0c00640 1 -- 172.21.15.146:0/1925637093 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v28) ==== 172+0+0 (secure 0 0 0) 0x7fd8ac07a230 con 0x7fd8c4071520 2024-04-24T23:02:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 7 and data pool 8 2024-04-24T23:02:25.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 msgr2=0x7fd8a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009710 tx=0x7fd8b4006c90 comp rx=0 tx=0).stop 2024-04-24T23:02:25.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 msgr2=0x7fd8c415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac0046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 shutdown_connections 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8c415e010 0x7fd8c415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8c4071520 0x7fd8c415f6f0 secure :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac0046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 --2- 172.21.15.146:0/1925637093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8c406e620 0x7fd8c414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 >> 172.21.15.146:0/1925637093 conn(0x7fd8c40b17b0 msgr2=0x7fd8c40cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 shutdown_connections 2024-04-24T23:02:25.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.201+0000 7fd8caa00640 1 -- 172.21.15.146:0/1925637093 wait complete. 2024-04-24T23:02:25.241 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.414+0000 7fdf18a00640 1 Processor -- start 2024-04-24T23:02:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.414+0000 7fdf18a00640 1 -- start start 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf18a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 0x7fdf140cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf18a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf140709d0 0x7fdf1415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf18a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf14070f90 con 0x7fdf141561c0 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf18a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdf140b4310 con 0x7fdf140709d0 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf18a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdf141565a0 con 0x7fdf140d0240 2024-04-24T23:02:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf140709d0 0x7fdf1415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf140709d0 0x7fdf1415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50830/0 (socket says 172.21.15.146:50830) 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 -- 172.21.15.146:0/2164681288 learned_addr learned my addr 172.21.15.146:0/2164681288 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf12a00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 0x7fdf140cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 -- 172.21.15.146:0/2164681288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 msgr2=0x7fdf140cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 0x7fdf140cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 -- 172.21.15.146:0/2164681288 >> v1:172.21.15.203:6789/0 conn(0x7fdf141561c0 legacy=0x7fdf140cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf13e00640 1 -- 172.21.15.146:0/2164681288 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf14071270 con 0x7fdf140709d0 2024-04-24T23:02:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.416+0000 7fdf12a00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 0x7fdf140cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.417+0000 7fdf13e00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140709d0 0x7fdf1415cb80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e50 tx=0x7fdf0c02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb7c807787c59d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf12000640 1 -- 172.21.15.146:0/2164681288 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c036070 con 0x7fdf140709d0 2024-04-24T23:02:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf12000640 1 -- 172.21.15.146:0/2164681288 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c031600 con 0x7fdf140709d0 2024-04-24T23:02:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf12000640 1 -- 172.21.15.146:0/2164681288 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0319d0 con 0x7fdf140709d0 2024-04-24T23:02:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 -- 172.21.15.146:0/2164681288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140709d0 msgr2=0x7fdf1415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140709d0 0x7fdf1415cb80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e50 tx=0x7fdf0c02a5b0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 -- 172.21.15.146:0/2164681288 shutdown_connections 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140709d0 0x7fdf1415cb80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 --2- 172.21.15.146:0/2164681288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140d0240 0x7fdf140cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 -- 172.21.15.146:0/2164681288 >> 172.21.15.146:0/2164681288 conn(0x7fdf1406b320 msgr2=0x7fdf1406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.418+0000 7fdf18a00640 1 -- 172.21.15.146:0/2164681288 shutdown_connections 2024-04-24T23:02:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.419+0000 7fdf18a00640 1 -- 172.21.15.146:0/2164681288 wait complete. 2024-04-24T23:02:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.420+0000 7fdf18a00640 1 Processor -- start 2024-04-24T23:02:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.420+0000 7fdf18a00640 1 -- start start 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140709d0 0x7fdf14156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 0x7fdf1415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf140b2c20 con 0x7fdf140d0240 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14071830 con 0x7fdf141561c0 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf18a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdf140b2da0 con 0x7fdf140709d0 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf12a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf12a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50842/0 (socket says 172.21.15.146:50842) 2024-04-24T23:02:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.421+0000 7fdf12a00640 1 -- 172.21.15.146:0/1149263630 learned_addr learned my addr 172.21.15.146:0/1149263630 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf13e00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 0x7fdf1415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf13400640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140709d0 0x7fdf14156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 -- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140709d0 msgr2=0x7fdf14156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140709d0 0x7fdf14156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 -- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 msgr2=0x7fdf1415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 0x7fdf1415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 -- 172.21.15.146:0/1149263630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf14157630 con 0x7fdf140d0240 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf13e00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 0x7fdf1415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:25.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.422+0000 7fdf12a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000c820 tx=0x7fdf0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.423+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00015070 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.423+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf00007a30 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.423+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00007e00 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.423+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1415a4f0 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.423+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf14156c70 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.424+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1404f500 con 0x7fdf140d0240 2024-04-24T23:02:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.425+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf00018070 con 0x7fdf140d0240 2024-04-24T23:02:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.426+0000 7fdf0b400640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 0x7fdef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.426+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fdf0008af50 con 0x7fdf140d0240 2024-04-24T23:02:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.426+0000 7fdf13400640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 0x7fdef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.427+0000 7fdf13400640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 0x7fdef406e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.430+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdf00059800 con 0x7fdf140d0240 2024-04-24T23:02:25.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.621+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf14155770 con 0x7fdf140d0240 2024-04-24T23:02:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.622+0000 7fdf0b400640 1 -- 172.21.15.146:0/1149263630 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16919 (secure 0 0 0) 0x7fdf00059100 con 0x7fdf140d0240 2024-04-24T23:02:25.624 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:25.624 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:24.669293+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.625+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 msgr2=0x7fdef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.625+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 0x7fdef406e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04008040 comp rx=0 tx=0).stop 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.625+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 msgr2=0x7fdf1414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.625+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000c820 tx=0x7fdf0000cc20 comp rx=0 tx=0).stop 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 shutdown_connections 2024-04-24T23:02:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf141561c0 0x7fdf1415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf140d0240 0x7fdf1414ce10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdef406be30 0x7fdef406e2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 --2- 172.21.15.146:0/1149263630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdf140709d0 0x7fdf14156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 >> 172.21.15.146:0/1149263630 conn(0x7fdf1406b320 msgr2=0x7fdf140cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 shutdown_connections 2024-04-24T23:02:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.626+0000 7fdf18a00640 1 -- 172.21.15.146:0/1149263630 wait complete. 2024-04-24T23:02:25.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:25.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.839+0000 7f1069e00640 1 Processor -- start 2024-04-24T23:02:25.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.840+0000 7f1069e00640 1 -- start start 2024-04-24T23:02:25.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.841+0000 7f1069e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106415e2e0 0x7f10640cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.841+0000 7f1069e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10640cec10 0x7f10640cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.841+0000 7f1069e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10640b1390 con 0x7f10640d09d0 2024-04-24T23:02:25.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.841+0000 7f1069e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f10640cc2d0 con 0x7f10640cec10 2024-04-24T23:02:25.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.841+0000 7f1069e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10640d1140 con 0x7f106415e2e0 2024-04-24T23:02:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10640cec10 0x7f10640cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10640cec10 0x7f10640cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50846/0 (socket says 172.21.15.146:50846) 2024-04-24T23:02:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 -- 172.21.15.146:0/2026228094 learned_addr learned my addr 172.21.15.146:0/2026228094 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1062a00640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106415e2e0 0x7f10640cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 -- 172.21.15.146:0/2026228094 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106415e2e0 msgr2=0x7f10640cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106415e2e0 0x7f10640cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 -- 172.21.15.146:0/2026228094 >> v1:172.21.15.203:6789/0 conn(0x7f10640d09d0 legacy=0x7f10640ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.842+0000 7f1063400640 1 -- 172.21.15.146:0/2026228094 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10640cc520 con 0x7f10640cec10 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.843+0000 7f1063400640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f10640cd000 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f105c009e50 tx=0x7f105c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24552f2417f79c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.844+0000 7f1061600640 1 -- 172.21.15.146:0/2026228094 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c036070 con 0x7f10640cec10 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.844+0000 7f1061600640 1 -- 172.21.15.146:0/2026228094 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f105c031600 con 0x7f10640cec10 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.844+0000 7f1061600640 1 -- 172.21.15.146:0/2026228094 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0319d0 con 0x7f10640cec10 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.844+0000 7f1069e00640 1 -- 172.21.15.146:0/2026228094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 msgr2=0x7f10640cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.844+0000 7f1069e00640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f10640cd000 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f105c009e50 tx=0x7f105c02a7a0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 -- 172.21.15.146:0/2026228094 shutdown_connections 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f10640cd000 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 --2- 172.21.15.146:0/2026228094 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106415e2e0 0x7f10640cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 -- 172.21.15.146:0/2026228094 >> 172.21.15.146:0/2026228094 conn(0x7f10640d1c80 msgr2=0x7f10640d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 -- 172.21.15.146:0/2026228094 shutdown_connections 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.845+0000 7f1069e00640 1 -- 172.21.15.146:0/2026228094 wait complete. 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.846+0000 7f1069e00640 1 Processor -- start 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.846+0000 7f1069e00640 1 -- start start 2024-04-24T23:02:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10640d09d0 0x7f1064156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 0x7f1064160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f106415e6c0 con 0x7f10640cec10 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10640ccae0 con 0x7f106415e2e0 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.847+0000 7f1069e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10640d0e10 con 0x7f10640d09d0 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50856/0 (socket says 172.21.15.146:50856) 2024-04-24T23:02:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 -- 172.21.15.146:0/3164141588 learned_addr learned my addr 172.21.15.146:0/3164141588 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1063400640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 0x7f1064160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062000640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10640d09d0 0x7f1064156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 -- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10640d09d0 msgr2=0x7f1064156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10640d09d0 0x7f1064156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 -- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 msgr2=0x7f1064160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 0x7f1064160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 -- 172.21.15.146:0/3164141588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106415f9b0 con 0x7f10640cec10 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1063400640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 0x7f1064160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.848+0000 7f1062a00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f105400d620 tx=0x7f105400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.849+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105400b620 con 0x7f10640cec10 2024-04-24T23:02:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.849+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1054019070 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.849+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105400ba00 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.849+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1064159cb0 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.849+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f106415a270 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.850+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10640688a0 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.851+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f105400bba0 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.852+0000 7f105b400640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 0x7f104006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.852+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f105408b410 con 0x7f10640cec10 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.853+0000 7f1062000640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 0x7f104006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.854+0000 7f1062000640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 0x7f104006e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10641f7580 tx=0x7f104c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:25.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:25.857+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1054059c20 con 0x7f10640cec10 2024-04-24T23:02:26.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.056+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10640d0060 con 0x7f10640cec10 2024-04-24T23:02:26.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.059+0000 7f105b400640 1 -- 172.21.15.146:0/3164141588 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16919 (secure 0 0 0) 0x7f1054059520 con 0x7f10640cec10 2024-04-24T23:02:26.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:26.060 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:24.669293+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.061+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 msgr2=0x7f104006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.061+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 0x7f104006e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10641f7580 tx=0x7f104c009040 comp rx=0 tx=0).stop 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 msgr2=0x7f106415f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f105400d620 tx=0x7f105400dae0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 shutdown_connections 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415e2e0 0x7f1064160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104006be30 0x7f104006e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10640d09d0 0x7f1064156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 --2- 172.21.15.146:0/3164141588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10640cec10 0x7f106415f470 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 >> 172.21.15.146:0/3164141588 conn(0x7f10640d1c80 msgr2=0x7f10640b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:26.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 shutdown_connections 2024-04-24T23:02:26.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.062+0000 7f1069e00640 1 -- 172.21.15.146:0/3164141588 wait complete. 2024-04-24T23:02:26.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:02:26.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.275+0000 7f6771200640 1 Processor -- start 2024-04-24T23:02:26.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.275+0000 7f6771200640 1 -- start start 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6771200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f676c141c80 0x7f676c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6771200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 0x7f676c071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6771200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f676c0ced40 con 0x7f676c13ef30 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6771200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f676c1423d0 con 0x7f676c141c80 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6771200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f676c070f80 con 0x7f676c0ce5a0 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.276+0000 7f6761400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f676c141c80 0x7f676c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f676c141c80 0x7f676c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50860/0 (socket says 172.21.15.146:50860) 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 -- 172.21.15.146:0/3309143477 learned_addr learned my addr 172.21.15.146:0/3309143477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 -- 172.21.15.146:0/3309143477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 msgr2=0x7f676c071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f676a800640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 0x7f676c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:26.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 0x7f676c071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 -- 172.21.15.146:0/3309143477 >> v1:172.21.15.203:6789/0 conn(0x7f676c13ef30 legacy=0x7f676c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:26.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f6761400640 1 -- 172.21.15.146:0/3309143477 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c0cf020 con 0x7f676c141c80 2024-04-24T23:02:26.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.277+0000 7f676a800640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 0x7f676c071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.278+0000 7f6761400640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c141c80 0x7f676c0ce060 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6754009870 tx=0x7f675402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f079af0dc91c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.278+0000 7f6769400640 1 -- 172.21.15.146:0/3309143477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754037070 con 0x7f676c141c80 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.278+0000 7f6769400640 1 -- 172.21.15.146:0/3309143477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6754032440 con 0x7f676c141c80 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.278+0000 7f6769400640 1 -- 172.21.15.146:0/3309143477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754032810 con 0x7f676c141c80 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 -- 172.21.15.146:0/3309143477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c141c80 msgr2=0x7f676c0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c141c80 0x7f676c0ce060 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6754009870 tx=0x7f675402a200 comp rx=0 tx=0).stop 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 -- 172.21.15.146:0/3309143477 shutdown_connections 2024-04-24T23:02:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c0ce5a0 0x7f676c071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 --2- 172.21.15.146:0/3309143477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c141c80 0x7f676c0ce060 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 -- 172.21.15.146:0/3309143477 >> 172.21.15.146:0/3309143477 conn(0x7f676c0b17b0 msgr2=0x7f676c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 -- 172.21.15.146:0/3309143477 shutdown_connections 2024-04-24T23:02:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.279+0000 7f6771200640 1 -- 172.21.15.146:0/3309143477 wait complete. 2024-04-24T23:02:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.281+0000 7f6771200640 1 Processor -- start 2024-04-24T23:02:26.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.281+0000 7f6771200640 1 -- start start 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c13ef30 0x7f676c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f676c141c80 0x7f676c0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f676c0cea50 con 0x7f676c0ce5a0 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f676c070c10 con 0x7f676c141c80 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6771200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f676c071950 con 0x7f676c13ef30 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6769e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6769e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50872/0 (socket says 172.21.15.146:50872) 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.282+0000 7f6769e00640 1 -- 172.21.15.146:0/3424260586 learned_addr learned my addr 172.21.15.146:0/3424260586 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 -- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c13ef30 msgr2=0x7f676c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c13ef30 0x7f676c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 -- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f676c141c80 msgr2=0x7f676c0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f676c141c80 0x7f676c0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 -- 172.21.15.146:0/3424260586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c155a30 con 0x7f676c0ce5a0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6769e00640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c430 tx=0x7f675c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c011790 con 0x7f676c0ce5a0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c017070 con 0x7f676c0ce5a0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c011bb0 con 0x7f676c0ce5a0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c155cd0 con 0x7f676c0ce5a0 2024-04-24T23:02:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.283+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c156290 con 0x7f676c0ce5a0 2024-04-24T23:02:26.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.284+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676c04f5a0 con 0x7f676c0ce5a0 2024-04-24T23:02:26.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.285+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f675c01c460 con 0x7f676c0ce5a0 2024-04-24T23:02:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.286+0000 7f6762a00640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 0x7f674806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.286+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f675c08adf0 con 0x7f676c0ce5a0 2024-04-24T23:02:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.287+0000 7f6761400640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 0x7f674806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.288+0000 7f6761400640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 0x7f674806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6754034000 tx=0x7f675402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.290+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f675c0596a0 con 0x7f676c0ce5a0 2024-04-24T23:02:26.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:26.523+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f676c13f790 con 0x7f676c0ce5a0 2024-04-24T23:02:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.244+0000 7f6762a00640 1 -- 172.21.15.146:0/3424260586 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f675c058fa0 con 0x7f676c0ce5a0 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 msgr2=0x7f674806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 0x7f674806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6754034000 tx=0x7f675402c000 comp rx=0 tx=0).stop 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 msgr2=0x7f676c1f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c430 tx=0x7f675c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 shutdown_connections 2024-04-24T23:02:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f676c141c80 0x7f676c0b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f674806be30 0x7f674806e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f676c13ef30 0x7f676c0aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 --2- 172.21.15.146:0/3424260586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f676c0ce5a0 0x7f676c1f6dd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.247+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 >> 172.21.15.146:0/3424260586 conn(0x7f676c0b17b0 msgr2=0x7f676c06c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.248+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 shutdown_connections 2024-04-24T23:02:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.248+0000 7f6771200640 1 -- 172.21.15.146:0/3424260586 wait complete. 2024-04-24T23:02:27.269 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:02:27.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:02:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.471+0000 7f8201c00640 1 Processor -- start 2024-04-24T23:02:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.471+0000 7f8201c00640 1 -- start start 2024-04-24T23:02:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f81fc0af810 0x7f81fc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc15eee0 0x7f81fc0b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81fc06b940 0x7f81fc071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc0b0130 con 0x7f81fc06b940 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc0b39c0 con 0x7f81fc0af810 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.473+0000 7f8201c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc0b3c80 con 0x7f81fc15eee0 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81fc06b940 0x7f81fc071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81fc06b940 0x7f81fc071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50888/0 (socket says 172.21.15.146:50888) 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 -- 172.21.15.146:0/4177230906 learned_addr learned my addr 172.21.15.146:0/4177230906 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f81fbe00640 1 --2- 172.21.15.146:0/4177230906 >> v2:172.21.15.203:3300/0 conn(0x7f81fc0af810 0x7f81fc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f81fb400640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc15eee0 0x7f81fc0b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 -- 172.21.15.146:0/4177230906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc15eee0 msgr2=0x7f81fc0b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc15eee0 0x7f81fc0b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 -- 172.21.15.146:0/4177230906 >> v2:172.21.15.203:3300/0 conn(0x7f81fc0af810 msgr2=0x7f81fc0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 --2- 172.21.15.146:0/4177230906 >> v2:172.21.15.203:3300/0 conn(0x7f81fc0af810 0x7f81fc0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.474+0000 7f8201200640 1 -- 172.21.15.146:0/4177230906 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc0b3f60 con 0x7f81fc06b940 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.475+0000 7f8201200640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc071ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81fc073330 tx=0x7f81f402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0d4396b16eecbf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.475+0000 7f81faa00640 1 -- 172.21.15.146:0/4177230906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4037070 con 0x7f81fc06b940 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.475+0000 7f81faa00640 1 -- 172.21.15.146:0/4177230906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f402ae00 con 0x7f81fc06b940 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.475+0000 7f81faa00640 1 -- 172.21.15.146:0/4177230906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4032660 con 0x7f81fc06b940 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 -- 172.21.15.146:0/4177230906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 msgr2=0x7f81fc071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc071ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81fc073330 tx=0x7f81f402a0b0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 -- 172.21.15.146:0/4177230906 shutdown_connections 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc071ae0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 --2- 172.21.15.146:0/4177230906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc15eee0 0x7f81fc0b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 --2- 172.21.15.146:0/4177230906 >> v2:172.21.15.203:3300/0 conn(0x7f81fc0af810 0x7f81fc0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 -- 172.21.15.146:0/4177230906 >> 172.21.15.146:0/4177230906 conn(0x7f81fc0b26c0 msgr2=0x7f81fc0b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:27.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 -- 172.21.15.146:0/4177230906 shutdown_connections 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.476+0000 7f8201c00640 1 -- 172.21.15.146:0/4177230906 wait complete. 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.478+0000 7f8201c00640 1 Processor -- start 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.478+0000 7f8201c00640 1 -- start start 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc0af810 0x7f81fc0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81fc15eee0 0x7f81fc0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc0b5c50 con 0x7f81fc06b940 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc0b5ad0 con 0x7f81fc15eee0 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f8201c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc0af2c0 con 0x7f81fc0af810 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f81fbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f81fbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50904/0 (socket says 172.21.15.146:50904) 2024-04-24T23:02:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.479+0000 7f81fbe00640 1 -- 172.21.15.146:0/3411834552 learned_addr learned my addr 172.21.15.146:0/3411834552 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f8201200640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81fc15eee0 0x7f81fc0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 -- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc0af810 msgr2=0x7f81fc0b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fb400640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc0af810 0x7f81fc0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc0af810 0x7f81fc0b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 -- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81fc15eee0 msgr2=0x7f81fc0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81fc15eee0 0x7f81fc0b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 -- 172.21.15.146:0/3411834552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc15f3f0 con 0x7f81fc06b940 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81fbe00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d830 tx=0x7f81ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec018030 con 0x7f81fc06b940 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec00be10 con 0x7f81fc06b940 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.480+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0098b0 con 0x7f81fc06b940 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.481+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc15f6d0 con 0x7f81fc06b940 2024-04-24T23:02:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.481+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1f42f0 con 0x7f81fc06b940 2024-04-24T23:02:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.482+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc04f500 con 0x7f81fc06b940 2024-04-24T23:02:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.483+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81ec01b070 con 0x7f81fc06b940 2024-04-24T23:02:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.484+0000 7f81f3e00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.484+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f81ec08b210 con 0x7f81fc06b940 2024-04-24T23:02:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.484+0000 7f81fb400640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.486+0000 7f81fb400640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f81e4008ef0 tx=0x7f81e4008440 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.488+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f81ec059a20 con 0x7f81fc06b940 2024-04-24T23:02:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:27.731+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f81fc06dd90 con 0x7f81fc06b940 2024-04-24T23:02:28.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.247+0000 7f81f3e00640 1 -- 172.21.15.146:0/3411834552 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f81ec059320 con 0x7f81fc06b940 2024-04-24T23:02:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 msgr2=0x7f81d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 0x7f81d806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f81e4008ef0 tx=0x7f81e4008440 comp rx=0 tx=0).stop 2024-04-24T23:02:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 msgr2=0x7f81fc1405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d830 tx=0x7f81ec00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 shutdown_connections 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81fc15eee0 0x7f81fc0b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d806be30 0x7f81d806e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81fc0af810 0x7f81fc0b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 --2- 172.21.15.146:0/3411834552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81fc06b940 0x7f81fc1405b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 >> 172.21.15.146:0/3411834552 conn(0x7f81fc0b26c0 msgr2=0x7f81fc06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 shutdown_connections 2024-04-24T23:02:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.251+0000 7f8201c00640 1 -- 172.21.15.146:0/3411834552 wait complete. 2024-04-24T23:02:28.274 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:02:28.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:28.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.470+0000 7fb89ec00640 1 Processor -- start 2024-04-24T23:02:28.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.470+0000 7fb89ec00640 1 -- start start 2024-04-24T23:02:28.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.471+0000 7fb89ec00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8981561c0 0x7fb8980cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.471+0000 7fb89ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 0x7fb89815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.471+0000 7fb89ec00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb898070f90 con 0x7fb8980709d0 2024-04-24T23:02:28.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.471+0000 7fb89ec00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb8980b4310 con 0x7fb8981561c0 2024-04-24T23:02:28.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.471+0000 7fb89ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb8981565a0 con 0x7fb8980d0240 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89d800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8981561c0 0x7fb8980cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89ce00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb8980709d0 0x7fb8980cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33908/0 (socket says 172.21.15.146:33908) 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89ce00640 1 -- 172.21.15.146:0/2973504295 learned_addr learned my addr 172.21.15.146:0/2973504295 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89e200640 1 --2- 172.21.15.146:0/2973504295 >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 0x7fb89815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89d800640 1 -- 172.21.15.146:0/2973504295 >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 msgr2=0x7fb89815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89d800640 1 --2- 172.21.15.146:0/2973504295 >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 0x7fb89815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89d800640 1 -- 172.21.15.146:0/2973504295 >> v1:172.21.15.146:6789/0 conn(0x7fb8980709d0 legacy=0x7fb8980cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89d800640 1 -- 172.21.15.146:0/2973504295 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb898071270 con 0x7fb8981561c0 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb897e00640 1 -- 172.21.15.146:0/2973504295 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000222419 0 0) 0x7fb898070f90 con 0x7fb8980709d0 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.472+0000 7fb89e200640 1 --2- 172.21.15.146:0/2973504295 >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 0x7fb89815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.473+0000 7fb89d800640 1 --2- 172.21.15.146:0/2973504295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980cdbf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb898159c30 tx=0x7fb88c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6afca04a34f1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.473+0000 7fb897e00640 1 -- 172.21.15.146:0/2973504295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c037070 con 0x7fb8981561c0 2024-04-24T23:02:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.473+0000 7fb897e00640 1 -- 172.21.15.146:0/2973504295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88c02add0 con 0x7fb8981561c0 2024-04-24T23:02:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.473+0000 7fb897e00640 1 -- 172.21.15.146:0/2973504295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c032660 con 0x7fb8981561c0 2024-04-24T23:02:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 -- 172.21.15.146:0/2973504295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 msgr2=0x7fb8980cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 --2- 172.21.15.146:0/2973504295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980cdbf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb898159c30 tx=0x7fb88c02a080 comp rx=0 tx=0).stop 2024-04-24T23:02:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 -- 172.21.15.146:0/2973504295 shutdown_connections 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 --2- 172.21.15.146:0/2973504295 >> v2:172.21.15.203:3300/0 conn(0x7fb8980d0240 0x7fb89815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 --2- 172.21.15.146:0/2973504295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980cdbf0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 -- 172.21.15.146:0/2973504295 >> 172.21.15.146:0/2973504295 conn(0x7fb89806b320 msgr2=0x7fb89806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 -- 172.21.15.146:0/2973504295 shutdown_connections 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.474+0000 7fb89ec00640 1 -- 172.21.15.146:0/2973504295 wait complete. 2024-04-24T23:02:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.476+0000 7fb89ec00640 1 Processor -- start 2024-04-24T23:02:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.476+0000 7fb89ec00640 1 -- start start 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8980709d0 0x7fb89815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8980d0240 0x7fb898153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb8980b2c20 con 0x7fb8981561c0 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb898071830 con 0x7fb8980d0240 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb8980b2da0 con 0x7fb8980709d0 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.477+0000 7fb89e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58940/0 (socket says 172.21.15.146:58940) 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 -- 172.21.15.146:0/1326473330 learned_addr learned my addr 172.21.15.146:0/1326473330 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89d800640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8980709d0 0x7fb89815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89ce00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8980d0240 0x7fb898153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 -- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8980709d0 msgr2=0x7fb89815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8980709d0 0x7fb89815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 -- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8980d0240 msgr2=0x7fb898153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8980d0240 0x7fb898153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 -- 172.21.15.146:0/1326473330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb898154a20 con 0x7fb8981561c0 2024-04-24T23:02:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.478+0000 7fb89e200640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb89000cef0 tx=0x7fb89000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.479+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89001a070 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.479+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89000d860 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.479+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89815b0e0 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.479+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89000dc50 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.479+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89815b6a0 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.480+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89804f500 con 0x7fb8981561c0 2024-04-24T23:02:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.481+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb89001d070 con 0x7fb8981561c0 2024-04-24T23:02:28.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.482+0000 7fb895600640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 0x7fb87806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.482+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb89008b8e0 con 0x7fb8981561c0 2024-04-24T23:02:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.482+0000 7fb89d800640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 0x7fb87806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.484+0000 7fb89d800640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 0x7fb87806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.486+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb89005a1b0 con 0x7fb8981561c0 2024-04-24T23:02:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.727+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb89815ec60 con 0x7fb8981561c0 2024-04-24T23:02:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.729+0000 7fb895600640 1 -- 172.21.15.146:0/1326473330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5193 (secure 0 0 0) 0x7fb890059ab0 con 0x7fb8981561c0 2024-04-24T23:02:28.730 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:28.730 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:02:27.732810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5898":{"gid":5898,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/1456962778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1456962778},{"type":"v1","addr":"172.21.15.146:6835","nonce":1456962778}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5898,"qdb_cluster":[5898]},"id":3}]} 2024-04-24T23:02:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 32 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 msgr2=0x7fb87806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 0x7fb87806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c02e000 comp rx=0 tx=0).stop 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 msgr2=0x7fb8980aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb89000cef0 tx=0x7fb89000a710 comp rx=0 tx=0).stop 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 shutdown_connections 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8981561c0 0x7fb8980aa310 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8980d0240 0x7fb898153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb87806be30 0x7fb87806e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 --2- 172.21.15.146:0/1326473330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8980709d0 0x7fb89815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 >> 172.21.15.146:0/1326473330 conn(0x7fb89806b320 msgr2=0x7fb8981552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 shutdown_connections 2024-04-24T23:02:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.732+0000 7fb89ec00640 1 -- 172.21.15.146:0/1326473330 wait complete. 2024-04-24T23:02:28.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:02:28.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.951+0000 7f3eff200640 1 Processor -- start 2024-04-24T23:02:28.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.951+0000 7f3eff200640 1 -- start start 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.952+0000 7f3eff200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f0015a980 0x7f3f0006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.952+0000 7f3eff200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3f000d0240 0x7f3f000ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.952+0000 7f3eff200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f000ccb10 con 0x7f3f00071dd0 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.952+0000 7f3eff200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3f00072230 con 0x7f3f0015a980 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.952+0000 7f3eff200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3f000aede0 con 0x7f3f000d0240 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f0015a980 0x7f3f0006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f0015a980 0x7f3f0006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58946/0 (socket says 172.21.15.146:58946) 2024-04-24T23:02:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 -- 172.21.15.146:0/1273710490 learned_addr learned my addr 172.21.15.146:0/1273710490 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 -- 172.21.15.146:0/1273710490 >> v2:172.21.15.203:3300/0 conn(0x7f3f000d0240 msgr2=0x7f3f000ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 --2- 172.21.15.146:0/1273710490 >> v2:172.21.15.203:3300/0 conn(0x7f3f000d0240 0x7f3f000ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 -- 172.21.15.146:0/1273710490 >> v1:172.21.15.203:6789/0 conn(0x7f3f00071dd0 legacy=0x7f3f000cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.953+0000 7f3efde00640 1 -- 172.21.15.146:0/1273710490 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0006ddc0 con 0x7f3f0015a980 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.954+0000 7f3efde00640 1 --2- 172.21.15.146:0/1273710490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f0015a980 0x7f3f0006d770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3f00071150 tx=0x7f3ef002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c62970687de993 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.954+0000 7f3efd400640 1 -- 172.21.15.146:0/1273710490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037070 con 0x7f3f0015a980 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.954+0000 7f3efd400640 1 -- 172.21.15.146:0/1273710490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0032440 con 0x7f3f0015a980 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.954+0000 7f3efd400640 1 -- 172.21.15.146:0/1273710490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0032810 con 0x7f3f0015a980 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 -- 172.21.15.146:0/1273710490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f0015a980 msgr2=0x7f3f0006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 --2- 172.21.15.146:0/1273710490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f0015a980 0x7f3f0006d770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3f00071150 tx=0x7f3ef002a1a0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 -- 172.21.15.146:0/1273710490 shutdown_connections 2024-04-24T23:02:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 --2- 172.21.15.146:0/1273710490 >> v2:172.21.15.203:3300/0 conn(0x7f3f000d0240 0x7f3f000ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 --2- 172.21.15.146:0/1273710490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f0015a980 0x7f3f0006d770 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 -- 172.21.15.146:0/1273710490 >> 172.21.15.146:0/1273710490 conn(0x7f3f0006b320 msgr2=0x7f3f0006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 -- 172.21.15.146:0/1273710490 shutdown_connections 2024-04-24T23:02:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.955+0000 7f3eff200640 1 -- 172.21.15.146:0/1273710490 wait complete. 2024-04-24T23:02:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.957+0000 7f3eff200640 1 Processor -- start 2024-04-24T23:02:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.957+0000 7f3eff200640 1 -- start start 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f000d0240 0x7f3f0015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f0015a980 0x7f3f00156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0006e660 con 0x7f3f00071dd0 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0006e380 con 0x7f3f000d0240 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3eff200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0015ad60 con 0x7f3f0015a980 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3efde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3efde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58948/0 (socket says 172.21.15.146:58948) 2024-04-24T23:02:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.958+0000 7f3efde00640 1 -- 172.21.15.146:0/1435448952 learned_addr learned my addr 172.21.15.146:0/1435448952 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 -- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f0015a980 msgr2=0x7f3f00156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f0015a980 0x7f3f00156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 -- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f000d0240 msgr2=0x7f3f0015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f000d0240 0x7f3f0015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 -- 172.21.15.146:0/1435448952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0015bb20 con 0x7f3f00071dd0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3efde00640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3ef002a1e0 tx=0x7f3ef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0041070 con 0x7f3f00071dd0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef003c890 con 0x7f3f00071dd0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f001f3080 con 0x7f3f00071dd0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037040 con 0x7f3f00071dd0 2024-04-24T23:02:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.959+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f001f3640 con 0x7f3f00071dd0 2024-04-24T23:02:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.960+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f00151c70 con 0x7f3f00071dd0 2024-04-24T23:02:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.962+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ef0044070 con 0x7f3f00071dd0 2024-04-24T23:02:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.962+0000 7f3ef6a00640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 0x7f3edc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.963+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef00abe90 con 0x7f3f00071dd0 2024-04-24T23:02:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.963+0000 7f3ef5400640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 0x7f3edc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.964+0000 7f3ef5400640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 0x7f3edc06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f0006cd50 tx=0x7f3ee8006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:28.967+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f000ccb10 con 0x7f3f00071dd0 2024-04-24T23:02:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.165+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f0004f500 con 0x7f3f00071dd0 2024-04-24T23:02:29.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.168+0000 7f3ef6a00640 1 -- 172.21.15.146:0/1435448952 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16906 (secure 0 0 0) 0x7f3ef00ad090 con 0x7f3f00071dd0 2024-04-24T23:02:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:29.170 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":54,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:26.216302+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.171+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 msgr2=0x7f3edc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.171+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 0x7f3edc06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f0006cd50 tx=0x7f3ee8006ba0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 msgr2=0x7f3f00151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3ef002a1e0 tx=0x7f3ef00046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 shutdown_connections 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3edc06be30 0x7f3edc06e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f0015a980 0x7f3f00156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f000d0240 0x7f3f0015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 --2- 172.21.15.146:0/1435448952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f00071dd0 0x7f3f00151100 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 >> 172.21.15.146:0/1435448952 conn(0x7f3f0006b320 msgr2=0x7f3f000af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 shutdown_connections 2024-04-24T23:02:29.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.172+0000 7f3eff200640 1 -- 172.21.15.146:0/1435448952 wait complete. 2024-04-24T23:02:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:02:29.191 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:02:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.396+0000 7ff78ec00640 1 Processor -- start 2024-04-24T23:02:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.396+0000 7ff78ec00640 1 -- start start 2024-04-24T23:02:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.397+0000 7ff78ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff78806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.397+0000 7ff78ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff788071dd0 0x7ff7880ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.397+0000 7ff78ec00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7880ccb10 con 0x7ff78815a980 2024-04-24T23:02:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.397+0000 7ff78ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff788072260 con 0x7ff788071dd0 2024-04-24T23:02:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.397+0000 7ff78ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7880aede0 con 0x7ff7880d0240 2024-04-24T23:02:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff78d800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff78815a980 0x7ff7880cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33918/0 (socket says 172.21.15.146:33918) 2024-04-24T23:02:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff78d800640 1 -- 172.21.15.146:0/1053670156 learned_addr learned my addr 172.21.15.146:0/1053670156 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff78e200640 1 --2- 172.21.15.146:0/1053670156 >> v2:172.21.15.203:3300/0 conn(0x7ff788071dd0 0x7ff7880ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571770878 0 0) 0x7ff77c001110 con 0x7ff78815a980 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff770005730 con 0x7ff78815a980 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.398+0000 7ff78ce00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff78806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990396442 0 0) 0x7ff770005730 con 0x7ff78815a980 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 msgr2=0x7ff78806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff78806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 >> v2:172.21.15.203:3300/0 conn(0x7ff788071dd0 msgr2=0x7ff7880ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 --2- 172.21.15.146:0/1053670156 >> v2:172.21.15.203:3300/0 conn(0x7ff788071dd0 0x7ff7880ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78806ddc0 con 0x7ff78815a980 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ff77c001840 con 0x7ff78815a980 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 >> v1:172.21.15.146:6789/0 conn(0x7ff78815a980 legacy=0x7ff7880cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770005bf0 0x7ff770006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff770006550 0x7ff770006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff770007170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff788072260 con 0x7ff770006550 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7880aede0 con 0x7ff770005bf0 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff77000ffd0 con 0x7ff7880d0240 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff78ce00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff770006550 0x7ff770006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff78d800640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770005bf0 0x7ff770006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.399+0000 7ff78e200640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff770007170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.400+0000 7ff78ce00640 1 -- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 msgr2=0x7ff770007170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.400+0000 7ff78ce00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7880d0240 0x7ff770007170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.400+0000 7ff78ce00640 1 -- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770005bf0 msgr2=0x7ff770006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.400+0000 7ff78ce00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770005bf0 0x7ff770006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.400+0000 7ff78ce00640 1 -- 172.21.15.146:0/1053670156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff770005730 con 0x7ff770006550 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff78ce00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff770006550 0x7ff770006a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff77400ba30 tx=0x7ff770007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197e733e138665b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774030070 con 0x7ff770006550 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77402ade0 con 0x7ff770006550 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff787e00640 1 -- 172.21.15.146:0/1053670156 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77400b600 con 0x7ff770006550 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff78ec00640 1 -- 172.21.15.146:0/1053670156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff770006550 msgr2=0x7ff770006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff78ec00640 1 --2- 172.21.15.146:0/1053670156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff770006550 0x7ff770006a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff77400ba30 tx=0x7ff770007a40 comp rx=0 tx=0).stop 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.401+0000 7ff78e200640 1 -- 172.21.15.146:0/1053670156 reap_dead start 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.402+0000 7ff78ec00640 1 -- 172.21.15.146:0/1053670156 shutdown_connections 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.402+0000 7ff78ec00640 1 -- 172.21.15.146:0/1053670156 >> 172.21.15.146:0/1053670156 conn(0x7ff78806b320 msgr2=0x7ff78806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.402+0000 7ff78ec00640 1 -- 172.21.15.146:0/1053670156 shutdown_connections 2024-04-24T23:02:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.402+0000 7ff78ec00640 1 -- 172.21.15.146:0/1053670156 wait complete. 2024-04-24T23:02:29.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.403+0000 7ff78ec00640 1 Processor -- start 2024-04-24T23:02:29.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.403+0000 7ff78ec00640 1 -- start start 2024-04-24T23:02:29.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 0x7ff788144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 0x7ff788152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806e660 con 0x7ff7880afd70 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806e380 con 0x7ff770006550 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.404+0000 7ff78ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff78815ad60 con 0x7ff788152180 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58960/0 (socket says 172.21.15.146:58960) 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 -- 172.21.15.146:0/2481670126 learned_addr learned my addr 172.21.15.146:0/2481670126 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78d800640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 0x7ff788144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78e200640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 0x7ff788152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 -- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 msgr2=0x7ff788152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 0x7ff788152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 -- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 msgr2=0x7ff788144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 0x7ff788144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 -- 172.21.15.146:0/2481670126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881448a0 con 0x7ff7880afd70 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78e200640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 0x7ff788152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78d800640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 0x7ff788144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.405+0000 7ff78ce00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff77400bb50 tx=0x7ff7740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.406+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774043030 con 0x7ff7880afd70 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.406+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77402abe0 con 0x7ff7880afd70 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.406+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77400b600 con 0x7ff7880afd70 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.406+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff788152f40 con 0x7ff7880afd70 2024-04-24T23:02:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.406+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff788153500 con 0x7ff7880afd70 2024-04-24T23:02:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.407+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78806c9b0 con 0x7ff7880afd70 2024-04-24T23:02:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.408+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff774046070 con 0x7ff7880afd70 2024-04-24T23:02:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.409+0000 7ff785600640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.409+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff7740abae0 con 0x7ff7880afd70 2024-04-24T23:02:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.410+0000 7ff78d800640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.411+0000 7ff78d800640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 0x7ff76806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000ff0 tx=0x7ff77c001600 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.413+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff7881448a0 con 0x7ff7880afd70 2024-04-24T23:02:29.574 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-04-24T23:02:29.573+0000 7fd124000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:02:29.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.609+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff78804f500 con 0x7ff76806be30 2024-04-24T23:02:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.627+0000 7ff785600640 1 -- 172.21.15.146:0/2481670126 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239290 (secure 0 0 0) 0x7ff78804f500 con 0x7ff76806be30 2024-04-24T23:02:29.632 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:02:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 msgr2=0x7ff76806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 0x7ff76806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000ff0 tx=0x7ff77c001600 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 msgr2=0x7ff7880b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff77400bb50 tx=0x7ff7740046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 shutdown_connections 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff76806be30 0x7ff76806e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff788152180 0x7ff788152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7880afd70 0x7ff7880b01f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 --2- 172.21.15.146:0/2481670126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff770006550 0x7ff788144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 >> 172.21.15.146:0/2481670126 conn(0x7ff78806b320 msgr2=0x7ff7880af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 shutdown_connections 2024-04-24T23:02:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.633+0000 7ff78ec00640 1 -- 172.21.15.146:0/2481670126 wait complete. 2024-04-24T23:02:29.654 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-04-24T23:02:27.641587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226132,"kb_used_data":5788,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748588,"statfs":{"total":773094113280,"available":772862554112,"internally_reserved":0,"allocated":5926912,"data_stored":3224897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.457587"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.253053+0000","last_change":"2024-04-24T23:02:25.249084+0000","last_active":"2024-04-24T23:02:25.253053+0000","last_peered":"2024-04-24T23:02:25.253053+0000","last_clean":"2024-04-24T23:02:25.253053+0000","last_became_active":"2024-04-24T23:02:25.248770+0000","last_became_peered":"2024-04-24T23:02:25.248770+0000","last_unstale":"2024-04-24T23:02:25.253053+0000","last_undegraded":"2024-04-24T23:02:25.253053+0000","last_fullsized":"2024-04-24T23:02:25.253053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:23:04.474089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.250250+0000","last_change":"2024-04-24T23:02:25.246908+0000","last_active":"2024-04-24T23:02:25.250250+0000","last_peered":"2024-04-24T23:02:25.250250+0000","last_clean":"2024-04-24T23:02:25.250250+0000","last_became_active":"2024-04-24T23:02:25.246604+0000","last_became_peered":"2024-04-24T23:02:25.246604+0000","last_unstale":"2024-04-24T23:02:25.250250+0000","last_undegraded":"2024-04-24T23:02:25.250250+0000","last_fullsized":"2024-04-24T23:02:25.250250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:58.586083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.247834+0000","last_change":"2024-04-24T23:02:24.226955+0000","last_active":"2024-04-24T23:02:25.247834+0000","last_peered":"2024-04-24T23:02:25.247834+0000","last_clean":"2024-04-24T23:02:25.247834+0000","last_became_active":"2024-04-24T23:02:24.226644+0000","last_became_peered":"2024-04-24T23:02:24.226644+0000","last_unstale":"2024-04-24T23:02:25.247834+0000","last_undegraded":"2024-04-24T23:02:25.247834+0000","last_fullsized":"2024-04-24T23:02:25.247834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:13.894152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.254983+0000","last_change":"2024-04-24T23:02:25.252785+0000","last_active":"2024-04-24T23:02:25.254983+0000","last_peered":"2024-04-24T23:02:25.254983+0000","last_clean":"2024-04-24T23:02:25.254983+0000","last_became_active":"2024-04-24T23:02:25.252488+0000","last_became_peered":"2024-04-24T23:02:25.252488+0000","last_unstale":"2024-04-24T23:02:25.254983+0000","last_undegraded":"2024-04-24T23:02:25.254983+0000","last_fullsized":"2024-04-24T23:02:25.254983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:30.308242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.256388+0000","last_change":"2024-04-24T23:02:25.254813+0000","last_active":"2024-04-24T23:02:25.256388+0000","last_peered":"2024-04-24T23:02:25.256388+0000","last_clean":"2024-04-24T23:02:25.256388+0000","last_became_active":"2024-04-24T23:02:25.254494+0000","last_became_peered":"2024-04-24T23:02:25.254494+0000","last_unstale":"2024-04-24T23:02:25.256388+0000","last_undegraded":"2024-04-24T23:02:25.256388+0000","last_fullsized":"2024-04-24T23:02:25.256388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:00.876959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.259818+0000","last_change":"2024-04-24T23:02:24.238004+0000","last_active":"2024-04-24T23:02:25.259818+0000","last_peered":"2024-04-24T23:02:25.259818+0000","last_clean":"2024-04-24T23:02:25.259818+0000","last_became_active":"2024-04-24T23:02:24.237737+0000","last_became_peered":"2024-04-24T23:02:24.237737+0000","last_unstale":"2024-04-24T23:02:25.259818+0000","last_undegraded":"2024-04-24T23:02:25.259818+0000","last_fullsized":"2024-04-24T23:02:25.259818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:34.371804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.248878+0000","last_change":"2024-04-24T23:02:25.244938+0000","last_active":"2024-04-24T23:02:25.248878+0000","last_peered":"2024-04-24T23:02:25.248878+0000","last_clean":"2024-04-24T23:02:25.248878+0000","last_became_active":"2024-04-24T23:02:25.239646+0000","last_became_peered":"2024-04-24T23:02:25.239646+0000","last_unstale":"2024-04-24T23:02:25.248878+0000","last_undegraded":"2024-04-24T23:02:25.248878+0000","last_fullsized":"2024-04-24T23:02:25.248878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:07.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.231344+0000","last_change":"2024-04-24T23:02:24.233697+0000","last_active":"2024-04-24T23:02:25.231344+0000","last_peered":"2024-04-24T23:02:25.231344+0000","last_clean":"2024-04-24T23:02:25.231344+0000","last_became_active":"2024-04-24T23:02:24.233376+0000","last_became_peered":"2024-04-24T23:02:24.233376+0000","last_unstale":"2024-04-24T23:02:25.231344+0000","last_undegraded":"2024-04-24T23:02:25.231344+0000","last_fullsized":"2024-04-24T23:02:25.231344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:01:08.531092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.230841+0000","last_change":"2024-04-24T23:02:24.231741+0000","last_active":"2024-04-24T23:02:25.230841+0000","last_peered":"2024-04-24T23:02:25.230841+0000","last_clean":"2024-04-24T23:02:25.230841+0000","last_became_active":"2024-04-24T23:02:24.231451+0000","last_became_peered":"2024-04-24T23:02:24.231451+0000","last_unstale":"2024-04-24T23:02:25.230841+0000","last_undegraded":"2024-04-24T23:02:25.230841+0000","last_fullsized":"2024-04-24T23:02:25.230841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:12.949728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.254051+0000","last_change":"2024-04-24T23:02:25.252660+0000","last_active":"2024-04-24T23:02:25.254051+0000","last_peered":"2024-04-24T23:02:25.254051+0000","last_clean":"2024-04-24T23:02:25.254051+0000","last_became_active":"2024-04-24T23:02:25.252335+0000","last_became_peered":"2024-04-24T23:02:25.252335+0000","last_unstale":"2024-04-24T23:02:25.254051+0000","last_undegraded":"2024-04-24T23:02:25.254051+0000","last_fullsized":"2024-04-24T23:02:25.254051+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:44.076615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.249788+0000","last_change":"2024-04-24T23:02:25.247170+0000","last_active":"2024-04-24T23:02:25.249788+0000","last_peered":"2024-04-24T23:02:25.249788+0000","last_clean":"2024-04-24T23:02:25.249788+0000","last_became_active":"2024-04-24T23:02:25.246804+0000","last_became_peered":"2024-04-24T23:02:25.246804+0000","last_unstale":"2024-04-24T23:02:25.249788+0000","last_undegraded":"2024-04-24T23:02:25.249788+0000","last_fullsized":"2024-04-24T23:02:25.249788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:34.238720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.232325+0000","last_change":"2024-04-24T23:02:24.233437+0000","last_active":"2024-04-24T23:02:25.232325+0000","last_peered":"2024-04-24T23:02:25.232325+0000","last_clean":"2024-04-24T23:02:25.232325+0000","last_became_active":"2024-04-24T23:02:24.232708+0000","last_became_peered":"2024-04-24T23:02:24.232708+0000","last_unstale":"2024-04-24T23:02:25.232325+0000","last_undegraded":"2024-04-24T23:02:25.232325+0000","last_fullsized":"2024-04-24T23:02:25.232325+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:31.346915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.256367+0000","last_change":"2024-04-24T23:02:25.254610+0000","last_active":"2024-04-24T23:02:25.256367+0000","last_peered":"2024-04-24T23:02:25.256367+0000","last_clean":"2024-04-24T23:02:25.256367+0000","last_became_active":"2024-04-24T23:02:25.253996+0000","last_became_peered":"2024-04-24T23:02:25.253996+0000","last_unstale":"2024-04-24T23:02:25.256367+0000","last_undegraded":"2024-04-24T23:02:25.256367+0000","last_fullsized":"2024-04-24T23:02:25.256367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:59.682882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:23.165082+0000","last_change":"2024-04-24T23:02:23.165082+0000","last_active":"2024-04-24T23:02:23.165082+0000","last_peered":"2024-04-24T23:02:23.165082+0000","last_clean":"2024-04-24T23:02:23.165082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:23.165082+0000","last_undegraded":"2024-04-24T23:02:23.165082+0000","last_fullsized":"2024-04-24T23:02:23.165082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:02:24.180618+0000","last_change":"2024-04-24T23:02:24.180618+0000","last_active":"2024-04-24T23:02:24.180618+0000","last_peered":"2024-04-24T23:02:24.180618+0000","last_clean":"2024-04-24T23:02:24.180618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:02:24.180618+0000","last_undegraded":"2024-04-24T23:02:24.180618+0000","last_fullsized":"2024-04-24T23:02:24.180618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.234863+0000","last_change":"2024-04-24T23:02:24.236950+0000","last_active":"2024-04-24T23:02:25.234863+0000","last_peered":"2024-04-24T23:02:25.234863+0000","last_clean":"2024-04-24T23:02:25.234863+0000","last_became_active":"2024-04-24T23:02:24.236601+0000","last_became_peered":"2024-04-24T23:02:24.236601+0000","last_unstale":"2024-04-24T23:02:25.234863+0000","last_undegraded":"2024-04-24T23:02:25.234863+0000","last_fullsized":"2024-04-24T23:02:25.234863+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:40.892142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-24T23:02:20.155556+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:02:20.155556+0000","last_peered":"2024-04-24T23:02:20.155556+0000","last_clean":"2024-04-24T23:02:20.155556+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:02:20.155556+0000","last_undegraded":"2024-04-24T23:02:20.155556+0000","last_fullsized":"2024-04-24T23:02:20.155556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1179648,"data_stored":843170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":252802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":864915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:02:29.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:02:29.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.892+0000 7f18ba600640 1 Processor -- start 2024-04-24T23:02:29.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.892+0000 7f18ba600640 1 -- start start 2024-04-24T23:02:29.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18ba600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18b4158590 0x7f18b4162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18ba600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f18b40715f0 0x7f18b4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18ba600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b4162990 con 0x7f18b40cfc90 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18ba600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f18b4158970 con 0x7f18b4158590 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18ba600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f18b4070c10 con 0x7f18b40715f0 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18b3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18b4158590 0x7f18b4162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18b3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18b4158590 0x7f18b4162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58962/0 (socket says 172.21.15.146:58962) 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.894+0000 7f18b3400640 1 -- 172.21.15.146:0/4173920231 learned_addr learned my addr 172.21.15.146:0/4173920231 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.895+0000 7f18b3400640 1 -- 172.21.15.146:0/4173920231 >> v2:172.21.15.203:3300/0 conn(0x7f18b40715f0 msgr2=0x7f18b4071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.895+0000 7f18b3400640 1 --2- 172.21.15.146:0/4173920231 >> v2:172.21.15.203:3300/0 conn(0x7f18b40715f0 0x7f18b4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.895+0000 7f18b3400640 1 -- 172.21.15.146:0/4173920231 >> v1:172.21.15.203:6789/0 conn(0x7f18b40cfc90 legacy=0x7f18b415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.895+0000 7f18b3400640 1 -- 172.21.15.146:0/4173920231 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b4070ef0 con 0x7f18b4158590 2024-04-24T23:02:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.896+0000 7f18b3400640 1 --2- 172.21.15.146:0/4173920231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b4158590 0x7f18b4162450 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f18b40d0ab0 tx=0x7f18a402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8ba9fd245f4c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.896+0000 7f18b2000640 1 -- 172.21.15.146:0/4173920231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4037070 con 0x7f18b4158590 2024-04-24T23:02:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.896+0000 7f18b2000640 1 -- 172.21.15.146:0/4173920231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a4032440 con 0x7f18b4158590 2024-04-24T23:02:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.896+0000 7f18b2000640 1 -- 172.21.15.146:0/4173920231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4032810 con 0x7f18b4158590 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 -- 172.21.15.146:0/4173920231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b4158590 msgr2=0x7f18b4162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 --2- 172.21.15.146:0/4173920231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b4158590 0x7f18b4162450 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f18b40d0ab0 tx=0x7f18a402a2c0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 -- 172.21.15.146:0/4173920231 shutdown_connections 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 --2- 172.21.15.146:0/4173920231 >> v2:172.21.15.203:3300/0 conn(0x7f18b40715f0 0x7f18b4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 --2- 172.21.15.146:0/4173920231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b4158590 0x7f18b4162450 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 -- 172.21.15.146:0/4173920231 >> 172.21.15.146:0/4173920231 conn(0x7f18b406b320 msgr2=0x7f18b406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 -- 172.21.15.146:0/4173920231 shutdown_connections 2024-04-24T23:02:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.897+0000 7f18ba600640 1 -- 172.21.15.146:0/4173920231 wait complete. 2024-04-24T23:02:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.899+0000 7f18ba600640 1 Processor -- start 2024-04-24T23:02:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.899+0000 7f18ba600640 1 -- start start 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 0x7f18b4159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b4158590 0x7f18b415a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4161f30 con 0x7f18b40715f0 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4161c50 con 0x7f18b40cfc90 2024-04-24T23:02:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18ba600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18b40d0100 con 0x7f18b4158590 2024-04-24T23:02:29.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18b3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18b3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58974/0 (socket says 172.21.15.146:58974) 2024-04-24T23:02:29.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.900+0000 7f18b3400640 1 -- 172.21.15.146:0/3558648059 learned_addr learned my addr 172.21.15.146:0/3558648059 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:29.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b2a00640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 0x7f18b4159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 -- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b4158590 msgr2=0x7f18b415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b4158590 0x7f18b415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 -- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 msgr2=0x7f18b4159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 0x7f18b4159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 -- 172.21.15.146:0/3558648059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b415c3f0 con 0x7f18b40715f0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b2a00640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 0x7f18b4159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18b3400640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f18a402a300 tx=0x7f18a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.901+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4041070 con 0x7f18b40715f0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.902+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a403c870 con 0x7f18b40715f0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.902+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4037040 con 0x7f18b40715f0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.902+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b40c4de0 con 0x7f18b40715f0 2024-04-24T23:02:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.902+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b4145b40 con 0x7f18b40715f0 2024-04-24T23:02:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.903+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4068190 con 0x7f18b40715f0 2024-04-24T23:02:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.904+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18a4044070 con 0x7f18b40715f0 2024-04-24T23:02:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.905+0000 7f18ab400640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 0x7f189406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.905+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f18a40abbc0 con 0x7f18b40715f0 2024-04-24T23:02:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.905+0000 7f18b2a00640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 0x7f189406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:29.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.906+0000 7f18b2a00640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 0x7f189406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18a0006fd0 tx=0x7f18a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:29.909+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f18b415c3f0 con 0x7f18b40715f0 2024-04-24T23:02:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.092+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18b4145350 con 0x7f189406be30 2024-04-24T23:02:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.112+0000 7f18ab400640 1 -- 172.21.15.146:0/3558648059 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f18a000ae20 con 0x7f189406be30 2024-04-24T23:02:30.116 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:02:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 msgr2=0x7f189406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 0x7f189406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18a0006fd0 tx=0x7f18a0008040 comp rx=0 tx=0).stop 2024-04-24T23:02:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 msgr2=0x7f18b4144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f18a402a300 tx=0x7f18a40046c0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 shutdown_connections 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f189406be30 0x7f189406e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b4158590 0x7f18b415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b40cfc90 0x7f18b4159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 --2- 172.21.15.146:0/3558648059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b40715f0 0x7f18b4144e10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 >> 172.21.15.146:0/3558648059 conn(0x7f18b406b320 msgr2=0x7f18b4160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 shutdown_connections 2024-04-24T23:02:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.117+0000 7f18ba600640 1 -- 172.21.15.146:0/3558648059 wait complete. 2024-04-24T23:02:30.136 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-24T23:02:29.642378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234828,"kb_used_data":6148,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739892,"statfs":{"total":773094113280,"available":772853649408,"internally_reserved":0,"allocated":6295552,"data_stored":3401776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002037"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241886+0000","last_change":"2024-04-24T23:02:25.246844+0000","last_active":"2024-04-24T23:02:27.241886+0000","last_peered":"2024-04-24T23:02:27.241886+0000","last_clean":"2024-04-24T23:02:27.241886+0000","last_became_active":"2024-04-24T23:02:25.243937+0000","last_became_peered":"2024-04-24T23:02:25.243937+0000","last_unstale":"2024-04-24T23:02:27.241886+0000","last_undegraded":"2024-04-24T23:02:27.241886+0000","last_fullsized":"2024-04-24T23:02:27.241886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:53:30.255799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860580+0000","last_change":"2024-04-24T23:02:25.227734+0000","last_active":"2024-04-24T23:02:26.860580+0000","last_peered":"2024-04-24T23:02:26.860580+0000","last_clean":"2024-04-24T23:02:26.860580+0000","last_became_active":"2024-04-24T23:02:25.226620+0000","last_became_peered":"2024-04-24T23:02:25.226620+0000","last_unstale":"2024-04-24T23:02:26.860580+0000","last_undegraded":"2024-04-24T23:02:26.860580+0000","last_fullsized":"2024-04-24T23:02:26.860580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:50.459094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238859+0000","last_change":"2024-04-24T23:02:25.250875+0000","last_active":"2024-04-24T23:02:26.238859+0000","last_peered":"2024-04-24T23:02:26.238859+0000","last_clean":"2024-04-24T23:02:26.238859+0000","last_became_active":"2024-04-24T23:02:25.250495+0000","last_became_peered":"2024-04-24T23:02:25.250495+0000","last_unstale":"2024-04-24T23:02:26.238859+0000","last_undegraded":"2024-04-24T23:02:26.238859+0000","last_fullsized":"2024-04-24T23:02:26.238859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:46.127692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234790+0000","last_change":"2024-04-24T23:02:25.227544+0000","last_active":"2024-04-24T23:02:26.234790+0000","last_peered":"2024-04-24T23:02:26.234790+0000","last_clean":"2024-04-24T23:02:26.234790+0000","last_became_active":"2024-04-24T23:02:25.227016+0000","last_became_peered":"2024-04-24T23:02:25.227016+0000","last_unstale":"2024-04-24T23:02:26.234790+0000","last_undegraded":"2024-04-24T23:02:26.234790+0000","last_fullsized":"2024-04-24T23:02:26.234790+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:53:03.284753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860377+0000","last_change":"2024-04-24T23:02:25.224568+0000","last_active":"2024-04-24T23:02:26.860377+0000","last_peered":"2024-04-24T23:02:26.860377+0000","last_clean":"2024-04-24T23:02:26.860377+0000","last_became_active":"2024-04-24T23:02:25.224252+0000","last_became_peered":"2024-04-24T23:02:25.224252+0000","last_unstale":"2024-04-24T23:02:26.860377+0000","last_undegraded":"2024-04-24T23:02:26.860377+0000","last_fullsized":"2024-04-24T23:02:26.860377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:54:12.183906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.237557+0000","last_change":"2024-04-24T23:02:25.221540+0000","last_active":"2024-04-24T23:02:26.237557+0000","last_peered":"2024-04-24T23:02:26.237557+0000","last_clean":"2024-04-24T23:02:26.237557+0000","last_became_active":"2024-04-24T23:02:25.220991+0000","last_became_peered":"2024-04-24T23:02:25.220991+0000","last_unstale":"2024-04-24T23:02:26.237557+0000","last_undegraded":"2024-04-24T23:02:26.237557+0000","last_fullsized":"2024-04-24T23:02:26.237557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:26.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.253053+0000","last_change":"2024-04-24T23:02:25.249084+0000","last_active":"2024-04-24T23:02:25.253053+0000","last_peered":"2024-04-24T23:02:25.253053+0000","last_clean":"2024-04-24T23:02:25.253053+0000","last_became_active":"2024-04-24T23:02:25.248770+0000","last_became_peered":"2024-04-24T23:02:25.248770+0000","last_unstale":"2024-04-24T23:02:25.253053+0000","last_undegraded":"2024-04-24T23:02:25.253053+0000","last_fullsized":"2024-04-24T23:02:25.253053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:23:04.474089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.236680+0000","last_change":"2024-04-24T23:02:25.244992+0000","last_active":"2024-04-24T23:02:26.236680+0000","last_peered":"2024-04-24T23:02:26.236680+0000","last_clean":"2024-04-24T23:02:26.236680+0000","last_became_active":"2024-04-24T23:02:25.244395+0000","last_became_peered":"2024-04-24T23:02:25.244395+0000","last_unstale":"2024-04-24T23:02:26.236680+0000","last_undegraded":"2024-04-24T23:02:26.236680+0000","last_fullsized":"2024-04-24T23:02:26.236680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:46.707858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240740+0000","last_change":"2024-04-24T23:02:25.247365+0000","last_active":"2024-04-24T23:02:26.240740+0000","last_peered":"2024-04-24T23:02:26.240740+0000","last_clean":"2024-04-24T23:02:26.240740+0000","last_became_active":"2024-04-24T23:02:25.246865+0000","last_became_peered":"2024-04-24T23:02:25.246865+0000","last_unstale":"2024-04-24T23:02:26.240740+0000","last_undegraded":"2024-04-24T23:02:26.240740+0000","last_fullsized":"2024-04-24T23:02:26.240740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:35.156307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.250250+0000","last_change":"2024-04-24T23:02:25.246908+0000","last_active":"2024-04-24T23:02:25.250250+0000","last_peered":"2024-04-24T23:02:25.250250+0000","last_clean":"2024-04-24T23:02:25.250250+0000","last_became_active":"2024-04-24T23:02:25.246604+0000","last_became_peered":"2024-04-24T23:02:25.246604+0000","last_unstale":"2024-04-24T23:02:25.250250+0000","last_undegraded":"2024-04-24T23:02:25.250250+0000","last_fullsized":"2024-04-24T23:02:25.250250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:58.586083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241559+0000","last_change":"2024-04-24T23:02:25.238291+0000","last_active":"2024-04-24T23:02:27.241559+0000","last_peered":"2024-04-24T23:02:27.241559+0000","last_clean":"2024-04-24T23:02:27.241559+0000","last_became_active":"2024-04-24T23:02:25.237732+0000","last_became_peered":"2024-04-24T23:02:25.237732+0000","last_unstale":"2024-04-24T23:02:27.241559+0000","last_undegraded":"2024-04-24T23:02:27.241559+0000","last_fullsized":"2024-04-24T23:02:27.241559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:37:59.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.237997+0000","last_change":"2024-04-24T23:02:25.220028+0000","last_active":"2024-04-24T23:02:26.237997+0000","last_peered":"2024-04-24T23:02:26.237997+0000","last_clean":"2024-04-24T23:02:26.237997+0000","last_became_active":"2024-04-24T23:02:25.219703+0000","last_became_peered":"2024-04-24T23:02:25.219703+0000","last_unstale":"2024-04-24T23:02:26.237997+0000","last_undegraded":"2024-04-24T23:02:26.237997+0000","last_fullsized":"2024-04-24T23:02:26.237997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:50.475141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.237987+0000","last_change":"2024-04-24T23:02:25.230773+0000","last_active":"2024-04-24T23:02:26.237987+0000","last_peered":"2024-04-24T23:02:26.237987+0000","last_clean":"2024-04-24T23:02:26.237987+0000","last_became_active":"2024-04-24T23:02:25.230455+0000","last_became_peered":"2024-04-24T23:02:25.230455+0000","last_unstale":"2024-04-24T23:02:26.237987+0000","last_undegraded":"2024-04-24T23:02:26.237987+0000","last_fullsized":"2024-04-24T23:02:26.237987+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:12.414502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241105+0000","last_change":"2024-04-24T23:02:25.242598+0000","last_active":"2024-04-24T23:02:27.241105+0000","last_peered":"2024-04-24T23:02:27.241105+0000","last_clean":"2024-04-24T23:02:27.241105+0000","last_became_active":"2024-04-24T23:02:25.241520+0000","last_became_peered":"2024-04-24T23:02:25.241520+0000","last_unstale":"2024-04-24T23:02:27.241105+0000","last_undegraded":"2024-04-24T23:02:27.241105+0000","last_fullsized":"2024-04-24T23:02:27.241105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:20.323278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234978+0000","last_change":"2024-04-24T23:02:25.220281+0000","last_active":"2024-04-24T23:02:26.234978+0000","last_peered":"2024-04-24T23:02:26.234978+0000","last_clean":"2024-04-24T23:02:26.234978+0000","last_became_active":"2024-04-24T23:02:25.220007+0000","last_became_peered":"2024-04-24T23:02:25.220007+0000","last_unstale":"2024-04-24T23:02:26.234978+0000","last_undegraded":"2024-04-24T23:02:26.234978+0000","last_fullsized":"2024-04-24T23:02:26.234978+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:46.707858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.236035+0000","last_change":"2024-04-24T23:02:25.217770+0000","last_active":"2024-04-24T23:02:26.236035+0000","last_peered":"2024-04-24T23:02:26.236035+0000","last_clean":"2024-04-24T23:02:26.236035+0000","last_became_active":"2024-04-24T23:02:25.217051+0000","last_became_peered":"2024-04-24T23:02:25.217051+0000","last_unstale":"2024-04-24T23:02:26.236035+0000","last_undegraded":"2024-04-24T23:02:26.236035+0000","last_fullsized":"2024-04-24T23:02:26.236035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:00.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.242606+0000","last_change":"2024-04-24T23:02:25.242120+0000","last_active":"2024-04-24T23:02:27.242606+0000","last_peered":"2024-04-24T23:02:27.242606+0000","last_clean":"2024-04-24T23:02:27.242606+0000","last_became_active":"2024-04-24T23:02:25.241781+0000","last_became_peered":"2024-04-24T23:02:25.241781+0000","last_unstale":"2024-04-24T23:02:27.242606+0000","last_undegraded":"2024-04-24T23:02:27.242606+0000","last_fullsized":"2024-04-24T23:02:27.242606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:11.095956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235130+0000","last_change":"2024-04-24T23:02:25.226216+0000","last_active":"2024-04-24T23:02:26.235130+0000","last_peered":"2024-04-24T23:02:26.235130+0000","last_clean":"2024-04-24T23:02:26.235130+0000","last_became_active":"2024-04-24T23:02:25.225949+0000","last_became_peered":"2024-04-24T23:02:25.225949+0000","last_unstale":"2024-04-24T23:02:26.235130+0000","last_undegraded":"2024-04-24T23:02:26.235130+0000","last_fullsized":"2024-04-24T23:02:26.235130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:12.414502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239174+0000","last_change":"2024-04-24T23:02:25.250173+0000","last_active":"2024-04-24T23:02:26.239174+0000","last_peered":"2024-04-24T23:02:26.239174+0000","last_clean":"2024-04-24T23:02:26.239174+0000","last_became_active":"2024-04-24T23:02:25.247441+0000","last_became_peered":"2024-04-24T23:02:25.247441+0000","last_unstale":"2024-04-24T23:02:26.239174+0000","last_undegraded":"2024-04-24T23:02:26.239174+0000","last_fullsized":"2024-04-24T23:02:26.239174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:23.284789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.859874+0000","last_change":"2024-04-24T23:02:25.226163+0000","last_active":"2024-04-24T23:02:26.859874+0000","last_peered":"2024-04-24T23:02:26.859874+0000","last_clean":"2024-04-24T23:02:26.859874+0000","last_became_active":"2024-04-24T23:02:25.225781+0000","last_became_peered":"2024-04-24T23:02:25.225781+0000","last_unstale":"2024-04-24T23:02:26.859874+0000","last_undegraded":"2024-04-24T23:02:26.859874+0000","last_fullsized":"2024-04-24T23:02:26.859874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:58.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234506+0000","last_change":"2024-04-24T23:02:25.218033+0000","last_active":"2024-04-24T23:02:26.234506+0000","last_peered":"2024-04-24T23:02:26.234506+0000","last_clean":"2024-04-24T23:02:26.234506+0000","last_became_active":"2024-04-24T23:02:25.217738+0000","last_became_peered":"2024-04-24T23:02:25.217738+0000","last_unstale":"2024-04-24T23:02:26.234506+0000","last_undegraded":"2024-04-24T23:02:26.234506+0000","last_fullsized":"2024-04-24T23:02:26.234506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:43:13.407748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238195+0000","last_change":"2024-04-24T23:02:25.256124+0000","last_active":"2024-04-24T23:02:26.238195+0000","last_peered":"2024-04-24T23:02:26.238195+0000","last_clean":"2024-04-24T23:02:26.238195+0000","last_became_active":"2024-04-24T23:02:25.255826+0000","last_became_peered":"2024-04-24T23:02:25.255826+0000","last_unstale":"2024-04-24T23:02:26.238195+0000","last_undegraded":"2024-04-24T23:02:26.238195+0000","last_fullsized":"2024-04-24T23:02:26.238195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:38.302335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239204+0000","last_change":"2024-04-24T23:02:25.240307+0000","last_active":"2024-04-24T23:02:26.239204+0000","last_peered":"2024-04-24T23:02:26.239204+0000","last_clean":"2024-04-24T23:02:26.239204+0000","last_became_active":"2024-04-24T23:02:25.240024+0000","last_became_peered":"2024-04-24T23:02:25.240024+0000","last_unstale":"2024-04-24T23:02:26.239204+0000","last_undegraded":"2024-04-24T23:02:26.239204+0000","last_fullsized":"2024-04-24T23:02:26.239204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:14:48.240989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.236689+0000","last_change":"2024-04-24T23:02:25.242783+0000","last_active":"2024-04-24T23:02:26.236689+0000","last_peered":"2024-04-24T23:02:26.236689+0000","last_clean":"2024-04-24T23:02:26.236689+0000","last_became_active":"2024-04-24T23:02:25.242511+0000","last_became_peered":"2024-04-24T23:02:25.242511+0000","last_unstale":"2024-04-24T23:02:26.236689+0000","last_undegraded":"2024-04-24T23:02:26.236689+0000","last_fullsized":"2024-04-24T23:02:26.236689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:47.732185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.242157+0000","last_change":"2024-04-24T23:02:25.252263+0000","last_active":"2024-04-24T23:02:27.242157+0000","last_peered":"2024-04-24T23:02:27.242157+0000","last_clean":"2024-04-24T23:02:27.242157+0000","last_became_active":"2024-04-24T23:02:25.251837+0000","last_became_peered":"2024-04-24T23:02:25.251837+0000","last_unstale":"2024-04-24T23:02:27.242157+0000","last_undegraded":"2024-04-24T23:02:27.242157+0000","last_fullsized":"2024-04-24T23:02:27.242157+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.064962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240768+0000","last_change":"2024-04-24T23:02:25.248857+0000","last_active":"2024-04-24T23:02:26.240768+0000","last_peered":"2024-04-24T23:02:26.240768+0000","last_clean":"2024-04-24T23:02:26.240768+0000","last_became_active":"2024-04-24T23:02:25.247527+0000","last_became_peered":"2024-04-24T23:02:25.247527+0000","last_unstale":"2024-04-24T23:02:26.240768+0000","last_undegraded":"2024-04-24T23:02:26.240768+0000","last_fullsized":"2024-04-24T23:02:26.240768+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:33.845515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238405+0000","last_change":"2024-04-24T23:02:25.243540+0000","last_active":"2024-04-24T23:02:26.238405+0000","last_peered":"2024-04-24T23:02:26.238405+0000","last_clean":"2024-04-24T23:02:26.238405+0000","last_became_active":"2024-04-24T23:02:25.243197+0000","last_became_peered":"2024-04-24T23:02:25.243197+0000","last_unstale":"2024-04-24T23:02:26.238405+0000","last_undegraded":"2024-04-24T23:02:26.238405+0000","last_fullsized":"2024-04-24T23:02:26.238405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:02.289416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860125+0000","last_change":"2024-04-24T23:02:25.255096+0000","last_active":"2024-04-24T23:02:26.860125+0000","last_peered":"2024-04-24T23:02:26.860125+0000","last_clean":"2024-04-24T23:02:26.860125+0000","last_became_active":"2024-04-24T23:02:25.254830+0000","last_became_peered":"2024-04-24T23:02:25.254830+0000","last_unstale":"2024-04-24T23:02:26.860125+0000","last_undegraded":"2024-04-24T23:02:26.860125+0000","last_fullsized":"2024-04-24T23:02:26.860125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:02.289416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241291+0000","last_change":"2024-04-24T23:02:25.238656+0000","last_active":"2024-04-24T23:02:27.241291+0000","last_peered":"2024-04-24T23:02:27.241291+0000","last_clean":"2024-04-24T23:02:27.241291+0000","last_became_active":"2024-04-24T23:02:25.237317+0000","last_became_peered":"2024-04-24T23:02:25.237317+0000","last_unstale":"2024-04-24T23:02:27.241291+0000","last_undegraded":"2024-04-24T23:02:27.241291+0000","last_fullsized":"2024-04-24T23:02:27.241291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:54:12.183906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.591767+0000","last_change":"2024-04-24T23:02:25.249276+0000","last_active":"2024-04-24T23:02:27.591767+0000","last_peered":"2024-04-24T23:02:27.591767+0000","last_clean":"2024-04-24T23:02:27.591767+0000","last_became_active":"2024-04-24T23:02:25.248546+0000","last_became_peered":"2024-04-24T23:02:25.248546+0000","last_unstale":"2024-04-24T23:02:27.591767+0000","last_undegraded":"2024-04-24T23:02:27.591767+0000","last_fullsized":"2024-04-24T23:02:27.591767+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:52.202874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239656+0000","last_change":"2024-04-24T23:02:25.256223+0000","last_active":"2024-04-24T23:02:26.239656+0000","last_peered":"2024-04-24T23:02:26.239656+0000","last_clean":"2024-04-24T23:02:26.239656+0000","last_became_active":"2024-04-24T23:02:25.255813+0000","last_became_peered":"2024-04-24T23:02:25.255813+0000","last_unstale":"2024-04-24T23:02:26.239656+0000","last_undegraded":"2024-04-24T23:02:26.239656+0000","last_fullsized":"2024-04-24T23:02:26.239656+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:52.202874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.859444+0000","last_change":"2024-04-24T23:02:25.242245+0000","last_active":"2024-04-24T23:02:26.859444+0000","last_peered":"2024-04-24T23:02:26.859444+0000","last_clean":"2024-04-24T23:02:26.859444+0000","last_became_active":"2024-04-24T23:02:25.241952+0000","last_became_peered":"2024-04-24T23:02:25.241952+0000","last_unstale":"2024-04-24T23:02:26.859444+0000","last_undegraded":"2024-04-24T23:02:26.859444+0000","last_fullsized":"2024-04-24T23:02:26.859444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:12.414502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.591839+0000","last_change":"2024-04-24T23:02:25.221941+0000","last_active":"2024-04-24T23:02:27.591839+0000","last_peered":"2024-04-24T23:02:27.591839+0000","last_clean":"2024-04-24T23:02:27.591839+0000","last_became_active":"2024-04-24T23:02:25.221629+0000","last_became_peered":"2024-04-24T23:02:25.221629+0000","last_unstale":"2024-04-24T23:02:27.591839+0000","last_undegraded":"2024-04-24T23:02:27.591839+0000","last_fullsized":"2024-04-24T23:02:27.591839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:07.169134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.383993+0000","last_change":"2024-04-24T23:02:24.232727+0000","last_active":"2024-04-24T23:02:26.383993+0000","last_peered":"2024-04-24T23:02:26.383993+0000","last_clean":"2024-04-24T23:02:26.383993+0000","last_became_active":"2024-04-24T23:02:24.232448+0000","last_became_peered":"2024-04-24T23:02:24.232448+0000","last_unstale":"2024-04-24T23:02:26.383993+0000","last_undegraded":"2024-04-24T23:02:26.383993+0000","last_fullsized":"2024-04-24T23:02:26.383993+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:49.459605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.591726+0000","last_change":"2024-04-24T23:02:25.232014+0000","last_active":"2024-04-24T23:02:27.591726+0000","last_peered":"2024-04-24T23:02:27.591726+0000","last_clean":"2024-04-24T23:02:27.591726+0000","last_became_active":"2024-04-24T23:02:25.231662+0000","last_became_peered":"2024-04-24T23:02:25.231662+0000","last_unstale":"2024-04-24T23:02:27.591726+0000","last_undegraded":"2024-04-24T23:02:27.591726+0000","last_fullsized":"2024-04-24T23:02:27.591726+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:14:48.240989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238719+0000","last_change":"2024-04-24T23:02:24.233090+0000","last_active":"2024-04-24T23:02:26.238719+0000","last_peered":"2024-04-24T23:02:26.238719+0000","last_clean":"2024-04-24T23:02:26.238719+0000","last_became_active":"2024-04-24T23:02:24.232033+0000","last_became_peered":"2024-04-24T23:02:24.232033+0000","last_unstale":"2024-04-24T23:02:26.238719+0000","last_undegraded":"2024-04-24T23:02:26.238719+0000","last_fullsized":"2024-04-24T23:02:26.238719+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:58.732542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592315+0000","last_change":"2024-04-24T23:02:25.223686+0000","last_active":"2024-04-24T23:02:27.592315+0000","last_peered":"2024-04-24T23:02:27.592315+0000","last_clean":"2024-04-24T23:02:27.592315+0000","last_became_active":"2024-04-24T23:02:25.223406+0000","last_became_peered":"2024-04-24T23:02:25.223406+0000","last_unstale":"2024-04-24T23:02:27.592315+0000","last_undegraded":"2024-04-24T23:02:27.592315+0000","last_fullsized":"2024-04-24T23:02:27.592315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:33.845515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.247834+0000","last_change":"2024-04-24T23:02:24.226955+0000","last_active":"2024-04-24T23:02:25.247834+0000","last_peered":"2024-04-24T23:02:25.247834+0000","last_clean":"2024-04-24T23:02:25.247834+0000","last_became_active":"2024-04-24T23:02:24.226644+0000","last_became_peered":"2024-04-24T23:02:24.226644+0000","last_unstale":"2024-04-24T23:02:25.247834+0000","last_undegraded":"2024-04-24T23:02:25.247834+0000","last_fullsized":"2024-04-24T23:02:25.247834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:13.894152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.254983+0000","last_change":"2024-04-24T23:02:25.252785+0000","last_active":"2024-04-24T23:02:25.254983+0000","last_peered":"2024-04-24T23:02:25.254983+0000","last_clean":"2024-04-24T23:02:25.254983+0000","last_became_active":"2024-04-24T23:02:25.252488+0000","last_became_peered":"2024-04-24T23:02:25.252488+0000","last_unstale":"2024-04-24T23:02:25.254983+0000","last_undegraded":"2024-04-24T23:02:25.254983+0000","last_fullsized":"2024-04-24T23:02:25.254983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:30.308242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860366+0000","last_change":"2024-04-24T23:02:24.228524+0000","last_active":"2024-04-24T23:02:26.860366+0000","last_peered":"2024-04-24T23:02:26.860366+0000","last_clean":"2024-04-24T23:02:26.860366+0000","last_became_active":"2024-04-24T23:02:24.228061+0000","last_became_peered":"2024-04-24T23:02:24.228061+0000","last_unstale":"2024-04-24T23:02:26.860366+0000","last_undegraded":"2024-04-24T23:02:26.860366+0000","last_fullsized":"2024-04-24T23:02:26.860366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:15.252487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.383608+0000","last_change":"2024-04-24T23:02:25.240161+0000","last_active":"2024-04-24T23:02:26.383608+0000","last_peered":"2024-04-24T23:02:26.383608+0000","last_clean":"2024-04-24T23:02:26.383608+0000","last_became_active":"2024-04-24T23:02:25.238834+0000","last_became_peered":"2024-04-24T23:02:25.238834+0000","last_unstale":"2024-04-24T23:02:26.383608+0000","last_undegraded":"2024-04-24T23:02:26.383608+0000","last_fullsized":"2024-04-24T23:02:26.383608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:54:12.183906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240359+0000","last_change":"2024-04-24T23:02:24.231613+0000","last_active":"2024-04-24T23:02:26.240359+0000","last_peered":"2024-04-24T23:02:26.240359+0000","last_clean":"2024-04-24T23:02:26.240359+0000","last_became_active":"2024-04-24T23:02:24.230512+0000","last_became_peered":"2024-04-24T23:02:24.230512+0000","last_unstale":"2024-04-24T23:02:26.240359+0000","last_undegraded":"2024-04-24T23:02:26.240359+0000","last_fullsized":"2024-04-24T23:02:26.240359+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:07.226680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592507+0000","last_change":"2024-04-24T23:02:25.234868+0000","last_active":"2024-04-24T23:02:27.592507+0000","last_peered":"2024-04-24T23:02:27.592507+0000","last_clean":"2024-04-24T23:02:27.592507+0000","last_became_active":"2024-04-24T23:02:25.234442+0000","last_became_peered":"2024-04-24T23:02:25.234442+0000","last_unstale":"2024-04-24T23:02:27.592507+0000","last_undegraded":"2024-04-24T23:02:27.592507+0000","last_fullsized":"2024-04-24T23:02:27.592507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:48.019493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592131+0000","last_change":"2024-04-24T23:02:24.229961+0000","last_active":"2024-04-24T23:02:27.592131+0000","last_peered":"2024-04-24T23:02:27.592131+0000","last_clean":"2024-04-24T23:02:27.592131+0000","last_became_active":"2024-04-24T23:02:24.229422+0000","last_became_peered":"2024-04-24T23:02:24.229422+0000","last_unstale":"2024-04-24T23:02:27.592131+0000","last_undegraded":"2024-04-24T23:02:27.592131+0000","last_fullsized":"2024-04-24T23:02:27.592131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:41.111431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.256388+0000","last_change":"2024-04-24T23:02:25.254813+0000","last_active":"2024-04-24T23:02:25.256388+0000","last_peered":"2024-04-24T23:02:25.256388+0000","last_clean":"2024-04-24T23:02:25.256388+0000","last_became_active":"2024-04-24T23:02:25.254494+0000","last_became_peered":"2024-04-24T23:02:25.254494+0000","last_unstale":"2024-04-24T23:02:25.256388+0000","last_undegraded":"2024-04-24T23:02:25.256388+0000","last_fullsized":"2024-04-24T23:02:25.256388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:00.876959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.591582+0000","last_change":"2024-04-24T23:02:24.230602+0000","last_active":"2024-04-24T23:02:27.591582+0000","last_peered":"2024-04-24T23:02:27.591582+0000","last_clean":"2024-04-24T23:02:27.591582+0000","last_became_active":"2024-04-24T23:02:24.230271+0000","last_became_peered":"2024-04-24T23:02:24.230271+0000","last_unstale":"2024-04-24T23:02:27.591582+0000","last_undegraded":"2024-04-24T23:02:27.591582+0000","last_fullsized":"2024-04-24T23:02:27.591582+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:48.524926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235704+0000","last_change":"2024-04-24T23:02:25.237672+0000","last_active":"2024-04-24T23:02:26.235704+0000","last_peered":"2024-04-24T23:02:26.235704+0000","last_clean":"2024-04-24T23:02:26.235704+0000","last_became_active":"2024-04-24T23:02:25.232645+0000","last_became_peered":"2024-04-24T23:02:25.232645+0000","last_unstale":"2024-04-24T23:02:26.235704+0000","last_undegraded":"2024-04-24T23:02:26.235704+0000","last_fullsized":"2024-04-24T23:02:26.235704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:58.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.236943+0000","last_change":"2024-04-24T23:02:24.225366+0000","last_active":"2024-04-24T23:02:26.236943+0000","last_peered":"2024-04-24T23:02:26.236943+0000","last_clean":"2024-04-24T23:02:26.236943+0000","last_became_active":"2024-04-24T23:02:24.224213+0000","last_became_peered":"2024-04-24T23:02:24.224213+0000","last_unstale":"2024-04-24T23:02:26.236943+0000","last_undegraded":"2024-04-24T23:02:26.236943+0000","last_fullsized":"2024-04-24T23:02:26.236943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:19.903106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.383794+0000","last_change":"2024-04-24T23:02:25.249032+0000","last_active":"2024-04-24T23:02:26.383794+0000","last_peered":"2024-04-24T23:02:26.383794+0000","last_clean":"2024-04-24T23:02:26.383794+0000","last_became_active":"2024-04-24T23:02:25.248604+0000","last_became_peered":"2024-04-24T23:02:25.248604+0000","last_unstale":"2024-04-24T23:02:26.383794+0000","last_undegraded":"2024-04-24T23:02:26.383794+0000","last_fullsized":"2024-04-24T23:02:26.383794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:50.459094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235794+0000","last_change":"2024-04-24T23:02:24.226612+0000","last_active":"2024-04-24T23:02:26.235794+0000","last_peered":"2024-04-24T23:02:26.235794+0000","last_clean":"2024-04-24T23:02:26.235794+0000","last_became_active":"2024-04-24T23:02:24.226309+0000","last_became_peered":"2024-04-24T23:02:24.226309+0000","last_unstale":"2024-04-24T23:02:26.235794+0000","last_undegraded":"2024-04-24T23:02:26.235794+0000","last_fullsized":"2024-04-24T23:02:26.235794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:06.471347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235438+0000","last_change":"2024-04-24T23:02:25.225673+0000","last_active":"2024-04-24T23:02:26.235438+0000","last_peered":"2024-04-24T23:02:26.235438+0000","last_clean":"2024-04-24T23:02:26.235438+0000","last_became_active":"2024-04-24T23:02:25.225400+0000","last_became_peered":"2024-04-24T23:02:25.225400+0000","last_unstale":"2024-04-24T23:02:26.235438+0000","last_undegraded":"2024-04-24T23:02:26.235438+0000","last_fullsized":"2024-04-24T23:02:26.235438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:50.475141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235224+0000","last_change":"2024-04-24T23:02:24.221344+0000","last_active":"2024-04-24T23:02:26.235224+0000","last_peered":"2024-04-24T23:02:26.235224+0000","last_clean":"2024-04-24T23:02:26.235224+0000","last_became_active":"2024-04-24T23:02:24.221054+0000","last_became_peered":"2024-04-24T23:02:24.221054+0000","last_unstale":"2024-04-24T23:02:26.235224+0000","last_undegraded":"2024-04-24T23:02:26.235224+0000","last_fullsized":"2024-04-24T23:02:26.235224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:17.158503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241140+0000","last_change":"2024-04-24T23:02:25.243536+0000","last_active":"2024-04-24T23:02:27.241140+0000","last_peered":"2024-04-24T23:02:27.241140+0000","last_clean":"2024-04-24T23:02:27.241140+0000","last_became_active":"2024-04-24T23:02:25.242901+0000","last_became_peered":"2024-04-24T23:02:25.242901+0000","last_unstale":"2024-04-24T23:02:27.241140+0000","last_undegraded":"2024-04-24T23:02:27.241140+0000","last_fullsized":"2024-04-24T23:02:27.241140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:51.677037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592498+0000","last_change":"2024-04-24T23:02:24.237065+0000","last_active":"2024-04-24T23:02:27.592498+0000","last_peered":"2024-04-24T23:02:27.592498+0000","last_clean":"2024-04-24T23:02:27.592498+0000","last_became_active":"2024-04-24T23:02:24.236789+0000","last_became_peered":"2024-04-24T23:02:24.236789+0000","last_unstale":"2024-04-24T23:02:27.592498+0000","last_undegraded":"2024-04-24T23:02:27.592498+0000","last_fullsized":"2024-04-24T23:02:27.592498+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:15:22.691039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860184+0000","last_change":"2024-04-24T23:02:25.250282+0000","last_active":"2024-04-24T23:02:26.860184+0000","last_peered":"2024-04-24T23:02:26.860184+0000","last_clean":"2024-04-24T23:02:26.860184+0000","last_became_active":"2024-04-24T23:02:25.249993+0000","last_became_peered":"2024-04-24T23:02:25.249993+0000","last_unstale":"2024-04-24T23:02:26.860184+0000","last_undegraded":"2024-04-24T23:02:26.860184+0000","last_fullsized":"2024-04-24T23:02:26.860184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:43:29.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.259818+0000","last_change":"2024-04-24T23:02:24.238004+0000","last_active":"2024-04-24T23:02:25.259818+0000","last_peered":"2024-04-24T23:02:25.259818+0000","last_clean":"2024-04-24T23:02:25.259818+0000","last_became_active":"2024-04-24T23:02:24.237737+0000","last_became_peered":"2024-04-24T23:02:24.237737+0000","last_unstale":"2024-04-24T23:02:25.259818+0000","last_undegraded":"2024-04-24T23:02:25.259818+0000","last_fullsized":"2024-04-24T23:02:25.259818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:34.371804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592323+0000","last_change":"2024-04-24T23:02:25.224715+0000","last_active":"2024-04-24T23:02:27.592323+0000","last_peered":"2024-04-24T23:02:27.592323+0000","last_clean":"2024-04-24T23:02:27.592323+0000","last_became_active":"2024-04-24T23:02:25.224399+0000","last_became_peered":"2024-04-24T23:02:25.224399+0000","last_unstale":"2024-04-24T23:02:27.592323+0000","last_undegraded":"2024-04-24T23:02:27.592323+0000","last_fullsized":"2024-04-24T23:02:27.592323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:35.156307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238289+0000","last_change":"2024-04-24T23:02:24.227879+0000","last_active":"2024-04-24T23:02:26.238289+0000","last_peered":"2024-04-24T23:02:26.238289+0000","last_clean":"2024-04-24T23:02:26.238289+0000","last_became_active":"2024-04-24T23:02:24.226787+0000","last_became_peered":"2024-04-24T23:02:24.226787+0000","last_unstale":"2024-04-24T23:02:26.238289+0000","last_undegraded":"2024-04-24T23:02:26.238289+0000","last_fullsized":"2024-04-24T23:02:26.238289+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:20.131096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241662+0000","last_change":"2024-04-24T23:02:25.238063+0000","last_active":"2024-04-24T23:02:27.241662+0000","last_peered":"2024-04-24T23:02:27.241662+0000","last_clean":"2024-04-24T23:02:27.241662+0000","last_became_active":"2024-04-24T23:02:25.237417+0000","last_became_peered":"2024-04-24T23:02:25.237417+0000","last_unstale":"2024-04-24T23:02:27.241662+0000","last_undegraded":"2024-04-24T23:02:27.241662+0000","last_fullsized":"2024-04-24T23:02:27.241662+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:34.119271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234411+0000","last_change":"2024-04-24T23:02:24.236455+0000","last_active":"2024-04-24T23:02:26.234411+0000","last_peered":"2024-04-24T23:02:26.234411+0000","last_clean":"2024-04-24T23:02:26.234411+0000","last_became_active":"2024-04-24T23:02:24.236154+0000","last_became_peered":"2024-04-24T23:02:24.236154+0000","last_unstale":"2024-04-24T23:02:26.234411+0000","last_undegraded":"2024-04-24T23:02:26.234411+0000","last_fullsized":"2024-04-24T23:02:26.234411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:00.141746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239113+0000","last_change":"2024-04-24T23:02:25.225156+0000","last_active":"2024-04-24T23:02:26.239113+0000","last_peered":"2024-04-24T23:02:26.239113+0000","last_clean":"2024-04-24T23:02:26.239113+0000","last_became_active":"2024-04-24T23:02:25.224641+0000","last_became_peered":"2024-04-24T23:02:25.224641+0000","last_unstale":"2024-04-24T23:02:26.239113+0000","last_undegraded":"2024-04-24T23:02:26.239113+0000","last_fullsized":"2024-04-24T23:02:26.239113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:43:29.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.859609+0000","last_change":"2024-04-24T23:02:24.226221+0000","last_active":"2024-04-24T23:02:26.859609+0000","last_peered":"2024-04-24T23:02:26.859609+0000","last_clean":"2024-04-24T23:02:26.859609+0000","last_became_active":"2024-04-24T23:02:24.225893+0000","last_became_peered":"2024-04-24T23:02:24.225893+0000","last_unstale":"2024-04-24T23:02:26.859609+0000","last_undegraded":"2024-04-24T23:02:26.859609+0000","last_fullsized":"2024-04-24T23:02:26.859609+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:17.158503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240838+0000","last_change":"2024-04-24T23:02:25.247131+0000","last_active":"2024-04-24T23:02:26.240838+0000","last_peered":"2024-04-24T23:02:26.240838+0000","last_clean":"2024-04-24T23:02:26.240838+0000","last_became_active":"2024-04-24T23:02:25.246535+0000","last_became_peered":"2024-04-24T23:02:25.246535+0000","last_unstale":"2024-04-24T23:02:26.240838+0000","last_undegraded":"2024-04-24T23:02:26.240838+0000","last_fullsized":"2024-04-24T23:02:26.240838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:48.019493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.236315+0000","last_change":"2024-04-24T23:02:24.227754+0000","last_active":"2024-04-24T23:02:26.236315+0000","last_peered":"2024-04-24T23:02:26.236315+0000","last_clean":"2024-04-24T23:02:26.236315+0000","last_became_active":"2024-04-24T23:02:24.227484+0000","last_became_peered":"2024-04-24T23:02:24.227484+0000","last_unstale":"2024-04-24T23:02:26.236315+0000","last_undegraded":"2024-04-24T23:02:26.236315+0000","last_fullsized":"2024-04-24T23:02:26.236315+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:00.141746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.248878+0000","last_change":"2024-04-24T23:02:25.244938+0000","last_active":"2024-04-24T23:02:25.248878+0000","last_peered":"2024-04-24T23:02:25.248878+0000","last_clean":"2024-04-24T23:02:25.248878+0000","last_became_active":"2024-04-24T23:02:25.239646+0000","last_became_peered":"2024-04-24T23:02:25.239646+0000","last_unstale":"2024-04-24T23:02:25.248878+0000","last_undegraded":"2024-04-24T23:02:25.248878+0000","last_fullsized":"2024-04-24T23:02:25.248878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:07.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240060+0000","last_change":"2024-04-24T23:02:24.229170+0000","last_active":"2024-04-24T23:02:26.240060+0000","last_peered":"2024-04-24T23:02:26.240060+0000","last_clean":"2024-04-24T23:02:26.240060+0000","last_became_active":"2024-04-24T23:02:24.228845+0000","last_became_peered":"2024-04-24T23:02:24.228845+0000","last_unstale":"2024-04-24T23:02:26.240060+0000","last_undegraded":"2024-04-24T23:02:26.240060+0000","last_fullsized":"2024-04-24T23:02:26.240060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:06.471347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241016+0000","last_change":"2024-04-24T23:02:25.250200+0000","last_active":"2024-04-24T23:02:27.241016+0000","last_peered":"2024-04-24T23:02:27.241016+0000","last_clean":"2024-04-24T23:02:27.241016+0000","last_became_active":"2024-04-24T23:02:25.249912+0000","last_became_peered":"2024-04-24T23:02:25.249912+0000","last_unstale":"2024-04-24T23:02:27.241016+0000","last_undegraded":"2024-04-24T23:02:27.241016+0000","last_fullsized":"2024-04-24T23:02:27.241016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:43:29.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239060+0000","last_change":"2024-04-24T23:02:24.235869+0000","last_active":"2024-04-24T23:02:26.239060+0000","last_peered":"2024-04-24T23:02:26.239060+0000","last_clean":"2024-04-24T23:02:26.239060+0000","last_became_active":"2024-04-24T23:02:24.230778+0000","last_became_peered":"2024-04-24T23:02:24.230778+0000","last_unstale":"2024-04-24T23:02:26.239060+0000","last_undegraded":"2024-04-24T23:02:26.239060+0000","last_fullsized":"2024-04-24T23:02:26.239060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:17.158503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.859578+0000","last_change":"2024-04-24T23:02:25.224133+0000","last_active":"2024-04-24T23:02:26.859578+0000","last_peered":"2024-04-24T23:02:26.859578+0000","last_clean":"2024-04-24T23:02:26.859578+0000","last_became_active":"2024-04-24T23:02:25.223821+0000","last_became_peered":"2024-04-24T23:02:25.223821+0000","last_unstale":"2024-04-24T23:02:26.859578+0000","last_undegraded":"2024-04-24T23:02:26.859578+0000","last_fullsized":"2024-04-24T23:02:26.859578+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:50.475141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235194+0000","last_change":"2024-04-24T23:02:24.227355+0000","last_active":"2024-04-24T23:02:26.235194+0000","last_peered":"2024-04-24T23:02:26.235194+0000","last_clean":"2024-04-24T23:02:26.235194+0000","last_became_active":"2024-04-24T23:02:24.227149+0000","last_became_peered":"2024-04-24T23:02:24.227149+0000","last_unstale":"2024-04-24T23:02:26.235194+0000","last_undegraded":"2024-04-24T23:02:26.235194+0000","last_fullsized":"2024-04-24T23:02:26.235194+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:20.131096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238012+0000","last_change":"2024-04-24T23:02:25.242363+0000","last_active":"2024-04-24T23:02:26.238012+0000","last_peered":"2024-04-24T23:02:26.238012+0000","last_clean":"2024-04-24T23:02:26.238012+0000","last_became_active":"2024-04-24T23:02:25.242025+0000","last_became_peered":"2024-04-24T23:02:25.242025+0000","last_unstale":"2024-04-24T23:02:26.238012+0000","last_undegraded":"2024-04-24T23:02:26.238012+0000","last_fullsized":"2024-04-24T23:02:26.238012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:58.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860533+0000","last_change":"2024-04-24T23:02:24.233466+0000","last_active":"2024-04-24T23:02:26.860533+0000","last_peered":"2024-04-24T23:02:26.860533+0000","last_clean":"2024-04-24T23:02:26.860533+0000","last_became_active":"2024-04-24T23:02:24.233204+0000","last_became_peered":"2024-04-24T23:02:24.233204+0000","last_unstale":"2024-04-24T23:02:26.860533+0000","last_undegraded":"2024-04-24T23:02:26.860533+0000","last_fullsized":"2024-04-24T23:02:26.860533+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:42:45.003835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860275+0000","last_change":"2024-04-24T23:02:25.227768+0000","last_active":"2024-04-24T23:02:26.860275+0000","last_peered":"2024-04-24T23:02:26.860275+0000","last_clean":"2024-04-24T23:02:26.860275+0000","last_became_active":"2024-04-24T23:02:25.225843+0000","last_became_peered":"2024-04-24T23:02:25.225843+0000","last_unstale":"2024-04-24T23:02:26.860275+0000","last_undegraded":"2024-04-24T23:02:26.860275+0000","last_fullsized":"2024-04-24T23:02:26.860275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:20.323278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241670+0000","last_change":"2024-04-24T23:02:24.234573+0000","last_active":"2024-04-24T23:02:27.241670+0000","last_peered":"2024-04-24T23:02:27.241670+0000","last_clean":"2024-04-24T23:02:27.241670+0000","last_became_active":"2024-04-24T23:02:24.234229+0000","last_became_peered":"2024-04-24T23:02:24.234229+0000","last_unstale":"2024-04-24T23:02:27.241670+0000","last_undegraded":"2024-04-24T23:02:27.241670+0000","last_fullsized":"2024-04-24T23:02:27.241670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:03:50.158359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.235091+0000","last_change":"2024-04-24T23:02:25.217637+0000","last_active":"2024-04-24T23:02:26.235091+0000","last_peered":"2024-04-24T23:02:26.235091+0000","last_clean":"2024-04-24T23:02:26.235091+0000","last_became_active":"2024-04-24T23:02:25.217343+0000","last_became_peered":"2024-04-24T23:02:25.217343+0000","last_unstale":"2024-04-24T23:02:26.235091+0000","last_undegraded":"2024-04-24T23:02:26.235091+0000","last_fullsized":"2024-04-24T23:02:26.235091+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:26.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238512+0000","last_change":"2024-04-24T23:02:24.232375+0000","last_active":"2024-04-24T23:02:26.238512+0000","last_peered":"2024-04-24T23:02:26.238512+0000","last_clean":"2024-04-24T23:02:26.238512+0000","last_became_active":"2024-04-24T23:02:24.231704+0000","last_became_peered":"2024-04-24T23:02:24.231704+0000","last_unstale":"2024-04-24T23:02:26.238512+0000","last_undegraded":"2024-04-24T23:02:26.238512+0000","last_fullsized":"2024-04-24T23:02:26.238512+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:36.801228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.241361+0000","last_change":"2024-04-24T23:02:25.245520+0000","last_active":"2024-04-24T23:02:27.241361+0000","last_peered":"2024-04-24T23:02:27.241361+0000","last_clean":"2024-04-24T23:02:27.241361+0000","last_became_active":"2024-04-24T23:02:25.242342+0000","last_became_peered":"2024-04-24T23:02:25.242342+0000","last_unstale":"2024-04-24T23:02:27.241361+0000","last_undegraded":"2024-04-24T23:02:27.241361+0000","last_fullsized":"2024-04-24T23:02:27.241361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:50.459094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.231344+0000","last_change":"2024-04-24T23:02:24.233697+0000","last_active":"2024-04-24T23:02:25.231344+0000","last_peered":"2024-04-24T23:02:25.231344+0000","last_clean":"2024-04-24T23:02:25.231344+0000","last_became_active":"2024-04-24T23:02:24.233376+0000","last_became_peered":"2024-04-24T23:02:24.233376+0000","last_unstale":"2024-04-24T23:02:25.231344+0000","last_undegraded":"2024-04-24T23:02:25.231344+0000","last_fullsized":"2024-04-24T23:02:25.231344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:01:08.531092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239836+0000","last_change":"2024-04-24T23:02:25.256696+0000","last_active":"2024-04-24T23:02:26.239836+0000","last_peered":"2024-04-24T23:02:26.239836+0000","last_clean":"2024-04-24T23:02:26.239836+0000","last_became_active":"2024-04-24T23:02:25.255142+0000","last_became_peered":"2024-04-24T23:02:25.255142+0000","last_unstale":"2024-04-24T23:02:26.239836+0000","last_undegraded":"2024-04-24T23:02:26.239836+0000","last_fullsized":"2024-04-24T23:02:26.239836+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:51.677037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.230841+0000","last_change":"2024-04-24T23:02:24.231741+0000","last_active":"2024-04-24T23:02:25.230841+0000","last_peered":"2024-04-24T23:02:25.230841+0000","last_clean":"2024-04-24T23:02:25.230841+0000","last_became_active":"2024-04-24T23:02:24.231451+0000","last_became_peered":"2024-04-24T23:02:24.231451+0000","last_unstale":"2024-04-24T23:02:25.230841+0000","last_undegraded":"2024-04-24T23:02:25.230841+0000","last_fullsized":"2024-04-24T23:02:25.230841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:12.949728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234852+0000","last_change":"2024-04-24T23:02:25.238061+0000","last_active":"2024-04-24T23:02:26.234852+0000","last_peered":"2024-04-24T23:02:26.234852+0000","last_clean":"2024-04-24T23:02:26.234852+0000","last_became_active":"2024-04-24T23:02:25.237788+0000","last_became_peered":"2024-04-24T23:02:25.237788+0000","last_unstale":"2024-04-24T23:02:26.234852+0000","last_undegraded":"2024-04-24T23:02:26.234852+0000","last_fullsized":"2024-04-24T23:02:26.234852+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:00.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592320+0000","last_change":"2024-04-24T23:02:24.232072+0000","last_active":"2024-04-24T23:02:27.592320+0000","last_peered":"2024-04-24T23:02:27.592320+0000","last_clean":"2024-04-24T23:02:27.592320+0000","last_became_active":"2024-04-24T23:02:24.231788+0000","last_became_peered":"2024-04-24T23:02:24.231788+0000","last_unstale":"2024-04-24T23:02:27.592320+0000","last_undegraded":"2024-04-24T23:02:27.592320+0000","last_fullsized":"2024-04-24T23:02:27.592320+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:23:43.793389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.254051+0000","last_change":"2024-04-24T23:02:25.252660+0000","last_active":"2024-04-24T23:02:25.254051+0000","last_peered":"2024-04-24T23:02:25.254051+0000","last_clean":"2024-04-24T23:02:25.254051+0000","last_became_active":"2024-04-24T23:02:25.252335+0000","last_became_peered":"2024-04-24T23:02:25.252335+0000","last_unstale":"2024-04-24T23:02:25.254051+0000","last_undegraded":"2024-04-24T23:02:25.254051+0000","last_fullsized":"2024-04-24T23:02:25.254051+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:44.076615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:27.592644+0000","last_change":"2024-04-24T23:02:24.233806+0000","last_active":"2024-04-24T23:02:27.592644+0000","last_peered":"2024-04-24T23:02:27.592644+0000","last_clean":"2024-04-24T23:02:27.592644+0000","last_became_active":"2024-04-24T23:02:24.233288+0000","last_became_peered":"2024-04-24T23:02:24.233288+0000","last_unstale":"2024-04-24T23:02:27.592644+0000","last_undegraded":"2024-04-24T23:02:27.592644+0000","last_fullsized":"2024-04-24T23:02:27.592644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:19.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.240337+0000","last_change":"2024-04-24T23:02:25.248729+0000","last_active":"2024-04-24T23:02:26.240337+0000","last_peered":"2024-04-24T23:02:26.240337+0000","last_clean":"2024-04-24T23:02:26.240337+0000","last_became_active":"2024-04-24T23:02:25.248221+0000","last_became_peered":"2024-04-24T23:02:25.248221+0000","last_unstale":"2024-04-24T23:02:26.240337+0000","last_undegraded":"2024-04-24T23:02:26.240337+0000","last_fullsized":"2024-04-24T23:02:26.240337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:07.169134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.238572+0000","last_change":"2024-04-24T23:02:24.223960+0000","last_active":"2024-04-24T23:02:26.238572+0000","last_peered":"2024-04-24T23:02:26.238572+0000","last_clean":"2024-04-24T23:02:26.238572+0000","last_became_active":"2024-04-24T23:02:24.223679+0000","last_became_peered":"2024-04-24T23:02:24.223679+0000","last_unstale":"2024-04-24T23:02:26.238572+0000","last_undegraded":"2024-04-24T23:02:26.238572+0000","last_fullsized":"2024-04-24T23:02:26.238572+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:38.751259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.249788+0000","last_change":"2024-04-24T23:02:25.247170+0000","last_active":"2024-04-24T23:02:25.249788+0000","last_peered":"2024-04-24T23:02:25.249788+0000","last_clean":"2024-04-24T23:02:25.249788+0000","last_became_active":"2024-04-24T23:02:25.246804+0000","last_became_peered":"2024-04-24T23:02:25.246804+0000","last_unstale":"2024-04-24T23:02:25.249788+0000","last_undegraded":"2024-04-24T23:02:25.249788+0000","last_fullsized":"2024-04-24T23:02:25.249788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:34.238720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.232325+0000","last_change":"2024-04-24T23:02:24.233437+0000","last_active":"2024-04-24T23:02:25.232325+0000","last_peered":"2024-04-24T23:02:25.232325+0000","last_clean":"2024-04-24T23:02:25.232325+0000","last_became_active":"2024-04-24T23:02:24.232708+0000","last_became_peered":"2024-04-24T23:02:24.232708+0000","last_unstale":"2024-04-24T23:02:25.232325+0000","last_undegraded":"2024-04-24T23:02:25.232325+0000","last_fullsized":"2024-04-24T23:02:25.232325+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:31.346915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.860363+0000","last_change":"2024-04-24T23:02:25.228529+0000","last_active":"2024-04-24T23:02:26.860363+0000","last_peered":"2024-04-24T23:02:26.860363+0000","last_clean":"2024-04-24T23:02:26.860363+0000","last_became_active":"2024-04-24T23:02:25.228181+0000","last_became_peered":"2024-04-24T23:02:25.228181+0000","last_unstale":"2024-04-24T23:02:26.860363+0000","last_undegraded":"2024-04-24T23:02:26.860363+0000","last_fullsized":"2024-04-24T23:02:26.860363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:51.677037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239126+0000","last_change":"2024-04-24T23:02:24.231754+0000","last_active":"2024-04-24T23:02:26.239126+0000","last_peered":"2024-04-24T23:02:26.239126+0000","last_clean":"2024-04-24T23:02:26.239126+0000","last_became_active":"2024-04-24T23:02:24.231251+0000","last_became_peered":"2024-04-24T23:02:24.231251+0000","last_unstale":"2024-04-24T23:02:26.239126+0000","last_undegraded":"2024-04-24T23:02:26.239126+0000","last_fullsized":"2024-04-24T23:02:26.239126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:41:05.744516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.256367+0000","last_change":"2024-04-24T23:02:25.254610+0000","last_active":"2024-04-24T23:02:25.256367+0000","last_peered":"2024-04-24T23:02:25.256367+0000","last_clean":"2024-04-24T23:02:25.256367+0000","last_became_active":"2024-04-24T23:02:25.253996+0000","last_became_peered":"2024-04-24T23:02:25.253996+0000","last_unstale":"2024-04-24T23:02:25.256367+0000","last_undegraded":"2024-04-24T23:02:25.256367+0000","last_fullsized":"2024-04-24T23:02:25.256367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:59.682882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.859809+0000","last_change":"2024-04-24T23:02:24.229834+0000","last_active":"2024-04-24T23:02:26.859809+0000","last_peered":"2024-04-24T23:02:26.859809+0000","last_clean":"2024-04-24T23:02:26.859809+0000","last_became_active":"2024-04-24T23:02:24.229426+0000","last_became_peered":"2024-04-24T23:02:24.229426+0000","last_unstale":"2024-04-24T23:02:26.859809+0000","last_undegraded":"2024-04-24T23:02:26.859809+0000","last_fullsized":"2024-04-24T23:02:26.859809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:06.471347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.239547+0000","last_change":"2024-04-24T23:02:25.243765+0000","last_active":"2024-04-24T23:02:26.239547+0000","last_peered":"2024-04-24T23:02:26.239547+0000","last_clean":"2024-04-24T23:02:26.239547+0000","last_became_active":"2024-04-24T23:02:25.243479+0000","last_became_peered":"2024-04-24T23:02:25.243479+0000","last_unstale":"2024-04-24T23:02:26.239547+0000","last_undegraded":"2024-04-24T23:02:26.239547+0000","last_fullsized":"2024-04-24T23:02:26.239547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:25:20.323278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234912+0000","last_change":"2024-04-24T23:02:24.229373+0000","last_active":"2024-04-24T23:02:26.234912+0000","last_peered":"2024-04-24T23:02:26.234912+0000","last_clean":"2024-04-24T23:02:26.234912+0000","last_became_active":"2024-04-24T23:02:24.228829+0000","last_became_peered":"2024-04-24T23:02:24.228829+0000","last_unstale":"2024-04-24T23:02:26.234912+0000","last_undegraded":"2024-04-24T23:02:26.234912+0000","last_fullsized":"2024-04-24T23:02:26.234912+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:58.732542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.383538+0000","last_change":"2024-04-24T23:02:25.235363+0000","last_active":"2024-04-24T23:02:26.383538+0000","last_peered":"2024-04-24T23:02:26.383538+0000","last_clean":"2024-04-24T23:02:26.383538+0000","last_became_active":"2024-04-24T23:02:25.235040+0000","last_became_peered":"2024-04-24T23:02:25.235040+0000","last_unstale":"2024-04-24T23:02:26.383538+0000","last_undegraded":"2024-04-24T23:02:26.383538+0000","last_fullsized":"2024-04-24T23:02:26.383538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:24.180618+0000","last_clean_scrub_stamp":"2024-04-24T23:02:24.180618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:51.677037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-24T23:02:25.234863+0000","last_change":"2024-04-24T23:02:24.236950+0000","last_active":"2024-04-24T23:02:25.234863+0000","last_peered":"2024-04-24T23:02:25.234863+0000","last_clean":"2024-04-24T23:02:25.234863+0000","last_became_active":"2024-04-24T23:02:24.236601+0000","last_became_peered":"2024-04-24T23:02:24.236601+0000","last_unstale":"2024-04-24T23:02:25.234863+0000","last_undegraded":"2024-04-24T23:02:25.234863+0000","last_fullsized":"2024-04-24T23:02:25.234863+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:02:23.165082+0000","last_clean_scrub_stamp":"2024-04-24T23:02:23.165082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:40.892142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-24T23:02:26.234991+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:02:26.234991+0000","last_peered":"2024-04-24T23:02:26.234991+0000","last_clean":"2024-04-24T23:02:26.234991+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:02:26.234991+0000","last_undegraded":"2024-04-24T23:02:26.234991+0000","last_fullsized":"2024-04-24T23:02:26.234991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":279593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":273427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":281241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":272935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":279571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1232896,"data_stored":869975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":280119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":864915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:02:30.140 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:02:30.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:02:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.390+0000 7fe22fe00640 1 Processor -- start 2024-04-24T23:02:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.390+0000 7fe22fe00640 1 -- start start 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe23006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe2301627e0 0x7fe23006b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22fe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2301631c0 con 0x7fe230162c60 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe2301634a0 con 0x7fe2301627e0 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe23006c7c0 con 0x7fe23015c880 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe230162c60 0x7fe230070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33928/0 (socket says 172.21.15.146:33928) 2024-04-24T23:02:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.392+0000 7fe22f400640 1 -- 172.21.15.146:0/3170951557 learned_addr learned my addr 172.21.15.146:0/3170951557 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254179363 0 0) 0x7fe2301631c0 con 0x7fe230162c60 2024-04-24T23:02:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe214003520 con 0x7fe230162c60 2024-04-24T23:02:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22ea00640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe23006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22e000640 1 --2- 172.21.15.146:0/3170951557 >> v2:172.21.15.203:3300/0 conn(0x7fe2301627e0 0x7fe23006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 396549230 0 0) 0x7fe214003520 con 0x7fe230162c60 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 msgr2=0x7fe23006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe23006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 >> v2:172.21.15.203:3300/0 conn(0x7fe2301627e0 msgr2=0x7fe23006b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 --2- 172.21.15.146:0/3170951557 >> v2:172.21.15.203:3300/0 conn(0x7fe2301627e0 0x7fe23006b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23006d500 con 0x7fe230162c60 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe2280019f0 con 0x7fe230162c60 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22e000640 1 --2- 172.21.15.146:0/3170951557 >> v2:172.21.15.203:3300/0 conn(0x7fe2301627e0 0x7fe23006b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 >> v1:172.21.15.146:6789/0 conn(0x7fe230162c60 legacy=0x7fe230070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2140039b0 0x7fe214003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.393+0000 7fe22d600640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe214004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22d600640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301634a0 con 0x7fe214004d40 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe23006c7c0 con 0x7fe2140039b0 2024-04-24T23:02:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe21400ba70 con 0x7fe23015c880 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22e000640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe214004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22ea00640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2140039b0 0x7fe214003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 -- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 msgr2=0x7fe214004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe23015c880 0x7fe214004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 -- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2140039b0 msgr2=0x7fe214003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2140039b0 0x7fe214003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.394+0000 7fe22f400640 1 -- 172.21.15.146:0/3170951557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe214003520 con 0x7fe214004d40 2024-04-24T23:02:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.395+0000 7fe22f400640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a8f0 tx=0x7fe214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b7b3a50009ad4c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22800a4c0 con 0x7fe214004d40 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22802f070 con 0x7fe214004d40 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22d600640 1 -- 172.21.15.146:0/3170951557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22802bce0 con 0x7fe214004d40 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 -- 172.21.15.146:0/3170951557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214004d40 msgr2=0x7fe2140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 --2- 172.21.15.146:0/3170951557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a8f0 tx=0x7fe214005830 comp rx=0 tx=0).stop 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22f400640 1 -- 172.21.15.146:0/3170951557 reap_dead start 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 -- 172.21.15.146:0/3170951557 shutdown_connections 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 -- 172.21.15.146:0/3170951557 >> 172.21.15.146:0/3170951557 conn(0x7fe2300b19c0 msgr2=0x7fe2300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 -- 172.21.15.146:0/3170951557 shutdown_connections 2024-04-24T23:02:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.396+0000 7fe22fe00640 1 -- 172.21.15.146:0/3170951557 wait complete. 2024-04-24T23:02:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.398+0000 7fe22fe00640 1 Processor -- start 2024-04-24T23:02:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.398+0000 7fe22fe00640 1 -- start start 2024-04-24T23:02:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 0x7fe230161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2300c4b60 0x7fe23014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe23006cfc0 con 0x7fe2300c5160 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300b4ad0 con 0x7fe2300c4b60 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.399+0000 7fe22fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe23006d140 con 0x7fe214004d40 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58996/0 (socket says 172.21.15.146:58996) 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 -- 172.21.15.146:0/2916702282 learned_addr learned my addr 172.21.15.146:0/2916702282 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22ea00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 0x7fe230161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22e000640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2300c4b60 0x7fe23014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 -- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 msgr2=0x7fe230161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 0x7fe230161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 -- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2300c4b60 msgr2=0x7fe23014cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2300c4b60 0x7fe23014cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22f400640 1 -- 172.21.15.146:0/2916702282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230160a60 con 0x7fe2300c5160 2024-04-24T23:02:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.400+0000 7fe22ea00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 0x7fe230161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe22f400640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe228001cf0 tx=0x7fe23006caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228044070 con 0x7fe2300c5160 2024-04-24T23:02:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe228034470 con 0x7fe2300c5160 2024-04-24T23:02:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22800a4c0 con 0x7fe2300c5160 2024-04-24T23:02:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe230160d40 con 0x7fe2300c5160 2024-04-24T23:02:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.401+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23014d010 con 0x7fe2300c5160 2024-04-24T23:02:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.402+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23004f500 con 0x7fe2300c5160 2024-04-24T23:02:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.403+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe228047070 con 0x7fe2300c5160 2024-04-24T23:02:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.404+0000 7fe227400640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 0x7fe21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.404+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe2280ab0d0 con 0x7fe2300c5160 2024-04-24T23:02:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.405+0000 7fe22ea00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 0x7fe21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.406+0000 7fe22ea00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 0x7fe21006e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe220009980 tx=0x7fe220008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.409+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe228079850 con 0x7fe2300c5160 2024-04-24T23:02:30.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.681+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe2300cbe90 con 0x7fe2300c5160 2024-04-24T23:02:30.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.685+0000 7fe227400640 1 -- 172.21.15.146:0/2916702282 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7fe228079150 con 0x7fe2300c5160 2024-04-24T23:02:30.686 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T23:02:30.686 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T23:02:30.686 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-04-24T23:02:30.687 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-04-24T23:02:30.687 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:02:30.687 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-04-24T23:02:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 msgr2=0x7fe21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 0x7fe21006e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe220009980 tx=0x7fe220008040 comp rx=0 tx=0).stop 2024-04-24T23:02:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 msgr2=0x7fe2300ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe228001cf0 tx=0x7fe23006caa0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 shutdown_connections 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.688+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2300c5160 0x7fe2300ce0e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2300c4b60 0x7fe23014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe21006be30 0x7fe21006e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 --2- 172.21.15.146:0/2916702282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe214004d40 0x7fe230161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 >> 172.21.15.146:0/2916702282 conn(0x7fe2300b19c0 msgr2=0x7fe2300cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 shutdown_connections 2024-04-24T23:02:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.689+0000 7fe22fe00640 1 -- 172.21.15.146:0/2916702282 wait complete. 2024-04-24T23:02:30.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:02:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.897+0000 7fb78d000640 1 Processor -- start 2024-04-24T23:02:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.897+0000 7fb78d000640 1 -- start start 2024-04-24T23:02:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb78d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb7880cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb78d000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb78806cbc0 0x7fb7880d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb78d000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7880cdf70 con 0x7fb788145640 2024-04-24T23:02:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb78d000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb788145a20 con 0x7fb78806cbc0 2024-04-24T23:02:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb78d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb78806d140 con 0x7fb7880b2a20 2024-04-24T23:02:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb786800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb78806cbc0 0x7fb7880d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb786800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb78806cbc0 0x7fb7880d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:53566/0 (socket says 172.21.15.146:53566) 2024-04-24T23:02:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.899+0000 7fb786800640 1 -- 172.21.15.146:0/1327949457 learned_addr learned my addr 172.21.15.146:0/1327949457 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.900+0000 7fb785400640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb7880cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.900+0000 7fb786800640 1 -- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 msgr2=0x7fb7880cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.900+0000 7fb786800640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb7880cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.900+0000 7fb786800640 1 -- 172.21.15.146:0/1327949457 >> v1:172.21.15.203:6789/0 conn(0x7fb788145640 legacy=0x7fb78815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.900+0000 7fb786800640 1 -- 172.21.15.146:0/1327949457 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78806d420 con 0x7fb78806cbc0 2024-04-24T23:02:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.902+0000 7fb786800640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb78806cbc0 0x7fb7880d01d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb780009e50 tx=0x7fb78002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31556f1e7a8f7038 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.902+0000 7fb784a00640 1 -- 172.21.15.146:0/1327949457 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780036070 con 0x7fb78806cbc0 2024-04-24T23:02:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.902+0000 7fb784a00640 1 -- 172.21.15.146:0/1327949457 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb780031600 con 0x7fb78806cbc0 2024-04-24T23:02:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.902+0000 7fb784a00640 1 -- 172.21.15.146:0/1327949457 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7800319d0 con 0x7fb78806cbc0 2024-04-24T23:02:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 -- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb78806cbc0 msgr2=0x7fb7880d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb78806cbc0 0x7fb7880d01d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb780009e50 tx=0x7fb78002a710 comp rx=0 tx=0).stop 2024-04-24T23:02:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 -- 172.21.15.146:0/1327949457 shutdown_connections 2024-04-24T23:02:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb78806cbc0 0x7fb7880d01d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 --2- 172.21.15.146:0/1327949457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb7880cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 -- 172.21.15.146:0/1327949457 >> 172.21.15.146:0/1327949457 conn(0x7fb78806b320 msgr2=0x7fb78806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 -- 172.21.15.146:0/1327949457 shutdown_connections 2024-04-24T23:02:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.903+0000 7fb78d000640 1 -- 172.21.15.146:0/1327949457 wait complete. 2024-04-24T23:02:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.905+0000 7fb78d000640 1 Processor -- start 2024-04-24T23:02:30.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.905+0000 7fb78d000640 1 -- start start 2024-04-24T23:02:30.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb78813b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb788145640 0x7fb788143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880ce450 con 0x7fb78806cbc0 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb78806d9e0 con 0x7fb788145640 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb78d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb7880ce5d0 con 0x7fb7880b2a20 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb785e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb785e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59000/0 (socket says 172.21.15.146:59000) 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.906+0000 7fb785e00640 1 -- 172.21.15.146:0/1678414144 learned_addr learned my addr 172.21.15.146:0/1678414144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb786800640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb788145640 0x7fb788143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785400640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb78813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 -- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 msgr2=0x7fb78813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb78813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 -- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb788145640 msgr2=0x7fb788143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb788145640 0x7fb788143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 -- 172.21.15.146:0/1678414144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78813e800 con 0x7fb78806cbc0 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb785e00640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c3c0 tx=0x7fb77800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780052d0 con 0x7fb78806cbc0 2024-04-24T23:02:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb778005490 con 0x7fb78806cbc0 2024-04-24T23:02:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778007260 con 0x7fb78806cbc0 2024-04-24T23:02:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.907+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78813eae0 con 0x7fb78806cbc0 2024-04-24T23:02:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.908+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78813c670 con 0x7fb78806cbc0 2024-04-24T23:02:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.909+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb788068190 con 0x7fb78806cbc0 2024-04-24T23:02:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.910+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb778007400 con 0x7fb78806cbc0 2024-04-24T23:02:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.911+0000 7fb77e000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 0x7fb76806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.911+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb77808a510 con 0x7fb78806cbc0 2024-04-24T23:02:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.912+0000 7fb785400640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 0x7fb76806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.913+0000 7fb785400640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 0x7fb76806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb788072510 tx=0x7fb774008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:30.916+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb778058c90 con 0x7fb78806cbc0 2024-04-24T23:02:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.156+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7880aed40 con 0x7fb78806cbc0 2024-04-24T23:02:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.157+0000 7fb77e000640 1 -- 172.21.15.146:0/1678414144 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5193 (secure 0 0 0) 0x7fb778058590 con 0x7fb78806cbc0 2024-04-24T23:02:31.158 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:02:31.158 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:02:27.732810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5898":{"gid":5898,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/1456962778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1456962778},{"type":"v1","addr":"172.21.15.146:6835","nonce":1456962778}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5898,"qdb_cluster":[5898]},"id":3}]} 2024-04-24T23:02:31.159 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 32 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 msgr2=0x7fb76806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 0x7fb76806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb788072510 tx=0x7fb774008040 comp rx=0 tx=0).stop 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 msgr2=0x7fb78813c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c3c0 tx=0x7fb77800c880 comp rx=0 tx=0).stop 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 shutdown_connections 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb788145640 0x7fb788143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb76806be60 0x7fb76806e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7880b2a20 0x7fb78813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 --2- 172.21.15.146:0/1678414144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78806cbc0 0x7fb78813c130 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.160+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 >> 172.21.15.146:0/1678414144 conn(0x7fb78806b320 msgr2=0x7fb7880b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.161+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 shutdown_connections 2024-04-24T23:02:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.161+0000 7fb78d000640 1 -- 172.21.15.146:0/1678414144 wait complete. 2024-04-24T23:02:31.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:02:24.670189+0000', 'modified': '2024-04-24T23:02:27.732810+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5898}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5898': {'gid': 5898, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/1456962778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 1456962778}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 1456962778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5898, 'qdb_cluster': [5898]} 2024-04-24T23:02:31.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:02:31.583 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:02:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.793+0000 7f129bc00640 1 Processor -- start 2024-04-24T23:02:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.793+0000 7f129bc00640 1 -- start start 2024-04-24T23:02:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f129bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294072680 0x7f1294071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f129bc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1294072060 0x7f1294161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f129bc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12940af210 con 0x7f12940aee30 2024-04-24T23:02:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f129bc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1294072c60 con 0x7f1294072060 2024-04-24T23:02:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f129bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1294071040 con 0x7f1294072680 2024-04-24T23:02:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.795+0000 7f1299200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12940aee30 0x7f12940b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33944/0 (socket says 172.21.15.146:33944) 2024-04-24T23:02:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1299200640 1 -- 172.21.15.146:0/2067420654 learned_addr learned my addr 172.21.15.146:0/2067420654 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:02:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1299c00640 1 --2- 172.21.15.146:0/2067420654 >> v2:172.21.15.203:3300/0 conn(0x7f1294072060 0x7f1294161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f128be00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294072680 0x7f1294071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027884966 0 0) 0x7f12940af210 con 0x7f12940aee30 2024-04-24T23:02:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1274003520 con 0x7f12940aee30 2024-04-24T23:02:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 850198311 0 0) 0x7f1274003520 con 0x7f12940aee30 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294072680 msgr2=0x7f1294071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294072680 0x7f1294071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 >> v2:172.21.15.203:3300/0 conn(0x7f1294072060 msgr2=0x7f1294161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 --2- 172.21.15.146:0/2067420654 >> v2:172.21.15.203:3300/0 conn(0x7f1294072060 0x7f1294161cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1294071320 con 0x7f12940aee30 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1284001670 con 0x7f12940aee30 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.796+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 >> v1:172.21.15.146:6789/0 conn(0x7f12940aee30 legacy=0x7f12940b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f1274003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1274004800 0x7f1274004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f12740051c0 0x7f127400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1294072c60 con 0x7f12740039b0 2024-04-24T23:02:31.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1294071040 con 0x7f1274004800 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f127400bfe0 con 0x7f12740051c0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f128be00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294072680 0x7f1294071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f1274003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299c00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f12740051c0 0x7f127400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 -- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f12740051c0 msgr2=0x7f127400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f12740051c0 0x7f127400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 -- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1274004800 msgr2=0x7f1274004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1274004800 0x7f1274004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.797+0000 7f1299200640 1 -- 172.21.15.146:0/2067420654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1274003520 con 0x7f12740039b0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.798+0000 7f1299200640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f1274003dd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1274005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d5f955ae73280a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284007d50 con 0x7f12740039b0 2024-04-24T23:02:31.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284005af0 con 0x7f12740039b0 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f1293e00640 1 -- 172.21.15.146:0/2067420654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284007070 con 0x7f12740039b0 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 -- 172.21.15.146:0/2067420654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 msgr2=0x7f1274003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 --2- 172.21.15.146:0/2067420654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f1274003dd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1274005830 comp rx=0 tx=0).stop 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f1299c00640 1 -- 172.21.15.146:0/2067420654 reap_dead start 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 -- 172.21.15.146:0/2067420654 shutdown_connections 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 -- 172.21.15.146:0/2067420654 >> 172.21.15.146:0/2067420654 conn(0x7f129406b140 msgr2=0x7f129406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 -- 172.21.15.146:0/2067420654 shutdown_connections 2024-04-24T23:02:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.799+0000 7f129bc00640 1 -- 172.21.15.146:0/2067420654 wait complete. 2024-04-24T23:02:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.801+0000 7f129bc00640 1 Processor -- start 2024-04-24T23:02:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.802+0000 7f129bc00640 1 -- start start 2024-04-24T23:02:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.802+0000 7f129bc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.802+0000 7f129bc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12941f8260 0x7f1294159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.802+0000 7f129bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294149790 0x7f129415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f129bc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1294071ca0 con 0x7f12740039b0 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f129bc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1294071b20 con 0x7f12941f8260 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f129bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1294071e20 con 0x7f1294149790 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59016/0 (socket says 172.21.15.146:59016) 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 -- 172.21.15.146:0/2386971775 learned_addr learned my addr 172.21.15.146:0/2386971775 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f128be00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12941f8260 0x7f1294159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299c00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294149790 0x7f129415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 -- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294149790 msgr2=0x7f129415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294149790 0x7f129415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 -- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12941f8260 msgr2=0x7f1294159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12941f8260 0x7f1294159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.803+0000 7f1299200640 1 -- 172.21.15.146:0/2386971775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12940ced70 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f1299200640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1284034040 tx=0x7f12940714f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f1291600640 1 -- 172.21.15.146:0/2386971775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284042070 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f1291600640 1 -- 172.21.15.146:0/2386971775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284007480 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12941f7780 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f1291600640 1 -- 172.21.15.146:0/2386971775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284001c80 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.804+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12941f7d40 con 0x7f12740039b0 2024-04-24T23:02:31.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.806+0000 7f1291600640 1 -- 172.21.15.146:0/2386971775 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1284045070 con 0x7f12740039b0 2024-04-24T23:02:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.807+0000 7f1291600640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 0x7f127006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.807+0000 7f1291600640 1 -- 172.21.15.146:0/2386971775 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f12840abba0 con 0x7f12740039b0 2024-04-24T23:02:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.808+0000 7f129ea36740 1 Processor -- start 2024-04-24T23:02:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.808+0000 7f128be00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 0x7f127006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.808+0000 7f129ea36740 1 -- start start 2024-04-24T23:02:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b636602510 0x55b6366028f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 0x55b63661e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6364d7ed0 con 0x55b63661fdb0 2024-04-24T23:02:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b63653adf0 con 0x55b636602510 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b6364e38d0 con 0x55b6365d81f0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f128be00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 0x7f127006e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12940cf130 tx=0x7f127c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f128be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f128be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59020/0 (socket says 172.21.15.146:59020) 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f128be00640 1 -- 172.21.15.146:0/1755414116 learned_addr learned my addr 172.21.15.146:0/1755414116 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.809+0000 7f1299200640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b636602510 0x55b6366028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f1299c00640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 0x55b63661e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 -- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 msgr2=0x55b63661e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 0x55b63661e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 -- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b636602510 msgr2=0x55b6366028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b636602510 0x55b6366028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 -- 172.21.15.146:0/1755414116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b63624f2d0 con 0x55b63661fdb0 2024-04-24T23:02:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f1299c00640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 0x55b63661e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f128be00640 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f12940732b0 tx=0x7f127c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f88b4edd258254 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f1289600640 1 -- 172.21.15.146:0/1755414116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c01b050 con 0x55b63661fdb0 2024-04-24T23:02:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f1289600640 1 -- 172.21.15.146:0/1755414116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c025070 con 0x55b63661fdb0 2024-04-24T23:02:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.810+0000 7f1289600640 1 -- 172.21.15.146:0/1755414116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c014bb0 con 0x55b63661fdb0 2024-04-24T23:02:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 -- 172.21.15.146:0/1755414116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 msgr2=0x55b636620300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f12940732b0 tx=0x7f127c012000 comp rx=0 tx=0).stop 2024-04-24T23:02:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 -- 172.21.15.146:0/1755414116 shutdown_connections 2024-04-24T23:02:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b6365d81f0 0x55b63661e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b63661fdb0 0x55b636620300 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 --2- 172.21.15.146:0/1755414116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b636602510 0x55b6366028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 -- 172.21.15.146:0/1755414116 >> 172.21.15.146:0/1755414116 conn(0x55b6365d4b20 msgr2=0x55b63661d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 -- 172.21.15.146:0/1755414116 shutdown_connections 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.811+0000 7f129ea36740 1 -- 172.21.15.146:0/1755414116 wait complete. 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.812+0000 7f129ea36740 1 -- start start 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.812+0000 7f129ea36740 1 Processor -- start 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b63661fdb0 0x55b636601380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6365fc8f0 0x55b6365fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6364f6d20 con 0x55b636602510 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b636536db0 con 0x55b6365fc8f0 2024-04-24T23:02:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b6365d8f90 con 0x55b63661fdb0 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f129ea36740 10 client.0 _ll_register_callbacks cb 0x55b636531f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59036/0 (socket says 172.21.15.146:59036) 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.813+0000 7f1299200640 1 -- 172.21.15.146:0/846604398 learned_addr learned my addr 172.21.15.146:0/846604398 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 -- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b63661fdb0 msgr2=0x55b636601380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b63661fdb0 0x55b636601380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 -- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6365fc8f0 msgr2=0x55b6365fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6365fc8f0 0x55b6365fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 -- 172.21.15.146:0/846604398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6363196b0 con 0x55b636602510 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1299200640 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1284005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802ca271640916ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1282000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128404c040 con 0x55b636602510 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1284079330 con 0x55b636602510 2024-04-24T23:02:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f127c025070 con 0x55b636602510 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f12840a8050 con 0x55b636602510 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f129ea36740 10 client.6021 fetch_fsmap learned FSMap version 32 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.814+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x55b6365ffc00 con 0x55b636602510 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c025070 con 0x55b636602510 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 32) ==== 3494+0+0 (secure 0 0 0) 0x7f12840801e0 con 0x55b636602510 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 10 client.6021 fetch_fsmap finished waiting for FSMap version 32 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 10 client.6021 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 20 client.6021 populate_metadata read hostname 'smithi146' 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b636631390 0x55b636631770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 4 client.6021 mds_command: new command op to 5898 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 --> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b636548330 con 0x55b636631390 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.815+0000 7f128be00640 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b636631390 0x55b636631770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.816+0000 7f128be00640 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b636631390 0x55b636631770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4109d4d8d4ee6cb server_cookie=1862e6a1a89beb7f in_seq=0 out_seq=0 2024-04-24T23:02:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.816+0000 7f1282000640 10 client.6021 ms_handle_connect on v2:172.21.15.146:6833/1456962778 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f1282000640 1 -- 172.21.15.146:0/846604398 <== mds.0 v2:172.21.15.146:6833/1456962778 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b636548330 con 0x55b636631390 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f1282000640 10 client.6021 handle_command_reply: tid=0 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 client.6021 shutdown 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 msgr2=0x55b6365fabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1284005ac0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 shutdown_connections 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b636631390 0x55b636631770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6365fc8f0 0x55b6365fcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b63661fdb0 0x55b636601380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 --2- 172.21.15.146:0/846604398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b636602510 0x55b6365fabd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 >> 172.21.15.146:0/846604398 conn(0x55b6365d81f0 msgr2=0x55b636621130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f1282000640 0 client.6021 ms_handle_reset on v2:172.21.15.146:6833/1456962778 2024-04-24T23:02:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 shutdown_connections 2024-04-24T23:02:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 1 -- 172.21.15.146:0/846604398 wait complete. 2024-04-24T23:02:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.817+0000 7f129ea36740 20 client.6021 trim_cache size 0 max 16384 2024-04-24T23:02:31.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.837+0000 7f129ea36740 1 Processor -- start 2024-04-24T23:02:31.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.837+0000 7f129ea36740 1 -- start start 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12942005e0 con 0x55b6365fc8f0 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f12941ff940 con 0x55b63661fdb0 2024-04-24T23:02:31.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f12941fff90 con 0x55b636602510 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59042/0 (socket says 172.21.15.146:59042) 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.838+0000 7f1299200640 1 -- 172.21.15.146:0/2361486749 learned_addr learned my addr 172.21.15.146:0/2361486749 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f128be00640 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299c00640 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365d8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 -- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 msgr2=0x55b6365d85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365d85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 -- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 msgr2=0x55b6365d8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365d8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 -- 172.21.15.146:0/2361486749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6365cdb30 con 0x55b6365fc8f0 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1299200640 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1284076660 tx=0x7f128407c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e01c0b6f220b083 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1288c00640 1 -- 172.21.15.146:0/2361486749 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128404c040 con 0x55b6365fc8f0 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1288c00640 1 -- 172.21.15.146:0/2361486749 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284079130 con 0x55b6365fc8f0 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.839+0000 7f1288c00640 1 -- 172.21.15.146:0/2361486749 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284080040 con 0x55b6365fc8f0 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 -- 172.21.15.146:0/2361486749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 msgr2=0x55b63668e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1284076660 tx=0x7f128407c000 comp rx=0 tx=0).stop 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 -- 172.21.15.146:0/2361486749 shutdown_connections 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365d8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365d85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 --2- 172.21.15.146:0/2361486749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b63668e710 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 -- 172.21.15.146:0/2361486749 >> 172.21.15.146:0/2361486749 conn(0x55b6365d81f0 msgr2=0x55b63662ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 -- 172.21.15.146:0/2361486749 shutdown_connections 2024-04-24T23:02:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.840+0000 7f129ea36740 1 -- 172.21.15.146:0/2361486749 wait complete. 2024-04-24T23:02:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.841+0000 7f129ea36740 1 -- start start 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.841+0000 7f129ea36740 1 Processor -- start 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6364f6d20 con 0x55b6365fc8f0 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b636536db0 con 0x55b63661fdb0 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b6365fff30 con 0x55b636602510 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f129ea36740 10 client.0 _ll_register_callbacks cb 0x7f1284075f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f1299200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59046/0 (socket says 172.21.15.146:59046) 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.842+0000 7f1299200640 1 -- 172.21.15.146:0/2751771241 learned_addr learned my addr 172.21.15.146:0/2751771241 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 -- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 msgr2=0x55b6365fddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299c00640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 -- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 msgr2=0x55b6365fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 -- 172.21.15.146:0/2751771241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6365fe2f0 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1299200640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1284049070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e6aa184bb8bc1b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1282000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128404c040 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1284075c30 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1284079130 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f128408c050 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f129ea36740 10 client.6027 fetch_fsmap learned FSMap version 32 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.843+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x55b6365fe2f0 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284079130 con 0x55b6365fc8f0 2024-04-24T23:02:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 32) ==== 3494+0+0 (secure 0 0 0) 0x7f1284078ba0 con 0x55b6365fc8f0 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 10 client.6027 fetch_fsmap finished waiting for FSMap version 32 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 10 client.6027 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 20 client.6027 populate_metadata read hostname 'smithi146' 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b63668cc60 0x55b63668d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 4 client.6027 mds_command: new command op to 5898 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 --> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] -- command(tid 0: {"prefix": "status"}) -- 0x55b636542680 con 0x55b63668cc60 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.844+0000 7f128be00640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b63668cc60 0x55b63668d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f128be00640 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b63668cc60 0x55b63668d040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736d69f65adb8366 server_cookie=7f615908a2b52282 in_seq=0 out_seq=0 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f1282000640 10 client.6027 ms_handle_connect on v2:172.21.15.146:6833/1456962778 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f1282000640 1 -- 172.21.15.146:0/2751771241 <== mds.0 v2:172.21.15.146:6833/1456962778 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b636542680 con 0x55b63668cc60 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f1282000640 10 client.6027 handle_command_reply: tid=0 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 client.6027 shutdown 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 msgr2=0x55b636613830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f128400c290 tx=0x7f1284049070 comp rx=0 tx=0).stop 2024-04-24T23:02:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 shutdown_connections 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:6833/1456962778,v1:172.21.15.146:6835/1456962778] conn(0x55b63668cc60 0x55b63668d040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b63661fdb0 0x55b6365fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b636602510 0x55b6365fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 --2- 172.21.15.146:0/2751771241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6365fc8f0 0x55b636613830 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f1282000640 0 client.6027 ms_handle_reset on v2:172.21.15.146:6833/1456962778 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 >> 172.21.15.146:0/2751771241 conn(0x55b6365d81f0 msgr2=0x55b63662fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 shutdown_connections 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 1 -- 172.21.15.146:0/2751771241 wait complete. 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.845+0000 7f129ea36740 20 client.6027 trim_cache size 0 max 16384 2024-04-24T23:02:31.850 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5898, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 6.6456519590000003, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 32, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 54, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 54, 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.110709639 2024-04-24T23:02:31.851 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:02:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 msgr2=0x7f127006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 0x7f127006e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12940cf130 tx=0x7f127c008040 comp rx=0 tx=0).stop 2024-04-24T23:02:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 msgr2=0x7f12940cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1284034040 tx=0x7f12940714f0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 shutdown_connections 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f127006be60 0x7f127006e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1294149790 0x7f129415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12941f8260 0x7f1294159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 --2- 172.21.15.146:0/2386971775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12740039b0 0x7f12940cce90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 >> 172.21.15.146:0/2386971775 conn(0x7f129406b140 msgr2=0x7f129415b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 shutdown_connections 2024-04-24T23:02:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:31.846+0000 7f129bc00640 1 -- 172.21.15.146:0/2386971775 wait complete. 2024-04-24T23:02:31.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:02:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.063+0000 7f364e200640 1 Processor -- start 2024-04-24T23:02:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.063+0000 7f364e200640 1 -- start start 2024-04-24T23:02:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f364e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f364e200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36480b2a20 0x7f36480cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f364e200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480cdf70 con 0x7f364806cbc0 2024-04-24T23:02:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f364e200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f364815d360 con 0x7f36480b2a20 2024-04-24T23:02:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f364e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3648145a20 con 0x7f3648145640 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.065+0000 7f363ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36480b2a20 0x7f36480cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36480b2a20 0x7f36480cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59054/0 (socket says 172.21.15.146:59054) 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 -- 172.21.15.146:0/3702550880 learned_addr learned my addr 172.21.15.146:0/3702550880 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f3647400640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 -- 172.21.15.146:0/3702550880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 msgr2=0x7f364815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 -- 172.21.15.146:0/3702550880 >> v1:172.21.15.203:6789/0 conn(0x7f364806cbc0 legacy=0x7f364815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.066+0000 7f363ea00640 1 -- 172.21.15.146:0/3702550880 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364806d140 con 0x7f36480b2a20 2024-04-24T23:02:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.067+0000 7f363ea00640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36480b2a20 0x7f36480cfc90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3630009870 tx=0x7f363002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a57b759402f921c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f3646a00640 1 -- 172.21.15.146:0/3702550880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630037070 con 0x7f36480b2a20 2024-04-24T23:02:32.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f3646a00640 1 -- 172.21.15.146:0/3702550880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3630032440 con 0x7f36480b2a20 2024-04-24T23:02:32.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f3646a00640 1 -- 172.21.15.146:0/3702550880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630032810 con 0x7f36480b2a20 2024-04-24T23:02:32.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 -- 172.21.15.146:0/3702550880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36480b2a20 msgr2=0x7f36480cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36480b2a20 0x7f36480cfc90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3630009870 tx=0x7f363002a250 comp rx=0 tx=0).stop 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 -- 172.21.15.146:0/3702550880 shutdown_connections 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36480b2a20 0x7f36480cfc90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 --2- 172.21.15.146:0/3702550880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.068+0000 7f364e200640 1 -- 172.21.15.146:0/3702550880 >> 172.21.15.146:0/3702550880 conn(0x7f364806b320 msgr2=0x7f364806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.069+0000 7f364e200640 1 -- 172.21.15.146:0/3702550880 shutdown_connections 2024-04-24T23:02:32.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.069+0000 7f364e200640 1 -- 172.21.15.146:0/3702550880 wait complete. 2024-04-24T23:02:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.070+0000 7f364e200640 1 Processor -- start 2024-04-24T23:02:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.070+0000 7f364e200640 1 -- start start 2024-04-24T23:02:32.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36480b2a20 0x7f3648142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f364806d9e0 con 0x7f364806cbc0 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f364806d700 con 0x7f36480b2a20 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.071+0000 7f364e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36480d01d0 con 0x7f3648145640 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59056/0 (socket says 172.21.15.146:59056) 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 -- 172.21.15.146:0/198152345 learned_addr learned my addr 172.21.15.146:0/198152345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f363ea00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36480b2a20 0x7f3648142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647e00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 -- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 msgr2=0x7f364815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 -- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36480b2a20 msgr2=0x7f3648142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36480b2a20 0x7f3648142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647400640 1 -- 172.21.15.146:0/198152345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3648144640 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.072+0000 7f3647e00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f3647400640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f363800d5f0 tx=0x7f363800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380125f0 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638019070 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380129d0 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f364e200640 1 -- 172.21.15.146:0/198152345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481435a0 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.073+0000 7f364e200640 1 -- 172.21.15.146:0/198152345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3648143b60 con 0x7f364806cbc0 2024-04-24T23:02:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.074+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648068190 con 0x7f364806cbc0 2024-04-24T23:02:32.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.075+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3638012b70 con 0x7f364806cbc0 2024-04-24T23:02:32.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.076+0000 7f363fe00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 0x7f362406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:02:32.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.076+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f363808b3f0 con 0x7f364806cbc0 2024-04-24T23:02:32.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.077+0000 7f363ea00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 0x7f362406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:02:32.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.078+0000 7f363ea00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 0x7f362406e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3630034000 tx=0x7f363002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:02:32.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.081+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3638059c00 con 0x7f364806cbc0 2024-04-24T23:02:32.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.324+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f36481600f0 con 0x7f364806cbc0 2024-04-24T23:02:32.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.325+0000 7f363fe00640 1 -- 172.21.15.146:0/198152345 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7f3638059500 con 0x7f364806cbc0 2024-04-24T23:02:32.327 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:02:32.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 msgr2=0x7f362406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 0x7f362406e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3630034000 tx=0x7f363002e000 comp rx=0 tx=0).stop 2024-04-24T23:02:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 msgr2=0x7f3648138390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:02:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f363800d5f0 tx=0x7f363800dab0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 shutdown_connections 2024-04-24T23:02:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f362406be30 0x7f362406e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3648145640 0x7f364815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36480b2a20 0x7f3648142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 --2- 172.21.15.146:0/198152345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f364806cbc0 0x7f3648138390 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:02:32.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 >> 172.21.15.146:0/198152345 conn(0x7f364806b320 msgr2=0x7f36480aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:02:32.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.328+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 shutdown_connections 2024-04-24T23:02:32.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32.329+0000 7f363cc00640 1 -- 172.21.15.146:0/198152345 wait complete. 2024-04-24T23:02:32.349 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:02:32.349 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:02:32.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:02:32.349 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:02:32.350 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:32.350 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:02:32.350 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:02:32.350 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:02:32.350 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:32.351 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:02:32.404 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:02:32.404 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:02:32.404 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:02:32.404 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.405 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:02:32.405 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.405 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:32.405 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:32.405 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:02:32.406 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:32.406 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:32.406 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:02:32.406 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:02:32.406 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:32.407 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:02:32.407 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:32.407 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:02:32.407 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42483sec preferred_lft 42483sec 2024-04-24T23:02:32.408 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:02:32.408 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.408 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:02:32.408 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:02:32.408 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:02:32.409 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.409 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:02:32.409 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.409 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:02:32.409 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:02:32.410 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:02:32.410 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.410 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:02:32.410 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:02:32.410 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:02:32.411 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:02:32.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:32.411 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:02:32.493 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:02:32.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:32.497 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:02:32.553 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:02:32.553 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:02:32.553 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:02:32.553 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:02:32.554 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:02:32.554 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:02:32.554 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:02:32.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:02:32.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:02:32.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:02:32.555 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:02:32.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:02:32.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:32.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:32.770 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:02:32.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:02:32.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:02:32.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:32.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:32.820 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:02:32.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:02:32.904 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:32.958 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:02:32.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:02:32.958 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:33.012 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:02:33.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:33.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:33.139 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:33.140 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:02:33.174 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:02:33.175 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:02:33.175 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:02:33.175 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:02:33.175 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:02:33.177 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:02:33.177 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:02:33.177 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:02:33.177 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:02:33.177 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:02:33.181 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:02:33.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:02:33.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:33.260 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:02:33.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:02:33.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:02:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:02:33.385 INFO:teuthology.orchestra.run.smithi146.stdout:client5134 2024-04-24T23:02:33.385 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:02:33.385 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:02:33.435 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:02:33.435 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T23:02:33.436 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:33.531 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 23:02:25.203266452 +0000 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 23:02:33.254079935 +0000 2024-04-24T23:02:33.532 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 23:02:25.203266452 +0000 2024-04-24T23:02:33.533 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-24T23:02:33.533 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-24T23:02:33.632 INFO:tasks.workunit:timeout=1h 2024-04-24T23:02:33.632 INFO:tasks.workunit:cleanup=True 2024-04-24T23:02:33.633 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:02:33.693 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T23:02:43.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:43.821 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:13.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:13.951 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:44.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:44.079 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:50.320 INFO:tasks.workunit.client.0.smithi146.stderr:Updating files: 63% (7911/12492) Updating files: 64% (7995/12492) Updating files: 65% (8120/12492) Updating files: 66% (8245/12492) Updating files: 67% (8370/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 70% (8745/12492) Updating files: 71% (8870/12492) Updating files: 72% (8995/12492) Updating files: 73% (9120/12492) Updating files: 74% (9245/12492) Updating files: 75% (9369/12492) Updating files: 76% (9494/12492) Updating files: 77% (9619/12492) Updating files: 78% (9744/12492) Updating files: 79% (9869/12492) Updating files: 80% (9994/12492) Updating files: 81% (10119/12492) Updating files: 82% (10244/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 85% (10619/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 88% (10993/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-24T23:03:50.797 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.798 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2024-04-24T23:03:50.799 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.799 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T23:03:50.799 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:03:50.799 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-24T23:03:50.807 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T23:03:50.868 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T23:03:50.875 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:03:50.875 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T23:03:51.611 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T23:03:51.719 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T23:03:51.799 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:03:51.804 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:03:51.805 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T23:03:51.886 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:03:51.896 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:03:51.896 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T23:03:51.945 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-04-24T23:03:51.946 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-04-24T23:03:51.946 DEBUG:teuthology.orchestra.run.smithi146:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-04-24T23:03:53.763 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T23:03:53.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T23:03:53.871 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-04-24T23:03:53.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T23:03:54.958 DEBUG:teuthology.parallel:result is None 2024-04-24T23:03:54.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:03:55.050 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:03:55.050 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:03:55.051 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:03:55.101 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:03:55.101 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:03:55.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:03:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.391+0000 7f25a4a00640 1 Processor -- start 2024-04-24T23:03:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.391+0000 7f25a4a00640 1 -- start start 2024-04-24T23:03:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f25a4a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a00b5c70 0x7f25a0162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f25a4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f25a4a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a0161bd0 con 0x7f25a0147930 2024-04-24T23:03:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f25a4a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f25a0161f00 con 0x7f25a00b5c70 2024-04-24T23:03:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f25a4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f25a0072490 con 0x7f25a01628d0 2024-04-24T23:03:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f2597e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a00b5c70 0x7f25a0162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f259de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f25a0147930 0x7f25a0071c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54110/0 (socket says 172.21.15.146:54110) 2024-04-24T23:03:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.392+0000 7f259de00640 1 -- 172.21.15.146:0/3535941617 learned_addr learned my addr 172.21.15.146:0/3535941617 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.393+0000 7f2597e00640 1 -- 172.21.15.146:0/3535941617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 msgr2=0x7f25a006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.393+0000 7f2597e00640 1 --2- 172.21.15.146:0/3535941617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.393+0000 7f2597e00640 1 -- 172.21.15.146:0/3535941617 >> v1:172.21.15.146:6789/0 conn(0x7f25a0147930 legacy=0x7f25a0071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.393+0000 7f2597e00640 1 -- 172.21.15.146:0/3535941617 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a0072770 con 0x7f25a00b5c70 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.393+0000 7f259d400640 1 -- 172.21.15.146:0/3535941617 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358149124 0 0) 0x7f25a0161bd0 con 0x7f25a0147930 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.394+0000 7f2597e00640 1 --2- 172.21.15.146:0/3535941617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a0162390 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f25a0162080 tx=0x7f258802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8771e2c5edf935b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.394+0000 7f259d400640 1 -- 172.21.15.146:0/3535941617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588037070 con 0x7f25a00b5c70 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.394+0000 7f259d400640 1 -- 172.21.15.146:0/3535941617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2588032440 con 0x7f25a00b5c70 2024-04-24T23:03:55.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.394+0000 7f259d400640 1 -- 172.21.15.146:0/3535941617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588032810 con 0x7f25a00b5c70 2024-04-24T23:03:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 -- 172.21.15.146:0/3535941617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 msgr2=0x7f25a0162390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 --2- 172.21.15.146:0/3535941617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a0162390 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f25a0162080 tx=0x7f258802a180 comp rx=0 tx=0).stop 2024-04-24T23:03:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 -- 172.21.15.146:0/3535941617 shutdown_connections 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 --2- 172.21.15.146:0/3535941617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 --2- 172.21.15.146:0/3535941617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a0162390 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 -- 172.21.15.146:0/3535941617 >> 172.21.15.146:0/3535941617 conn(0x7f25a00b28a0 msgr2=0x7f25a00b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 -- 172.21.15.146:0/3535941617 shutdown_connections 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.395+0000 7f25a4a00640 1 -- 172.21.15.146:0/3535941617 wait complete. 2024-04-24T23:03:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.397+0000 7f25a4a00640 1 Processor -- start 2024-04-24T23:03:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.397+0000 7f25a4a00640 1 -- start start 2024-04-24T23:03:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a0147930 0x7f25a0160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a0160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25a006b800 con 0x7f25a00b5c70 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f25a006b680 con 0x7f25a0147930 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f25a4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f25a006b980 con 0x7f25a01628d0 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f259de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f259de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49128/0 (socket says 172.21.15.146:49128) 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.398+0000 7f259de00640 1 -- 172.21.15.146:0/1618538005 learned_addr learned my addr 172.21.15.146:0/1618538005 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 -- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 msgr2=0x7f25a0160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a0160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 -- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a0147930 msgr2=0x7f25a0160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a0147930 0x7f25a0160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 -- 172.21.15.146:0/1618538005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a01f70d0 con 0x7f25a00b5c70 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f259de00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f259000c4d0 tx=0x7f259000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590018070 con 0x7f25a00b5c70 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2590007500 con 0x7f25a00b5c70 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a01f73b0 con 0x7f25a00b5c70 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590004a20 con 0x7f25a00b5c70 2024-04-24T23:03:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.399+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01f7970 con 0x7f25a00b5c70 2024-04-24T23:03:55.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.401+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a00688a0 con 0x7f25a00b5c70 2024-04-24T23:03:55.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.402+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f259001b070 con 0x7f25a00b5c70 2024-04-24T23:03:55.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.403+0000 7f2596000640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.403+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f259008a3a0 con 0x7f25a00b5c70 2024-04-24T23:03:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.403+0000 7f2597e00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.404+0000 7f2597e00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 0x7f257c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2588034000 tx=0x7f258802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.407+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2590058b90 con 0x7f25a00b5c70 2024-04-24T23:03:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.606+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25a0142d40 con 0x7f25a00b5c70 2024-04-24T23:03:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.609+0000 7f2596000640 1 -- 172.21.15.146:0/1618538005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16954 (secure 0 0 0) 0x7f2590058490 con 0x7f25a00b5c70 2024-04-24T23:03:55.612 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:03:55.612 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:02:38.294720+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.5","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:03:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 msgr2=0x7f257c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 0x7f257c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2588034000 tx=0x7f258802c000 comp rx=0 tx=0).stop 2024-04-24T23:03:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 msgr2=0x7f25a013f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f259000c4d0 tx=0x7f259000c990 comp rx=0 tx=0).stop 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 shutdown_connections 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a01628d0 0x7f25a0160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a0147930 0x7f25a0160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 --2- 172.21.15.146:0/1618538005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00b5c70 0x7f25a013f590 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 >> 172.21.15.146:0/1618538005 conn(0x7f25a00b28a0 msgr2=0x7f25a00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 shutdown_connections 2024-04-24T23:03:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.612+0000 7f25a4a00640 1 -- 172.21.15.146:0/1618538005 wait complete. 2024-04-24T23:03:55.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:02:22.460061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:02:23.670988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:03:55.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:03:55.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.821+0000 7f7688c00640 1 Processor -- start 2024-04-24T23:03:55.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.821+0000 7f7688c00640 1 -- start start 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f768415e010 0x7f768406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 0x7f76840719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f768415e3f0 con 0x7f768415e010 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f768406cd20 con 0x7f7684071520 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7688c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f768415f440 con 0x7f768406e620 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7681e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f768415e010 0x7f768406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7681e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f768415e010 0x7f768406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49144/0 (socket says 172.21.15.146:49144) 2024-04-24T23:03:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7681e00640 1 -- 172.21.15.146:0/1286137836 learned_addr learned my addr 172.21.15.146:0/1286137836 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7679400640 1 --2- 172.21.15.146:0/1286137836 >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 0x7f76840719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.823+0000 7f7682800640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7681e00640 1 -- 172.21.15.146:0/1286137836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 msgr2=0x7f768406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7681e00640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768406ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7681e00640 1 -- 172.21.15.146:0/1286137836 >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 msgr2=0x7f76840719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7681e00640 1 --2- 172.21.15.146:0/1286137836 >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 0x7f76840719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7681e00640 1 -- 172.21.15.146:0/1286137836 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7684071fe0 con 0x7f768415e010 2024-04-24T23:03:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.824+0000 7f7679400640 1 --2- 172.21.15.146:0/1286137836 >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 0x7f76840719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:03:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.825+0000 7f7681e00640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768406dd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7674009870 tx=0x7f767402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aeb7fa84a9c57b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.825+0000 7f7681400640 1 -- 172.21.15.146:0/1286137836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674037070 con 0x7f768415e010 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.825+0000 7f7681400640 1 -- 172.21.15.146:0/1286137836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674032440 con 0x7f768415e010 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.825+0000 7f7681400640 1 -- 172.21.15.146:0/1286137836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674032810 con 0x7f768415e010 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 -- 172.21.15.146:0/1286137836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 msgr2=0x7f768406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768406dd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7674009870 tx=0x7f767402a210 comp rx=0 tx=0).stop 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 -- 172.21.15.146:0/1286137836 shutdown_connections 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 --2- 172.21.15.146:0/1286137836 >> v2:172.21.15.203:3300/0 conn(0x7f7684071520 0x7f76840719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 --2- 172.21.15.146:0/1286137836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768406dd80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 -- 172.21.15.146:0/1286137836 >> 172.21.15.146:0/1286137836 conn(0x7f76840b17b0 msgr2=0x7f76840b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 -- 172.21.15.146:0/1286137836 shutdown_connections 2024-04-24T23:03:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.826+0000 7f7688c00640 1 -- 172.21.15.146:0/1286137836 wait complete. 2024-04-24T23:03:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.827+0000 7f7688c00640 1 Processor -- start 2024-04-24T23:03:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.828+0000 7f7688c00640 1 -- start start 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.828+0000 7f7688c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.828+0000 7f7688c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 0x7f76840c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7688c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7688c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f768406d580 con 0x7f768415e010 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7688c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f768406d2a0 con 0x7f7684071520 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7688c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f768406d860 con 0x7f768406e620 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49160/0 (socket says 172.21.15.146:49160) 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 -- 172.21.15.146:0/3106962517 learned_addr learned my addr 172.21.15.146:0/3106962517 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7681e00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7679400640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 0x7f76840c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 -- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 msgr2=0x7f768414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 -- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 msgr2=0x7f76840c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 0x7f76840c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7682800640 1 -- 172.21.15.146:0/3106962517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768414c630 con 0x7f768415e010 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7681e00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.829+0000 7f7679400640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 0x7f76840c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f7682800640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f767c00cb80 tx=0x7f767c00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c015070 con 0x7f768415e010 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c00abd0 con 0x7f768415e010 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c00d040 con 0x7f768415e010 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768414c910 con 0x7f768415e010 2024-04-24T23:03:55.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.830+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768414ced0 con 0x7f768415e010 2024-04-24T23:03:55.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.831+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76840b3190 con 0x7f768415e010 2024-04-24T23:03:55.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.832+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f767c018070 con 0x7f768415e010 2024-04-24T23:03:55.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.833+0000 7f767aa00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:55.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.833+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f767c08acd0 con 0x7f768415e010 2024-04-24T23:03:55.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.834+0000 7f7681e00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:55.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.835+0000 7f7681e00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 0x7f766006e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7674034000 tx=0x7f767402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:55.838+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f767c059430 con 0x7f768415e010 2024-04-24T23:03:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.034+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f76840684c0 con 0x7f768415e010 2024-04-24T23:03:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.035+0000 7f767aa00640 1 -- 172.21.15.146:0/3106962517 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f767c058d30 con 0x7f768415e010 2024-04-24T23:03:56.037 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:03:56.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 msgr2=0x7f766006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 0x7f766006e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7674034000 tx=0x7f767402e000 comp rx=0 tx=0).stop 2024-04-24T23:03:56.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 msgr2=0x7f768415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f767c00cb80 tx=0x7f767c00a4c0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 shutdown_connections 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f768415e010 0x7f768415b3c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7684071520 0x7f76840c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 --2- 172.21.15.146:0/3106962517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f768406e620 0x7f768414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 >> 172.21.15.146:0/3106962517 conn(0x7f76840b17b0 msgr2=0x7f76840b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 shutdown_connections 2024-04-24T23:03:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.038+0000 7f7688c00640 1 -- 172.21.15.146:0/3106962517 wait complete. 2024-04-24T23:03:56.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:03:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.252+0000 7f851b200640 1 Processor -- start 2024-04-24T23:03:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.252+0000 7f851b200640 1 -- start start 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f851b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85140d03d0 0x7f8514166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f851b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85140b4df0 con 0x7f851415bcd0 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f851b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85140b4b10 con 0x7f851415cd60 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f851b200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f851415c8d0 con 0x7f85140d03d0 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f8519e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f851415bcd0 0x7f85140cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54120/0 (socket says 172.21.15.146:54120) 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f8519e00640 1 -- 172.21.15.146:0/2449155997 learned_addr learned my addr 172.21.15.146:0/2449155997 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:03:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.254+0000 7f851a800640 1 --2- 172.21.15.146:0/2449155997 >> v2:172.21.15.146:3300/0 conn(0x7f85140d03d0 0x7f8514166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.255+0000 7f8518a00640 1 -- 172.21.15.146:0/2449155997 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660315979 0 0) 0x7f85140b4df0 con 0x7f851415bcd0 2024-04-24T23:03:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.255+0000 7f8518a00640 1 -- 172.21.15.146:0/2449155997 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8500003520 con 0x7f851415bcd0 2024-04-24T23:03:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.255+0000 7f851a800640 1 -- 172.21.15.146:0/2449155997 >> v1:172.21.15.203:6789/0 conn(0x7f851415cd60 legacy=0x7f85140cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.255+0000 7f851a800640 1 -- 172.21.15.146:0/2449155997 >> v1:172.21.15.146:6789/0 conn(0x7f851415bcd0 legacy=0x7f85140cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.255+0000 7f851a800640 1 -- 172.21.15.146:0/2449155997 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851415c280 con 0x7f85140d03d0 2024-04-24T23:03:56.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.256+0000 7f851a800640 1 --2- 172.21.15.146:0/2449155997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f8514166a80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f85100097d0 tx=0x7f851002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f49a18638f1ecb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.256+0000 7f8518a00640 1 -- 172.21.15.146:0/2449155997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510037070 con 0x7f85140d03d0 2024-04-24T23:03:56.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.256+0000 7f8518a00640 1 -- 172.21.15.146:0/2449155997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8510032440 con 0x7f85140d03d0 2024-04-24T23:03:56.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.256+0000 7f8518a00640 1 -- 172.21.15.146:0/2449155997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85100327f0 con 0x7f85140d03d0 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 -- 172.21.15.146:0/2449155997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 msgr2=0x7f8514166a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 --2- 172.21.15.146:0/2449155997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f8514166a80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f85100097d0 tx=0x7f851002a200 comp rx=0 tx=0).stop 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 -- 172.21.15.146:0/2449155997 shutdown_connections 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 --2- 172.21.15.146:0/2449155997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f8514166a80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 -- 172.21.15.146:0/2449155997 >> 172.21.15.146:0/2449155997 conn(0x7f851406b560 msgr2=0x7f851406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 -- 172.21.15.146:0/2449155997 shutdown_connections 2024-04-24T23:03:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.257+0000 7f851b200640 1 -- 172.21.15.146:0/2449155997 wait complete. 2024-04-24T23:03:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.259+0000 7f851b200640 1 Processor -- start 2024-04-24T23:03:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.259+0000 7f851b200640 1 -- start start 2024-04-24T23:03:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851415bcd0 0x7f8514160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f851415cd60 0x7f85141f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85140b4790 con 0x7f85140d03d0 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f851406e590 con 0x7f851415bcd0 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f851b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8514166fc0 con 0x7f851415cd60 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49170/0 (socket says 172.21.15.146:49170) 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519e00640 1 -- 172.21.15.146:0/2827234348 learned_addr learned my addr 172.21.15.146:0/2827234348 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519400640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851415bcd0 0x7f8514160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519e00640 1 -- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f851415cd60 msgr2=0x7f85141f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.260+0000 7f8519e00640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f851415cd60 0x7f85141f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f8519e00640 1 -- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851415bcd0 msgr2=0x7f8514160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f8519e00640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851415bcd0 0x7f8514160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f8519e00640 1 -- 172.21.15.146:0/2827234348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85140713b0 con 0x7f85140d03d0 2024-04-24T23:03:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f8519e00640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f850c001460 tx=0x7f850c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c017070 con 0x7f85140d03d0 2024-04-24T23:03:56.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850c00ad00 con 0x7f85140d03d0 2024-04-24T23:03:56.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851414eda0 con 0x7f85140d03d0 2024-04-24T23:03:56.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c012640 con 0x7f85140d03d0 2024-04-24T23:03:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.261+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851414f6a0 con 0x7f85140d03d0 2024-04-24T23:03:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.262+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851404f500 con 0x7f85140d03d0 2024-04-24T23:03:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.263+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f850c01a070 con 0x7f85140d03d0 2024-04-24T23:03:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.265+0000 7f850a000640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.265+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f850c08aee0 con 0x7f85140d03d0 2024-04-24T23:03:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.265+0000 7f8519400640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.267+0000 7f8519400640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 0x7f84f806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8514072950 tx=0x7f8504009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.269+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85140713b0 con 0x7f85140d03d0 2024-04-24T23:03:56.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.468+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f85140cf030 con 0x7f85140d03d0 2024-04-24T23:03:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.469+0000 7f850a000640 1 -- 172.21.15.146:0/2827234348 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) ==== 104+0+11 (secure 0 0 0) 0x7f850c059640 con 0x7f85140d03d0 2024-04-24T23:03:56.471 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 msgr2=0x7f84f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 0x7f84f806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8514072950 tx=0x7f8504009040 comp rx=0 tx=0).stop 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 msgr2=0x7f851414f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f850c001460 tx=0x7f850c00a430 comp rx=0 tx=0).stop 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 shutdown_connections 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f84f806be30 0x7f84f806e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f851415cd60 0x7f85141f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f851415bcd0 0x7f8514160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 --2- 172.21.15.146:0/2827234348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85140d03d0 0x7f851414f080 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 >> 172.21.15.146:0/2827234348 conn(0x7f851406b560 msgr2=0x7f851406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 shutdown_connections 2024-04-24T23:03:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.472+0000 7f851b200640 1 -- 172.21.15.146:0/2827234348 wait complete. 2024-04-24T23:03:56.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:03:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.692+0000 7f2eab200640 1 Processor -- start 2024-04-24T23:03:56.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.692+0000 7f2eab200640 1 -- start start 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eab200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2eac0726b0 0x7f2eac06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eab200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2eac06c3d0 0x7f2eac15f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eab200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eac06bf20 con 0x7f2eac06cd80 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eab200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac072ce0 con 0x7f2eac06c3d0 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eab200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac072fc0 con 0x7f2eac0726b0 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eaa800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2eac06c3d0 0x7f2eac15f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eaa800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2eac06c3d0 0x7f2eac15f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49186/0 (socket says 172.21.15.146:49186) 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.694+0000 7f2eaa800640 1 -- 172.21.15.146:0/3902232603 learned_addr learned my addr 172.21.15.146:0/3902232603 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:56.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.695+0000 7f2ea9400640 1 --2- 172.21.15.146:0/3902232603 >> v2:172.21.15.203:3300/0 conn(0x7f2eac0726b0 0x7f2eac06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.695+0000 7f2eaa800640 1 -- 172.21.15.146:0/3902232603 >> v2:172.21.15.203:3300/0 conn(0x7f2eac0726b0 msgr2=0x7f2eac06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.695+0000 7f2eaa800640 1 --2- 172.21.15.146:0/3902232603 >> v2:172.21.15.203:3300/0 conn(0x7f2eac0726b0 0x7f2eac06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.695+0000 7f2eaa800640 1 -- 172.21.15.146:0/3902232603 >> v1:172.21.15.203:6789/0 conn(0x7f2eac06cd80 legacy=0x7f2eac06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.695+0000 7f2eaa800640 1 -- 172.21.15.146:0/3902232603 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac06b1e0 con 0x7f2eac06c3d0 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.696+0000 7f2eaa800640 1 --2- 172.21.15.146:0/3902232603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac06c3d0 0x7f2eac15f8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2eac067580 tx=0x7f2ea402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cc7ea49fed7b2e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.696+0000 7f2ea8a00640 1 -- 172.21.15.146:0/3902232603 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4036070 con 0x7f2eac06c3d0 2024-04-24T23:03:56.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2ea8a00640 1 -- 172.21.15.146:0/3902232603 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4031600 con 0x7f2eac06c3d0 2024-04-24T23:03:56.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2ea8a00640 1 -- 172.21.15.146:0/3902232603 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40319d0 con 0x7f2eac06c3d0 2024-04-24T23:03:56.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 -- 172.21.15.146:0/3902232603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac06c3d0 msgr2=0x7f2eac15f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 --2- 172.21.15.146:0/3902232603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac06c3d0 0x7f2eac15f8e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2eac067580 tx=0x7f2ea402a660 comp rx=0 tx=0).stop 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 -- 172.21.15.146:0/3902232603 shutdown_connections 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 --2- 172.21.15.146:0/3902232603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac06c3d0 0x7f2eac15f8e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 --2- 172.21.15.146:0/3902232603 >> v2:172.21.15.203:3300/0 conn(0x7f2eac0726b0 0x7f2eac06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 -- 172.21.15.146:0/3902232603 >> 172.21.15.146:0/3902232603 conn(0x7f2eac0b28e0 msgr2=0x7f2eac0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 -- 172.21.15.146:0/3902232603 shutdown_connections 2024-04-24T23:03:56.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.697+0000 7f2eab200640 1 -- 172.21.15.146:0/3902232603 wait complete. 2024-04-24T23:03:56.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.699+0000 7f2eab200640 1 Processor -- start 2024-04-24T23:03:56.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.699+0000 7f2eab200640 1 -- start start 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2eac06c3d0 0x7f2eac1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eac06cd80 0x7f2eac0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac15c020 con 0x7f2eac0726b0 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0732a0 con 0x7f2eac06cd80 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eab200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac15c1a0 con 0x7f2eac06c3d0 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.700+0000 7f2eaa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49188/0 (socket says 172.21.15.146:49188) 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 -- 172.21.15.146:0/4253179263 learned_addr learned my addr 172.21.15.146:0/4253179263 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2ea9400640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eac06cd80 0x7f2eac0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 -- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2eac06c3d0 msgr2=0x7f2eac1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2eac06c3d0 0x7f2eac1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 -- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eac06cd80 msgr2=0x7f2eac0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eac06cd80 0x7f2eac0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 -- 172.21.15.146:0/4253179263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac15deb0 con 0x7f2eac0726b0 2024-04-24T23:03:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.701+0000 7f2eaa800640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009f40 tx=0x7f2ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.702+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4036050 con 0x7f2eac0726b0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.702+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4042070 con 0x7f2eac0726b0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.702+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4009510 con 0x7f2eac0726b0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.702+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac15e190 con 0x7f2eac0726b0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.702+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac15e750 con 0x7f2eac0726b0 2024-04-24T23:03:56.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.703+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac04f500 con 0x7f2eac0726b0 2024-04-24T23:03:56.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.704+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ea4007bd0 con 0x7f2eac0726b0 2024-04-24T23:03:56.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.705+0000 7f2ea2000640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 0x7f2e8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:56.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.705+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f2ea40abf70 con 0x7f2eac0726b0 2024-04-24T23:03:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.705+0000 7f2ea9e00640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 0x7f2e8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.706+0000 7f2ea9e00640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 0x7f2e8c06e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c003cc0 tx=0x7f2e9c0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.709+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2ea407a6d0 con 0x7f2eac0726b0 2024-04-24T23:03:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.906+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2eac06de20 con 0x7f2eac0726b0 2024-04-24T23:03:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.907+0000 7f2ea2000640 1 -- 172.21.15.146:0/4253179263 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) ==== 100+0+11 (secure 0 0 0) 0x7f2ea4079fd0 con 0x7f2eac0726b0 2024-04-24T23:03:56.909 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:03:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 msgr2=0x7f2e8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 0x7f2e8c06e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c003cc0 tx=0x7f2e9c0079b0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 msgr2=0x7f2eac147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009f40 tx=0x7f2ea4004a40 comp rx=0 tx=0).stop 2024-04-24T23:03:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 shutdown_connections 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eac0726b0 0x7f2eac147b00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eac06cd80 0x7f2eac0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2e8c06be30 0x7f2e8c06e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 --2- 172.21.15.146:0/4253179263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2eac06c3d0 0x7f2eac1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 >> 172.21.15.146:0/4253179263 conn(0x7f2eac0b28e0 msgr2=0x7f2eac0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 shutdown_connections 2024-04-24T23:03:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:56.909+0000 7f2eab200640 1 -- 172.21.15.146:0/4253179263 wait complete. 2024-04-24T23:03:56.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:03:57.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.126+0000 7f6d73e00640 1 Processor -- start 2024-04-24T23:03:57.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.126+0000 7f6d73e00640 1 -- start start 2024-04-24T23:03:57.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d73e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d7415bdc0 0x7f6d74072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d73e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d7415c1a0 con 0x7f6d7415cd80 2024-04-24T23:03:57.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d73e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d7415d210 con 0x7f6d740aef40 2024-04-24T23:03:57.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d73e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d740cc5d0 con 0x7f6d7415bdc0 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d72000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6d7415cd80 0x7f6d740ae830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54122/0 (socket says 172.21.15.146:54122) 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d72000640 1 -- 172.21.15.146:0/627960961 learned_addr learned my addr 172.21.15.146:0/627960961 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.128+0000 7f6d72a00640 1 --2- 172.21.15.146:0/627960961 >> v2:172.21.15.203:3300/0 conn(0x7f6d7415bdc0 0x7f6d74072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340826498 0 0) 0x7f6d7415c1a0 con 0x7f6d7415cd80 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d58003520 con 0x7f6d7415cd80 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 369008706 0 0) 0x7f6d58003520 con 0x7f6d7415cd80 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 >> v2:172.21.15.203:3300/0 conn(0x7f6d7415bdc0 msgr2=0x7f6d74072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 --2- 172.21.15.146:0/627960961 >> v2:172.21.15.203:3300/0 conn(0x7f6d7415bdc0 0x7f6d74072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 >> v1:172.21.15.203:6789/0 conn(0x7f6d740aef40 legacy=0x7f6d740cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d74072c70 con 0x7f6d7415cd80 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6d60001670 con 0x7f6d7415cd80 2024-04-24T23:03:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 >> v1:172.21.15.146:6789/0 conn(0x7f6d7415cd80 legacy=0x7f6d740ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 0x7f6d58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58004800 0x7f6d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580051c0 0x7f6d5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740cc5d0 con 0x7f6d580039b0 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5800c160 con 0x7f6d58004800 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.129+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5800c360 con 0x7f6d580051c0 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 0x7f6d58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 -- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580051c0 msgr2=0x7f6d5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580051c0 0x7f6d5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 -- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58004800 msgr2=0x7f6d58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58004800 0x7f6d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d72a00640 1 -- 172.21.15.146:0/627960961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d58003520 con 0x7f6d580039b0 2024-04-24T23:03:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.130+0000 7f6d73400640 1 -- 172.21.15.146:0/627960961 reap_dead start 2024-04-24T23:03:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.131+0000 7f6d72a00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 0x7f6d58003dd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009ac0 tx=0x7f6d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45c29a84bf910ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.131+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64036070 con 0x7f6d580039b0 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.131+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64031400 con 0x7f6d580039b0 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.131+0000 7f6d71600640 1 -- 172.21.15.146:0/627960961 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64009690 con 0x7f6d580039b0 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 -- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 msgr2=0x7f6d58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 0x7f6d58003dd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009ac0 tx=0x7f6d58005830 comp rx=0 tx=0).stop 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 -- 172.21.15.146:0/627960961 shutdown_connections 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 --2- 172.21.15.146:0/627960961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d580039b0 0x7f6d58003dd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 -- 172.21.15.146:0/627960961 >> 172.21.15.146:0/627960961 conn(0x7f6d740b1560 msgr2=0x7f6d740b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 -- 172.21.15.146:0/627960961 shutdown_connections 2024-04-24T23:03:57.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.132+0000 7f6d73e00640 1 -- 172.21.15.146:0/627960961 wait complete. 2024-04-24T23:03:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.134+0000 7f6d73e00640 1 Processor -- start 2024-04-24T23:03:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.134+0000 7f6d73e00640 1 -- start start 2024-04-24T23:03:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d580039b0 0x7f6d740ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d740c4c50 0x7f6d7414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74070de0 con 0x7f6d740c47d0 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740cf6b0 con 0x7f6d580039b0 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d73e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740710c0 con 0x7f6d740c4c50 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d72000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d72000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49204/0 (socket says 172.21.15.146:49204) 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.135+0000 7f6d72000640 1 -- 172.21.15.146:0/1088135062 learned_addr learned my addr 172.21.15.146:0/1088135062 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 -- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d740c4c50 msgr2=0x7f6d7414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d740c4c50 0x7f6d7414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 -- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d580039b0 msgr2=0x7f6d740ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d580039b0 0x7f6d740ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 -- 172.21.15.146:0/1088135062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740ab090 con 0x7f6d740c47d0 2024-04-24T23:03:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d72000640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c870 tx=0x7f6d6000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60018070 con 0x7f6d740c47d0 2024-04-24T23:03:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d600074e0 con 0x7f6d740c47d0 2024-04-24T23:03:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d600049e0 con 0x7f6d740c47d0 2024-04-24T23:03:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d740a9ff0 con 0x7f6d740c47d0 2024-04-24T23:03:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.136+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d740aa5b0 con 0x7f6d740c47d0 2024-04-24T23:03:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.138+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7404f500 con 0x7f6d740c47d0 2024-04-24T23:03:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.139+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d60004b80 con 0x7f6d740c47d0 2024-04-24T23:03:57.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.139+0000 7f6d6aa00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 0x7f6d5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:57.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.140+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f6d6008a5f0 con 0x7f6d740c47d0 2024-04-24T23:03:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.140+0000 7f6d72a00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 0x7f6d5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.141+0000 7f6d72a00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 0x7f6d5406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d64033000 tx=0x7f6d6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:57.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.144+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6d60058de0 con 0x7f6d740c47d0 2024-04-24T23:03:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.352+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d740aeb80 con 0x7f6d740c47d0 2024-04-24T23:03:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.353+0000 7f6d6aa00640 1 -- 172.21.15.146:0/1088135062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) ==== 80+0+0 (secure 0 0 0) 0x7f6d600586e0 con 0x7f6d740c47d0 2024-04-24T23:03:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:03:57.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.355+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 msgr2=0x7f6d5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.355+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 0x7f6d5406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d64033000 tx=0x7f6d6402e000 comp rx=0 tx=0).stop 2024-04-24T23:03:57.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.355+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 msgr2=0x7f6d7414a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.355+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c870 tx=0x7f6d6000cd30 comp rx=0 tx=0).stop 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 shutdown_connections 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6d5406be30 0x7f6d5406e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d740c4c50 0x7f6d7414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d740c47d0 0x7f6d7414a100 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 --2- 172.21.15.146:0/1088135062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d580039b0 0x7f6d740ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:57.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 >> 172.21.15.146:0/1088135062 conn(0x7f6d740b1560 msgr2=0x7f6d7406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:57.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 shutdown_connections 2024-04-24T23:03:57.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:57.356+0000 7f6d73e00640 1 -- 172.21.15.146:0/1088135062 wait complete. 2024-04-24T23:03:57.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:03:57.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:03:57.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:03:57.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:03:57.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:03:57.510 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:03:57.561 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:03:57.561 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:03:57.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:03:57.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:03:57.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:03:57.603 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-24T23:03:57.684 INFO:teuthology.orchestra.run.smithi203.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-24T23:03:57.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:03:57.686 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:03:57.686 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:03:57.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:03:57.738 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:03:57.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:03:57.738 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-24T23:03:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-24T23:03:57.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:03:57.783 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:03:57.783 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:03:57.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:03:57.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:03:57.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:03:57.839 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-24T23:03:57.889 INFO:teuthology.orchestra.run.smithi203.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-24T23:03:57.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:03:57.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:03:58.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.101+0000 7f4e66000640 1 Processor -- start 2024-04-24T23:03:58.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.101+0000 7f4e66000640 1 -- start start 2024-04-24T23:03:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.103+0000 7f4e66000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4e600aee30 0x7f4e60072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.103+0000 7f4e66000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.103+0000 7f4e66000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e600af210 con 0x7f4e600b3550 2024-04-24T23:03:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.103+0000 7f4e66000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4e60072c60 con 0x7f4e600aee30 2024-04-24T23:03:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.103+0000 7f4e66000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e60071040 con 0x7f4e60161cb0 2024-04-24T23:03:58.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.104+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.104+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:33622/0 (socket says 172.21.15.146:33622) 2024-04-24T23:03:58.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.104+0000 7f4e5fe00640 1 -- 172.21.15.146:0/911353804 learned_addr learned my addr 172.21.15.146:0/911353804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:58.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.104+0000 7f4e5f400640 1 --2- 172.21.15.146:0/911353804 >> v2:172.21.15.203:3300/0 conn(0x7f4e600aee30 0x7f4e60072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.105+0000 7f4e5fe00640 1 -- 172.21.15.146:0/911353804 >> v2:172.21.15.203:3300/0 conn(0x7f4e600aee30 msgr2=0x7f4e60072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:03:58.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.105+0000 7f4e5fe00640 1 --2- 172.21.15.146:0/911353804 >> v2:172.21.15.203:3300/0 conn(0x7f4e600aee30 0x7f4e60072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.105+0000 7f4e5fe00640 1 -- 172.21.15.146:0/911353804 >> v1:172.21.15.203:6789/0 conn(0x7f4e600b3550 legacy=0x7f4e60071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.105+0000 7f4e5fe00640 1 -- 172.21.15.146:0/911353804 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60071320 con 0x7f4e60161cb0 2024-04-24T23:03:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.106+0000 7f4e5fe00640 1 --2- 172.21.15.146:0/911353804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009e50 tx=0x7f4e5802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78d580a62ec610 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.107+0000 7f4e5ea00640 1 -- 172.21.15.146:0/911353804 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58036070 con 0x7f4e60161cb0 2024-04-24T23:03:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.107+0000 7f4e5ea00640 1 -- 172.21.15.146:0/911353804 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e58031600 con 0x7f4e60161cb0 2024-04-24T23:03:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.107+0000 7f4e5ea00640 1 -- 172.21.15.146:0/911353804 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580319d0 con 0x7f4e60161cb0 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 -- 172.21.15.146:0/911353804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 msgr2=0x7f4e60162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 --2- 172.21.15.146:0/911353804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009e50 tx=0x7f4e5802a680 comp rx=0 tx=0).stop 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 -- 172.21.15.146:0/911353804 shutdown_connections 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 --2- 172.21.15.146:0/911353804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e60161cb0 0x7f4e60162140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 --2- 172.21.15.146:0/911353804 >> v2:172.21.15.203:3300/0 conn(0x7f4e600aee30 0x7f4e60072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 -- 172.21.15.146:0/911353804 >> 172.21.15.146:0/911353804 conn(0x7f4e6006b140 msgr2=0x7f4e6006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 -- 172.21.15.146:0/911353804 shutdown_connections 2024-04-24T23:03:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.108+0000 7f4e66000640 1 -- 172.21.15.146:0/911353804 wait complete. 2024-04-24T23:03:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.110+0000 7f4e66000640 1 Processor -- start 2024-04-24T23:03:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.111+0000 7f4e66000640 1 -- start start 2024-04-24T23:03:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e600aee30 0x7f4e60150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 0x7f4e600cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600b39c0 con 0x7f4e60161cb0 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e60070d10 con 0x7f4e600b3550 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e66000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e600cc830 con 0x7f4e600aee30 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48002/0 (socket says 172.21.15.146:48002) 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e5fe00640 1 -- 172.21.15.146:0/1942702319 learned_addr learned my addr 172.21.15.146:0/1942702319 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e5f400640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e600aee30 0x7f4e60150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.112+0000 7f4e57e00640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 0x7f4e600cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 -- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e600aee30 msgr2=0x7f4e60150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e600aee30 0x7f4e60150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 -- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 msgr2=0x7f4e600cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 0x7f4e600cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 -- 172.21.15.146:0/1942702319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e600ccb10 con 0x7f4e60161cb0 2024-04-24T23:03:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e57e00640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 0x7f4e600cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e5fe00640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4e58034040 tx=0x7f4e58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58041020 con 0x7f4e60161cb0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e580077a0 con 0x7f4e60161cb0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58036040 con 0x7f4e60161cb0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.113+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e600ccdf0 con 0x7f4e60161cb0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.114+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e600cd3b0 con 0x7f4e60161cb0 2024-04-24T23:03:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.115+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e600b14d0 con 0x7f4e60161cb0 2024-04-24T23:03:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.116+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e58044020 con 0x7f4e60161cb0 2024-04-24T23:03:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.117+0000 7f4e57400640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 0x7f4e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:03:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.117+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6130+0+0 (secure 0 0 0) 0x7f4e580abd20 con 0x7f4e60161cb0 2024-04-24T23:03:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.118+0000 7f4e5f400640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 0x7f4e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:03:58.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.119+0000 7f4e5f400640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 0x7f4e3c06e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009a30 tx=0x7f4e50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:03:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.122+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4e600b14d0 con 0x7f4e60161cb0 2024-04-24T23:03:58.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.362+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4e600cbb70 con 0x7f4e60161cb0 2024-04-24T23:03:58.365 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:03:58.364+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:03:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.367+0000 7f4e57400640 1 -- 172.21.15.146:0/1942702319 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f4e5804b030 con 0x7f4e60161cb0 2024-04-24T23:03:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 msgr2=0x7f4e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 0x7f4e3c06e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009a30 tx=0x7f4e50008040 comp rx=0 tx=0).stop 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 msgr2=0x7f4e600cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4e58034040 tx=0x7f4e58004a40 comp rx=0 tx=0).stop 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 shutdown_connections 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e60161cb0 0x7f4e600cd910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e600b3550 0x7f4e600cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4e3c06be30 0x7f4e3c06e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 --2- 172.21.15.146:0/1942702319 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e600aee30 0x7f4e60150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:03:58.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.371+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 >> 172.21.15.146:0/1942702319 conn(0x7f4e6006b140 msgr2=0x7f4e600b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:03:58.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.374+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 shutdown_connections 2024-04-24T23:03:58.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:03:58.374+0000 7f4e66000640 1 -- 172.21.15.146:0/1942702319 wait complete. 2024-04-24T23:03:58.396 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:03:58.396 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T23:03:58.396 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:03:58.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:03:58.437 INFO:teuthology.orchestra.run.smithi146.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-24T23:03:58.437 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:03:58.446 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:03:58.482 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-24T23:03:58.483 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-24T23:03:58.568 INFO:tasks.workunit:timeout=1h 2024-04-24T23:03:58.568 INFO:tasks.workunit:cleanup=True 2024-04-24T23:03:58.568 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:03:58.667 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T23:04:14.272 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:14.281 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:44.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:44.494 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:14.382 INFO:tasks.workunit.client.0.smithi146.stderr:Updating files: 62% (7796/12492) Updating files: 63% (7870/12492) Updating files: 64% (7995/12492) Updating files: 65% (8120/12492) Updating files: 66% (8245/12492) Updating files: 67% (8370/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 70% (8745/12492) Updating files: 71% (8870/12492) Updating files: 72% (8995/12492) Updating files: 73% (9120/12492) Updating files: 74% (9245/12492) Updating files: 75% (9369/12492) Updating files: 76% (9494/12492) Updating files: 77% (9619/12492) Updating files: 78% (9744/12492) Updating files: 79% (9869/12492) Updating files: 80% (9994/12492) Updating files: 81% (10119/12492) Updating files: 82% (10244/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 85% (10619/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 88% (10993/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-24T23:05:14.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:14.630 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.015 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:05:15.016 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-24T23:05:15.023 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T23:05:15.071 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T23:05:15.078 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:05:15.078 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T23:05:15.170 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T23:05:15.261 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T23:05:15.344 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:05:15.350 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:05:15.350 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T23:05:15.431 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:05:15.441 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:05:15.441 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T23:05:15.537 INFO:tasks.workunit:Running workunits matching suites/cephfs_journal_tool_smoke.sh on client.0... 2024-04-24T23:05:15.538 INFO:tasks.workunit:Running workunit suites/cephfs_journal_tool_smoke.sh... 2024-04-24T23:05:15.539 DEBUG:teuthology.orchestra.run.smithi146:workunit test suites/cephfs_journal_tool_smoke.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/cephfs_journal_tool_smoke.sh 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ export 'BIN=cephfs-journal-tool --rank=cephfs:0' 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ BIN='cephfs-journal-tool --rank=cephfs:0' 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ export JOURNAL_FILE=/tmp/journal.bin 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ JOURNAL_FILE=/tmp/journal.bin 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ export JSON_OUTPUT=/tmp/json.tmp 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ JSON_OUTPUT=/tmp/json.tmp 2024-04-24T23:05:15.606 INFO:tasks.workunit.client.0.smithi146.stderr:+ export BINARY_OUTPUT=/tmp/binary.tmp 2024-04-24T23:05:15.607 INFO:tasks.workunit.client.0.smithi146.stderr:+ BINARY_OUTPUT=/tmp/binary.tmp 2024-04-24T23:05:15.607 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' -d /tmp/binary.tmp ']' 2024-04-24T23:05:15.607 INFO:tasks.workunit.client.0.smithi146.stdout:Testing that export/import cycle preserves state 2024-04-24T23:05:15.607 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Testing that export/import cycle preserves state' 2024-04-24T23:05:15.607 INFO:tasks.workunit.client.0.smithi146.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-04-24T23:05:15.656 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.654+0000 7f5797a7a280 1 -- start start 2024-04-24T23:05:15.656 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.654+0000 7f5797a7a280 1 Processor -- start 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e77882c00 0x557e778ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e77883c00 0x557e778ef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557e785e4180 con 0x557e77883800 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e785e4300 con 0x557e77883c00 2024-04-24T23:05:15.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557e785e4480 con 0x557e77882c00 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34368/0 (socket says 172.21.15.146:34368) 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 -- 172.21.15.146:0/2010108596 learned_addr learned my addr 172.21.15.146:0/2010108596 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 -- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e77882c00 msgr2=0x557e778ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e77882c00 0x557e778ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 -- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e77883c00 msgr2=0x557e778ef080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e77883c00 0x557e778ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.655+0000 7f5795200640 1 -- 172.21.15.146:0/2010108596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e778b6780 con 0x557e77883800 2024-04-24T23:05:15.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5795200640 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557e786a2b40 tx=0x557e78614c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3260dae6a003f11a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5792a00640 1 -- 172.21.15.146:0/2010108596 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a89c0 con 0x557e77883800 2024-04-24T23:05:15.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5792a00640 1 -- 172.21.15.146:0/2010108596 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557e778aefc0 con 0x557e77883800 2024-04-24T23:05:15.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5792a00640 1 -- 172.21.15.146:0/2010108596 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a8680 con 0x557e77883800 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e778b6000 con 0x557e77883800 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x557e778b63c0 con 0x557e77883800 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5792a00640 1 -- 172.21.15.146:0/2010108596 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x557e77968a00 con 0x557e77883800 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.656+0000 7f5792a00640 1 -- 172.21.15.146:0/2010108596 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x557e778dd180 con 0x557e77883800 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.657+0000 7f5797a7a280 1 Processor -- start 2024-04-24T23:05:15.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.657+0000 7f5797a7a280 1 -- start start 2024-04-24T23:05:15.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778efb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557e785e4600 con 0x557e787b4000 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e785e4780 con 0x557e787b4400 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557e785e4900 con 0x557e787b4800 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5796600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5796600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34380/0 (socket says 172.21.15.146:34380) 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.658+0000 7f5796600640 1 -- 172.21.15.146:0/1656853773 learned_addr learned my addr 172.21.15.146:0/1656853773 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 -- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 msgr2=0x557e778f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 -- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 msgr2=0x557e778efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 -- 172.21.15.146:0/1656853773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e778b6960 con 0x557e787b4000 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5796600640 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x557e7875e4b0 tx=0x557e78762c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb982f63ba45ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5790200640 1 -- 172.21.15.146:0/1656853773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a89c0 con 0x557e787b4000 2024-04-24T23:05:15.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5790200640 1 -- 172.21.15.146:0/1656853773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557e778aec40 con 0x557e787b4000 2024-04-24T23:05:15.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.659+0000 7f5790200640 1 -- 172.21.15.146:0/1656853773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a8680 con 0x557e787b4000 2024-04-24T23:05:15.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 -- 172.21.15.146:0/1656853773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 msgr2=0x557e778ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x557e7875e4b0 tx=0x557e78762c00 comp rx=0 tx=0).stop 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 -- 172.21.15.146:0/1656853773 shutdown_connections 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 --2- 172.21.15.146:0/1656853773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778ef600 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 -- 172.21.15.146:0/1656853773 >> 172.21.15.146:0/1656853773 conn(0x557e78669c00 msgr2=0x557e77973800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 -- 172.21.15.146:0/1656853773 shutdown_connections 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.660+0000 7f5797a7a280 1 -- 172.21.15.146:0/1656853773 wait complete. 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.661+0000 7f5797a7a280 1 Processor -- start 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.661+0000 7f5797a7a280 1 -- start start 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557e785e5980 con 0x557e787b4000 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e785e4300 con 0x557e787b4400 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5797a7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557e785e4c00 con 0x557e787b4800 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34386/0 (socket says 172.21.15.146:34386) 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 -- 172.21.15.146:0/905525614 learned_addr learned my addr 172.21.15.146:0/905525614 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5795200640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5795c00640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 msgr2=0x557e778f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e787b4800 0x557e778f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 msgr2=0x557e778f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e787b4400 0x557e778f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.662+0000 7f5796600640 1 -- 172.21.15.146:0/905525614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e778b74a0 con 0x557e787b4000 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f5796600640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778f1180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x557e7875f770 tx=0x557e78612300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f578e400640 1 -- 172.21.15.146:0/905525614 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a84e0 con 0x557e787b4000 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f578e400640 1 -- 172.21.15.146:0/905525614 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557e778ae1c0 con 0x557e787b4000 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e778b7680 con 0x557e787b4000 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f578e400640 1 -- 172.21.15.146:0/905525614 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557e778a89c0 con 0x557e787b4000 2024-04-24T23:05:15.667 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.663+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e778b7860 con 0x557e787b4000 2024-04-24T23:05:15.668 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.665+0000 7f578e400640 1 -- 172.21.15.146:0/905525614 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x557e787c0c00 con 0x557e787b4000 2024-04-24T23:05:15.668 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.665+0000 7f578e400640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557e787ce400 0x557e778f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.668 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.665+0000 7f578e400640 1 -- 172.21.15.146:0/905525614 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x557e787baa00 con 0x557e787b4000 2024-04-24T23:05:15.668 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.665+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557e787b4c00 0x557e778f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.665+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x557e787b5000 con 0x557e787b4c00 2024-04-24T23:05:15.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.666+0000 7f5795c00640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557e787ce400 0x557e778f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.666+0000 7f5795200640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557e787b4c00 0x557e778f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.667+0000 7f5795200640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557e787b4c00 0x557e778f0100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.667+0000 7f5795c00640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557e787ce400 0x557e778f1700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e785fc9c0 tx=0x557e77c000c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.670 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.669+0000 7f5795200640 1 -- 172.21.15.146:0/905525614 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x557e78602000 con 0x557e787b4c00 2024-04-24T23:05:15.670 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.669+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557e787cf400 0x557e778efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.670 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.669+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x557e787cf800 con 0x557e787cf400 2024-04-24T23:05:15.671 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.669+0000 7f5796600640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557e787cf400 0x557e778efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.672 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.670+0000 7f5796600640 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557e787cf400 0x557e778efb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.673 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.671+0000 7f5796600640 1 -- 172.21.15.146:0/905525614 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x557e78602500 con 0x557e787cf400 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557e787cf400 msgr2=0x557e778efb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557e787cf400 0x557e778efb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557e787b4c00 msgr2=0x557e778f0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557e787b4c00 0x557e778f0100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557e787ce400 msgr2=0x557e778f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557e787ce400 0x557e778f1700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e785fc9c0 tx=0x557e77c000c0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 msgr2=0x557e778f1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 --2- 172.21.15.146:0/905525614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e787b4000 0x557e778f1180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x557e7875f770 tx=0x557e78612300 comp rx=0 tx=0).stop 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5795c00640 1 -- 172.21.15.146:0/905525614 reap_dead start 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5795c00640 1 -- 172.21.15.146:0/905525614 reap_dead start 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 shutdown_connections 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 >> 172.21.15.146:0/905525614 conn(0x557e78669c00 msgr2=0x557e77973800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 shutdown_connections 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/905525614 wait complete. 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 msgr2=0x557e778eeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.672+0000 7f5797a7a280 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557e786a2b40 tx=0x557e78614c60 comp rx=0 tx=0).stop 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 shutdown_connections 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e77883c00 0x557e778ef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e77883800 0x557e778eeb00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 --2- 172.21.15.146:0/2010108596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557e77882c00 0x557e778ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 >> 172.21.15.146:0/2010108596 conn(0x557e77883000 msgr2=0x557e77973000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 shutdown_connections 2024-04-24T23:05:15.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.673+0000 7f5797a7a280 1 -- 172.21.15.146:0/2010108596 wait complete. 2024-04-24T23:05:15.679 INFO:tasks.workunit.client.0.smithi146.stderr:+ HEADER_STATE='{ 2024-04-24T23:05:15.679 INFO:tasks.workunit.client.0.smithi146.stderr: "magic": "ceph fs volume v011", 2024-04-24T23:05:15.679 INFO:tasks.workunit.client.0.smithi146.stderr: "write_pos": 4200296, 2024-04-24T23:05:15.679 INFO:tasks.workunit.client.0.smithi146.stderr: "expire_pos": 4194304, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "trimmed_pos": 4194304, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "stream_format": 1, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "layout": { 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_unit": 4194304, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_count": 1, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "object_size": 4194304, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_id": 7, 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_ns": "" 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr: } 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr:}' 2024-04-24T23:05:15.680 INFO:tasks.workunit.client.0.smithi146.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-04-24T23:05:15.727 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.724+0000 7fe523bfd280 1 -- start start 2024-04-24T23:05:15.727 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 Processor -- start 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 0x55d9c068eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c0623c00 0x55d9c068f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138e180 con 0x55d9c0622c00 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138e300 con 0x55d9c0623800 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.725+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d9c138e480 con 0x55d9c0623c00 2024-04-24T23:05:15.728 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34412/0 (socket says 172.21.15.146:34412) 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 -- 172.21.15.146:0/4072542637 learned_addr learned my addr 172.21.15.146:0/4072542637 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe522600640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c0623c00 0x55d9c068f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521200640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 0x55d9c068eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 -- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c0623c00 msgr2=0x55d9c068f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c0623c00 0x55d9c068f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 -- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 msgr2=0x55d9c068eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 0x55d9c068eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521c00640 1 -- 172.21.15.146:0/4072542637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c0656780 con 0x55d9c0622c00 2024-04-24T23:05:15.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.726+0000 7fe521200640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 0x55d9c068eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe521c00640 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55d9c14393e0 tx=0x55d9c13b3da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367ce641a9f1a0d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe51ea00640 1 -- 172.21.15.146:0/4072542637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c0648680 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe51ea00640 1 -- 172.21.15.146:0/4072542637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9c064e700 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c06574a0 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe51ea00640 1 -- 172.21.15.146:0/4072542637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c0648b60 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d9c0656000 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe51ea00640 1 -- 172.21.15.146:0/4072542637 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55d9c14f2600 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.727+0000 7fe51ea00640 1 -- 172.21.15.146:0/4072542637 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55d9c067d180 con 0x55d9c0622c00 2024-04-24T23:05:15.731 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.728+0000 7fe523bfd280 1 Processor -- start 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.728+0000 7fe523bfd280 1 -- start start 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c068f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138e600 con 0x55d9c14f9800 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138e780 con 0x55d9c14f9c00 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d9c138e900 con 0x55d9c14f9400 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34428/0 (socket says 172.21.15.146:34428) 2024-04-24T23:05:15.732 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.729+0000 7fe521c00640 1 -- 172.21.15.146:0/1775307007 learned_addr learned my addr 172.21.15.146:0/1775307007 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 -- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 msgr2=0x55d9c068f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe522600640 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c068f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521200640 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c068f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 -- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 msgr2=0x55d9c0690100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 -- 172.21.15.146:0/1775307007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c06563c0 con 0x55d9c14f9800 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe521c00640 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55d9c15186c0 tx=0x55d9c069ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f4b7549e8ff14b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe51c200640 1 -- 172.21.15.146:0/1775307007 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c0648820 con 0x55d9c14f9800 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe51c200640 1 -- 172.21.15.146:0/1775307007 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9c064efc0 con 0x55d9c14f9800 2024-04-24T23:05:15.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.730+0000 7fe51c200640 1 -- 172.21.15.146:0/1775307007 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c0648680 con 0x55d9c14f9800 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 -- 172.21.15.146:0/1775307007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 msgr2=0x55d9c068fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55d9c15186c0 tx=0x55d9c069ea20 comp rx=0 tx=0).stop 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 -- 172.21.15.146:0/1775307007 shutdown_connections 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c068fb80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 --2- 172.21.15.146:0/1775307007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c068f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 -- 172.21.15.146:0/1775307007 >> 172.21.15.146:0/1775307007 conn(0x55d9c14f9000 msgr2=0x55d9c0715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 -- 172.21.15.146:0/1775307007 shutdown_connections 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 -- 172.21.15.146:0/1775307007 wait complete. 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.731+0000 7fe523bfd280 1 Processor -- start 2024-04-24T23:05:15.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 -- start start 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c0691180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138fc80 con 0x55d9c14f9800 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d9c138ea80 con 0x55d9c14f9c00 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.732+0000 7fe523bfd280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d9c138fb00 con 0x55d9c14f9400 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34444/0 (socket says 172.21.15.146:34444) 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 -- 172.21.15.146:0/3190523284 learned_addr learned my addr 172.21.15.146:0/3190523284 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.737 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 msgr2=0x55d9c0691180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c14f9400 0x55d9c0691180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 msgr2=0x55d9c0690680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c14f9c00 0x55d9c0690680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c0656780 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe521c00640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d9c1519380 tx=0x55d9c151b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe51a400640 1 -- 172.21.15.146:0/3190523284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c0648b60 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.733+0000 7fe51a400640 1 -- 172.21.15.146:0/3190523284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d9c064ee00 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.734+0000 7fe51a400640 1 -- 172.21.15.146:0/3190523284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d9c06484e0 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.734+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9c06574a0 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.734+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c0656960 con 0x55d9c14f9800 2024-04-24T23:05:15.738 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.735+0000 7fe51a400640 1 -- 172.21.15.146:0/3190523284 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d9c1566c00 con 0x55d9c14f9800 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.736+0000 7fe51a400640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 0x55d9c0691700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.736+0000 7fe51a400640 1 -- 172.21.15.146:0/3190523284 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55d9c156a600 con 0x55d9c14f9800 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.736+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d9c1565800 0x55d9c0690100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.736+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d9c1565c00 con 0x55d9c1565800 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.737+0000 7fe522600640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 0x55d9c0691700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.739 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.737+0000 7fe521200640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d9c1565800 0x55d9c0690100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.740 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.738+0000 7fe522600640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 0x55d9c0691700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55d9c066bb00 tx=0x55d9c13b29c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.740 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.738+0000 7fe521200640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d9c1565800 0x55d9c0690100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.741 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.739+0000 7fe521200640 1 -- 172.21.15.146:0/3190523284 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55d9c13a2000 con 0x55d9c1565800 2024-04-24T23:05:15.741 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.739+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d9c09ac000 0x55d9c068fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.741 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.739+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d9c09ac400 con 0x55d9c09ac000 2024-04-24T23:05:15.742 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.740+0000 7fe522600640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d9c09ac000 0x55d9c068fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.742 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.741+0000 7fe522600640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d9c09ac000 0x55d9c068fb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.743 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.741+0000 7fe522600640 1 -- 172.21.15.146:0/3190523284 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55d9c13a2500 con 0x55d9c09ac000 2024-04-24T23:05:15.743 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.742+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d9c09ac800 con 0x55d9c09ac000 2024-04-24T23:05:15.745 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.743+0000 7fe522600640 1 -- 172.21.15.146:0/3190523284 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv19 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55d9c13a2500 con 0x55d9c09ac000 2024-04-24T23:05:15.745 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.743+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55d9c09acc00 0x55d9c068f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.745 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.743+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d9c09ad000 con 0x55d9c09acc00 2024-04-24T23:05:15.746 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.744+0000 7fe521c00640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55d9c09acc00 0x55d9c068f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.747 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.745+0000 7fe521c00640 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55d9c09acc00 0x55d9c068f600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.747 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe521c00640 1 -- 172.21.15.146:0/3190523284 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d9c1410f00 con 0x55d9c09acc00 2024-04-24T23:05:15.748 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55d9c09acc00 msgr2=0x55d9c068f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.748 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55d9c09acc00 0x55d9c068f600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.748 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d9c09ac000 msgr2=0x55d9c068fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d9c09ac000 0x55d9c068fb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d9c1565800 msgr2=0x55d9c0690100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d9c1565800 0x55d9c0690100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe521200640 1 -- 172.21.15.146:0/3190523284 reap_dead start 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 msgr2=0x55d9c0691700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 0x55d9c0691700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55d9c066bb00 tx=0x55d9c13b29c0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 msgr2=0x55d9c0690c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d9c1519380 tx=0x55d9c151b800 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 shutdown_connections 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c14f9800 0x55d9c0690c00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 --2- 172.21.15.146:0/3190523284 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d9c1565400 0x55d9c0691700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 >> 172.21.15.146:0/3190523284 conn(0x55d9c14f9000 msgr2=0x55d9c0715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 shutdown_connections 2024-04-24T23:05:15.749 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.746+0000 7fe523bfd280 1 -- 172.21.15.146:0/3190523284 wait complete. 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 msgr2=0x55d9c068e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55d9c14393e0 tx=0x55d9c13b3da0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 shutdown_connections 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d9c0623c00 0x55d9c068f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d9c0623800 0x55d9c068eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 --2- 172.21.15.146:0/4072542637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d9c0622c00 0x55d9c068e580 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.751 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 >> 172.21.15.146:0/4072542637 conn(0x55d9c0623000 msgr2=0x55d9c0714800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.751 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 shutdown_connections 2024-04-24T23:05:15.751 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.747+0000 7fe523bfd280 1 -- 172.21.15.146:0/4072542637 wait complete. 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr:+ EVENT_LIST='0.000000 0x400000 LID: () 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:25.206593+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.167338+0000 0x4003ac SESSION: () 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255021+0000 0x4004ae OPEN: () 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255588+0000 0x40055a UPDATE: (setattr) 2024-04-24T23:05:15.754 INFO:tasks.workunit.client.0.smithi146.stderr: / 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.622008+0000 0x400889 UPDATE: (mkdir) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:06.157490+0000 0x4010a6 UPDATE: (cap update) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:51.995934+0000 0x401768 UPDATE: (mkdir) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.016129+0000 0x402300 UPDATE: (mkdir) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/foo 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.017888+0000 0x402c4a UPDATE: (openc) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.035611+0000 0x403466 UPDATE: (cap update) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.846439+0000 0x403c8f UPDATE: (unlink_local) 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000002 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp/foo 2024-04-24T23:05:15.755 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.849002+0000 0x404f49 UPDATE: (unlink_local) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000003 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.865528+0000 0x405c54 UPDATE: (unlink_local) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000001 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:55.046308+0000 0x406936 UPDATE: (unlink_local) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000000 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344226+0000 0x4074d2 UPDATE: (purge_stray) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000002 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344375+0000 0x407729 UPDATE: (purge_stray) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000003 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344567+0000 0x407980 UPDATE: (purge_stray) 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000001 2024-04-24T23:05:15.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.461304+0000 0x407bd7 UPDATE: (scatter_writebehind) 2024-04-24T23:05:15.757 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.463178+0000 0x408049 SESSION: () 2024-04-24T23:05:15.757 INFO:tasks.workunit.client.0.smithi146.stderr:0.000000 0x4080f6 PURGED: ()' 2024-04-24T23:05:15.757 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-04-24T23:05:15.799 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.797+0000 7f469beb2280 1 -- start start 2024-04-24T23:05:15.799 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.797+0000 7f469beb2280 1 Processor -- start 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 0x5603eb2ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb283800 0x5603eb2eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5603ebfe4600 con 0x5603eb283c00 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5603ebfe4480 con 0x5603eb282c00 2024-04-24T23:05:15.800 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5603ebfe4300 con 0x5603eb283800 2024-04-24T23:05:15.801 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.801 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34456/0 (socket says 172.21.15.146:34456) 2024-04-24T23:05:15.801 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.798+0000 7f469aa00640 1 -- 172.21.15.146:0/3832169198 learned_addr learned my addr 172.21.15.146:0/3832169198 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.802 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f4699600640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb283800 0x5603eb2eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.802 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 -- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb283800 msgr2=0x5603eb2eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.802 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb283800 0x5603eb2eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.802 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469a000640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 0x5603eb2ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.802 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 -- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 msgr2=0x5603eb2ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 0x5603eb2ee580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 -- 172.21.15.146:0/3832169198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603eb2b6780 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469a000640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 0x5603eb2ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f469aa00640 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x5603ec09f560 tx=0x5603ec014de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5c234784b39c1c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.799+0000 7f4696e00640 1 -- 172.21.15.146:0/3832169198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a8680 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f4696e00640 1 -- 172.21.15.146:0/3832169198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5603eb2aee00 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f4696e00640 1 -- 172.21.15.146:0/3832169198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a8b60 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603eb2b74a0 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5603eb2b6000 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f4696e00640 1 -- 172.21.15.146:0/3832169198 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5603eb369000 con 0x5603eb283c00 2024-04-24T23:05:15.803 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.800+0000 7f4696e00640 1 -- 172.21.15.146:0/3832169198 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5603eb2dd180 con 0x5603eb283c00 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.801+0000 7f469beb2280 1 Processor -- start 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.801+0000 7f469beb2280 1 -- start start 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b400 0x5603eb2ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b800 0x5603eb2efb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5603ebfe4180 con 0x5603ec15bc00 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5603eb2e4900 con 0x5603ec15b800 2024-04-24T23:05:15.806 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5603eb2e4480 con 0x5603ec15b400 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34464/0 (socket says 172.21.15.146:34464) 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f4699600640 1 -- 172.21.15.146:0/3255219079 learned_addr learned my addr 172.21.15.146:0/3255219079 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.802+0000 7f4699600640 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b400 0x5603eb2ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 -- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b400 msgr2=0x5603eb2ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b400 0x5603eb2ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 -- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b800 msgr2=0x5603eb2efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f469a000640 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b800 0x5603eb2efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b800 0x5603eb2efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 -- 172.21.15.146:0/3255219079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603eb2b63c0 con 0x5603ec15bc00 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4699600640 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5603ec150330 tx=0x5603ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f77cb09858847d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4694600640 1 -- 172.21.15.146:0/3255219079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a89c0 con 0x5603ec15bc00 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4694600640 1 -- 172.21.15.146:0/3255219079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5603eb2aec40 con 0x5603ec15bc00 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.803+0000 7f4694600640 1 -- 172.21.15.146:0/3255219079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a8680 con 0x5603ec15bc00 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 -- 172.21.15.146:0/3255219079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 msgr2=0x5603eb2f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.807 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5603ec150330 tx=0x5603ec014000 comp rx=0 tx=0).stop 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 -- 172.21.15.146:0/3255219079 shutdown_connections 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0100 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b800 0x5603eb2efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 --2- 172.21.15.146:0/3255219079 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b400 0x5603eb2ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 -- 172.21.15.146:0/3255219079 >> 172.21.15.146:0/3255219079 conn(0x5603ec15b000 msgr2=0x5603eb373800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 -- 172.21.15.146:0/3255219079 shutdown_connections 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 -- 172.21.15.146:0/3255219079 wait complete. 2024-04-24T23:05:15.808 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.804+0000 7f469beb2280 1 Processor -- start 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 -- start start 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b400 0x5603eb2f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b800 0x5603eb2f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5603ebfe5980 con 0x5603ec15bc00 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5603ebfe4180 con 0x5603ec15b400 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.805+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5603ebfe5800 con 0x5603ec15b800 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34474/0 (socket says 172.21.15.146:34474) 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 -- 172.21.15.146:0/3680737722 learned_addr learned my addr 172.21.15.146:0/3680737722 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b800 msgr2=0x5603eb2f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.810 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603ec15b800 0x5603eb2f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b400 msgr2=0x5603eb2f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603ec15b400 0x5603eb2f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603eb2b6780 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4699600640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x5603ec151560 tx=0x5603ec014c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4692800640 1 -- 172.21.15.146:0/3680737722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a8b60 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4692800640 1 -- 172.21.15.146:0/3680737722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5603eb2ae1c0 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603eb2b74a0 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.806+0000 7f4692800640 1 -- 172.21.15.146:0/3680737722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb2a84e0 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.807+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603eb2b6960 con 0x5603ec15bc00 2024-04-24T23:05:15.811 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.808+0000 7f4692800640 1 -- 172.21.15.146:0/3680737722 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5603ec076c00 con 0x5603ec15bc00 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.809+0000 7f4692800640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 0x5603eb2f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.809+0000 7f4692800640 1 -- 172.21.15.146:0/3680737722 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5603ec07a400 con 0x5603ec15bc00 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.809+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603ec07c800 0x5603eb2f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.809+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603ec07cc00 con 0x5603ec07c800 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.809+0000 7f469a000640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 0x5603eb2f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.812 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.810+0000 7f4699600640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603ec07c800 0x5603eb2f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.813 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.811+0000 7f4699600640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603ec07c800 0x5603eb2f0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.813 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.811+0000 7f469a000640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 0x5603eb2f1700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5603ec09f3e0 tx=0x5603eb57cba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.814 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.812+0000 7f4699600640 1 -- 172.21.15.146:0/3680737722 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5603ec002000 con 0x5603ec07c800 2024-04-24T23:05:15.814 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.812+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603ec07d000 0x5603eb2efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.814 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.812+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603ec07d400 con 0x5603ec07d000 2024-04-24T23:05:15.814 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.812+0000 7f469aa00640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603ec07d000 0x5603eb2efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.815 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.813+0000 7f469aa00640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603ec07d000 0x5603eb2efb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.816 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.814+0000 7f469aa00640 1 -- 172.21.15.146:0/3680737722 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5603ec002500 con 0x5603ec07d000 2024-04-24T23:05:15.816 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.814+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603ec07d800 con 0x5603ec07d000 2024-04-24T23:05:15.817 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.815+0000 7f469aa00640 1 -- 172.21.15.146:0/3680737722 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv19 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x5603ec002500 con 0x5603ec07d000 2024-04-24T23:05:15.817 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.815+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb5fa800 0x5603eb2ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.817 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.815+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603eb5fac00 con 0x5603eb5fa800 2024-04-24T23:05:15.818 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.816+0000 7f469a000640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb5fa800 0x5603eb2ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.819 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.817+0000 7f469a000640 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb5fa800 0x5603eb2ef600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.820 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.818+0000 7f469a000640 1 -- 172.21.15.146:0/3680737722 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5603eb614f00 con 0x5603eb5fa800 2024-04-24T23:05:15.821 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.819+0000 7f469beb2280 1 -- start start 2024-04-24T23:05:15.821 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.819+0000 7f469beb2280 1 Processor -- start 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb5fb400 0x5603eb66c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb5fb800 0x5603eb66c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5603eb2e4900 con 0x5603eb5fbc00 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5603eb674000 con 0x5603eb5fb400 2024-04-24T23:05:15.822 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f469beb2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5603eb674180 con 0x5603eb5fb800 2024-04-24T23:05:15.823 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.823 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f4699600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34488/0 (socket says 172.21.15.146:34488) 2024-04-24T23:05:15.823 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.820+0000 7f4699600640 1 -- 172.21.15.146:0/2844989253 learned_addr learned my addr 172.21.15.146:0/2844989253 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.824 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f469a000640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb5fb800 0x5603eb66c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.824 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb5fb800 msgr2=0x5603eb66c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.824 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f469aa00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb5fb400 0x5603eb66c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.824 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb5fb800 0x5603eb66c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.824 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb5fb400 msgr2=0x5603eb66c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb5fb400 0x5603eb66c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603eb2b7680 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f4699600640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x5603ec1f35c0 tx=0x5603eb67c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abd9b23013280ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f468ec00640 1 -- 172.21.15.146:0/2844989253 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb578b60 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.821+0000 7f468ec00640 1 -- 172.21.15.146:0/2844989253 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5603eb2ae8c0 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f468ec00640 1 -- 172.21.15.146:0/2844989253 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5603eb578d00 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603eb2b63c0 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5603eb2b6780 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f468ec00640 1 -- 172.21.15.146:0/2844989253 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5603eb67a400 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f468ec00640 1 -- 172.21.15.146:0/2844989253 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5603eb2dd500 con 0x5603eb5fbc00 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603eb67f400 0x5603eb66d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.825 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.822+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603eb67f800 con 0x5603eb67f400 2024-04-24T23:05:15.826 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.823+0000 7f469aa00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603eb67f400 0x5603eb66d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.826 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.824+0000 7f469aa00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603eb67f400 0x5603eb66d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=3909048d99f07734 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.826 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.824+0000 7f469aa00640 1 -- 172.21.15.146:0/2844989253 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5603ec002500 con 0x5603eb67f400 2024-04-24T23:05:15.827 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.825+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603eb67fc00 0x5603eb66d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.827 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.825+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603eb698000 con 0x5603eb67fc00 2024-04-24T23:05:15.827 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.825+0000 7f469a000640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603eb67fc00 0x5603eb66d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.828 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.827+0000 7f469a000640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603eb67fc00 0x5603eb66d600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=56c7e4c7dfdbd96d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.829 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.827+0000 7f469a000640 1 -- 172.21.15.146:0/2844989253 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5603eb614f00 con 0x5603eb67fc00 2024-04-24T23:05:15.829 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.827+0000 7f468ce00640 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5603eb69e000 con 0x5603eb67fc00 2024-04-24T23:05:15.829 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.828+0000 7f468ce00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb69e400 0x5603eb66e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.829 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.828+0000 7f468ce00640 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5603eb69e800 con 0x5603eb69e400 2024-04-24T23:05:15.830 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.828+0000 7f469aa00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb69e400 0x5603eb66e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.830 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.828+0000 7f469a000640 1 -- 172.21.15.146:0/2844989253 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5603eb614f00 con 0x5603eb67fc00 2024-04-24T23:05:15.831 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.829+0000 7f469aa00640 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb69e400 0x5603eb66e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=807f9f7d7383607b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.832 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.830+0000 7f469aa00640 1 -- 172.21.15.146:0/2844989253 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5603ec002500 con 0x5603eb69e400 2024-04-24T23:05:15.832 INFO:tasks.workunit.client.0.smithi146.stdout:journal is 4194304~33090 2024-04-24T23:05:15.832 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.830+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:2e2fa760:::200.00000001:head [read 0~33090] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5603eb698400 con 0x5603eb67fc00 2024-04-24T23:05:15.833 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.831+0000 7f469a000640 1 -- 172.21.15.146:0/2844989253 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000001 [read 0~33090 out=33090b] v0'0 uv19 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x5603eb614f00 con 0x5603eb67fc00 2024-04-24T23:05:15.833 INFO:tasks.workunit.client.0.smithi146.stdout:wrote 33090 bytes at offset 4194304 to /tmp/journal.bin 2024-04-24T23:05:15.833 INFO:tasks.workunit.client.0.smithi146.stdout:NOTE: this is a _sparse_ file; you can 2024-04-24T23:05:15.833 INFO:tasks.workunit.client.0.smithi146.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-04-24T23:05:15.833 INFO:tasks.workunit.client.0.smithi146.stdout: to efficiently compress it while preserving sparseness. 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb69e400 msgr2=0x5603eb66e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb69e400 0x5603eb66e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603eb67fc00 msgr2=0x5603eb66d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603eb67fc00 0x5603eb66d600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603eb67f400 msgr2=0x5603eb66d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603eb67f400 0x5603eb66d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f4699600640 1 -- 172.21.15.146:0/2844989253 reap_dead start 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 msgr2=0x5603eb66cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x5603ec1f35c0 tx=0x5603eb67c000 comp rx=0 tx=0).stop 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 shutdown_connections 2024-04-24T23:05:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/2844989253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb5fbc00 0x5603eb66cb00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 >> 172.21.15.146:0/2844989253 conn(0x5603eb5fb000 msgr2=0x5603eb375800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 shutdown_connections 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/2844989253 wait complete. 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb5fa800 msgr2=0x5603eb2ef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5603eb5fa800 0x5603eb2ef600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603ec07d000 msgr2=0x5603eb2efb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5603ec07d000 0x5603eb2efb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603ec07c800 msgr2=0x5603eb2f0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5603ec07c800 0x5603eb2f0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469a000640 1 -- 172.21.15.146:0/3680737722 reap_dead start 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 msgr2=0x5603eb2f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 0x5603eb2f1700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5603ec09f3e0 tx=0x5603eb57cba0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 msgr2=0x5603eb2f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x5603ec151560 tx=0x5603ec014c60 comp rx=0 tx=0).stop 2024-04-24T23:05:15.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 shutdown_connections 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603ec15bc00 0x5603eb2f0680 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 --2- 172.21.15.146:0/3680737722 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5603ec07c400 0x5603eb2f1700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.832+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 >> 172.21.15.146:0/3680737722 conn(0x5603ec15b000 msgr2=0x5603eb373800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 shutdown_connections 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3680737722 wait complete. 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 msgr2=0x5603eb2ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x5603ec09f560 tx=0x5603ec014de0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 shutdown_connections 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603eb283c00 0x5603eb2ef080 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5603eb283800 0x5603eb2eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 --2- 172.21.15.146:0/3832169198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5603eb282c00 0x5603eb2ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 >> 172.21.15.146:0/3832169198 conn(0x5603eb283000 msgr2=0x5603eb373000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 shutdown_connections 2024-04-24T23:05:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.833+0000 7f469beb2280 1 -- 172.21.15.146:0/3832169198 wait complete. 2024-04-24T23:05:15.841 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-04-24T23:05:15.888 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.886+0000 7f9b97a62280 1 -- start start 2024-04-24T23:05:15.888 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.886+0000 7f9b97a62280 1 Processor -- start 2024-04-24T23:05:15.890 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.890 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 0x55b09dbf2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09db87c00 0x55b09dbf3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8180 con 0x55b09db86c00 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8300 con 0x55b09db87c00 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09e8e8480 con 0x55b09db87800 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b95c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b95c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34504/0 (socket says 172.21.15.146:34504) 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.887+0000 7f9b95c00640 1 -- 172.21.15.146:0/1842588105 learned_addr learned my addr 172.21.15.146:0/1842588105 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 -- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 msgr2=0x55b09dbf2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95200640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 0x55b09dbf2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b96600640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09db87c00 0x55b09dbf3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 0x55b09dbf2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 -- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09db87c00 msgr2=0x55b09dbf3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09db87c00 0x55b09dbf3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 -- 172.21.15.146:0/1842588105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09dbba780 con 0x55b09db86c00 2024-04-24T23:05:15.891 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95200640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 0x55b09dbf2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b95c00640 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d350 tx=0x55b09e917e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7813b479cb0e5cae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b92a00640 1 -- 172.21.15.146:0/1842588105 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbac9c0 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b92a00640 1 -- 172.21.15.146:0/1842588105 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09dbb2700 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b92a00640 1 -- 172.21.15.146:0/1842588105 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbac680 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09dbbb4a0 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.888+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b09dbba000 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.889+0000 7f9b92a00640 1 -- 172.21.15.146:0/1842588105 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b09ea48200 con 0x55b09db86c00 2024-04-24T23:05:15.892 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.889+0000 7f9b92a00640 1 -- 172.21.15.146:0/1842588105 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55b09dbe1180 con 0x55b09db86c00 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.890+0000 7f9b97a62280 1 Processor -- start 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.890+0000 7f9b97a62280 1 -- start start 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2000 0x55b09dbf3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2800 0x55b09dbf4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8600 con 0x55b09eaa2400 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8780 con 0x55b09eaa2000 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09e8e8900 con 0x55b09eaa2800 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34512/0 (socket says 172.21.15.146:34512) 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 -- 172.21.15.146:0/4105537660 learned_addr learned my addr 172.21.15.146:0/4105537660 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.894 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 -- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2800 msgr2=0x55b09dbf4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2800 0x55b09dbf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 -- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2000 msgr2=0x55b09dbf3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2000 0x55b09dbf3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.891+0000 7f9b95c00640 1 -- 172.21.15.146:0/4105537660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09dbba3c0 con 0x55b09eaa2400 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b95c00640 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d7d0 tx=0x55b09dc02f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3d6a861743fd00 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b90200640 1 -- 172.21.15.146:0/4105537660 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbacb60 con 0x55b09eaa2400 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b90200640 1 -- 172.21.15.146:0/4105537660 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09dbb2fc0 con 0x55b09eaa2400 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b90200640 1 -- 172.21.15.146:0/4105537660 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbac820 con 0x55b09eaa2400 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 -- 172.21.15.146:0/4105537660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 msgr2=0x55b09dbf3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.895 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d7d0 tx=0x55b09dc02f60 comp rx=0 tx=0).stop 2024-04-24T23:05:15.897 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 -- 172.21.15.146:0/4105537660 shutdown_connections 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2800 0x55b09dbf4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2400 0x55b09dbf3b80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 --2- 172.21.15.146:0/4105537660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2000 0x55b09dbf3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 -- 172.21.15.146:0/4105537660 >> 172.21.15.146:0/4105537660 conn(0x55b09e915c00 msgr2=0x55b09dc91000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 -- 172.21.15.146:0/4105537660 shutdown_connections 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.892+0000 7f9b97a62280 1 -- 172.21.15.146:0/4105537660 wait complete. 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.893+0000 7f9b97a62280 1 Processor -- start 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.893+0000 7f9b97a62280 1 -- start start 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2400 0x55b09dbf4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2800 0x55b09dbf4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e9c80 con 0x55b09eaa2000 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e9b00 con 0x55b09eaa2800 2024-04-24T23:05:15.898 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09e8e9980 con 0x55b09eaa2400 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b96600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b96600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34522/0 (socket says 172.21.15.146:34522) 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b96600640 1 -- 172.21.15.146:0/742431252 learned_addr learned my addr 172.21.15.146:0/742431252 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 -- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2400 msgr2=0x55b09dbf4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.894+0000 7f9b95200640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2800 0x55b09dbf4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2400 0x55b09dbf4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 -- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2800 msgr2=0x55b09dbf4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2800 0x55b09dbf4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 -- 172.21.15.146:0/742431252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09dbba960 con 0x55b09eaa2000 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b96600640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55b09ea59650 tx=0x55b09ea5acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b8e400640 1 -- 172.21.15.146:0/742431252 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbacb60 con 0x55b09eaa2000 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b8e400640 1 -- 172.21.15.146:0/742431252 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09dbb2c40 con 0x55b09eaa2000 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09dbbb680 con 0x55b09eaa2000 2024-04-24T23:05:15.899 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b8e400640 1 -- 172.21.15.146:0/742431252 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09dbac820 con 0x55b09eaa2000 2024-04-24T23:05:15.900 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.895+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09dbbb860 con 0x55b09eaa2000 2024-04-24T23:05:15.900 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.897+0000 7f9b8e400640 1 -- 172.21.15.146:0/742431252 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b09eab2c00 con 0x55b09eaa2000 2024-04-24T23:05:15.900 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.897+0000 7f9b8e400640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 0x55b09dbf5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.901 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.897+0000 7f9b8e400640 1 -- 172.21.15.146:0/742431252 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b09eaa9000 con 0x55b09eaa2000 2024-04-24T23:05:15.901 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.898+0000 7f9b95c00640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 0x55b09dbf5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.901 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.899+0000 7f9b97a62280 1 -- start start 2024-04-24T23:05:15.901 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.899+0000 7f9b97a62280 1 Processor -- start 2024-04-24T23:05:15.903 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.899+0000 7f9b95c00640 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 0x55b09dbf5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d7d0 tx=0x55b09e9168a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.903 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa3000 0x55b09dbf4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.903 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eabf400 0x55b09dbf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8c00 con 0x55b09eabf800 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09e8e8d80 con 0x55b09eaa3000 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b97a62280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09e8e9680 con 0x55b09eabf400 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34524/0 (socket says 172.21.15.146:34524) 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 -- 172.21.15.146:0/929134249 learned_addr learned my addr 172.21.15.146:0/929134249 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95c00640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eabf400 0x55b09dbf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b96600640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa3000 0x55b09dbf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eabf400 msgr2=0x55b09dbf3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eabf400 0x55b09dbf3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa3000 msgr2=0x55b09dbf4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa3000 0x55b09dbf4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.904 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.900+0000 7f9b95200640 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09dbbba40 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b95200640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55b09de957d0 tx=0x55b09df440c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d33e780a237db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b8a800640 1 -- 172.21.15.146:0/929134249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09eaefba0 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b8a800640 1 -- 172.21.15.146:0/929134249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09dbb21c0 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09dbba960 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b09dbbb680 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b8a800640 1 -- 172.21.15.146:0/929134249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09eaefa00 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b8a800640 1 -- 172.21.15.146:0/929134249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b09df4a600 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b8a800640 1 -- 172.21.15.146:0/929134249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55b09dbe1500 con 0x55b09eabf800 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b09eabfc00 0x55b09df62000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.905 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.901+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b09df47c00 con 0x55b09eabfc00 2024-04-24T23:05:15.906 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.902+0000 7f9b96600640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b09eabfc00 0x55b09df62000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.906 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.903+0000 7f9b96600640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b09eabfc00 0x55b09df62000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=1662f5321c13cf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.906 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.904+0000 7f9b96600640 1 -- 172.21.15.146:0/929134249 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b09e906000 con 0x55b09eabfc00 2024-04-24T23:05:15.906 INFO:tasks.workunit.client.0.smithi146.stdout:undump /tmp/journal.bin 2024-04-24T23:05:15.907 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.904+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b09df6e000 0x55b09df62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.907 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.904+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b09df6e400 con 0x55b09df6e000 2024-04-24T23:05:15.907 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.905+0000 7f9b95c00640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b09df6e000 0x55b09df62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.907 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.906+0000 7f9b95c00640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b09df6e000 0x55b09df62580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=f799644b10aced3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.908 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.906+0000 7f9b95c00640 1 -- 172.21.15.146:0/929134249 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b09e906500 con 0x55b09df6e000 2024-04-24T23:05:15.909 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.907+0000 7f9b88a00640 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x55b09df74000 con 0x55b09df6e000 2024-04-24T23:05:15.909 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.907+0000 7f9b88a00640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b09df74400 0x55b09df64680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.909 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.907+0000 7f9b88a00640 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x55b09df74800 con 0x55b09df74400 2024-04-24T23:05:15.909 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.907+0000 7f9b95c00640 1 -- 172.21.15.146:0/929134249 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55b09e906500 con 0x55b09df6e000 2024-04-24T23:05:15.909 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.907+0000 7f9b96600640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b09df74400 0x55b09df64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.910 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.908+0000 7f9b96600640 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b09df74400 0x55b09df64680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=bea39d6454d8bd4a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.911 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.909+0000 7f9b96600640 1 -- 172.21.15.146:0/929134249 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b09e906000 con 0x55b09df74400 2024-04-24T23:05:15.911 INFO:tasks.workunit.client.0.smithi146.stdout:start 4194304 len 33090 write_pos 4200296 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-04-24T23:05:15.911 INFO:tasks.workunit.client.0.smithi146.stdout:writing header 200.00000000 2024-04-24T23:05:15.911 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.909+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55b09df6e800 con 0x55b09df6e000 2024-04-24T23:05:15.915 INFO:tasks.workunit.client.0.smithi146.stdout:Purging 2 objects from 1 2024-04-24T23:05:15.916 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.914+0000 7f9b95c00640 1 -- 172.21.15.146:0/929134249 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v57'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b09e906500 con 0x55b09df6e000 2024-04-24T23:05:15.916 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.914+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55b09df6ec00 con 0x55b09df6e000 2024-04-24T23:05:15.916 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.914+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:7 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55b09df6f000 con 0x55b09df74400 2024-04-24T23:05:15.921 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.919+0000 7f9b95c00640 1 -- 172.21.15.146:0/929134249 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(6 200.00000001 [delete] v57'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b09e906500 con 0x55b09df6e000 2024-04-24T23:05:15.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.922+0000 7f9b96600640 1 -- 172.21.15.146:0/929134249 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(7 200.00000002 [delete] v57'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b09e906000 con 0x55b09df74400 2024-04-24T23:05:15.924 INFO:tasks.workunit.client.0.smithi146.stdout: writing 4194304~33090 2024-04-24T23:05:15.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.922+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 7.14 7:2e2fa760:::200.00000001:head [write 0~33090 in=33090b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55b09df6f400 con 0x55b09df6e000 2024-04-24T23:05:15.928 INFO:tasks.workunit.client.0.smithi146.stdout:done. 2024-04-24T23:05:15.930 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b95c00640 1 -- 172.21.15.146:0/929134249 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(8 200.00000001 [write 0~33090] v57'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b09e906500 con 0x55b09df6e000 2024-04-24T23:05:15.930 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b09df74400 msgr2=0x55b09df64680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b09df74400 0x55b09df64680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b09df6e000 msgr2=0x55b09df62580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b09df6e000 0x55b09df62580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b09eabfc00 msgr2=0x55b09df62000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.926+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b09eabfc00 0x55b09df62000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 msgr2=0x55b09dbf3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55b09de957d0 tx=0x55b09df440c0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b95200640 1 -- 172.21.15.146:0/929134249 reap_dead start 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 shutdown_connections 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/929134249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eabf800 0x55b09dbf3600 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 >> 172.21.15.146:0/929134249 conn(0x55b09eaa2c00 msgr2=0x55b09dc91800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 shutdown_connections 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/929134249 wait complete. 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 msgr2=0x55b09dbf5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.931 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 0x55b09dbf5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d7d0 tx=0x55b09e9168a0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 msgr2=0x55b09dbf5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55b09ea59650 tx=0x55b09ea5acc0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 shutdown_connections 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09eaa2800 0x55b09dbf4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b09eabf000 0x55b09dbf5700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09eaa2400 0x55b09dbf4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 --2- 172.21.15.146:0/742431252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09eaa2000 0x55b09dbf5180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 >> 172.21.15.146:0/742431252 conn(0x55b09e915c00 msgr2=0x55b09dc91000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.927+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 shutdown_connections 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/742431252 wait complete. 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 msgr2=0x55b09dbf2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x55b09e99d350 tx=0x55b09e917e00 comp rx=0 tx=0).stop 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 shutdown_connections 2024-04-24T23:05:15.932 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09db87c00 0x55b09dbf3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.933 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09db87800 0x55b09dbf2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.933 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 --2- 172.21.15.146:0/1842588105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09db86c00 0x55b09dbf2580 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.933 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 >> 172.21.15.146:0/1842588105 conn(0x55b09db87000 msgr2=0x55b09dc90800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.933 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 shutdown_connections 2024-04-24T23:05:15.933 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.928+0000 7f9b97a62280 1 -- 172.21.15.146:0/1842588105 wait complete. 2024-04-24T23:05:15.936 INFO:tasks.workunit.client.0.smithi146.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-04-24T23:05:15.983 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.981+0000 7fcd4f00e280 1 -- start start 2024-04-24T23:05:15.984 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.981+0000 7fcd4f00e280 1 Processor -- start 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09f392c00 0x55b09f3fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09f393800 0x55b09f3feb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09f478180 con 0x55b09f393c00 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09f478300 con 0x55b09f393800 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.982+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09f478480 con 0x55b09f392c00 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34528/0 (socket says 172.21.15.146:34528) 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 -- 172.21.15.146:0/2677643361 learned_addr learned my addr 172.21.15.146:0/2677643361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.986 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 -- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09f392c00 msgr2=0x55b09f3fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09f392c00 0x55b09f3fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 -- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09f393800 msgr2=0x55b09f3feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09f393800 0x55b09f3feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 -- 172.21.15.146:0/2677643361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09f3c6780 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd4ce00640 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55b0a01b5380 tx=0x55b0a0123da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce94eda3ecaf9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.983+0000 7fcd49200640 1 -- 172.21.15.146:0/2677643361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b8680 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd49200640 1 -- 172.21.15.146:0/2677643361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09f3befc0 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd49200640 1 -- 172.21.15.146:0/2677643361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b8b60 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09f3c63c0 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b09f3c7680 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd49200640 1 -- 172.21.15.146:0/2677643361 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b0a0252600 con 0x55b09f393c00 2024-04-24T23:05:15.987 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.984+0000 7fcd49200640 1 -- 172.21.15.146:0/2677643361 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55b09f3ed180 con 0x55b09f393c00 2024-04-24T23:05:15.990 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.985+0000 7fcd4f00e280 1 Processor -- start 2024-04-24T23:05:15.990 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.985+0000 7fcd4f00e280 1 -- start start 2024-04-24T23:05:15.990 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255400 0x55b09f3ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.990 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.990 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255c00 0x55b09f400100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09f478600 con 0x55b0a0255800 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09f478780 con 0x55b0a0255400 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09f478900 con 0x55b0a0255c00 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34532/0 (socket says 172.21.15.146:34532) 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 -- 172.21.15.146:0/2673575711 learned_addr learned my addr 172.21.15.146:0/2673575711 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 -- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255c00 msgr2=0x55b09f400100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255c00 0x55b09f400100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 -- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255400 msgr2=0x55b09f3ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255400 0x55b09f3ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.986+0000 7fcd4c400640 1 -- 172.21.15.146:0/2673575711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09f3c74a0 con 0x55b0a0255800 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4c400640 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55b0a02706c0 tx=0x55b0a0272d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99db0e6791be50 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd46a00640 1 -- 172.21.15.146:0/2673575711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b89c0 con 0x55b0a0255800 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd46a00640 1 -- 172.21.15.146:0/2673575711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09f3bee00 con 0x55b0a0255800 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd46a00640 1 -- 172.21.15.146:0/2673575711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b8680 con 0x55b0a0255800 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2673575711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 msgr2=0x55b09f3ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55b0a02706c0 tx=0x55b0a0272d20 comp rx=0 tx=0).stop 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2673575711 shutdown_connections 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255c00 0x55b09f400100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255800 0x55b09f3ffb80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2673575711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255400 0x55b09f3ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.987+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2673575711 >> 172.21.15.146:0/2673575711 conn(0x55b0a0255000 msgr2=0x55b09f485000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.988+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2673575711 shutdown_connections 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.988+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2673575711 wait complete. 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.988+0000 7fcd4f00e280 1 Processor -- start 2024-04-24T23:05:15.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.988+0000 7fcd4f00e280 1 -- start start 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 0x55b09f401180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255800 0x55b09f400c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255c00 0x55b09f400680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b09f3f4180 con 0x55b0a0255400 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b09f479e00 con 0x55b0a0255c00 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4f00e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b09f478d80 con 0x55b0a0255800 2024-04-24T23:05:15.994 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4ba00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 0x55b09f401180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4ba00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 0x55b09f401180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34540/0 (socket says 172.21.15.146:34540) 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.989+0000 7fcd4ba00640 1 -- 172.21.15.146:0/4175772360 learned_addr learned my addr 172.21.15.146:0/4175772360 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255800 msgr2=0x55b09f400c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b0a0255800 0x55b09f400c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255c00 msgr2=0x55b09f400680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b0a0255c00 0x55b09f400680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 -- 172.21.15.146:0/4175772360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09f3c6780 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4ba00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 0x55b09f401180 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55b0a0271440 tx=0x55b0a0273020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd44c00640 1 -- 172.21.15.146:0/4175772360 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b89c0 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd44c00640 1 -- 172.21.15.146:0/4175772360 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b09f3bea80 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09f3c63c0 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd44c00640 1 -- 172.21.15.146:0/4175772360 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b09f3b8680 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.990+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09f3c6000 con 0x55b0a0255400 2024-04-24T23:05:15.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.992+0000 7fcd44c00640 1 -- 172.21.15.146:0/4175772360 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b0a016ac00 con 0x55b0a0255400 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.992+0000 7fcd44c00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b0a02d3000 0x55b09f401700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.993+0000 7fcd44c00640 1 -- 172.21.15.146:0/4175772360 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b0a02d4a00 con 0x55b0a0255400 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.993+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b0a02d3400 0x55b09f400100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.993+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b0a02d3800 con 0x55b0a02d3400 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.993+0000 7fcd4c400640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b0a02d3000 0x55b09f401700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.993+0000 7fcd4ba00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b0a02d3400 0x55b09f400100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.994+0000 7fcd4c400640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b0a02d3000 0x55b09f401700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55b0a02706c0 tx=0x55b0a0272c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.995+0000 7fcd4ba00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b0a02d3400 0x55b09f400100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:15.998 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.996+0000 7fcd4ba00640 1 -- 172.21.15.146:0/4175772360 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b0a0112000 con 0x55b0a02d3400 2024-04-24T23:05:15.998 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.996+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b0a02d3c00 0x55b09f3ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:15.998 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.996+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b09f710000 con 0x55b0a02d3c00 2024-04-24T23:05:15.998 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.996+0000 7fcd4ce00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b0a02d3c00 0x55b09f3ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:15.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.997+0000 7fcd4ce00640 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b0a02d3c00 0x55b09f3ffb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.001 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4ce00640 1 -- 172.21.15.146:0/4175772360 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b0a0112500 con 0x55b0a02d3c00 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b0a02d3c00 msgr2=0x55b09f3ffb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b0a02d3c00 0x55b09f3ffb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b0a02d3400 msgr2=0x55b09f400100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b0a02d3400 0x55b09f400100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b0a02d3000 msgr2=0x55b09f401700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.998+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b0a02d3000 0x55b09f401700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55b0a02706c0 tx=0x55b0a0272c00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 msgr2=0x55b09f401180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/4175772360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b0a0255400 0x55b09f401180 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55b0a0271440 tx=0x55b0a0273020 comp rx=0 tx=0).stop 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4c400640 1 -- 172.21.15.146:0/4175772360 reap_dead start 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4c400640 1 -- 172.21.15.146:0/4175772360 reap_dead start 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 shutdown_connections 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 >> 172.21.15.146:0/4175772360 conn(0x55b0a0255000 msgr2=0x55b09f485000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 shutdown_connections 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/4175772360 wait complete. 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 msgr2=0x55b09f3ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55b0a01b5380 tx=0x55b0a0123da0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 shutdown_connections 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b09f393c00 0x55b09f3ff080 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b09f393800 0x55b09f3feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 --2- 172.21.15.146:0/2677643361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b09f392c00 0x55b09f3fe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 >> 172.21.15.146:0/2677643361 conn(0x55b09f393000 msgr2=0x55b09f484800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 shutdown_connections 2024-04-24T23:05:16.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:15.999+0000 7fcd4f00e280 1 -- 172.21.15.146:0/2677643361 wait complete. 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr:+ NEW_HEADER_STATE='{ 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "write_pos": 4200296, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "expire_pos": 4194304, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "trimmed_pos": 4194304, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "stream_format": 1, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "layout": { 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_unit": 4194304, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_count": 1, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "object_size": 4194304, 2024-04-24T23:05:16.006 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_id": 7, 2024-04-24T23:05:16.007 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_ns": "" 2024-04-24T23:05:16.007 INFO:tasks.workunit.client.0.smithi146.stderr: } 2024-04-24T23:05:16.007 INFO:tasks.workunit.client.0.smithi146.stderr:}' 2024-04-24T23:05:16.007 INFO:tasks.workunit.client.0.smithi146.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-04-24T23:05:16.054 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.052+0000 7ff283122280 1 -- start start 2024-04-24T23:05:16.055 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 Processor -- start 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54ea30c00 0x55b54ea9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54ea31800 0x55b54ea9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792180 con 0x55b54ea31c00 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792300 con 0x55b54ea30c00 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.053+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b54f792480 con 0x55b54ea31800 2024-04-24T23:05:16.057 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34556/0 (socket says 172.21.15.146:34556) 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 -- 172.21.15.146:0/3869369296 learned_addr learned my addr 172.21.15.146:0/3869369296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 -- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54ea31800 msgr2=0x55b54ea9cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54ea31800 0x55b54ea9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 -- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54ea30c00 msgr2=0x55b54ea9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281200640 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54ea30c00 0x55b54ea9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54ea30c00 0x55b54ea9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.054+0000 7ff281c00640 1 -- 172.21.15.146:0/3869369296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54ea64780 con 0x55b54ea31c00 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff281c00640 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55b54f845380 tx=0x55b54f7c1da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557ba6627be3de41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff27e000640 1 -- 172.21.15.146:0/3869369296 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea56680 con 0x55b54ea31c00 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff27e000640 1 -- 172.21.15.146:0/3869369296 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b54ea5cfc0 con 0x55b54ea31c00 2024-04-24T23:05:16.058 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54ea654a0 con 0x55b54ea31c00 2024-04-24T23:05:16.059 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff27e000640 1 -- 172.21.15.146:0/3869369296 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea56b60 con 0x55b54ea31c00 2024-04-24T23:05:16.059 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b54ea64000 con 0x55b54ea31c00 2024-04-24T23:05:16.059 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff27e000640 1 -- 172.21.15.146:0/3869369296 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b54f8f4a00 con 0x55b54ea31c00 2024-04-24T23:05:16.059 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.055+0000 7ff27e000640 1 -- 172.21.15.146:0/3869369296 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55b54ea8b180 con 0x55b54ea31c00 2024-04-24T23:05:16.061 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.056+0000 7ff283122280 1 Processor -- start 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.056+0000 7ff283122280 1 -- start start 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7800 0x55b54ea9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7c00 0x55b54ea9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792600 con 0x55b54f8f7400 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792780 con 0x55b54f8f7c00 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b54f792900 con 0x55b54f8f7800 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff280800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff280800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34570/0 (socket says 172.21.15.146:34570) 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.057+0000 7ff280800640 1 -- 172.21.15.146:0/706163346 learned_addr learned my addr 172.21.15.146:0/706163346 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 -- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7800 msgr2=0x55b54ea9db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.062 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7800 0x55b54ea9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 -- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7c00 msgr2=0x55b54ea9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7c00 0x55b54ea9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 -- 172.21.15.146:0/706163346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54ea643c0 con 0x55b54f8f7400 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff280800640 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55b54f9106c0 tx=0x55b54f913920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a38c8c9c32ce93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff27b800640 1 -- 172.21.15.146:0/706163346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea56680 con 0x55b54f8f7400 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff27b800640 1 -- 172.21.15.146:0/706163346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b54ea5ca80 con 0x55b54f8f7400 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.058+0000 7ff27b800640 1 -- 172.21.15.146:0/706163346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea56b60 con 0x55b54f8f7400 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 -- 172.21.15.146:0/706163346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 msgr2=0x55b54ea9d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55b54f9106c0 tx=0x55b54f913920 comp rx=0 tx=0).stop 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 -- 172.21.15.146:0/706163346 shutdown_connections 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7c00 0x55b54ea9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7800 0x55b54ea9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.063 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 --2- 172.21.15.146:0/706163346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9d600 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.064 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 -- 172.21.15.146:0/706163346 >> 172.21.15.146:0/706163346 conn(0x55b54f8f7000 msgr2=0x55b54eb3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.064 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 -- 172.21.15.146:0/706163346 shutdown_connections 2024-04-24T23:05:16.064 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.059+0000 7ff283122280 1 -- 172.21.15.146:0/706163346 wait complete. 2024-04-24T23:05:16.064 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.060+0000 7ff283122280 1 Processor -- start 2024-04-24T23:05:16.064 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.060+0000 7ff283122280 1 -- start start 2024-04-24T23:05:16.066 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.066 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7800 0x55b54ea9ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7c00 0x55b54ea9e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792900 con 0x55b54f8f7400 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b54f792a80 con 0x55b54f8f7800 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff283122280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b54f792780 con 0x55b54f8f7c00 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34574/0 (socket says 172.21.15.146:34574) 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 -- 172.21.15.146:0/2143571410 learned_addr learned my addr 172.21.15.146:0/2143571410 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7c00 msgr2=0x55b54ea9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54f8f7c00 0x55b54ea9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff281200640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7800 0x55b54ea9ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7800 msgr2=0x55b54ea9ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54f8f7800 0x55b54ea9ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.067 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.061+0000 7ff280800640 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54ea64780 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff280800640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55b54f911380 tx=0x55b54f913800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff279a00640 1 -- 172.21.15.146:0/2143571410 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea564e0 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff279a00640 1 -- 172.21.15.146:0/2143571410 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b54ea5ce00 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b54ea654a0 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff279a00640 1 -- 172.21.15.146:0/2143571410 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b54ea56680 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.062+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54ea64960 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.063+0000 7ff279a00640 1 -- 172.21.15.146:0/2143571410 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b54f96cc00 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.064+0000 7ff279a00640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 0x55b54ea9f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.064+0000 7ff279a00640 1 -- 172.21.15.146:0/2143571410 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55b54f96aa00 con 0x55b54f8f7400 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.064+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b54f969400 0x55b54ea9e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.068 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.064+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b54f969800 con 0x55b54f969400 2024-04-24T23:05:16.069 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.065+0000 7ff280800640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b54f969400 0x55b54ea9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.069 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.065+0000 7ff281200640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 0x55b54ea9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.066+0000 7ff280800640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b54f969400 0x55b54ea9e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.066+0000 7ff281200640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 0x55b54ea9f700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55b54eb10030 tx=0x55b54f7c1ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.067+0000 7ff280800640 1 -- 172.21.15.146:0/2143571410 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b54f7b0000 con 0x55b54f969400 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.067+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b54f969c00 0x55b54ea9db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.067+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b54f822000 con 0x55b54f969c00 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.067+0000 7ff281c00640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b54f969c00 0x55b54ea9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.070 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.068+0000 7ff281c00640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b54f969c00 0x55b54ea9db80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.071 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.069+0000 7ff281c00640 1 -- 172.21.15.146:0/2143571410 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b54f7b0500 con 0x55b54f969c00 2024-04-24T23:05:16.071 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.069+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b54f822400 con 0x55b54f969c00 2024-04-24T23:05:16.073 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.071+0000 7ff281c00640 1 -- 172.21.15.146:0/2143571410 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv22 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55b54f7b0500 con 0x55b54f969c00 2024-04-24T23:05:16.073 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.071+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b54f822800 0x55b54ea9d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.073 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.071+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55b54f822c00 con 0x55b54f822800 2024-04-24T23:05:16.073 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.072+0000 7ff281200640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b54f822800 0x55b54ea9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.074 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.073+0000 7ff281200640 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b54f822800 0x55b54ea9d600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.075 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.073+0000 7ff281200640 1 -- 172.21.15.146:0/2143571410 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b54edc2f00 con 0x55b54f822800 2024-04-24T23:05:16.077 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b54f822800 msgr2=0x55b54ea9d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.077 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55b54f822800 0x55b54ea9d600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.077 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b54f969c00 msgr2=0x55b54ea9db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.077 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55b54f969c00 0x55b54ea9db80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b54f969400 msgr2=0x55b54ea9e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55b54f969400 0x55b54ea9e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff281200640 1 -- 172.21.15.146:0/2143571410 reap_dead start 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 msgr2=0x55b54ea9f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 0x55b54ea9f700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55b54eb10030 tx=0x55b54f7c1ec0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 msgr2=0x55b54ea9f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55b54f911380 tx=0x55b54f913800 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 shutdown_connections 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b54f969000 0x55b54ea9f700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 --2- 172.21.15.146:0/2143571410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54f8f7400 0x55b54ea9f180 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.078 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 >> 172.21.15.146:0/2143571410 conn(0x55b54f8f7000 msgr2=0x55b54eb3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 shutdown_connections 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.074+0000 7ff283122280 1 -- 172.21.15.146:0/2143571410 wait complete. 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 msgr2=0x55b54ea9d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55b54f845380 tx=0x55b54f7c1da0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 shutdown_connections 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b54ea31c00 0x55b54ea9d080 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b54ea31800 0x55b54ea9cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 --2- 172.21.15.146:0/3869369296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b54ea30c00 0x55b54ea9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 >> 172.21.15.146:0/3869369296 conn(0x55b54ea31000 msgr2=0x55b54eb3a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 shutdown_connections 2024-04-24T23:05:16.079 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.075+0000 7ff283122280 1 -- 172.21.15.146:0/3869369296 wait complete. 2024-04-24T23:05:16.081 INFO:tasks.workunit.client.0.smithi146.stderr:+ NEW_EVENT_LIST='0.000000 0x400000 LID: () 2024-04-24T23:05:16.081 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:25.206593+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.167338+0000 0x4003ac SESSION: () 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255021+0000 0x4004ae OPEN: () 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255588+0000 0x40055a UPDATE: (setattr) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: / 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.622008+0000 0x400889 UPDATE: (mkdir) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:06.157490+0000 0x4010a6 UPDATE: (cap update) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:51.995934+0000 0x401768 UPDATE: (mkdir) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.016129+0000 0x402300 UPDATE: (mkdir) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/foo 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.017888+0000 0x402c4a UPDATE: (openc) 2024-04-24T23:05:16.082 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.035611+0000 0x403466 UPDATE: (cap update) 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.846439+0000 0x403c8f UPDATE: (unlink_local) 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000002 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp/foo 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.849002+0000 0x404f49 UPDATE: (unlink_local) 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000003 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.865528+0000 0x405c54 UPDATE: (unlink_local) 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000001 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:55.046308+0000 0x406936 UPDATE: (unlink_local) 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000000 2024-04-24T23:05:16.083 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344226+0000 0x4074d2 UPDATE: (purge_stray) 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000002 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344375+0000 0x407729 UPDATE: (purge_stray) 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000003 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344567+0000 0x407980 UPDATE: (purge_stray) 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000001 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.461304+0000 0x407bd7 UPDATE: (scatter_writebehind) 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.463178+0000 0x408049 SESSION: () 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:0.000000 0x4080f6 PURGED: ()' 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' '!' '{ 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: "write_pos": 4200296, 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: "expire_pos": 4194304, 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: "trimmed_pos": 4194304, 2024-04-24T23:05:16.084 INFO:tasks.workunit.client.0.smithi146.stderr: "stream_format": 1, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "layout": { 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_unit": 4194304, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_count": 1, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "object_size": 4194304, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_id": 7, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_ns": "" 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: } 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr:}' = '{ 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "write_pos": 4200296, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "expire_pos": 4194304, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "trimmed_pos": 4194304, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "stream_format": 1, 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "layout": { 2024-04-24T23:05:16.085 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_unit": 4194304, 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: "stripe_count": 1, 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: "object_size": 4194304, 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_id": 7, 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: "pool_ns": "" 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: } 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:}' ']' 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' '!' '0.000000 0x400000 LID: () 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:25.206593+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.167338+0000 0x4003ac SESSION: () 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255021+0000 0x4004ae OPEN: () 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255588+0000 0x40055a UPDATE: (setattr) 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: / 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.622008+0000 0x400889 UPDATE: (mkdir) 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:06.157490+0000 0x4010a6 UPDATE: (cap update) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:51.995934+0000 0x401768 UPDATE: (mkdir) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.016129+0000 0x402300 UPDATE: (mkdir) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/foo 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.017888+0000 0x402c4a UPDATE: (openc) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.035611+0000 0x403466 UPDATE: (cap update) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.846439+0000 0x403c8f UPDATE: (unlink_local) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000002 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp/foo 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.849002+0000 0x404f49 UPDATE: (unlink_local) 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000003 2024-04-24T23:05:16.087 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.865528+0000 0x405c54 UPDATE: (unlink_local) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000001 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:55.046308+0000 0x406936 UPDATE: (unlink_local) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000000 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344226+0000 0x4074d2 UPDATE: (purge_stray) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000002 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344375+0000 0x407729 UPDATE: (purge_stray) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000003 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344567+0000 0x407980 UPDATE: (purge_stray) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000001 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.461304+0000 0x407bd7 UPDATE: (scatter_writebehind) 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.463178+0000 0x408049 SESSION: () 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:0.000000 0x4080f6 PURGED: ()' = '0.000000 0x400000 LID: () 2024-04-24T23:05:16.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:25.206593+0000 0x400030 SUBTREEMAP: () 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.167338+0000 0x4003ac SESSION: () 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255021+0000 0x4004ae OPEN: () 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.255588+0000 0x40055a UPDATE: (setattr) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: / 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:02:33.622008+0000 0x400889 UPDATE: (mkdir) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:06.157490+0000 0x4010a6 UPDATE: (cap update) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:51.995934+0000 0x401768 UPDATE: (mkdir) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.016129+0000 0x402300 UPDATE: (mkdir) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/foo 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.017888+0000 0x402c4a UPDATE: (openc) 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:52.035611+0000 0x403466 UPDATE: (cap update) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.846439+0000 0x403c8f UPDATE: (unlink_local) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000002 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp/foo 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.849002+0000 0x404f49 UPDATE: (unlink_local) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000003 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: tmp/bar 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:53.865528+0000 0x405c54 UPDATE: (unlink_local) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000001 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: client.0/tmp 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:55.046308+0000 0x406936 UPDATE: (unlink_local) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: client.0 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: stray2/10000000000 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344226+0000 0x4074d2 UPDATE: (purge_stray) 2024-04-24T23:05:16.090 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000002 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344375+0000 0x407729 UPDATE: (purge_stray) 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000003 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:56.344567+0000 0x407980 UPDATE: (purge_stray) 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr: 10000000001 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.461304+0000 0x407bd7 UPDATE: (scatter_writebehind) 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:03:57.463178+0000 0x408049 SESSION: () 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:0.000000 0x4080f6 PURGED: ()' ']' 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stdout:Testing 'journal' commands... 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Testing '\''journal'\'' commands...' 2024-04-24T23:05:16.091 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-04-24T23:05:16.127 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.125+0000 7fa88de18280 1 -- start start 2024-04-24T23:05:16.127 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.125+0000 7fa88de18280 1 Processor -- start 2024-04-24T23:05:16.129 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.129 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 0x5564ccaafb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.129 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1c00 0x5564ccaaf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.129 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564cd82c480 con 0x5564cd7a0400 2024-04-24T23:05:16.129 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564cd82c600 con 0x5564cd7a0800 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5564cd82c780 con 0x5564cd7a1c00 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.126+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34586/0 (socket says 172.21.15.146:34586) 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 -- 172.21.15.146:0/1615187052 learned_addr learned my addr 172.21.15.146:0/1615187052 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88b400640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 0x5564ccaafb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88c800640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1c00 0x5564ccaaf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 -- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1c00 msgr2=0x5564ccaaf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1c00 0x5564ccaaf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 -- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 msgr2=0x5564ccaafb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 0x5564ccaafb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.130 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88be00640 1 -- 172.21.15.146:0/1615187052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564cca76780 con 0x5564cd7a0400 2024-04-24T23:05:16.131 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.127+0000 7fa88b400640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 0x5564ccaafb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa88be00640 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x5564cd867680 tx=0x5564cd7d4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87220d787cbee47d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa888c00640 1 -- 172.21.15.146:0/1615187052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca68d00 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa888c00640 1 -- 172.21.15.146:0/1615187052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564cca6e700 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa888c00640 1 -- 172.21.15.146:0/1615187052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca68680 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564cca76000 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5564cca77a40 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.128+0000 7fa888c00640 1 -- 172.21.15.146:0/1615187052 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5564ccb28e00 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.129+0000 7fa888c00640 1 -- 172.21.15.146:0/1615187052 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5564cca9d180 con 0x5564cd7a0400 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.129+0000 7fa88de18280 1 Processor -- start 2024-04-24T23:05:16.132 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 -- start start 2024-04-24T23:05:16.134 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.134 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564ccaa4180 con 0x5564cd91b000 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564cd82d680 con 0x5564cd91b400 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.130+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5564cd82d500 con 0x5564cd7a1800 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34588/0 (socket says 172.21.15.146:34588) 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 -- 172.21.15.146:0/3940231776 learned_addr learned my addr 172.21.15.146:0/3940231776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88c800640 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 -- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 msgr2=0x5564ccaaeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 -- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 msgr2=0x5564ccab0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.135 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 -- 172.21.15.146:0/3940231776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564cca77860 con 0x5564cd91b000 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.131+0000 7fa88be00640 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x5564cd934b10 tx=0x5564cd7d2600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1094d06471a7fd36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa886400640 1 -- 172.21.15.146:0/3940231776 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca68820 con 0x5564cd91b000 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa886400640 1 -- 172.21.15.146:0/3940231776 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564cca6efc0 con 0x5564cd91b000 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa886400640 1 -- 172.21.15.146:0/3940231776 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca68d00 con 0x5564cd91b000 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 -- 172.21.15.146:0/3940231776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 msgr2=0x5564ccab0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x5564cd934b10 tx=0x5564cd7d2600 comp rx=0 tx=0).stop 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 -- 172.21.15.146:0/3940231776 shutdown_connections 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 --2- 172.21.15.146:0/3940231776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 -- 172.21.15.146:0/3940231776 >> 172.21.15.146:0/3940231776 conn(0x5564cd7a1400 msgr2=0x5564ccb35800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.136 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 -- 172.21.15.146:0/3940231776 shutdown_connections 2024-04-24T23:05:16.137 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.132+0000 7fa88de18280 1 -- 172.21.15.146:0/3940231776 wait complete. 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.133+0000 7fa88de18280 1 Processor -- start 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.133+0000 7fa88de18280 1 -- start start 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564cd82c900 con 0x5564cd91b000 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564cd82ca80 con 0x5564cd91b400 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88de18280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5564cd82c180 con 0x5564cd7a1800 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.139 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34600/0 (socket says 172.21.15.146:34600) 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 -- 172.21.15.146:0/435349831 learned_addr learned my addr 172.21.15.146:0/435349831 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88c800640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 msgr2=0x5564ccaaeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1800 0x5564ccaaeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 msgr2=0x5564ccab0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88b400640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.134+0000 7fa88be00640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd91b400 0x5564ccab0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa88be00640 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564cca76780 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa88be00640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5564cd9357d0 tx=0x5564cd937800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa884600640 1 -- 172.21.15.146:0/435349831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca68680 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa884600640 1 -- 172.21.15.146:0/435349831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5564cca6ee00 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564cca76000 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa884600640 1 -- 172.21.15.146:0/435349831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5564cca684e0 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.135+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564cca77680 con 0x5564cd91b000 2024-04-24T23:05:16.140 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.137+0000 7fa884600640 1 -- 172.21.15.146:0/435349831 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5564cd7a6c00 con 0x5564cd91b000 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.137+0000 7fa884600640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 0x5564ccab1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.137+0000 7fa884600640 1 -- 172.21.15.146:0/435349831 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5564cd7aa600 con 0x5564cd91b000 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.137+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5564cd91b800 0x5564ccab0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.137+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5564cd91bc00 con 0x5564cd91b800 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.138+0000 7fa88c800640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 0x5564ccab1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.138+0000 7fa88b400640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5564cd91b800 0x5564ccab0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.139+0000 7fa88c800640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 0x5564ccab1700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5564cd7bc810 tx=0x5564cd7d4de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.142 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.139+0000 7fa88b400640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5564cd91b800 0x5564ccab0c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.143 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.140+0000 7fa88b400640 1 -- 172.21.15.146:0/435349831 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5564cd7c2000 con 0x5564cd91b800 2024-04-24T23:05:16.143 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.140+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5564cd985800 0x5564ccab1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.143 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.140+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5564cd985c00 con 0x5564cd985800 2024-04-24T23:05:16.143 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.141+0000 7fa88c800640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5564cd985800 0x5564ccab1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.143 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.142+0000 7fa88c800640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5564cd985800 0x5564ccab1180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.144 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.143+0000 7fa88c800640 1 -- 172.21.15.146:0/435349831 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5564cd7c2500 con 0x5564cd985800 2024-04-24T23:05:16.144 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.143+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5564ccdbe000 con 0x5564cd985800 2024-04-24T23:05:16.146 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.144+0000 7fa88c800640 1 -- 172.21.15.146:0/435349831 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv22 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x5564cd7c2500 con 0x5564cd985800 2024-04-24T23:05:16.146 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.144+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5564ccdbe400 0x5564ccdd2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.146 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.144+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5564ccdbe800 con 0x5564ccdbe400 2024-04-24T23:05:16.146 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.145+0000 7fa88be00640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5564ccdbe400 0x5564ccdd2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.147 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88be00640 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5564ccdbe400 0x5564ccdd2000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.148 INFO:tasks.workunit.client.0.smithi146.stdout:Overall journal integrity: OK 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88be00640 1 -- 172.21.15.146:0/435349831 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5564ccdccf00 con 0x5564ccdbe400 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5564ccdbe400 msgr2=0x5564ccdd2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5564ccdbe400 0x5564ccdd2000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5564cd985800 msgr2=0x5564ccab1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5564cd985800 0x5564ccab1180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5564cd91b800 msgr2=0x5564ccab0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5564cd91b800 0x5564ccab0c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88b400640 1 -- 172.21.15.146:0/435349831 reap_dead start 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 msgr2=0x5564ccab1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 0x5564ccab1700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5564cd7bc810 tx=0x5564cd7d4de0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.150 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 msgr2=0x5564ccab0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.146+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5564cd9357d0 tx=0x5564cd937800 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 shutdown_connections 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd91b000 0x5564ccab0100 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/435349831 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5564cd985400 0x5564ccab1700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 >> 172.21.15.146:0/435349831 conn(0x5564cd7a1400 msgr2=0x5564ccb35800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 shutdown_connections 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/435349831 wait complete. 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 msgr2=0x5564ccaaf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x5564cd867680 tx=0x5564cd7d4d20 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 shutdown_connections 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5564cd7a1c00 0x5564ccaaf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564cd7a0800 0x5564ccaafb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 --2- 172.21.15.146:0/1615187052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564cd7a0400 0x5564ccaaf600 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 >> 172.21.15.146:0/1615187052 conn(0x5564cca43000 msgr2=0x5564ccb33800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.151 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 shutdown_connections 2024-04-24T23:05:16.152 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.147+0000 7fa88de18280 1 -- 172.21.15.146:0/1615187052 wait complete. 2024-04-24T23:05:16.154 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-04-24T23:05:16.199 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.196+0000 7fd6bf40c280 1 -- start start 2024-04-24T23:05:16.199 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.197+0000 7fd6bf40c280 1 Processor -- start 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.197+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e898b8c00 0x563e89924580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e898b9800 0x563e89924b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563e8a61a600 con 0x563e898b9c00 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e8a61a480 con 0x563e898b9800 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563e8a61a300 con 0x563e898b8c00 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34632/0 (socket says 172.21.15.146:34632) 2024-04-24T23:05:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 -- 172.21.15.146:0/594533176 learned_addr learned my addr 172.21.15.146:0/594533176 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bc800640 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e898b8c00 0x563e89924580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 -- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e898b8c00 msgr2=0x563e89924580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e898b8c00 0x563e89924580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e898b9800 0x563e89924b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 -- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e898b9800 msgr2=0x563e89924b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e898b9800 0x563e89924b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.198+0000 7fd6bd200640 1 -- 172.21.15.146:0/594533176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e898ec780 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6bd200640 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563e8a6cb380 tx=0x563e8a649e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570bddac3bdeb940 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6b9600640 1 -- 172.21.15.146:0/594533176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de9c0 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6b9600640 1 -- 172.21.15.146:0/594533176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563e898e4c40 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6b9600640 1 -- 172.21.15.146:0/594533176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de680 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e898ec3c0 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563e898ed680 con 0x563e898b9c00 2024-04-24T23:05:16.202 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6b9600640 1 -- 172.21.15.146:0/594533176 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x563e89bb2200 con 0x563e898b9c00 2024-04-24T23:05:16.203 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.199+0000 7fd6b9600640 1 -- 172.21.15.146:0/594533176 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x563e89913180 con 0x563e898b9c00 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.200+0000 7fd6bf40c280 1 Processor -- start 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.200+0000 7fd6bf40c280 1 -- start start 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89925600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89925b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563e8a61a180 con 0x563e89c16800 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e8991a900 con 0x563e89c16400 2024-04-24T23:05:16.205 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563e8991a480 con 0x563e89c16000 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34648/0 (socket says 172.21.15.146:34648) 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.201+0000 7fd6bbe00640 1 -- 172.21.15.146:0/540115931 learned_addr learned my addr 172.21.15.146:0/540115931 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89925600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 -- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 msgr2=0x563e89925600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bc800640 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89925b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89925600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 -- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 msgr2=0x563e89925b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89925b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 -- 172.21.15.146:0/540115931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e898ed4a0 con 0x563e89c16800 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x563e89bc6b10 tx=0x563e89bcacc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1554207e39bffc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6b6e00640 1 -- 172.21.15.146:0/540115931 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de9c0 con 0x563e89c16800 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6b6e00640 1 -- 172.21.15.146:0/540115931 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563e898e4700 con 0x563e89c16800 2024-04-24T23:05:16.206 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.202+0000 7fd6b6e00640 1 -- 172.21.15.146:0/540115931 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de680 con 0x563e89c16800 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 -- 172.21.15.146:0/540115931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 msgr2=0x563e89926100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x563e89bc6b10 tx=0x563e89bcacc0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 -- 172.21.15.146:0/540115931 shutdown_connections 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926100 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89925b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/540115931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89925600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 -- 172.21.15.146:0/540115931 >> 172.21.15.146:0/540115931 conn(0x563e8a647c00 msgr2=0x563e899c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 -- 172.21.15.146:0/540115931 shutdown_connections 2024-04-24T23:05:16.207 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.203+0000 7fd6bf40c280 1 -- 172.21.15.146:0/540115931 wait complete. 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 Processor -- start 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 -- start start 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89927180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89926c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563e8a61b380 con 0x563e89c16800 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e8a61a180 con 0x563e89c16400 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.204+0000 7fd6bf40c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563e8a61ac00 con 0x563e89c16000 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34664/0 (socket says 172.21.15.146:34664) 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 -- 172.21.15.146:0/521959107 learned_addr learned my addr 172.21.15.146:0/521959107 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.209 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89927180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 msgr2=0x563e89927180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e89c16000 0x563e89927180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 msgr2=0x563e89926c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e89c16400 0x563e89926c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 -- 172.21.15.146:0/521959107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e898ec000 con 0x563e89c16800 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.205+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x563e89bc77d0 tx=0x563e89bcac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.206+0000 7fd6b5000640 1 -- 172.21.15.146:0/521959107 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de4e0 con 0x563e89c16800 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.206+0000 7fd6b5000640 1 -- 172.21.15.146:0/521959107 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563e898e48c0 con 0x563e89c16800 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.206+0000 7fd6b5000640 1 -- 172.21.15.146:0/521959107 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563e898de9c0 con 0x563e89c16800 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.206+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e898ec960 con 0x563e89c16800 2024-04-24T23:05:16.210 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.206+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e898ed860 con 0x563e89c16800 2024-04-24T23:05:16.211 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.207+0000 7fd6b5000640 1 -- 172.21.15.146:0/521959107 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x563e89c26c00 con 0x563e89c16800 2024-04-24T23:05:16.211 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.208+0000 7fd6b5000640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x563e89c20400 0x563e89927700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.211 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.208+0000 7fd6b5000640 1 -- 172.21.15.146:0/521959107 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x563e89c24a00 con 0x563e89c16800 2024-04-24T23:05:16.211 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.208+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x563e89c16c00 0x563e89926100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.211 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.208+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x563e89c17000 con 0x563e89c16c00 2024-04-24T23:05:16.212 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.209+0000 7fd6bc800640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x563e89c20400 0x563e89927700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.212 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.209+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x563e89c16c00 0x563e89926100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.212 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.210+0000 7fd6bc800640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x563e89c20400 0x563e89927700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563e89998870 tx=0x563e89d240c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.212 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.210+0000 7fd6bbe00640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x563e89c16c00 0x563e89926100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.213 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.211+0000 7fd6bbe00640 1 -- 172.21.15.146:0/521959107 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563e8a638000 con 0x563e89c16c00 2024-04-24T23:05:16.213 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.211+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x563e89c21400 0x563e89925b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.213 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.211+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x563e89c21800 con 0x563e89c21400 2024-04-24T23:05:16.214 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.212+0000 7fd6bd200640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x563e89c21400 0x563e89925b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.215 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.213+0000 7fd6bd200640 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x563e89c21400 0x563e89925b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bd200640 1 -- 172.21.15.146:0/521959107 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563e8a638500 con 0x563e89c21400 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout:{ 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout: "write_pos": 4200296, 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout: "expire_pos": 4194304, 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout: "trimmed_pos": 4194304, 2024-04-24T23:05:16.216 INFO:tasks.workunit.client.0.smithi146.stdout: "stream_format": 1, 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "layout": { 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_unit": 4194304, 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_count": 1, 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "object_size": 4194304, 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_id": 7, 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_ns": "" 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: } 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout:} 2024-04-24T23:05:16.217 INFO:tasks.workunit.client.0.smithi146.stdout: 2024-04-24T23:05:16.218 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x563e89c21400 msgr2=0x563e89925b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x563e89c21400 0x563e89925b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x563e89c16c00 msgr2=0x563e89926100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x563e89c16c00 0x563e89926100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x563e89c20400 msgr2=0x563e89927700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x563e89c20400 0x563e89927700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563e89998870 tx=0x563e89d240c0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 msgr2=0x563e89926680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/521959107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e89c16800 0x563e89926680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x563e89bc77d0 tx=0x563e89bcac00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bc800640 1 -- 172.21.15.146:0/521959107 reap_dead start 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bc800640 1 -- 172.21.15.146:0/521959107 reap_dead start 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 shutdown_connections 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 >> 172.21.15.146:0/521959107 conn(0x563e8a647c00 msgr2=0x563e899c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 shutdown_connections 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.214+0000 7fd6bf40c280 1 -- 172.21.15.146:0/521959107 wait complete. 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 msgr2=0x563e89925080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.219 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x563e8a6cb380 tx=0x563e8a649e00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 shutdown_connections 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563e898b9c00 0x563e89925080 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e898b9800 0x563e89924b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 --2- 172.21.15.146:0/594533176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563e898b8c00 0x563e89924580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 >> 172.21.15.146:0/594533176 conn(0x563e898b9000 msgr2=0x563e899c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 shutdown_connections 2024-04-24T23:05:16.220 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.215+0000 7fd6bf40c280 1 -- 172.21.15.146:0/594533176 wait complete. 2024-04-24T23:05:16.222 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-04-24T23:05:16.269 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.267+0000 7f7ada6d2280 1 -- start start 2024-04-24T23:05:16.269 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.267+0000 7f7ada6d2280 1 Processor -- start 2024-04-24T23:05:16.270 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56147251ec00 0x56147258a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 0x56147258b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561473280180 con 0x56147251f800 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561473280300 con 0x56147251ec00 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561473280480 con 0x56147251fc00 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ad7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ad7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34670/0 (socket says 172.21.15.146:34670) 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ad7e00640 1 -- 172.21.15.146:0/189146890 learned_addr learned my addr 172.21.15.146:0/189146890 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ad8800640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56147251ec00 0x56147258a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.268+0000 7f7ad9200640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 0x56147258b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 -- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 msgr2=0x56147258b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 0x56147258b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 -- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56147251ec00 msgr2=0x56147258a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.271 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56147251ec00 0x56147258a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.272 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 -- 172.21.15.146:0/189146890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561472552780 con 0x56147251f800 2024-04-24T23:05:16.272 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad9200640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 0x56147258b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.272 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5614733373b0 tx=0x5614732ae780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3348af068493a348 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad5600640 1 -- 172.21.15.146:0/189146890 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561472544680 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad5600640 1 -- 172.21.15.146:0/189146890 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56147254aa80 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad5600640 1 -- 172.21.15.146:0/189146890 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561472544b60 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614725534a0 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561472552000 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.269+0000 7f7ad5600640 1 -- 172.21.15.146:0/189146890 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5614733ee600 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.270+0000 7f7ad5600640 1 -- 172.21.15.146:0/189146890 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x561472579180 con 0x56147251f800 2024-04-24T23:05:16.274 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.270+0000 7f7ada6d2280 1 Processor -- start 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 -- start start 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 0x56147258bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7c00 0x56147258c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561473280600 con 0x5614733e7400 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561473280780 con 0x5614733e7c00 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.271+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561473280900 con 0x5614733e7800 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34686/0 (socket says 172.21.15.146:34686) 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 -- 172.21.15.146:0/10808690 learned_addr learned my addr 172.21.15.146:0/10808690 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad8800640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 0x56147258bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 -- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 msgr2=0x56147258bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 0x56147258bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.275 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7c00 0x56147258c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.276 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 -- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7c00 msgr2=0x56147258c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.276 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7c00 0x56147258c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.276 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 -- 172.21.15.146:0/10808690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614725523c0 con 0x5614733e7400 2024-04-24T23:05:16.276 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad8800640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 0x56147258bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.276 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.272+0000 7f7ad9200640 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x5614734027b0 tx=0x5614732afec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b0da3b5acd99b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.278 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ad2e00640 1 -- 172.21.15.146:0/10808690 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5614725449c0 con 0x5614733e7400 2024-04-24T23:05:16.278 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ad2e00640 1 -- 172.21.15.146:0/10808690 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56147254afc0 con 0x5614733e7400 2024-04-24T23:05:16.278 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ad2e00640 1 -- 172.21.15.146:0/10808690 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561472544680 con 0x5614733e7400 2024-04-24T23:05:16.278 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 -- 172.21.15.146:0/10808690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 msgr2=0x56147258b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x5614734027b0 tx=0x5614732afec0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 -- 172.21.15.146:0/10808690 shutdown_connections 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7c00 0x56147258c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7800 0x56147258bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/10808690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258b600 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 -- 172.21.15.146:0/10808690 >> 172.21.15.146:0/10808690 conn(0x5614733e7000 msgr2=0x561472629000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 -- 172.21.15.146:0/10808690 shutdown_connections 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.273+0000 7f7ada6d2280 1 -- 172.21.15.146:0/10808690 wait complete. 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.274+0000 7f7ada6d2280 1 Processor -- start 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.274+0000 7f7ada6d2280 1 -- start start 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7800 0x56147258cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7c00 0x56147258c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.279 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561472580900 con 0x5614733e7400 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561473281e00 con 0x5614733e7800 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561473280d80 con 0x5614733e7c00 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34700/0 (socket says 172.21.15.146:34700) 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 learned_addr learned my addr 172.21.15.146:0/1958353959 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7800 0x56147258cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7c00 msgr2=0x56147258c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5614733e7c00 0x56147258c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7800 msgr2=0x56147258cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5614733e7800 0x56147258cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.275+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561472552780 con 0x5614733e7400 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x561473402ae0 tx=0x5614732ae6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ad1000640 1 -- 172.21.15.146:0/1958353959 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561472544b60 con 0x5614733e7400 2024-04-24T23:05:16.280 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ad1000640 1 -- 172.21.15.146:0/1958353959 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56147254ae00 con 0x5614733e7400 2024-04-24T23:05:16.281 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614725534a0 con 0x5614733e7400 2024-04-24T23:05:16.281 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ad1000640 1 -- 172.21.15.146:0/1958353959 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5614725444e0 con 0x5614733e7400 2024-04-24T23:05:16.281 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.276+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561472552960 con 0x5614733e7400 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.278+0000 7f7ad1000640 1 -- 172.21.15.146:0/1958353959 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56147330ec00 con 0x5614733e7400 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.279+0000 7f7ad1000640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 0x56147258d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.279+0000 7f7ad1000640 1 -- 172.21.15.146:0/1958353959 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x561473312600 con 0x5614733e7400 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.279+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561473458800 0x56147258c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.279+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561473458c00 con 0x561473458800 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.279+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 0x56147258d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.282 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.280+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561473458800 0x56147258c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.283 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.280+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 0x56147258d700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5614725fe690 tx=0x561472812ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.283 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.281+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561473458800 0x56147258c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.283 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.281+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1958353959 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x56147329e000 con 0x561473458800 2024-04-24T23:05:16.283 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.282+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561473459000 0x56147258bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.283 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.282+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561473459400 con 0x561473459000 2024-04-24T23:05:16.284 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.282+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561473459000 0x56147258bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.285 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.283+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561473459000 0x56147258bb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.286 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.284+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56147329e500 con 0x561473459000 2024-04-24T23:05:16.286 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.284+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561473459800 con 0x561473459000 2024-04-24T23:05:16.287 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.285+0000 7f7ad9200640 1 -- 172.21.15.146:0/1958353959 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv22 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x56147329e500 con 0x561473459000 2024-04-24T23:05:16.287 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.285+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472892800 0x56147258b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.287 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.285+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561472892c00 con 0x561472892800 2024-04-24T23:05:16.287 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.286+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472892800 0x56147258b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.288 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.287+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472892800 0x56147258b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.289 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.287+0000 7f7ad8800640 1 -- 172.21.15.146:0/1958353959 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5614728aef00 con 0x561472892800 2024-04-24T23:05:16.290 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.288+0000 7f7ada6d2280 1 -- start start 2024-04-24T23:05:16.290 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.288+0000 7f7ada6d2280 1 Processor -- start 2024-04-24T23:05:16.291 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 0x561472902000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.291 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561472893800 0x561472902580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561472893c00 0x561472902b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561473280780 con 0x561472893400 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561473280a80 con 0x561472893800 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.289+0000 7f7ada6d2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561473280900 con 0x561472893c00 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 0x561472902000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 0x561472902000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34706/0 (socket says 172.21.15.146:34706) 2024-04-24T23:05:16.292 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 -- 172.21.15.146:0/1874488314 learned_addr learned my addr 172.21.15.146:0/1874488314 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561472893c00 0x561472902b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561472893800 0x561472902580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561472893c00 msgr2=0x561472902b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561472893c00 0x561472902b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561472893800 msgr2=0x561472902580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561472893800 0x561472902580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561472553680 con 0x561472893400 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561472893c00 0x561472902b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561472893800 0x561472902580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.290+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 0x561472902000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x561472845770 tx=0x56147290a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3558d13bdebee95d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.294 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7acd400640 1 -- 172.21.15.146:0/1874488314 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56147280eb60 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7acd400640 1 -- 172.21.15.146:0/1874488314 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56147254ac40 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7acd400640 1 -- 172.21.15.146:0/1874488314 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56147280ed00 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614725523c0 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561472552780 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7acd400640 1 -- 172.21.15.146:0/1874488314 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x56147290c600 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7acd400640 1 -- 172.21.15.146:0/1874488314 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x561472579500 con 0x561472893400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561472923400 0x561472903080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.291+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561472923800 con 0x561472923400 2024-04-24T23:05:16.295 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.292+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561472923400 0x561472903080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.296 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.293+0000 7f7ad8800640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561472923400 0x561472903080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=9856c5026fe7a207 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.296 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.294+0000 7f7ad8800640 1 -- 172.21.15.146:0/1874488314 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5614728aef00 con 0x561472923400 2024-04-24T23:05:16.296 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.294+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561472923c00 0x561472903600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.296 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.294+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56147292a000 con 0x561472923c00 2024-04-24T23:05:16.296 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.294+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561472923c00 0x561472903600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.297 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.295+0000 7f7ad7e00640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561472923c00 0x561472903600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=635201c92ca00d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.298 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.296+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1874488314 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56147329e000 con 0x561472923c00 2024-04-24T23:05:16.298 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.296+0000 7f7acb600640 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x561472930000 con 0x561472923c00 2024-04-24T23:05:16.298 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.296+0000 7f7acb600640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472930400 0x561472904680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.298 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.296+0000 7f7acb600640 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x561472930800 con 0x561472930400 2024-04-24T23:05:16.299 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.297+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472930400 0x561472904680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.299 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.297+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1874488314 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x56147329e000 con 0x561472923c00 2024-04-24T23:05:16.299 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.298+0000 7f7ad9200640 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472930400 0x561472904680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=7fc882a40ad1bc5f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.300 INFO:tasks.workunit.client.0.smithi146.stdout:journal is 4194304~33090 2024-04-24T23:05:16.300 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.298+0000 7f7ad9200640 1 -- 172.21.15.146:0/1874488314 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56147329e500 con 0x561472930400 2024-04-24T23:05:16.301 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.299+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:2e2fa760:::200.00000001:head [read 0~33090] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56147292a400 con 0x561472923c00 2024-04-24T23:05:16.301 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1874488314 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000001 [read 0~33090 out=33090b] v0'0 uv22 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x56147329e000 con 0x561472923c00 2024-04-24T23:05:16.302 INFO:tasks.workunit.client.0.smithi146.stdout:wrote 33090 bytes at offset 4194304 to /tmp/journal.bin 2024-04-24T23:05:16.302 INFO:tasks.workunit.client.0.smithi146.stdout:NOTE: this is a _sparse_ file; you can 2024-04-24T23:05:16.302 INFO:tasks.workunit.client.0.smithi146.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-04-24T23:05:16.302 INFO:tasks.workunit.client.0.smithi146.stdout: to efficiently compress it while preserving sparseness. 2024-04-24T23:05:16.304 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472930400 msgr2=0x561472904680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.304 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472930400 0x561472904680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.304 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561472923c00 msgr2=0x561472903600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.304 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561472923c00 0x561472903600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.304 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561472923400 msgr2=0x561472903080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561472923400 0x561472903080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 msgr2=0x561472902000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1874488314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561472893400 0x561472902000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x561472845770 tx=0x56147290a060 comp rx=0 tx=0).stop 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1874488314 reap_dead start 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ad7e00640 1 -- 172.21.15.146:0/1874488314 reap_dead start 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 shutdown_connections 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 >> 172.21.15.146:0/1874488314 conn(0x561472893000 msgr2=0x561472629800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 shutdown_connections 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.300+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1874488314 wait complete. 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472892800 msgr2=0x56147258b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x561472892800 0x56147258b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561473459000 msgr2=0x56147258bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.305 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561473459000 0x56147258bb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561473458800 msgr2=0x56147258c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561473458800 0x56147258c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ad8800640 1 -- 172.21.15.146:0/1958353959 reap_dead start 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 msgr2=0x56147258d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 0x56147258d700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5614725fe690 tx=0x561472812ae0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 msgr2=0x56147258d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x561473402ae0 tx=0x5614732ae6c0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 shutdown_connections 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561473458400 0x56147258d700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/1958353959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614733e7400 0x56147258d180 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 >> 172.21.15.146:0/1958353959 conn(0x5614733e7000 msgr2=0x561472629000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.306 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 shutdown_connections 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.301+0000 7f7ada6d2280 1 -- 172.21.15.146:0/1958353959 wait complete. 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 msgr2=0x56147258ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5614733373b0 tx=0x5614732ae780 comp rx=0 tx=0).stop 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 shutdown_connections 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56147251fc00 0x56147258b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56147251f800 0x56147258ab00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 --2- 172.21.15.146:0/189146890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56147251ec00 0x56147258a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 >> 172.21.15.146:0/189146890 conn(0x56147251f000 msgr2=0x561472628800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 shutdown_connections 2024-04-24T23:05:16.307 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.302+0000 7f7ada6d2280 1 -- 172.21.15.146:0/189146890 wait complete. 2024-04-24T23:05:16.309 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' '!' -s /tmp/journal.bin ']' 2024-04-24T23:05:16.309 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset 2024-04-24T23:05:16.354 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.352+0000 7fa2a0410280 1 -- start start 2024-04-24T23:05:16.354 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.352+0000 7fa2a0410280 1 Processor -- start 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c314f800 0x5625c31bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 0x5625c31bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb0180 con 0x5625c314ec00 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625c31b0480 con 0x5625c314f800 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5625c31b0900 con 0x5625c314fc00 2024-04-24T23:05:16.355 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa29d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.356 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa29d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34734/0 (socket says 172.21.15.146:34734) 2024-04-24T23:05:16.356 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.353+0000 7fa29d600640 1 -- 172.21.15.146:0/2767469019 learned_addr learned my addr 172.21.15.146:0/2767469019 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29e000640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 0x5625c31bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29cc00640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c314f800 0x5625c31bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 -- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 msgr2=0x5625c31bb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 0x5625c31bb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 -- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c314f800 msgr2=0x5625c31bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c314f800 0x5625c31bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.357 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 -- 172.21.15.146:0/2767469019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c3182780 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29e000640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 0x5625c31bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29d600640 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5625c3f67380 tx=0x5625c3edfec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d856474eafe041 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29a400640 1 -- 172.21.15.146:0/2767469019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174680 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29a400640 1 -- 172.21.15.146:0/2767469019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5625c317a700 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa29a400640 1 -- 172.21.15.146:0/2767469019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174b60 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c31834a0 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.354+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5625c3182000 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.355+0000 7fa29a400640 1 -- 172.21.15.146:0/2767469019 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5625c4012600 con 0x5625c314ec00 2024-04-24T23:05:16.358 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.355+0000 7fa29a400640 1 -- 172.21.15.146:0/2767469019 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5625c31a9180 con 0x5625c314ec00 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.356+0000 7fa2a0410280 1 Processor -- start 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.356+0000 7fa2a0410280 1 -- start start 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625c31b0180 con 0x5625c4015400 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb1500 con 0x5625c4015c00 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5625c3eb1380 con 0x5625c4015800 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34750/0 (socket says 172.21.15.146:34750) 2024-04-24T23:05:16.360 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 -- 172.21.15.146:0/1072564070 learned_addr learned my addr 172.21.15.146:0/1072564070 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29cc00640 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 -- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015800 msgr2=0x5625c31ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 -- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015c00 msgr2=0x5625c31bc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.357+0000 7fa29e000640 1 -- 172.21.15.146:0/1072564070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c31823c0 con 0x5625c4015400 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa29e000640 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x5625c4030810 tx=0x5625c40338c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c29738eda1df2e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa297c00640 1 -- 172.21.15.146:0/1072564070 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174680 con 0x5625c4015400 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa297c00640 1 -- 172.21.15.146:0/1072564070 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5625c317afc0 con 0x5625c4015400 2024-04-24T23:05:16.361 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa297c00640 1 -- 172.21.15.146:0/1072564070 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174b60 con 0x5625c4015400 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 -- 172.21.15.146:0/1072564070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 msgr2=0x5625c31bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x5625c4030810 tx=0x5625c40338c0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 -- 172.21.15.146:0/1072564070 shutdown_connections 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1072564070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.358+0000 7fa2a0410280 1 -- 172.21.15.146:0/1072564070 >> 172.21.15.146:0/1072564070 conn(0x5625c4015000 msgr2=0x5625c3259000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.359+0000 7fa2a0410280 1 -- 172.21.15.146:0/1072564070 shutdown_connections 2024-04-24T23:05:16.364 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.359+0000 7fa2a0410280 1 -- 172.21.15.146:0/1072564070 wait complete. 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.359+0000 7fa2a0410280 1 Processor -- start 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.359+0000 7fa2a0410280 1 -- start start 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb0780 con 0x5625c4015400 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb0900 con 0x5625c4015800 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5625c3eb0600 con 0x5625c4015c00 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa29e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa29e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34756/0 (socket says 172.21.15.146:34756) 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.360+0000 7fa29e000640 1 -- 172.21.15.146:0/2000511706 learned_addr learned my addr 172.21.15.146:0/2000511706 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 -- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015c00 msgr2=0x5625c31bc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.365 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 -- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015800 msgr2=0x5625c31ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 -- 172.21.15.146:0/2000511706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c3182780 con 0x5625c4015400 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa29e000640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5625c40314d0 tx=0x5625c4033800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa295e00640 1 -- 172.21.15.146:0/2000511706 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c31744e0 con 0x5625c4015400 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa295e00640 1 -- 172.21.15.146:0/2000511706 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5625c317aa80 con 0x5625c4015400 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa295e00640 1 -- 172.21.15.146:0/2000511706 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174680 con 0x5625c4015400 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c31834a0 con 0x5625c4015400 2024-04-24T23:05:16.366 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.361+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c3182960 con 0x5625c4015400 2024-04-24T23:05:16.367 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.363+0000 7fa295e00640 1 -- 172.21.15.146:0/2000511706 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5625c4092c00 con 0x5625c4015400 2024-04-24T23:05:16.367 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.364+0000 7fa295e00640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 0x5625c34be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.367 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.364+0000 7fa295e00640 1 -- 172.21.15.146:0/2000511706 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5625c4090a00 con 0x5625c4015400 2024-04-24T23:05:16.367 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.364+0000 7fa29d600640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 0x5625c34be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.368 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.365+0000 7fa2a0410280 1 -- start start 2024-04-24T23:05:16.368 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.365+0000 7fa2a0410280 1 Processor -- start 2024-04-24T23:05:16.368 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.365+0000 7fa29d600640 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 0x5625c34be000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5625c40305a0 tx=0x5625c3ede900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c408b800 0x5625c31bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c3513000 0x5625c31bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb1980 con 0x5625c408bc00 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625c3eb1b00 con 0x5625c408b800 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa2a0410280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5625c3eb1c80 con 0x5625c3513000 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa29d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.370 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa29d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34768/0 (socket says 172.21.15.146:34768) 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.366+0000 7fa29d600640 1 -- 172.21.15.146:0/1788823286 learned_addr learned my addr 172.21.15.146:0/1788823286 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c408b800 0x5625c31bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c3513000 msgr2=0x5625c31bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c3513000 0x5625c31bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c408b800 msgr2=0x5625c31bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c408b800 0x5625c31bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c3183680 con 0x5625c408bc00 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa29d600640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5625c34737a0 tx=0x5625c3edfe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d4448590aac4a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa292200640 1 -- 172.21.15.146:0/1788823286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c3174820 con 0x5625c408bc00 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa292200640 1 -- 172.21.15.146:0/1788823286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5625c317ae00 con 0x5625c408bc00 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa292200640 1 -- 172.21.15.146:0/1788823286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c40c3d40 con 0x5625c408bc00 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c31823c0 con 0x5625c408bc00 2024-04-24T23:05:16.371 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.367+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5625c3182780 con 0x5625c408bc00 2024-04-24T23:05:16.372 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.368+0000 7fa292200640 1 -- 172.21.15.146:0/1788823286 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5625c3522200 con 0x5625c408bc00 2024-04-24T23:05:16.372 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.368+0000 7fa292200640 1 -- 172.21.15.146:0/1788823286 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5625c31a9500 con 0x5625c408bc00 2024-04-24T23:05:16.372 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.368+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 0x5625c31bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.372 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.368+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5625c3513800 con 0x5625c3513400 2024-04-24T23:05:16.372 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.369+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 0x5625c31bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.373 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.369+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 0x5625c31bd700 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=8dac71dcb21f1c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.373 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.370+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3513400 2024-04-24T23:05:16.373 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.370+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 0x5625c34be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.373 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.370+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5625c3531800 con 0x5625c3513c00 2024-04-24T23:05:16.373 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.371+0000 7fa29cc00640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 0x5625c34be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.374 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.372+0000 7fa29cc00640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 0x5625c34be580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=f623aefa68de9286 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.375 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.373+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5625c3ece500 con 0x5625c3513c00 2024-04-24T23:05:16.375 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.373+0000 7fa290400640 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5625c3edd400 con 0x5625c3513c00 2024-04-24T23:05:16.375 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.373+0000 7fa290400640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 0x5625c34c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.375 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.373+0000 7fa290400640 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5625c3edc800 con 0x5625c3edd000 2024-04-24T23:05:16.376 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.374+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 0x5625c34c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.376 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.374+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5625c3ece500 con 0x5625c3513c00 2024-04-24T23:05:16.376 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.375+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 0x5625c34c0c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=4e53975cea9faed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.377 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.375+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3edd000 2024-04-24T23:05:16.377 INFO:tasks.workunit.client.0.smithi146.stdout:old journal was 4194304~33090 2024-04-24T23:05:16.377 INFO:tasks.workunit.client.0.smithi146.stdout:new journal start will be 8388608 (4161214 bytes past old end) 2024-04-24T23:05:16.377 INFO:tasks.workunit.client.0.smithi146.stdout:writing journal head 2024-04-24T23:05:16.378 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.375+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3531c00 con 0x5625c3513c00 2024-04-24T23:05:16.381 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.379+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v57'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece500 con 0x5625c3513c00 2024-04-24T23:05:16.381 INFO:tasks.workunit.client.0.smithi146.stdout:writing EResetJournal entry 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:6 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3531800 con 0x5625c3edd000 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 0x5625c34beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:7 7.b 7:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3552000 con 0x5625c3edcc00 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 0x5625c34bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:8 7.1f 7:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3552800 con 0x5625c3552400 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 0x5625c34bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:9 7.1a 7:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3553000 con 0x5625c3552c00 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:10 7.1e 7:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3553400 con 0x5625c3513400 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:11 7.1d 7:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3553800 con 0x5625c3513c00 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa29cc00640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 0x5625c34bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 0x5625c34bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.383 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.380+0000 7fa29d600640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 0x5625c34beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.384 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.381+0000 7fa29e000640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 0x5625c34bf600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=dea73a4f6f30fe5b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.384 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.381+0000 7fa29cc00640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 0x5625c34bf080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=fcab692dc062c69c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.384 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.382+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(9 200.00000005 [delete] v57'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3552c00 2024-04-24T23:05:16.384 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.382+0000 7fa29d600640 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 0x5625c34beb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=7ea0d42ee7132cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.385 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.383+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(11 200.00000007 [delete] v57'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece500 con 0x5625c3513c00 2024-04-24T23:05:16.387 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.385+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(8 200.00000004 [delete] v57'5 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece500 con 0x5625c3552400 2024-04-24T23:05:16.387 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.386+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(10 200.00000006 [delete] v57'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3513400 2024-04-24T23:05:16.389 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.387+0000 7fa29d600640 1 -- 172.21.15.146:0/1788823286 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(7 200.00000003 [delete] v57'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece780 con 0x5625c3edcc00 2024-04-24T23:05:16.389 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.388+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(6 200.00000002 [delete] v57'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3edd000 2024-04-24T23:05:16.389 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.388+0000 7fa290400640 1 -- 172.21.15.146:0/1788823286 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:12 7.1b 7:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5625c3531800 con 0x5625c3edd000 2024-04-24T23:05:16.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.391+0000 7fa29e000640 1 -- 172.21.15.146:0/1788823286 <== osd.4 v2:172.21.15.203:6810/306347931 3 ==== osd_op_reply(12 200.00000002 [write 0~48] v57'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5625c3ece000 con 0x5625c3edd000 2024-04-24T23:05:16.394 INFO:tasks.workunit.client.0.smithi146.stdout:done 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 msgr2=0x5625c34bf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 0x5625c34bf080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 msgr2=0x5625c34bf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 0x5625c34bf600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 msgr2=0x5625c34c0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 0x5625c34c0c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 msgr2=0x5625c34be580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 0x5625c34be580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 msgr2=0x5625c34beb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 0x5625c34beb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 msgr2=0x5625c31bd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 0x5625c31bd700 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 msgr2=0x5625c31bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5625c34737a0 tx=0x5625c3edfe60 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 shutdown_connections 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5625c3edcc00 0x5625c34beb00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 reap_dead start 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5625c3513c00 0x5625c34be580 crc :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5625c3513400 0x5625c31bd700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5625c3edd000 0x5625c34c0c00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c3513000 0x5625c31bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x5625c3552400 0x5625c34bf080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c408bc00 0x5625c31bcc00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x5625c3552c00 0x5625c34bf600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 --2- 172.21.15.146:0/1788823286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c408b800 0x5625c31bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 >> 172.21.15.146:0/1788823286 conn(0x5625c408b400 msgr2=0x5625c3259800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 reap_dead start 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 reap_dead start 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa29cc00640 1 -- 172.21.15.146:0/1788823286 reap_dead start 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 shutdown_connections 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.392+0000 7fa2a0410280 1 -- 172.21.15.146:0/1788823286 wait complete. 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 msgr2=0x5625c34be000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 0x5625c34be000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5625c40305a0 tx=0x5625c3ede900 comp rx=0 tx=0).stop 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 msgr2=0x5625c31bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5625c40314d0 tx=0x5625c4033800 comp rx=0 tx=0).stop 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 shutdown_connections 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5625c408b000 0x5625c34be000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c4015c00 0x5625c31bc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c4015800 0x5625c31ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2000511706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c4015400 0x5625c31bab00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 >> 172.21.15.146:0/2000511706 conn(0x5625c4015000 msgr2=0x5625c3259000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 shutdown_connections 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2000511706 wait complete. 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.393+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 msgr2=0x5625c31bbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x5625c3f67380 tx=0x5625c3edfec0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 shutdown_connections 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5625c314fc00 0x5625c31bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625c314f800 0x5625c31bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 --2- 172.21.15.146:0/2767469019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625c314ec00 0x5625c31bbb80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 >> 172.21.15.146:0/2767469019 conn(0x5625c314f000 msgr2=0x5625c3258800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 shutdown_connections 2024-04-24T23:05:16.399 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.394+0000 7fa2a0410280 1 -- 172.21.15.146:0/2767469019 wait complete. 2024-04-24T23:05:16.400 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-04-24T23:05:16.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.450+0000 7f8250861280 1 -- start start 2024-04-24T23:05:16.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.450+0000 7f8250861280 1 Processor -- start 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34d513c00 0x55f34d57eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e2a0400 0x55f34d57f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4000 con 0x55f34e2a0800 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4180 con 0x55f34e2a0400 2024-04-24T23:05:16.453 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f34e2e4300 con 0x55f34d513c00 2024-04-24T23:05:16.455 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.451+0000 7f824e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.455 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34776/0 (socket says 172.21.15.146:34776) 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 -- 172.21.15.146:0/3690768071 learned_addr learned my addr 172.21.15.146:0/3690768071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824f400640 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e2a0400 0x55f34d57f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824ea00640 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34d513c00 0x55f34d57eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 -- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34d513c00 msgr2=0x55f34d57eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34d513c00 0x55f34d57eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 -- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e2a0400 msgr2=0x55f34d57f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e2a0400 0x55f34d57f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 -- 172.21.15.146:0/3690768071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34d546780 con 0x55f34e2a0800 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824e000640 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55f34e3353b0 tx=0x55f34e2a2720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ca53013ef732f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.452+0000 7f824b800640 1 -- 172.21.15.146:0/3690768071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d5389c0 con 0x55f34e2a0800 2024-04-24T23:05:16.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f824b800640 1 -- 172.21.15.146:0/3690768071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f34d53ea80 con 0x55f34e2a0800 2024-04-24T23:05:16.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f824b800640 1 -- 172.21.15.146:0/3690768071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d538b60 con 0x55f34e2a0800 2024-04-24T23:05:16.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34d546000 con 0x55f34e2a0800 2024-04-24T23:05:16.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f34d547a40 con 0x55f34e2a0800 2024-04-24T23:05:16.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f824b800640 1 -- 172.21.15.146:0/3690768071 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55f34e3ee800 con 0x55f34e2a0800 2024-04-24T23:05:16.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.453+0000 7f824b800640 1 -- 172.21.15.146:0/3690768071 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55f34d56d180 con 0x55f34e2a0800 2024-04-24T23:05:16.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.454+0000 7f8250861280 1 Processor -- start 2024-04-24T23:05:16.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.454+0000 7f8250861280 1 -- start start 2024-04-24T23:05:16.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4480 con 0x55f34e448000 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4600 con 0x55f34e448400 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f34e2e4780 con 0x55f34e448800 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34784/0 (socket says 172.21.15.146:34784) 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 -- 172.21.15.146:0/2889248370 learned_addr learned my addr 172.21.15.146:0/2889248370 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 -- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448800 msgr2=0x55f34d580680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 -- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448400 msgr2=0x55f34d580100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.455+0000 7f824f400640 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f824f400640 1 -- 172.21.15.146:0/2889248370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34d547860 con 0x55f34e448000 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f824f400640 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55f34e3fe8d0 tx=0x55f34e403800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fed95bb4e4da3b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f8249000640 1 -- 172.21.15.146:0/2889248370 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d5389c0 con 0x55f34e448000 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f8249000640 1 -- 172.21.15.146:0/2889248370 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f34d53ec40 con 0x55f34e448000 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f8249000640 1 -- 172.21.15.146:0/2889248370 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d538b60 con 0x55f34e448000 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f8250861280 1 -- 172.21.15.146:0/2889248370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 msgr2=0x55f34d57e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.456+0000 7f8250861280 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55f34e3fe8d0 tx=0x55f34e403800 comp rx=0 tx=0).stop 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 -- 172.21.15.146:0/2889248370 shutdown_connections 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.463 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 --2- 172.21.15.146:0/2889248370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 -- 172.21.15.146:0/2889248370 >> 172.21.15.146:0/2889248370 conn(0x55f34e3e3c00 msgr2=0x55f34d61b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 -- 172.21.15.146:0/2889248370 shutdown_connections 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 -- 172.21.15.146:0/2889248370 wait complete. 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.457+0000 7f8250861280 1 Processor -- start 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 -- start start 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.464 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4d80 con 0x55f34e448400 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f34e2e4f00 con 0x55f34e448800 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.458+0000 7f8250861280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f34e2e5080 con 0x55f34e448000 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34792/0 (socket says 172.21.15.146:34792) 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 learned_addr learned my addr 172.21.15.146:0/533668172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448000 msgr2=0x55f34d57e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448800 msgr2=0x55f34d580680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.465 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34d5474a0 con 0x55f34e448400 2024-04-24T23:05:16.466 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34e448000 0x55f34d57e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.466 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e448800 0x55f34d580680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.466 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.459+0000 7f824ea00640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55f34e334d20 tx=0x55f34e2a3f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.467 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.460+0000 7f8247200640 1 -- 172.21.15.146:0/533668172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d538680 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.460+0000 7f8247200640 1 -- 172.21.15.146:0/533668172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f34d53e1c0 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.460+0000 7f8247200640 1 -- 172.21.15.146:0/533668172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f34d5389c0 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.460+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f34d546960 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.460+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34d546780 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.461+0000 7f8247200640 1 -- 172.21.15.146:0/533668172 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55f34e450c00 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.462+0000 7f8247200640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 0x55f34d581700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.462+0000 7f8247200640 1 -- 172.21.15.146:0/533668172 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55f34e44ee00 con 0x55f34e448400 2024-04-24T23:05:16.468 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.462+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f34e448c00 0x55f34d580c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.462+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f34e449000 con 0x55f34e448c00 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.463+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 0x55f34d581700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.463+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f34e448c00 0x55f34d580c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.464+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f34e448c00 0x55f34d580c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.464+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 0x55f34d581700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55f34e3fe8d0 tx=0x55f34e2a28a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.465+0000 7f824e000640 1 -- 172.21.15.146:0/533668172 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55f34e292000 con 0x55f34e448c00 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.465+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f34e449400 0x55f34d581180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.469 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.465+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f34d88e000 con 0x55f34e449400 2024-04-24T23:05:16.470 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.466+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f34e449400 0x55f34d581180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.470 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.467+0000 7f824f400640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f34e449400 0x55f34d581180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.470 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.468+0000 7f824f400640 1 -- 172.21.15.146:0/533668172 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55f34e292500 con 0x55f34e449400 2024-04-24T23:05:16.471 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.468+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f34d88e400 0x55f34d898000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.471 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.468+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f34d88e800 con 0x55f34d88e400 2024-04-24T23:05:16.471 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.469+0000 7f824ea00640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f34d88e400 0x55f34d898000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.472 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.470+0000 7f824ea00640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f34d88e400 0x55f34d898000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.471+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(3 200.00000002 [read 0~48 out=48b] v0'0 uv4 ondisk = 0) ==== 156+0+48 (crc 0 0 0) 0x55f34e292780 con 0x55f34d88e400 2024-04-24T23:05:16.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.471+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f34d88ec00 0x55f34d898580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.471+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:4 7.b 7:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f34d88f000 con 0x55f34d88ec00 2024-04-24T23:05:16.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.472+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f34d88ec00 0x55f34d898580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.475 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.473+0000 7f824e000640 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f34d88ec00 0x55f34d898580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.476 INFO:tasks.workunit.client.0.smithi146.stdout:Overall journal integrity: OK 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f824e000640 1 -- 172.21.15.146:0/533668172 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f34e292000 con 0x55f34d88ec00 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f34d88e400 msgr2=0x55f34d898000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f34d88e400 0x55f34d898000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f34e449400 msgr2=0x55f34d581180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f34e449400 0x55f34d581180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f34d88ec00 msgr2=0x55f34d898580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f34d88ec00 0x55f34d898580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f34e448c00 msgr2=0x55f34d580c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f34e448c00 0x55f34d580c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.474+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 reap_dead start 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f824ea00640 1 -- 172.21.15.146:0/533668172 reap_dead start 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 msgr2=0x55f34d581700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 0x55f34d581700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55f34e3fe8d0 tx=0x55f34e2a28a0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 msgr2=0x55f34d580100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55f34e334d20 tx=0x55f34e2a3f80 comp rx=0 tx=0).stop 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 shutdown_connections 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e448400 0x55f34d580100 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 --2- 172.21.15.146:0/533668172 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f34e449c00 0x55f34d581700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 >> 172.21.15.146:0/533668172 conn(0x55f34e3e3c00 msgr2=0x55f34d61b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 shutdown_connections 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/533668172 wait complete. 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 msgr2=0x55f34d57fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.475+0000 7f8250861280 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55f34e3353b0 tx=0x55f34e2a2720 comp rx=0 tx=0).stop 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 shutdown_connections 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f34e2a0400 0x55f34d57f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f34e2a0800 0x55f34d57fb80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 --2- 172.21.15.146:0/3690768071 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f34d513c00 0x55f34d57eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 >> 172.21.15.146:0/3690768071 conn(0x55f34d513000 msgr2=0x55f34d61c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 shutdown_connections 2024-04-24T23:05:16.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.476+0000 7f8250861280 1 -- 172.21.15.146:0/3690768071 wait complete. 2024-04-24T23:05:16.483 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-04-24T23:05:16.530 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.528+0000 7f74ca024280 1 -- start start 2024-04-24T23:05:16.531 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.528+0000 7f74ca024280 1 Processor -- start 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9d44000 0x5596b904f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9d44800 0x5596b904fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db4000 con 0x5596b8fe3c00 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db4180 con 0x5596b9d44000 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.529+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5596b9db4300 con 0x5596b9d44800 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34810/0 (socket says 172.21.15.146:34810) 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 -- 172.21.15.146:0/2674466011 learned_addr learned my addr 172.21.15.146:0/2674466011 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c7400640 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9d44000 0x5596b904f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.532 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9d44800 0x5596b904fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 -- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9d44800 msgr2=0x5596b904fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9d44800 0x5596b904fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 -- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9d44000 msgr2=0x5596b904f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9d44000 0x5596b904f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.530+0000 7f74c6a00640 1 -- 172.21.15.146:0/2674466011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b9016780 con 0x5596b8fe3c00 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c6a00640 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5596b9e06c90 tx=0x5596b9d726c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74da82a598063472 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c4200640 1 -- 172.21.15.146:0/2674466011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008d00 con 0x5596b8fe3c00 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c4200640 1 -- 172.21.15.146:0/2674466011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b900ea80 con 0x5596b8fe3c00 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c4200640 1 -- 172.21.15.146:0/2674466011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008b60 con 0x5596b8fe3c00 2024-04-24T23:05:16.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b90174a0 con 0x5596b8fe3c00 2024-04-24T23:05:16.535 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5596b9016960 con 0x5596b8fe3c00 2024-04-24T23:05:16.535 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c4200640 1 -- 172.21.15.146:0/2674466011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5596b9eb4200 con 0x5596b8fe3c00 2024-04-24T23:05:16.535 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.531+0000 7f74c4200640 1 -- 172.21.15.146:0/2674466011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x5596b903d180 con 0x5596b8fe3c00 2024-04-24T23:05:16.535 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.532+0000 7f74ca024280 1 Processor -- start 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.532+0000 7f74ca024280 1 -- start start 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b904f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db4480 con 0x5596b9de3800 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db4600 con 0x5596b9de3c00 2024-04-24T23:05:16.537 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5596b9db4780 con 0x5596b9de3400 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.533+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34826/0 (socket says 172.21.15.146:34826) 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 -- 172.21.15.146:0/3451522578 learned_addr learned my addr 172.21.15.146:0/3451522578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c6a00640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7e00640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b904f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 -- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 msgr2=0x5596b904f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b904f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 -- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 msgr2=0x5596b9050100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 -- 172.21.15.146:0/3451522578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b90163c0 con 0x5596b9de3800 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c6a00640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c7400640 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5596b9ec4660 tx=0x5596b9ec6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0162532fb733fad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.534+0000 7f74c1a00640 1 -- 172.21.15.146:0/3451522578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008d00 con 0x5596b9de3800 2024-04-24T23:05:16.538 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74c1a00640 1 -- 172.21.15.146:0/3451522578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b900e8c0 con 0x5596b9de3800 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74c1a00640 1 -- 172.21.15.146:0/3451522578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008b60 con 0x5596b9de3800 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 -- 172.21.15.146:0/3451522578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 msgr2=0x5596b904e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5596b9ec4660 tx=0x5596b9ec6c00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 -- 172.21.15.146:0/3451522578 shutdown_connections 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b904e580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 --2- 172.21.15.146:0/3451522578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b904f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 -- 172.21.15.146:0/3451522578 >> 172.21.15.146:0/3451522578 conn(0x5596b9d44400 msgr2=0x5596b90eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 -- 172.21.15.146:0/3451522578 shutdown_connections 2024-04-24T23:05:16.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.535+0000 7f74ca024280 1 -- 172.21.15.146:0/3451522578 wait complete. 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.536+0000 7f74ca024280 1 Processor -- start 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.536+0000 7f74ca024280 1 -- start start 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b9051180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db5b00 con 0x5596b9de3800 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596b9db5980 con 0x5596b9de3c00 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74ca024280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5596b9db4c00 con 0x5596b9de3400 2024-04-24T23:05:16.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34834/0 (socket says 172.21.15.146:34834) 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 -- 172.21.15.146:0/2891169568 learned_addr learned my addr 172.21.15.146:0/2891169568 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 msgr2=0x5596b9051180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9de3400 0x5596b9051180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 msgr2=0x5596b9050680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9de3c00 0x5596b9050680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.537+0000 7f74c7400640 1 -- 172.21.15.146:0/2891169568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b9016780 con 0x5596b9de3800 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74c7400640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5596b9ec5320 tx=0x5596b905f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74bfc00640 1 -- 172.21.15.146:0/2891169568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008680 con 0x5596b9de3800 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74bfc00640 1 -- 172.21.15.146:0/2891169568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5596b900e540 con 0x5596b9de3800 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74bfc00640 1 -- 172.21.15.146:0/2891169568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5596b9008d00 con 0x5596b9de3800 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596b9016000 con 0x5596b9de3800 2024-04-24T23:05:16.542 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.538+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b9017680 con 0x5596b9de3800 2024-04-24T23:05:16.543 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.540+0000 7f74bfc00640 1 -- 172.21.15.146:0/2891169568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5596b9f1cc00 con 0x5596b9de3800 2024-04-24T23:05:16.543 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.540+0000 7f74bfc00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5596b9f1b000 0x5596b9051700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.543 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.540+0000 7f74bfc00640 1 -- 172.21.15.146:0/2891169568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5596b9f15400 con 0x5596b9de3800 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.541+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5596b9f1b400 0x5596b9050100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.541+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5596b9f1b800 con 0x5596b9f1b400 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.541+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5596b9f1b000 0x5596b9051700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.541+0000 7f74c6a00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5596b9f1b400 0x5596b9050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.542+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5596b9f1b000 0x5596b9051700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5596b902ba70 tx=0x5596b92dce40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.544 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.543+0000 7f74c6a00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5596b9f1b400 0x5596b9050100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.545 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.543+0000 7f74c6a00640 1 -- 172.21.15.146:0/2891169568 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5596b9d62000 con 0x5596b9f1b400 2024-04-24T23:05:16.545 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.543+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5596b9f1bc00 0x5596b904e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.545 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.543+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5596b935a000 con 0x5596b9f1bc00 2024-04-24T23:05:16.546 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.544+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5596b9f1bc00 0x5596b904e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.547 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.545+0000 7f74c7e00640 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5596b9f1bc00 0x5596b904e580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.547 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74c7e00640 1 -- 172.21.15.146:0/2891169568 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5596b9d62500 con 0x5596b9f1bc00 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout:{ 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "write_pos": 8388608, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "expire_pos": 8388608, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "trimmed_pos": 8388608, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "stream_format": 1, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "layout": { 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_unit": 4194304, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_count": 1, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "object_size": 4194304, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_id": 7, 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_ns": "" 2024-04-24T23:05:16.548 INFO:tasks.workunit.client.0.smithi146.stdout: } 2024-04-24T23:05:16.549 INFO:tasks.workunit.client.0.smithi146.stdout:} 2024-04-24T23:05:16.549 INFO:tasks.workunit.client.0.smithi146.stdout: 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5596b9f1bc00 msgr2=0x5596b904e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5596b9f1bc00 0x5596b904e580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5596b9f1b400 msgr2=0x5596b9050100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5596b9f1b400 0x5596b9050100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5596b9f1b000 msgr2=0x5596b9051700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5596b9f1b000 0x5596b9051700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5596b902ba70 tx=0x5596b92dce40 comp rx=0 tx=0).stop 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 msgr2=0x5596b9050c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74c7400640 1 -- 172.21.15.146:0/2891169568 reap_dead start 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5596b9ec5320 tx=0x5596b905f440 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 shutdown_connections 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2891169568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b9de3800 0x5596b9050c00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 >> 172.21.15.146:0/2891169568 conn(0x5596b9d44400 msgr2=0x5596b90eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 shutdown_connections 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2891169568 wait complete. 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 msgr2=0x5596b904eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.546+0000 7f74ca024280 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5596b9e06c90 tx=0x5596b9d726c0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 shutdown_connections 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5596b9d44800 0x5596b904fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596b8fe3c00 0x5596b904eb00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 --2- 172.21.15.146:0/2674466011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596b9d44000 0x5596b904f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 >> 172.21.15.146:0/2674466011 conn(0x5596b8fe3000 msgr2=0x5596b90ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 shutdown_connections 2024-04-24T23:05:16.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.547+0000 7f74ca024280 1 -- 172.21.15.146:0/2674466011 wait complete. 2024-04-24T23:05:16.553 INFO:tasks.workunit.client.0.smithi146.stdout:Rolling back journal to original state... 2024-04-24T23:05:16.553 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Rolling back journal to original state...' 2024-04-24T23:05:16.553 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-04-24T23:05:16.599 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.597+0000 7f6d62681280 1 -- start start 2024-04-24T23:05:16.600 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.597+0000 7f6d62681280 1 Processor -- start 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d7688400 0x55e1d6997600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2000 0x55e1d6996580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f8000 con 0x55e1d7689c00 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f8180 con 0x55e1d7688400 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.598+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e1d77f8300 con 0x55e1d77f2000 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34854/0 (socket says 172.21.15.146:34854) 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 -- 172.21.15.146:0/273779348 learned_addr learned my addr 172.21.15.146:0/273779348 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.602 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d60800640 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d7688400 0x55e1d6997600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 -- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2000 msgr2=0x55e1d6996580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2000 0x55e1d6996580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 -- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d7688400 msgr2=0x55e1d6997600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d7688400 0x55e1d6997600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 -- 172.21.15.146:0/273779348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d695e780 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.599+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55e1d77528d0 tx=0x55e1d76ba4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c7dd7b7e1d94bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d5d600640 1 -- 172.21.15.146:0/273779348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950b60 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d5d600640 1 -- 172.21.15.146:0/273779348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e1d6956e00 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d695e000 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d5d600640 1 -- 172.21.15.146:0/273779348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950d00 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e1d695fa40 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d5d600640 1 -- 172.21.15.146:0/273779348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55e1d76ce800 con 0x55e1d7689c00 2024-04-24T23:05:16.603 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.600+0000 7f6d5d600640 1 -- 172.21.15.146:0/273779348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55e1d6985180 con 0x55e1d7689c00 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.601+0000 7f6d62681280 1 Processor -- start 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.601+0000 7f6d62681280 1 -- start start 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6998100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f3000 0x55e1d6998680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f8480 con 0x55e1d77f2800 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f8600 con 0x55e1d77f2c00 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e1d77f8780 con 0x55e1d77f3000 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d61200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d61200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34868/0 (socket says 172.21.15.146:34868) 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d61200640 1 -- 172.21.15.146:0/1498646109 learned_addr learned my addr 172.21.15.146:0/1498646109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.602+0000 7f6d60800640 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6998100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 -- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f3000 msgr2=0x55e1d6998680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f3000 0x55e1d6998680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 -- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 msgr2=0x55e1d6998100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6998100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 -- 172.21.15.146:0/1498646109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d695f860 con 0x55e1d77f2800 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d61200640 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55e1d7804630 tx=0x55e1d780ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c1dafe871c51b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d5ae00640 1 -- 172.21.15.146:0/1498646109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950b60 con 0x55e1d77f2800 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d5ae00640 1 -- 172.21.15.146:0/1498646109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e1d69561c0 con 0x55e1d77f2800 2024-04-24T23:05:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.603+0000 7f6d5ae00640 1 -- 172.21.15.146:0/1498646109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950d00 con 0x55e1d77f2800 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 -- 172.21.15.146:0/1498646109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 msgr2=0x55e1d6997b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55e1d7804630 tx=0x55e1d780ed20 comp rx=0 tx=0).stop 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 -- 172.21.15.146:0/1498646109 shutdown_connections 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f3000 0x55e1d6998680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6998100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 --2- 172.21.15.146:0/1498646109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f2800 0x55e1d6997b80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 -- 172.21.15.146:0/1498646109 >> 172.21.15.146:0/1498646109 conn(0x55e1d77f2400 msgr2=0x55e1d6a1d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 -- 172.21.15.146:0/1498646109 shutdown_connections 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 -- 172.21.15.146:0/1498646109 wait complete. 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.604+0000 7f6d62681280 1 Processor -- start 2024-04-24T23:05:16.609 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 -- start start 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2800 0x55e1d6999700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6999180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f9b00 con 0x55e1d77f3000 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f9980 con 0x55e1d77f2c00 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.605+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e1d77f8c00 con 0x55e1d77f2800 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34878/0 (socket says 172.21.15.146:34878) 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 -- 172.21.15.146:0/1054896937 learned_addr learned my addr 172.21.15.146:0/1054896937 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d60800640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6999180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 -- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2800 msgr2=0x55e1d6999700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2800 0x55e1d6999700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 -- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 msgr2=0x55e1d6999180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6999180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 -- 172.21.15.146:0/1054896937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d695f680 con 0x55e1d77f3000 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d60800640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6999180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55e1d7805320 tx=0x55e1d76ba480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.606+0000 7f6d59000640 1 -- 172.21.15.146:0/1054896937 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950680 con 0x55e1d77f3000 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.607+0000 7f6d59000640 1 -- 172.21.15.146:0/1054896937 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e1d6956c40 con 0x55e1d77f3000 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.607+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1d695e3c0 con 0x55e1d77f3000 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.607+0000 7f6d59000640 1 -- 172.21.15.146:0/1054896937 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d6950820 con 0x55e1d77f3000 2024-04-24T23:05:16.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.607+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d695fc20 con 0x55e1d77f3000 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.608+0000 7f6d59000640 1 -- 172.21.15.146:0/1054896937 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55e1d786cc00 con 0x55e1d77f3000 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.609+0000 7f6d59000640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 0x55e1d6ca0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.609+0000 7f6d59000640 1 -- 172.21.15.146:0/1054896937 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55e1d76ce400 con 0x55e1d77f3000 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.610+0000 7f6d61200640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 0x55e1d6ca0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.610+0000 7f6d62681280 1 -- start start 2024-04-24T23:05:16.612 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.610+0000 7f6d62681280 1 Processor -- start 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d61200640 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 0x55e1d6ca0000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55e1d7804630 tx=0x55e1d780ec00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d6cfa000 0x55e1d6998680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d6cfa800 0x55e1d6997b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f8f00 con 0x55e1d6cfa400 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1d77f9680 con 0x55e1d6cfa800 2024-04-24T23:05:16.613 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.611+0000 7f6d62681280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e1d77f8480 con 0x55e1d6cfa000 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34882/0 (socket says 172.21.15.146:34882) 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 -- 172.21.15.146:0/3615172103 learned_addr learned my addr 172.21.15.146:0/3615172103 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d6cfa800 0x55e1d6997b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d61200640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d6cfa000 0x55e1d6998680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.615 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d6cfa000 msgr2=0x55e1d6998680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d6cfa000 0x55e1d6998680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d6cfa800 msgr2=0x55e1d6997b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d6cfa800 0x55e1d6997b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d695fe00 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.612+0000 7f6d60800640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55e1d6c53860 tx=0x55e1d6d060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8ae3747e8d29b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d55400640 1 -- 172.21.15.146:0/3615172103 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d789a1a0 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d55400640 1 -- 172.21.15.146:0/3615172103 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e1d6956700 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d55400640 1 -- 172.21.15.146:0/3615172103 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e1d78a3a00 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d695e780 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e1d695e000 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d55400640 1 -- 172.21.15.146:0/3615172103 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55e1d6d01200 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d55400640 1 -- 172.21.15.146:0/3615172103 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55e1d6985500 con 0x55e1d6cfa400 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55e1d6cfac00 0x55e1d6ca0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.613+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6cfb000 con 0x55e1d6cfac00 2024-04-24T23:05:16.617 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.614+0000 7f6d61200640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55e1d6cfac00 0x55e1d6ca0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.617 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.615+0000 7f6d61200640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55e1d6cfac00 0x55e1d6ca0580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=3259775155ebe901 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.618 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.616+0000 7f6d61200640 1 -- 172.21.15.146:0/3615172103 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55e1d76aa000 con 0x55e1d6cfac00 2024-04-24T23:05:16.618 INFO:tasks.workunit.client.0.smithi146.stdout:undump /tmp/journal.bin 2024-04-24T23:05:16.618 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.616+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e1d6cfb400 0x55e1d6ca0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.618 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.616+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6cfb800 con 0x55e1d6cfb400 2024-04-24T23:05:16.618 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.616+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e1d6cfb400 0x55e1d6ca0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.619 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.617+0000 7f6d5fe00640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e1d6cfb400 0x55e1d6ca0b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=640b1e0e1b9988e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.620 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.618+0000 7f6d5fe00640 1 -- 172.21.15.146:0/3615172103 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55e1d76aa500 con 0x55e1d6cfb400 2024-04-24T23:05:16.620 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.618+0000 7f6d53600640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e1d6d0cc00 0x55e1d6ca2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.620 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.618+0000 7f6d53600640 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6d0d000 con 0x55e1d6d0cc00 2024-04-24T23:05:16.620 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.619+0000 7f6d61200640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e1d6d0cc00 0x55e1d6ca2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.622 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.620+0000 7f6d61200640 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e1d6d0cc00 0x55e1d6ca2c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=6c066c4f8349b488 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.622 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.621+0000 7f6d61200640 1 -- 172.21.15.146:0/3615172103 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv4 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55e1d76aa000 con 0x55e1d6d0cc00 2024-04-24T23:05:16.623 INFO:tasks.workunit.client.0.smithi146.stdout:start 4194304 len 33090 write_pos 4200296 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-04-24T23:05:16.623 INFO:tasks.workunit.client.0.smithi146.stdout:writing header 200.00000000 2024-04-24T23:05:16.623 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.621+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:4 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6d0d800 con 0x55e1d6cfb400 2024-04-24T23:05:16.627 INFO:tasks.workunit.client.0.smithi146.stdout:Purging 2 objects from 1 2024-04-24T23:05:16.627 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.625+0000 7f6d5fe00640 1 -- 172.21.15.146:0/3615172103 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v57'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55e1d76aa500 con 0x55e1d6cfb400 2024-04-24T23:05:16.627 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.625+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6d0dc00 con 0x55e1d6cfb400 2024-04-24T23:05:16.627 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.625+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:6 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6d2c000 con 0x55e1d6d0cc00 2024-04-24T23:05:16.631 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.629+0000 7f6d5fe00640 1 -- 172.21.15.146:0/3615172103 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000001 [delete] v57'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55e1d76aa500 con 0x55e1d6cfb400 2024-04-24T23:05:16.632 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.630+0000 7f6d61200640 1 -- 172.21.15.146:0/3615172103 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(6 200.00000002 [delete] v57'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55e1d76aa000 con 0x55e1d6d0cc00 2024-04-24T23:05:16.632 INFO:tasks.workunit.client.0.smithi146.stdout: writing 4194304~33090 2024-04-24T23:05:16.632 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.630+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:7 7.14 7:2e2fa760:::200.00000001:head [write 0~33090 in=33090b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55e1d6d2c400 con 0x55e1d6cfb400 2024-04-24T23:05:16.636 INFO:tasks.workunit.client.0.smithi146.stdout:done. 2024-04-24T23:05:16.638 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d5fe00640 1 -- 172.21.15.146:0/3615172103 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(7 200.00000001 [write 0~33090] v57'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55e1d76aa500 con 0x55e1d6cfb400 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e1d6d0cc00 msgr2=0x55e1d6ca2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e1d6d0cc00 0x55e1d6ca2c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e1d6cfb400 msgr2=0x55e1d6ca0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e1d6cfb400 0x55e1d6ca0b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55e1d6cfac00 msgr2=0x55e1d6ca0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55e1d6cfac00 0x55e1d6ca0580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d60800640 1 -- 172.21.15.146:0/3615172103 reap_dead start 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 msgr2=0x55e1d6998100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55e1d6c53860 tx=0x55e1d6d060c0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 shutdown_connections 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 --2- 172.21.15.146:0/3615172103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d6cfa400 0x55e1d6998100 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 >> 172.21.15.146:0/3615172103 conn(0x55e1d7875c00 msgr2=0x55e1d6a1d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 shutdown_connections 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.635+0000 7f6d62681280 1 -- 172.21.15.146:0/3615172103 wait complete. 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 msgr2=0x55e1d6ca0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 0x55e1d6ca0000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55e1d7804630 tx=0x55e1d780ec00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 msgr2=0x55e1d6998c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55e1d7805320 tx=0x55e1d76ba480 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 shutdown_connections 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d77f3000 0x55e1d6998c00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d77f2c00 0x55e1d6999180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e1d7875800 0x55e1d6ca0000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/1054896937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2800 0x55e1d6999700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 >> 172.21.15.146:0/1054896937 conn(0x55e1d77f2400 msgr2=0x55e1d6a1d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 shutdown_connections 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/1054896937 wait complete. 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 msgr2=0x55e1d6996b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.640 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.636+0000 7f6d62681280 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55e1d77528d0 tx=0x55e1d76ba4e0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 shutdown_connections 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e1d77f2000 0x55e1d6996580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1d7689c00 0x55e1d6996b00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 --2- 172.21.15.146:0/273779348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1d7688400 0x55e1d6997600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 >> 172.21.15.146:0/273779348 conn(0x55e1d692b000 msgr2=0x55e1d6a1c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 shutdown_connections 2024-04-24T23:05:16.641 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.637+0000 7f6d62681280 1 -- 172.21.15.146:0/273779348 wait complete. 2024-04-24T23:05:16.643 INFO:tasks.workunit.client.0.smithi146.stdout:Testing 'header' commands... 2024-04-24T23:05:16.643 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Testing '\''header'\'' commands...' 2024-04-24T23:05:16.644 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-04-24T23:05:16.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.688+0000 7f62aee14280 1 -- start start 2024-04-24T23:05:16.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.688+0000 7f62aee14280 1 Processor -- start 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e96b7e000 0x562e96b05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e96b7e800 0x562e96b05600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562e97864480 con 0x562e96a99c00 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562e97864600 con 0x562e96b7e000 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562e97864780 con 0x562e96b7e800 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62ab800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62ab800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34902/0 (socket says 172.21.15.146:34902) 2024-04-24T23:05:16.692 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.689+0000 7f62ab800640 1 -- 172.21.15.146:0/2941017265 learned_addr learned my addr 172.21.15.146:0/2941017265 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ac200640 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e96b7e000 0x562e96b05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 -- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e96b7e800 msgr2=0x562e96b05600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e96b7e800 0x562e96b05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 -- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e96b7e000 msgr2=0x562e96b05080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e96b7e000 0x562e96b05080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 -- 172.21.15.146:0/2941017265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e96acc780 con 0x562e96a99c00 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62ab800640 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x562e978bf260 tx=0x562e978284e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d604aba441323712 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62a9000640 1 -- 172.21.15.146:0/2941017265 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abe9c0 con 0x562e96a99c00 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62a9000640 1 -- 172.21.15.146:0/2941017265 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562e96ac4700 con 0x562e96a99c00 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62a9000640 1 -- 172.21.15.146:0/2941017265 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abeb60 con 0x562e96a99c00 2024-04-24T23:05:16.693 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e96acc000 con 0x562e96a99c00 2024-04-24T23:05:16.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562e96acda40 con 0x562e96a99c00 2024-04-24T23:05:16.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.690+0000 7f62a9000640 1 -- 172.21.15.146:0/2941017265 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x562e97968400 con 0x562e96a99c00 2024-04-24T23:05:16.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.691+0000 7f62a9000640 1 -- 172.21.15.146:0/2941017265 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x562e96af3180 con 0x562e96a99c00 2024-04-24T23:05:16.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.691+0000 7f62aee14280 1 Processor -- start 2024-04-24T23:05:16.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 -- start start 2024-04-24T23:05:16.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e979d0400 0x562e96b06680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562e96afa180 con 0x562e979d0000 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562e97865680 con 0x562e97965c00 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.692+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562e97865500 con 0x562e979d0400 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34910/0 (socket says 172.21.15.146:34910) 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 -- 172.21.15.146:0/1744278924 learned_addr learned my addr 172.21.15.146:0/1744278924 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 -- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e979d0400 msgr2=0x562e96b06680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e979d0400 0x562e96b06680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 -- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e97965c00 msgr2=0x562e96b04b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 -- 172.21.15.146:0/1744278924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e96acd860 con 0x562e979d0000 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.693+0000 7f62ac200640 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x562e97982600 tx=0x562e978288a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5763d53758f868c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62a6800640 1 -- 172.21.15.146:0/1744278924 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abe680 con 0x562e979d0000 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62a6800640 1 -- 172.21.15.146:0/1744278924 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562e96ac4e00 con 0x562e979d0000 2024-04-24T23:05:16.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62a6800640 1 -- 172.21.15.146:0/1744278924 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abe9c0 con 0x562e979d0000 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 -- 172.21.15.146:0/1744278924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 msgr2=0x562e96b06100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x562e97982600 tx=0x562e978288a0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 -- 172.21.15.146:0/1744278924 shutdown_connections 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e979d0400 0x562e96b06680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e979d0000 0x562e96b06100 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 --2- 172.21.15.146:0/1744278924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 -- 172.21.15.146:0/1744278924 >> 172.21.15.146:0/1744278924 conn(0x562e96b7e400 msgr2=0x562e96b8b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 -- 172.21.15.146:0/1744278924 shutdown_connections 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.694+0000 7f62aee14280 1 -- 172.21.15.146:0/1744278924 wait complete. 2024-04-24T23:05:16.699 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.695+0000 7f62aee14280 1 Processor -- start 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.695+0000 7f62aee14280 1 -- start start 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e977f4000 0x562e96b06100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e977f4400 0x562e96b06680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562e97864900 con 0x562e97965c00 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562e97864a80 con 0x562e977f4000 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62aee14280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562e97864180 con 0x562e977f4400 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 0x562e96b04b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34924/0 (socket says 172.21.15.146:34924) 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 -- 172.21.15.146:0/3840884820 learned_addr learned my addr 172.21.15.146:0/3840884820 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e977f4400 msgr2=0x562e96b06680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e977f4400 0x562e96b06680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e977f4000 msgr2=0x562e96b06100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.700 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e977f4000 0x562e96b06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.696+0000 7f62acc00640 1 -- 172.21.15.146:0/3840884820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e96acd4a0 con 0x562e97965c00 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62acc00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 0x562e96b04b00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x562e979833e0 tx=0x562e97987800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62a4a00640 1 -- 172.21.15.146:0/3840884820 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abe680 con 0x562e97965c00 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62a4a00640 1 -- 172.21.15.146:0/3840884820 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562e96ac4e00 con 0x562e97965c00 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62a4a00640 1 -- 172.21.15.146:0/3840884820 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562e96abe9c0 con 0x562e97965c00 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e96acc960 con 0x562e97965c00 2024-04-24T23:05:16.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.697+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e96acc780 con 0x562e97965c00 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.699+0000 7f62a4a00640 1 -- 172.21.15.146:0/3840884820 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562e979d0c00 con 0x562e97965c00 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.699+0000 7f62a4a00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562e977fac00 0x562e96b07700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.699+0000 7f62a4a00640 1 -- 172.21.15.146:0/3840884820 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x562e979d6a00 con 0x562e97965c00 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.700+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562e977f4800 0x562e96b06c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.700+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562e977f4c00 con 0x562e977f4800 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.700+0000 7f62ac200640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562e977fac00 0x562e96b07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.700+0000 7f62ab800640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562e977f4800 0x562e96b06c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.703 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.702+0000 7f62ab800640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562e977f4800 0x562e96b06c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.703 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.702+0000 7f62ac200640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562e977fac00 0x562e96b07700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x562e97982600 tx=0x562e97829920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.704 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.702+0000 7f62ab800640 1 -- 172.21.15.146:0/3840884820 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x562e97818000 con 0x562e977f4800 2024-04-24T23:05:16.704 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.703+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562e977f5000 0x562e96b07180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.704 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.703+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562e977f5400 con 0x562e977f5000 2024-04-24T23:05:16.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.703+0000 7f62acc00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562e977f5000 0x562e96b07180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.704+0000 7f62acc00640 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562e977f5000 0x562e96b07180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62acc00640 1 -- 172.21.15.146:0/3840884820 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x562e97818500 con 0x562e977f5000 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout:{ 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "magic": "ceph fs volume v011", 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "write_pos": 4200296, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "expire_pos": 4194304, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "trimmed_pos": 4194304, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "stream_format": 1, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "layout": { 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_unit": 4194304, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "stripe_count": 1, 2024-04-24T23:05:16.707 INFO:tasks.workunit.client.0.smithi146.stdout: "object_size": 4194304, 2024-04-24T23:05:16.708 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_id": 7, 2024-04-24T23:05:16.708 INFO:tasks.workunit.client.0.smithi146.stdout: "pool_ns": "" 2024-04-24T23:05:16.708 INFO:tasks.workunit.client.0.smithi146.stdout: } 2024-04-24T23:05:16.708 INFO:tasks.workunit.client.0.smithi146.stdout:} 2024-04-24T23:05:16.708 INFO:tasks.workunit.client.0.smithi146.stdout: 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562e977f5000 msgr2=0x562e96b07180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562e977f5000 0x562e96b07180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562e977f4800 msgr2=0x562e96b06c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562e977f4800 0x562e96b06c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562e977fac00 msgr2=0x562e96b07700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562e977fac00 0x562e96b07700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x562e97982600 tx=0x562e97829920 comp rx=0 tx=0).stop 2024-04-24T23:05:16.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 msgr2=0x562e96b04b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 --2- 172.21.15.146:0/3840884820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e97965c00 0x562e96b04b00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x562e979833e0 tx=0x562e97987800 comp rx=0 tx=0).stop 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62ac200640 1 -- 172.21.15.146:0/3840884820 reap_dead start 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62ac200640 1 -- 172.21.15.146:0/3840884820 reap_dead start 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 shutdown_connections 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 >> 172.21.15.146:0/3840884820 conn(0x562e96b7e400 msgr2=0x562e96b8b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.705+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 shutdown_connections 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/3840884820 wait complete. 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 msgr2=0x562e96b05b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x562e978bf260 tx=0x562e978284e0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 shutdown_connections 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562e96b7e800 0x562e96b05600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e96a99c00 0x562e96b05b80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 --2- 172.21.15.146:0/2941017265 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562e96b7e000 0x562e96b05080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 >> 172.21.15.146:0/2941017265 conn(0x562e96a99000 msgr2=0x562e96b8b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 shutdown_connections 2024-04-24T23:05:16.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.706+0000 7f62aee14280 1 -- 172.21.15.146:0/2941017265 wait complete. 2024-04-24T23:05:16.713 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set write_pos 123 2024-04-24T23:05:16.759 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.757+0000 7f5a06c0c280 1 -- start start 2024-04-24T23:05:16.759 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.757+0000 7f5a06c0c280 1 Processor -- start 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b75cecc00 0x561b75d58580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b75ced800 0x561b75d58b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4e180 con 0x561b75cedc00 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4e300 con 0x561b75ced800 2024-04-24T23:05:16.760 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561b76a4e480 con 0x561b75cecc00 2024-04-24T23:05:16.761 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a04a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.761 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a04a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34952/0 (socket says 172.21.15.146:34952) 2024-04-24T23:05:16.761 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.758+0000 7f5a04a00640 1 -- 172.21.15.146:0/2755612180 learned_addr learned my addr 172.21.15.146:0/2755612180 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 -- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b75cecc00 msgr2=0x561b75d58580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b75cecc00 0x561b75d58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 -- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b75ced800 msgr2=0x561b75d58b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b75ced800 0x561b75d58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 -- 172.21.15.146:0/2755612180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b75d20780 con 0x561b75cedc00 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a04a00640 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x561b76b07380 tx=0x561b76a7dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f99c62252d95cba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a00e00640 1 -- 172.21.15.146:0/2755612180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d129c0 con 0x561b75cedc00 2024-04-24T23:05:16.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a00e00640 1 -- 172.21.15.146:0/2755612180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b75d18fc0 con 0x561b75cedc00 2024-04-24T23:05:16.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a00e00640 1 -- 172.21.15.146:0/2755612180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d12680 con 0x561b75cedc00 2024-04-24T23:05:16.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b75d214a0 con 0x561b75cedc00 2024-04-24T23:05:16.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.759+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561b75d20000 con 0x561b75cedc00 2024-04-24T23:05:16.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.760+0000 7f5a00e00640 1 -- 172.21.15.146:0/2755612180 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x561b76ba6200 con 0x561b75cedc00 2024-04-24T23:05:16.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.760+0000 7f5a00e00640 1 -- 172.21.15.146:0/2755612180 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x561b75d47180 con 0x561b75cedc00 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.761+0000 7f5a06c0c280 1 Processor -- start 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.761+0000 7f5a06c0c280 1 -- start start 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.761+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08000 0x561b75d59600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08800 0x561b75d5a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4e600 con 0x561b76c08400 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4e780 con 0x561b76c08000 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561b76a4e900 con 0x561b76c08800 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34968/0 (socket says 172.21.15.146:34968) 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 -- 172.21.15.146:0/1197017429 learned_addr learned my addr 172.21.15.146:0/1197017429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 -- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08800 msgr2=0x561b75d5a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a03600640 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08000 0x561b75d59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.765 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08800 0x561b75d5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 -- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08000 msgr2=0x561b75d59600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08000 0x561b75d59600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.762+0000 7f5a04000640 1 -- 172.21.15.146:0/1197017429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b75d203c0 con 0x561b76c08400 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a04000640 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x561b76adea50 tx=0x561b76bb8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1776f628285a3aee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f59fe600640 1 -- 172.21.15.146:0/1197017429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d129c0 con 0x561b76c08400 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f59fe600640 1 -- 172.21.15.146:0/1197017429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b75d18a80 con 0x561b76c08400 2024-04-24T23:05:16.766 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f59fe600640 1 -- 172.21.15.146:0/1197017429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d12680 con 0x561b76c08400 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 -- 172.21.15.146:0/1197017429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 msgr2=0x561b75d59b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x561b76adea50 tx=0x561b76bb8d20 comp rx=0 tx=0).stop 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 -- 172.21.15.146:0/1197017429 shutdown_connections 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08800 0x561b75d5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08400 0x561b75d59b80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/1197017429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08000 0x561b75d59600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 -- 172.21.15.146:0/1197017429 >> 172.21.15.146:0/1197017429 conn(0x561b76a7bc00 msgr2=0x561b75df7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 -- 172.21.15.146:0/1197017429 shutdown_connections 2024-04-24T23:05:16.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.763+0000 7f5a06c0c280 1 -- 172.21.15.146:0/1197017429 wait complete. 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.764+0000 7f5a06c0c280 1 Processor -- start 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.764+0000 7f5a06c0c280 1 -- start start 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 0x561b75d5b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08400 0x561b75d5ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08800 0x561b75d5a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4f980 con 0x561b76c08000 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561b76a4e300 con 0x561b76c08800 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a06c0c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x561b76a4ec00 con 0x561b76c08400 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a03600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 0x561b75d5b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a03600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 0x561b75d5b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34980/0 (socket says 172.21.15.146:34980) 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.765+0000 7f5a03600640 1 -- 172.21.15.146:0/3390840991 learned_addr learned my addr 172.21.15.146:0/3390840991 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a04000640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08400 0x561b75d5ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08400 msgr2=0x561b75d5ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b76c08400 0x561b75d5ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08800 msgr2=0x561b75d5a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b76c08800 0x561b75d5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b75d20960 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a03600640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 0x561b75d5b180 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x561b76adf7d0 tx=0x561b76bb8e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f59fc800640 1 -- 172.21.15.146:0/3390840991 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d129c0 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f59fc800640 1 -- 172.21.15.146:0/3390840991 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561b75d18c40 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f59fc800640 1 -- 172.21.15.146:0/3390840991 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561b75d12680 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.766+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b75d21680 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.767+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b75d21860 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.768+0000 7f59fc800640 1 -- 172.21.15.146:0/3390840991 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x561b76c12c00 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.769+0000 7f59fc800640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561b76c21000 0x561b75d5b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.769+0000 7f59fc800640 1 -- 172.21.15.146:0/3390840991 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x561b76c16c00 con 0x561b76c08000 2024-04-24T23:05:16.775 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.769+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561b76c08c00 0x561b75d5a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.776 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.769+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561b76c09000 con 0x561b76c08c00 2024-04-24T23:05:16.776 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.769+0000 7f5a04000640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561b76c21000 0x561b75d5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.776 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.770+0000 7f5a03600640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561b76c08c00 0x561b75d5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.776 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.771+0000 7f5a04000640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561b76c21000 0x561b75d5b700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x561b76adea50 tx=0x561b76bb8c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.776 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.771+0000 7f5a03600640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561b76c08c00 0x561b75d5a100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.772+0000 7f5a03600640 1 -- 172.21.15.146:0/3390840991 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x561b76a6c000 con 0x561b76c08c00 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.772+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561b76c21400 0x561b75d59b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.772+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x561b76c21800 con 0x561b76c21400 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.772+0000 7f5a04a00640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561b76c21400 0x561b75d59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.773+0000 7f5a04a00640 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561b76c21400 0x561b75d59b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.777 INFO:tasks.workunit.client.0.smithi146.stdout:Updating write_pos 0x401768 -> 0x7b 2024-04-24T23:05:16.778 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.774+0000 7f5a04a00640 1 -- 172.21.15.146:0/3390840991 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x561b76a6c500 con 0x561b76c21400 2024-04-24T23:05:16.778 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.774+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x561b76c21c00 con 0x561b76c21400 2024-04-24T23:05:16.780 INFO:tasks.workunit.client.0.smithi146.stdout:Successfully updated header. 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a04a00640 1 -- 172.21.15.146:0/3390840991 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v57'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561b76a6c500 con 0x561b76c21400 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561b76c21400 msgr2=0x561b75d59b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x561b76c21400 0x561b75d59b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561b76c08c00 msgr2=0x561b75d5a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x561b76c08c00 0x561b75d5a100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561b76c21000 msgr2=0x561b75d5b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x561b76c21000 0x561b75d5b700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x561b76adea50 tx=0x561b76bb8c00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 msgr2=0x561b75d5b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/3390840991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b76c08000 0x561b75d5b180 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x561b76adf7d0 tx=0x561b76bb8e40 comp rx=0 tx=0).stop 2024-04-24T23:05:16.782 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a04000640 1 -- 172.21.15.146:0/3390840991 reap_dead start 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a04000640 1 -- 172.21.15.146:0/3390840991 reap_dead start 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 shutdown_connections 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 >> 172.21.15.146:0/3390840991 conn(0x561b76a7bc00 msgr2=0x561b75df7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 shutdown_connections 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.779+0000 7f5a06c0c280 1 -- 172.21.15.146:0/3390840991 wait complete. 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 msgr2=0x561b75d59080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x561b76b07380 tx=0x561b76a7dec0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 shutdown_connections 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b75cedc00 0x561b75d59080 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561b75ced800 0x561b75d58b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 --2- 172.21.15.146:0/2755612180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x561b75cecc00 0x561b75d58580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 >> 172.21.15.146:0/2755612180 conn(0x561b75ced000 msgr2=0x561b75df6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 shutdown_connections 2024-04-24T23:05:16.783 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.780+0000 7f5a06c0c280 1 -- 172.21.15.146:0/2755612180 wait complete. 2024-04-24T23:05:16.787 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set expire_pos 123 2024-04-24T23:05:16.835 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.833+0000 7fa5b331e280 1 -- start start 2024-04-24T23:05:16.835 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.833+0000 7fa5b331e280 1 Processor -- start 2024-04-24T23:05:16.836 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d343e1dc00 0x55d343e88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344bec800 0x55d343e89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d344b82000 con 0x55d344bec000 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d344b82180 con 0x55d344bec800 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d344b82300 con 0x55d343e1dc00 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34998/0 (socket says 172.21.15.146:34998) 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.834+0000 7fa5b0a00640 1 -- 172.21.15.146:0/4175581197 learned_addr learned my addr 172.21.15.146:0/4175581197 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 -- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d343e1dc00 msgr2=0x55d343e88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d343e1dc00 0x55d343e88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 -- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344bec800 msgr2=0x55d343e89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344bec800 0x55d343e89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.837 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 -- 172.21.15.146:0/4175581197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d343e50780 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b0a00640 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55d344c3ecc0 tx=0x55d344badda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11586b49c27634d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5ad800640 1 -- 172.21.15.146:0/4175581197 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42d00 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5ad800640 1 -- 172.21.15.146:0/4175581197 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d343e48e00 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5ad800640 1 -- 172.21.15.146:0/4175581197 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42680 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d343e514a0 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.835+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d343e50960 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.836+0000 7fa5ad800640 1 -- 172.21.15.146:0/4175581197 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55d344b88400 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.836+0000 7fa5ad800640 1 -- 172.21.15.146:0/4175581197 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55d343e77180 con 0x55d344bec000 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.837+0000 7fa5b331e280 1 Processor -- start 2024-04-24T23:05:16.839 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.837+0000 7fa5b331e280 1 -- start start 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07800 0x55d343e88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07c00 0x55d343e8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d344b82480 con 0x55d344c07400 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d344b82600 con 0x55d344c07c00 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d344b82780 con 0x55d344c07800 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35010/0 (socket says 172.21.15.146:35010) 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 -- 172.21.15.146:0/3004434782 learned_addr learned my addr 172.21.15.146:0/3004434782 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 -- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07800 msgr2=0x55d343e88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07800 0x55d343e88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 -- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07c00 msgr2=0x55d343e8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.841 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07c00 0x55d343e8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.842 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.838+0000 7fa5b1400640 1 -- 172.21.15.146:0/3004434782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d343e503c0 con 0x55d344c07400 2024-04-24T23:05:16.842 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b1400640 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55d344cfa660 tx=0x55d344cfec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9189c9fb94327607 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.842 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5ab000640 1 -- 172.21.15.146:0/3004434782 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42d00 con 0x55d344c07400 2024-04-24T23:05:16.842 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5ab000640 1 -- 172.21.15.146:0/3004434782 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d343e48c40 con 0x55d344c07400 2024-04-24T23:05:16.842 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5ab000640 1 -- 172.21.15.146:0/3004434782 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42680 con 0x55d344c07400 2024-04-24T23:05:16.844 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 -- 172.21.15.146:0/3004434782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 msgr2=0x55d343e89600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.844 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55d344cfa660 tx=0x55d344cfec00 comp rx=0 tx=0).stop 2024-04-24T23:05:16.844 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 -- 172.21.15.146:0/3004434782 shutdown_connections 2024-04-24T23:05:16.844 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07c00 0x55d343e8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.844 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07800 0x55d343e88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 --2- 172.21.15.146:0/3004434782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e89600 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 -- 172.21.15.146:0/3004434782 >> 172.21.15.146:0/3004434782 conn(0x55d344bec400 msgr2=0x55d343f25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 -- 172.21.15.146:0/3004434782 shutdown_connections 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.839+0000 7fa5b331e280 1 -- 172.21.15.146:0/3004434782 wait complete. 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.840+0000 7fa5b331e280 1 Processor -- start 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.840+0000 7fa5b331e280 1 -- start start 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07800 0x55d343e8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07c00 0x55d343e8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d344b83b00 con 0x55d344c07400 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d344b83980 con 0x55d344c07800 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b331e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d344b82c00 con 0x55d344c07c00 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.845 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35012/0 (socket says 172.21.15.146:35012) 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.841+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 learned_addr learned my addr 172.21.15.146:0/4152036116 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07c00 msgr2=0x55d343e8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d344c07c00 0x55d343e8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07800 msgr2=0x55d343e8ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344c07800 0x55d343e8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d343e50780 con 0x55d344c07400 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b1400640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55d344cfa8d0 tx=0x55d343e99440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5a9200640 1 -- 172.21.15.146:0/4152036116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42820 con 0x55d344c07400 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5a9200640 1 -- 172.21.15.146:0/4152036116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d343e481c0 con 0x55d344c07400 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d343e50000 con 0x55d344c07400 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5a9200640 1 -- 172.21.15.146:0/4152036116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d343e42d00 con 0x55d344c07400 2024-04-24T23:05:16.846 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.842+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d343e51680 con 0x55d344c07400 2024-04-24T23:05:16.847 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.844+0000 7fa5a9200640 1 -- 172.21.15.146:0/4152036116 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d344d56c00 con 0x55d344c07400 2024-04-24T23:05:16.847 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.844+0000 7fa5a9200640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d344d5ac00 0x55d343e8b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.847 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.845+0000 7fa5a9200640 1 -- 172.21.15.146:0/4152036116 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55d344d54a00 con 0x55d344c07400 2024-04-24T23:05:16.848 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.845+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d344d5b000 0x55d343e8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.848 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.845+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d344d5b400 con 0x55d344d5b000 2024-04-24T23:05:16.848 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.845+0000 7fa5b0a00640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d344d5ac00 0x55d343e8b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.848 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.845+0000 7fa5b0000640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d344d5b000 0x55d343e8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.849 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.847+0000 7fa5b0000640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d344d5b000 0x55d343e8a100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.849 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.847+0000 7fa5b0a00640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d344d5ac00 0x55d343e8b700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55d344c3f5f0 tx=0x55d344bac720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.849 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.847+0000 7fa5b0000640 1 -- 172.21.15.146:0/4152036116 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55d344b9c000 con 0x55d344d5b000 2024-04-24T23:05:16.849 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.848+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d344d5b800 0x55d343e88580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.849 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.848+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55d344d5bc00 con 0x55d344d5b800 2024-04-24T23:05:16.850 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.848+0000 7fa5b1400640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d344d5b800 0x55d343e88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.851 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.849+0000 7fa5b1400640 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d344d5b800 0x55d343e88580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.852 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.850+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv27 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55d344b9c500 con 0x55d344d5b800 2024-04-24T23:05:16.852 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.850+0000 7fa5b331e280 -1 Header is invalid (inconsistent offsets) 2024-04-24T23:05:16.852 INFO:tasks.workunit.client.0.smithi146.stdout:Updating expire_pos 0x400000 -> 0x7b 2024-04-24T23:05:16.853 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.850+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55d3441a8000 con 0x55d344d5b800 2024-04-24T23:05:16.856 INFO:tasks.workunit.client.0.smithi146.stdout:Successfully updated header. 2024-04-24T23:05:16.858 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b1400640 1 -- 172.21.15.146:0/4152036116 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v57'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55d344b9c500 con 0x55d344d5b800 2024-04-24T23:05:16.858 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d344d5b800 msgr2=0x55d343e88580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.858 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d344d5b800 0x55d343e88580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.858 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d344d5b000 msgr2=0x55d343e8a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d344d5b000 0x55d343e8a100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d344d5ac00 msgr2=0x55d343e8b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d344d5ac00 0x55d343e8b700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55d344c3f5f0 tx=0x55d344bac720 comp rx=0 tx=0).stop 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 msgr2=0x55d343e8b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55d344cfa8d0 tx=0x55d343e99440 comp rx=0 tx=0).stop 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b0000640 1 -- 172.21.15.146:0/4152036116 reap_dead start 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 shutdown_connections 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4152036116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344c07400 0x55d343e8b180 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 >> 172.21.15.146:0/4152036116 conn(0x55d344bec400 msgr2=0x55d343f25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.859 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 shutdown_connections 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.855+0000 7fa5b331e280 1 -- 172.21.15.146:0/4152036116 wait complete. 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 msgr2=0x55d343e89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55d344c3ecc0 tx=0x55d344badda0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 shutdown_connections 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d344bec800 0x55d343e89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d343e1dc00 0x55d343e88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 --2- 172.21.15.146:0/4175581197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d344bec000 0x55d343e89080 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 >> 172.21.15.146:0/4175581197 conn(0x55d343e1d000 msgr2=0x55d343f26000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 shutdown_connections 2024-04-24T23:05:16.860 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.856+0000 7fa5b331e280 1 -- 172.21.15.146:0/4175581197 wait complete. 2024-04-24T23:05:16.862 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set trimmed_pos 123 2024-04-24T23:05:16.911 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.909+0000 7f6f2ebc5280 1 -- start start 2024-04-24T23:05:16.911 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.909+0000 7f6f2ebc5280 1 Processor -- start 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa8f518c00 0x55fa8f584580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa8f519800 0x55fa8f584b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027a180 con 0x55fa8f519c00 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027a300 con 0x55fa8f518c00 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fa9027a480 con 0x55fa8f519800 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35022/0 (socket says 172.21.15.146:35022) 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.910+0000 7f6f2d600640 1 -- 172.21.15.146:0/2613442294 learned_addr learned my addr 172.21.15.146:0/2613442294 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.914 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2c200640 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa8f519800 0x55fa8f584b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2cc00640 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa8f518c00 0x55fa8f584580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 -- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa8f519800 msgr2=0x55fa8f584b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa8f519800 0x55fa8f584b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 -- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa8f518c00 msgr2=0x55fa8f584580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa8f518c00 0x55fa8f584580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 -- 172.21.15.146:0/2613442294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8f54c780 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2d600640 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55fa90337350 tx=0x55fa902a9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c873d6b7386227d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f29a00640 1 -- 172.21.15.146:0/2613442294 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e9c0 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f29a00640 1 -- 172.21.15.146:0/2613442294 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa8f544700 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f29a00640 1 -- 172.21.15.146:0/2613442294 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e680 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8f54d4a0 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.911+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55fa8f54c000 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.912+0000 7f6f29a00640 1 -- 172.21.15.146:0/2613442294 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55fa903e8200 con 0x55fa8f519c00 2024-04-24T23:05:16.915 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.912+0000 7f6f29a00640 1 -- 172.21.15.146:0/2613442294 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55fa8f573180 con 0x55fa8f519c00 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.913+0000 7f6f2ebc5280 1 Processor -- start 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.913+0000 7f6f2ebc5280 1 -- start start 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.918 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027a600 con 0x55fa90434800 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027a780 con 0x55fa90434000 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fa9027a900 con 0x55fa90434400 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35032/0 (socket says 172.21.15.146:35032) 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 -- 172.21.15.146:0/610611655 learned_addr learned my addr 172.21.15.146:0/610611655 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2cc00640 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 -- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434400 msgr2=0x55fa8f585b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 -- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434000 msgr2=0x55fa8f585600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.914+0000 7f6f2c200640 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f2c200640 1 -- 172.21.15.146:0/610611655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8f54c3c0 con 0x55fa90434800 2024-04-24T23:05:16.919 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f2c200640 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55fa903ec8a0 tx=0x55fa903f0c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce19baa8bdf7921a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f27200640 1 -- 172.21.15.146:0/610611655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e9c0 con 0x55fa90434800 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f27200640 1 -- 172.21.15.146:0/610611655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa8f544fc0 con 0x55fa90434800 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f27200640 1 -- 172.21.15.146:0/610611655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e680 con 0x55fa90434800 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/610611655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 msgr2=0x55fa8f586100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.915+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55fa903ec8a0 tx=0x55fa903f0c60 comp rx=0 tx=0).stop 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/610611655 shutdown_connections 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434800 0x55fa8f586100 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/610611655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/610611655 >> 172.21.15.146:0/610611655 conn(0x55fa902a7c00 msgr2=0x55fa8f623000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/610611655 shutdown_connections 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/610611655 wait complete. 2024-04-24T23:05:16.920 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 Processor -- start 2024-04-24T23:05:16.921 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.916+0000 7f6f2ebc5280 1 -- start start 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434c00 0x55fa8f586680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027b980 con 0x55fa90434400 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fa9027a300 con 0x55fa90434c00 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2ebc5280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fa9027ac00 con 0x55fa90434000 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35038/0 (socket says 172.21.15.146:35038) 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.917+0000 7f6f2cc00640 1 -- 172.21.15.146:0/3867847474 learned_addr learned my addr 172.21.15.146:0/3867847474 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434000 msgr2=0x55fa8f585600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa90434000 0x55fa8f585600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434c00 msgr2=0x55fa8f586680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.923 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa90434c00 0x55fa8f586680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8f54c960 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2cc00640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55fa903ed560 tx=0x55fa903f19e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f25400640 1 -- 172.21.15.146:0/3867847474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e9c0 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f25400640 1 -- 172.21.15.146:0/3867847474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa8f544e00 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f25400640 1 -- 172.21.15.146:0/3867847474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fa8f53e680 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa8f54d680 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.918+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8f54d860 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.920+0000 7f6f25400640 1 -- 172.21.15.146:0/3867847474 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55fa903d8c00 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.921+0000 7f6f25400640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fa8f878000 0x55fa8f587700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.921+0000 7f6f25400640 1 -- 172.21.15.146:0/3867847474 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55fa903d6e00 con 0x55fa90434400 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.921+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fa90435000 0x55fa8f586c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.924 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.921+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fa8f878400 con 0x55fa90435000 2024-04-24T23:05:16.925 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.921+0000 7f6f2c200640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fa8f878000 0x55fa8f587700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.925 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.922+0000 7f6f2c200640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fa90435000 0x55fa8f586c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.925 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.923+0000 7f6f2c200640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fa8f878000 0x55fa8f587700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55fa90337020 tx=0x55fa8f80cde0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.925 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.923+0000 7f6f2c200640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fa90435000 0x55fa8f586c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.926 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.924+0000 7f6f2c200640 1 -- 172.21.15.146:0/3867847474 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55fa90298000 con 0x55fa90435000 2024-04-24T23:05:16.926 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.924+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fa8f878800 0x55fa8f587180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.926 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.924+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fa8f878c00 con 0x55fa8f878800 2024-04-24T23:05:16.926 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.924+0000 7f6f2d600640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fa8f878800 0x55fa8f587180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.927 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.925+0000 7f6f2d600640 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fa8f878800 0x55fa8f587180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.928 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.926+0000 7f6f2d600640 1 -- 172.21.15.146:0/3867847474 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv28 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55fa90298500 con 0x55fa8f878800 2024-04-24T23:05:16.928 INFO:tasks.workunit.client.0.smithi146.stdout:Updating trimmed_pos 0x400000 -> 0x7b 2024-04-24T23:05:16.929 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.926+0000 7f6f2ebc5280 -1 Header is invalid (inconsistent offsets) 2024-04-24T23:05:16.929 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.926+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55fa8f879000 con 0x55fa8f878800 2024-04-24T23:05:16.933 INFO:tasks.workunit.client.0.smithi146.stdout:Successfully updated header. 2024-04-24T23:05:16.934 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2d600640 1 -- 172.21.15.146:0/3867847474 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v57'29 uv29 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55fa90298500 con 0x55fa8f878800 2024-04-24T23:05:16.934 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fa8f878800 msgr2=0x55fa8f587180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.934 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fa8f878800 0x55fa8f587180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.934 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fa90435000 msgr2=0x55fa8f586c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fa90435000 0x55fa8f586c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fa8f878000 msgr2=0x55fa8f587700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fa8f878000 0x55fa8f587700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55fa90337020 tx=0x55fa8f80cde0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 msgr2=0x55fa8f585b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55fa903ed560 tx=0x55fa903f19e0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2cc00640 1 -- 172.21.15.146:0/3867847474 reap_dead start 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 shutdown_connections 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/3867847474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa90434400 0x55fa8f585b80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.931+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 >> 172.21.15.146:0/3867847474 conn(0x55fa902a7c00 msgr2=0x55fa8f623000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 shutdown_connections 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/3867847474 wait complete. 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 msgr2=0x55fa8f585080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55fa90337350 tx=0x55fa902a9e60 comp rx=0 tx=0).stop 2024-04-24T23:05:16.935 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 shutdown_connections 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa8f519c00 0x55fa8f585080 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fa8f519800 0x55fa8f584b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 --2- 172.21.15.146:0/2613442294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fa8f518c00 0x55fa8f584580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 >> 172.21.15.146:0/2613442294 conn(0x55fa8f519000 msgr2=0x55fa8f622800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 shutdown_connections 2024-04-24T23:05:16.936 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.932+0000 7f6f2ebc5280 1 -- 172.21.15.146:0/2613442294 wait complete. 2024-04-24T23:05:16.939 INFO:tasks.workunit.client.0.smithi146.stdout:Rolling back journal to original state... 2024-04-24T23:05:16.939 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Rolling back journal to original state...' 2024-04-24T23:05:16.940 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-04-24T23:05:16.988 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.986+0000 7f6a9ac11280 1 -- start start 2024-04-24T23:05:16.988 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.986+0000 7f6a9ac11280 1 Processor -- start 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957b29800 0x560957b94b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560957b29c00 0x560957b95080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56095888a180 con 0x560957b28c00 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56095888a300 con 0x560957b29800 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56095888a480 con 0x560957b29c00 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a98000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a98000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35054/0 (socket says 172.21.15.146:35054) 2024-04-24T23:05:16.989 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a98000640 1 -- 172.21.15.146:0/1266100237 learned_addr learned my addr 172.21.15.146:0/1266100237 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a98a00640 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560957b29c00 0x560957b95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.987+0000 7f6a97600640 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957b29800 0x560957b94b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 -- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560957b29c00 msgr2=0x560957b95080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560957b29c00 0x560957b95080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 -- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957b29800 msgr2=0x560957b94b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957b29800 0x560957b94b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 -- 172.21.15.146:0/1266100237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957b5c780 con 0x560957b28c00 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a98000640 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x56095894d380 tx=0x5609588b86c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf394b97985b182 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a94e00640 1 -- 172.21.15.146:0/1266100237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e680 con 0x560957b28c00 2024-04-24T23:05:16.991 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a94e00640 1 -- 172.21.15.146:0/1266100237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560957b54700 con 0x560957b28c00 2024-04-24T23:05:16.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a94e00640 1 -- 172.21.15.146:0/1266100237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4eb60 con 0x560957b28c00 2024-04-24T23:05:16.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560957b5c3c0 con 0x560957b28c00 2024-04-24T23:05:16.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560957b5d680 con 0x560957b28c00 2024-04-24T23:05:16.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.988+0000 7f6a94e00640 1 -- 172.21.15.146:0/1266100237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5609589ec600 con 0x560957b28c00 2024-04-24T23:05:16.992 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.989+0000 7f6a94e00640 1 -- 172.21.15.146:0/1266100237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x560957b83180 con 0x560957b28c00 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.989+0000 7f6a9ac11280 1 Processor -- start 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 -- start start 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3400 0x560957b95600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56095888a600 con 0x5609589f3c00 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56095888a780 con 0x5609589f3400 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.990+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56095888a900 con 0x5609589f3800 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35056/0 (socket says 172.21.15.146:35056) 2024-04-24T23:05:16.995 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 -- 172.21.15.146:0/4243343929 learned_addr learned my addr 172.21.15.146:0/4243343929 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a98000640 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 -- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 msgr2=0x560957b95b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b95b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 -- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3400 msgr2=0x560957b95600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3400 0x560957b95600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 -- 172.21.15.146:0/4243343929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957b5d4a0 con 0x5609589f3c00 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.991+0000 7f6a97600640 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x560958a0a780 tx=0x5609588b8720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2089c4ce6788f238 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a92600640 1 -- 172.21.15.146:0/4243343929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e9c0 con 0x5609589f3c00 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a92600640 1 -- 172.21.15.146:0/4243343929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560957b54fc0 con 0x5609589f3c00 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a92600640 1 -- 172.21.15.146:0/4243343929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e680 con 0x5609589f3c00 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4243343929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 msgr2=0x560957b96100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x560958a0a780 tx=0x5609588b8720 comp rx=0 tx=0).stop 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4243343929 shutdown_connections 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3c00 0x560957b96100 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.996 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b95b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4243343929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3400 0x560957b95600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4243343929 >> 172.21.15.146:0/4243343929 conn(0x5609589f3000 msgr2=0x560957c33000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4243343929 shutdown_connections 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.992+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4243343929 wait complete. 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.993+0000 7f6a9ac11280 1 Processor -- start 2024-04-24T23:05:16.997 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.993+0000 7f6a9ac11280 1 -- start start 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b96c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 0x560957b96680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560957b8a180 con 0x5609589f3400 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56095888be00 con 0x5609589f3c00 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56095888ad80 con 0x5609589f3800 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a98a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a98a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35072/0 (socket says 172.21.15.146:35072) 2024-04-24T23:05:16.999 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a98a00640 1 -- 172.21.15.146:0/836589262 learned_addr learned my addr 172.21.15.146:0/836589262 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a98000640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.994+0000 7f6a97600640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 0x560957b96680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 -- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 msgr2=0x560957b96c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b96c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 -- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 msgr2=0x560957b96680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 0x560957b96680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 -- 172.21.15.146:0/836589262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957b5c780 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a97600640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 0x560957b96680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a98a00640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x560958a0b5c0 tx=0x560958a0f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a90800640 1 -- 172.21.15.146:0/836589262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e9c0 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a90800640 1 -- 172.21.15.146:0/836589262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560957b54c40 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560957b5c3c0 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a90800640 1 -- 172.21.15.146:0/836589262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e680 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.995+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560957b5c000 con 0x5609589f3400 2024-04-24T23:05:17.000 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.997+0000 7f6a90800640 1 -- 172.21.15.146:0/836589262 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56095891ec00 con 0x5609589f3400 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.998+0000 7f6a90800640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 0x560957b97700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.998+0000 7f6a90800640 1 -- 172.21.15.146:0/836589262 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x560958a64a00 con 0x5609589f3400 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.998+0000 7f6a98000640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 0x560957b97700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.999+0000 7f6a9ac11280 1 -- start start 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.999+0000 7f6a9ac11280 1 Processor -- start 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:16.999+0000 7f6a98000640 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 0x560957b97700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x560958a0a5a0 tx=0x5609588b8900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560958927800 0x560957b96100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 0x560957b95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957ee5000 0x560957b95600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.002 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56095888b080 con 0x560958927c00 2024-04-24T23:05:17.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56095888bb00 con 0x560957ee5000 2024-04-24T23:05:17.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a9ac11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56095888bc80 con 0x560958927800 2024-04-24T23:05:17.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 0x560957b95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 0x560957b95b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35088/0 (socket says 172.21.15.146:35088) 2024-04-24T23:05:17.003 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 -- 172.21.15.146:0/4077837298 learned_addr learned my addr 172.21.15.146:0/4077837298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.004 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560958927800 msgr2=0x560957b96100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.004 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560958927800 0x560957b96100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.004 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957ee5000 msgr2=0x560957b95600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.004 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957ee5000 0x560957b95600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.004 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.000+0000 7f6a98000640 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560957b5c960 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a98000640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 0x560957b95b80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x560957e478c0 tx=0x5609588b9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1439a1eb5684a6f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a8cc00640 1 -- 172.21.15.146:0/4077837298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560957b4e820 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a8cc00640 1 -- 172.21.15.146:0/4077837298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560957b548c0 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a8cc00640 1 -- 172.21.15.146:0/4077837298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560958a95d40 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560957b5c780 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560957b5c3c0 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a8cc00640 1 -- 172.21.15.146:0/4077837298 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x560957eee200 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.001+0000 7f6a8cc00640 1 -- 172.21.15.146:0/4077837298 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x560957b83500 con 0x560958927c00 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.002+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x560957ee5400 0x560957f0c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.002+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x560957ee5800 con 0x560957ee5400 2024-04-24T23:05:17.005 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.002+0000 7f6a98a00640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x560957ee5400 0x560957f0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.006 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.003+0000 7f6a98a00640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x560957ee5400 0x560957f0c000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=b7bf7d2c9a6abe08 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.006 INFO:tasks.workunit.client.0.smithi146.stdout:undump /tmp/journal.bin 2024-04-24T23:05:17.007 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.004+0000 7f6a98a00640 1 -- 172.21.15.146:0/4077837298 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5609588a8000 con 0x560957ee5400 2024-04-24T23:05:17.007 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.004+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x560957ee5c00 0x560957f0c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.007 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.004+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x560957f03800 con 0x560957ee5c00 2024-04-24T23:05:17.007 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.005+0000 7f6a97600640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x560957ee5c00 0x560957f0c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.007 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.006+0000 7f6a97600640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x560957ee5c00 0x560957f0c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=4d91ebf797ef3235 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.008 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.006+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.008 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.006+0000 7f6a8ae00640 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5609588b7400 con 0x560957ee5c00 2024-04-24T23:05:17.008 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.006+0000 7f6a8ae00640 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:4 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x5609588b7000 con 0x560957ee5c00 2024-04-24T23:05:17.009 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.007+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000000 [stat out=16b] v0'0 uv29 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.009 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.007+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(4 200.00000001 [stat out=16b] v0'0 uv26 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.009 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.007+0000 7f6a8ae00640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5609588b6c00 0x560957f0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.009 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.008+0000 7f6a8ae00640 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:5 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x560957f03800 con 0x5609588b6c00 2024-04-24T23:05:17.010 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.008+0000 7f6a98a00640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5609588b6c00 0x560957f0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.011 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.009+0000 7f6a98a00640 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5609588b6c00 0x560957f0e680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=a1f07de2dff1fe45 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.011 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.010+0000 7f6a98a00640 1 -- 172.21.15.146:0/4077837298 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(5 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5609588a8000 con 0x5609588b6c00 2024-04-24T23:05:17.012 INFO:tasks.workunit.client.0.smithi146.stdout:start 4194304 len 33090 write_pos 4200296 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-04-24T23:05:17.012 INFO:tasks.workunit.client.0.smithi146.stdout:writing header 200.00000000 2024-04-24T23:05:17.012 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.010+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x560957f03c00 con 0x560957ee5c00 2024-04-24T23:05:17.015 INFO:tasks.workunit.client.0.smithi146.stdout:Purging 2 objects from 1 2024-04-24T23:05:17.016 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.014+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(6 200.00000000 [writefull 0~90] v57'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.016 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.014+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:7 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x560957f24000 con 0x560957ee5c00 2024-04-24T23:05:17.016 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.014+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:8 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x560957f24400 con 0x5609588b6c00 2024-04-24T23:05:17.019 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.018+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(7 200.00000001 [delete] v57'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.020 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.018+0000 7f6a98a00640 1 -- 172.21.15.146:0/4077837298 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(8 200.00000002 [delete] v57'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5609588a8000 con 0x5609588b6c00 2024-04-24T23:05:17.020 INFO:tasks.workunit.client.0.smithi146.stdout: writing 4194304~33090 2024-04-24T23:05:17.020 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.018+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:9 7.14 7:2e2fa760:::200.00000001:head [write 0~33090 in=33090b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x560957f24800 con 0x560957ee5c00 2024-04-24T23:05:17.025 INFO:tasks.workunit.client.0.smithi146.stdout:done. 2024-04-24T23:05:17.027 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(9 200.00000001 [write 0~33090] v57'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5609588a8500 con 0x560957ee5c00 2024-04-24T23:05:17.027 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5609588b6c00 msgr2=0x560957f0e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.027 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5609588b6c00 0x560957f0e680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.027 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x560957ee5c00 msgr2=0x560957f0c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x560957ee5c00 0x560957f0c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x560957ee5400 msgr2=0x560957f0c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.023+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x560957ee5400 0x560957f0c000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 msgr2=0x560957b95b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/4077837298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560958927c00 0x560957b95b80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x560957e478c0 tx=0x5609588b9e60 comp rx=0 tx=0).stop 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 reap_dead start 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a97600640 1 -- 172.21.15.146:0/4077837298 reap_dead start 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 shutdown_connections 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 >> 172.21.15.146:0/4077837298 conn(0x560958927400 msgr2=0x560957c33800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 shutdown_connections 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/4077837298 wait complete. 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 msgr2=0x560957b97700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 0x560957b97700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x560958a0a5a0 tx=0x5609588b8900 comp rx=0 tx=0).stop 2024-04-24T23:05:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 msgr2=0x560957b97180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x560958a0b5c0 tx=0x560958a0f8c0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 shutdown_connections 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609589f3c00 0x560957b96680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x560958927000 0x560957b97700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5609589f3800 0x560957b96c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/836589262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5609589f3400 0x560957b97180 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.024+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 >> 172.21.15.146:0/836589262 conn(0x5609589f3000 msgr2=0x560957c33000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 shutdown_connections 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/836589262 wait complete. 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 msgr2=0x560957b94580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x56095894d380 tx=0x5609588b86c0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 shutdown_connections 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560957b29c00 0x560957b95080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.029 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560957b29800 0x560957b94b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.030 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 --2- 172.21.15.146:0/1266100237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560957b28c00 0x560957b94580 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.030 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 >> 172.21.15.146:0/1266100237 conn(0x560957b29000 msgr2=0x560957c32800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.030 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.025+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 shutdown_connections 2024-04-24T23:05:17.030 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.026+0000 7f6a9ac11280 1 -- 172.21.15.146:0/1266100237 wait complete. 2024-04-24T23:05:17.032 INFO:tasks.workunit.client.0.smithi146.stdout:Testing 'event' commands... 2024-04-24T23:05:17.033 INFO:tasks.workunit.client.0.smithi146.stderr:+ echo 'Testing '\''event'\'' commands...' 2024-04-24T23:05:17.033 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get summary 2024-04-24T23:05:17.085 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.083+0000 7fde3b2f7280 1 -- start start 2024-04-24T23:05:17.085 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.083+0000 7fde3b2f7280 1 Processor -- start 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 0x55f605d3b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98000 0x55f605d3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9e000 con 0x55f605db5c00 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9e180 con 0x55f606b98000 2024-04-24T23:05:17.086 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f606b9e300 con 0x55f605db4400 2024-04-24T23:05:17.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde38a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde38a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35098/0 (socket says 172.21.15.146:35098) 2024-04-24T23:05:17.087 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.084+0000 7fde38a00640 1 -- 172.21.15.146:0/2102368398 learned_addr learned my addr 172.21.15.146:0/2102368398 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.088 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde39400640 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 0x55f605d3b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 -- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 msgr2=0x55f605d3b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 0x55f605d3b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 -- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98000 msgr2=0x55f605d3a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98000 0x55f605d3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 -- 172.21.15.146:0/2102368398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f605d02780 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde39400640 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 0x55f605d3b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde38a00640 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x55f606aff350 tx=0x55f606a5e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787c9c6b1811bbc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde36200640 1 -- 172.21.15.146:0/2102368398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf4680 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde36200640 1 -- 172.21.15.146:0/2102368398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f605cfaa80 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde36200640 1 -- 172.21.15.146:0/2102368398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf49c0 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f605d03680 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.085+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f605d02000 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.086+0000 7fde36200640 1 -- 172.21.15.146:0/2102368398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55f606ba6400 con 0x55f605db5c00 2024-04-24T23:05:17.089 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.086+0000 7fde36200640 1 -- 172.21.15.146:0/2102368398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55f605d29180 con 0x55f605db5c00 2024-04-24T23:05:17.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.087+0000 7fde3b2f7280 1 Processor -- start 2024-04-24T23:05:17.090 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.087+0000 7fde3b2f7280 1 -- start start 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98800 0x55f605d3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b99000 0x55f605d3c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9e480 con 0x55f606b98c00 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9e600 con 0x55f606b98800 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f606b9e780 con 0x55f606b99000 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35112/0 (socket says 172.21.15.146:35112) 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 -- 172.21.15.146:0/2646204963 learned_addr learned my addr 172.21.15.146:0/2646204963 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39e00640 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98800 0x55f605d3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 -- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b99000 msgr2=0x55f605d3c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.092 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b99000 0x55f605d3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 -- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98800 msgr2=0x55f605d3bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98800 0x55f605d3bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.088+0000 7fde39400640 1 -- 172.21.15.146:0/2646204963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f605d023c0 con 0x55f606b98c00 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde39400640 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55f606aff230 tx=0x55f606bbccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d69ba8e9b077a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde33a00640 1 -- 172.21.15.146:0/2646204963 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf4680 con 0x55f606b98c00 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde33a00640 1 -- 172.21.15.146:0/2646204963 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f605cfae00 con 0x55f606b98c00 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde33a00640 1 -- 172.21.15.146:0/2646204963 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf49c0 con 0x55f606b98c00 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2646204963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 msgr2=0x55f605d3c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55f606aff230 tx=0x55f606bbccc0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2646204963 shutdown_connections 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.089+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b99000 0x55f605d3c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3c100 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2646204963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98800 0x55f605d3bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2646204963 >> 172.21.15.146:0/2646204963 conn(0x55f606b98400 msgr2=0x55f605dc1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.093 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2646204963 shutdown_connections 2024-04-24T23:05:17.094 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2646204963 wait complete. 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 Processor -- start 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.090+0000 7fde3b2f7280 1 -- start start 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b98800 0x55f605d3d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b99000 0x55f605d3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9fb00 con 0x55f606b98c00 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f606b9f980 con 0x55f606b99000 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde3b2f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f606b9ec00 con 0x55f606b98800 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde39400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.091+0000 7fde39400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35122/0 (socket says 172.21.15.146:35122) 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 learned_addr learned my addr 172.21.15.146:0/1940126618 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39e00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b98800 0x55f605d3d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.096 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b98800 msgr2=0x55f605d3d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f606b98800 0x55f605d3d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde38a00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b99000 0x55f605d3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b99000 msgr2=0x55f605d3cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b99000 0x55f605d3cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f605d02960 con 0x55f606b98c00 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde39400640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55f606bba9c0 tx=0x55f606bbcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde31c00640 1 -- 172.21.15.146:0/1940126618 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf4680 con 0x55f606b98c00 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde31c00640 1 -- 172.21.15.146:0/1940126618 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f605cfac40 con 0x55f606b98c00 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde31c00640 1 -- 172.21.15.146:0/1940126618 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f605cf49c0 con 0x55f606b98c00 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.092+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f605d03860 con 0x55f606b98c00 2024-04-24T23:05:17.097 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.093+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f605d03a40 con 0x55f606b98c00 2024-04-24T23:05:17.098 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.094+0000 7fde31c00640 1 -- 172.21.15.146:0/1940126618 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55f606a28c00 con 0x55f606b98c00 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.095+0000 7fde31c00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 0x55f606044000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.095+0000 7fde31c00640 1 -- 172.21.15.146:0/1940126618 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55f606a3a000 con 0x55f606b98c00 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.095+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f606c16800 0x55f605d3c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.095+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f606c16c00 con 0x55f606c16800 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.096+0000 7fde39e00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 0x55f606044000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.096+0000 7fde38a00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f606c16800 0x55f605d3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.097+0000 7fde38a00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f606c16800 0x55f605d3c680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.097+0000 7fde39e00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 0x55f606044000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55f606a488a0 tx=0x55f605fd2de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.098+0000 7fde38a00640 1 -- 172.21.15.146:0/1940126618 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55f606a4e000 con 0x55f606c16800 2024-04-24T23:05:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.098+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f606c17000 0x55f605d3c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.098+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f606c17400 con 0x55f606c17000 2024-04-24T23:05:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.098+0000 7fde39e00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f606c17000 0x55f605d3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.101 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.099+0000 7fde39e00640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f606c17000 0x55f605d3c100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.102 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.100+0000 7fde39e00640 1 -- 172.21.15.146:0/1940126618 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55f606a4e500 con 0x55f606c17000 2024-04-24T23:05:17.102 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.100+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f606c17800 con 0x55f606c17000 2024-04-24T23:05:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.102+0000 7fde39e00640 1 -- 172.21.15.146:0/1940126618 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55f606a4e500 con 0x55f606c17000 2024-04-24T23:05:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.102+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f606c17c00 0x55f605d3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.102+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55f606068000 con 0x55f606c17c00 2024-04-24T23:05:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.103+0000 7fde39400640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f606c17c00 0x55f605d3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.105 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.104+0000 7fde39400640 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f606c17c00 0x55f605d3bb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.106 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.104+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f60605ef00 con 0x55f606c17c00 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout:Events by type: 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: LID: 1 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: OPEN: 1 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: PURGED: 1 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: SESSION: 2 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: SUBTREEMAP: 1 2024-04-24T23:05:17.107 INFO:tasks.workunit.client.0.smithi146.stdout: UPDATE: 15 2024-04-24T23:05:17.108 INFO:tasks.workunit.client.0.smithi146.stdout:Errors: 0 2024-04-24T23:05:17.109 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f606c17c00 msgr2=0x55f605d3bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.109 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55f606c17c00 0x55f605d3bb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.109 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f606c17000 msgr2=0x55f605d3c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.109 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55f606c17000 0x55f605d3c100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.109 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f606c16800 msgr2=0x55f605d3c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55f606c16800 0x55f605d3c680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde39400640 1 -- 172.21.15.146:0/1940126618 reap_dead start 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 msgr2=0x55f606044000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 0x55f606044000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55f606a488a0 tx=0x55f605fd2de0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 msgr2=0x55f605d3d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55f606bba9c0 tx=0x55f606bbcc00 comp rx=0 tx=0).stop 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 shutdown_connections 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f606b98c00 0x55f605d3d180 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/1940126618 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f606c16400 0x55f606044000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 >> 172.21.15.146:0/1940126618 conn(0x55f606b98400 msgr2=0x55f605dc1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 shutdown_connections 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/1940126618 wait complete. 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 msgr2=0x55f605d3ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.110 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.105+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x55f606aff350 tx=0x55f606a5e900 comp rx=0 tx=0).stop 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 shutdown_connections 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f606b98000 0x55f605d3a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f605db5c00 0x55f605d3ab00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 --2- 172.21.15.146:0/2102368398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f605db4400 0x55f605d3b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 >> 172.21.15.146:0/2102368398 conn(0x55f605ccf000 msgr2=0x55f605dc0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 shutdown_connections 2024-04-24T23:05:17.111 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.106+0000 7fde3b2f7280 1 -- 172.21.15.146:0/2102368398 wait complete. 2024-04-24T23:05:17.112 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get --type=UPDATE --path=/ --inode=0 --frag=0x100 summary 2024-04-24T23:05:17.164 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.162+0000 7feab3e81280 1 -- start start 2024-04-24T23:05:17.164 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.162+0000 7feab3e81280 1 Processor -- start 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de50c48c00 0x55de50cb5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de50c49800 0x55de50cb5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55de519aa180 con 0x55de50c49c00 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55de50caa480 con 0x55de50c49800 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55de50caa900 con 0x55de50c48c00 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35146/0 (socket says 172.21.15.146:35146) 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 -- 172.21.15.146:0/894544119 learned_addr learned my addr 172.21.15.146:0/894544119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.166 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2000640 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de50c48c00 0x55de50cb5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab1600640 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de50c49800 0x55de50cb5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 -- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de50c48c00 msgr2=0x55de50cb5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de50c48c00 0x55de50cb5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 -- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de50c49800 msgr2=0x55de50cb5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de50c49800 0x55de50cb5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.163+0000 7feab2a00640 1 -- 172.21.15.146:0/894544119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de50c7c780 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feab2a00640 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x55de51a61380 tx=0x55de519d9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f554c01b4c16f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feaaee00640 1 -- 172.21.15.146:0/894544119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6e680 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feaaee00640 1 -- 172.21.15.146:0/894544119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55de50c74700 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feaaee00640 1 -- 172.21.15.146:0/894544119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6eb60 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de50c7d4a0 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55de50c7c000 con 0x55de50c49c00 2024-04-24T23:05:17.167 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feaaee00640 1 -- 172.21.15.146:0/894544119 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55de51b0c600 con 0x55de50c49c00 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.164+0000 7feaaee00640 1 -- 172.21.15.146:0/894544119 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55de50ca3180 con 0x55de50c49c00 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.165+0000 7feab3e81280 1 Processor -- start 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 -- start start 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55de50caa180 con 0x55de51b0fc00 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55de519ab500 con 0x55de51b0f400 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.166+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55de519ab380 con 0x55de51b0f800 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35156/0 (socket says 172.21.15.146:35156) 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 -- 172.21.15.146:0/1493060302 learned_addr learned my addr 172.21.15.146:0/1493060302 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.169 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 -- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0f800 msgr2=0x55de50cb4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.170 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.170 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 -- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 msgr2=0x55de50cb4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.170 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.170 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 -- 172.21.15.146:0/1493060302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de50c7c3c0 con 0x55de51b0fc00 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feab1600640 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55de51b2a690 tx=0x55de51b2f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a490d40fae63f0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feaac600640 1 -- 172.21.15.146:0/1493060302 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6e680 con 0x55de51b0fc00 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feaac600640 1 -- 172.21.15.146:0/1493060302 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55de50c74fc0 con 0x55de51b0fc00 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.167+0000 7feaac600640 1 -- 172.21.15.146:0/1493060302 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6eb60 con 0x55de51b0fc00 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 -- 172.21.15.146:0/1493060302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 msgr2=0x55de50cb6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55de51b2a690 tx=0x55de51b2f800 comp rx=0 tx=0).stop 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 -- 172.21.15.146:0/1493060302 shutdown_connections 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 --2- 172.21.15.146:0/1493060302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 -- 172.21.15.146:0/1493060302 >> 172.21.15.146:0/1493060302 conn(0x55de51b0f000 msgr2=0x55de50d53000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.172 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 -- 172.21.15.146:0/1493060302 shutdown_connections 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.168+0000 7feab3e81280 1 -- 172.21.15.146:0/1493060302 wait complete. 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.169+0000 7feab3e81280 1 Processor -- start 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.169+0000 7feab3e81280 1 -- start start 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55de519aa780 con 0x55de51b0f800 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55de519aa900 con 0x55de51b0f400 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab3e81280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55de519aa600 con 0x55de51b0fc00 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35168/0 (socket says 172.21.15.146:35168) 2024-04-24T23:05:17.173 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 learned_addr learned my addr 172.21.15.146:0/606680566 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0fc00 msgr2=0x55de50cb6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de51b0fc00 0x55de50cb6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 msgr2=0x55de50cb4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de50c7c780 con 0x55de51b0f800 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.170+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de51b0f400 0x55de50cb4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.180 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feab2000640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55de51b2b320 tx=0x55de519d8720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feaaa800640 1 -- 172.21.15.146:0/606680566 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6e9c0 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feaaa800640 1 -- 172.21.15.146:0/606680566 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55de50c74a80 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feaaa800640 1 -- 172.21.15.146:0/606680566 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de50c6e680 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de50c7d4a0 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.171+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de50c7c960 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.173+0000 7feaaa800640 1 -- 172.21.15.146:0/606680566 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55de51b8cc00 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.173+0000 7feaaa800640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 0x55de50fb8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.173+0000 7feaaa800640 1 -- 172.21.15.146:0/606680566 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55de51b8ac00 con 0x55de51b0f800 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.173+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55de51b89400 0x55de50cb6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.173+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55de51b89800 con 0x55de51b89400 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.174+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 0x55de50fb8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.174+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55de51b89400 0x55de50cb6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.181 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.175+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 0x55de50fb8000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55de51b2a7e0 tx=0x55de50f4aae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.175+0000 7feab1600640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55de51b89400 0x55de50cb6680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.176+0000 7feab1600640 1 -- 172.21.15.146:0/606680566 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55de519c8000 con 0x55de51b89400 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.176+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55de51b89c00 0x55de50cb6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.176+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55de51b86000 con 0x55de51b89c00 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.177+0000 7feab2a00640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55de51b89c00 0x55de50cb6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.182 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.178+0000 7feab2a00640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55de51b89c00 0x55de50cb6c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.179+0000 7feab2a00640 1 -- 172.21.15.146:0/606680566 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55de519c8500 con 0x55de51b89c00 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.179+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55de51b86400 con 0x55de51b89c00 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.180+0000 7feab2a00640 1 -- 172.21.15.146:0/606680566 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55de519c8500 con 0x55de51b89c00 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.180+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55de51b86800 0x55de50cb7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.180+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55de51b86c00 con 0x55de51b86800 2024-04-24T23:05:17.183 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.181+0000 7feab2000640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55de51b86800 0x55de50cb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.184 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.182+0000 7feab2000640 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55de51b86800 0x55de50cb7180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.184 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.182+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55de519c9900 con 0x55de51b86800 2024-04-24T23:05:17.184 INFO:tasks.workunit.client.0.smithi146.stdout:Events by type: 2024-04-24T23:05:17.185 INFO:tasks.workunit.client.0.smithi146.stdout: UPDATE: 4 2024-04-24T23:05:17.185 INFO:tasks.workunit.client.0.smithi146.stdout:Errors: 0 2024-04-24T23:05:17.186 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55de51b86800 msgr2=0x55de50cb7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.186 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55de51b86800 0x55de50cb7180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55de51b89c00 msgr2=0x55de50cb6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55de51b89c00 0x55de50cb6c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55de51b89400 msgr2=0x55de50cb6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55de51b89400 0x55de50cb6680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab2000640 1 -- 172.21.15.146:0/606680566 reap_dead start 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 msgr2=0x55de50fb8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 0x55de50fb8000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55de51b2a7e0 tx=0x55de50f4aae0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 msgr2=0x55de50cb4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55de51b2b320 tx=0x55de519d8720 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 shutdown_connections 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55de51b89000 0x55de50fb8000 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.187 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/606680566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de51b0f800 0x55de50cb4580 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 >> 172.21.15.146:0/606680566 conn(0x55de51b0f000 msgr2=0x55de50d53000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 shutdown_connections 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/606680566 wait complete. 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 msgr2=0x55de50cb5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.183+0000 7feab3e81280 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x55de51a61380 tx=0x55de519d9e60 comp rx=0 tx=0).stop 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 shutdown_connections 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55de50c49c00 0x55de50cb5080 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de50c49800 0x55de50cb5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 --2- 172.21.15.146:0/894544119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55de50c48c00 0x55de50cb5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 >> 172.21.15.146:0/894544119 conn(0x55de50c49000 msgr2=0x55de50d52800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 shutdown_connections 2024-04-24T23:05:17.188 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.184+0000 7feab3e81280 1 -- 172.21.15.146:0/894544119 wait complete. 2024-04-24T23:05:17.190 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get json --path /tmp/json.tmp 2024-04-24T23:05:17.238 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.236+0000 7fc75ce15280 1 -- start start 2024-04-24T23:05:17.238 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.236+0000 7fc75ce15280 1 Processor -- start 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1b800 0x559705c86b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559705c1bc00 0x559705c87080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55970697c180 con 0x5597069a9400 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55970697c300 con 0x559705c1b800 2024-04-24T23:05:17.240 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55970697c480 con 0x559705c1bc00 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35188/0 (socket says 172.21.15.146:35188) 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.237+0000 7fc75ac00640 1 -- 172.21.15.146:0/4124056778 learned_addr learned my addr 172.21.15.146:0/4124056778 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc759800640 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559705c1bc00 0x559705c87080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75a200640 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1b800 0x559705c86b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 -- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559705c1bc00 msgr2=0x559705c87080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559705c1bc00 0x559705c87080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 -- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1b800 msgr2=0x559705c86b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1b800 0x559705c86b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 -- 172.21.15.146:0/4124056778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559705c4e780 con 0x5597069a9400 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ac00640 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559706a314a0 tx=0x5597069aa7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1030574f6add9b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc757000640 1 -- 172.21.15.146:0/4124056778 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c40680 con 0x5597069a9400 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc757000640 1 -- 172.21.15.146:0/4124056778 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559705c46700 con 0x5597069a9400 2024-04-24T23:05:17.241 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc757000640 1 -- 172.21.15.146:0/4124056778 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c40b60 con 0x5597069a9400 2024-04-24T23:05:17.242 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559705c4f4a0 con 0x5597069a9400 2024-04-24T23:05:17.242 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.238+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559705c4e000 con 0x5597069a9400 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.239+0000 7fc757000640 1 -- 172.21.15.146:0/4124056778 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x559706adc600 con 0x5597069a9400 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.239+0000 7fc757000640 1 -- 172.21.15.146:0/4124056778 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x559705c75180 con 0x5597069a9400 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.240+0000 7fc75ce15280 1 Processor -- start 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.240+0000 7fc75ce15280 1 -- start start 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c88100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559706af1000 0x559705c88680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55970697c600 con 0x5597069a8800 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55970697c780 con 0x559705c1ac00 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55970697c900 con 0x559706af1000 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.244 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35192/0 (socket says 172.21.15.146:35192) 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 -- 172.21.15.146:0/910611998 learned_addr learned my addr 172.21.15.146:0/910611998 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 -- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559706af1000 msgr2=0x559705c88680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559706af1000 0x559705c88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 -- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 msgr2=0x559705c88100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc75a200640 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c88100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.241+0000 7fc759800640 1 -- 172.21.15.146:0/910611998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559705c4e3c0 con 0x5597069a8800 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc759800640 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x559706afa900 tx=0x559706afd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6a0ab150216096 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc754800640 1 -- 172.21.15.146:0/910611998 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c40680 con 0x5597069a8800 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc754800640 1 -- 172.21.15.146:0/910611998 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559705c46fc0 con 0x5597069a8800 2024-04-24T23:05:17.245 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc754800640 1 -- 172.21.15.146:0/910611998 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c40b60 con 0x5597069a8800 2024-04-24T23:05:17.247 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 -- 172.21.15.146:0/910611998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 msgr2=0x559705c87b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x559706afa900 tx=0x559706afd800 comp rx=0 tx=0).stop 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 -- 172.21.15.146:0/910611998 shutdown_connections 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559706af1000 0x559705c88680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c88100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 --2- 172.21.15.146:0/910611998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a8800 0x559705c87b80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.242+0000 7fc75ce15280 1 -- 172.21.15.146:0/910611998 >> 172.21.15.146:0/910611998 conn(0x5597069a9000 msgr2=0x559705d25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.243+0000 7fc75ce15280 1 -- 172.21.15.146:0/910611998 shutdown_connections 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.243+0000 7fc75ce15280 1 -- 172.21.15.146:0/910611998 wait complete. 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.243+0000 7fc75ce15280 1 Processor -- start 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.243+0000 7fc75ce15280 1 -- start start 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5597069a9000 0x559705c88100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c87b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.248 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55970697c900 con 0x559706af1c00 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55970697ca80 con 0x559705c1ac00 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc75ce15280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55970697c780 con 0x5597069a9000 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc759800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc759800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35200/0 (socket says 172.21.15.146:35200) 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.244+0000 7fc759800640 1 -- 172.21.15.146:0/1716838235 learned_addr learned my addr 172.21.15.146:0/1716838235 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5597069a9000 msgr2=0x559705c88100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5597069a9000 0x559705c88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 msgr2=0x559705c87b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1ac00 0x559705c87b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559705c4e780 con 0x559706af1c00 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc759800640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x559706afb5c0 tx=0x5597069aa780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc752a00640 1 -- 172.21.15.146:0/1716838235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c404e0 con 0x559706af1c00 2024-04-24T23:05:17.249 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc752a00640 1 -- 172.21.15.146:0/1716838235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559705c46e00 con 0x559706af1c00 2024-04-24T23:05:17.250 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559705c4f4a0 con 0x559706af1c00 2024-04-24T23:05:17.250 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc752a00640 1 -- 172.21.15.146:0/1716838235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559705c40680 con 0x559706af1c00 2024-04-24T23:05:17.250 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.245+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559705c4e960 con 0x559706af1c00 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.247+0000 7fc752a00640 1 -- 172.21.15.146:0/1716838235 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x559706b58c00 con 0x559706af1c00 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.248+0000 7fc752a00640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 0x559705c89700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.248+0000 7fc752a00640 1 -- 172.21.15.146:0/1716838235 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x559706b56a00 con 0x559706af1c00 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.248+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x559706af1800 0x559705c88c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.248+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x559706af1400 con 0x559706af1800 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.249+0000 7fc75a200640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 0x559705c89700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.251 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.249+0000 7fc759800640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x559706af1800 0x559705c88c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.252 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.250+0000 7fc759800640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x559706af1800 0x559705c88c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.252 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.250+0000 7fc75a200640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 0x559705c89700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x559705cfa060 tx=0x5597069abe60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.252 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.250+0000 7fc759800640 1 -- 172.21.15.146:0/1716838235 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55970699a000 con 0x559706af1800 2024-04-24T23:05:17.252 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.251+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559706af1000 0x559705c89180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.253 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.251+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x559706a04000 con 0x559706af1000 2024-04-24T23:05:17.253 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.251+0000 7fc75ac00640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559706af1000 0x559705c89180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.254 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.252+0000 7fc75ac00640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559706af1000 0x559705c89180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.255 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.253+0000 7fc75ac00640 1 -- 172.21.15.146:0/1716838235 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55970699a500 con 0x559706af1000 2024-04-24T23:05:17.255 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.253+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x559706a04400 con 0x559706af1000 2024-04-24T23:05:17.256 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.254+0000 7fc75ac00640 1 -- 172.21.15.146:0/1716838235 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55970699a500 con 0x559706af1000 2024-04-24T23:05:17.256 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.255+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x559706a04800 0x559705fb0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.256 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.255+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x559706a04c00 con 0x559706a04800 2024-04-24T23:05:17.257 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.255+0000 7fc75a200640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x559706a04800 0x559705fb0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.258 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.256+0000 7fc75a200640 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x559706a04800 0x559705fb0000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.259 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.257+0000 7fc75a200640 1 -- 172.21.15.146:0/1716838235 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559705fa6f00 con 0x559706a04800 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:Wrote output to JSON file '/tmp/json.tmp' 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x559706a04800 msgr2=0x559705fb0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x559706a04800 0x559705fb0000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559706af1000 msgr2=0x559705c89180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559706af1000 0x559705c89180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x559706af1800 msgr2=0x559705c88c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x559706af1800 0x559705c88c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75a200640 1 -- 172.21.15.146:0/1716838235 reap_dead start 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 msgr2=0x559705c89700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 0x559705c89700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x559705cfa060 tx=0x5597069abe60 comp rx=0 tx=0).stop 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 msgr2=0x559705c88680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.264 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x559706afb5c0 tx=0x5597069aa780 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 shutdown_connections 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559706af1c00 0x559705c88680 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 --2- 172.21.15.146:0/1716838235 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559706b55000 0x559705c89700 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 >> 172.21.15.146:0/1716838235 conn(0x5597069a8800 msgr2=0x559705d25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 shutdown_connections 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.261+0000 7fc75ce15280 1 -- 172.21.15.146:0/1716838235 wait complete. 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 msgr2=0x559705c87600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559706a314a0 tx=0x5597069aa7e0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 shutdown_connections 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597069a9400 0x559705c87600 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559705c1bc00 0x559705c87080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 --2- 172.21.15.146:0/4124056778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559705c1b800 0x559705c86b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 >> 172.21.15.146:0/4124056778 conn(0x559705c1b000 msgr2=0x559705d24800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.265 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 shutdown_connections 2024-04-24T23:05:17.266 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.262+0000 7fc75ce15280 1 -- 172.21.15.146:0/4124056778 wait complete. 2024-04-24T23:05:17.268 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' '!' -s /tmp/json.tmp ']' 2024-04-24T23:05:17.269 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get binary --path /tmp/binary.tmp 2024-04-24T23:05:17.316 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.314+0000 7f785eef7280 1 -- start start 2024-04-24T23:05:17.316 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.314+0000 7f785eef7280 1 Processor -- start 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5044c00 0x55fdb50b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5045800 0x55fdb50b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2180 con 0x55fdb5045c00 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2300 con 0x55fdb5044c00 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2480 con 0x55fdb5045800 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.317 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35228/0 (socket says 172.21.15.146:35228) 2024-04-24T23:05:17.318 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.315+0000 7f785da00640 1 -- 172.21.15.146:0/2405453239 learned_addr learned my addr 172.21.15.146:0/2405453239 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.319 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 -- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5045800 msgr2=0x55fdb50b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.319 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5045800 0x55fdb50b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.319 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 -- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5044c00 msgr2=0x55fdb50b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.319 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5044c00 0x55fdb50b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 -- 172.21.15.146:0/2405453239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb5078780 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785da00640 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55fdb5e61440 tx=0x55fdb5dd5ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78b389dac3ab5ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f7859e00640 1 -- 172.21.15.146:0/2405453239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506a680 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f7859e00640 1 -- 172.21.15.146:0/2405453239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fdb5070fc0 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f7859e00640 1 -- 172.21.15.146:0/2405453239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506ab60 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb50794a0 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.316+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55fdb5078000 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.317+0000 7f7859e00640 1 -- 172.21.15.146:0/2405453239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55fdb5f06600 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.317+0000 7f7859e00640 1 -- 172.21.15.146:0/2405453239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55fdb509f180 con 0x55fdb5045c00 2024-04-24T23:05:17.320 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.318+0000 7f785eef7280 1 Processor -- start 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.318+0000 7f785eef7280 1 -- start start 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03800 0x55fdb50b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03c00 0x55fdb50b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2600 con 0x55fdb5f03400 2024-04-24T23:05:17.323 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2780 con 0x55fdb5f03800 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2900 con 0x55fdb5f03c00 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35230/0 (socket says 172.21.15.146:35230) 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 -- 172.21.15.146:0/2937806427 learned_addr learned my addr 172.21.15.146:0/2937806427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 -- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03c00 msgr2=0x55fdb50b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03c00 0x55fdb50b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 -- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03800 msgr2=0x55fdb50b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785d000640 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03800 0x55fdb50b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03800 0x55fdb50b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.319+0000 7f785c600640 1 -- 172.21.15.146:0/2937806427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb50783c0 con 0x55fdb5f03400 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785c600640 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55fdb5f22840 tx=0x55fdb5f24d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348b6b9c085ea84a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f7857600640 1 -- 172.21.15.146:0/2937806427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506a9c0 con 0x55fdb5f03400 2024-04-24T23:05:17.324 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f7857600640 1 -- 172.21.15.146:0/2937806427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fdb5070e00 con 0x55fdb5f03400 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f7857600640 1 -- 172.21.15.146:0/2937806427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506a680 con 0x55fdb5f03400 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 -- 172.21.15.146:0/2937806427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 msgr2=0x55fdb50b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55fdb5f22840 tx=0x55fdb5f24d20 comp rx=0 tx=0).stop 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 -- 172.21.15.146:0/2937806427 shutdown_connections 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03c00 0x55fdb50b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03800 0x55fdb50b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 --2- 172.21.15.146:0/2937806427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03400 0x55fdb50b1600 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 -- 172.21.15.146:0/2937806427 >> 172.21.15.146:0/2937806427 conn(0x55fdb5f03000 msgr2=0x55fdb514f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 -- 172.21.15.146:0/2937806427 shutdown_connections 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.320+0000 7f785eef7280 1 -- 172.21.15.146:0/2937806427 wait complete. 2024-04-24T23:05:17.325 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.321+0000 7f785eef7280 1 Processor -- start 2024-04-24T23:05:17.326 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.321+0000 7f785eef7280 1 -- start start 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03400 0x55fdb50b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03800 0x55fdb50b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fdb50a6180 con 0x55fdb5f03c00 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fdb5dd3e00 con 0x55fdb5f03400 2024-04-24T23:05:17.328 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785eef7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fdb5dd2d80 con 0x55fdb5f03800 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35238/0 (socket says 172.21.15.146:35238) 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.322+0000 7f785c600640 1 -- 172.21.15.146:0/1187898620 learned_addr learned my addr 172.21.15.146:0/1187898620 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03800 0x55fdb50b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03800 msgr2=0x55fdb50b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03800 0x55fdb50b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03400 msgr2=0x55fdb50b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5f03400 0x55fdb50b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb5078780 con 0x55fdb5f03c00 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5f03800 0x55fdb50b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785c600640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55fdb5f22b70 tx=0x55fdb5f24c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f7855800640 1 -- 172.21.15.146:0/1187898620 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506ab60 con 0x55fdb5f03c00 2024-04-24T23:05:17.329 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f7855800640 1 -- 172.21.15.146:0/1187898620 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fdb5070c40 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f7855800640 1 -- 172.21.15.146:0/1187898620 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55fdb506a4e0 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdb50794a0 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.323+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb5078960 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.325+0000 7f7855800640 1 -- 172.21.15.146:0/1187898620 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55fdb5e14c00 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.325+0000 7f7855800640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 0x55fdb50b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.326+0000 7f7855800640 1 -- 172.21.15.146:0/1187898620 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55fdb5f80600 con 0x55fdb5f03c00 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.326+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fdb5e32800 0x55fdb50b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.326+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fdb5e32c00 con 0x55fdb5e32800 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.326+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 0x55fdb50b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.330 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.326+0000 7f785c600640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fdb5e32800 0x55fdb50b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.331 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.327+0000 7f785c600640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fdb5e32800 0x55fdb50b2100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.331 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.327+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 0x55fdb50b3700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55fdb5e61350 tx=0x55fdb53a60c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.331 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.328+0000 7f785c600640 1 -- 172.21.15.146:0/1187898620 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55fdb5dc4000 con 0x55fdb5e32800 2024-04-24T23:05:17.331 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.328+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fdb5e33000 0x55fdb50b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.331 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.328+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fdb5e33400 con 0x55fdb5e33000 2024-04-24T23:05:17.332 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.329+0000 7f785da00640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fdb5e33000 0x55fdb50b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.332 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.330+0000 7f785da00640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fdb5e33000 0x55fdb50b1b80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.333 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.331+0000 7f785da00640 1 -- 172.21.15.146:0/1187898620 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55fdb5dc4500 con 0x55fdb5e33000 2024-04-24T23:05:17.333 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.331+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fdb5e33800 con 0x55fdb5e33000 2024-04-24T23:05:17.334 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.332+0000 7f785da00640 1 -- 172.21.15.146:0/1187898620 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x55fdb5dc4500 con 0x55fdb5e33000 2024-04-24T23:05:17.334 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.332+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdb53ac800 0x55fdb50b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.334 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.332+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x55fdb53acc00 con 0x55fdb53ac800 2024-04-24T23:05:17.334 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.333+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdb53ac800 0x55fdb50b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.335 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.334+0000 7f785d000640 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdb53ac800 0x55fdb50b1600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.336 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.334+0000 7f785d000640 1 -- 172.21.15.146:0/1187898620 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55fdb53c4f00 con 0x55fdb53ac800 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:Wrote output to binary files in directory '/tmp/binary.tmp' 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdb53ac800 msgr2=0x55fdb50b1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdb53ac800 0x55fdb50b1600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fdb5e33000 msgr2=0x55fdb50b1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55fdb5e33000 0x55fdb50b1b80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fdb5e32800 msgr2=0x55fdb50b2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55fdb5e32800 0x55fdb50b2100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.340 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785d000640 1 -- 172.21.15.146:0/1187898620 reap_dead start 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 msgr2=0x55fdb50b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 0x55fdb50b3700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55fdb5e61350 tx=0x55fdb53a60c0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 msgr2=0x55fdb50b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55fdb5f22b70 tx=0x55fdb5f24c00 comp rx=0 tx=0).stop 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 shutdown_connections 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5f03c00 0x55fdb50b2680 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.336+0000 7f785eef7280 1 --2- 172.21.15.146:0/1187898620 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55fdb5e32400 0x55fdb50b3700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 >> 172.21.15.146:0/1187898620 conn(0x55fdb5f03000 msgr2=0x55fdb514f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 shutdown_connections 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/1187898620 wait complete. 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 msgr2=0x55fdb50b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55fdb5e61440 tx=0x55fdb5dd5ec0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 shutdown_connections 2024-04-24T23:05:17.341 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdb5045c00 0x55fdb50b1080 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.342 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdb5045800 0x55fdb50b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.342 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 --2- 172.21.15.146:0/2405453239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdb5044c00 0x55fdb50b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.342 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 >> 172.21.15.146:0/2405453239 conn(0x55fdb5045000 msgr2=0x55fdb514e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.342 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 shutdown_connections 2024-04-24T23:05:17.342 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.337+0000 7f785eef7280 1 -- 172.21.15.146:0/2405453239 wait complete. 2024-04-24T23:05:17.344 INFO:tasks.workunit.client.0.smithi146.stderr:+ '[' '!' -s /tmp/binary.tmp ']' 2024-04-24T23:05:17.344 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event recover_dentries summary 2024-04-24T23:05:17.390 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.388+0000 7fb07b920280 1 -- start start 2024-04-24T23:05:17.391 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.388+0000 7fb07b920280 1 Processor -- start 2024-04-24T23:05:17.392 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 0x562219047b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 0x562219047600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562219db4000 con 0x562218fdbc00 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562219db4180 con 0x562219d68800 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.389+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562219db4300 con 0x562219d69c00 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35256/0 (socket says 172.21.15.146:35256) 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 -- 172.21.15.146:0/3195290979 learned_addr learned my addr 172.21.15.146:0/3195290979 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb079a00640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 0x562219047600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 -- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 msgr2=0x562219047600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 0x562219047600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb079000640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 0x562219047b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.393 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 -- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 msgr2=0x562219047b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 0x562219047b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 -- 172.21.15.146:0/3195290979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221900e780 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb079a00640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 0x562219047600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb079000640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 0x562219047b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.390+0000 7fb078600640 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x562219df73e0 tx=0x562219d6a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3f938b86e2d291 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb075e00640 1 -- 172.21.15.146:0/3195290979 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562219000d00 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb075e00640 1 -- 172.21.15.146:0/3195290979 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562219006700 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb075e00640 1 -- 172.21.15.146:0/3195290979 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622190009c0 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221900e000 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56221900f680 con 0x562218fdbc00 2024-04-24T23:05:17.394 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb075e00640 1 -- 172.21.15.146:0/3195290979 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x562219e94600 con 0x562218fdbc00 2024-04-24T23:05:17.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.391+0000 7fb075e00640 1 -- 172.21.15.146:0/3195290979 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x562219035180 con 0x562218fdbc00 2024-04-24T23:05:17.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.392+0000 7fb07b920280 1 Processor -- start 2024-04-24T23:05:17.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.392+0000 7fb07b920280 1 -- start start 2024-04-24T23:05:17.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d68000 0x562219047080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.396 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1800 0x562219048100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562219db4480 con 0x562219ea1c00 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562219db4600 con 0x562219ea1800 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562219db4780 con 0x562219d68000 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb078600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb078600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35266/0 (socket says 172.21.15.146:35266) 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.393+0000 7fb078600640 1 -- 172.21.15.146:0/917753309 learned_addr learned my addr 172.21.15.146:0/917753309 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb079a00640 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d68000 0x562219047080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb079000640 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1800 0x562219048100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 -- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d68000 msgr2=0x562219047080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d68000 0x562219047080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 -- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1800 msgr2=0x562219048100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1800 0x562219048100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 -- 172.21.15.146:0/917753309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221900f860 con 0x562219ea1c00 2024-04-24T23:05:17.397 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb078600640 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x562219eae6c0 tx=0x562219d6a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4addfa913bfc48 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb073600640 1 -- 172.21.15.146:0/917753309 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5622190004e0 con 0x562219ea1c00 2024-04-24T23:05:17.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb073600640 1 -- 172.21.15.146:0/917753309 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562219006c40 con 0x562219ea1c00 2024-04-24T23:05:17.398 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.394+0000 7fb073600640 1 -- 172.21.15.146:0/917753309 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562219000d00 con 0x562219ea1c00 2024-04-24T23:05:17.400 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 -- 172.21.15.146:0/917753309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 msgr2=0x562219048680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.400 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x562219eae6c0 tx=0x562219d6a900 comp rx=0 tx=0).stop 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 -- 172.21.15.146:0/917753309 shutdown_connections 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219ea1c00 0x562219048680 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1800 0x562219048100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 --2- 172.21.15.146:0/917753309 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d68000 0x562219047080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 -- 172.21.15.146:0/917753309 >> 172.21.15.146:0/917753309 conn(0x562219d68400 msgr2=0x5622190e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 -- 172.21.15.146:0/917753309 shutdown_connections 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.395+0000 7fb07b920280 1 -- 172.21.15.146:0/917753309 wait complete. 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.396+0000 7fb07b920280 1 Processor -- start 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.396+0000 7fb07b920280 1 -- start start 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.396+0000 7fb07b920280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219ea1800 0x562219049180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb07b920280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1c00 0x562219048c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb07b920280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562219db4a80 con 0x562219d68000 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562219db4900 con 0x562219ea1c00 2024-04-24T23:05:17.401 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb07b920280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x562219db5c80 con 0x562219ea1800 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35270/0 (socket says 172.21.15.146:35270) 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 learned_addr learned my addr 172.21.15.146:0/400397621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219ea1800 0x562219049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb078600640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1c00 0x562219048c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219ea1800 msgr2=0x562219049180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219ea1800 0x562219049180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1c00 msgr2=0x562219048c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219ea1c00 0x562219048c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221900e780 con 0x562219d68000 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.397+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219ea1800 0x562219049180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x562219022f00 tx=0x562219d6bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.402 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb071800640 1 -- 172.21.15.146:0/400397621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562219000b60 con 0x562219d68000 2024-04-24T23:05:17.403 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb071800640 1 -- 172.21.15.146:0/400397621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562219006e00 con 0x562219d68000 2024-04-24T23:05:17.403 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb071800640 1 -- 172.21.15.146:0/400397621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562219000820 con 0x562219d68000 2024-04-24T23:05:17.403 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56221900e000 con 0x562219d68000 2024-04-24T23:05:17.403 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.398+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221900fa40 con 0x562219d68000 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.400+0000 7fb071800640 1 -- 172.21.15.146:0/400397621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562219f0cc00 con 0x562219d68000 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.400+0000 7fb071800640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 0x56221934c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.400+0000 7fb071800640 1 -- 172.21.15.146:0/400397621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x562219f14600 con 0x562219d68000 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.400+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562219f1c800 0x562219048680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.400+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219f1c800 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.401+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 0x56221934c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.401+0000 7fb078600640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562219f1c800 0x562219048680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.404 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.402+0000 7fb078600640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562219f1c800 0x562219048680 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.405 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.402+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 0x56221934c000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5622190bab10 tx=0x5622192d8fc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.405 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.403+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.405 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.403+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562219f1d000 0x562219048100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.405 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.403+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219f1d000 2024-04-24T23:05:17.406 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.404+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562219f1d000 0x562219048100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.406 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.404+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562219f1d000 0x562219048100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.407 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.405+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.407 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.405+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d800 con 0x562219f1d000 2024-04-24T23:05:17.408 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.406+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.408 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.406+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x562219f1dc00 0x562219047080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.408 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.406+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219f1dc00 2024-04-24T23:05:17.409 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.407+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x562219f1dc00 0x562219047080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.410 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.408+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x562219f1dc00 0x562219047080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.411 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.409+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56221936ef00 con 0x562219f1dc00 2024-04-24T23:05:17.411 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.409+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x562219357000 0x56221934c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.411 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.409+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:5 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219357000 2024-04-24T23:05:17.411 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.409+0000 7fb078600640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x562219357000 0x56221934c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.411 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.410+0000 7fb078600640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x562219357000 0x56221934c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.412 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.410+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.412 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.410+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:6 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219357000 2024-04-24T23:05:17.412 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.410+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.413 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.411+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357c00 con 0x562219f1c800 2024-04-24T23:05:17.413 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.411+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.413 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.411+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:8 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219f1c800 2024-04-24T23:05:17.414 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.412+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.414 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.412+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:9 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1d000 2024-04-24T23:05:17.415 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.414+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.415 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.414+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:10 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219f1d000 2024-04-24T23:05:17.420 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.418+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v57'33 uv33 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.420 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.418+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:11 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219357000 2024-04-24T23:05:17.420 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.418+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.420 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.418+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:12 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219357000 2024-04-24T23:05:17.423 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.421+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v57'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.423 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.421+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:13 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c000 con 0x562219357000 2024-04-24T23:05:17.423 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.422+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.423 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.422+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937c400 con 0x562219357000 2024-04-24T23:05:17.426 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.425+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 6 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v57'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.427 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.425+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:15 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c800 con 0x562219f1c800 2024-04-24T23:05:17.428 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.426+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 4 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.428 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.426+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:16 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.432 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.430+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 5 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v57'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.432 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.430+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.433 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.431+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 6 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.433 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.431+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:18 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1d000 2024-04-24T23:05:17.434 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.432+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv33 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.434 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.432+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x562219f1d000 2024-04-24T23:05:17.438 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.437+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v57'34 uv34 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.439 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.437+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:20 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937dc00 con 0x562219357000 2024-04-24T23:05:17.439 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.437+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 7 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.439 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.437+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:21 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219357000 2024-04-24T23:05:17.442 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.440+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 8 ==== osd_op_reply(21 1.00000000 [omap-set-header] v57'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.442 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.441+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:22 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x562219357000 2024-04-24T23:05:17.443 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.441+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 9 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv8 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.443 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.441+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:23 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219357000 2024-04-24T23:05:17.446 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.444+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 10 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v57'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.446 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.444+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:24 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1d000 2024-04-24T23:05:17.447 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.445+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv34 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.447 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.446+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:25 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1d000 2024-04-24T23:05:17.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.450+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v57'35 uv35 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.450+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:26 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357c00 con 0x562219357000 2024-04-24T23:05:17.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.451+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 11 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.452 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.451+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:27 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219357000 2024-04-24T23:05:17.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.454+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 12 ==== osd_op_reply(27 1.00000000 [omap-set-header] v57'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.456 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.454+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:28 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219357000 2024-04-24T23:05:17.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.455+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 13 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv10 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.457 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.455+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:29 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d800 con 0x562219357000 2024-04-24T23:05:17.460 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.459+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 14 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v57'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.461 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.459+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:30 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219f1c800 2024-04-24T23:05:17.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.460+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 7 ==== osd_op_reply(30 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.462 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.460+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:31 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.466 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.464+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 8 ==== osd_op_reply(31 10000000000.00000000 [omap-set-header] v57'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.466 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.464+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:32 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c000 con 0x562219f1c800 2024-04-24T23:05:17.467 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.465+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 9 ==== osd_op_reply(32 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.467 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.465+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:33 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937c400 con 0x562219f1c800 2024-04-24T23:05:17.472 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.470+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 10 ==== osd_op_reply(33 10000000000.00000000 [omap-set-vals] v57'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.472 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.470+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x56221937c800 0x56221934cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.472 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.470+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:34 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x56221937c800 2024-04-24T23:05:17.472 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.471+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x56221937c800 0x56221934cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.472+0000 7fb079a00640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x56221937c800 0x56221934cb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.473+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(34 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.474 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.473+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:35 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x56221937c800 2024-04-24T23:05:17.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.476+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(35 10000000001.00000000 [omap-set-header] v57'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.478 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.477+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:36 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x56221937c800 2024-04-24T23:05:17.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.477+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(36 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.479 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.478+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:37 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x562219f1d000 2024-04-24T23:05:17.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.479+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 9 ==== osd_op_reply(37 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.480 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.479+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:38 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937dc00 con 0x562219f1d000 2024-04-24T23:05:17.485 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.483+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 10 ==== osd_op_reply(38 1.00000000.inode [writefull 0~582] v57'36 uv36 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.485 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.483+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:39 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.486 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.485+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 11 ==== osd_op_reply(39 10000000000.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.486 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.485+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:40 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.490 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.488+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 12 ==== osd_op_reply(40 10000000000.00000000 [omap-set-header] v57'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.490 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.488+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:41 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.491 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.489+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 13 ==== osd_op_reply(41 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv13 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.491 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.489+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:42 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x562219f1c800 2024-04-24T23:05:17.495 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.493+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 14 ==== osd_op_reply(42 10000000000.00000000 [omap-set-vals] v57'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.495 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.493+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:43 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937dc00 con 0x56221937c800 2024-04-24T23:05:17.496 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.494+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 4 ==== osd_op_reply(43 10000000001.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.496 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.494+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:44 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x56221937c800 2024-04-24T23:05:17.500 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.499+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 5 ==== osd_op_reply(44 10000000001.00000000 [omap-set-header] v57'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.501 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.499+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:45 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x56221937c800 2024-04-24T23:05:17.501 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.500+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 6 ==== osd_op_reply(45 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.502 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.500+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:46 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x56221937c800 2024-04-24T23:05:17.505 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.503+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 7 ==== osd_op_reply(46 10000000001.00000000 [omap-set-vals] v57'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.505 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.503+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562219f1d800 0x56221934d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.505 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.503+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:47 7.12 7:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219f1d800 2024-04-24T23:05:17.506 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.504+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562219f1d800 0x56221934d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.507 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.505+0000 7fb079000640 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562219f1d800 0x56221934d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.508 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.506+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(47 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x56221936ef00 con 0x562219f1d800 2024-04-24T23:05:17.508 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.506+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:48 7.12 7:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1d800 2024-04-24T23:05:17.512 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.510+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(48 10000000002.00000000 [omap-set-header] v57'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x56221936ef00 con 0x562219f1d800 2024-04-24T23:05:17.512 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.510+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:49 7.12 7:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357c00 con 0x562219f1d800 2024-04-24T23:05:17.512 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.511+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(49 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x56221936ef00 con 0x562219f1d800 2024-04-24T23:05:17.513 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.511+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:50 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219f1c800 2024-04-24T23:05:17.514 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.512+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 15 ==== osd_op_reply(50 10000000000.00000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.514 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.512+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:51 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937c000 con 0x562219f1c800 2024-04-24T23:05:17.518 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.516+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 16 ==== osd_op_reply(51 10000000000.00000000 [omap-set-header] v57'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.518 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.517+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:52 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c400 con 0x562219f1c800 2024-04-24T23:05:17.519 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.518+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 17 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv15 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.520 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.518+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:53 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219356800 con 0x562219f1c800 2024-04-24T23:05:17.524 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.522+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 18 ==== osd_op_reply(53 10000000000.00000000 [omap-set-vals] v57'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.524 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.522+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:54 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x56221937c800 2024-04-24T23:05:17.525 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.523+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 8 ==== osd_op_reply(54 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.525 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.523+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:55 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x56221937c800 2024-04-24T23:05:17.529 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.527+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 9 ==== osd_op_reply(55 10000000001.00000000 [omap-set-header] v57'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.529 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.527+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:56 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x56221937c800 2024-04-24T23:05:17.530 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.528+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 10 ==== osd_op_reply(56 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.530 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.528+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:57 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-vals in=603b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939e000 con 0x56221937c800 2024-04-24T23:05:17.534 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.532+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 11 ==== osd_op_reply(57 10000000001.00000000 [omap-set-vals] v57'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.535 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.533+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:58 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939e400 con 0x562219f1c800 2024-04-24T23:05:17.536 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.534+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 19 ==== osd_op_reply(58 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.536 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.534+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:59 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939e800 con 0x562219f1c800 2024-04-24T23:05:17.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.538+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 20 ==== osd_op_reply(59 10000000000.00000000 [omap-set-header] v57'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.539 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.538+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:60 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939ec00 con 0x562219f1c800 2024-04-24T23:05:17.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.539+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 21 ==== osd_op_reply(60 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv17 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.541 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.539+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:61 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939f000 con 0x562219f1c800 2024-04-24T23:05:17.545 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.544+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 22 ==== osd_op_reply(61 10000000000.00000000 [omap-set-vals] v57'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.545 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.544+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:62 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939f400 con 0x56221937c800 2024-04-24T23:05:17.546 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.545+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 12 ==== osd_op_reply(62 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.546 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.545+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:63 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939f800 con 0x56221937c800 2024-04-24T23:05:17.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.548+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 13 ==== osd_op_reply(63 10000000001.00000000 [omap-set-header] v57'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.550 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.548+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:64 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939fc00 con 0x56221937c800 2024-04-24T23:05:17.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.549+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 14 ==== osd_op_reply(64 10000000001.00000000 [omap-get-vals-by-keys out=603b] v0'0 uv9 ondisk = 0) ==== 164+0+603 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.551 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.550+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:65 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-vals in=611b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939e400 con 0x56221937c800 2024-04-24T23:05:17.556 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.554+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 15 ==== osd_op_reply(65 10000000001.00000000 [omap-set-vals] v57'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.556 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.554+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:66 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219357000 2024-04-24T23:05:17.557 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.555+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 15 ==== osd_op_reply(66 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.557 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.555+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:67 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219357000 2024-04-24T23:05:17.561 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.559+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 16 ==== osd_op_reply(67 1.00000000 [omap-set-header] v57'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.561 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.559+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:68 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219357000 2024-04-24T23:05:17.561 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.560+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 17 ==== osd_op_reply(68 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv12 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.562 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.560+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:69 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219356800 con 0x562219357000 2024-04-24T23:05:17.565 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.563+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 18 ==== osd_op_reply(69 1.00000000 [omap-set-vals] v57'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.565 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.564+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:70 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219f1c800 2024-04-24T23:05:17.567 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.565+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 23 ==== osd_op_reply(70 10000000000.00000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.567 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.565+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:71 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1c800 2024-04-24T23:05:17.571 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.569+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 24 ==== osd_op_reply(71 10000000000.00000000 [omap-set-header] v57'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.571 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.569+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:72 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1c800 2024-04-24T23:05:17.572 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.571+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 25 ==== osd_op_reply(72 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv19 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.572 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.571+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:73 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.576 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.575+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 26 ==== osd_op_reply(73 10000000000.00000000 [omap-set-vals] v57'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.576 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.575+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:74 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.578 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.576+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 27 ==== osd_op_reply(74 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.578 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.576+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:75 7.13 7:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.582 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.580+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 28 ==== osd_op_reply(75 100.00000000 [omap-set-header] v57'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.582 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.580+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:76 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.583 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.581+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 29 ==== osd_op_reply(76 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.583 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.581+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:77 7.13 7:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x562219f1c800 2024-04-24T23:05:17.590 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.587+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 30 ==== osd_op_reply(77 100.00000000 [omap-set-vals] v57'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.590 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.587+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:78 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c000 con 0x562219f1c800 2024-04-24T23:05:17.590 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.588+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 31 ==== osd_op_reply(78 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.591 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.589+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:79 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937c400 con 0x562219f1c800 2024-04-24T23:05:17.594 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.593+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 32 ==== osd_op_reply(79 602.00000000 [omap-set-header] v57'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.595 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.593+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:80 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937dc00 con 0x562219f1c800 2024-04-24T23:05:17.596 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.594+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 33 ==== osd_op_reply(80 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.596 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.594+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:81 7.10 7:0bd6d154:::602.00000000:head [omap-set-vals in=590b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939e800 con 0x562219f1c800 2024-04-24T23:05:17.600 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.598+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 34 ==== osd_op_reply(81 602.00000000 [omap-set-vals] v57'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.600 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.598+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:82 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939ec00 con 0x56221937c800 2024-04-24T23:05:17.601 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.599+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 16 ==== osd_op_reply(82 10000000001.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.601 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.599+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:83 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221939f000 con 0x56221937c800 2024-04-24T23:05:17.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.603+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 17 ==== osd_op_reply(83 10000000001.00000000 [omap-set-header] v57'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.605 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.603+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:84 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221939e000 con 0x56221937c800 2024-04-24T23:05:17.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.604+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 18 ==== osd_op_reply(84 10000000001.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv11 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.606 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.604+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:85 7.7 7:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x56221937c800 2024-04-24T23:05:17.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.608+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 19 ==== osd_op_reply(85 10000000001.00000000 [omap-rm-keys] v57'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.610 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.608+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:86 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219f1d000 2024-04-24T23:05:17.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.609+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 11 ==== osd_op_reply(86 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.611 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.610+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:87 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219356800 con 0x562219f1d000 2024-04-24T23:05:17.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.614+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 12 ==== osd_op_reply(87 1.00000000.inode [writefull 0~582] v57'37 uv37 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.616 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.614+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:88 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219f1c800 2024-04-24T23:05:17.617 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.615+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 35 ==== osd_op_reply(88 10000000000.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.617 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.615+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:89 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1c800 2024-04-24T23:05:17.622 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.620+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 36 ==== osd_op_reply(89 10000000000.00000000 [omap-set-header] v57'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.622 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.620+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:90 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219f1c800 2024-04-24T23:05:17.623 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.621+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 37 ==== osd_op_reply(90 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv23 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.623 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.621+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:91 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219f1c800 2024-04-24T23:05:17.627 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.625+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 38 ==== osd_op_reply(91 10000000000.00000000 [omap-set-vals] v57'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.627 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.625+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:92 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219f1c800 2024-04-24T23:05:17.628 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.627+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 39 ==== osd_op_reply(92 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.629 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.627+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:93 7.13 7:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1c800 2024-04-24T23:05:17.633 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.631+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 40 ==== osd_op_reply(93 100.00000000 [omap-set-header] v57'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.633 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.631+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:94 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219f1c800 2024-04-24T23:05:17.634 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.632+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 41 ==== osd_op_reply(94 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv5 ondisk = 0) ==== 156+0+507 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.634 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.632+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:95 7.13 7:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.638 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.636+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 42 ==== osd_op_reply(95 100.00000000 [omap-set-vals] v57'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.638 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.636+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:96 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1c800 2024-04-24T23:05:17.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.637+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 43 ==== osd_op_reply(96 602.00000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.639 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.637+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:97 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.641+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 44 ==== osd_op_reply(97 602.00000000 [omap-set-header] v57'25 uv25 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.641+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:98 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.642+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 45 ==== osd_op_reply(98 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.642+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:99 7.10 7:0bd6d154:::602.00000000:head [omap-set-vals in=636b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.648 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.646+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 46 ==== osd_op_reply(99 602.00000000 [omap-set-vals] v57'26 uv26 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.648 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.646+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:100 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d800 con 0x56221937c800 2024-04-24T23:05:17.649 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.647+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 20 ==== osd_op_reply(100 10000000001.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.649 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.648+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:101 7.7 7:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937c000 con 0x56221937c800 2024-04-24T23:05:17.653 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.651+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 21 ==== osd_op_reply(101 10000000001.00000000 [omap-set-header] v57'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.653 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.651+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:102 7.7 7:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937c400 con 0x56221937c800 2024-04-24T23:05:17.654 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.653+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 22 ==== osd_op_reply(102 10000000001.00000000 [omap-get-vals-by-keys out=611b] v0'0 uv13 ondisk = 0) ==== 164+0+611 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.655 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.653+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:103 7.7 7:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937dc00 con 0x56221937c800 2024-04-24T23:05:17.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.656+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.3 v2:172.21.15.146:6808/1724749641 23 ==== osd_op_reply(103 10000000001.00000000 [omap-rm-keys] v57'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a500 con 0x56221937c800 2024-04-24T23:05:17.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.657+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:104 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc000 con 0x562219357000 2024-04-24T23:05:17.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.658+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 19 ==== osd_op_reply(104 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.658+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:105 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc400 con 0x562219357000 2024-04-24T23:05:17.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.662+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 20 ==== osd_op_reply(105 1.00000000 [omap-set-header] v57'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.663+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:106 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc800 con 0x562219357000 2024-04-24T23:05:17.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.664+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 21 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv14 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.666 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.664+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:107 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bcc00 con 0x562219357000 2024-04-24T23:05:17.669 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.668+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 22 ==== osd_op_reply(107 1.00000000 [omap-set-vals] v57'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.670 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.668+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:108 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd000 con 0x562219f1c800 2024-04-24T23:05:17.671 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.669+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 47 ==== osd_op_reply(108 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.671 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.669+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:109 7.13 7:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd400 con 0x562219f1c800 2024-04-24T23:05:17.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.673+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 48 ==== osd_op_reply(109 100.00000000 [omap-set-header] v57'7 uv7 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.675 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.674+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:110 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd800 con 0x562219f1c800 2024-04-24T23:05:17.676 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.674+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 49 ==== osd_op_reply(110 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv7 ondisk = 0) ==== 156+0+507 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.677 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.675+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:111 7.13 7:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bdc00 con 0x562219f1c800 2024-04-24T23:05:17.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.679+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 50 ==== osd_op_reply(111 100.00000000 [omap-set-vals] v57'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.679+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:112 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc000 con 0x562219f1c800 2024-04-24T23:05:17.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.680+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 51 ==== osd_op_reply(112 602.00000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.680+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:113 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc400 con 0x562219f1c800 2024-04-24T23:05:17.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.684+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 52 ==== osd_op_reply(113 602.00000000 [omap-set-header] v57'27 uv27 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.684+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:114 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.685+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 53 ==== osd_op_reply(114 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.685+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:115 7.10 7:0bd6d154:::602.00000000:head [omap-set-vals in=586b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.690+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 54 ==== osd_op_reply(115 602.00000000 [omap-set-vals] v57'28 uv28 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.690+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:116 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.692 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.691+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 55 ==== osd_op_reply(116 10000000000.00000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.692 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.691+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:117 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.694+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 56 ==== osd_op_reply(117 10000000000.00000000 [omap-set-header] v57'29 uv29 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.696 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.694+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:118 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1c800 2024-04-24T23:05:17.697 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.695+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 57 ==== osd_op_reply(118 10000000000.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv29 ondisk = 0) ==== 164+0+565 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.697 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.695+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:119 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219f1c800 2024-04-24T23:05:17.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.699+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 58 ==== osd_op_reply(119 10000000000.00000000 [omap-rm-keys] v57'30 uv30 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.701 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.699+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:120 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219357000 2024-04-24T23:05:17.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.700+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 23 ==== osd_op_reply(120 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.702 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.700+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:121 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219357000 2024-04-24T23:05:17.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.704+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 24 ==== osd_op_reply(121 1.00000000 [omap-set-header] v57'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.704+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:122 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219357000 2024-04-24T23:05:17.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.705+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 25 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv16 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.705+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:123 7.1f 7:ff5b34d6:::1.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219357000 2024-04-24T23:05:17.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.710+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 26 ==== osd_op_reply(123 1.00000000 [omap-rm-keys] v57'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.710+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:124 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.711+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 59 ==== osd_op_reply(124 100.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.711+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:125 7.13 7:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1c800 2024-04-24T23:05:17.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.715+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 60 ==== osd_op_reply(125 100.00000000 [omap-set-header] v57'9 uv9 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.716+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:126 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.719 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.717+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 61 ==== osd_op_reply(126 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv9 ondisk = 0) ==== 156+0+507 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.719 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.717+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:127 7.13 7:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.724 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.722+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 62 ==== osd_op_reply(127 100.00000000 [omap-set-vals] v57'10 uv10 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.724 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.722+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:128 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.725 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.723+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 63 ==== osd_op_reply(128 602.00000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.725 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.723+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:129 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc000 con 0x562219f1c800 2024-04-24T23:05:17.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.728+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 64 ==== osd_op_reply(129 602.00000000 [omap-set-header] v57'31 uv31 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.729 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.728+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:130 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc400 con 0x562219f1c800 2024-04-24T23:05:17.730 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.728+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 65 ==== osd_op_reply(130 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.730 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.728+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:131 7.10 7:0bd6d154:::602.00000000:head [omap-set-vals in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc800 con 0x562219f1c800 2024-04-24T23:05:17.734 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.732+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 66 ==== osd_op_reply(131 602.00000000 [omap-set-vals] v57'32 uv32 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.735 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.733+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:132 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bcc00 con 0x562219f1d000 2024-04-24T23:05:17.736 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.734+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 13 ==== osd_op_reply(132 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.736 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.734+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:133 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd000 con 0x562219f1d000 2024-04-24T23:05:17.740 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.738+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 14 ==== osd_op_reply(133 1.00000000.inode [writefull 0~582] v57'38 uv38 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.740 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.738+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:134 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd400 con 0x562219f1c800 2024-04-24T23:05:17.741 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.739+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 67 ==== osd_op_reply(134 602.00000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.741 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.739+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:135 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd800 con 0x562219f1c800 2024-04-24T23:05:17.745 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.744+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 68 ==== osd_op_reply(135 602.00000000 [omap-set-header] v57'33 uv33 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.745 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.744+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:136 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bdc00 con 0x562219f1c800 2024-04-24T23:05:17.746 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.744+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 69 ==== osd_op_reply(136 602.00000000 [omap-get-vals-by-keys out=590b] v0'0 uv33 ondisk = 0) ==== 156+0+590 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.746 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.744+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:137 7.10 7:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc000 con 0x562219f1c800 2024-04-24T23:05:17.750 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.749+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 70 ==== osd_op_reply(137 602.00000000 [omap-rm-keys] v57'34 uv34 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.751 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.749+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:138 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc400 con 0x562219f1c800 2024-04-24T23:05:17.752 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.750+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 71 ==== osd_op_reply(138 602.00000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.752 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.750+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:139 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193bc800 con 0x562219f1c800 2024-04-24T23:05:17.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.755+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 72 ==== osd_op_reply(139 602.00000000 [omap-set-header] v57'35 uv35 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.756 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.755+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:140 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193bd400 con 0x562219f1c800 2024-04-24T23:05:17.757 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.756+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 73 ==== osd_op_reply(140 602.00000000 [omap-get-vals-by-keys out=636b] v0'0 uv35 ondisk = 0) ==== 156+0+636 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.758 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.756+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:141 7.10 7:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937cc00 con 0x562219f1c800 2024-04-24T23:05:17.761 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.760+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 74 ==== osd_op_reply(141 602.00000000 [omap-rm-keys] v57'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.762 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.760+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:142 7.10 7:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56221937d000 con 0x562219f1c800 2024-04-24T23:05:17.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.761+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 75 ==== osd_op_reply(142 602.00000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.763 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.761+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:143 7.10 7:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56221937d400 con 0x562219f1c800 2024-04-24T23:05:17.767 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.765+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 76 ==== osd_op_reply(143 602.00000000 [omap-set-header] v57'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.767 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.765+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:144 7.10 7:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219ea0c00 con 0x562219f1c800 2024-04-24T23:05:17.768 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.766+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 77 ==== osd_op_reply(144 602.00000000 [omap-get-vals-by-keys out=586b] v0'0 uv37 ondisk = 0) ==== 156+0+586 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.768 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.766+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:145 7.10 7:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219ea1000 con 0x562219f1c800 2024-04-24T23:05:17.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.771+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 78 ==== osd_op_reply(145 602.00000000 [omap-rm-keys] v57'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.773 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.771+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:146 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219f1d400 con 0x562219357000 2024-04-24T23:05:17.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.772+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 27 ==== osd_op_reply(146 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.774 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.772+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:147 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219f1cc00 con 0x562219357000 2024-04-24T23:05:17.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.775+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 28 ==== osd_op_reply(147 1.00000000 [omap-set-header] v57'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.777 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.775+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:148 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219356c00 con 0x562219357000 2024-04-24T23:05:17.778 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.776+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.0 v2:172.21.15.146:6811/1520723108 29 ==== osd_op_reply(148 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562219d5a000 con 0x562219357000 2024-04-24T23:05:17.778 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.776+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:149 7.14 7:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562219357800 con 0x562219f1d000 2024-04-24T23:05:17.780 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.778+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 15 ==== osd_op_reply(149 1.00000000.inode [read 0~582 out=582b] v0'0 uv38 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.780 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.778+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:150 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x562219357400 con 0x562219f1d000 2024-04-24T23:05:17.784 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.783+0000 7fb079a00640 1 -- 172.21.15.146:0/400397621 <== osd.5 v2:172.21.15.203:6800/1152275008 16 ==== osd_op_reply(150 1.00000000.inode [writefull 0~582] v57'39 uv39 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562219d5a500 con 0x562219f1d000 2024-04-24T23:05:17.785 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.783+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:151 7.13 7:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x5622193d4000 con 0x562219f1c800 2024-04-24T23:05:17.786 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.784+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 79 ==== osd_op_reply(151 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.790 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.784+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:152 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5622193d4400 con 0x562219f1c800 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb078600640 1 -- 172.21.15.146:0/400397621 <== osd.7 v2:172.21.15.203:6824/1423940067 80 ==== osd_op_reply(152 mds0_inotable [writefull 0~34] v57'11 uv11 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x562219d5a000 con 0x562219f1c800 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout:Events by type: 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: LID: 1 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: OPEN: 1 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: PURGED: 1 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: SESSION: 2 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: SUBTREEMAP: 1 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout: UPDATE: 15 2024-04-24T23:05:17.791 INFO:tasks.workunit.client.0.smithi146.stdout:Errors: 0 2024-04-24T23:05:17.792 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x562219357000 msgr2=0x56221934c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x562219357000 0x56221934c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562219f1d800 msgr2=0x56221934d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562219f1d800 0x56221934d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x56221937c800 msgr2=0x56221934cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x56221937c800 0x56221934cb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x562219f1dc00 msgr2=0x562219047080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x562219f1dc00 0x562219047080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562219f1d000 msgr2=0x562219048100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x562219f1d000 0x562219048100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562219f1c800 msgr2=0x562219048680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x562219f1c800 0x562219048680 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 reap_dead start 2024-04-24T23:05:17.793 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 reap_dead start 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb079000640 1 -- 172.21.15.146:0/400397621 reap_dead start 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 msgr2=0x56221934c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.789+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 0x56221934c000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5622190bab10 tx=0x5622192d8fc0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 msgr2=0x562219049700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x562219022f00 tx=0x562219d6bda0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 shutdown_connections 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562219f1c400 0x56221934c000 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 --2- 172.21.15.146:0/400397621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562219d68000 0x562219049700 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 >> 172.21.15.146:0/400397621 conn(0x562219d68400 msgr2=0x5622190e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 shutdown_connections 2024-04-24T23:05:17.794 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.790+0000 7fb07b920280 1 -- 172.21.15.146:0/400397621 wait complete. 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.791+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 msgr2=0x562219046b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.791+0000 7fb07b920280 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x562219df73e0 tx=0x562219d6a6c0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 shutdown_connections 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562219d69c00 0x562219047600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562218fdbc00 0x562219046b00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.795 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 --2- 172.21.15.146:0/3195290979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562219d68800 0x562219047b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.796 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 >> 172.21.15.146:0/3195290979 conn(0x562218fdb000 msgr2=0x5622190e4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:17.796 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 shutdown_connections 2024-04-24T23:05:17.796 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.792+0000 7fb07b920280 1 -- 172.21.15.146:0/3195290979 wait complete. 2024-04-24T23:05:17.807 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 event splice summary 2024-04-24T23:05:17.863 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.861+0000 7f3065822280 1 -- start start 2024-04-24T23:05:17.863 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.861+0000 7f3065822280 1 Processor -- start 2024-04-24T23:05:17.865 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.865 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 0x563351275080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.865 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563351f97400 0x563351274b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:17.865 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563351fd0480 con 0x563351f96800 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563351fd0600 con 0x563351f97c00 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.862+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563351fd0780 con 0x563351f97400 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51196/0 (socket says 172.21.15.146:51196) 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 -- 172.21.15.146:0/351237446 learned_addr learned my addr 172.21.15.146:0/351237446 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062200640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 0x563351275080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3063600640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563351f97400 0x563351274b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 -- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563351f97400 msgr2=0x563351274b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563351f97400 0x563351274b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 -- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 msgr2=0x563351275080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 0x563351275080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:17.866 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 -- 172.21.15.146:0/351237446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56335123c780 con 0x563351f96800 2024-04-24T23:05:17.867 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062200640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 0x563351275080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:17.867 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.863+0000 7f3062c00640 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x56335202b350 tx=0x563351f98720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23349ae69879618a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:17.869 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f305fa00640 1 -- 172.21.15.146:0/351237446 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122ed00 con 0x563351f96800 2024-04-24T23:05:18.642 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f305fa00640 1 -- 172.21.15.146:0/351237446 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563351234fc0 con 0x563351f96800 2024-04-24T23:05:18.642 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f305fa00640 1 -- 172.21.15.146:0/351237446 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122e680 con 0x563351f96800 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56335123c000 con 0x563351f96800 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56335123c3c0 con 0x563351f96800 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f305fa00640 1 -- 172.21.15.146:0/351237446 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x5633520ca600 con 0x563351f96800 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.864+0000 7f305fa00640 1 -- 172.21.15.146:0/351237446 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x563351263180 con 0x563351f96800 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.865+0000 7f3065822280 1 Processor -- start 2024-04-24T23:05:18.643 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.865+0000 7f3065822280 1 -- start start 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56335126a180 con 0x5633520cd800 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563351fd1680 con 0x5633520cd000 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.866+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563351fd1500 con 0x5633520cd400 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51204/0 (socket says 172.21.15.146:51204) 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 -- 172.21.15.146:0/4285813366 learned_addr learned my addr 172.21.15.146:0/4285813366 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062c00640 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 -- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 msgr2=0x563351276680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.644 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 -- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 msgr2=0x563351276100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 -- 172.21.15.146:0/4285813366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56335123d680 con 0x5633520cd800 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.867+0000 7f3062200640 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5633520e4810 tx=0x5633520e7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5689bfed836f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f305d200640 1 -- 172.21.15.146:0/4285813366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122ed00 con 0x5633520cd800 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f305d200640 1 -- 172.21.15.146:0/4285813366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563351234e00 con 0x5633520cd800 2024-04-24T23:05:18.645 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f305d200640 1 -- 172.21.15.146:0/4285813366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122e680 con 0x5633520cd800 2024-04-24T23:05:18.656 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 -- 172.21.15.146:0/4285813366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 msgr2=0x563351276c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.656 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5633520e4810 tx=0x5633520e7800 comp rx=0 tx=0).stop 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 -- 172.21.15.146:0/4285813366 shutdown_connections 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 --2- 172.21.15.146:0/4285813366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 -- 172.21.15.146:0/4285813366 >> 172.21.15.146:0/4285813366 conn(0x563351f97800 msgr2=0x563351313800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 -- 172.21.15.146:0/4285813366 shutdown_connections 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.868+0000 7f3065822280 1 -- 172.21.15.146:0/4285813366 wait complete. 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.869+0000 7f3065822280 1 Processor -- start 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.869+0000 7f3065822280 1 -- start start 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.657 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563351fd0900 con 0x5633520cd800 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563351fd0a80 con 0x5633520cd000 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3065822280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x563351fd0180 con 0x5633520cd400 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3062200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3062200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51218/0 (socket says 172.21.15.146:51218) 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.870+0000 7f3062200640 1 -- 172.21.15.146:0/2565222286 learned_addr learned my addr 172.21.15.146:0/2565222286 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 msgr2=0x563351276680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.658 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 msgr2=0x563351276100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56335123c780 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5633520cd400 0x563351276680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633520cd000 0x563351276100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3062200640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x5633520e5ad0 tx=0x5633512cc900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f305b400640 1 -- 172.21.15.146:0/2565222286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122e820 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f305b400640 1 -- 172.21.15.146:0/2565222286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563351234c40 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56335123c000 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f305b400640 1 -- 172.21.15.146:0/2565222286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56335122ed00 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.871+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56335123d860 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.873+0000 7f305b400640 1 -- 172.21.15.146:0/2565222286 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56335213ac00 con 0x5633520cd800 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.874+0000 7f305b400640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 0x563351277700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.659 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.874+0000 7f305b400640 1 -- 172.21.15.146:0/2565222286 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x563352138a00 con 0x5633520cd800 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.874+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5633520cdc00 0x563351277180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.874+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56335213d400 con 0x5633520cdc00 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.874+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 0x563351277700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.875+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5633520cdc00 0x563351277180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.875+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 0x563351277700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x563351251f50 tx=0x563351f986c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.876+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5633520cdc00 0x563351277180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.877+0000 7f3062c00640 1 -- 172.21.15.146:0/2565222286 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x563351f88000 con 0x5633520cdc00 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.877+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56335213d800 0x563351582000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.877+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56335213dc00 con 0x56335213d800 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.878+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56335213d800 0x563351582000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.878+0000 7f3063600640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56335213d800 0x563351582000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.660 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.879+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.879+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56335158e000 con 0x56335213d800 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.880+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [read 0~33090 out=33090b] v0'0 uv32 ondisk = 0) ==== 156+0+33090 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.880+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x56335158e400 0x563351582580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.880+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x56335158e800 con 0x56335158e400 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.881+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x56335158e400 0x563351582580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.882+0000 7f3062c00640 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x56335158e400 0x563351582580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.883+0000 7f3062c00640 1 -- 172.21.15.146:0/2565222286 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x563351f88000 con 0x56335158e400 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.883+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158ec00 con 0x56335213d800 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.888+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000001 [write 0~48] v57'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.661 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.888+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 7.14 7:2e2fa760:::200.00000001:head [write 48~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f000 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.892+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(6 200.00000001 [write 48~892] v57'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.892+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:7 7.14 7:2e2fa760:::200.00000001:head [write 940~258 in=258b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f400 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.896+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(7 200.00000001 [write 940~258] v57'42 uv42 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.896+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 7.14 7:2e2fa760:::200.00000001:head [write 1198~172 in=172b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f800 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.901+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(8 200.00000001 [write 1198~172] v57'43 uv43 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.901+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:9 7.14 7:2e2fa760:::200.00000001:head [write 1370~815 in=815b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158e000 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.906+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(9 200.00000001 [write 1370~815] v57'44 uv44 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.906+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:10 7.14 7:2e2fa760:::200.00000001:head [write 2185~2077 in=2077b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158ec00 con 0x56335213d800 2024-04-24T23:05:18.662 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.911+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(10 200.00000001 [write 2185~2077] v57'45 uv45 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.911+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:11 7.14 7:2e2fa760:::200.00000001:head [write 4262~1730 in=1730b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f000 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.915+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 9 ==== osd_op_reply(11 200.00000001 [write 4262~1730] v57'46 uv46 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.916+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 7.14 7:2e2fa760:::200.00000001:head [write 5992~2968 in=2968b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f400 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.921+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 10 ==== osd_op_reply(12 200.00000001 [write 5992~2968] v57'47 uv47 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.921+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:13 7.14 7:2e2fa760:::200.00000001:head [write 8960~2378 in=2378b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158fc00 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.925+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 11 ==== osd_op_reply(13 200.00000001 [write 8960~2378] v57'48 uv48 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.925+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:14 7.14 7:2e2fa760:::200.00000001:head [write 11338~2076 in=2076b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335213dc00 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.931+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 12 ==== osd_op_reply(14 200.00000001 [write 11338~2076] v57'49 uv49 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.931+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:15 7.14 7:2e2fa760:::200.00000001:head [write 13414~2089 in=2089b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x563351209800 con 0x56335213d800 2024-04-24T23:05:18.663 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.935+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 13 ==== osd_op_reply(15 200.00000001 [write 13414~2089] v57'50 uv50 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.935+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:16 7.14 7:2e2fa760:::200.00000001:head [write 15503~4794 in=4794b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335213dc00 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.941+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 14 ==== osd_op_reply(16 200.00000001 [write 15503~4794] v57'51 uv51 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.941+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:17 7.14 7:2e2fa760:::200.00000001:head [write 20297~3339 in=3339b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f800 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.945+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 15 ==== osd_op_reply(17 200.00000001 [write 20297~3339] v57'52 uv52 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.945+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:18 7.14 7:2e2fa760:::200.00000001:head [write 23636~3298 in=3298b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158e000 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.950+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 16 ==== osd_op_reply(18 200.00000001 [write 23636~3298] v57'53 uv53 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.950+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 7.14 7:2e2fa760:::200.00000001:head [write 26934~2972 in=2972b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158ec00 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.955+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 17 ==== osd_op_reply(19 200.00000001 [write 26934~2972] v57'54 uv54 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.955+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:20 7.14 7:2e2fa760:::200.00000001:head [write 29906~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f000 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.960+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 18 ==== osd_op_reply(20 200.00000001 [write 29906~599] v57'55 uv55 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.664 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.960+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 7.14 7:2e2fa760:::200.00000001:head [write 30505~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f400 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.965+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 19 ==== osd_op_reply(21 200.00000001 [write 30505~599] v57'56 uv56 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.965+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:22 7.14 7:2e2fa760:::200.00000001:head [write 31104~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158fc00 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.969+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 20 ==== osd_op_reply(22 200.00000001 [write 31104~599] v57'57 uv57 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.969+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:23 7.14 7:2e2fa760:::200.00000001:head [write 31703~1138 in=1138b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158f800 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.974+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 21 ==== osd_op_reply(23 200.00000001 [write 31703~1138] v57'58 uv58 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.974+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:24 7.14 7:2e2fa760:::200.00000001:head [write 32841~173 in=173b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158e000 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.979+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 22 ==== osd_op_reply(24 200.00000001 [write 32841~173] v57'59 uv59 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.979+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:25 7.14 7:2e2fa760:::200.00000001:head [write 33014~76 in=76b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56335158ec00 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.983+0000 7f3063600640 1 -- 172.21.15.146:0/2565222286 <== osd.5 v2:172.21.15.203:6800/1152275008 23 ==== osd_op_reply(25 200.00000001 [write 33014~76] v57'60 uv60 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x563351f88500 con 0x56335213d800 2024-04-24T23:05:18.665 INFO:tasks.workunit.client.0.smithi146.stdout:Events by type: 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: LID: 1 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: OPEN: 1 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: PURGED: 1 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: SESSION: 2 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: SUBTREEMAP: 1 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout: UPDATE: 15 2024-04-24T23:05:18.666 INFO:tasks.workunit.client.0.smithi146.stdout:Errors: 0 2024-04-24T23:05:18.678 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x56335158e400 msgr2=0x563351582580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.678 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x56335158e400 0x563351582580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56335213d800 msgr2=0x563351582000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56335213d800 0x563351582000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5633520cdc00 msgr2=0x563351277180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x5633520cdc00 0x563351277180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3062200640 1 -- 172.21.15.146:0/2565222286 reap_dead start 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 msgr2=0x563351277700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 0x563351277700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x563351251f50 tx=0x563351f986c0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 msgr2=0x563351276c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.984+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x5633520e5ad0 tx=0x5633512cc900 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 shutdown_connections 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633520cd800 0x563351276c00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.679 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 --2- 172.21.15.146:0/2565222286 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56335213d000 0x563351277700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 >> 172.21.15.146:0/2565222286 conn(0x563351f97800 msgr2=0x563351313800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 shutdown_connections 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.985+0000 7f3065822280 1 -- 172.21.15.146:0/2565222286 wait complete. 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 msgr2=0x563351275b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x56335202b350 tx=0x563351f98720 comp rx=0 tx=0).stop 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 shutdown_connections 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x563351f97400 0x563351274b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563351f97c00 0x563351275080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 --2- 172.21.15.146:0/351237446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563351f96800 0x563351275b80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 >> 172.21.15.146:0/351237446 conn(0x563351209000 msgr2=0x563351313000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.986+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 shutdown_connections 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:17.987+0000 7f3065822280 1 -- 172.21.15.146:0/351237446 wait complete. 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset 2024-04-24T23:05:18.680 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.051+0000 7fac3460c280 1 -- start start 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.051+0000 7fac3460c280 1 Processor -- start 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86a74c00 0x557f86ae1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 0x557f86ae1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f877d6180 con 0x557f86a75800 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557f86ad6480 con 0x557f86a75c00 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557f86ad6900 con 0x557f86a74c00 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.052+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51244/0 (socket says 172.21.15.146:51244) 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 -- 172.21.15.146:0/4231922456 learned_addr learned my addr 172.21.15.146:0/4231922456 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac32400640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 0x557f86ae1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 -- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86a74c00 msgr2=0x557f86ae1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.681 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31a00640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86a74c00 0x557f86ae1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86a74c00 0x557f86ae1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 -- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 msgr2=0x557f86ae1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 0x557f86ae1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 -- 172.21.15.146:0/4231922456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f86aa8780 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac32400640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 0x557f86ae1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.053+0000 7fac31000640 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x557f8788d380 tx=0x557f87805ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba4fcff0b29555f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac2e800640 1 -- 172.21.15.146:0/4231922456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9a680 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac2e800640 1 -- 172.21.15.146:0/4231922456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f86aa0700 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac2e800640 1 -- 172.21.15.146:0/4231922456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9ab60 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f86aa94a0 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x557f86aa8000 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac2e800640 1 -- 172.21.15.146:0/4231922456 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x557f87934600 con 0x557f86a75800 2024-04-24T23:05:18.682 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.054+0000 7fac2e800640 1 -- 172.21.15.146:0/4231922456 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x557f86acf180 con 0x557f86a75800 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.055+0000 7fac3460c280 1 Processor -- start 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.055+0000 7fac3460c280 1 -- start start 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f86ad6180 con 0x557f8793b800 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557f877d7500 con 0x557f8793b400 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557f877d7380 con 0x557f8793bc00 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac31a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.056+0000 7fac31a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51260/0 (socket says 172.21.15.146:51260) 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 -- 172.21.15.146:0/3076131607 learned_addr learned my addr 172.21.15.146:0/3076131607 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 -- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793bc00 msgr2=0x557f86ae2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 -- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b400 msgr2=0x557f86ae0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.683 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 -- 172.21.15.146:0/3076131607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f86aa83c0 con 0x557f8793b800 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac31a00640 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x557f87956810 tx=0x557f879598c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1461049b89694b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac2c000640 1 -- 172.21.15.146:0/3076131607 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9a680 con 0x557f8793b800 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.057+0000 7fac2c000640 1 -- 172.21.15.146:0/3076131607 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f86aa0fc0 con 0x557f8793b800 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac2c000640 1 -- 172.21.15.146:0/3076131607 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9ab60 con 0x557f8793b800 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 -- 172.21.15.146:0/3076131607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 msgr2=0x557f86ae0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x557f87956810 tx=0x557f879598c0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 -- 172.21.15.146:0/3076131607 shutdown_connections 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 --2- 172.21.15.146:0/3076131607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 -- 172.21.15.146:0/3076131607 >> 172.21.15.146:0/3076131607 conn(0x557f8793b000 msgr2=0x557f86b7f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 -- 172.21.15.146:0/3076131607 shutdown_connections 2024-04-24T23:05:18.684 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.058+0000 7fac3460c280 1 -- 172.21.15.146:0/3076131607 wait complete. 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.059+0000 7fac3460c280 1 Processor -- start 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.059+0000 7fac3460c280 1 -- start start 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f877d6780 con 0x557f8793bc00 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557f877d6900 con 0x557f8793b800 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557f877d6600 con 0x557f8793b400 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51268/0 (socket says 172.21.15.146:51268) 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 -- 172.21.15.146:0/1620801185 learned_addr learned my addr 172.21.15.146:0/1620801185 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31a00640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 -- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793b400 msgr2=0x557f86ae0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.685 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac32400640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 -- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 msgr2=0x557f86ae0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31000640 1 -- 172.21.15.146:0/1620801185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f86aa8780 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.060+0000 7fac31a00640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac31000640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x557f879566c0 tx=0x557f87804900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac2a200640 1 -- 172.21.15.146:0/1620801185 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9a820 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac2a200640 1 -- 172.21.15.146:0/1620801185 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f86aa0a80 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f86aa94a0 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac2a200640 1 -- 172.21.15.146:0/1620801185 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86a9a680 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.061+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f86aa8960 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.063+0000 7fac2a200640 1 -- 172.21.15.146:0/1620801185 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x557f879b8c00 con 0x557f8793bc00 2024-04-24T23:05:18.686 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.064+0000 7fac2a200640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 0x557f86de6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.064+0000 7fac2a200640 1 -- 172.21.15.146:0/1620801185 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x557f879b6c00 con 0x557f8793bc00 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.064+0000 7fac32400640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 0x557f86de6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.065+0000 7fac3460c280 1 -- start start 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.065+0000 7fac3460c280 1 Processor -- start 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.065+0000 7fac32400640 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 0x557f86de6000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x557f86abdf50 tx=0x557f87804720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86de4800 0x557f86ae2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86de4c00 0x557f86ae2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f877d6600 con 0x557f86de5000 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557f877d6900 con 0x557f86de4c00 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac3460c280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x557f877d6780 con 0x557f86de4800 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac31000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51284/0 (socket says 172.21.15.146:51284) 2024-04-24T23:05:18.687 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.066+0000 7fac31000640 1 -- 172.21.15.146:0/107295659 learned_addr learned my addr 172.21.15.146:0/107295659 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86de4800 msgr2=0x557f86ae2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86de4c00 0x557f86ae2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86de4800 0x557f86ae2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86de4800 0x557f86ae2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86de4c00 msgr2=0x557f86ae2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86de4c00 0x557f86ae2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f86aa9680 con 0x557f86de5000 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86de4c00 0x557f86ae2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac31000640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x557f879f1410 tx=0x557f86d782a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911846695d0eb75f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac26600640 1 -- 172.21.15.146:0/107295659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86d74d00 con 0x557f86de5000 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac26600640 1 -- 172.21.15.146:0/107295659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557f86aa0fc0 con 0x557f86de5000 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac26600640 1 -- 172.21.15.146:0/107295659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557f86d74ea0 con 0x557f86de5000 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f86aa8000 con 0x557f86de5000 2024-04-24T23:05:18.688 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.067+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x557f86aa8780 con 0x557f86de5000 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.068+0000 7fac26600640 1 -- 172.21.15.146:0/107295659 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x557f87868600 con 0x557f86de5000 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.068+0000 7fac26600640 1 -- 172.21.15.146:0/107295659 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x557f86acf500 con 0x557f86de5000 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.068+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 0x557f86ae3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.068+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x557f86e58400 con 0x557f86de5400 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.069+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 0x557f86ae3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.070+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 0x557f86ae3700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=5643e8732f95aaf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.071+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x557f877f4000 con 0x557f86de5400 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.071+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557f86e58800 0x557f86de6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.071+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x557f86e58c00 con 0x557f86e58800 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.072+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557f86e58800 0x557f86de6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.073+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557f86e58800 0x557f86de6580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=4d31e6d2598bc621 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.074+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x557f877f4500 con 0x557f86e58800 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.074+0000 7fac24800640 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x557f879b0800 con 0x557f86e58800 2024-04-24T23:05:18.689 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.074+0000 7fac24800640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x557f879b0000 0x557f86de8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.074+0000 7fac24800640 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e57) -- 0x557f879b0400 con 0x557f879b0000 2024-04-24T23:05:18.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.075+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv60 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x557f877f4500 con 0x557f86e58800 2024-04-24T23:05:18.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.075+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x557f879b0000 0x557f86de8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.076+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x557f879b0000 0x557f86de8c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=7cec35827bab079b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.690 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.076+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4000 con 0x557f879b0000 2024-04-24T23:05:18.691 INFO:tasks.workunit.client.0.smithi146.stdout:old journal was 4194304~33090 2024-04-24T23:05:18.691 INFO:tasks.workunit.client.0.smithi146.stdout:new journal start will be 8388608 (4161214 bytes past old end) 2024-04-24T23:05:18.691 INFO:tasks.workunit.client.0.smithi146.stdout:writing journal head 2024-04-24T23:05:18.691 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.077+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e59000 con 0x557f86e58800 2024-04-24T23:05:18.692 INFO:tasks.workunit.client.0.smithi146.stdout:writing EResetJournal entry 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.080+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v57'61 uv61 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x557f877f4500 con 0x557f86e58800 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.080+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:6 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e59400 con 0x557f879b0000 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x557f86e59800 0x557f86de6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:7 7.b 7:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e58c00 con 0x557f86e59800 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x557f86e59c00 0x557f86de7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:8 7.1f 7:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e6e000 con 0x557f86e59c00 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x557f86e6e400 0x557f86de7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:9 7.1a 7:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e6e800 con 0x557f86e6e400 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:10 7.1e 7:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e6ec00 con 0x557f86de5400 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:11 7.1d 7:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f86e6f000 con 0x557f86e58800 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac31000640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x557f86e59c00 0x557f86de7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.694 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x557f86e6e400 0x557f86de7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.081+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x557f86e59800 0x557f86de6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.082+0000 7fac31000640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x557f86e59c00 0x557f86de7080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=b27257d598026872 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.082+0000 7fac32400640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x557f86e6e400 0x557f86de7600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=1f38427d5049d274 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.083+0000 7fac31a00640 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x557f86e59800 0x557f86de6b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=229f22d570d3b761 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.083+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(9 200.00000005 [delete] v57'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4000 con 0x557f86e6e400 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.085+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(11 200.00000007 [delete] v57'5 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4500 con 0x557f86e58800 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.085+0000 7fac31000640 1 -- 172.21.15.146:0/107295659 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(8 200.00000004 [delete] v57'19 uv18 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4780 con 0x557f86e59c00 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.086+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(10 200.00000006 [delete] v57'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4000 con 0x557f86de5400 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.086+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(7 200.00000003 [delete] v57'5 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4500 con 0x557f86e59800 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.087+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(6 200.00000002 [delete] v57'7 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x557f877f4000 con 0x557f879b0000 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.087+0000 7fac24800640 1 -- 172.21.15.146:0/107295659 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:12 7.1b 7:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x557f879b0400 con 0x557f879b0000 2024-04-24T23:05:18.695 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac32400640 1 -- 172.21.15.146:0/107295659 <== osd.4 v2:172.21.15.203:6810/306347931 3 ==== osd_op_reply(12 200.00000002 [write 0~48] v57'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x557f877f4000 con 0x557f879b0000 2024-04-24T23:05:18.696 INFO:tasks.workunit.client.0.smithi146.stdout:done 2024-04-24T23:05:18.704 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x557f86e59c00 msgr2=0x557f86de7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x557f86e59c00 0x557f86de7080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x557f86e6e400 msgr2=0x557f86de7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x557f86e6e400 0x557f86de7600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x557f879b0000 msgr2=0x557f86de8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x557f879b0000 0x557f86de8c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557f86e58800 msgr2=0x557f86de6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x557f86e58800 0x557f86de6580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x557f86e59800 msgr2=0x557f86de6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 reap_dead start 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x557f86e59800 0x557f86de6b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac31a00640 1 -- 172.21.15.146:0/107295659 reap_dead start 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 msgr2=0x557f86ae3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.705 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 0x557f86ae3700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 msgr2=0x557f86ae3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x557f879f1410 tx=0x557f86d782a0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 shutdown_connections 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x557f86de5400 0x557f86ae3700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 --2- 172.21.15.146:0/107295659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86de5000 0x557f86ae3180 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 >> 172.21.15.146:0/107295659 conn(0x557f86de4400 msgr2=0x557f86b7f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.091+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 shutdown_connections 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/107295659 wait complete. 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 msgr2=0x557f86de6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 0x557f86de6000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x557f86abdf50 tx=0x557f87804720 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 msgr2=0x557f86ae2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x557f879566c0 tx=0x557f87804900 comp rx=0 tx=0).stop 2024-04-24T23:05:18.706 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 shutdown_connections 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f8793bc00 0x557f86ae2100 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f8793b800 0x557f86ae0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x557f86de4000 0x557f86de6000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 --2- 172.21.15.146:0/1620801185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f8793b400 0x557f86ae0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 >> 172.21.15.146:0/1620801185 conn(0x557f8793b000 msgr2=0x557f86b7f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 shutdown_connections 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.092+0000 7fac3460c280 1 -- 172.21.15.146:0/1620801185 wait complete. 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 msgr2=0x557f86ae1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x557f8788d380 tx=0x557f87805ec0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 shutdown_connections 2024-04-24T23:05:18.707 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557f86a75c00 0x557f86ae1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86a75800 0x557f86ae1600 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 --2- 172.21.15.146:0/4231922456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x557f86a74c00 0x557f86ae1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 >> 172.21.15.146:0/4231922456 conn(0x557f86a75000 msgr2=0x557f86b7e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 shutdown_connections 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.093+0000 7fac3460c280 1 -- 172.21.15.146:0/4231922456 wait complete. 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:+ cephfs-table-tool all reset session 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.145+0000 7fe9c3520280 1 -- start start 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.145+0000 7fe9c3520280 1 Processor -- start 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 0x55cb93095080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93029c00 0x55cb93095b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.708 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cb93e0a480 con 0x55cb93e04800 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cb93e0a600 con 0x55cb93e04000 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cb93e0a780 con 0x55cb93029c00 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.146+0000 7fe9c1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51314/0 (socket says 172.21.15.146:51314) 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 -- 172.21.15.146:0/2625959571 learned_addr learned my addr 172.21.15.146:0/2625959571 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c0200640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93029c00 0x55cb93095b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 0x55cb93095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.709 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 -- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93029c00 msgr2=0x55cb93095b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93029c00 0x55cb93095b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 -- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 msgr2=0x55cb93095080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 0x55cb93095080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.710 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 -- 172.21.15.146:0/2625959571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9305c780 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 0x55cb93095080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c1600640 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x55cb93e45260 tx=0x55cb93db87e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c13520b0093c3d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9bda00640 1 -- 172.21.15.146:0/2625959571 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304ed00 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9bda00640 1 -- 172.21.15.146:0/2625959571 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55cb93054700 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9305c000 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55cb9305d680 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.147+0000 7fe9bda00640 1 -- 172.21.15.146:0/2625959571 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304e680 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.148+0000 7fe9bda00640 1 -- 172.21.15.146:0/2625959571 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55cb93ee8400 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.148+0000 7fe9bda00640 1 -- 172.21.15.146:0/2625959571 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 34) ==== 3490+0+0 (secure 0 0 0) 0x55cb93083180 con 0x55cb93e04800 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.149+0000 7fe9c3520280 1 Processor -- start 2024-04-24T23:05:18.711 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.149+0000 7fe9c3520280 1 -- start start 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 0x55cb93096680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cb9308a180 con 0x55cb93ee5000 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cb93e0b680 con 0x55cb93ee4c00 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cb93e0b500 con 0x55cb93ee5400 2024-04-24T23:05:18.712 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51320/0 (socket says 172.21.15.146:51320) 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 -- 172.21.15.146:0/917724939 learned_addr learned my addr 172.21.15.146:0/917724939 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0200640 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 -- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 msgr2=0x55cb93096680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 0x55cb93096680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 -- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee4c00 msgr2=0x55cb93094b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:18.713 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.150+0000 7fe9c0c00640 1 -- 172.21.15.146:0/917724939 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9305dc20 con 0x55cb93ee5000 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x55cb93f54060 tx=0x55cb93db9ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4603b666236a39e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9bb200640 1 -- 172.21.15.146:0/917724939 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304eb60 con 0x55cb93ee5000 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9bb200640 1 -- 172.21.15.146:0/917724939 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55cb93054e00 con 0x55cb93ee5000 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9bb200640 1 -- 172.21.15.146:0/917724939 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304ed00 con 0x55cb93ee5000 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 -- 172.21.15.146:0/917724939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 msgr2=0x55cb93096100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x55cb93f54060 tx=0x55cb93db9ec0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 -- 172.21.15.146:0/917724939 shutdown_connections 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 0x55cb93096680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.714 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 --2- 172.21.15.146:0/917724939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.151+0000 7fe9c3520280 1 -- 172.21.15.146:0/917724939 >> 172.21.15.146:0/917724939 conn(0x55cb93e04400 msgr2=0x55cb93da5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.152+0000 7fe9c3520280 1 -- 172.21.15.146:0/917724939 shutdown_connections 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.152+0000 7fe9c3520280 1 -- 172.21.15.146:0/917724939 wait complete. 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.152+0000 7fe9c3520280 1 Processor -- start 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.152+0000 7fe9c3520280 1 -- start start 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 0x55cb93096680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cb93e0a900 con 0x55cb93ee4c00 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cb93e0aa80 con 0x55cb93ee5000 2024-04-24T23:05:18.715 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c3520280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cb93e0a180 con 0x55cb93ee5400 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c0200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c0200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51332/0 (socket says 172.21.15.146:51332) 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.153+0000 7fe9c0200640 1 -- 172.21.15.146:0/3143716123 learned_addr learned my addr 172.21.15.146:0/3143716123 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 -- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 msgr2=0x55cb93096680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93ee5400 0x55cb93096680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 -- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee5000 msgr2=0x55cb93096100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 -- 172.21.15.146:0/3143716123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9305da40 con 0x55cb93ee4c00 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93ee5000 0x55cb93096100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c0200640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x55cb93f55470 tx=0x55cb93eff800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.716 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9b9400640 1 -- 172.21.15.146:0/3143716123 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304eb60 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9b9400640 1 -- 172.21.15.146:0/3143716123 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55cb930541c0 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9b9400640 1 -- 172.21.15.146:0/3143716123 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55cb9304ed00 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.154+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb9305d860 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.155+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9305c3c0 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.156+0000 7fe9b9400640 1 -- 172.21.15.146:0/3143716123 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55cb93f5cc00 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.157+0000 7fe9b9400640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55cb93f65000 0x55cb93097700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.157+0000 7fe9b9400640 1 -- 172.21.15.146:0/3143716123 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x55cb93f5ac00 con 0x55cb93ee4c00 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.157+0000 7fe9c3520280 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55cb93ee5800 0x55cb93096c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.157+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 7.b 7:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55cb93ee5c00 con 0x55cb93ee5800 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.158+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55cb93f65000 0x55cb93097700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.158+0000 7fe9c0200640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55cb93ee5800 0x55cb93096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:18.717 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.159+0000 7fe9c0c00640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55cb93f65000 0x55cb93097700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55cb93f54060 tx=0x55cb93db9da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.159+0000 7fe9c0200640 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55cb93ee5800 0x55cb93096c00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stdout:{ 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stdout: "0": { 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stdout: "data": {}, 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stdout: "result": 0 2024-04-24T23:05:18.718 INFO:tasks.workunit.client.0.smithi146.stdout: } 2024-04-24T23:05:18.719 INFO:tasks.workunit.client.0.smithi146.stdout:} 2024-04-24T23:05:18.719 INFO:tasks.workunit.client.0.smithi146.stdout: 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c0200640 1 -- 172.21.15.146:0/3143716123 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v57'6 uv6 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x55cb931a6000 con 0x55cb93ee5800 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55cb93ee5800 msgr2=0x55cb93096c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55cb93ee5800 0x55cb93096c00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55cb93f65000 msgr2=0x55cb93097700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55cb93f65000 0x55cb93097700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55cb93f54060 tx=0x55cb93db9da0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 msgr2=0x55cb93094b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 --2- 172.21.15.146:0/3143716123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93ee4c00 0x55cb93094b00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x55cb93f55470 tx=0x55cb93eff800 comp rx=0 tx=0).stop 2024-04-24T23:05:18.721 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c0c00640 1 -- 172.21.15.146:0/3143716123 reap_dead start 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 shutdown_connections 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 >> 172.21.15.146:0/3143716123 conn(0x55cb93e04400 msgr2=0x55cb93da5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 shutdown_connections 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.162+0000 7fe9c3520280 1 -- 172.21.15.146:0/3143716123 wait complete. 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 msgr2=0x55cb93095600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x55cb93e45260 tx=0x55cb93db87e0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 shutdown_connections 2024-04-24T23:05:18.722 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cb93e04800 0x55cb93095600 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.723 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cb93029c00 0x55cb93095b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.723 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 --2- 172.21.15.146:0/2625959571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb93e04000 0x55cb93095080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:18.723 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 >> 172.21.15.146:0/2625959571 conn(0x55cb93029000 msgr2=0x55cb93da5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:18.723 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 shutdown_connections 2024-04-24T23:05:18.723 INFO:tasks.workunit.client.0.smithi146.stderr:2024-04-24T23:05:18.163+0000 7fe9c3520280 1 -- 172.21.15.146:0/2625959571 wait complete. 2024-04-24T23:05:18.723 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T23:05:18.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T23:05:18.825 INFO:tasks.workunit:Stopping ['suites/cephfs_journal_tool_smoke.sh'] on client.0... 2024-04-24T23:05:18.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T23:05:19.822 DEBUG:teuthology.parallel:result is None 2024-04-24T23:05:19.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:05:19.902 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:05:19.902 DEBUG:teuthology.orchestra.run.smithi146:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:19.962 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:05:19.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-24T23:05:20.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.164+0000 7f938d400640 1 Processor -- start 2024-04-24T23:05:20.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.164+0000 7f938d400640 1 -- start start 2024-04-24T23:05:20.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.165+0000 7f938d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f938806dd80 0x7f938806e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:20.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.165+0000 7f938d400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938815e3f0 con 0x7f938806eb60 2024-04-24T23:05:20.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.165+0000 7f938d400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938806e230 con 0x7f938815e010 2024-04-24T23:05:20.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.165+0000 7f938d400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f938806ef90 con 0x7f938806dd80 2024-04-24T23:05:20.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f938806dd80 0x7f938806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:20.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f938806dd80 0x7f938806e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51336/0 (socket says 172.21.15.146:51336) 2024-04-24T23:05:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f9387200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f938806eb60 0x7f93880b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51096/0 (socket says 172.21.15.146:51096) 2024-04-24T23:05:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 -- 172.21.15.146:0/2933648465 learned_addr learned my addr 172.21.15.146:0/2933648465 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 -- 172.21.15.146:0/2933648465 >> v1:172.21.15.203:6789/0 conn(0x7f938815e010 legacy=0x7f9388071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 -- 172.21.15.146:0/2933648465 >> v1:172.21.15.146:6789/0 conn(0x7f938806eb60 legacy=0x7f93880b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.166+0000 7f937de00640 1 -- 172.21.15.146:0/2933648465 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938806cd20 con 0x7f938806dd80 2024-04-24T23:05:20.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.167+0000 7f937de00640 1 --2- 172.21.15.146:0/2933648465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938806dd80 0x7f938806e620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9370009870 tx=0x7f937002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81458589f1aa3af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f9385e00640 1 -- 172.21.15.146:0/2933648465 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370037070 con 0x7f938806dd80 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f9385e00640 1 -- 172.21.15.146:0/2933648465 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9370032440 con 0x7f938806dd80 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f9385e00640 1 -- 172.21.15.146:0/2933648465 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370032810 con 0x7f938806dd80 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f938d400640 1 -- 172.21.15.146:0/2933648465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938806dd80 msgr2=0x7f938806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f938d400640 1 --2- 172.21.15.146:0/2933648465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938806dd80 0x7f938806e620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9370009870 tx=0x7f937002a2a0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.168+0000 7f938d400640 1 -- 172.21.15.146:0/2933648465 shutdown_connections 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.169+0000 7f938d400640 1 --2- 172.21.15.146:0/2933648465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938806dd80 0x7f938806e620 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.169+0000 7f938d400640 1 -- 172.21.15.146:0/2933648465 >> 172.21.15.146:0/2933648465 conn(0x7f93880b17b0 msgr2=0x7f93880b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.169+0000 7f938d400640 1 -- 172.21.15.146:0/2933648465 shutdown_connections 2024-04-24T23:05:20.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.169+0000 7f938d400640 1 -- 172.21.15.146:0/2933648465 wait complete. 2024-04-24T23:05:20.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.170+0000 7f938d400640 1 Processor -- start 2024-04-24T23:05:20.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.170+0000 7f938d400640 1 -- start start 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f938806dd80 0x7f93881f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f938806eb60 0x7f93881470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f938806cfc0 con 0x7f938815e010 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9388071fe0 con 0x7f938806dd80 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.171+0000 7f938d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f938806d2a0 con 0x7f938806eb60 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51342/0 (socket says 172.21.15.146:51342) 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 -- 172.21.15.146:0/2200773776 learned_addr learned my addr 172.21.15.146:0/2200773776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9386800640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f938806dd80 0x7f93881f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:20.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f937de00640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f938806eb60 0x7f93881470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 -- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f938806eb60 msgr2=0x7f93881470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f938806eb60 0x7f93881470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 -- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f938806dd80 msgr2=0x7f93881f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f938806dd80 0x7f93881f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 -- 172.21.15.146:0/2200773776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93881f7a70 con 0x7f938815e010 2024-04-24T23:05:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.172+0000 7f9387200640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f938000c780 tx=0x7f938000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.173+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380017070 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.173+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938000a640 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.173+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93881f7d50 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.173+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938000aa30 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.173+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93881f3ff0 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.174+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938804f5a0 con 0x7f938815e010 2024-04-24T23:05:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.175+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f938001a070 con 0x7f938815e010 2024-04-24T23:05:20.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.176+0000 7f937f400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 0x7f936406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:20.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.176+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f938008a670 con 0x7f938815e010 2024-04-24T23:05:20.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.177+0000 7f9386800640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 0x7f936406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:20.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.178+0000 7f9386800640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 0x7f936406e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9378004ea0 tx=0x7f9378009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:20.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.181+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9380058730 con 0x7f938815e010 2024-04-24T23:05:20.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.403+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f93880b3950 con 0x7f938815e010 2024-04-24T23:05:20.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.875+0000 7f937f400640 1 -- 172.21.15.146:0/2200773776 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v35) ==== 162+0+0 (secure 0 0 0) 0x7f938005ca30 con 0x7f938815e010 2024-04-24T23:05:20.877 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-24T23:05:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 msgr2=0x7f936406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 0x7f936406e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9378004ea0 tx=0x7f9378009040 comp rx=0 tx=0).stop 2024-04-24T23:05:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 msgr2=0x7f93881f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f938000c780 tx=0x7f938000cc40 comp rx=0 tx=0).stop 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 shutdown_connections 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938815e010 0x7f93881f6fb0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f936406be60 0x7f936406e320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f938806eb60 0x7f93881470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 --2- 172.21.15.146:0/2200773776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f938806dd80 0x7f93881f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 >> 172.21.15.146:0/2200773776 conn(0x7f93880b17b0 msgr2=0x7f93880b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 shutdown_connections 2024-04-24T23:05:20.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:20.878+0000 7f938d400640 1 -- 172.21.15.146:0/2200773776 wait complete. 2024-04-24T23:05:20.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:05:21.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.084+0000 7f6591c00640 1 Processor -- start 2024-04-24T23:05:21.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.084+0000 7f6591c00640 1 -- start start 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6591c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f658c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6591c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658c1449c0 con 0x7f658c1445e0 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6591c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658c071820 con 0x7f658c0728c0 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6591c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f658c072430 con 0x7f658c0d03a0 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f658aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f658c1445e0 0x7f658c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51102/0 (socket says 172.21.15.146:51102) 2024-04-24T23:05:21.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f658aa00640 1 -- 172.21.15.146:0/439704096 learned_addr learned my addr 172.21.15.146:0/439704096 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:05:21.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707944121 0 0) 0x7f658c1449c0 con 0x7f658c1445e0 2024-04-24T23:05:21.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.086+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6570005730 con 0x7f658c1445e0 2024-04-24T23:05:21.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f658a000640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f658c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614424640 0 0) 0x7f6570005730 con 0x7f658c1445e0 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 msgr2=0x7f658c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f658c070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 >> v1:172.21.15.203:6789/0 conn(0x7f658c0728c0 legacy=0x7f658c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c071b00 con 0x7f658c1445e0 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f657c001670 con 0x7f658c1445e0 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f658a000640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f658c070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 >> v1:172.21.15.146:6789/0 conn(0x7f658c1445e0 legacy=0x7f658c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f6570005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65700062c0 0x7f6570006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6570006fa0 0x7f6570007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f658c072430 con 0x7f6570006fa0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f657000de10 con 0x7f65700062c0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f657000e010 con 0x7f658c0d03a0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.087+0000 7f658b400640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6570006fa0 0x7f6570007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658aa00640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f6570005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658a000640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65700062c0 0x7f6570006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658b400640 1 -- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 msgr2=0x7f6570005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658b400640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c0d03a0 0x7f6570005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658b400640 1 -- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65700062c0 msgr2=0x7f6570006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658b400640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f65700062c0 0x7f6570006a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.088+0000 7f658b400640 1 -- 172.21.15.146:0/439704096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6570005730 con 0x7f6570006fa0 2024-04-24T23:05:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.089+0000 7f658b400640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6570006fa0 0x7f6570007420 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6584001e20 tx=0x7f6570007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6200dc744510c24d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.089+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584001a70 con 0x7f6570006fa0 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.089+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658402ae40 con 0x7f6570006fa0 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.089+0000 7f6589600640 1 -- 172.21.15.146:0/439704096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584003bb0 con 0x7f6570006fa0 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 -- 172.21.15.146:0/439704096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6570006fa0 msgr2=0x7f6570007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 --2- 172.21.15.146:0/439704096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6570006fa0 0x7f6570007420 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6584001e20 tx=0x7f6570007a40 comp rx=0 tx=0).stop 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f658b400640 1 -- 172.21.15.146:0/439704096 reap_dead start 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 -- 172.21.15.146:0/439704096 shutdown_connections 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 -- 172.21.15.146:0/439704096 >> 172.21.15.146:0/439704096 conn(0x7f658c06b320 msgr2=0x7f658c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 -- 172.21.15.146:0/439704096 shutdown_connections 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.090+0000 7f6591c00640 1 -- 172.21.15.146:0/439704096 wait complete. 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.092+0000 7f6591c00640 1 Processor -- start 2024-04-24T23:05:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.092+0000 7f6591c00640 1 -- start start 2024-04-24T23:05:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6570006fa0 0x7f658c138d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c1f43f0 0x7f658c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0720c0 con 0x7f658c1f5650 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0b2d70 con 0x7f6570006fa0 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f6591c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f658c0cd5e0 con 0x7f658c1f43f0 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f658a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f658a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51356/0 (socket says 172.21.15.146:51356) 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f658a000640 1 -- 172.21.15.146:0/1325738673 learned_addr learned my addr 172.21.15.146:0/1325738673 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.093+0000 7f658aa00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6570006fa0 0x7f658c138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 -- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c1f43f0 msgr2=0x7f658c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c1f43f0 0x7f658c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 -- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6570006fa0 msgr2=0x7f658c138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6570006fa0 0x7f658c138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 -- 172.21.15.146:0/1325738673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c139260 con 0x7f658c1f5650 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f658a000640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f657800d860 tx=0x7f657800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578016070 con 0x7f658c1f5650 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780089c0 con 0x7f658c1f5650 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578008d90 con 0x7f658c1f5650 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c1f49c0 con 0x7f658c1f5650 2024-04-24T23:05:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.094+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c1f4f80 con 0x7f658c1f5650 2024-04-24T23:05:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.095+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c068190 con 0x7f658c1f5650 2024-04-24T23:05:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.096+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6578019070 con 0x7f658c1f5650 2024-04-24T23:05:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.097+0000 7f6582a00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.097+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f657808b1b0 con 0x7f658c1f5650 2024-04-24T23:05:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.098+0000 7f658aa00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.099+0000 7f658aa00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 0x7f656c06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f658c141820 tx=0x7f657c001d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:21.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.102+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f658c139260 con 0x7f658c1f5650 2024-04-24T23:05:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.341+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f658c0cc7d0 con 0x7f658c1f5650 2024-04-24T23:05:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.342+0000 7f6582a00640 1 -- 172.21.15.146:0/1325738673 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5187 (secure 0 0 0) 0x7f657800be20 con 0x7f658c1f5650 2024-04-24T23:05:21.345 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:05:21.345 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:20.880941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-04-24T23:05:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2024-04-24T23:05:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 msgr2=0x7f656c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 0x7f656c06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f658c141820 tx=0x7f657c001d50 comp rx=0 tx=0).stop 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 msgr2=0x7f658c1f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f657800d860 tx=0x7f657800dd20 comp rx=0 tx=0).stop 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 shutdown_connections 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f656c06be60 0x7f656c06e320 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f658c1f43f0 0x7f658c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f658c1f5650 0x7f658c1f3eb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 --2- 172.21.15.146:0/1325738673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6570006fa0 0x7f658c138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 >> 172.21.15.146:0/1325738673 conn(0x7f658c06b320 msgr2=0x7f658c0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 shutdown_connections 2024-04-24T23:05:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:21.345+0000 7f6591c00640 1 -- 172.21.15.146:0/1325738673 wait complete. 2024-04-24T23:05:21.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:02:24.670189+0000', 'modified': '2024-04-24T23:05:20.880941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6078}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6078': {'gid': 6078, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/3630709161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3630709161}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3630709161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-24T23:05:21.768 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6078:up:replay 2024-04-24T23:05:22.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:05:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.975+0000 7f9c10a00640 1 Processor -- start 2024-04-24T23:05:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.975+0000 7f9c10a00640 1 -- start start 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c10a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 0x7f9c0c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c10a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c0af300 con 0x7f9c0c15e330 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c10a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c06e120 con 0x7f9c0c15a410 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c10a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c06e400 con 0x7f9c0c06dc50 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c0be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9c0c15e330 0x7f9c0c0b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51104/0 (socket says 172.21.15.146:51104) 2024-04-24T23:05:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.977+0000 7f9c0be00640 1 -- 172.21.15.146:0/3074801033 learned_addr learned my addr 172.21.15.146:0/3074801033 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:05:22.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 0x7f9c0c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:22.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628128317 0 0) 0x7f9c0c0af300 con 0x7f9c0c15e330 2024-04-24T23:05:22.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bf0003520 con 0x7f9c0c15e330 2024-04-24T23:05:22.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804766009 0 0) 0x7f9bf0003520 con 0x7f9c0c15e330 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 msgr2=0x7f9c0c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 0x7f9c0c15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 >> v1:172.21.15.203:6789/0 conn(0x7f9c0c15a410 legacy=0x7f9c0c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c06e6e0 con 0x7f9c0c15e330 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9c040019f0 con 0x7f9c0c15e330 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 >> v1:172.21.15.146:6789/0 conn(0x7f9c0c15e330 legacy=0x7f9c0c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 0x7f9bf00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9bf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bf0004d40 0x7f9bf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c06e400 con 0x7f9bf0004010 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf000dd90 con 0x7f9bf0004d40 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf000df90 con 0x7f9c0c06dc50 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.978+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9bf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.979+0000 7f9c0aa00640 1 -- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 msgr2=0x7f9bf00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.979+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c06dc50 0x7f9bf00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.979+0000 7f9c0aa00640 1 -- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bf0004d40 msgr2=0x7f9bf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.979+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bf0004d40 0x7f9bf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.979+0000 7f9c0aa00640 1 -- 172.21.15.146:0/3074801033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf0003520 con 0x7f9bf0004010 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.980+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9bf0004800 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800ba00 tx=0x7f9bf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ecddc019f3b9b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.980+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8030070 con 0x7f9bf0004010 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.980+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf802ade0 con 0x7f9bf0004010 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.980+0000 7f9c0a000640 1 -- 172.21.15.146:0/3074801033 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800b600 con 0x7f9bf0004010 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 -- 172.21.15.146:0/3074801033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 msgr2=0x7f9bf0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 --2- 172.21.15.146:0/3074801033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9bf0004800 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800ba00 tx=0x7f9bf0005830 comp rx=0 tx=0).stop 2024-04-24T23:05:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c0be00640 1 -- 172.21.15.146:0/3074801033 reap_dead start 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 -- 172.21.15.146:0/3074801033 shutdown_connections 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 -- 172.21.15.146:0/3074801033 >> 172.21.15.146:0/3074801033 conn(0x7f9c0c06b320 msgr2=0x7f9c0c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 -- 172.21.15.146:0/3074801033 shutdown_connections 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.981+0000 7f9c10a00640 1 -- 172.21.15.146:0/3074801033 wait complete. 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.982+0000 7f9c10a00640 1 Processor -- start 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 -- start start 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c159620 0x7f9c0c150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c159aa0 0x7f9c0c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c0cfb30 con 0x7f9bf0004010 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c15e040 con 0x7f9c0c159620 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.983+0000 7f9c10a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c0cfcb0 con 0x7f9c0c159aa0 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51362/0 (socket says 172.21.15.146:51362) 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 -- 172.21.15.146:0/2058942971 learned_addr learned my addr 172.21.15.146:0/2058942971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 -- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c159aa0 msgr2=0x7f9c0c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c159620 0x7f9c0c150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c159aa0 0x7f9c0c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 -- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c159620 msgr2=0x7f9c0c150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c159620 0x7f9c0c150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.984+0000 7f9c0b400640 1 -- 172.21.15.146:0/2058942971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c0cc410 con 0x7f9bf0004010 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c0b400640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c500 tx=0x7f9bfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0052d0 con 0x7f9bf0004010 2024-04-24T23:05:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc005470 con 0x7f9bf0004010 2024-04-24T23:05:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc012870 con 0x7f9bf0004010 2024-04-24T23:05:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c0ae650 con 0x7f9bf0004010 2024-04-24T23:05:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.985+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1f8000 con 0x7f9bf0004010 2024-04-24T23:05:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.986+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c04f500 con 0x7f9bf0004010 2024-04-24T23:05:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.987+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bfc012a10 con 0x7f9bf0004010 2024-04-24T23:05:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.988+0000 7f9c03400640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.988+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f9bfc08ada0 con 0x7f9bf0004010 2024-04-24T23:05:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.989+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:22.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.990+0000 7f9c0aa00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 0x7f9bec06e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c06e050 tx=0x7f9bf8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:22.993+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9c0c0ae650 con 0x7f9bf0004010 2024-04-24T23:05:23.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.226+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c0c15dac0 con 0x7f9bf0004010 2024-04-24T23:05:23.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.227+0000 7f9c03400640 1 -- 172.21.15.146:0/2058942971 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5188 (secure 0 0 0) 0x7f9c0c0cc410 con 0x7f9bf0004010 2024-04-24T23:05:23.230 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:05:23.230 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:21.897186+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-04-24T23:05:23.230 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-04-24T23:05:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 msgr2=0x7f9bec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 0x7f9bec06e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c06e050 tx=0x7f9bf8030000 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 msgr2=0x7f9c0c0ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00c500 tx=0x7f9bfc00c9c0 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 shutdown_connections 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c0c159aa0 0x7f9c0c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c159620 0x7f9c0c150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 --2- 172.21.15.146:0/2058942971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf0004010 0x7f9c0c0ae110 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 >> 172.21.15.146:0/2058942971 conn(0x7f9c0c06b320 msgr2=0x7f9c0c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 shutdown_connections 2024-04-24T23:05:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:23.230+0000 7f9c10a00640 1 -- 172.21.15.146:0/2058942971 wait complete. 2024-04-24T23:05:23.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:02:24.670189+0000', 'modified': '2024-04-24T23:05:21.897186+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6078}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6078': {'gid': 6078, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 23, 'addr': '172.21.15.146:6835/3630709161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3630709161}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3630709161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-24T23:05:23.653 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6078:up:rejoin 2024-04-24T23:05:24.391 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-04-24T23:05:24.389+0000 7f3277000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:05:24.655 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:05:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.856+0000 7f4fb7a00640 1 Processor -- start 2024-04-24T23:05:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.856+0000 7f4fb7a00640 1 -- start start 2024-04-24T23:05:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.857+0000 7f4fb7a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4fb0145640 0x7f4fb015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb7a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fb00d03a0 0x7f4fb00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb7a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb00cdf70 con 0x7f4fb00b2a20 2024-04-24T23:05:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb7a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4fb015d360 con 0x7f4fb00d03a0 2024-04-24T23:05:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb7a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4fb0145a20 con 0x7f4fb0145640 2024-04-24T23:05:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fb00d03a0 0x7f4fb00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fb00d03a0 0x7f4fb00ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51372/0 (socket says 172.21.15.146:51372) 2024-04-24T23:05:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 -- 172.21.15.146:0/3370604762 learned_addr learned my addr 172.21.15.146:0/3370604762 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:24.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 -- 172.21.15.146:0/3370604762 >> v2:172.21.15.203:3300/0 conn(0x7f4fb0145640 msgr2=0x7f4fb015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:24.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 --2- 172.21.15.146:0/3370604762 >> v2:172.21.15.203:3300/0 conn(0x7f4fb0145640 0x7f4fb015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 -- 172.21.15.146:0/3370604762 >> v1:172.21.15.203:6789/0 conn(0x7f4fb00b2a20 legacy=0x7f4fb00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:24.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.858+0000 7f4fb5a00640 1 -- 172.21.15.146:0/3370604762 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb006d140 con 0x7f4fb00d03a0 2024-04-24T23:05:24.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.859+0000 7f4fb5a00640 1 --2- 172.21.15.146:0/3370604762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00d03a0 0x7f4fb00ce450 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00d0830 tx=0x7f4fa802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04544a9462b0570 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:24.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.860+0000 7f4faf400640 1 -- 172.21.15.146:0/3370604762 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8036070 con 0x7f4fb00d03a0 2024-04-24T23:05:24.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.860+0000 7f4faf400640 1 -- 172.21.15.146:0/3370604762 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa8031600 con 0x7f4fb00d03a0 2024-04-24T23:05:24.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.860+0000 7f4faf400640 1 -- 172.21.15.146:0/3370604762 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80319d0 con 0x7f4fb00d03a0 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.860+0000 7f4fb7a00640 1 -- 172.21.15.146:0/3370604762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00d03a0 msgr2=0x7f4fb00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.860+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/3370604762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00d03a0 0x7f4fb00ce450 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00d0830 tx=0x7f4fa802a6d0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 -- 172.21.15.146:0/3370604762 shutdown_connections 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/3370604762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00d03a0 0x7f4fb00ce450 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/3370604762 >> v2:172.21.15.203:3300/0 conn(0x7f4fb0145640 0x7f4fb015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 -- 172.21.15.146:0/3370604762 >> 172.21.15.146:0/3370604762 conn(0x7f4fb006b320 msgr2=0x7f4fb006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 -- 172.21.15.146:0/3370604762 shutdown_connections 2024-04-24T23:05:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.861+0000 7f4fb7a00640 1 -- 172.21.15.146:0/3370604762 wait complete. 2024-04-24T23:05:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.863+0000 7f4fb7a00640 1 Processor -- start 2024-04-24T23:05:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.863+0000 7f4fb7a00640 1 -- start start 2024-04-24T23:05:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 0x7f4fb01f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fb00d03a0 0x7f4fb013a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb006d9e0 con 0x7f4fb0145640 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb006d700 con 0x7f4fb00d03a0 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb7a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb006cbc0 con 0x7f4fb00b2a20 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51380/0 (socket says 172.21.15.146:51380) 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb5a00640 1 -- 172.21.15.146:0/248806228 learned_addr learned my addr 172.21.15.146:0/248806228 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fafe00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fb00d03a0 0x7f4fb013a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.864+0000 7f4fb5000640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 0x7f4fb01f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 -- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 msgr2=0x7f4fb01f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 0x7f4fb01f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 -- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fb00d03a0 msgr2=0x7f4fb013a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fb00d03a0 0x7f4fb013a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 -- 172.21.15.146:0/248806228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb01f1ad0 con 0x7f4fb0145640 2024-04-24T23:05:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5000640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 0x7f4fb01f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb5a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034040 tx=0x7f4fa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8041020 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80094d0 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8036040 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb013ae40 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.865+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01f1d50 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.867+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb013b360 con 0x7f4fb0145640 2024-04-24T23:05:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.868+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fa8044020 con 0x7f4fb0145640 2024-04-24T23:05:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.868+0000 7f4facc00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 0x7f4f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.869+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f4fa80abe80 con 0x7f4fb0145640 2024-04-24T23:05:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.869+0000 7f4fb5000640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 0x7f4f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:24.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.870+0000 7f4fb5000640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 0x7f4f9406e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a870 tx=0x7f4fa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:24.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:24.873+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4fa804b030 con 0x7f4fb0145640 2024-04-24T23:05:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.106+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fb0068190 con 0x7f4fb0145640 2024-04-24T23:05:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.108+0000 7f4facc00640 1 -- 172.21.15.146:0/248806228 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5195 (secure 0 0 0) 0x7f4fb01f1ad0 con 0x7f4fb0145640 2024-04-24T23:05:25.110 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:05:25.110 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:23.906529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":24,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6078,"qdb_cluster":[6078]},"id":3}]} 2024-04-24T23:05:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2024-04-24T23:05:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.110+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 msgr2=0x7f4f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.110+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 0x7f4f9406e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a870 tx=0x7f4fa4008040 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.110+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 msgr2=0x7f4fb0144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.110+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034040 tx=0x7f4fa8004a40 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 shutdown_connections 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb0145640 0x7f4fb0144110 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fb00d03a0 0x7f4fb013a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f9406be30 0x7f4f9406e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 --2- 172.21.15.146:0/248806228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4fb00b2a20 0x7f4fb01f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 >> 172.21.15.146:0/248806228 conn(0x7f4fb006b320 msgr2=0x7f4fb00b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 shutdown_connections 2024-04-24T23:05:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.111+0000 7f4fb7a00640 1 -- 172.21.15.146:0/248806228 wait complete. 2024-04-24T23:05:25.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:02:24.670189+0000', 'modified': '2024-04-24T23:05:23.906529+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6078}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6078': {'gid': 6078, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 24, 'addr': '172.21.15.146:6835/3630709161', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3630709161}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3630709161}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6078, 'qdb_cluster': [6078]} 2024-04-24T23:05:25.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:05:25.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:05:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.740+0000 7f81f8e00640 1 Processor -- start 2024-04-24T23:05:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.740+0000 7f81f8e00640 1 -- start start 2024-04-24T23:05:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f8e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f81f415e010 0x7f81f40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f8e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81f4072380 0x7f81f40ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f8e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f4070a80 con 0x7f81f40ade00 2024-04-24T23:05:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f8e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f81f40ae270 con 0x7f81f4072380 2024-04-24T23:05:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f8e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f81f40aeb60 con 0x7f81f415e010 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81eaa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81f4072380 0x7f81f40ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81f40ade00 0x7f81f4161a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51116/0 (socket says 172.21.15.146:51116) 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.742+0000 7f81f3e00640 1 -- 172.21.15.146:0/3579369853 learned_addr learned my addr 172.21.15.146:0/3579369853 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.743+0000 7f81f3400640 1 --2- 172.21.15.146:0/3579369853 >> v2:172.21.15.203:3300/0 conn(0x7f81f415e010 0x7f81f40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.743+0000 7f81eaa00640 1 -- 172.21.15.146:0/3579369853 >> v2:172.21.15.203:3300/0 conn(0x7f81f415e010 msgr2=0x7f81f40b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.743+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3579369853 >> v2:172.21.15.203:3300/0 conn(0x7f81f415e010 0x7f81f40b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.743+0000 7f81eaa00640 1 -- 172.21.15.146:0/3579369853 >> v1:172.21.15.146:6789/0 conn(0x7f81f40ade00 legacy=0x7f81f4161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.743+0000 7f81eaa00640 1 -- 172.21.15.146:0/3579369853 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4070d20 con 0x7f81f4072380 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.744+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3579369853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4072380 0x7f81f40ad8c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f81f406ea60 tx=0x7f81dc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268cd0fc33a607af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.744+0000 7f81f2a00640 1 -- 172.21.15.146:0/3579369853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x7f81f4072380 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.744+0000 7f81f2a00640 1 -- 172.21.15.146:0/3579369853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc032440 con 0x7f81f4072380 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.744+0000 7f81f2a00640 1 -- 172.21.15.146:0/3579369853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc032810 con 0x7f81f4072380 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 -- 172.21.15.146:0/3579369853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4072380 msgr2=0x7f81f40ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 --2- 172.21.15.146:0/3579369853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4072380 0x7f81f40ad8c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f81f406ea60 tx=0x7f81dc02a250 comp rx=0 tx=0).stop 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 -- 172.21.15.146:0/3579369853 shutdown_connections 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 --2- 172.21.15.146:0/3579369853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4072380 0x7f81f40ad8c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 --2- 172.21.15.146:0/3579369853 >> v2:172.21.15.203:3300/0 conn(0x7f81f415e010 0x7f81f40b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 -- 172.21.15.146:0/3579369853 >> 172.21.15.146:0/3579369853 conn(0x7f81f40b1560 msgr2=0x7f81f40b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 -- 172.21.15.146:0/3579369853 shutdown_connections 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.745+0000 7f81f8e00640 1 -- 172.21.15.146:0/3579369853 wait complete. 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.747+0000 7f81f8e00640 1 Processor -- start 2024-04-24T23:05:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.748+0000 7f81f8e00640 1 -- start start 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 0x7f81f41f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81f40ade00 0x7f81f41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40712e0 con 0x7f81f415e010 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4071930 con 0x7f81f40ade00 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f8e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f81f40715c0 con 0x7f81f4072380 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51390/0 (socket says 172.21.15.146:51390) 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f3e00640 1 -- 172.21.15.146:0/972335952 learned_addr learned my addr 172.21.15.146:0/972335952 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81eaa00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81f40ade00 0x7f81f41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.749+0000 7f81f3400640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 0x7f81f41f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 -- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 msgr2=0x7f81f41f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 0x7f81f41f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 -- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81f40ade00 msgr2=0x7f81f41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81f40ade00 0x7f81f41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 -- 172.21.15.146:0/972335952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41f47c0 con 0x7f81f415e010 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3400640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 0x7f81f41f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f3e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00cbc0 tx=0x7f81ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81ebe00640 1 -- 172.21.15.146:0/972335952 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017070 con 0x7f81f415e010 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81ebe00640 1 -- 172.21.15.146:0/972335952 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec00ad40 con 0x7f81f415e010 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81ebe00640 1 -- 172.21.15.146:0/972335952 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec012600 con 0x7f81f415e010 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41f7840 con 0x7f81f415e010 2024-04-24T23:05:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.750+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41f3a80 con 0x7f81f415e010 2024-04-24T23:05:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.753+0000 7f81ebe00640 1 -- 172.21.15.146:0/972335952 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81ec01a070 con 0x7f81f415e010 2024-04-24T23:05:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.754+0000 7f81ebe00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.754+0000 7f81ebe00640 1 -- 172.21.15.146:0/972335952 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f81ec08ad90 con 0x7f81f415e010 2024-04-24T23:05:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.754+0000 7f81f3400640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.754+0000 7f81fd181740 1 Processor -- start 2024-04-24T23:05:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.755+0000 7f81fd181740 1 -- start start 2024-04-24T23:05:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.755+0000 7f81f3400640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 0x7f81d006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006fd0 tx=0x7f81e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.755+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c5bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81fd181740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 0x55cc67c77680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81fd181740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cc67b30ed0 con 0x55cc67c78fc0 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc67b93df0 con 0x55cc67c5b720 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cc67b3c8d0 con 0x55cc67c31400 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51406/0 (socket says 172.21.15.146:51406) 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 -- 172.21.15.146:0/3031499664 learned_addr learned my addr 172.21.15.146:0/3031499664 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81f3e00640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 0x55cc67c77680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81f3400640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c5bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 -- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 msgr2=0x55cc67c77680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 0x55cc67c77680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 -- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 msgr2=0x55cc67c5bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c5bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81eaa00640 1 -- 172.21.15.146:0/3031499664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc678a82d0 con 0x55cc67c78fc0 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.756+0000 7f81f3e00640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 0x55cc67c77680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:25.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.757+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f81dc035040 tx=0x7f81dc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8cd758dceca0f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.757+0000 7f81e3e00640 1 -- 172.21.15.146:0/3031499664 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037040 con 0x55cc67c78fc0 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.757+0000 7f81e3e00640 1 -- 172.21.15.146:0/3031499664 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc032780 con 0x55cc67c78fc0 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.757+0000 7f81e3e00640 1 -- 172.21.15.146:0/3031499664 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc032b30 con 0x55cc67c78fc0 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- 172.21.15.146:0/3031499664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 msgr2=0x55cc67c79510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f81dc035040 tx=0x7f81dc02c000 comp rx=0 tx=0).stop 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- 172.21.15.146:0/3031499664 shutdown_connections 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c31400 0x55cc67c77680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c79510 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 --2- 172.21.15.146:0/3031499664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c5bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- 172.21.15.146:0/3031499664 >> 172.21.15.146:0/3031499664 conn(0x55cc67c2dd30 msgr2=0x55cc67c76530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- 172.21.15.146:0/3031499664 shutdown_connections 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- 172.21.15.146:0/3031499664 wait complete. 2024-04-24T23:05:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.758+0000 7f81fd181740 1 -- start start 2024-04-24T23:05:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.759+0000 7f81fd181740 1 Processor -- start 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c6f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c5dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cc67b4fd20 con 0x55cc67c5b720 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc67b8fdb0 con 0x55cc67c78fc0 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cc67c321a0 con 0x55cc67c58220 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81fd181740 10 client.0 _ll_register_callbacks cb 0x55cc67b8af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51408/0 (socket says 172.21.15.146:51408) 2024-04-24T23:05:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 -- 172.21.15.146:0/2183507991 learned_addr learned my addr 172.21.15.146:0/2183507991 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 -- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 msgr2=0x55cc67c5dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c5dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 -- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 msgr2=0x55cc67c6f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c6f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.760+0000 7f81f3400640 1 -- 172.21.15.146:0/2183507991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc679726b0 con 0x55cc67c5b720 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81f3400640 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f81e400efe0 tx=0x7f81e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd88625fb3c6b16b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400f040 con 0x55cc67c5b720 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f81e4015da0 con 0x55cc67c5b720 2024-04-24T23:05:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81dc032780 con 0x55cc67c5b720 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f81e4005990 con 0x55cc67c5b720 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81fd181740 10 client.6462 fetch_fsmap learned FSMap version 39 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55cc67c5f7c0 con 0x55cc67c5b720 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.761+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc032780 con 0x55cc67c5b720 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f81e4030080 con 0x55cc67c5b720 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 10 client.6462 fetch_fsmap finished waiting for FSMap version 39 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 10 client.6462 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 20 client.6462 populate_metadata read hostname 'smithi146' 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67c8a390 0x55cc67c94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 4 client.6462 mds_command: new command op to 6078 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 --> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc67ba1330 con 0x55cc67c8a390 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81eaa00640 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67c8a390 0x55cc67c94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81eaa00640 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67c8a390 0x55cc67c94fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f139045a67b95b3b server_cookie=e3e4aca4e475d0f2 in_seq=0 out_seq=0 2024-04-24T23:05:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.762+0000 7f81e0c00640 10 client.6462 ms_handle_connect on v2:172.21.15.146:6833/3630709161 2024-04-24T23:05:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.763+0000 7f81e0c00640 1 -- 172.21.15.146:0/2183507991 <== mds.0 v2:172.21.15.146:6833/3630709161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cc67ba1330 con 0x55cc67c8a390 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.763+0000 7f81e0c00640 10 client.6462 handle_command_reply: tid=0 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.763+0000 7f81fd181740 1 client.6462 shutdown 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 msgr2=0x55cc67c5ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f81e400efe0 tx=0x7f81e4004730 comp rx=0 tx=0).stop 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 shutdown_connections 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67c8a390 0x55cc67c94fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c5dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c6f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 --2- 172.21.15.146:0/2183507991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5ecb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81e0c00640 0 client.6462 ms_handle_reset on v2:172.21.15.146:6833/3630709161 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 >> 172.21.15.146:0/2183507991 conn(0x55cc67c31400 msgr2=0x55cc67c75cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 shutdown_connections 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 1 -- 172.21.15.146:0/2183507991 wait complete. 2024-04-24T23:05:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.764+0000 7f81fd181740 20 client.6462 trim_cache size 0 max 16384 2024-04-24T23:05:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.783+0000 7f81fd181740 1 Processor -- start 2024-04-24T23:05:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 -- start start 2024-04-24T23:05:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c30630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81f41ffc20 con 0x55cc67c5b720 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4157130 con 0x55cc67c78fc0 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.784+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f81f41ff600 con 0x55cc67c58220 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51424/0 (socket says 172.21.15.146:51424) 2024-04-24T23:05:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 -- 172.21.15.146:0/3218930879 learned_addr learned my addr 172.21.15.146:0/3218930879 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81f3400640 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 -- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 msgr2=0x55cc67c6e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81f3e00640 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c30630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c6e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 -- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 msgr2=0x55cc67c30630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c30630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 -- 172.21.15.146:0/3218930879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc67c2b680 con 0x55cc67c5b720 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.785+0000 7f81eaa00640 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f81dc02a840 tx=0x7f81dc03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51568eecce29f18a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81e3400640 1 -- 172.21.15.146:0/3218930879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037040 con 0x55cc67c5b720 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81e3400640 1 -- 172.21.15.146:0/3218930879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc04a070 con 0x55cc67c5b720 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81e3400640 1 -- 172.21.15.146:0/3218930879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc032980 con 0x55cc67c5b720 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 -- 172.21.15.146:0/3218930879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 msgr2=0x55cc67c5a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f81dc02a840 tx=0x7f81dc03b000 comp rx=0 tx=0).stop 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 -- 172.21.15.146:0/3218930879 shutdown_connections 2024-04-24T23:05:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c78fc0 0x55cc67c30630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c5b720 0x55cc67c5a950 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 --2- 172.21.15.146:0/3218930879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c6e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 -- 172.21.15.146:0/3218930879 >> 172.21.15.146:0/3218930879 conn(0x55cc67c31400 msgr2=0x55cc67c26d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 -- 172.21.15.146:0/3218930879 shutdown_connections 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.786+0000 7f81fd181740 1 -- 172.21.15.146:0/3218930879 wait complete. 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.787+0000 7f81fd181740 1 -- start start 2024-04-24T23:05:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.787+0000 7f81fd181740 1 Processor -- start 2024-04-24T23:05:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c79470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cc67c5e520 con 0x55cc67c78fc0 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc67c5faa0 con 0x55cc67c5b720 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55cc67c6dd50 con 0x55cc67c58220 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81fd181740 10 client.0 _ll_register_callbacks cb 0x7f81e4009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.788+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51440/0 (socket says 172.21.15.146:51440) 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 -- 172.21.15.146:0/1848234736 learned_addr learned my addr 172.21.15.146:0/1848234736 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3400640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c79470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81eaa00640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 -- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 msgr2=0x55cc67c79470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c79470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 -- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 msgr2=0x55cc67c799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c799b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 -- 172.21.15.146:0/1848234736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc67c6e420 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3400640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c79470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81f3e00640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f81ec061450 tx=0x7f81ec058f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccc695a6d0022da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.789+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec087060 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f81ec0616f0 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81dc04a070 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f81ec05c030 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 10 client.6468 fetch_fsmap learned FSMap version 39 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55cc67c9a410 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc04a070 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f81ec004b60 con 0x55cc67c78fc0 2024-04-24T23:05:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 10 client.6468 fetch_fsmap finished waiting for FSMap version 39 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 10 client.6468 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 20 client.6468 populate_metadata read hostname 'smithi146' 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67cefca0 0x55cc67cf0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 4 client.6468 mds_command: new command op to 6078 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 --> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] -- command(tid 0: {"prefix": "status"}) -- 0x55cc67b9b680 con 0x55cc67cefca0 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.790+0000 7f81f3400640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67cefca0 0x55cc67cf0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81f3400640 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67cefca0 0x55cc67cf0080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bdba583b33124db server_cookie=ea911a400e64193e in_seq=0 out_seq=0 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81e0c00640 10 client.6468 ms_handle_connect on v2:172.21.15.146:6833/3630709161 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81e0c00640 1 -- 172.21.15.146:0/1848234736 <== mds.0 v2:172.21.15.146:6833/3630709161 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55cc67b9b680 con 0x55cc67cefca0 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81e0c00640 10 client.6468 handle_command_reply: tid=0 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 client.6468 shutdown 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 msgr2=0x55cc67c84b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f81ec061450 tx=0x7f81ec058f90 comp rx=0 tx=0).stop 2024-04-24T23:05:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 shutdown_connections 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:6833/3630709161,v1:172.21.15.146:6835/3630709161] conn(0x55cc67cefca0 0x55cc67cf0080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc67c78fc0 0x55cc67c84b70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc67c5b720 0x55cc67c799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 --2- 172.21.15.146:0/1848234736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55cc67c58220 0x55cc67c79470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81e0c00640 0 client.6468 ms_handle_reset on v2:172.21.15.146:6833/3630709161 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.791+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 >> 172.21.15.146:0/1848234736 conn(0x55cc67c31400 msgr2=0x55cc67c6f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 shutdown_connections 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81fd181740 1 -- 172.21.15.146:0/1848234736 wait complete. 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81fd181740 20 client.6468 trim_cache size 0 max 16384 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:05:25.797 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6078, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.9079781530000002, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 39, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 57, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 57, 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 87.343642506999998 2024-04-24T23:05:25.798 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 msgr2=0x7f81d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 0x7f81d006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006fd0 tx=0x7f81e4008040 comp rx=0 tx=0).stop 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 msgr2=0x7f81f41f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.792+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00cbc0 tx=0x7f81ec00a430 comp rx=0 tx=0).stop 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 shutdown_connections 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f415e010 0x7f81f41f6e60 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f81f40ade00 0x7f81f41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 --2- 172.21.15.146:0/972335952 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f81f4072380 0x7f81f41f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 >> 172.21.15.146:0/972335952 conn(0x7f81f40b1560 msgr2=0x7f81f40af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 shutdown_connections 2024-04-24T23:05:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.793+0000 7f81f8e00640 1 -- 172.21.15.146:0/972335952 wait complete. 2024-04-24T23:05:25.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:05:25.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.988+0000 7fc449a00640 1 Processor -- start 2024-04-24T23:05:25.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.988+0000 7fc449a00640 1 -- start start 2024-04-24T23:05:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc4440cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 0x7fc44415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4440cfb30 0x7fc4440cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc4440b4310 con 0x7fc4440cfb30 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc4440d04e0 con 0x7fc4440709d0 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc4441565a0 con 0x7fc4441561c0 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4440cfb30 0x7fc4440cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4440cfb30 0x7fc4440cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51444/0 (socket says 172.21.15.146:51444) 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 -- 172.21.15.146:0/772208329 learned_addr learned my addr 172.21.15.146:0/772208329 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc43b400640 1 --2- 172.21.15.146:0/772208329 >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 0x7fc44415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc443e00640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc4440cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 -- 172.21.15.146:0/772208329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 msgr2=0x7fc4440cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc4440cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 -- 172.21.15.146:0/772208329 >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 msgr2=0x7fc44415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 --2- 172.21.15.146:0/772208329 >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 0x7fc44415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc449000640 1 -- 172.21.15.146:0/772208329 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc444070f90 con 0x7fc4440cfb30 2024-04-24T23:05:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.990+0000 7fc43b400640 1 --2- 172.21.15.146:0/772208329 >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 0x7fc44415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:05:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.991+0000 7fc449000640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc4440cffa0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc444067d20 tx=0x7fc43c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abbee3de53cf4ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc443400640 1 -- 172.21.15.146:0/772208329 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c036070 con 0x7fc4440cfb30 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc443400640 1 -- 172.21.15.146:0/772208329 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c031600 con 0x7fc4440cfb30 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc443400640 1 -- 172.21.15.146:0/772208329 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0319d0 con 0x7fc4440cfb30 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 -- 172.21.15.146:0/772208329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 msgr2=0x7fc4440cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc4440cffa0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc444067d20 tx=0x7fc43c02a570 comp rx=0 tx=0).stop 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 -- 172.21.15.146:0/772208329 shutdown_connections 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc4440cffa0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 --2- 172.21.15.146:0/772208329 >> v2:172.21.15.203:3300/0 conn(0x7fc4440709d0 0x7fc44415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 --2- 172.21.15.146:0/772208329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc4440cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 -- 172.21.15.146:0/772208329 >> 172.21.15.146:0/772208329 conn(0x7fc44406b320 msgr2=0x7fc44406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 -- 172.21.15.146:0/772208329 shutdown_connections 2024-04-24T23:05:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.992+0000 7fc449a00640 1 -- 172.21.15.146:0/772208329 wait complete. 2024-04-24T23:05:25.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.994+0000 7fc449a00640 1 Processor -- start 2024-04-24T23:05:25.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.994+0000 7fc449a00640 1 -- start start 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4440709d0 0x7fc4441f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc44414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc444071830 con 0x7fc4440cfb30 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc444071550 con 0x7fc4440709d0 2024-04-24T23:05:25.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc449a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc4440b2c20 con 0x7fc4441561c0 2024-04-24T23:05:25.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc43b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc43b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51458/0 (socket says 172.21.15.146:51458) 2024-04-24T23:05:25.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.995+0000 7fc43b400640 1 -- 172.21.15.146:0/1459601692 learned_addr learned my addr 172.21.15.146:0/1459601692 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 -- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 msgr2=0x7fc44414f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc449000640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc44414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc443e00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4440709d0 0x7fc4441f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc44414f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 -- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4440709d0 msgr2=0x7fc4441f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4440709d0 0x7fc4441f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 -- 172.21.15.146:0/1459601692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4441f5460 con 0x7fc4440cfb30 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc43b400640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c7f0 tx=0x7fc42c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c015070 con 0x7fc4440cfb30 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c007a30 con 0x7fc4440cfb30 2024-04-24T23:05:25.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c007e00 con 0x7fc4440cfb30 2024-04-24T23:05:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.996+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4441f5740 con 0x7fc4440cfb30 2024-04-24T23:05:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.997+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44414bfb0 con 0x7fc4440cfb30 2024-04-24T23:05:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.998+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44404f500 con 0x7fc4440cfb30 2024-04-24T23:05:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:25.999+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc42c018070 con 0x7fc4440cfb30 2024-04-24T23:05:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.000+0000 7fc440c00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 0x7fc42006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:05:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.000+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fc42c08b060 con 0x7fc4440cfb30 2024-04-24T23:05:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.001+0000 7fc443e00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 0x7fc42006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:05:26.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.002+0000 7fc443e00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 0x7fc42006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b740 tx=0x7fc434008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:05:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.005+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc42c059800 con 0x7fc4440cfb30 2024-04-24T23:05:26.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.221+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4440ce780 con 0x7fc4440cfb30 2024-04-24T23:05:26.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.222+0000 7fc440c00640 1 -- 172.21.15.146:0/1459601692 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7fc42c059100 con 0x7fc4440cfb30 2024-04-24T23:05:26.224 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.224+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 msgr2=0x7fc42006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 0x7fc42006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b740 tx=0x7fc434008040 comp rx=0 tx=0).stop 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 msgr2=0x7fc44414a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c7f0 tx=0x7fc42c00cbf0 comp rx=0 tx=0).stop 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 shutdown_connections 2024-04-24T23:05:26.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc42006be30 0x7fc42006e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc4441561c0 0x7fc44414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4440cfb30 0x7fc44414a000 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 --2- 172.21.15.146:0/1459601692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4440709d0 0x7fc4441f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 >> 172.21.15.146:0/1459601692 conn(0x7fc44406b320 msgr2=0x7fc44406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 shutdown_connections 2024-04-24T23:05:26.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26.225+0000 7fc449a00640 1 -- 172.21.15.146:0/1459601692 wait complete. 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:05:26.244 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:05:26.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.245 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:05:26.292 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42309sec preferred_lft 42309sec 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:05:26.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:05:26.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:05:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:05:26.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:05:26.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.296 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:05:26.368 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:05:26.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.371 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:05:26.421 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:05:26.421 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:05:26.421 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:05:26.421 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:05:26.422 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:05:26.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:05:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:05:26.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.633 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:05:26.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:05:26.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:05:26.677 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:05:26.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:05:26.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:05:26.806 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:26.859 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:05:26.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:05:26.859 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:26.909 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:05:26.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:26.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:05:27.037 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:05:27.038 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:05:27.074 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:05:27.074 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:05:27.074 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:05:27.074 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:05:27.074 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:05:27.076 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:05:27.077 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:05:27.077 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:05:27.077 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:05:27.077 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:05:27.083 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:05:27.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:05:27.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:27.157 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:05:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:05:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:05:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:05:27.269 INFO:teuthology.orchestra.run.smithi146.stdout:client5248 2024-04-24T23:05:27.270 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:05:27.270 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:05:27.317 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:05:27.317 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T23:05:27.317 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:27.414 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-24 23:03:55.042859729 +0000 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-24 23:03:55.042859729 +0000 2024-04-24T23:05:27.415 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-24 23:02:25.203266452 +0000 2024-04-24T23:05:27.415 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-24T23:05:27.416 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-24T23:05:27.509 INFO:tasks.workunit:timeout=1h 2024-04-24T23:05:27.509 INFO:tasks.workunit:cleanup=True 2024-04-24T23:05:27.510 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:05:27.570 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T23:05:44.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:44.851 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:15.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:15.010 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:43.606 INFO:tasks.workunit.client.0.smithi146.stderr:Updating files: 65% (8209/12492) Updating files: 66% (8245/12492) Updating files: 67% (8370/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 70% (8745/12492) Updating files: 71% (8870/12492) Updating files: 72% (8995/12492) Updating files: 73% (9120/12492) Updating files: 74% (9245/12492) Updating files: 75% (9369/12492) Updating files: 76% (9494/12492) Updating files: 77% (9619/12492) Updating files: 78% (9744/12492) Updating files: 79% (9869/12492) Updating files: 80% (9994/12492) Updating files: 81% (10119/12492) Updating files: 82% (10244/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 85% (10619/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 88% (10993/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.290 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr: 2024-04-24T23:06:44.291 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-24T23:06:44.299 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T23:06:44.350 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T23:06:44.356 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:06:44.357 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T23:06:44.447 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T23:06:44.543 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T23:06:44.630 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:06:44.635 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:06:44.635 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T23:06:44.716 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:06:44.726 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:06:44.726 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T23:06:44.775 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-04-24T23:06:44.776 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-04-24T23:06:44.776 DEBUG:teuthology.orchestra.run.smithi146:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-04-24T23:06:45.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:45.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:46.810 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T23:06:46.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T23:06:46.911 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-04-24T23:06:46.911 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T23:06:47.991 DEBUG:teuthology.parallel:result is None 2024-04-24T23:06:47.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:06:48.079 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:06:48.079 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:06:48.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:06:48.187 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:06:48.305 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:06:48.305 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:06:48.305 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:06:48.305 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:06:48.360 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:06:48.360 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:06:48.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:06:48.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.662+0000 7fb1cac00640 1 Processor -- start 2024-04-24T23:06:48.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.662+0000 7fb1cac00640 1 -- start start 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1cac00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb1c4145640 0x7fb1c415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1cac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 0x7fb1c40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1cac00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40cdf70 con 0x7fb1c40b2a20 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1cac00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c415d360 con 0x7fb1c4145640 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1cac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c4145a20 con 0x7fb1c40d03a0 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1bb400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1c40b2a20 0x7fb1c40cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51922/0 (socket says 172.21.15.146:51922) 2024-04-24T23:06:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.664+0000 7fb1bb400640 1 -- 172.21.15.146:0/2819464663 learned_addr learned my addr 172.21.15.146:0/2819464663 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c8c00640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 0x7fb1c40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/2819464663 >> v2:172.21.15.203:3300/0 conn(0x7fb1c4145640 0x7fb1c415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638377340 0 0) 0x7fb1c40cdf70 con 0x7fb1c40b2a20 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1a8003520 con 0x7fb1c40b2a20 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2463549268 0 0) 0x7fb1a8003520 con 0x7fb1c40b2a20 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 msgr2=0x7fb1c40ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 0x7fb1c40ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 >> v2:172.21.15.203:3300/0 conn(0x7fb1c4145640 msgr2=0x7fb1c415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 --2- 172.21.15.146:0/2819464663 >> v2:172.21.15.203:3300/0 conn(0x7fb1c4145640 0x7fb1c415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c406d140 con 0x7fb1c40b2a20 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb1ac001690 con 0x7fb1c40b2a20 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.665+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 >> v1:172.21.15.146:6789/0 conn(0x7fb1c40b2a20 legacy=0x7fb1c40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a80039b0 0x7fb1a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a8004800 0x7fb1a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 0x7fb1a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c415d360 con 0x7fb1a8004800 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4145a20 con 0x7fb1a80039b0 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a800b9c0 con 0x7fb1c40d03a0 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a8004800 0x7fb1a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a80039b0 0x7fb1a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 -- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 msgr2=0x7fb1a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:48.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c40d03a0 0x7fb1a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 -- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a80039b0 msgr2=0x7fb1a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:48.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a80039b0 0x7fb1a8003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.666+0000 7fb1bb400640 1 -- 172.21.15.146:0/2819464663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a8003520 con 0x7fb1a8004800 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.667+0000 7fb1bb400640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a8004800 0x7fb1a8004c80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c210 tx=0x7fb1a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96feda590f690f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac007d60 con 0x7fb1a8004800 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac005af0 con 0x7fb1a8004800 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1c3400640 1 -- 172.21.15.146:0/2819464663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac007070 con 0x7fb1a8004800 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1cac00640 1 -- 172.21.15.146:0/2819464663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a8004800 msgr2=0x7fb1a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1cac00640 1 --2- 172.21.15.146:0/2819464663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a8004800 0x7fb1a8004c80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c210 tx=0x7fb1a8005830 comp rx=0 tx=0).stop 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1c8c00640 1 -- 172.21.15.146:0/2819464663 reap_dead start 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1cac00640 1 -- 172.21.15.146:0/2819464663 shutdown_connections 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1cac00640 1 -- 172.21.15.146:0/2819464663 >> 172.21.15.146:0/2819464663 conn(0x7fb1c406b320 msgr2=0x7fb1c406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.668+0000 7fb1cac00640 1 -- 172.21.15.146:0/2819464663 shutdown_connections 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.669+0000 7fb1cac00640 1 -- 172.21.15.146:0/2819464663 wait complete. 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.670+0000 7fb1cac00640 1 Processor -- start 2024-04-24T23:06:48.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.670+0000 7fb1cac00640 1 -- start start 2024-04-24T23:06:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a8004800 0x7fb1c41f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c415ba70 0x7fb1c4138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c406d9e0 con 0x7fb1c41f12d0 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c406d700 con 0x7fb1a8004800 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.671+0000 7fb1cac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c406cbc0 con 0x7fb1c415ba70 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54172/0 (socket says 172.21.15.146:54172) 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 -- 172.21.15.146:0/3323386773 learned_addr learned my addr 172.21.15.146:0/3323386773 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a8004800 0x7fb1c41f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 -- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c415ba70 msgr2=0x7fb1c4138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c415ba70 0x7fb1c4138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 -- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a8004800 msgr2=0x7fb1c41f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a8004800 0x7fb1c41f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 -- 172.21.15.146:0/3323386773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c415bf80 con 0x7fb1c41f12d0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.672+0000 7fb1bb400640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac02ae20 tx=0x7fb1c406d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.673+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac042070 con 0x7fb1c41f12d0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.673+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac0074c0 con 0x7fb1c41f12d0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.673+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c415c260 con 0x7fb1c41f12d0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.673+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac001ca0 con 0x7fb1c41f12d0 2024-04-24T23:06:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.673+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c4136d30 con 0x7fb1c41f12d0 2024-04-24T23:06:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.674+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4068190 con 0x7fb1c41f12d0 2024-04-24T23:06:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.675+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1ac045070 con 0x7fb1c41f12d0 2024-04-24T23:06:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.676+0000 7fb1c0c00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 0x7fb1a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.676+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fb1ac0ab930 con 0x7fb1c41f12d0 2024-04-24T23:06:48.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.676+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 0x7fb1a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:48.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.677+0000 7fb1c3e00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 0x7fb1a006e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4003a50 tx=0x7fb1b400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.681+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb1ac07a040 con 0x7fb1c41f12d0 2024-04-24T23:06:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.864+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1c406b7d0 con 0x7fb1c41f12d0 2024-04-24T23:06:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.866+0000 7fb1c0c00640 1 -- 172.21.15.146:0/3323386773 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17085 (secure 0 0 0) 0x7fb1ac079940 con 0x7fb1c41f12d0 2024-04-24T23:06:48.867 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:03:58.364830+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.5","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/1456962778":"2024-04-25T23:03:58.364770+0000","172.21.15.146:6833/1456962778":"2024-04-25T23:03:58.364770+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 msgr2=0x7fb1a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 0x7fb1a006e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4003a50 tx=0x7fb1b400b040 comp rx=0 tx=0).stop 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 msgr2=0x7fb1c415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac02ae20 tx=0x7fb1c406d310 comp rx=0 tx=0).stop 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 shutdown_connections 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1a006be30 0x7fb1a006e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1c415ba70 0x7fb1c4138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.868+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c41f12d0 0x7fb1c415b530 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.869+0000 7fb1cac00640 1 --2- 172.21.15.146:0/3323386773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1a8004800 0x7fb1c41f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:48.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.869+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 >> 172.21.15.146:0/3323386773 conn(0x7fb1c406b320 msgr2=0x7fb1c40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:48.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.869+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 shutdown_connections 2024-04-24T23:06:48.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:48.869+0000 7fb1cac00640 1 -- 172.21.15.146:0/3323386773 wait complete. 2024-04-24T23:06:48.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:02:22.460061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:02:23.670988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:06:48.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:06:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.084+0000 7f97de800640 1 Processor -- start 2024-04-24T23:06:49.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.085+0000 7f97de800640 1 -- start start 2024-04-24T23:06:49.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.086+0000 7f97de800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97d815c1d0 0x7f97d80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.086+0000 7f97de800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d80cfa00 0x7f97d80cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.086+0000 7f97de800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d80cd6d0 con 0x7f97d80d0380 2024-04-24T23:06:49.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.086+0000 7f97de800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f97d80b4950 con 0x7f97d815c1d0 2024-04-24T23:06:49.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.086+0000 7f97de800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f97d80d0800 con 0x7f97d80cfa00 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dde00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f97d80d0380 0x7f97d80ce140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51930/0 (socket says 172.21.15.146:51930) 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dde00640 1 -- 172.21.15.146:0/464693761 learned_addr learned my addr 172.21.15.146:0/464693761 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dd400640 1 --2- 172.21.15.146:0/464693761 >> v2:172.21.15.146:3300/0 conn(0x7f97d815c1d0 0x7f97d80cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dca00640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d80cfa00 0x7f97d80cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dd400640 1 -- 172.21.15.146:0/464693761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d80cfa00 msgr2=0x7f97d80cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dd400640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d80cfa00 0x7f97d80cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dd400640 1 -- 172.21.15.146:0/464693761 >> v1:172.21.15.146:6789/0 conn(0x7f97d80d0380 legacy=0x7f97d80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97dd400640 1 -- 172.21.15.146:0/464693761 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d80cd950 con 0x7f97d815c1d0 2024-04-24T23:06:49.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.087+0000 7f97d7e00640 1 -- 172.21.15.146:0/464693761 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777547875 0 0) 0x7f97d0001110 con 0x7f97d80d0380 2024-04-24T23:06:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.088+0000 7f97dd400640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d815c1d0 0x7f97d80cd190 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c284a1b41c5686 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.088+0000 7f97d7e00640 1 -- 172.21.15.146:0/464693761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8007740 con 0x7f97d815c1d0 2024-04-24T23:06:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.088+0000 7f97d7e00640 1 -- 172.21.15.146:0/464693761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c80078e0 con 0x7f97d815c1d0 2024-04-24T23:06:49.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.088+0000 7f97d7e00640 1 -- 172.21.15.146:0/464693761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8007cb0 con 0x7f97d815c1d0 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 -- 172.21.15.146:0/464693761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d815c1d0 msgr2=0x7f97d80cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d815c1d0 0x7f97d80cd190 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c802a6f0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 -- 172.21.15.146:0/464693761 shutdown_connections 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d80cfa00 0x7f97d80cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 --2- 172.21.15.146:0/464693761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d815c1d0 0x7f97d80cd190 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 -- 172.21.15.146:0/464693761 >> 172.21.15.146:0/464693761 conn(0x7f97d80d1b00 msgr2=0x7f97d80d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 -- 172.21.15.146:0/464693761 shutdown_connections 2024-04-24T23:06:49.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.089+0000 7f97de800640 1 -- 172.21.15.146:0/464693761 wait complete. 2024-04-24T23:06:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.091+0000 7f97de800640 1 Processor -- start 2024-04-24T23:06:49.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.091+0000 7f97de800640 1 -- start start 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d80d0380 0x7f97d81f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d815c1d0 0x7f97d815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97d80b5160 con 0x7f97d80cfa00 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f97d80b4e80 con 0x7f97d80d0380 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97de800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f97d815c5b0 con 0x7f97d815c1d0 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97dd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97dd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54184/0 (socket says 172.21.15.146:54184) 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.092+0000 7f97dd400640 1 -- 172.21.15.146:0/385596974 learned_addr learned my addr 172.21.15.146:0/385596974 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:49.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 -- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d815c1d0 msgr2=0x7f97d815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d815c1d0 0x7f97d815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 -- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d80d0380 msgr2=0x7f97d81f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dca00640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d80d0380 0x7f97d81f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d80d0380 0x7f97d81f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 -- 172.21.15.146:0/385596974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d80c6160 con 0x7f97d80cfa00 2024-04-24T23:06:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97dd400640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f97c802ace0 tx=0x7f97c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c803f070 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c8031bc0 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.093+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8043410 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.094+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d80c9110 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.094+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d815f540 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.095+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d804f500 con 0x7f97d80cfa00 2024-04-24T23:06:49.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.096+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97c80435b0 con 0x7f97d80cfa00 2024-04-24T23:06:49.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.097+0000 7f97d5600640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.097+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f97c80ac4e0 con 0x7f97d80cfa00 2024-04-24T23:06:49.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.097+0000 7f97dca00640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.099+0000 7f97dca00640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 0x7f97b806e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f97d80c49a0 tx=0x7f97c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.101+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f97d80c6160 con 0x7f97d80cfa00 2024-04-24T23:06:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.306+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97d806ef80 con 0x7f97d80cfa00 2024-04-24T23:06:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.307+0000 7f97d5600640 1 -- 172.21.15.146:0/385596974 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7f97c807ac80 con 0x7f97d80cfa00 2024-04-24T23:06:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.309+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 msgr2=0x7f97b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.309+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 0x7f97b806e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f97d80c49a0 tx=0x7f97c4008040 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.309+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 msgr2=0x7f97d80c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.309+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f97c802ace0 tx=0x7f97c8004a40 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 shutdown_connections 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97d815c1d0 0x7f97d815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d80d0380 0x7f97d81f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 --2- 172.21.15.146:0/385596974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97d80cfa00 0x7f97d80c8bd0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 >> 172.21.15.146:0/385596974 conn(0x7f97d80d1b00 msgr2=0x7f97d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 shutdown_connections 2024-04-24T23:06:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.310+0000 7f97de800640 1 -- 172.21.15.146:0/385596974 wait complete. 2024-04-24T23:06:49.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:06:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.536+0000 7f686be00640 1 Processor -- start 2024-04-24T23:06:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.536+0000 7f686be00640 1 -- start start 2024-04-24T23:06:49.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.537+0000 7f686be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f686c15bcd0 0x7f686c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c0b4df0 con 0x7f686c15cd60 2024-04-24T23:06:49.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c0b4b10 con 0x7f686c0d03d0 2024-04-24T23:06:49.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f686c15c8d0 con 0x7f686c15bcd0 2024-04-24T23:06:49.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f6862000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f686c15cd60 0x7f686c0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51934/0 (socket says 172.21.15.146:51934) 2024-04-24T23:06:49.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f6862000640 1 -- 172.21.15.146:0/1112087242 learned_addr learned my addr 172.21.15.146:0/1112087242 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686aa00640 1 --2- 172.21.15.146:0/1112087242 >> v2:172.21.15.203:3300/0 conn(0x7f686c15bcd0 0x7f686c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159142179 0 0) 0x7f686c0b4df0 con 0x7f686c15cd60 2024-04-24T23:06:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.538+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6850003520 con 0x7f686c15cd60 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2882679583 0 0) 0x7f6850003520 con 0x7f686c15cd60 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 >> v2:172.21.15.203:3300/0 conn(0x7f686c15bcd0 msgr2=0x7f686c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 --2- 172.21.15.146:0/1112087242 >> v2:172.21.15.203:3300/0 conn(0x7f686c15bcd0 0x7f686c0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 >> v1:172.21.15.203:6789/0 conn(0x7f686c0d03d0 legacy=0x7f686c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c15c280 con 0x7f686c15cd60 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6854001690 con 0x7f686c15cd60 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 >> v1:172.21.15.146:6789/0 conn(0x7f686c15cd60 legacy=0x7f686c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68500039b0 0x7f6850003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6850004800 0x7f6850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 0x7f685000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15c8d0 con 0x7f68500051c0 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f685000c060 con 0x7f68500039b0 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f685000c260 con 0x7f6850004800 2024-04-24T23:06:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.539+0000 7f686b400640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 0x7f685000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686aa00640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68500039b0 0x7f6850003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f6862000640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6850004800 0x7f6850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686b400640 1 -- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6850004800 msgr2=0x7f6850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686b400640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6850004800 0x7f6850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686b400640 1 -- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68500039b0 msgr2=0x7f6850003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686b400640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68500039b0 0x7f6850003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f686b400640 1 -- 172.21.15.146:0/1112087242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6850003520 con 0x7f68500051c0 2024-04-24T23:06:49.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.540+0000 7f6862000640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6850004800 0x7f6850004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.541+0000 7f686b400640 1 -- 172.21.15.146:0/1112087242 reap_dead start 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.541+0000 7f686b400640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 0x7f685000b9c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f686c0d0900 tx=0x7f6850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916617b545a71ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.541+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864001a70 con 0x7f68500051c0 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.541+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686402add0 con 0x7f68500051c0 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.541+0000 7f686a000640 1 -- 172.21.15.146:0/1112087242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864003bb0 con 0x7f68500051c0 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 -- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 msgr2=0x7f685000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 0x7f685000b9c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f686c0d0900 tx=0x7f6850005830 comp rx=0 tx=0).stop 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 -- 172.21.15.146:0/1112087242 shutdown_connections 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 --2- 172.21.15.146:0/1112087242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68500051c0 0x7f685000b9c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 -- 172.21.15.146:0/1112087242 >> 172.21.15.146:0/1112087242 conn(0x7f686c06b560 msgr2=0x7f686c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 -- 172.21.15.146:0/1112087242 shutdown_connections 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.542+0000 7f686be00640 1 -- 172.21.15.146:0/1112087242 wait complete. 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.544+0000 7f686be00640 1 Processor -- start 2024-04-24T23:06:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.544+0000 7f686be00640 1 -- start start 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68500051c0 0x7f686c141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c0c9190 0x7f686c152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f686c0b4790 con 0x7f686c142380 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f686c06e590 con 0x7f686c0c9190 2024-04-24T23:06:49.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f686be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f686c0cfcc0 con 0x7f68500051c0 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f6862000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f6862000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54190/0 (socket says 172.21.15.146:54190) 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.545+0000 7f6862000640 1 -- 172.21.15.146:0/476572537 learned_addr learned my addr 172.21.15.146:0/476572537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f686aa00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68500051c0 0x7f686c141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 -- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68500051c0 msgr2=0x7f686c141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68500051c0 0x7f686c141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 -- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c0c9190 msgr2=0x7f686c152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c0c9190 0x7f686c152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 -- 172.21.15.146:0/476572537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c1427e0 con 0x7f686c142380 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6862000640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f685400d800 tx=0x7f685400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854019070 con 0x7f686c142380 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540074e0 con 0x7f686c142380 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540049e0 con 0x7f686c142380 2024-04-24T23:06:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.546+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c153b50 con 0x7f686c142380 2024-04-24T23:06:49.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.547+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c0cb060 con 0x7f686c142380 2024-04-24T23:06:49.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.548+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c0c95b0 con 0x7f686c142380 2024-04-24T23:06:49.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.549+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6854004b80 con 0x7f686c142380 2024-04-24T23:06:49.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.550+0000 7f6863400640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 0x7f684806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.550+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f685408aa40 con 0x7f686c142380 2024-04-24T23:06:49.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.550+0000 7f686aa00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 0x7f684806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.552+0000 7f686aa00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 0x7f684806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f685c0098d0 tx=0x7f685c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.554+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6854059280 con 0x7f686c142380 2024-04-24T23:06:49.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.749+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f686c0cf030 con 0x7f686c142380 2024-04-24T23:06:49.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.750+0000 7f6863400640 1 -- 172.21.15.146:0/476572537 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) ==== 104+0+11 (secure 0 0 0) 0x7f685408ae20 con 0x7f686c142380 2024-04-24T23:06:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:06:49.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 msgr2=0x7f684806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 0x7f684806e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f685c0098d0 tx=0x7f685c008040 comp rx=0 tx=0).stop 2024-04-24T23:06:49.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 msgr2=0x7f686c0c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f685400d800 tx=0x7f685400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 shutdown_connections 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f686c0c9190 0x7f686c152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f686c142380 0x7f686c0c8c50 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f684806be30 0x7f684806e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 --2- 172.21.15.146:0/476572537 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68500051c0 0x7f686c141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 >> 172.21.15.146:0/476572537 conn(0x7f686c06b560 msgr2=0x7f686c070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 shutdown_connections 2024-04-24T23:06:49.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.753+0000 7f686be00640 1 -- 172.21.15.146:0/476572537 wait complete. 2024-04-24T23:06:49.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:06:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.972+0000 7fe2aae00640 1 Processor -- start 2024-04-24T23:06:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.972+0000 7fe2aae00640 1 -- start start 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2aae00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe2a4155460 0x7fe2a415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2aae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 0x7fe2a406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2aae00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a40b3250 con 0x7fe2a406e870 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2aae00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a40723f0 con 0x7fe2a4155460 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2aae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a406eca0 con 0x7fe2a40b2ab0 2024-04-24T23:06:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2a8e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe2a406e870 0x7fe2a415e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51940/0 (socket says 172.21.15.146:51940) 2024-04-24T23:06:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.974+0000 7fe2a8e00640 1 -- 172.21.15.146:0/1502427670 learned_addr learned my addr 172.21.15.146:0/1502427670 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/1502427670 >> v2:172.21.15.203:3300/0 conn(0x7fe2a4155460 0x7fe2a415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a3400640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 0x7fe2a406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994153200 0 0) 0x7fe2a40b3250 con 0x7fe2a406e870 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe288003520 con 0x7fe2a406e870 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1869805352 0 0) 0x7fe288003520 con 0x7fe2a406e870 2024-04-24T23:06:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 msgr2=0x7fe2a406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 0x7fe2a406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 >> v2:172.21.15.203:3300/0 conn(0x7fe2a4155460 msgr2=0x7fe2a415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 --2- 172.21.15.146:0/1502427670 >> v2:172.21.15.203:3300/0 conn(0x7fe2a4155460 0x7fe2a415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a40b3530 con 0x7fe2a406e870 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe29c001670 con 0x7fe2a406e870 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 >> v1:172.21.15.146:6789/0 conn(0x7fe2a406e870 legacy=0x7fe2a415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2880039b0 0x7fe288003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 0x7fe288004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288004d40 0x7fe2880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a406eca0 con 0x7fe2880039b0 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe28800b9c0 con 0x7fe288004d40 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.975+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe28800bb40 con 0x7fe2a40b2ab0 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2880039b0 0x7fe288003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 -- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 msgr2=0x7fe288004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a40b2ab0 0x7fe288004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 -- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288004d40 msgr2=0x7fe2880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe288004d40 0x7fe2880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.976+0000 7fe2a3e00640 1 -- 172.21.15.146:0/1502427670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe288003520 con 0x7fe2880039b0 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.977+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2880039b0 0x7fe288003dd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe29400e170 tx=0x7fe288005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6956673daa01412 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.977+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294034020 con 0x7fe2880039b0 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe294030430 con 0x7fe2880039b0 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2a2a00640 1 -- 172.21.15.146:0/1502427670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294009c10 con 0x7fe2880039b0 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 -- 172.21.15.146:0/1502427670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2880039b0 msgr2=0x7fe288003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 --2- 172.21.15.146:0/1502427670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2880039b0 0x7fe288003dd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe29400e170 tx=0x7fe288005830 comp rx=0 tx=0).stop 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2a8e00640 1 -- 172.21.15.146:0/1502427670 reap_dead start 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 -- 172.21.15.146:0/1502427670 shutdown_connections 2024-04-24T23:06:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 -- 172.21.15.146:0/1502427670 >> 172.21.15.146:0/1502427670 conn(0x7fe2a40b17b0 msgr2=0x7fe2a40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 -- 172.21.15.146:0/1502427670 shutdown_connections 2024-04-24T23:06:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.978+0000 7fe2aae00640 1 -- 172.21.15.146:0/1502427670 wait complete. 2024-04-24T23:06:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.980+0000 7fe2aae00640 1 Processor -- start 2024-04-24T23:06:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.980+0000 7fe2aae00640 1 -- start start 2024-04-24T23:06:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a4151ad0 0x7fe2a4148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a413e270 0x7fe2a41472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a40b2f60 con 0x7fe2a413f300 2024-04-24T23:06:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4070ec0 con 0x7fe2a413e270 2024-04-24T23:06:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2aae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a40b3af0 con 0x7fe2a4151ad0 2024-04-24T23:06:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2a3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2a3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54222/0 (socket says 172.21.15.146:54222) 2024-04-24T23:06:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.981+0000 7fe2a3400640 1 -- 172.21.15.146:0/2429772792 learned_addr learned my addr 172.21.15.146:0/2429772792 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a4151ad0 0x7fe2a4148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 -- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a4151ad0 msgr2=0x7fe2a4148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a8e00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a413e270 0x7fe2a41472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a4151ad0 0x7fe2a4148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 -- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a413e270 msgr2=0x7fe2a41472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a413e270 0x7fe2a41472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 -- 172.21.15.146:0/2429772792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a415a910 con 0x7fe2a413f300 2024-04-24T23:06:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe2a3400640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e7c0 tx=0x7fe29000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290017070 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29000c940 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.982+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000cd10 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.983+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a415abf0 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.983+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a4146dd0 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.984+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a404f5a0 con 0x7fe2a413f300 2024-04-24T23:06:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.985+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe29001a070 con 0x7fe2a413f300 2024-04-24T23:06:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.986+0000 7fe29be00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 0x7fe28406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.986+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fe29008b390 con 0x7fe2a413f300 2024-04-24T23:06:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.986+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 0x7fe28406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.987+0000 7fe2a3e00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 0x7fe28406e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe294035000 tx=0x7fe29402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:49.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:49.990+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe290059aa0 con 0x7fe2a413f300 2024-04-24T23:06:50.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.189+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2a414d100 con 0x7fe2a413f300 2024-04-24T23:06:50.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.190+0000 7fe29be00640 1 -- 172.21.15.146:0/2429772792 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) ==== 100+0+11 (secure 0 0 0) 0x7fe2900593a0 con 0x7fe2a413f300 2024-04-24T23:06:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:06:50.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 msgr2=0x7fe28406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 0x7fe28406e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe294035000 tx=0x7fe29402f000 comp rx=0 tx=0).stop 2024-04-24T23:06:50.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 msgr2=0x7fe2a413dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e7c0 tx=0x7fe29000ec80 comp rx=0 tx=0).stop 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 shutdown_connections 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a413e270 0x7fe2a41472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2a413f300 0x7fe2a413dd30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe28406be30 0x7fe28406e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 --2- 172.21.15.146:0/2429772792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a4151ad0 0x7fe2a4148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 >> 172.21.15.146:0/2429772792 conn(0x7fe2a40b17b0 msgr2=0x7fe2a40af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 shutdown_connections 2024-04-24T23:06:50.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.193+0000 7fe2aae00640 1 -- 172.21.15.146:0/2429772792 wait complete. 2024-04-24T23:06:50.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:06:50.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.404+0000 7fea2fc00640 1 Processor -- start 2024-04-24T23:06:50.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.404+0000 7fea2fc00640 1 -- start start 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2fc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea28142570 0x7fea2806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2fc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 0x7fea2806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2fc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28142950 con 0x7fea2806d640 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2fc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fea28071c40 con 0x7fea28142570 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2fc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fea28071030 con 0x7fea28070ba0 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea28142570 0x7fea2806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea28142570 0x7fea2806cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54234/0 (socket says 172.21.15.146:54234) 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.406+0000 7fea2d200640 1 -- 172.21.15.146:0/2950849133 learned_addr learned my addr 172.21.15.146:0/2950849133 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea1fe00640 1 --2- 172.21.15.146:0/2950849133 >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 0x7fea2806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea2d200640 1 -- 172.21.15.146:0/2950849133 >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 msgr2=0x7fea2806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea2d200640 1 --2- 172.21.15.146:0/2950849133 >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 0x7fea2806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea2d200640 1 -- 172.21.15.146:0/2950849133 >> v1:172.21.15.203:6789/0 conn(0x7fea2806d640 legacy=0x7fea280ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea2d200640 1 -- 172.21.15.146:0/2950849133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28071310 con 0x7fea28142570 2024-04-24T23:06:50.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.407+0000 7fea1fe00640 1 --2- 172.21.15.146:0/2950849133 >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 0x7fea2806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:50.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.408+0000 7fea2d200640 1 --2- 172.21.15.146:0/2950849133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea28142570 0x7fea2806cbc0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fea2806e970 tx=0x7fea1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab2d4b81a8cf868 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:50.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.408+0000 7fea27e00640 1 -- 172.21.15.146:0/2950849133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18037070 con 0x7fea28142570 2024-04-24T23:06:50.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.408+0000 7fea27e00640 1 -- 172.21.15.146:0/2950849133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea18032440 con 0x7fea28142570 2024-04-24T23:06:50.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.408+0000 7fea27e00640 1 -- 172.21.15.146:0/2950849133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18032810 con 0x7fea28142570 2024-04-24T23:06:50.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 -- 172.21.15.146:0/2950849133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea28142570 msgr2=0x7fea2806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 --2- 172.21.15.146:0/2950849133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea28142570 0x7fea2806cbc0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fea2806e970 tx=0x7fea1802a230 comp rx=0 tx=0).stop 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 -- 172.21.15.146:0/2950849133 shutdown_connections 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 --2- 172.21.15.146:0/2950849133 >> v2:172.21.15.203:3300/0 conn(0x7fea28070ba0 0x7fea2806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 --2- 172.21.15.146:0/2950849133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea28142570 0x7fea2806cbc0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 -- 172.21.15.146:0/2950849133 >> 172.21.15.146:0/2950849133 conn(0x7fea2806b140 msgr2=0x7fea2806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 -- 172.21.15.146:0/2950849133 shutdown_connections 2024-04-24T23:06:50.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.409+0000 7fea2fc00640 1 -- 172.21.15.146:0/2950849133 wait complete. 2024-04-24T23:06:50.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.411+0000 7fea2fc00640 1 Processor -- start 2024-04-24T23:06:50.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.411+0000 7fea2fc00640 1 -- start start 2024-04-24T23:06:50.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 0x7fea280ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea281f25c0 0x7fea280cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea28072c60 con 0x7fea2806d640 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea280718d0 con 0x7fea28142570 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.412+0000 7fea2fc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea28072de0 con 0x7fea281f25c0 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54240/0 (socket says 172.21.15.146:54240) 2024-04-24T23:06:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 -- 172.21.15.146:0/1288838524 learned_addr learned my addr 172.21.15.146:0/1288838524 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:50.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea1fe00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 0x7fea280ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 -- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea281f25c0 msgr2=0x7fea280cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2dc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea281f25c0 0x7fea280cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea281f25c0 0x7fea280cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 -- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 msgr2=0x7fea280ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 0x7fea280ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 -- 172.21.15.146:0/1288838524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280c8910 con 0x7fea2806d640 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea1fe00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 0x7fea280ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.413+0000 7fea2d200640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fea18000c00 tx=0x7fea180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.414+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18041020 con 0x7fea2806d640 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.414+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea18030970 con 0x7fea2806d640 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.414+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea280c8bf0 con 0x7fea2806d640 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.414+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18037040 con 0x7fea2806d640 2024-04-24T23:06:50.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.414+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea280c91b0 con 0x7fea2806d640 2024-04-24T23:06:50.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.415+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2804f5a0 con 0x7fea2806d640 2024-04-24T23:06:50.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.416+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea18044020 con 0x7fea2806d640 2024-04-24T23:06:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.417+0000 7fea25600640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 0x7fea0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.417+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fea180abab0 con 0x7fea2806d640 2024-04-24T23:06:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.418+0000 7fea1fe00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 0x7fea0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.419+0000 7fea1fe00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 0x7fea0406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea10006fd0 tx=0x7fea10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:50.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.422+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fea1804b030 con 0x7fea2806d640 2024-04-24T23:06:50.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.631+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea2806e4f0 con 0x7fea2806d640 2024-04-24T23:06:50.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.632+0000 7fea25600640 1 -- 172.21.15.146:0/1288838524 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v57) ==== 80+0+124 (secure 0 0 0) 0x7fea1807a250 con 0x7fea2806d640 2024-04-24T23:06:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6835/1456962778 2024-04-25T23:03:58.364770+0000 2024-04-24T23:06:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6833/1456962778 2024-04-25T23:03:58.364770+0000 2024-04-24T23:06:50.634 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.634+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 msgr2=0x7fea0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 0x7fea0406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea10006fd0 tx=0x7fea10008040 comp rx=0 tx=0).stop 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 msgr2=0x7fea281f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fea18000c00 tx=0x7fea180046c0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 shutdown_connections 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fea0406be30 0x7fea0406e2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea281f25c0 0x7fea280cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea28142570 0x7fea280ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 --2- 172.21.15.146:0/1288838524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea2806d640 0x7fea281f2080 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 >> 172.21.15.146:0/1288838524 conn(0x7fea2806b140 msgr2=0x7fea2815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 shutdown_connections 2024-04-24T23:06:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:50.635+0000 7fea2fc00640 1 -- 172.21.15.146:0/1288838524 wait complete. 2024-04-24T23:06:50.654 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:06:50.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:06:50.655 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:06:50.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:06:50.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:06:50.765 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:06:50.823 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:06:50.823 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:06:50.823 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:06:50.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:06:50.865 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:06:50.865 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:06:50.865 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:06:50.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:06:50.907 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:06:50.907 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:06:50.907 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:06:50.950 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:06:50.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:06:51.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.144+0000 7fd817e00640 1 Processor -- start 2024-04-24T23:06:51.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.144+0000 7fd817e00640 1 -- start start 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.145+0000 7fd817e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd8180b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd817e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd8180b2dc0 0x7fd8180b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd817e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8180d4bc0 con 0x7fd8180d06e0 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd817e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd8180cf5b0 con 0x7fd8180b2dc0 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd817e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8180d48e0 con 0x7fd81815e5b0 2024-04-24T23:06:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd816a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd8180d06e0 0x7fd81815dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51950/0 (socket says 172.21.15.146:51950) 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd816a00640 1 -- 172.21.15.146:0/1698211811 learned_addr learned my addr 172.21.15.146:0/1698211811 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd817400640 1 --2- 172.21.15.146:0/1698211811 >> v2:172.21.15.203:3300/0 conn(0x7fd8180b2dc0 0x7fd8180b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd8180b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487470329 0 0) 0x7fd8180d4bc0 con 0x7fd8180d06e0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.146+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7fc003520 con 0x7fd8180d06e0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 799861004 0 0) 0x7fd7fc003520 con 0x7fd8180d06e0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 msgr2=0x7fd8180b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd8180b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 >> v2:172.21.15.203:3300/0 conn(0x7fd8180b2dc0 msgr2=0x7fd8180b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 --2- 172.21.15.146:0/1698211811 >> v2:172.21.15.203:3300/0 conn(0x7fd8180b2dc0 0x7fd8180b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180cf850 con 0x7fd8180d06e0 2024-04-24T23:06:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fd808001670 con 0x7fd8180d06e0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd817400640 1 --2- 172.21.15.146:0/1698211811 >> v2:172.21.15.203:3300/0 conn(0x7fd8180b2dc0 0x7fd8180b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd8180b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 >> v1:172.21.15.146:6789/0 conn(0x7fd8180d06e0 legacy=0x7fd81815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd7fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180cf5b0 con 0x7fd7fc004800 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180d48e0 con 0x7fd7fc0039b0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd7fc00bb20 con 0x7fd81815e5b0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.147+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd816a00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd817400640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd7fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd80fe00640 1 -- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 msgr2=0x7fd7fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd81815e5b0 0x7fd7fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd80fe00640 1 -- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7fc0039b0 msgr2=0x7fd7fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.148+0000 7fd80fe00640 1 -- 172.21.15.146:0/1698211811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc003520 con 0x7fd7fc004800 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.149+0000 7fd80fe00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd800006fd0 tx=0x7fd7fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc2b696f1bace20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.149+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80000f040 con 0x7fd7fc004800 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.149+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80002ac70 con 0x7fd7fc004800 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.149+0000 7fd816000640 1 -- 172.21.15.146:0/1698211811 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800004250 con 0x7fd7fc004800 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 -- 172.21.15.146:0/1698211811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7fc004800 msgr2=0x7fd7fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 --2- 172.21.15.146:0/1698211811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7fc004800 0x7fd7fc004c80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd800006fd0 tx=0x7fd7fc005830 comp rx=0 tx=0).stop 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817400640 1 -- 172.21.15.146:0/1698211811 reap_dead start 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 -- 172.21.15.146:0/1698211811 shutdown_connections 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 -- 172.21.15.146:0/1698211811 >> 172.21.15.146:0/1698211811 conn(0x7fd8180d3d20 msgr2=0x7fd8180d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 -- 172.21.15.146:0/1698211811 shutdown_connections 2024-04-24T23:06:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.150+0000 7fd817e00640 1 -- 172.21.15.146:0/1698211811 wait complete. 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.152+0000 7fd817e00640 1 Processor -- start 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.152+0000 7fd817e00640 1 -- start start 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7fc004800 0x7fd8181570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 0x7fd8180b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180d2e40 con 0x7fd8180b66a0 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8180d2cc0 con 0x7fd8180b6b20 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8180d0ac0 con 0x7fd7fc004800 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54250/0 (socket says 172.21.15.146:54250) 2024-04-24T23:06:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 -- 172.21.15.146:0/59252002 learned_addr learned my addr 172.21.15.146:0/59252002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd816a00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7fc004800 0x7fd8181570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd817400640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 0x7fd8180b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 -- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7fc004800 msgr2=0x7fd8181570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7fc004800 0x7fd8181570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 -- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 msgr2=0x7fd8180b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.153+0000 7fd80fe00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 0x7fd8180b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd80fe00640 1 -- 172.21.15.146:0/59252002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81809ec50 con 0x7fd8180b66a0 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd817400640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 0x7fd8180b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd80fe00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd800034040 tx=0x7fd800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800041070 con 0x7fd8180b66a0 2024-04-24T23:06:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80000f000 con 0x7fd8180b66a0 2024-04-24T23:06:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800003c50 con 0x7fd8180b66a0 2024-04-24T23:06:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8180b7090 con 0x7fd8180b66a0 2024-04-24T23:06:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.154+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8180b7650 con 0x7fd8180b66a0 2024-04-24T23:06:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.156+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81809ee20 con 0x7fd8180b66a0 2024-04-24T23:06:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.157+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd800044070 con 0x7fd8180b66a0 2024-04-24T23:06:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.157+0000 7fd80ea00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 0x7fd7f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.158+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fd8000ab680 con 0x7fd8180b66a0 2024-04-24T23:06:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.158+0000 7fd816a00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 0x7fd7f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.159+0000 7fd816a00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 0x7fd7f406e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd8180b9470 tx=0x7fd808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.162+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd80002ae20 con 0x7fd8180b66a0 2024-04-24T23:06:51.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.400+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd81804f500 con 0x7fd8180b66a0 2024-04-24T23:06:51.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.402+0000 7fd80ea00640 1 -- 172.21.15.146:0/59252002 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5195 (secure 0 0 0) 0x7fd800079e30 con 0x7fd8180b66a0 2024-04-24T23:06:51.403 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:23.906529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":24,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6078,"qdb_cluster":[6078]},"id":3}]} 2024-04-24T23:06:51.403 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 msgr2=0x7fd7f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 0x7fd7f406e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd8180b9470 tx=0x7fd808009040 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 msgr2=0x7fd8180b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd800034040 tx=0x7fd800004730 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 shutdown_connections 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8180b6b20 0x7fd8180b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8180b66a0 0x7fd8180b8370 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7f406be60 0x7fd7f406e320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 --2- 172.21.15.146:0/59252002 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7fc004800 0x7fd8181570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 >> 172.21.15.146:0/59252002 conn(0x7fd8180d3d20 msgr2=0x7fd8180b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:51.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 shutdown_connections 2024-04-24T23:06:51.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.405+0000 7fd817e00640 1 -- 172.21.15.146:0/59252002 wait complete. 2024-04-24T23:06:51.425 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:06:51.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.617+0000 7fb69e600640 1 Processor -- start 2024-04-24T23:06:51.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.618+0000 7fb69e600640 1 -- start start 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69e600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6980d06e0 0x7fb6980b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69e600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb69815e5b0 0x7fb6980b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69e600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980d4bc0 con 0x7fb6980b2dc0 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69e600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980cf5b0 con 0x7fb69815e5b0 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69e600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb6980d48e0 con 0x7fb6980d06e0 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb69815e5b0 0x7fb6980b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb69815e5b0 0x7fb6980b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54258/0 (socket says 172.21.15.146:54258) 2024-04-24T23:06:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69dc00640 1 -- 172.21.15.146:0/3797686034 learned_addr learned my addr 172.21.15.146:0/3797686034 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:51.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.619+0000 7fb69d200640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6980d06e0 0x7fb6980b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.620+0000 7fb69dc00640 1 -- 172.21.15.146:0/3797686034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6980d06e0 msgr2=0x7fb6980b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.620+0000 7fb69dc00640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6980d06e0 0x7fb6980b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.620+0000 7fb69dc00640 1 -- 172.21.15.146:0/3797686034 >> v1:172.21.15.203:6789/0 conn(0x7fb6980b2dc0 legacy=0x7fb69815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:51.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.620+0000 7fb69dc00640 1 -- 172.21.15.146:0/3797686034 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980cf850 con 0x7fb69815e5b0 2024-04-24T23:06:51.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.621+0000 7fb69dc00640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69815e5b0 0x7fb6980b3450 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb690009870 tx=0x7fb69002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3846b6af73ed5a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.621+0000 7fb697400640 1 -- 172.21.15.146:0/3797686034 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690037070 con 0x7fb69815e5b0 2024-04-24T23:06:51.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.621+0000 7fb697400640 1 -- 172.21.15.146:0/3797686034 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690032440 con 0x7fb69815e5b0 2024-04-24T23:06:51.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.621+0000 7fb697400640 1 -- 172.21.15.146:0/3797686034 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690032810 con 0x7fb69815e5b0 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 -- 172.21.15.146:0/3797686034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69815e5b0 msgr2=0x7fb6980b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69815e5b0 0x7fb6980b3450 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb690009870 tx=0x7fb69002a180 comp rx=0 tx=0).stop 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 -- 172.21.15.146:0/3797686034 shutdown_connections 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69815e5b0 0x7fb6980b3450 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 --2- 172.21.15.146:0/3797686034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6980d06e0 0x7fb6980b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 -- 172.21.15.146:0/3797686034 >> 172.21.15.146:0/3797686034 conn(0x7fb6980d3d20 msgr2=0x7fb6980d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:51.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 -- 172.21.15.146:0/3797686034 shutdown_connections 2024-04-24T23:06:51.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.622+0000 7fb69e600640 1 -- 172.21.15.146:0/3797686034 wait complete. 2024-04-24T23:06:51.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.624+0000 7fb69e600640 1 Processor -- start 2024-04-24T23:06:51.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.624+0000 7fb69e600640 1 -- start start 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 0x7fb6980a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb69815e5b0 0x7fb69809f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980d2e40 con 0x7fb6980d06e0 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980d2cc0 con 0x7fb6980b2dc0 2024-04-24T23:06:51.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69e600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb6980d0ac0 con 0x7fb69815e5b0 2024-04-24T23:06:51.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb697e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb697e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54266/0 (socket says 172.21.15.146:54266) 2024-04-24T23:06:51.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb697e00640 1 -- 172.21.15.146:0/4256458797 learned_addr learned my addr 172.21.15.146:0/4256458797 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.625+0000 7fb69d200640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 0x7fb6980a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 -- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb69815e5b0 msgr2=0x7fb69809f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb69dc00640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb69815e5b0 0x7fb69809f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb69815e5b0 0x7fb69809f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 -- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 msgr2=0x7fb6980a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 0x7fb6980a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 -- 172.21.15.146:0/4256458797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69809ed80 con 0x7fb6980d06e0 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb69d200640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 0x7fb6980a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb697e00640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c410 tx=0x7fb68000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680017070 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6800035f0 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680003a20 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980caf20 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.626+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69809e7c0 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.627+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69804f500 con 0x7fb6980d06e0 2024-04-24T23:06:51.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.629+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb680003bc0 con 0x7fb6980d06e0 2024-04-24T23:06:51.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.629+0000 7fb694c00640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:51.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.630+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fb68008a250 con 0x7fb6980d06e0 2024-04-24T23:06:51.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.630+0000 7fb69d200640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:51.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.631+0000 7fb69d200640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 0x7fb67406e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb688007f50 tx=0x7fb6880074a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:51.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.634+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb680058a90 con 0x7fb6980d06e0 2024-04-24T23:06:51.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.835+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6980cd9c0 con 0x7fb6980d06e0 2024-04-24T23:06:51.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.837+0000 7fb694c00640 1 -- 172.21.15.146:0/4256458797 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17085 (secure 0 0 0) 0x7fb6800010c0 con 0x7fb6980d06e0 2024-04-24T23:06:51.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:03:58.364830+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.5","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/1456962778":"2024-04-25T23:03:58.364770+0000","172.21.15.146:6833/1456962778":"2024-04-25T23:03:58.364770+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 msgr2=0x7fb67406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 0x7fb67406e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb688007f50 tx=0x7fb6880074a0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 msgr2=0x7fb69809f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c410 tx=0x7fb68000c8d0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 shutdown_connections 2024-04-24T23:06:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb67406be60 0x7fb67406e320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb69815e5b0 0x7fb69809f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6980d06e0 0x7fb69809f190 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 --2- 172.21.15.146:0/4256458797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6980b2dc0 0x7fb6980a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.839+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 >> 172.21.15.146:0/4256458797 conn(0x7fb6980d3d20 msgr2=0x7fb6980b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.840+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 shutdown_connections 2024-04-24T23:06:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:51.840+0000 7fb69e600640 1 -- 172.21.15.146:0/4256458797 wait complete. 2024-04-24T23:06:51.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:02:22.460061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:02:23.670988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:06:51.861 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:06:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.053+0000 7f1979c00640 1 Processor -- start 2024-04-24T23:06:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.053+0000 7f1979c00640 1 -- start start 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.054+0000 7f1979c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415bcd0 0x7f19740cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.054+0000 7f1979c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19740d03d0 0x7f197415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.054+0000 7f1979c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19740b4df0 con 0x7f197415cd60 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.054+0000 7f1979c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f197415c8d0 con 0x7f19740d03d0 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.054+0000 7f1979c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f19740b4b10 con 0x7f197415bcd0 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19740d03d0 0x7f197415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19740d03d0 0x7f197415f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54276/0 (socket says 172.21.15.146:54276) 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 -- 172.21.15.146:0/3995602367 learned_addr learned my addr 172.21.15.146:0/3995602367 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1973e00640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415bcd0 0x7f19740cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 -- 172.21.15.146:0/3995602367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415bcd0 msgr2=0x7f19740cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415bcd0 0x7f19740cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 -- 172.21.15.146:0/3995602367 >> v1:172.21.15.203:6789/0 conn(0x7f197415cd60 legacy=0x7f19740cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.055+0000 7f1979200640 1 -- 172.21.15.146:0/3995602367 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197415c280 con 0x7f19740d03d0 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.056+0000 7f1979200640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19740d03d0 0x7f197415f6f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f196c009870 tx=0x7f196c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f9f2cedf80da94 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.056+0000 7f1972a00640 1 -- 172.21.15.146:0/3995602367 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c037070 con 0x7f19740d03d0 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1972a00640 1 -- 172.21.15.146:0/3995602367 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c032440 con 0x7f19740d03d0 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1972a00640 1 -- 172.21.15.146:0/3995602367 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c032810 con 0x7f19740d03d0 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 -- 172.21.15.146:0/3995602367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19740d03d0 msgr2=0x7f197415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19740d03d0 0x7f197415f6f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f196c009870 tx=0x7f196c02a210 comp rx=0 tx=0).stop 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 -- 172.21.15.146:0/3995602367 shutdown_connections 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19740d03d0 0x7f197415f6f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 --2- 172.21.15.146:0/3995602367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415bcd0 0x7f19740cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 -- 172.21.15.146:0/3995602367 >> 172.21.15.146:0/3995602367 conn(0x7f197406b560 msgr2=0x7f197406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 -- 172.21.15.146:0/3995602367 shutdown_connections 2024-04-24T23:06:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.057+0000 7f1979c00640 1 -- 172.21.15.146:0/3995602367 wait complete. 2024-04-24T23:06:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.059+0000 7f1979c00640 1 Processor -- start 2024-04-24T23:06:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.059+0000 7f1979c00640 1 -- start start 2024-04-24T23:06:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 0x7f1974140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 0x7f1974155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f197406e590 con 0x7f197415bcd0 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19740cc770 con 0x7f19740d03d0 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1979c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f19740b4790 con 0x7f197415cd60 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.060+0000 7f1973400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54292/0 (socket says 172.21.15.146:54292) 2024-04-24T23:06:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 -- 172.21.15.146:0/289359753 learned_addr learned my addr 172.21.15.146:0/289359753 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973e00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 0x7f1974140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1979200640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 0x7f1974155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 -- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 msgr2=0x7f1974155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 0x7f1974155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 -- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 msgr2=0x7f1974140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 0x7f1974140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 -- 172.21.15.146:0/289359753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197414faa0 con 0x7f197415bcd0 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973e00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 0x7f1974140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1979200640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 0x7f1974155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.061+0000 7f1973400640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f196000ba50 tx=0x7f196000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.062+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960019070 con 0x7f197415bcd0 2024-04-24T23:06:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.062+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196000cc20 con 0x7f197415bcd0 2024-04-24T23:06:52.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.062+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960014680 con 0x7f197415bcd0 2024-04-24T23:06:52.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.062+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197414fd10 con 0x7f197415bcd0 2024-04-24T23:06:52.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.062+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19741502d0 con 0x7f197415bcd0 2024-04-24T23:06:52.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.063+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197404f500 con 0x7f197415bcd0 2024-04-24T23:06:52.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.064+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f196001c070 con 0x7f197415bcd0 2024-04-24T23:06:52.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.065+0000 7f196be00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 0x7f195406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.065+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f196008ad20 con 0x7f197415bcd0 2024-04-24T23:06:52.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.066+0000 7f1973e00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 0x7f195406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.067+0000 7f1973e00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 0x7f195406e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1964006fd0 tx=0x7f1964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.069+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1960058e70 con 0x7f197415bcd0 2024-04-24T23:06:52.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.268+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19740cf030 con 0x7f197415bcd0 2024-04-24T23:06:52.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.268+0000 7f196be00640 1 -- 172.21.15.146:0/289359753 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7f196005d170 con 0x7f197415bcd0 2024-04-24T23:06:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:06:52.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 msgr2=0x7f195406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 0x7f195406e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1964006fd0 tx=0x7f1964008040 comp rx=0 tx=0).stop 2024-04-24T23:06:52.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 msgr2=0x7f1974155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f196000ba50 tx=0x7f196000bf10 comp rx=0 tx=0).stop 2024-04-24T23:06:52.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 shutdown_connections 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f195406be30 0x7f195406e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197415cd60 0x7f1974155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f197415bcd0 0x7f1974155780 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 --2- 172.21.15.146:0/289359753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19740d03d0 0x7f1974140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 >> 172.21.15.146:0/289359753 conn(0x7f197406b560 msgr2=0x7f197406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 shutdown_connections 2024-04-24T23:06:52.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.271+0000 7f1979c00640 1 -- 172.21.15.146:0/289359753 wait complete. 2024-04-24T23:06:52.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:06:52.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.499+0000 7ff576a00640 1 Processor -- start 2024-04-24T23:06:52.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.499+0000 7ff576a00640 1 -- start start 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.500+0000 7ff576a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff57015e430 0x7ff5700d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.500+0000 7ff576a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5700cfb40 con 0x7ff5700d4880 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff576a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5700cfe20 con 0x7ff5700d1c40 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff576a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff5700b36c0 con 0x7ff57015e430 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff576000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff5700d4880 0x7ff5700cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51954/0 (socket says 172.21.15.146:51954) 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff576000640 1 -- 172.21.15.146:0/3233599492 learned_addr learned my addr 172.21.15.146:0/3233599492 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff575600640 1 --2- 172.21.15.146:0/3233599492 >> v2:172.21.15.203:3300/0 conn(0x7ff57015e430 0x7ff5700d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377348007 0 0) 0x7ff5700cfb40 con 0x7ff5700d4880 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.501+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff558003520 con 0x7ff5700d4880 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2583711005 0 0) 0x7ff558003520 con 0x7ff5700d4880 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 >> v2:172.21.15.203:3300/0 conn(0x7ff57015e430 msgr2=0x7ff5700d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 --2- 172.21.15.146:0/3233599492 >> v2:172.21.15.203:3300/0 conn(0x7ff57015e430 0x7ff5700d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 >> v1:172.21.15.203:6789/0 conn(0x7ff5700d1c40 legacy=0x7ff5700ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5700b39a0 con 0x7ff5700d4880 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ff5680019f0 con 0x7ff5700d4880 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 >> v1:172.21.15.146:6789/0 conn(0x7ff5700d4880 legacy=0x7ff5700cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 0x7ff558003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff558004800 0x7ff558004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558005210 0x7ff55800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700b36c0 con 0x7ff558003a00 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff55800c160 con 0x7ff558005210 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff55800c360 con 0x7ff558004800 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.502+0000 7ff575600640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 0x7ff558003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff576000640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558005210 0x7ff55800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff574c00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff558004800 0x7ff558004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff575600640 1 -- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff558004800 msgr2=0x7ff558004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff575600640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff558004800 0x7ff558004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff575600640 1 -- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558005210 msgr2=0x7ff55800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff575600640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558005210 0x7ff55800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff575600640 1 -- 172.21.15.146:0/3233599492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff558003520 con 0x7ff558003a00 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.503+0000 7ff576000640 1 -- 172.21.15.146:0/3233599492 reap_dead start 2024-04-24T23:06:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.504+0000 7ff575600640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 0x7ff558003e20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff56400ba10 tx=0x7ff558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876e68d9a593f1d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.504+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564030070 con 0x7ff558003a00 2024-04-24T23:06:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.504+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56402add0 con 0x7ff558003a00 2024-04-24T23:06:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.504+0000 7ff56fe00640 1 -- 172.21.15.146:0/3233599492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56400b5e0 con 0x7ff558003a00 2024-04-24T23:06:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 -- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 msgr2=0x7ff558003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 0x7ff558003e20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff56400ba10 tx=0x7ff558005830 comp rx=0 tx=0).stop 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 -- 172.21.15.146:0/3233599492 shutdown_connections 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 --2- 172.21.15.146:0/3233599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff558003a00 0x7ff558003e20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 -- 172.21.15.146:0/3233599492 >> 172.21.15.146:0/3233599492 conn(0x7ff5700d3d60 msgr2=0x7ff5700d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 -- 172.21.15.146:0/3233599492 shutdown_connections 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.505+0000 7ff576a00640 1 -- 172.21.15.146:0/3233599492 wait complete. 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.507+0000 7ff576a00640 1 Processor -- start 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.507+0000 7ff576a00640 1 -- start start 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 0x7ff570155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5701560f0 0x7ff5701f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700d2b30 con 0x7ff570156570 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff57015e810 con 0x7ff558003a00 2024-04-24T23:06:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5700d2cb0 con 0x7ff5701560f0 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54310/0 (socket says 172.21.15.146:54310) 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 -- 172.21.15.146:0/1483260996 learned_addr learned my addr 172.21.15.146:0/1483260996 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff575600640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 0x7ff570155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 -- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5701560f0 msgr2=0x7ff5701f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5701560f0 0x7ff5701f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 -- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 msgr2=0x7ff570155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 0x7ff570155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff576000640 1 -- 172.21.15.146:0/1483260996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5701f49e0 con 0x7ff570156570 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.508+0000 7ff575600640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 0x7ff570155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff576000640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff5700d39a0 tx=0x7ff568007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56800eaa0 con 0x7ff570156570 2024-04-24T23:06:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56800ec40 con 0x7ff570156570 2024-04-24T23:06:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5701f4cc0 con 0x7ff570156570 2024-04-24T23:06:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568014480 con 0x7ff570156570 2024-04-24T23:06:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.509+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff570155bd0 con 0x7ff570156570 2024-04-24T23:06:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.510+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57004f500 con 0x7ff570156570 2024-04-24T23:06:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.511+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff568014640 con 0x7ff570156570 2024-04-24T23:06:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.512+0000 7ff56d600640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 0x7ff55006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.512+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7ff56808afe0 con 0x7ff570156570 2024-04-24T23:06:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.513+0000 7ff575600640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 0x7ff55006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.514+0000 7ff575600640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 0x7ff55006e320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff56400b9e0 tx=0x7ff564030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.516+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff568059750 con 0x7ff570156570 2024-04-24T23:06:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.716+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff5701f4e90 con 0x7ff570156570 2024-04-24T23:06:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.717+0000 7ff56d600640 1 -- 172.21.15.146:0/1483260996 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) ==== 104+0+11 (secure 0 0 0) 0x7ff568059050 con 0x7ff570156570 2024-04-24T23:06:52.718 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 msgr2=0x7ff55006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 0x7ff55006e320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff56400b9e0 tx=0x7ff564030000 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 msgr2=0x7ff5701f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff5700d39a0 tx=0x7ff568007bc0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 shutdown_connections 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff570156570 0x7ff5701f4400 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff55006be60 0x7ff55006e320 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5701560f0 0x7ff5701f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 --2- 172.21.15.146:0/1483260996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff558003a00 0x7ff570155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.719+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 >> 172.21.15.146:0/1483260996 conn(0x7ff5700d3d60 msgr2=0x7ff5700b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.720+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 shutdown_connections 2024-04-24T23:06:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.720+0000 7ff576a00640 1 -- 172.21.15.146:0/1483260996 wait complete. 2024-04-24T23:06:52.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:06:52.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.946+0000 7f5190e00640 1 Processor -- start 2024-04-24T23:06:52.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.946+0000 7f5190e00640 1 -- start start 2024-04-24T23:06:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5190e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f518c15a170 0x7f518c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5190e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f518c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5190e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518c0b3460 con 0x7f518c15a550 2024-04-24T23:06:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5190e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f518c0b3720 con 0x7f518c15a170 2024-04-24T23:06:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5190e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f518c06c7f0 con 0x7f518c06cff0 2024-04-24T23:06:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5182a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f518c15a550 0x7f518c15a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51970/0 (socket says 172.21.15.146:51970) 2024-04-24T23:06:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.948+0000 7f5182a00640 1 -- 172.21.15.146:0/2390678444 learned_addr learned my addr 172.21.15.146:0/2390678444 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518be00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f518c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518b400640 1 --2- 172.21.15.146:0/2390678444 >> v2:172.21.15.203:3300/0 conn(0x7f518c15a170 0x7f518c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475319204 0 0) 0x7f518c0b3460 con 0x7f518c15a550 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5170003520 con 0x7f518c15a550 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2405542934 0 0) 0x7f5170003520 con 0x7f518c15a550 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 msgr2=0x7f518c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f518c06d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 >> v2:172.21.15.203:3300/0 conn(0x7f518c15a170 msgr2=0x7f518c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 --2- 172.21.15.146:0/2390678444 >> v2:172.21.15.203:3300/0 conn(0x7f518c15a170 0x7f518c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518c06cad0 con 0x7f518c15a550 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f5174001670 con 0x7f518c15a550 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 >> v1:172.21.15.146:6789/0 conn(0x7f518c15a550 legacy=0x7f518c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f5170003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f5170004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5170004d40 0x7f51700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f518c0b3720 con 0x7f51700039b0 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f518c06c7f0 con 0x7f5170004d40 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.949+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f517000b9c0 con 0x7f518c06cff0 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f5170003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518be00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5170004d40 0x7f51700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 -- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 msgr2=0x7f5170004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f5182a00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f5170004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c06cff0 0x7f5170004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 -- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5170004d40 msgr2=0x7f51700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5170004d40 0x7f51700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518b400640 1 -- 172.21.15.146:0/2390678444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5170003520 con 0x7f51700039b0 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.950+0000 7f518be00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5170004d40 0x7f51700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.951+0000 7f518b400640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f5170003dd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f517c009fc0 tx=0x7f5170005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31f9355ef896461 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.951+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c009c10 con 0x7f51700039b0 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c02e640 con 0x7f51700039b0 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f518aa00640 1 -- 172.21.15.146:0/2390678444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c02ea30 con 0x7f51700039b0 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 -- 172.21.15.146:0/2390678444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 msgr2=0x7f5170003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 --2- 172.21.15.146:0/2390678444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f5170003dd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f517c009fc0 tx=0x7f5170005830 comp rx=0 tx=0).stop 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f518be00640 1 -- 172.21.15.146:0/2390678444 reap_dead start 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 -- 172.21.15.146:0/2390678444 shutdown_connections 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 -- 172.21.15.146:0/2390678444 >> 172.21.15.146:0/2390678444 conn(0x7f518c06b560 msgr2=0x7f518c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 -- 172.21.15.146:0/2390678444 shutdown_connections 2024-04-24T23:06:52.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.952+0000 7f5190e00640 1 -- 172.21.15.146:0/2390678444 wait complete. 2024-04-24T23:06:52.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.954+0000 7f5190e00640 1 Processor -- start 2024-04-24T23:06:52.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.954+0000 7f5190e00640 1 -- start start 2024-04-24T23:06:52.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f518c14a920 0x7f518c0afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c146e20 0x7f518c0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f518c15b5b0 con 0x7f51700039b0 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f518c0b3a00 con 0x7f518c14a920 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.955+0000 7f5190e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f518c1473b0 con 0x7f518c146e20 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54320/0 (socket says 172.21.15.146:54320) 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 -- 172.21.15.146:0/2979177179 learned_addr learned my addr 172.21.15.146:0/2979177179 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f5182a00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f518c14a920 0x7f518c0afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 -- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c146e20 msgr2=0x7f518c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c146e20 0x7f518c0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 -- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f518c14a920 msgr2=0x7f518c0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f518c14a920 0x7f518c0afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 -- 172.21.15.146:0/2979177179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518c147690 con 0x7f51700039b0 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.956+0000 7f518b400640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e230 tx=0x7f517c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.957+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c009c10 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.957+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c02e440 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.957+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c003bd0 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.957+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518c147970 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.957+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518c144dd0 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.958+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518c04f500 con 0x7f51700039b0 2024-04-24T23:06:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.959+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f517c049020 con 0x7f51700039b0 2024-04-24T23:06:52.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.960+0000 7f5183e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 0x7f516806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:52.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.960+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f517c0ab620 con 0x7f51700039b0 2024-04-24T23:06:52.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.961+0000 7f5182a00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 0x7f516806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:52.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.962+0000 7f5182a00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 0x7f516806e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5174001860 tx=0x7f5174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:52.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:52.965+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f517c010040 con 0x7f51700039b0 2024-04-24T23:06:53.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.163+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f518c0af4f0 con 0x7f51700039b0 2024-04-24T23:06:53.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.163+0000 7f5183e00640 1 -- 172.21.15.146:0/2979177179 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) ==== 100+0+11 (secure 0 0 0) 0x7f517c034030 con 0x7f51700039b0 2024-04-24T23:06:53.165 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 msgr2=0x7f516806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 0x7f516806e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5174001860 tx=0x7f5174009040 comp rx=0 tx=0).stop 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 msgr2=0x7f518c1f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e230 tx=0x7f517c009750 comp rx=0 tx=0).stop 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 shutdown_connections 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f516806be60 0x7f516806e320 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f518c146e20 0x7f518c0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f518c14a920 0x7f518c0afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 --2- 172.21.15.146:0/2979177179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51700039b0 0x7f518c1f3550 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.166+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 >> 172.21.15.146:0/2979177179 conn(0x7f518c06b560 msgr2=0x7f518c153420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.167+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 shutdown_connections 2024-04-24T23:06:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.167+0000 7f5190e00640 1 -- 172.21.15.146:0/2979177179 wait complete. 2024-04-24T23:06:53.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:06:53.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.386+0000 7fe097200640 1 Processor -- start 2024-04-24T23:06:53.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.386+0000 7fe097200640 1 -- start start 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.387+0000 7fe097200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0981561c0 0x7fe0980cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.387+0000 7fe097200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 0x7fe09815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe097200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe098070f90 con 0x7fe0980709d0 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe097200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe0980b4310 con 0x7fe0981561c0 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe097200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0981565a0 con 0x7fe0980d0240 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0981561c0 0x7fe0980cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0980709d0 0x7fe0980cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51980/0 (socket says 172.21.15.146:51980) 2024-04-24T23:06:53.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095400640 1 -- 172.21.15.146:0/2171588510 learned_addr learned my addr 172.21.15.146:0/2171588510 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe096800640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 0x7fe09815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095e00640 1 -- 172.21.15.146:0/2171588510 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 msgr2=0x7fe09815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095e00640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 0x7fe09815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095e00640 1 -- 172.21.15.146:0/2171588510 >> v1:172.21.15.146:6789/0 conn(0x7fe0980709d0 legacy=0x7fe0980cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe095e00640 1 -- 172.21.15.146:0/2171588510 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe098071270 con 0x7fe0981561c0 2024-04-24T23:06:53.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.388+0000 7fe096800640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 0x7fe09815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.390+0000 7fe095e00640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980cdbf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe088009d90 tx=0x7fe08802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45dcbc78267ba8d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.390+0000 7fe094a00640 1 -- 172.21.15.146:0/2171588510 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088007740 con 0x7fe0981561c0 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.390+0000 7fe094a00640 1 -- 172.21.15.146:0/2171588510 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0880078e0 con 0x7fe0981561c0 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.390+0000 7fe094a00640 1 -- 172.21.15.146:0/2171588510 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088007cb0 con 0x7fe0981561c0 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 -- 172.21.15.146:0/2171588510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 msgr2=0x7fe0980cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980cdbf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe088009d90 tx=0x7fe08802a530 comp rx=0 tx=0).stop 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 -- 172.21.15.146:0/2171588510 shutdown_connections 2024-04-24T23:06:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980d0240 0x7fe09815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 --2- 172.21.15.146:0/2171588510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980cdbf0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 -- 172.21.15.146:0/2171588510 >> 172.21.15.146:0/2171588510 conn(0x7fe09806b320 msgr2=0x7fe09806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 -- 172.21.15.146:0/2171588510 shutdown_connections 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.391+0000 7fe097200640 1 -- 172.21.15.146:0/2171588510 wait complete. 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.392+0000 7fe097200640 1 Processor -- start 2024-04-24T23:06:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.393+0000 7fe097200640 1 -- start start 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.393+0000 7fe097200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980709d0 0x7fe098143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe097200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0980d0240 0x7fe0980b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe097200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe097200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0980b2c20 con 0x7fe0981561c0 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe097200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe098071830 con 0x7fe0980d0240 2024-04-24T23:06:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe097200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0980b2da0 con 0x7fe0980709d0 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54350/0 (socket says 172.21.15.146:54350) 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 -- 172.21.15.146:0/418990447 learned_addr learned my addr 172.21.15.146:0/418990447 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe095e00640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980709d0 0x7fe098143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe095400640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0980d0240 0x7fe0980b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 -- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980709d0 msgr2=0x7fe098143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980709d0 0x7fe098143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 -- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0980d0240 msgr2=0x7fe0980b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0980d0240 0x7fe0980b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.394+0000 7fe096800640 1 -- 172.21.15.146:0/418990447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09814ebb0 con 0x7fe0981561c0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe096800640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7f0 tx=0x7fe09000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090015070 con 0x7fe0981561c0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe090007820 con 0x7fe0981561c0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090007c50 con 0x7fe0981561c0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09814ee90 con 0x7fe0981561c0 2024-04-24T23:06:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.395+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09814f450 con 0x7fe0981561c0 2024-04-24T23:06:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.397+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09804f500 con 0x7fe0981561c0 2024-04-24T23:06:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.397+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe090018070 con 0x7fe0981561c0 2024-04-24T23:06:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.398+0000 7fe08e000640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 0x7fe07806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.398+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fe09008b2b0 con 0x7fe0981561c0 2024-04-24T23:06:53.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.399+0000 7fe095e00640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 0x7fe07806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.400+0000 7fe095e00640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 0x7fe07806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe088034000 tx=0x7fe088033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.402+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe090059930 con 0x7fe0981561c0 2024-04-24T23:06:53.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.638+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0981550d0 con 0x7fe0981561c0 2024-04-24T23:06:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.639+0000 7fe08e000640 1 -- 172.21.15.146:0/418990447 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5195 (secure 0 0 0) 0x7fe090059230 con 0x7fe0981561c0 2024-04-24T23:06:53.640 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:53.640 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:23.906529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":24,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6078,"qdb_cluster":[6078]},"id":3}]} 2024-04-24T23:06:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2024-04-24T23:06:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 msgr2=0x7fe07806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 0x7fe07806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe088034000 tx=0x7fe088033040 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 msgr2=0x7fe0980b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7f0 tx=0x7fe09000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 shutdown_connections 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981561c0 0x7fe0980b21f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0980d0240 0x7fe0980b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe07806be30 0x7fe07806e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 --2- 172.21.15.146:0/418990447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0980709d0 0x7fe098143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 >> 172.21.15.146:0/418990447 conn(0x7fe09806b320 msgr2=0x7fe0980748a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 shutdown_connections 2024-04-24T23:06:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.642+0000 7fe097200640 1 -- 172.21.15.146:0/418990447 wait complete. 2024-04-24T23:06:53.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:06:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.853+0000 7f6835e00640 1 Processor -- start 2024-04-24T23:06:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.853+0000 7f6835e00640 1 -- start start 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6835e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68300d03a0 0x7f68300b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6835e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f683014be80 0x7f6830071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6835e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68301662b0 con 0x7f683014b850 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6835e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f683014bc30 con 0x7f68300d03a0 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6835e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6830166590 con 0x7f683014be80 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68300d03a0 0x7f68300b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68300d03a0 0x7f68300b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54352/0 (socket says 172.21.15.146:54352) 2024-04-24T23:06:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 -- 172.21.15.146:0/3423316975 learned_addr learned my addr 172.21.15.146:0/3423316975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 -- 172.21.15.146:0/3423316975 >> v2:172.21.15.203:3300/0 conn(0x7f683014be80 msgr2=0x7f6830071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 --2- 172.21.15.146:0/3423316975 >> v2:172.21.15.203:3300/0 conn(0x7f683014be80 0x7f6830071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 -- 172.21.15.146:0/3423316975 >> v1:172.21.15.203:6789/0 conn(0x7f683014b850 legacy=0x7f68300cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.855+0000 7f6826000640 1 -- 172.21.15.146:0/3423316975 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830166870 con 0x7f68300d03a0 2024-04-24T23:06:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.856+0000 7f6826000640 1 --2- 172.21.15.146:0/3423316975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68300d03a0 0x7f68300b4a10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f68300d0a40 tx=0x7f681802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6503ea47b405ff07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.857+0000 7f682e000640 1 -- 172.21.15.146:0/3423316975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818037070 con 0x7f68300d03a0 2024-04-24T23:06:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.857+0000 7f682e000640 1 -- 172.21.15.146:0/3423316975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6818032440 con 0x7f68300d03a0 2024-04-24T23:06:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.857+0000 7f682e000640 1 -- 172.21.15.146:0/3423316975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818032810 con 0x7f68300d03a0 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.857+0000 7f6835e00640 1 -- 172.21.15.146:0/3423316975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68300d03a0 msgr2=0x7f68300b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.857+0000 7f6835e00640 1 --2- 172.21.15.146:0/3423316975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68300d03a0 0x7f68300b4a10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f68300d0a40 tx=0x7f681802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 -- 172.21.15.146:0/3423316975 shutdown_connections 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 --2- 172.21.15.146:0/3423316975 >> v2:172.21.15.203:3300/0 conn(0x7f683014be80 0x7f6830071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 --2- 172.21.15.146:0/3423316975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68300d03a0 0x7f68300b4a10 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 -- 172.21.15.146:0/3423316975 >> 172.21.15.146:0/3423316975 conn(0x7f683006b320 msgr2=0x7f683006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 -- 172.21.15.146:0/3423316975 shutdown_connections 2024-04-24T23:06:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.858+0000 7f6835e00640 1 -- 172.21.15.146:0/3423316975 wait complete. 2024-04-24T23:06:53.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.859+0000 7f6835e00640 1 Processor -- start 2024-04-24T23:06:53.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.859+0000 7f6835e00640 1 -- start start 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.860+0000 7f6835e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68300d03a0 0x7f68301ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.860+0000 7f6835e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.860+0000 7f6835e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f683014be80 0x7f6830145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6835e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6830166070 con 0x7f683014b850 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6835e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6830165ef0 con 0x7f683014be80 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6835e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6830071690 con 0x7f68300d03a0 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54368/0 (socket says 172.21.15.146:54368) 2024-04-24T23:06:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 -- 172.21.15.146:0/2921287592 learned_addr learned my addr 172.21.15.146:0/2921287592 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:53.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f682ea00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68300d03a0 0x7f68301ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 -- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68300d03a0 msgr2=0x7f68301ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f682f400640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f683014be80 0x7f6830145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68300d03a0 0x7f68301ebbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 -- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f683014be80 msgr2=0x7f6830145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f683014be80 0x7f6830145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.861+0000 7f6826000640 1 -- 172.21.15.146:0/2921287592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68301ec260 con 0x7f683014b850 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6826000640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f68180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818041070 con 0x7f683014b850 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681803c870 con 0x7f683014b850 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818037040 con 0x7f683014b850 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68301ec540 con 0x7f683014b850 2024-04-24T23:06:53.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.862+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68301ecb00 con 0x7f683014b850 2024-04-24T23:06:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.863+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6830068190 con 0x7f683014b850 2024-04-24T23:06:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.864+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6818044070 con 0x7f683014b850 2024-04-24T23:06:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.865+0000 7f6827e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 0x7f680c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.866+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f68180abe00 con 0x7f683014b850 2024-04-24T23:06:53.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.866+0000 7f682ea00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 0x7f680c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:53.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.867+0000 7f682ea00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 0x7f680c06e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6820007fd0 tx=0x7f6820009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:53.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:53.870+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f681807a630 con 0x7f683014b850 2024-04-24T23:06:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.074+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f683006e770 con 0x7f683014b850 2024-04-24T23:06:54.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.075+0000 7f6827e00640 1 -- 172.21.15.146:0/2921287592 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17085 (secure 0 0 0) 0x7f6818079f30 con 0x7f683014b850 2024-04-24T23:06:54.077 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:54.077 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:03:58.364830+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.5","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/1456962778":"2024-04-25T23:03:58.364770+0000","172.21.15.146:6833/1456962778":"2024-04-25T23:03:58.364770+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:06:54.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 msgr2=0x7f680c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 0x7f680c06e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6820007fd0 tx=0x7f6820009040 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 msgr2=0x7f683015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f68180046c0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 shutdown_connections 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f683014be80 0x7f6830145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f683014b850 0x7f683015ebb0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f680c06be30 0x7f680c06e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 --2- 172.21.15.146:0/2921287592 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68300d03a0 0x7f68301ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 >> 172.21.15.146:0/2921287592 conn(0x7f683006b320 msgr2=0x7f68300cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.078+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 shutdown_connections 2024-04-24T23:06:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.079+0000 7f6835e00640 1 -- 172.21.15.146:0/2921287592 wait complete. 2024-04-24T23:06:54.100 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:06:54.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:06:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.285+0000 7f2a6f200640 1 Processor -- start 2024-04-24T23:06:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.285+0000 7f2a6f200640 1 -- start start 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a7015bab0 0x7f2a700b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2a700d0240 0x7f2a700709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7015cb30 con 0x7f2a700b3640 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7015ce10 con 0x7f2a7015bab0 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7015d0f0 con 0x7f2a700d0240 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a7015bab0 0x7f2a700b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a7015bab0 0x7f2a700b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54374/0 (socket says 172.21.15.146:54374) 2024-04-24T23:06:54.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.287+0000 7f2a6de00640 1 -- 172.21.15.146:0/1265305944 learned_addr learned my addr 172.21.15.146:0/1265305944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:54.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.288+0000 7f2a6de00640 1 -- 172.21.15.146:0/1265305944 >> v2:172.21.15.203:3300/0 conn(0x7f2a700d0240 msgr2=0x7f2a700709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.288+0000 7f2a6de00640 1 --2- 172.21.15.146:0/1265305944 >> v2:172.21.15.203:3300/0 conn(0x7f2a700d0240 0x7f2a700709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.288+0000 7f2a6de00640 1 -- 172.21.15.146:0/1265305944 >> v1:172.21.15.203:6789/0 conn(0x7f2a700b3640 legacy=0x7f2a700cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.288+0000 7f2a6de00640 1 -- 172.21.15.146:0/1265305944 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a700b2900 con 0x7f2a7015bab0 2024-04-24T23:06:54.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6de00640 1 --2- 172.21.15.146:0/1265305944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a700b3100 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2a70071d60 tx=0x7f2a6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c039af8915832e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6ca00640 1 -- 172.21.15.146:0/1265305944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60037070 con 0x7f2a7015bab0 2024-04-24T23:06:54.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6ca00640 1 -- 172.21.15.146:0/1265305944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a60032440 con 0x7f2a7015bab0 2024-04-24T23:06:54.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6ca00640 1 -- 172.21.15.146:0/1265305944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60032810 con 0x7f2a7015bab0 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6f200640 1 -- 172.21.15.146:0/1265305944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 msgr2=0x7f2a700b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.289+0000 7f2a6f200640 1 --2- 172.21.15.146:0/1265305944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a700b3100 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2a70071d60 tx=0x7f2a6002a230 comp rx=0 tx=0).stop 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 -- 172.21.15.146:0/1265305944 shutdown_connections 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 --2- 172.21.15.146:0/1265305944 >> v2:172.21.15.203:3300/0 conn(0x7f2a700d0240 0x7f2a700709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 --2- 172.21.15.146:0/1265305944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a700b3100 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 -- 172.21.15.146:0/1265305944 >> 172.21.15.146:0/1265305944 conn(0x7f2a7006b320 msgr2=0x7f2a7006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 -- 172.21.15.146:0/1265305944 shutdown_connections 2024-04-24T23:06:54.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.290+0000 7f2a6f200640 1 -- 172.21.15.146:0/1265305944 wait complete. 2024-04-24T23:06:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.291+0000 7f2a6f200640 1 Processor -- start 2024-04-24T23:06:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.291+0000 7f2a6f200640 1 -- start start 2024-04-24T23:06:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 0x7f2a70147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a701542b0 0x7f2a701f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70072880 con 0x7f2a7015bab0 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70072700 con 0x7f2a701542b0 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.292+0000 7f2a6f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a70070f10 con 0x7f2a700d0240 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54380/0 (socket says 172.21.15.146:54380) 2024-04-24T23:06:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 -- 172.21.15.146:0/2533498408 learned_addr learned my addr 172.21.15.146:0/2533498408 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6e800640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a701542b0 0x7f2a701f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6de00640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 0x7f2a70147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 -- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 msgr2=0x7f2a70147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 0x7f2a70147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 -- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a701542b0 msgr2=0x7f2a701f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a701542b0 0x7f2a701f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6d400640 1 -- 172.21.15.146:0/2533498408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a70154810 con 0x7f2a7015bab0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.293+0000 7f2a6de00640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 0x7f2a70147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a6d400640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c410 tx=0x7f2a5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c017070 con 0x7f2a7015bab0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0035f0 con 0x7f2a7015bab0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c003a20 con 0x7f2a7015bab0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a70154af0 con 0x7f2a7015bab0 2024-04-24T23:06:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.294+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a70147840 con 0x7f2a7015bab0 2024-04-24T23:06:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.295+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7004f500 con 0x7f2a7015bab0 2024-04-24T23:06:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.296+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a5c01a070 con 0x7f2a7015bab0 2024-04-24T23:06:54.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.297+0000 7f2a66000640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.297+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f2a5c08a4f0 con 0x7f2a7015bab0 2024-04-24T23:06:54.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.298+0000 7f2a6de00640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.299+0000 7f2a6de00640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 0x7f2a5006e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2a60034000 tx=0x7f2a6002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.301+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a5c058ca0 con 0x7f2a7015bab0 2024-04-24T23:06:54.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.544+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a700b42a0 con 0x7f2a7015bab0 2024-04-24T23:06:54.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.546+0000 7f2a66000640 1 -- 172.21.15.146:0/2533498408 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5195 (secure 0 0 0) 0x7f2a5c0585a0 con 0x7f2a7015bab0 2024-04-24T23:06:54.547 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:54.547 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:23.906529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":24,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6078,"qdb_cluster":[6078]},"id":3}]} 2024-04-24T23:06:54.547 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 msgr2=0x7f2a5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 0x7f2a5006e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2a60034000 tx=0x7f2a6002e000 comp rx=0 tx=0).stop 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 msgr2=0x7f2a70151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c410 tx=0x7f2a5c00c8d0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 shutdown_connections 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a701542b0 0x7f2a701f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7015bab0 0x7f2a70151c70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a5006be30 0x7f2a5006e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 --2- 172.21.15.146:0/2533498408 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a700d0240 0x7f2a70147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 >> 172.21.15.146:0/2533498408 conn(0x7f2a7006b320 msgr2=0x7f2a7015df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:54.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 shutdown_connections 2024-04-24T23:06:54.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.549+0000 7f2a6f200640 1 -- 172.21.15.146:0/2533498408 wait complete. 2024-04-24T23:06:54.569 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:06:54.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.769+0000 7f8d70600640 1 Processor -- start 2024-04-24T23:06:54.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.769+0000 7f8d70600640 1 -- start start 2024-04-24T23:06:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.770+0000 7f8d70600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8d681445e0 0x7f8d680cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.770+0000 7f8d70600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 0x7f8d680d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.770+0000 7f8d70600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d681449c0 con 0x7f8d68070c10 2024-04-24T23:06:54.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.770+0000 7f8d70600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8d68072430 con 0x7f8d681445e0 2024-04-24T23:06:54.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.770+0000 7f8d70600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d680b2d70 con 0x7f8d680728c0 2024-04-24T23:06:54.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d6e600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d68070c10 0x7f8d6815e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51994/0 (socket says 172.21.15.146:51994) 2024-04-24T23:06:54.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d6e600640 1 -- 172.21.15.146:0/3473468471 learned_addr learned my addr 172.21.15.146:0/3473468471 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:54.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d6dc00640 1 --2- 172.21.15.146:0/3473468471 >> v2:172.21.15.203:3300/0 conn(0x7f8d681445e0 0x7f8d680cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d6d200640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 0x7f8d680d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975871528 0 0) 0x7f8d681449c0 con 0x7f8d68070c10 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50005730 con 0x7f8d68070c10 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3757549000 0 0) 0x7f8d50005730 con 0x7f8d68070c10 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 msgr2=0x7f8d680d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 0x7f8d680d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 >> v2:172.21.15.203:3300/0 conn(0x7f8d681445e0 msgr2=0x7f8d680cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 --2- 172.21.15.146:0/3473468471 >> v2:172.21.15.203:3300/0 conn(0x7f8d681445e0 0x7f8d680cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.771+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d68071820 con 0x7f8d68070c10 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f8d600019f0 con 0x7f8d68070c10 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 >> v1:172.21.15.146:6789/0 conn(0x7f8d68070c10 legacy=0x7f8d6815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d50005bc0 0x7f8d50005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 0x7f8d50006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d50006f50 0x7f8d500073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d68072430 con 0x7f8d50006f50 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680b2d70 con 0x7f8d50005bc0 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5000dbd0 con 0x7f8d680728c0 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d50006f50 0x7f8d500073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6dc00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d50005bc0 0x7f8d50005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 -- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 msgr2=0x7f8d50006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d680728c0 0x7f8d50006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 -- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d50005bc0 msgr2=0x7f8d50005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d50005bc0 0x7f8d50005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6e600640 1 -- 172.21.15.146:0/3473468471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d50005730 con 0x7f8d50006f50 2024-04-24T23:06:54.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.772+0000 7f8d6dc00640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d50005bc0 0x7f8d50005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.773+0000 7f8d6e600640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d50006f50 0x7f8d500073d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000a880 tx=0x7f8d50007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e13add883a6cd0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000a4a0 con 0x7f8d50006f50 2024-04-24T23:06:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6002f070 con 0x7f8d50006f50 2024-04-24T23:06:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d67e00640 1 -- 172.21.15.146:0/3473468471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6002bd00 con 0x7f8d50006f50 2024-04-24T23:06:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 -- 172.21.15.146:0/3473468471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d50006f50 msgr2=0x7f8d500073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 --2- 172.21.15.146:0/3473468471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d50006f50 0x7f8d500073d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000a880 tx=0x7f8d50007a40 comp rx=0 tx=0).stop 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d6e600640 1 -- 172.21.15.146:0/3473468471 reap_dead start 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 -- 172.21.15.146:0/3473468471 shutdown_connections 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 -- 172.21.15.146:0/3473468471 >> 172.21.15.146:0/3473468471 conn(0x7f8d6806b320 msgr2=0x7f8d6806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 -- 172.21.15.146:0/3473468471 shutdown_connections 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.774+0000 7f8d70600640 1 -- 172.21.15.146:0/3473468471 wait complete. 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.776+0000 7f8d70600640 1 Processor -- start 2024-04-24T23:06:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.776+0000 7f8d70600640 1 -- start start 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d681f3c80 0x7f8d681383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d6813af80 0x7f8d680aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680720c0 con 0x7f8d681388e0 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d68071de0 con 0x7f8d681f3c80 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d70600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d680d01d0 con 0x7f8d6813af80 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d6d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d6d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54388/0 (socket says 172.21.15.146:54388) 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.777+0000 7f8d6d200640 1 -- 172.21.15.146:0/1927212947 learned_addr learned my addr 172.21.15.146:0/1927212947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 -- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d6813af80 msgr2=0x7f8d680aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d6813af80 0x7f8d680aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 -- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d681f3c80 msgr2=0x7f8d681383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d681f3c80 0x7f8d681383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 -- 172.21.15.146:0/1927212947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d681f7880 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d6d200640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e7c0 tx=0x7f8d5400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54017070 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5400c650 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400ca20 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.778+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d681f7af0 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.779+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d681f85d0 con 0x7f8d681388e0 2024-04-24T23:06:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.780+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d68068190 con 0x7f8d681388e0 2024-04-24T23:06:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.780+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d5401a070 con 0x7f8d681388e0 2024-04-24T23:06:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.781+0000 7f8d65600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.781+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f8d5408b200 con 0x7f8d681388e0 2024-04-24T23:06:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.782+0000 7f8d6dc00640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:54.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.783+0000 7f8d6dc00640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d68138350 tx=0x7f8d5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:54.786+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d54059910 con 0x7f8d681388e0 2024-04-24T23:06:55.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.027+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6806eab0 con 0x7f8d681388e0 2024-04-24T23:06:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.029+0000 7f8d65600640 1 -- 172.21.15.146:0/1927212947 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5195 (secure 0 0 0) 0x7f8d54059210 con 0x7f8d681388e0 2024-04-24T23:06:55.031 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:55.031 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:02:24.670189+0000","modified":"2024-04-24T23:05:23.906529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6078},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6078":{"gid":6078,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":24,"addr":"172.21.15.146:6835/3630709161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3630709161},{"type":"v1","addr":"172.21.15.146:6835","nonce":3630709161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6078,"qdb_cluster":[6078]},"id":3}]} 2024-04-24T23:06:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.031+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 msgr2=0x7f8d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.031+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d68138350 tx=0x7f8d5c008040 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.031+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 msgr2=0x7f8d680ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.031+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e7c0 tx=0x7f8d5400ebc0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 shutdown_connections 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d6813af80 0x7f8d680aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d681388e0 0x7f8d680ae910 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 --2- 172.21.15.146:0/1927212947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d681f3c80 0x7f8d681383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 >> 172.21.15.146:0/1927212947 conn(0x7f8d6806b320 msgr2=0x7f8d680b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 shutdown_connections 2024-04-24T23:06:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.032+0000 7f8d70600640 1 -- 172.21.15.146:0/1927212947 wait complete. 2024-04-24T23:06:55.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:06:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.237+0000 7fcf6b200640 1 Processor -- start 2024-04-24T23:06:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.238+0000 7fcf6b200640 1 -- start start 2024-04-24T23:06:55.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.239+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf6c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.239+0000 7fcf6b200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcf6c0d0070 0x7fcf6c0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.239+0000 7fcf6b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6c15e1b0 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.239+0000 7fcf6b200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6c0713b0 con 0x7fcf6c0d0070 2024-04-24T23:06:55.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.239+0000 7fcf6b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6c071690 con 0x7fcf6c072920 2024-04-24T23:06:55.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf6c15ddd0 0x7fcf6c070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51998/0 (socket says 172.21.15.146:51998) 2024-04-24T23:06:55.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69e00640 1 -- 172.21.15.146:0/3379285286 learned_addr learned my addr 172.21.15.146:0/3379285286 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16191981 0 0) 0x7fcf6c15e1b0 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf50003520 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf61400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf6c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf6a800640 1 --2- 172.21.15.146:0/3379285286 >> v2:172.21.15.203:3300/0 conn(0x7fcf6c0d0070 0x7fcf6c0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1705124190 0 0) 0x7fcf50003520 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 msgr2=0x7fcf6c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf6c0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 >> v2:172.21.15.203:3300/0 conn(0x7fcf6c0d0070 msgr2=0x7fcf6c0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:55.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 --2- 172.21.15.146:0/3379285286 >> v2:172.21.15.203:3300/0 conn(0x7fcf6c0d0070 0x7fcf6c0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c071970 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fcf5c001690 con 0x7fcf6c15ddd0 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.240+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 >> v1:172.21.15.146:6789/0 conn(0x7fcf6c15ddd0 legacy=0x7fcf6c070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004030 0x7fcf50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c0713b0 con 0x7fcf50004d40 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c071690 con 0x7fcf50004030 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5000bb20 con 0x7fcf6c072920 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf69e00640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf61400640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004030 0x7fcf50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 -- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 msgr2=0x7fcf500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:55.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c072920 0x7fcf500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 -- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004030 msgr2=0x7fcf50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:55.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004030 0x7fcf50004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.241+0000 7fcf6a800640 1 -- 172.21.15.146:0/3379285286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50003520 con 0x7fcf50004d40 2024-04-24T23:06:55.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.242+0000 7fcf6a800640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fcf64007360 tx=0x7fcf50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee8032948afd9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.242+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009be0 con 0x7fcf50004d40 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6402e620 con 0x7fcf50004d40 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf69400640 1 -- 172.21.15.146:0/3379285286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402e9f0 con 0x7fcf50004d40 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 -- 172.21.15.146:0/3379285286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf50004d40 msgr2=0x7fcf500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 --2- 172.21.15.146:0/3379285286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf50004d40 0x7fcf500051c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fcf64007360 tx=0x7fcf50005830 comp rx=0 tx=0).stop 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6a800640 1 -- 172.21.15.146:0/3379285286 reap_dead start 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 -- 172.21.15.146:0/3379285286 shutdown_connections 2024-04-24T23:06:55.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 -- 172.21.15.146:0/3379285286 >> 172.21.15.146:0/3379285286 conn(0x7fcf6c06b320 msgr2=0x7fcf6c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:55.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 -- 172.21.15.146:0/3379285286 shutdown_connections 2024-04-24T23:06:55.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.243+0000 7fcf6b200640 1 -- 172.21.15.146:0/3379285286 wait complete. 2024-04-24T23:06:55.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.245+0000 7fcf6b200640 1 Processor -- start 2024-04-24T23:06:55.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.245+0000 7fcf6b200640 1 -- start start 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004d40 0x7fcf6c1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c1487f0 0x7fcf6c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c0cfcb0 con 0x7fcf6c148040 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c0cfb30 con 0x7fcf50004d40 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6c0cfe30 con 0x7fcf6c1487f0 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54400/0 (socket says 172.21.15.146:54400) 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.246+0000 7fcf6a800640 1 -- 172.21.15.146:0/59544902 learned_addr learned my addr 172.21.15.146:0/59544902 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf69e00640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004d40 0x7fcf6c1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf61400640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c1487f0 0x7fcf6c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 -- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c1487f0 msgr2=0x7fcf6c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c1487f0 0x7fcf6c147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 -- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004d40 msgr2=0x7fcf6c1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004d40 0x7fcf6c1452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 -- 172.21.15.146:0/59544902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c160d40 con 0x7fcf6c148040 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6a800640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402b0a0 tx=0x7fcf64004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009be0 con 0x7fcf6c148040 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6402e420 con 0x7fcf6c148040 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c145b10 con 0x7fcf6c148040 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.247+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64038280 con 0x7fcf6c148040 2024-04-24T23:06:55.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.248+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c1460d0 con 0x7fcf6c148040 2024-04-24T23:06:55.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.248+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6c04f500 con 0x7fcf6c148040 2024-04-24T23:06:55.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.249+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf64038890 con 0x7fcf6c148040 2024-04-24T23:06:55.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.250+0000 7fcf62a00640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 0x7fcf4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.250+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7fcf640ab9e0 con 0x7fcf6c148040 2024-04-24T23:06:55.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.251+0000 7fcf69e00640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 0x7fcf4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.252+0000 7fcf69e00640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 0x7fcf4806e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c161190 tx=0x7fcf5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.255+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf64032030 con 0x7fcf6c148040 2024-04-24T23:06:55.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.450+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf6c0b29e0 con 0x7fcf6c148040 2024-04-24T23:06:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.453+0000 7fcf62a00640 1 -- 172.21.15.146:0/59544902 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17085 (secure 0 0 0) 0x7fcf6407a060 con 0x7fcf6c148040 2024-04-24T23:06:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:06:55.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:03:58.364830+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:02:22.460061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-24T23:02:23.670988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.5","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/1456962778":"2024-04-25T23:03:58.364770+0000","172.21.15.146:6833/1456962778":"2024-04-25T23:03:58.364770+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 msgr2=0x7fcf4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 0x7fcf4806e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c161190 tx=0x7fcf5c009040 comp rx=0 tx=0).stop 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 msgr2=0x7fcf6c1468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402b0a0 tx=0x7fcf64004ab0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 shutdown_connections 2024-04-24T23:06:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c148040 0x7fcf6c1468d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf4806be30 0x7fcf4806e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6c1487f0 0x7fcf6c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 --2- 172.21.15.146:0/59544902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf50004d40 0x7fcf6c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 >> 172.21.15.146:0/59544902 conn(0x7fcf6c06b320 msgr2=0x7fcf6c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 shutdown_connections 2024-04-24T23:06:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.456+0000 7fcf6b200640 1 -- 172.21.15.146:0/59544902 wait complete. 2024-04-24T23:06:55.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:06:55.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.661+0000 7f82eb000640 1 Processor -- start 2024-04-24T23:06:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.662+0000 7f82eb000640 1 -- start start 2024-04-24T23:06:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.663+0000 7f82eb000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f82e40b45f0 0x7f82e4162780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.663+0000 7f82eb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.663+0000 7f82eb000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40b5540 con 0x7f82e40d08c0 2024-04-24T23:06:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.663+0000 7f82eb000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f82e40d2af0 con 0x7f82e40b45f0 2024-04-24T23:06:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.663+0000 7f82eb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40d2200 con 0x7f82e40d0ca0 2024-04-24T23:06:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.664+0000 7f82ea600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.664+0000 7f82ea600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:35852/0 (socket says 172.21.15.146:35852) 2024-04-24T23:06:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.664+0000 7f82ea600640 1 -- 172.21.15.146:0/1189241886 learned_addr learned my addr 172.21.15.146:0/1189241886 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.664+0000 7f82e9200640 1 --2- 172.21.15.146:0/1189241886 >> v2:172.21.15.203:3300/0 conn(0x7f82e40b45f0 0x7f82e4162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.665+0000 7f82ea600640 1 -- 172.21.15.146:0/1189241886 >> v2:172.21.15.203:3300/0 conn(0x7f82e40b45f0 msgr2=0x7f82e4162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.665+0000 7f82ea600640 1 --2- 172.21.15.146:0/1189241886 >> v2:172.21.15.203:3300/0 conn(0x7f82e40b45f0 0x7f82e4162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.665+0000 7f82ea600640 1 -- 172.21.15.146:0/1189241886 >> v1:172.21.15.203:6789/0 conn(0x7f82e40d08c0 legacy=0x7f82e4162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.665+0000 7f82ea600640 1 -- 172.21.15.146:0/1189241886 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40d24a0 con 0x7f82e40d0ca0 2024-04-24T23:06:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.666+0000 7f82ea600640 1 --2- 172.21.15.146:0/1189241886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009e50 tx=0x7f82dc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8776256e9d8c326 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.666+0000 7f82e3e00640 1 -- 172.21.15.146:0/1189241886 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc036070 con 0x7f82e40d0ca0 2024-04-24T23:06:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82e3e00640 1 -- 172.21.15.146:0/1189241886 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc031600 con 0x7f82e40d0ca0 2024-04-24T23:06:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82e3e00640 1 -- 172.21.15.146:0/1189241886 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0319d0 con 0x7f82e40d0ca0 2024-04-24T23:06:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 -- 172.21.15.146:0/1189241886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 msgr2=0x7f82e40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 --2- 172.21.15.146:0/1189241886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009e50 tx=0x7f82dc02a680 comp rx=0 tx=0).stop 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 -- 172.21.15.146:0/1189241886 shutdown_connections 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 --2- 172.21.15.146:0/1189241886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40cea00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 --2- 172.21.15.146:0/1189241886 >> v2:172.21.15.203:3300/0 conn(0x7f82e40b45f0 0x7f82e4162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 -- 172.21.15.146:0/1189241886 >> 172.21.15.146:0/1189241886 conn(0x7f82e409d010 msgr2=0x7f82e40d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 -- 172.21.15.146:0/1189241886 shutdown_connections 2024-04-24T23:06:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.667+0000 7f82eb000640 1 -- 172.21.15.146:0/1189241886 wait complete. 2024-04-24T23:06:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.669+0000 7f82eb000640 1 Processor -- start 2024-04-24T23:06:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.669+0000 7f82eb000640 1 -- start start 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 0x7f82e415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82e4162e40 con 0x7f82e40b45f0 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f82e4162cc0 con 0x7f82e40d08c0 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82eb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40b4f80 con 0x7f82e40d0ca0 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82e9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82e9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54402/0 (socket says 172.21.15.146:54402) 2024-04-24T23:06:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.670+0000 7f82e9c00640 1 -- 172.21.15.146:0/1380006285 learned_addr learned my addr 172.21.15.146:0/1380006285 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82ea600640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9200640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 0x7f82e415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 -- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 msgr2=0x7f82e40b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 -- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 msgr2=0x7f82e415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 0x7f82e415fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 -- 172.21.15.146:0/1380006285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40b97b0 con 0x7f82e40b45f0 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9200640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 0x7f82e415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.671+0000 7f82e9c00640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c480 tx=0x7f82d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.672+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40052d0 con 0x7f82e40b45f0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.672+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4005470 con 0x7f82e40b45f0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.672+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4012870 con 0x7f82e40b45f0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.672+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e415ec30 con 0x7f82e40b45f0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.672+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e415f1f0 con 0x7f82e40b45f0 2024-04-24T23:06:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.673+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e404f500 con 0x7f82e40b45f0 2024-04-24T23:06:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.674+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82d4012a10 con 0x7f82e40b45f0 2024-04-24T23:06:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.675+0000 7f82e1600640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 0x7f82c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.675+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6216+0+0 (secure 0 0 0) 0x7f82d408ac80 con 0x7f82e40b45f0 2024-04-24T23:06:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.676+0000 7f82e9200640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 0x7f82c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:55.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.677+0000 7f82e9200640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 0x7f82c406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f82e41f76c0 tx=0x7f82d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.680+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f82d40594c0 con 0x7f82e40b45f0 2024-04-24T23:06:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.910+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f82e40cfa60 con 0x7f82e40b45f0 2024-04-24T23:06:55.913 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:06:55.912+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:06:55.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.916+0000 7f82e1600640 1 -- 172.21.15.146:0/1380006285 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7f82d4058dc0 con 0x7f82e40b45f0 2024-04-24T23:06:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:06:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 msgr2=0x7f82c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 0x7f82c406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f82e41f76c0 tx=0x7f82d0008040 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 msgr2=0x7f82e41511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c480 tx=0x7f82d400c940 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 shutdown_connections 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82c406be30 0x7f82c406e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f82e40d0ca0 0x7f82e40b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e40d08c0 0x7f82e415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 --2- 172.21.15.146:0/1380006285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e40b45f0 0x7f82e41511f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.918+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 >> 172.21.15.146:0/1380006285 conn(0x7f82e409d010 msgr2=0x7f82e406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.919+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 shutdown_connections 2024-04-24T23:06:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:55.919+0000 7f82eb000640 1 -- 172.21.15.146:0/1380006285 wait complete. 2024-04-24T23:06:55.936 INFO:tasks.ceph.mds.a.smithi146.stderr: -9762> 2024-04-24T23:05:24.389+0000 7f3277000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:06:55.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:06:55.996 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:06:56.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.121+0000 7f7ac4c00640 1 Processor -- start 2024-04-24T23:06:56.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.122+0000 7f7ac4c00640 1 -- start start 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7ac4c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac015be20 0x7f7ac00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7ac4c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac015c340 con 0x7f7ac015ba40 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7ac4c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac015c5e0 con 0x7f7ac00d01f0 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7ac4c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac00ce1c0 con 0x7f7ac015be20 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7abf400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7ac015ba40 0x7f7ac00cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52022/0 (socket says 172.21.15.146:52022) 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7abf400640 1 -- 172.21.15.146:0/2879355172 learned_addr learned my addr 172.21.15.146:0/2879355172 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.123+0000 7f7abfe00640 1 --2- 172.21.15.146:0/2879355172 >> v2:172.21.15.146:3300/0 conn(0x7f7ac015be20 0x7f7ac00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:56.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.124+0000 7f7abea00640 1 -- 172.21.15.146:0/2879355172 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831198916 0 0) 0x7f7ac015c340 con 0x7f7ac015ba40 2024-04-24T23:06:56.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.124+0000 7f7abea00640 1 -- 172.21.15.146:0/2879355172 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa4003520 con 0x7f7ac015ba40 2024-04-24T23:06:56.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.124+0000 7f7abfe00640 1 -- 172.21.15.146:0/2879355172 >> v1:172.21.15.203:6789/0 conn(0x7f7ac00d01f0 legacy=0x7f7ac015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:56.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.124+0000 7f7abfe00640 1 -- 172.21.15.146:0/2879355172 >> v1:172.21.15.146:6789/0 conn(0x7f7ac015ba40 legacy=0x7f7ac00cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.124+0000 7f7abfe00640 1 -- 172.21.15.146:0/2879355172 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac015c8c0 con 0x7f7ac015be20 2024-04-24T23:06:56.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.125+0000 7f7abfe00640 1 --2- 172.21.15.146:0/2879355172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015be20 0x7f7ac00cdc80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009d90 tx=0x7f7ab802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45757ea033c3c818 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:56.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.125+0000 7f7abea00640 1 -- 172.21.15.146:0/2879355172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8007740 con 0x7f7ac015be20 2024-04-24T23:06:56.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.125+0000 7f7abea00640 1 -- 172.21.15.146:0/2879355172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab80078e0 con 0x7f7ac015be20 2024-04-24T23:06:56.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.125+0000 7f7abea00640 1 -- 172.21.15.146:0/2879355172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8007c90 con 0x7f7ac015be20 2024-04-24T23:06:56.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 -- 172.21.15.146:0/2879355172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015be20 msgr2=0x7f7ac00cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/2879355172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015be20 0x7f7ac00cdc80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009d90 tx=0x7f7ab802a6a0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 -- 172.21.15.146:0/2879355172 shutdown_connections 2024-04-24T23:06:56.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/2879355172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015be20 0x7f7ac00cdc80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 -- 172.21.15.146:0/2879355172 >> 172.21.15.146:0/2879355172 conn(0x7f7ac006b350 msgr2=0x7f7ac006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:56.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 -- 172.21.15.146:0/2879355172 shutdown_connections 2024-04-24T23:06:56.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.126+0000 7f7ac4c00640 1 -- 172.21.15.146:0/2879355172 wait complete. 2024-04-24T23:06:56.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.128+0000 7f7ac4c00640 1 Processor -- start 2024-04-24T23:06:56.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.128+0000 7f7ac4c00640 1 -- start start 2024-04-24T23:06:56.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ac00d01f0 0x7f7ac00aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ac015be20 0x7f7ac0071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac006e120 con 0x7f7ac015ba40 2024-04-24T23:06:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac015cf10 con 0x7f7ac015be20 2024-04-24T23:06:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ac4c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac006e590 con 0x7f7ac00d01f0 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ab6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ab6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54430/0 (socket says 172.21.15.146:54430) 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.129+0000 7f7ab6a00640 1 -- 172.21.15.146:0/3834354996 learned_addr learned my addr 172.21.15.146:0/3834354996 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 -- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ac00d01f0 msgr2=0x7f7ac00aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ac00d01f0 0x7f7ac00aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 -- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ac015be20 msgr2=0x7f7ac0071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ac015be20 0x7f7ac0071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 -- 172.21.15.146:0/3834354996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac00a99e0 con 0x7f7ac015ba40 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab6a00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c430 tx=0x7f7aa800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8011790 con 0x7f7ac015ba40 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa8017070 con 0x7f7ac015ba40 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8011bb0 con 0x7f7ac015ba40 2024-04-24T23:06:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.130+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac00a9cc0 con 0x7f7ac015ba40 2024-04-24T23:06:56.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.131+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac00aa280 con 0x7f7ac015ba40 2024-04-24T23:06:56.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.132+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac004f500 con 0x7f7ac015ba40 2024-04-24T23:06:56.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.133+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7aa801c460 con 0x7f7ac015ba40 2024-04-24T23:06:56.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.134+0000 7f7ab7e00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:56.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.134+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6302+0+0 (secure 0 0 0) 0x7f7aa808aff0 con 0x7f7ac015ba40 2024-04-24T23:06:56.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.135+0000 7f7abf400640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:56.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.136+0000 7f7abf400640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000f60 tx=0x7f7ab00078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:56.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.139+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7aa8059710 con 0x7f7ac015ba40 2024-04-24T23:06:56.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.365+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7ac00aa450 con 0x7f7ac015ba40 2024-04-24T23:06:56.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.919+0000 7f7ab7e00640 1 -- 172.21.15.146:0/3834354996 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f7aa8059010 con 0x7f7ac015ba40 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 msgr2=0x7f7a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000f60 tx=0x7f7ab00078f0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 msgr2=0x7f7ac0159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c430 tx=0x7f7aa800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 shutdown_connections 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ac015be20 0x7f7ac0071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac015ba40 0x7f7ac0159e30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 --2- 172.21.15.146:0/3834354996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ac00d01f0 0x7f7ac00aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:56.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.923+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 >> 172.21.15.146:0/3834354996 conn(0x7f7ac006b350 msgr2=0x7f7ac0156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:56.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.924+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 shutdown_connections 2024-04-24T23:06:56.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:56.924+0000 7f7ac4c00640 1 -- 172.21.15.146:0/3834354996 wait complete. 2024-04-24T23:06:56.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:06:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.149+0000 7f7330a00640 1 Processor -- start 2024-04-24T23:06:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.149+0000 7f7330a00640 1 -- start start 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.150+0000 7f7330a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f732c0cc200 0x7f732c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.150+0000 7f7330a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f732c06e230 0x7f732c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.150+0000 7f7330a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c160420 con 0x7f732c071f10 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.150+0000 7f7330a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f732c15d2a0 con 0x7f732c0cc200 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.150+0000 7f7330a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f732c06e070 con 0x7f732c06e230 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f732c0cc200 0x7f732c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f732c0cc200 0x7f732c06db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54446/0 (socket says 172.21.15.146:54446) 2024-04-24T23:06:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 -- 172.21.15.146:0/2997338405 learned_addr learned my addr 172.21.15.146:0/2997338405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:57.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 -- 172.21.15.146:0/2997338405 >> v2:172.21.15.203:3300/0 conn(0x7f732c06e230 msgr2=0x7f732c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:57.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 --2- 172.21.15.146:0/2997338405 >> v2:172.21.15.203:3300/0 conn(0x7f732c06e230 0x7f732c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:57.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 -- 172.21.15.146:0/2997338405 >> v1:172.21.15.203:6789/0 conn(0x7f732c071f10 legacy=0x7f732c15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:57.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.151+0000 7f7329e00640 1 -- 172.21.15.146:0/2997338405 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c15c390 con 0x7f732c0cc200 2024-04-24T23:06:57.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.152+0000 7f7329e00640 1 --2- 172.21.15.146:0/2997338405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0cc200 0x7f732c06db30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f732c0b2250 tx=0x7f731402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c045a4f938dcca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:57.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7329400640 1 -- 172.21.15.146:0/2997338405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314037070 con 0x7f732c0cc200 2024-04-24T23:06:57.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7329400640 1 -- 172.21.15.146:0/2997338405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7314032440 con 0x7f732c0cc200 2024-04-24T23:06:57.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7329400640 1 -- 172.21.15.146:0/2997338405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314032810 con 0x7f732c0cc200 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 -- 172.21.15.146:0/2997338405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0cc200 msgr2=0x7f732c06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 --2- 172.21.15.146:0/2997338405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0cc200 0x7f732c06db30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f732c0b2250 tx=0x7f731402a230 comp rx=0 tx=0).stop 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 -- 172.21.15.146:0/2997338405 shutdown_connections 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 --2- 172.21.15.146:0/2997338405 >> v2:172.21.15.203:3300/0 conn(0x7f732c06e230 0x7f732c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 --2- 172.21.15.146:0/2997338405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0cc200 0x7f732c06db30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.153+0000 7f7330a00640 1 -- 172.21.15.146:0/2997338405 >> 172.21.15.146:0/2997338405 conn(0x7f732c0b1460 msgr2=0x7f732c0b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.154+0000 7f7330a00640 1 -- 172.21.15.146:0/2997338405 shutdown_connections 2024-04-24T23:06:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.154+0000 7f7330a00640 1 -- 172.21.15.146:0/2997338405 wait complete. 2024-04-24T23:06:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.155+0000 7f7330a00640 1 Processor -- start 2024-04-24T23:06:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.155+0000 7f7330a00640 1 -- start start 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 0x7f732c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 0x7f732c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f732c15c700 con 0x7f732c071f10 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f732c0722f0 con 0x7f732c06e230 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7330a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f732c159ce0 con 0x7f732c0cc200 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.156+0000 7f7329e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54462/0 (socket says 172.21.15.146:54462) 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 -- 172.21.15.146:0/2084682692 learned_addr learned my addr 172.21.15.146:0/2084682692 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f732a800640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 0x7f732c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 -- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 msgr2=0x7f732c147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f732b200640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 0x7f732c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 0x7f732c147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 -- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 msgr2=0x7f732c155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 0x7f732c155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 -- 172.21.15.146:0/2084682692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c1568e0 con 0x7f732c071f10 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f732a800640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 0x7f732c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f732b200640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 0x7f732c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.157+0000 7f7329e00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f73140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.158+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314041070 con 0x7f732c071f10 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.158+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731403c870 con 0x7f732c071f10 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.158+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314037040 con 0x7f732c071f10 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.158+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c156bc0 con 0x7f732c071f10 2024-04-24T23:06:57.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.158+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c157180 con 0x7f732c071f10 2024-04-24T23:06:57.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.159+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c04f500 con 0x7f732c071f10 2024-04-24T23:06:57.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.160+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7314044070 con 0x7f732c071f10 2024-04-24T23:06:57.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.161+0000 7f7322a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:57.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.161+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6302+0+0 (secure 0 0 0) 0x7f73140abeb0 con 0x7f732c071f10 2024-04-24T23:06:57.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.162+0000 7f732a800640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:57.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.163+0000 7f732a800640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 0x7f730806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f731c001dc0 tx=0x7f731c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:57.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.165+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f731407a720 con 0x7f732c071f10 2024-04-24T23:06:57.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:57.363+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f732c0724a0 con 0x7f732c071f10 2024-04-24T23:06:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.226+0000 7f7322a00640 1 -- 172.21.15.146:0/2084682692 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f731407a020 con 0x7f732c071f10 2024-04-24T23:06:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 msgr2=0x7f730806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 0x7f730806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f731c001dc0 tx=0x7f731c009040 comp rx=0 tx=0).stop 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 msgr2=0x7f732c147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f73140046c0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 shutdown_connections 2024-04-24T23:06:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f730806be30 0x7f730806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f732c0cc200 0x7f732c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c071f10 0x7f732c147230 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 --2- 172.21.15.146:0/2084682692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f732c06e230 0x7f732c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.230+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 >> 172.21.15.146:0/2084682692 conn(0x7f732c0b1460 msgr2=0x7f732c071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.231+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 shutdown_connections 2024-04-24T23:06:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.231+0000 7f7330a00640 1 -- 172.21.15.146:0/2084682692 wait complete. 2024-04-24T23:06:58.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:06:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.450+0000 7f8c9a000640 1 Processor -- start 2024-04-24T23:06:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.450+0000 7f8c9a000640 1 -- start start 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.451+0000 7f8c9a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8c94071f10 0x7f8c940cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c9a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c9415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c9a000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c9406e230 0x7f8c9406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c9a000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8c9406ebc0 con 0x7f8c9406e230 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c9a000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8c940722f0 con 0x7f8c94071f10 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c9a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9415c700 con 0x7f8c9406db30 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c99600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c9406e230 0x7f8c9406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c99600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c9406e230 0x7f8c9406e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36934/0 (socket says 172.21.15.146:36934) 2024-04-24T23:06:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c99600640 1 -- 172.21.15.146:0/4029467403 learned_addr learned my addr 172.21.15.146:0/4029467403 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:58.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c98c00640 1 --2- 172.21.15.146:0/4029467403 >> v2:172.21.15.203:3300/0 conn(0x7f8c94071f10 0x7f8c940cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.452+0000 7f8c93e00640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c9415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.453+0000 7f8c99600640 1 -- 172.21.15.146:0/4029467403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 msgr2=0x7f8c9415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.453+0000 7f8c99600640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c9415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.453+0000 7f8c99600640 1 -- 172.21.15.146:0/4029467403 >> v2:172.21.15.203:3300/0 conn(0x7f8c94071f10 msgr2=0x7f8c940cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.453+0000 7f8c99600640 1 --2- 172.21.15.146:0/4029467403 >> v2:172.21.15.203:3300/0 conn(0x7f8c94071f10 0x7f8c940cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.453+0000 7f8c99600640 1 -- 172.21.15.146:0/4029467403 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c94160420 con 0x7f8c9406e230 2024-04-24T23:06:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.454+0000 7f8c99600640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c9406e230 0x7f8c9406e680 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8c940d08d0 tx=0x7f8c8c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b321de68201dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.454+0000 7f8c93400640 1 -- 172.21.15.146:0/4029467403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c036070 con 0x7f8c9406e230 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.454+0000 7f8c93400640 1 -- 172.21.15.146:0/4029467403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c031600 con 0x7f8c9406e230 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.454+0000 7f8c93400640 1 -- 172.21.15.146:0/4029467403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0319d0 con 0x7f8c9406e230 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 -- 172.21.15.146:0/4029467403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c9406e230 msgr2=0x7f8c9406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c9406e230 0x7f8c9406e680 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8c940d08d0 tx=0x7f8c8c02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 -- 172.21.15.146:0/4029467403 shutdown_connections 2024-04-24T23:06:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c9406e230 0x7f8c9406e680 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 --2- 172.21.15.146:0/4029467403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c9415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 --2- 172.21.15.146:0/4029467403 >> v2:172.21.15.203:3300/0 conn(0x7f8c94071f10 0x7f8c940cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 -- 172.21.15.146:0/4029467403 >> 172.21.15.146:0/4029467403 conn(0x7f8c940b1460 msgr2=0x7f8c940b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 -- 172.21.15.146:0/4029467403 shutdown_connections 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.455+0000 7f8c9a000640 1 -- 172.21.15.146:0/4029467403 wait complete. 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.457+0000 7f8c9a000640 1 Processor -- start 2024-04-24T23:06:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.457+0000 7f8c9a000640 1 -- start start 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c941482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 0x7f8c940b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9406dfb0 con 0x7f8c94071f10 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94159ce0 con 0x7f8c9406e230 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c9a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8c94160700 con 0x7f8c9406db30 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36936/0 (socket says 172.21.15.146:36936) 2024-04-24T23:06:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 -- 172.21.15.146:0/538878675 learned_addr learned my addr 172.21.15.146:0/538878675 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c98c00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c941482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c93e00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 0x7f8c940b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 -- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 msgr2=0x7f8c941482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c941482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 -- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 msgr2=0x7f8c940b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 0x7f8c940b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c99600640 1 -- 172.21.15.146:0/538878675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c94154c90 con 0x7f8c94071f10 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c98c00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c941482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.458+0000 7f8c93e00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 0x7f8c940b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c99600640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02ac90 tx=0x7f8c8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c03f020 con 0x7f8c94071f10 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c037040 con 0x7f8c94071f10 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9415aac0 con 0x7f8c94071f10 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c036070 con 0x7f8c94071f10 2024-04-24T23:06:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.459+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9415b080 con 0x7f8c94071f10 2024-04-24T23:06:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.461+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9404f500 con 0x7f8c94071f10 2024-04-24T23:06:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.461+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c8c042020 con 0x7f8c94071f10 2024-04-24T23:06:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.462+0000 7f8c90c00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 0x7f8c7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.462+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5864+0+0 (secure 0 0 0) 0x7f8c8c0ab490 con 0x7f8c94071f10 2024-04-24T23:06:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.463+0000 7f8c98c00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 0x7f8c7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.464+0000 7f8c98c00640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 0x7f8c7406e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006fd0 tx=0x7f8c88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:58.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.466+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8c8c049030 con 0x7f8c94071f10 2024-04-24T23:06:58.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:58.665+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c940724a0 con 0x7f8c94071f10 2024-04-24T23:06:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.238+0000 7f8c90c00640 1 -- 172.21.15.146:0/538878675 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f8c8c079d10 con 0x7f8c94071f10 2024-04-24T23:06:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:06:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 msgr2=0x7f8c7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 0x7f8c7406e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006fd0 tx=0x7f8c88008040 comp rx=0 tx=0).stop 2024-04-24T23:06:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 msgr2=0x7f8c9415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02ac90 tx=0x7f8c8c004a40 comp rx=0 tx=0).stop 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 shutdown_connections 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94071f10 0x7f8c9415dbe0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c9406e230 0x7f8c940b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8c7406be30 0x7f8c7406e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 --2- 172.21.15.146:0/538878675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8c9406db30 0x7f8c941482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.242+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 >> 172.21.15.146:0/538878675 conn(0x7f8c940b1460 msgr2=0x7f8c940ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.243+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 shutdown_connections 2024-04-24T23:06:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.243+0000 7f8c9a000640 1 -- 172.21.15.146:0/538878675 wait complete. 2024-04-24T23:06:59.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:06:59.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.472+0000 7fb1f5400640 1 Processor -- start 2024-04-24T23:06:59.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.472+0000 7fb1f5400640 1 -- start start 2024-04-24T23:06:59.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1f5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1f015c360 0x7fb1f00cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1f5400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00cf460 con 0x7fb1f00ce210 2024-04-24T23:06:59.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1f5400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00b14a0 con 0x7fb1f015c360 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1f5400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00b1d40 con 0x7fb1f00cda40 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1ee800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1f015c360 0x7fb1f00cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.473+0000 7fb1ede00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1f00ce210 0x7fb1f00b21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60504/0 (socket says 172.21.15.146:60504) 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ede00640 1 -- 172.21.15.146:0/361982609 learned_addr learned my addr 172.21.15.146:0/361982609 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ef200640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ed400640 1 -- 172.21.15.146:0/361982609 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744572027 0 0) 0x7fb1f00cf460 con 0x7fb1f00ce210 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ed400640 1 -- 172.21.15.146:0/361982609 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d4003520 con 0x7fb1f00ce210 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ee800640 1 -- 172.21.15.146:0/361982609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 msgr2=0x7fb1f00d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ee800640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ee800640 1 -- 172.21.15.146:0/361982609 >> v1:172.21.15.146:6789/0 conn(0x7fb1f00ce210 legacy=0x7fb1f00b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.474+0000 7fb1ee800640 1 -- 172.21.15.146:0/361982609 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00b16f0 con 0x7fb1f015c360 2024-04-24T23:06:59.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.475+0000 7fb1ee800640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f00cfe10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009d90 tx=0x7fb1e002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d426b09c9f928cd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1ed400640 1 -- 172.21.15.146:0/361982609 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0007740 con 0x7fb1f015c360 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1ed400640 1 -- 172.21.15.146:0/361982609 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e00078e0 con 0x7fb1f015c360 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1ed400640 1 -- 172.21.15.146:0/361982609 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0007cb0 con 0x7fb1f015c360 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 -- 172.21.15.146:0/361982609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 msgr2=0x7fb1f00cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f00cfe10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009d90 tx=0x7fb1e002a530 comp rx=0 tx=0).stop 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 -- 172.21.15.146:0/361982609 shutdown_connections 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 --2- 172.21.15.146:0/361982609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f00cfe10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 -- 172.21.15.146:0/361982609 >> 172.21.15.146:0/361982609 conn(0x7fb1f00d1d00 msgr2=0x7fb1f00d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 -- 172.21.15.146:0/361982609 shutdown_connections 2024-04-24T23:06:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.476+0000 7fb1f5400640 1 -- 172.21.15.146:0/361982609 wait complete. 2024-04-24T23:06:59.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.478+0000 7fb1f5400640 1 Processor -- start 2024-04-24T23:06:59.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.478+0000 7fb1f5400640 1 -- start start 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f00ce210 0x7fb1f01f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f015c740 con 0x7fb1f015c360 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00cf100 con 0x7fb1f00ce210 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.479+0000 7fb1f5400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f015c8c0 con 0x7fb1f00cda40 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36948/0 (socket says 172.21.15.146:36948) 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 -- 172.21.15.146:0/2414667395 learned_addr learned my addr 172.21.15.146:0/2414667395 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ee800640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ede00640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f00ce210 0x7fb1f01f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 -- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 msgr2=0x7fb1f00b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 -- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f00ce210 msgr2=0x7fb1f01f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f00ce210 0x7fb1f01f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 -- 172.21.15.146:0/2414667395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f006c3d0 con 0x7fb1f015c360 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.480+0000 7fb1ef200640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800d800 tx=0x7fb1e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.481+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800b6c0 con 0x7fb1f015c360 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.481+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e8019070 con 0x7fb1f015c360 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.481+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800bac0 con 0x7fb1f015c360 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.481+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00cbb30 con 0x7fb1f015c360 2024-04-24T23:06:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.481+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00b7810 con 0x7fb1f015c360 2024-04-24T23:06:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.482+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f004f570 con 0x7fb1f015c360 2024-04-24T23:06:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.483+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1e800bc60 con 0x7fb1f015c360 2024-04-24T23:06:59.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.485+0000 7fb1e6a00640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.485+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7fb1e808b1c0 con 0x7fb1f015c360 2024-04-24T23:06:59.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.485+0000 7fb1ee800640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.487+0000 7fb1ee800640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.489+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb1e8059bf0 con 0x7fb1f015c360 2024-04-24T23:06:59.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.687+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb1f00c5180 con 0x7fb1f015c360 2024-04-24T23:06:59.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.694+0000 7fb1e6a00640 1 -- 172.21.15.146:0/2414667395 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fb1e80594f0 con 0x7fb1f015c360 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.696+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 msgr2=0x7fb1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.696+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e002f000 comp rx=0 tx=0).stop 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 msgr2=0x7fb1f01f7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800d800 tx=0x7fb1e800dcc0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 shutdown_connections 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f015c360 0x7fb1f01f7f50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f00ce210 0x7fb1f01f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 --2- 172.21.15.146:0/2414667395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb1f00cda40 0x7fb1f00b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 >> 172.21.15.146:0/2414667395 conn(0x7fb1f00d1d00 msgr2=0x7fb1f015b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:59.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 shutdown_connections 2024-04-24T23:06:59.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.697+0000 7fb1f5400640 1 -- 172.21.15.146:0/2414667395 wait complete. 2024-04-24T23:06:59.716 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-04-24T23:06:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.915+0000 7faf3be00640 1 Processor -- start 2024-04-24T23:06:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.915+0000 7faf3be00640 1 -- start start 2024-04-24T23:06:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf3c0d0240 0x7faf3c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3c0ccb10 con 0x7faf3c15a980 2024-04-24T23:06:59.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faf3c072240 con 0x7faf3c0d0240 2024-04-24T23:06:59.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c0aede0 con 0x7faf3c071dd0 2024-04-24T23:06:59.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faf3c15a980 0x7faf3c0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60508/0 (socket says 172.21.15.146:60508) 2024-04-24T23:06:59.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.917+0000 7faf3aa00640 1 -- 172.21.15.146:0/516741535 learned_addr learned my addr 172.21.15.146:0/516741535 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:06:59.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3a000640 1 --2- 172.21.15.146:0/516741535 >> v2:172.21.15.146:3300/0 conn(0x7faf3c0d0240 0x7faf3c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3b400640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf39600640 1 -- 172.21.15.146:0/516741535 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301324815 0 0) 0x7faf2c001490 con 0x7faf3c15a980 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf39600640 1 -- 172.21.15.146:0/516741535 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf20003520 con 0x7faf3c15a980 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3a000640 1 -- 172.21.15.146:0/516741535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 msgr2=0x7faf3c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3a000640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3a000640 1 -- 172.21.15.146:0/516741535 >> v1:172.21.15.146:6789/0 conn(0x7faf3c15a980 legacy=0x7faf3c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.918+0000 7faf3a000640 1 -- 172.21.15.146:0/516741535 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c06ddc0 con 0x7faf3c0d0240 2024-04-24T23:06:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.919+0000 7faf3a000640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c06d770 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6a50d3141857e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.919+0000 7faf39600640 1 -- 172.21.15.146:0/516741535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28037070 con 0x7faf3c0d0240 2024-04-24T23:06:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf39600640 1 -- 172.21.15.146:0/516741535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2802ae40 con 0x7faf3c0d0240 2024-04-24T23:06:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf39600640 1 -- 172.21.15.146:0/516741535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28032640 con 0x7faf3c0d0240 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 -- 172.21.15.146:0/516741535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 msgr2=0x7faf3c06d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c06d770 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802a130 comp rx=0 tx=0).stop 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 -- 172.21.15.146:0/516741535 shutdown_connections 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 --2- 172.21.15.146:0/516741535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c06d770 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 -- 172.21.15.146:0/516741535 >> 172.21.15.146:0/516741535 conn(0x7faf3c06b320 msgr2=0x7faf3c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 -- 172.21.15.146:0/516741535 shutdown_connections 2024-04-24T23:06:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.920+0000 7faf3be00640 1 -- 172.21.15.146:0/516741535 wait complete. 2024-04-24T23:06:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.922+0000 7faf3be00640 1 Processor -- start 2024-04-24T23:06:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.922+0000 7faf3be00640 1 -- start start 2024-04-24T23:06:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 0x7faf3c1e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c06e660 con 0x7faf3c0d0240 2024-04-24T23:06:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c06e380 con 0x7faf3c15a980 2024-04-24T23:06:59.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c15ad60 con 0x7faf3c071dd0 2024-04-24T23:06:59.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36964/0 (socket says 172.21.15.146:36964) 2024-04-24T23:06:59.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.923+0000 7faf3a000640 1 -- 172.21.15.146:0/1098650725 learned_addr learned my addr 172.21.15.146:0/1098650725 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3aa00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3b400640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 0x7faf3c1e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 -- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 msgr2=0x7faf3c147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 -- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 msgr2=0x7faf3c1e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 0x7faf3c1e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:06:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 -- 172.21.15.146:0/1098650725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c1f2950 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3b400640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 0x7faf3c1e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf3a000640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faf28035040 tx=0x7faf280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.924+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28041070 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.925+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2803c670 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.925+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28037040 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.925+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3c0aa430 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.925+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c0aa9f0 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.926+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3c04f500 con 0x7faf3c0d0240 2024-04-24T23:06:59.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.927+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf28044070 con 0x7faf3c0d0240 2024-04-24T23:06:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.927+0000 7faf32a00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 0x7faf1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:06:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.928+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7faf280ab1d0 con 0x7faf3c0d0240 2024-04-24T23:06:59.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.928+0000 7faf3aa00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 0x7faf1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:06:59.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.929+0000 7faf3aa00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 0x7faf1c06e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf2c001630 tx=0x7faf2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:06:59.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:06:59.932+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faf28079c90 con 0x7faf3c0d0240 2024-04-24T23:07:00.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.204+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) -- 0x7faf3c0ceeb0 con 0x7faf3c0d0240 2024-04-24T23:07:00.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.241+0000 7faf32a00640 1 -- 172.21.15.146:0/1098650725 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v312) ==== 148+0+0 (secure 0 0 0) 0x7faf28079590 con 0x7faf3c0d0240 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 msgr2=0x7faf1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 0x7faf1c06e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf2c001630 tx=0x7faf2c009040 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 msgr2=0x7faf3c1e2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faf28035040 tx=0x7faf280046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 shutdown_connections 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf3c15a980 0x7faf3c1e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf3c0d0240 0x7faf3c1e2ff0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf1c06be30 0x7faf1c06e2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 --2- 172.21.15.146:0/1098650725 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf3c071dd0 0x7faf3c147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.244+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 >> 172.21.15.146:0/1098650725 conn(0x7faf3c06b320 msgr2=0x7faf3c0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.245+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 shutdown_connections 2024-04-24T23:07:00.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.245+0000 7faf3be00640 1 -- 172.21.15.146:0/1098650725 wait complete. 2024-04-24T23:07:00.265 INFO:tasks.cephfs_test_runner:test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-04-24T23:07:00.266 INFO:tasks.cephfs_test_runner:Starting test: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) That after forcibly modifying the backing store, we can get back into 2024-04-24T23:07:00.266 INFO:tasks.cephfs_test_runner:test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-04-24T23:07:00.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:00.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.460+0000 7f5146800640 1 Processor -- start 2024-04-24T23:07:00.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.460+0000 7f5146800640 1 -- start start 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5146800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f51400d03a0 0x7f5140070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5146800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f51400728c0 0x7f5140071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5146800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51401449c0 con 0x7f51401445e0 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5146800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5140072430 con 0x7f51400d03a0 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5146800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f51400b2d70 con 0x7f51400728c0 2024-04-24T23:07:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f513f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51401445e0 0x7f51400cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60514/0 (socket says 172.21.15.146:60514) 2024-04-24T23:07:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f513f400640 1 -- 172.21.15.146:0/1385671130 learned_addr learned my addr 172.21.15.146:0/1385671130 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.462+0000 7f5136a00640 1 --2- 172.21.15.146:0/1385671130 >> v2:172.21.15.146:3300/0 conn(0x7f51400d03a0 0x7f5140070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f513ea00640 1 -- 172.21.15.146:0/1385671130 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760616667 0 0) 0x7f51401449c0 con 0x7f51401445e0 2024-04-24T23:07:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f513ea00640 1 -- 172.21.15.146:0/1385671130 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5124003520 con 0x7f51401445e0 2024-04-24T23:07:00.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f513fe00640 1 --2- 172.21.15.146:0/1385671130 >> v2:172.21.15.203:3300/0 conn(0x7f51400728c0 0x7f5140071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f5136a00640 1 -- 172.21.15.146:0/1385671130 >> v2:172.21.15.203:3300/0 conn(0x7f51400728c0 msgr2=0x7f5140071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:00.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f5136a00640 1 --2- 172.21.15.146:0/1385671130 >> v2:172.21.15.203:3300/0 conn(0x7f51400728c0 0x7f5140071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f5136a00640 1 -- 172.21.15.146:0/1385671130 >> v1:172.21.15.146:6789/0 conn(0x7f51401445e0 legacy=0x7f51400cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.463+0000 7f5136a00640 1 -- 172.21.15.146:0/1385671130 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5140071820 con 0x7f51400d03a0 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.464+0000 7f5136a00640 1 --2- 172.21.15.146:0/1385671130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f5140070c10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51400ccca0 tx=0x7f512802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48dcf710228342e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.464+0000 7f513ea00640 1 -- 172.21.15.146:0/1385671130 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128037070 con 0x7f51400d03a0 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.464+0000 7f513ea00640 1 -- 172.21.15.146:0/1385671130 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128032440 con 0x7f51400d03a0 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.464+0000 7f513ea00640 1 -- 172.21.15.146:0/1385671130 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128032810 con 0x7f51400d03a0 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 -- 172.21.15.146:0/1385671130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 msgr2=0x7f5140070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 --2- 172.21.15.146:0/1385671130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f5140070c10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51400ccca0 tx=0x7f512802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 -- 172.21.15.146:0/1385671130 shutdown_connections 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 --2- 172.21.15.146:0/1385671130 >> v2:172.21.15.203:3300/0 conn(0x7f51400728c0 0x7f5140071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 --2- 172.21.15.146:0/1385671130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f5140070c10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 -- 172.21.15.146:0/1385671130 >> 172.21.15.146:0/1385671130 conn(0x7f514006b320 msgr2=0x7f514006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 -- 172.21.15.146:0/1385671130 shutdown_connections 2024-04-24T23:07:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.465+0000 7f5146800640 1 -- 172.21.15.146:0/1385671130 wait complete. 2024-04-24T23:07:00.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.467+0000 7f5146800640 1 Processor -- start 2024-04-24T23:07:00.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.467+0000 7f5146800640 1 -- start start 2024-04-24T23:07:00.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51400728c0 0x7f5140137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 0x7f51400ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51400720c0 con 0x7f51400d03a0 2024-04-24T23:07:00.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5140071de0 con 0x7f51401445e0 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5146800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f514006cbc0 con 0x7f51400728c0 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5136a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5136a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36984/0 (socket says 172.21.15.146:36984) 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5136a00640 1 -- 172.21.15.146:0/3950420455 learned_addr learned my addr 172.21.15.146:0/3950420455 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f513fe00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 0x7f51400ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f5136a00640 1 -- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51400728c0 msgr2=0x7f5140137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.468+0000 7f513f400640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51400728c0 0x7f5140137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5136a00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51400728c0 0x7f5140137b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5136a00640 1 -- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 msgr2=0x7f51400ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5136a00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 0x7f51400ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5136a00640 1 -- 172.21.15.146:0/3950420455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5140138050 con 0x7f51400d03a0 2024-04-24T23:07:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f513fe00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 0x7f51400ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5136a00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f51280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128037040 con 0x7f51400d03a0 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128042070 con 0x7f51400d03a0 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128030960 con 0x7f51400d03a0 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51400cd360 con 0x7f51400d03a0 2024-04-24T23:07:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.469+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51400ae430 con 0x7f51400d03a0 2024-04-24T23:07:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.471+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5140068190 con 0x7f51400d03a0 2024-04-24T23:07:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.471+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5128030b00 con 0x7f51400d03a0 2024-04-24T23:07:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.472+0000 7f5137e00640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 0x7f511c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.472+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7f51280ab600 con 0x7f51400d03a0 2024-04-24T23:07:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.473+0000 7f513f400640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 0x7f511c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.474+0000 7f513f400640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 0x7f511c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5130000f60 tx=0x7f5130009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.477+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f512807a160 con 0x7f51400d03a0 2024-04-24T23:07:00.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.677+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f514013b250 con 0x7f51400d03a0 2024-04-24T23:07:00.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.679+0000 7f5137e00640 1 -- 172.21.15.146:0/3950420455 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13451 (secure 0 0 0) 0x7f5128079a60 con 0x7f51400d03a0 2024-04-24T23:07:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:00.682 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":60,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:06:59.227219+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/3630709161":"2024-04-25T23:06:55.911964+0000","172.21.15.146:6833/3630709161":"2024-04-25T23:06:55.911964+0000","172.21.15.146:6835/1456962778":"2024-04-25T23:03:58.364770+0000","172.21.15.146:6833/1456962778":"2024-04-25T23:03:58.364770+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:00.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 msgr2=0x7f511c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 0x7f511c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5130000f60 tx=0x7f5130009040 comp rx=0 tx=0).stop 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 msgr2=0x7f51400ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f51280046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 shutdown_connections 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51401445e0 0x7f51400ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400d03a0 0x7f51400ad8c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f511c06be30 0x7f511c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 --2- 172.21.15.146:0/3950420455 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51400728c0 0x7f5140137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 >> 172.21.15.146:0/3950420455 conn(0x7f514006b320 msgr2=0x7f514013b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 shutdown_connections 2024-04-24T23:07:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.682+0000 7f5146800640 1 -- 172.21.15.146:0/3950420455 wait complete. 2024-04-24T23:07:00.707 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:07:00.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:07:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.915+0000 7fb085600640 1 Processor -- start 2024-04-24T23:07:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.915+0000 7fb085600640 1 -- start start 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb085600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb08015bcd0 0x7fb0800cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb085600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 0x7fb08015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb085600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0800b4df0 con 0x7fb08015cd60 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb085600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb08015c8d0 con 0x7fb08015bcd0 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb085600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb0800b4b10 con 0x7fb0800d03d0 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb07fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb08015bcd0 0x7fb0800cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb07fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb08015bcd0 0x7fb0800cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36998/0 (socket says 172.21.15.146:36998) 2024-04-24T23:07:00.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb07fe00640 1 -- 172.21.15.146:0/3979234204 learned_addr learned my addr 172.21.15.146:0/3979234204 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:00.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.917+0000 7fb084c00640 1 --2- 172.21.15.146:0/3979234204 >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 0x7fb08015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.918+0000 7fb07fe00640 1 -- 172.21.15.146:0/3979234204 >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 msgr2=0x7fb08015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:00.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.918+0000 7fb07fe00640 1 --2- 172.21.15.146:0/3979234204 >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 0x7fb08015f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.918+0000 7fb07fe00640 1 -- 172.21.15.146:0/3979234204 >> v1:172.21.15.203:6789/0 conn(0x7fb08015cd60 legacy=0x7fb0800cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:00.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.918+0000 7fb07fe00640 1 -- 172.21.15.146:0/3979234204 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08015c280 con 0x7fb08015bcd0 2024-04-24T23:07:00.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.918+0000 7fb084c00640 1 --2- 172.21.15.146:0/3979234204 >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 0x7fb08015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:00.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.919+0000 7fb07fe00640 1 --2- 172.21.15.146:0/3979234204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08015bcd0 0x7fb0800cc230 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb08006da10 tx=0x7fb07002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531d9d402e08905a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.919+0000 7fb07f400640 1 -- 172.21.15.146:0/3979234204 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070037070 con 0x7fb08015bcd0 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.919+0000 7fb07f400640 1 -- 172.21.15.146:0/3979234204 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070032440 con 0x7fb08015bcd0 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.919+0000 7fb07f400640 1 -- 172.21.15.146:0/3979234204 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070032810 con 0x7fb08015bcd0 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 -- 172.21.15.146:0/3979234204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08015bcd0 msgr2=0x7fb0800cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 --2- 172.21.15.146:0/3979234204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08015bcd0 0x7fb0800cc230 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb08006da10 tx=0x7fb07002a230 comp rx=0 tx=0).stop 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 -- 172.21.15.146:0/3979234204 shutdown_connections 2024-04-24T23:07:00.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 --2- 172.21.15.146:0/3979234204 >> v2:172.21.15.203:3300/0 conn(0x7fb0800d03d0 0x7fb08015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 --2- 172.21.15.146:0/3979234204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08015bcd0 0x7fb0800cc230 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 -- 172.21.15.146:0/3979234204 >> 172.21.15.146:0/3979234204 conn(0x7fb08006b560 msgr2=0x7fb08006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:00.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 -- 172.21.15.146:0/3979234204 shutdown_connections 2024-04-24T23:07:00.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.920+0000 7fb085600640 1 -- 172.21.15.146:0/3979234204 wait complete. 2024-04-24T23:07:00.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.922+0000 7fb085600640 1 Processor -- start 2024-04-24T23:07:00.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.922+0000 7fb085600640 1 -- start start 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb08015bcd0 0x7fb0800709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 0x7fb0801585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb08006e590 con 0x7fb0800d03d0 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb0800cc770 con 0x7fb08015cd60 2024-04-24T23:07:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb085600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb0800b4790 con 0x7fb08015bcd0 2024-04-24T23:07:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb07fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb07fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37008/0 (socket says 172.21.15.146:37008) 2024-04-24T23:07:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.923+0000 7fb07fe00640 1 -- 172.21.15.146:0/3476677911 learned_addr learned my addr 172.21.15.146:0/3476677911 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb084c00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 0x7fb0801585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 -- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb08015bcd0 msgr2=0x7fb0800709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb08015bcd0 0x7fb0800709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 -- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 msgr2=0x7fb0801585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 0x7fb0801585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 -- 172.21.15.146:0/3476677911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb080071490 con 0x7fb0800d03d0 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb084c00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 0x7fb0801585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07fe00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb070000c00 tx=0x7fb0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070037040 con 0x7fb0800d03d0 2024-04-24T23:07:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070004250 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07003c670 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.924+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb080071770 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.925+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb080071d30 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.926+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08004f500 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.927+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb07003a070 con 0x7fb0800d03d0 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.928+0000 7fb07cc00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 0x7fb05c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.928+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7fb0700ab6e0 con 0x7fb0800d03d0 2024-04-24T23:07:00.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.928+0000 7fb077e00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 0x7fb05c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.930+0000 7fb077e00640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 0x7fb05c06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb068006fd0 tx=0x7fb068006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:00.932+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb070041020 con 0x7fb0800d03d0 2024-04-24T23:07:01.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.132+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb0800cf030 con 0x7fb0800d03d0 2024-04-24T23:07:01.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.133+0000 7fb07cc00640 1 -- 172.21.15.146:0/3476677911 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7fb07007a230 con 0x7fb0800d03d0 2024-04-24T23:07:01.135 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 msgr2=0x7fb05c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 0x7fb05c06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb068006fd0 tx=0x7fb068006bc0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 msgr2=0x7fb0801431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb070000c00 tx=0x7fb0700046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 shutdown_connections 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb08015cd60 0x7fb0801585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb05c06be30 0x7fb05c06e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb08015bcd0 0x7fb0800709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 --2- 172.21.15.146:0/3476677911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0800d03d0 0x7fb0801431b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 >> 172.21.15.146:0/3476677911 conn(0x7fb08006b560 msgr2=0x7fb08015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 shutdown_connections 2024-04-24T23:07:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.136+0000 7fb085600640 1 -- 172.21.15.146:0/3476677911 wait complete. 2024-04-24T23:07:01.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-04-24T23:07:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.360+0000 7f98df000640 1 Processor -- start 2024-04-24T23:07:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.360+0000 7f98df000640 1 -- start start 2024-04-24T23:07:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98df000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98d80b2a20 0x7f98d80cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98df000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98d806cbc0 0x7f98d80d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98df000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d80cdf70 con 0x7f98d8145640 2024-04-24T23:07:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98df000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f98d8145a20 con 0x7f98d806cbc0 2024-04-24T23:07:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98df000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f98d806d140 con 0x7f98d80b2a20 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.362+0000 7f98dd000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98d806cbc0 0x7f98d80d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98d806cbc0 0x7f98d80d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37018/0 (socket says 172.21.15.146:37018) 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 -- 172.21.15.146:0/2562134699 learned_addr learned my addr 172.21.15.146:0/2562134699 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98d7400640 1 --2- 172.21.15.146:0/2562134699 >> v2:172.21.15.203:3300/0 conn(0x7f98d80b2a20 0x7f98d80cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 -- 172.21.15.146:0/2562134699 >> v2:172.21.15.203:3300/0 conn(0x7f98d80b2a20 msgr2=0x7f98d80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 --2- 172.21.15.146:0/2562134699 >> v2:172.21.15.203:3300/0 conn(0x7f98d80b2a20 0x7f98d80cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 -- 172.21.15.146:0/2562134699 >> v1:172.21.15.203:6789/0 conn(0x7f98d8145640 legacy=0x7f98d815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.363+0000 7f98dd000640 1 -- 172.21.15.146:0/2562134699 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d806d420 con 0x7f98d806cbc0 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.364+0000 7f98dd000640 1 --2- 172.21.15.146:0/2562134699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d806cbc0 0x7f98d80d01d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f98d8072f30 tx=0x7f98d002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d1d98526f9af84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.364+0000 7f98d6a00640 1 -- 172.21.15.146:0/2562134699 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0036070 con 0x7f98d806cbc0 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.364+0000 7f98d6a00640 1 -- 172.21.15.146:0/2562134699 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0031600 con 0x7f98d806cbc0 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.364+0000 7f98d6a00640 1 -- 172.21.15.146:0/2562134699 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00319d0 con 0x7f98d806cbc0 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 -- 172.21.15.146:0/2562134699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d806cbc0 msgr2=0x7f98d80d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 --2- 172.21.15.146:0/2562134699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d806cbc0 0x7f98d80d01d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f98d8072f30 tx=0x7f98d002a730 comp rx=0 tx=0).stop 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 -- 172.21.15.146:0/2562134699 shutdown_connections 2024-04-24T23:07:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 --2- 172.21.15.146:0/2562134699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d806cbc0 0x7f98d80d01d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 --2- 172.21.15.146:0/2562134699 >> v2:172.21.15.203:3300/0 conn(0x7f98d80b2a20 0x7f98d80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 -- 172.21.15.146:0/2562134699 >> 172.21.15.146:0/2562134699 conn(0x7f98d806b320 msgr2=0x7f98d806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:01.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 -- 172.21.15.146:0/2562134699 shutdown_connections 2024-04-24T23:07:01.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.365+0000 7f98df000640 1 -- 172.21.15.146:0/2562134699 wait complete. 2024-04-24T23:07:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.367+0000 7f98df000640 1 Processor -- start 2024-04-24T23:07:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.367+0000 7f98df000640 1 -- start start 2024-04-24T23:07:01.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98d806cbc0 0x7f98d8152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98d80b2a20 0x7f98d81382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98d80ce450 con 0x7f98d8145640 2024-04-24T23:07:01.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98d806d9e0 con 0x7f98d806cbc0 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.368+0000 7f98df000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98d80ce5d0 con 0x7f98d80b2a20 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37026/0 (socket says 172.21.15.146:37026) 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 -- 172.21.15.146:0/357545219 learned_addr learned my addr 172.21.15.146:0/357545219 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98d7e00640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98d806cbc0 0x7f98d8152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98d7400640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98d80b2a20 0x7f98d81382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 -- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98d80b2a20 msgr2=0x7f98d81382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98d80b2a20 0x7f98d81382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 -- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98d806cbc0 msgr2=0x7f98d8152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98d806cbc0 0x7f98d8152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 -- 172.21.15.146:0/357545219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d8152a90 con 0x7f98d8145640 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.369+0000 7f98dd000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009f40 tx=0x7f98d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:01.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.370+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0036050 con 0x7f98d8145640 2024-04-24T23:07:01.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.370+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0042070 con 0x7f98d8145640 2024-04-24T23:07:01.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.370+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d81f81c0 con 0x7f98d8145640 2024-04-24T23:07:01.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.370+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0009510 con 0x7f98d8145640 2024-04-24T23:07:01.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.370+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d8137ad0 con 0x7f98d8145640 2024-04-24T23:07:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.371+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d8068190 con 0x7f98d8145640 2024-04-24T23:07:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.372+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98d0007bf0 con 0x7f98d8145640 2024-04-24T23:07:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.373+0000 7f98cfe00640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 0x7f98b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.373+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7f98d00abb30 con 0x7f98d8145640 2024-04-24T23:07:01.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.374+0000 7f98d7e00640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 0x7f98b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.375+0000 7f98d7e00640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 0x7f98b806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98d806b7b0 tx=0x7f98c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.378+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98d8152a90 con 0x7f98d8145640 2024-04-24T23:07:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:01.651+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) -- 0x7f98d8072c30 con 0x7f98d8145640 2024-04-24T23:07:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.247+0000 7f98cfe00640 1 -- 172.21.15.146:0/357545219 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v314) ==== 143+0+0 (secure 0 0 0) 0x7f98d0045360 con 0x7f98d8145640 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.250+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 msgr2=0x7f98b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.250+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 0x7f98b806e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f98d806b7b0 tx=0x7f98c8009040 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 msgr2=0x7f98d81f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009f40 tx=0x7f98d0004a40 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 shutdown_connections 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98d8145640 0x7f98d81f7650 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f98b806be30 0x7f98b806e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98d80b2a20 0x7f98d81382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 --2- 172.21.15.146:0/357545219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98d806cbc0 0x7f98d8152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 >> 172.21.15.146:0/357545219 conn(0x7f98d806b320 msgr2=0x7f98d80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 shutdown_connections 2024-04-24T23:07:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.251+0000 7f98df000640 1 -- 172.21.15.146:0/357545219 wait complete. 2024-04-24T23:07:02.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:07:02.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.480+0000 7fcb72800640 1 Processor -- start 2024-04-24T23:07:02.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.480+0000 7fcb72800640 1 -- start start 2024-04-24T23:07:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.482+0000 7fcb72800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 0x7fcb6c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.482+0000 7fcb72800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcb6c15f3c0 0x7fcb6c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.482+0000 7fcb72800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c071960 con 0x7fcb6c15e8b0 2024-04-24T23:07:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.482+0000 7fcb72800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c071c40 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.482+0000 7fcb72800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c071f20 con 0x7fcb6c15abb0 2024-04-24T23:07:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.483+0000 7fcb6aa00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fcb6c15e8b0 0x7fcb6c15ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:35576/0 (socket says 172.21.15.146:35576) 2024-04-24T23:07:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.483+0000 7fcb6aa00640 1 -- 172.21.15.146:0/3049527119 learned_addr learned my addr 172.21.15.146:0/3049527119 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.483+0000 7fcb6b400640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 0x7fcb6c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.483+0000 7fcb6be00640 1 --2- 172.21.15.146:0/3049527119 >> v2:172.21.15.203:3300/0 conn(0x7fcb6c15f3c0 0x7fcb6c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6a000640 1 -- 172.21.15.146:0/3049527119 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038930219 0 0) 0x7fcb6c071960 con 0x7fcb6c15e8b0 2024-04-24T23:07:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6a000640 1 -- 172.21.15.146:0/3049527119 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb4c005730 con 0x7fcb6c15e8b0 2024-04-24T23:07:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6be00640 1 -- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 msgr2=0x7fcb6c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6be00640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 0x7fcb6c06cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6be00640 1 -- 172.21.15.146:0/3049527119 >> v1:172.21.15.203:6789/0 conn(0x7fcb6c15e8b0 legacy=0x7fcb6c15ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6be00640 1 -- 172.21.15.146:0/3049527119 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c072200 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.484+0000 7fcb6b400640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 0x7fcb6c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:07:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.485+0000 7fcb6be00640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c15c7b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097a0 tx=0x7fcb6402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fddf0997846522d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.486+0000 7fcb6a000640 1 -- 172.21.15.146:0/3049527119 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64037070 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.486+0000 7fcb6a000640 1 -- 172.21.15.146:0/3049527119 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6402ae50 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.486+0000 7fcb6a000640 1 -- 172.21.15.146:0/3049527119 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64032660 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 -- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15f3c0 msgr2=0x7fcb6c15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c15c7b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097a0 tx=0x7fcb6402a100 comp rx=0 tx=0).stop 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 -- 172.21.15.146:0/3049527119 shutdown_connections 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c15c7b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 --2- 172.21.15.146:0/3049527119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15abb0 0x7fcb6c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 -- 172.21.15.146:0/3049527119 >> 172.21.15.146:0/3049527119 conn(0x7fcb6c06b140 msgr2=0x7fcb6c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 -- 172.21.15.146:0/3049527119 shutdown_connections 2024-04-24T23:07:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.487+0000 7fcb72800640 1 -- 172.21.15.146:0/3049527119 wait complete. 2024-04-24T23:07:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.489+0000 7fcb72800640 1 Processor -- start 2024-04-24T23:07:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.489+0000 7fcb72800640 1 -- start start 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15abb0 0x7fcb6c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15e8b0 0x7fcb6c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c15c120 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c15bfa0 con 0x7fcb6c15abb0 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb72800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c15ccf0 con 0x7fcb6c15e8b0 2024-04-24T23:07:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37042/0 (socket says 172.21.15.146:37042) 2024-04-24T23:07:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb6be00640 1 -- 172.21.15.146:0/1682071962 learned_addr learned my addr 172.21.15.146:0/1682071962 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb6b400640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15abb0 0x7fcb6c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.490+0000 7fcb6aa00640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15e8b0 0x7fcb6c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 -- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15e8b0 msgr2=0x7fcb6c0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15e8b0 0x7fcb6c0b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 -- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15abb0 msgr2=0x7fcb6c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15abb0 0x7fcb6c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 -- 172.21.15.146:0/1682071962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c0cd260 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb6be00640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcb64035040 tx=0x7fcb640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64041070 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6403c460 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64037040 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c0cd540 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.491+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c0c9ad0 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.493+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c04f5a0 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.493+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb64044070 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.494+0000 7fcb63400640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:02.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.494+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7fcb640ab420 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.495+0000 7fcb6b400640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:02.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.496+0000 7fcb6b400640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009560 tx=0x7fcb5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:02.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.499+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb6407a000 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.696+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcb6c073e70 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.701+0000 7fcb63400640 1 -- 172.21.15.146:0/1682071962 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fcb64079900 con 0x7fcb6c15f3c0 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 msgr2=0x7fcb4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009560 tx=0x7fcb5c008040 comp rx=0 tx=0).stop 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 msgr2=0x7fcb6c152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcb64035040 tx=0x7fcb640046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 shutdown_connections 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb6c15f3c0 0x7fcb6c152270 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb6c15e8b0 0x7fcb6c0b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 --2- 172.21.15.146:0/1682071962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb6c15abb0 0x7fcb6c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 >> 172.21.15.146:0/1682071962 conn(0x7fcb6c06b140 msgr2=0x7fcb6c156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 shutdown_connections 2024-04-24T23:07:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:02.704+0000 7fcb72800640 1 -- 172.21.15.146:0/1682071962 wait complete. 2024-04-24T23:07:02.725 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:07:02.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:07:02.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:07:02.933 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:07:02.933 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:07:02.933 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:02.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:07:02.991 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:07:02.992 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:03.049 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:07:03.049 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:07:03.049 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:03.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:07:03.110 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:07:03.111 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:03.169 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:07:03.169 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:07:03.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.379+0000 7f0014a00640 1 Processor -- start 2024-04-24T23:07:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.379+0000 7f0014a00640 1 -- start start 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.380+0000 7f0014a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f001015a980 0x7f001006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f0014a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00100ccb10 con 0x7f00100d0240 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f0014a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001006ddc0 con 0x7f0010071dd0 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f0014a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0010072230 con 0x7f001015a980 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f000fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f00100d0240 0x7f00100ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60528/0 (socket says 172.21.15.146:60528) 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f000fe00640 1 -- 172.21.15.146:0/1430850146 learned_addr learned my addr 172.21.15.146:0/1430850146 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594099516 0 0) 0x7f0008001490 con 0x7f00100d0240 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff4003520 con 0x7f00100d0240 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.381+0000 7f000f400640 1 --2- 172.21.15.146:0/1430850146 >> v2:172.21.15.203:3300/0 conn(0x7f001015a980 0x7f001006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2769374075 0 0) 0x7efff4003520 con 0x7f00100d0240 2024-04-24T23:07:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 >> v2:172.21.15.203:3300/0 conn(0x7f001015a980 msgr2=0x7f001006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 --2- 172.21.15.146:0/1430850146 >> v2:172.21.15.203:3300/0 conn(0x7f001015a980 0x7f001006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 >> v1:172.21.15.203:6789/0 conn(0x7f0010071dd0 legacy=0x7f00100cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001006e0a0 con 0x7f00100d0240 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f0008001bc0 con 0x7f00100d0240 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 >> v1:172.21.15.146:6789/0 conn(0x7f00100d0240 legacy=0x7f00100ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40039b0 0x7efff4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efff4004800 0x7efff4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 0x7efff400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0010072230 con 0x7efff40052e0 2024-04-24T23:07:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efff400c1e0 con 0x7efff40039b0 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efff400c3e0 con 0x7efff4004800 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.382+0000 7f000fe00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 0x7efff400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000f400640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40039b0 0x7efff4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f0006a00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efff4004800 0x7efff4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000fe00640 1 -- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efff4004800 msgr2=0x7efff4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000fe00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efff4004800 0x7efff4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000fe00640 1 -- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40039b0 msgr2=0x7efff4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000fe00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40039b0 0x7efff4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.383+0000 7f000fe00640 1 -- 172.21.15.146:0/1430850146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff4003520 con 0x7efff40052e0 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.384+0000 7f000fe00640 1 -- 172.21.15.146:0/1430850146 reap_dead start 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.384+0000 7f000fe00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 0x7efff400b9c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f000800a9f0 tx=0x7efff4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c4bd27d5ad9467 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.384+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800a640 con 0x7efff40052e0 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.384+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000802f070 con 0x7efff40052e0 2024-04-24T23:07:03.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.384+0000 7f000ea00640 1 -- 172.21.15.146:0/1430850146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008034470 con 0x7efff40052e0 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 -- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 msgr2=0x7efff400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 0x7efff400b9c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f000800a9f0 tx=0x7efff4005830 comp rx=0 tx=0).stop 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 -- 172.21.15.146:0/1430850146 shutdown_connections 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 --2- 172.21.15.146:0/1430850146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff40052e0 0x7efff400b9c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 -- 172.21.15.146:0/1430850146 >> 172.21.15.146:0/1430850146 conn(0x7f001006b320 msgr2=0x7f001006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 -- 172.21.15.146:0/1430850146 shutdown_connections 2024-04-24T23:07:03.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.385+0000 7f0014a00640 1 -- 172.21.15.146:0/1430850146 wait complete. 2024-04-24T23:07:03.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.387+0000 7f0014a00640 1 Processor -- start 2024-04-24T23:07:03.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.387+0000 7f0014a00640 1 -- start start 2024-04-24T23:07:03.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40052e0 0x7f0010154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00100b1b00 0x7f00100b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f001006e660 con 0x7f001015d230 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f00100aede0 con 0x7efff40052e0 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0014a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f001015ad60 con 0x7f00100b1b00 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37062/0 (socket says 172.21.15.146:37062) 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 -- 172.21.15.146:0/2249507175 learned_addr learned my addr 172.21.15.146:0/2249507175 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000f400640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40052e0 0x7f0010154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f0006a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00100b1b00 0x7f00100b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 -- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00100b1b00 msgr2=0x7f00100b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00100b1b00 0x7f00100b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 -- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40052e0 msgr2=0x7f0010154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40052e0 0x7f0010154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.388+0000 7f000fe00640 1 -- 172.21.15.146:0/2249507175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00101f55f0 con 0x7f001015d230 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f000fe00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0008000f80 tx=0x7f001006df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000802be20 con 0x7f001015d230 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008034470 con 0x7f001015d230 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00101f58d0 con 0x7f001015d230 2024-04-24T23:07:03.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008034860 con 0x7f001015d230 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.389+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00101f5e90 con 0x7f001015d230 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.390+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001015dbf0 con 0x7f001015d230 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.391+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0008034a00 con 0x7f001015d230 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.392+0000 7f0007e00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 0x7effec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.392+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7f00080aad10 con 0x7f001015d230 2024-04-24T23:07:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.393+0000 7f000f400640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 0x7effec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.394+0000 7f000f400640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 0x7effec06e320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.397+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f00100ccb10 con 0x7f001015d230 2024-04-24T23:07:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.639+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f001004f500 con 0x7f001015d230 2024-04-24T23:07:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.640+0000 7f0007e00640 1 -- 172.21.15.146:0/2249507175 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+3881 (secure 0 0 0) 0x7f00080797e0 con 0x7f001015d230 2024-04-24T23:07:03.641 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:03.641 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1697688080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1697688080},{"type":"v1","addr":"172.21.15.203:6835","nonce":1697688080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/1473560673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":1473560673},{"type":"v1","addr":"172.21.15.203:6837","nonce":1473560673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5895,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2976780779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2976780779},{"type":"v1","addr":"172.21.15.146:6834","nonce":2976780779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":6579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1950588295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1950588295},{"type":"v1","addr":"172.21.15.146:6835","nonce":1950588295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[]} 2024-04-24T23:07:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 41 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.642+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 msgr2=0x7effec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.642+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 0x7effec06e320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).stop 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.642+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 msgr2=0x7f001015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.642+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0008000f80 tx=0x7f001006df90 comp rx=0 tx=0).stop 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 shutdown_connections 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f001015d230 0x7f001015d6b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7effec06be60 0x7effec06e320 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f00100b1b00 0x7f00100b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 --2- 172.21.15.146:0/2249507175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efff40052e0 0x7f0010154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 >> 172.21.15.146:0/2249507175 conn(0x7f001006b320 msgr2=0x7f00100cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 shutdown_connections 2024-04-24T23:07:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.643+0000 7f0014a00640 1 -- 172.21.15.146:0/2249507175 wait complete. 2024-04-24T23:07:03.663 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:07:03.663 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:07:03.663 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:07:03.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:07:03.664 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:07:03.664 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:07:03.664 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:07:03.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:07:03.664 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:07:03.664 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:07:03.664 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:07:03.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:07:03.665 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:07:03.665 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:07:03.665 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:07:03.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:07:03.679 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:07:03.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:07:03.681 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:07:03.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:07:03.695 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:07:03.695 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:07:03.696 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:07:03.696 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:07:03.728 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:07:03.729 DEBUG:teuthology.parallel:result is None 2024-04-24T23:07:03.735 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:07:03.735 DEBUG:teuthology.parallel:result is None 2024-04-24T23:07:03.743 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:07:03.744 DEBUG:teuthology.parallel:result is None 2024-04-24T23:07:03.749 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:07:03.749 DEBUG:teuthology.parallel:result is None 2024-04-24T23:07:03.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:07:03.876 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:07:03.876 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:07:03.899 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:07:03.900 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:07:03.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.928+0000 7f4067000640 1 Processor -- start 2024-04-24T23:07:03.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.928+0000 7f4067000640 1 -- start start 2024-04-24T23:07:03.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.929+0000 7f4067000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f406015abb0 0x7f406006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.929+0000 7f4067000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f406015f3f0 0x7f406015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.929+0000 7f4067000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4060071960 con 0x7f406015e8b0 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.929+0000 7f4067000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4060071c40 con 0x7f406015f3f0 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.929+0000 7f4067000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4060071f20 con 0x7f406015abb0 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4057e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f406015e8b0 0x7f406015ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60552/0 (socket says 172.21.15.146:60552) 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4057e00640 1 -- 172.21.15.146:0/2621447439 learned_addr learned my addr 172.21.15.146:0/2621447439 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4065000640 1 --2- 172.21.15.146:0/2621447439 >> v2:172.21.15.146:3300/0 conn(0x7f406015f3f0 0x7f406015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f405fe00640 1 --2- 172.21.15.146:0/2621447439 >> v2:172.21.15.203:3300/0 conn(0x7f406015abb0 0x7f406006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4065000640 1 -- 172.21.15.146:0/2621447439 >> v2:172.21.15.203:3300/0 conn(0x7f406015abb0 msgr2=0x7f406006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:03.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4065000640 1 --2- 172.21.15.146:0/2621447439 >> v2:172.21.15.203:3300/0 conn(0x7f406015abb0 0x7f406006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4065000640 1 -- 172.21.15.146:0/2621447439 >> v1:172.21.15.146:6789/0 conn(0x7f406015e8b0 legacy=0x7f406015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.930+0000 7f4065000640 1 -- 172.21.15.146:0/2621447439 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4060072200 con 0x7f406015f3f0 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.931+0000 7f4065000640 1 --2- 172.21.15.146:0/2621447439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f406015c7b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f40600d0b20 tx=0x7f405802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39afc4dc9e8cbd5b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.931+0000 7f405f400640 1 -- 172.21.15.146:0/2621447439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058007740 con 0x7f406015f3f0 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.931+0000 7f405f400640 1 -- 172.21.15.146:0/2621447439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40580078e0 con 0x7f406015f3f0 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.931+0000 7f405f400640 1 -- 172.21.15.146:0/2621447439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058007cb0 con 0x7f406015f3f0 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 -- 172.21.15.146:0/2621447439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 msgr2=0x7f406015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 --2- 172.21.15.146:0/2621447439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f406015c7b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f40600d0b20 tx=0x7f405802a680 comp rx=0 tx=0).stop 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 -- 172.21.15.146:0/2621447439 shutdown_connections 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 --2- 172.21.15.146:0/2621447439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f406015c7b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 --2- 172.21.15.146:0/2621447439 >> v2:172.21.15.203:3300/0 conn(0x7f406015abb0 0x7f406006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 -- 172.21.15.146:0/2621447439 >> 172.21.15.146:0/2621447439 conn(0x7f406006b140 msgr2=0x7f406006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:03.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 -- 172.21.15.146:0/2621447439 shutdown_connections 2024-04-24T23:07:03.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.932+0000 7f4067000640 1 -- 172.21.15.146:0/2621447439 wait complete. 2024-04-24T23:07:03.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.934+0000 7f4067000640 1 Processor -- start 2024-04-24T23:07:03.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.934+0000 7f4067000640 1 -- start start 2024-04-24T23:07:03.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f406015abb0 0x7f40600ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f406015e8b0 0x7f4060144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f406015c120 con 0x7f406015f3f0 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f406015bfa0 con 0x7f406015abb0 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4067000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f406015ccf0 con 0x7f406015e8b0 2024-04-24T23:07:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4065000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4065000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37126/0 (socket says 172.21.15.146:37126) 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4065000640 1 -- 172.21.15.146:0/969118933 learned_addr learned my addr 172.21.15.146:0/969118933 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f405fe00640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f406015abb0 0x7f40600ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.935+0000 7f4057e00640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f406015e8b0 0x7f4060144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 -- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f406015e8b0 msgr2=0x7f4060144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f406015e8b0 0x7f4060144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 -- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f406015abb0 msgr2=0x7f40600ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f406015abb0 0x7f40600ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 -- 172.21.15.146:0/969118933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40600caa60 con 0x7f406015f3f0 2024-04-24T23:07:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4065000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f405802ac70 tx=0x7f4058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405803f070 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058031bc0 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40600cad40 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.936+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058009450 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.937+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40600cb300 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.938+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406004f5a0 con 0x7f406015f3f0 2024-04-24T23:07:03.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.939+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f405803b410 con 0x7f406015f3f0 2024-04-24T23:07:03.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.939+0000 7f405cc00640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 0x7f403c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:03.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.940+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5421+0+0 (secure 0 0 0) 0x7f40580ac340 con 0x7f406015f3f0 2024-04-24T23:07:03.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.940+0000 7f405fe00640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 0x7f403c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:03.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.941+0000 7f405fe00640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 0x7f403c06e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4050009b40 tx=0x7f4050009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:03.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:03.944+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f405807a7f0 con 0x7f406015f3f0 2024-04-24T23:07:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.157+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4060156a90 con 0x7f406015f3f0 2024-04-24T23:07:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.271+0000 7f405cc00640 1 -- 172.21.15.146:0/969118933 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7f405807eaf0 con 0x7f406015f3f0 2024-04-24T23:07:04.272 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-04-24T23:07:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 msgr2=0x7f403c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 0x7f403c06e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4050009b40 tx=0x7f4050009190 comp rx=0 tx=0).stop 2024-04-24T23:07:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 msgr2=0x7f40600ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f405802ac70 tx=0x7f4058004a40 comp rx=0 tx=0).stop 2024-04-24T23:07:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 shutdown_connections 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406015f3f0 0x7f40600ced80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f403c06be60 0x7f403c06e320 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f406015e8b0 0x7f4060144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 --2- 172.21.15.146:0/969118933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f406015abb0 0x7f40600ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.274+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 >> 172.21.15.146:0/969118933 conn(0x7f406006b140 msgr2=0x7f4060070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.275+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 shutdown_connections 2024-04-24T23:07:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.275+0000 7f4067000640 1 -- 172.21.15.146:0/969118933 wait complete. 2024-04-24T23:07:04.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:07:04.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.490+0000 7f7d9dc00640 1 Processor -- start 2024-04-24T23:07:04.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.491+0000 7f7d9dc00640 1 -- start start 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d98145640 0x7f7d9815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7d980b2a20 0x7f7d980cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 0x7f7d980d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7d980cdf70 con 0x7f7d98145640 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9815d360 con 0x7f7d980b2a20 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d9dc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d98145a20 con 0x7f7d9806cbc0 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d96a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d98145640 0x7f7d9815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d96a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d98145640 0x7f7d9815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37130/0 (socket says 172.21.15.146:37130) 2024-04-24T23:07:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.492+0000 7f7d96a00640 1 -- 172.21.15.146:0/1827789848 learned_addr learned my addr 172.21.15.146:0/1827789848 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d97400640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 0x7f7d980d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d8fe00640 1 --2- 172.21.15.146:0/1827789848 >> v2:172.21.15.203:3300/0 conn(0x7f7d980b2a20 0x7f7d980cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d96a00640 1 -- 172.21.15.146:0/1827789848 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 msgr2=0x7f7d980d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d96a00640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 0x7f7d980d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d96a00640 1 -- 172.21.15.146:0/1827789848 >> v2:172.21.15.203:3300/0 conn(0x7f7d980b2a20 msgr2=0x7f7d980cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d96a00640 1 --2- 172.21.15.146:0/1827789848 >> v2:172.21.15.203:3300/0 conn(0x7f7d980b2a20 0x7f7d980cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d96a00640 1 -- 172.21.15.146:0/1827789848 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9806d140 con 0x7f7d98145640 2024-04-24T23:07:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.493+0000 7f7d97400640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 0x7f7d980d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:04.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.494+0000 7f7d96a00640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d9815ce20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7d98072f30 tx=0x7f7d8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1164e21e26df0a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:04.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.494+0000 7f7d96000640 1 -- 172.21.15.146:0/1827789848 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88037070 con 0x7f7d98145640 2024-04-24T23:07:04.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.494+0000 7f7d96000640 1 -- 172.21.15.146:0/1827789848 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88032440 con 0x7f7d98145640 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.494+0000 7f7d96000640 1 -- 172.21.15.146:0/1827789848 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88032810 con 0x7f7d98145640 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 -- 172.21.15.146:0/1827789848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 msgr2=0x7f7d9815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d9815ce20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7d98072f30 tx=0x7f7d8802a140 comp rx=0 tx=0).stop 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 -- 172.21.15.146:0/1827789848 shutdown_connections 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d9806cbc0 0x7f7d980d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/1827789848 >> v2:172.21.15.203:3300/0 conn(0x7f7d980b2a20 0x7f7d980cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/1827789848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d9815ce20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 -- 172.21.15.146:0/1827789848 >> 172.21.15.146:0/1827789848 conn(0x7f7d9806b320 msgr2=0x7f7d9806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 -- 172.21.15.146:0/1827789848 shutdown_connections 2024-04-24T23:07:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.495+0000 7f7d9dc00640 1 -- 172.21.15.146:0/1827789848 wait complete. 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.497+0000 7f7d9dc00640 1 Processor -- start 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.497+0000 7f7d9dc00640 1 -- start start 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d9806cbc0 0x7f7d980b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d980b2a20 0x7f7d98153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9806d9e0 con 0x7f7d98145640 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9806d700 con 0x7f7d9806cbc0 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d9dc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9815f9c0 con 0x7f7d980b2a20 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37144/0 (socket says 172.21.15.146:37144) 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 -- 172.21.15.146:0/201999950 learned_addr learned my addr 172.21.15.146:0/201999950 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d8fe00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d980b2a20 0x7f7d98153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 -- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d980b2a20 msgr2=0x7f7d98153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d96a00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d9806cbc0 0x7f7d980b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d980b2a20 0x7f7d98153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 -- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d9806cbc0 msgr2=0x7f7d980b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d9806cbc0 0x7f7d980b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.498+0000 7f7d97400640 1 -- 172.21.15.146:0/201999950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981445c0 con 0x7f7d98145640 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d97400640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000cf20 tx=0x7f7d9000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9001a070 con 0x7f7d98145640 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9000d840 con 0x7f7d98145640 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d98144840 con 0x7f7d98145640 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000dc30 con 0x7f7d98145640 2024-04-24T23:07:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.499+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9813ab40 con 0x7f7d98145640 2024-04-24T23:07:04.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.501+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d98068190 con 0x7f7d98145640 2024-04-24T23:07:04.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.501+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d9001d070 con 0x7f7d98145640 2024-04-24T23:07:04.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.502+0000 7f7d8ea00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 0x7f7d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:04.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.503+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f7d9008b570 con 0x7f7d98145640 2024-04-24T23:07:04.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.503+0000 7f7d96a00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 0x7f7d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:04.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.504+0000 7f7d96a00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 0x7f7d7406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d88034000 tx=0x7f7d8802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:04.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.507+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7d981445c0 con 0x7f7d98145640 2024-04-24T23:07:04.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.774+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7d98165a90 con 0x7f7d98145640 2024-04-24T23:07:04.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.775+0000 7f7d8ea00640 1 -- 172.21.15.146:0/201999950 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f7d9005a040 con 0x7f7d98145640 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ==", 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ==", 2024-04-24T23:07:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-04-24T23:07:04.779 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg==", 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg==", 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.781 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA==", 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.782 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-04-24T23:07:04.783 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ==", 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA==", 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg==", 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.786 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-04-24T23:07:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ==", 2024-04-24T23:07:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.790 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q==", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.791 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ==", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA==", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:07:04.792 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw==", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g==", 2024-04-24T23:07:04.793 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw==", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:07:04.794 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg==", 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.795 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmFG6LAxAA7YUamq4/Vvt8ibyWUFiI+w==", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA==", 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg==", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:07:04.797 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 msgr2=0x7f7d7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 0x7f7d7406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d88034000 tx=0x7f7d8802e000 comp rx=0 tx=0).stop 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 msgr2=0x7f7d98136cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000cf20 tx=0x7f7d9000a710 comp rx=0 tx=0).stop 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 shutdown_connections 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d98145640 0x7f7d98136cc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d7406be30 0x7f7d7406e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d980b2a20 0x7f7d98153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 --2- 172.21.15.146:0/201999950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d9806cbc0 0x7f7d980b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 >> 172.21.15.146:0/201999950 conn(0x7f7d9806b320 msgr2=0x7f7d98152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 shutdown_connections 2024-04-24T23:07:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.778+0000 7f7d9dc00640 1 -- 172.21.15.146:0/201999950 wait complete. 2024-04-24T23:07:04.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:05.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.998+0000 7fe3ea200640 1 Processor -- start 2024-04-24T23:07:05.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:04.999+0000 7fe3ea200640 1 -- start start 2024-04-24T23:07:05.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.000+0000 7fe3ea200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3e406d770 0x7fe3e4071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.000+0000 7fe3ea200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e40ccb10 con 0x7fe3e40d0240 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.000+0000 7fe3ea200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e406ddc0 con 0x7fe3e415a980 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.000+0000 7fe3ea200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e40aede0 con 0x7fe3e406d770 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3e406d770 0x7fe3e4071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3e406d770 0x7fe3e4071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37150/0 (socket says 172.21.15.146:37150) 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3dbe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe3e40d0240 0x7fe3e40ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60560/0 (socket says 172.21.15.146:60560) 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 -- 172.21.15.146:0/4286001081 learned_addr learned my addr 172.21.15.146:0/4286001081 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:05.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 -- 172.21.15.146:0/4286001081 >> v1:172.21.15.203:6789/0 conn(0x7fe3e415a980 legacy=0x7fe3e40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 -- 172.21.15.146:0/4286001081 >> v1:172.21.15.146:6789/0 conn(0x7fe3e40d0240 legacy=0x7fe3e40ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.001+0000 7fe3e9800640 1 -- 172.21.15.146:0/4286001081 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e406e0a0 con 0x7fe3e406d770 2024-04-24T23:07:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.002+0000 7fe3e9800640 1 --2- 172.21.15.146:0/4286001081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e406d770 0x7fe3e4071dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e50 tx=0x7fe3dc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f5e4145acde2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.002+0000 7fe3e3e00640 1 -- 172.21.15.146:0/4286001081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc036070 con 0x7fe3e406d770 2024-04-24T23:07:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3e3e00640 1 -- 172.21.15.146:0/4286001081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc031600 con 0x7fe3e406d770 2024-04-24T23:07:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3e3e00640 1 -- 172.21.15.146:0/4286001081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0319d0 con 0x7fe3e406d770 2024-04-24T23:07:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 -- 172.21.15.146:0/4286001081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e406d770 msgr2=0x7fe3e4071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 --2- 172.21.15.146:0/4286001081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e406d770 0x7fe3e4071dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e50 tx=0x7fe3dc02a6f0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 -- 172.21.15.146:0/4286001081 shutdown_connections 2024-04-24T23:07:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 --2- 172.21.15.146:0/4286001081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e406d770 0x7fe3e4071dd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 -- 172.21.15.146:0/4286001081 >> 172.21.15.146:0/4286001081 conn(0x7fe3e406b320 msgr2=0x7fe3e406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 -- 172.21.15.146:0/4286001081 shutdown_connections 2024-04-24T23:07:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.003+0000 7fe3ea200640 1 -- 172.21.15.146:0/4286001081 wait complete. 2024-04-24T23:07:05.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.005+0000 7fe3ea200640 1 Processor -- start 2024-04-24T23:07:05.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.005+0000 7fe3ea200640 1 -- start start 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3e406d770 0x7fe3e415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3e415a980 0x7fe3e40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e415ad60 con 0x7fe3e40d0240 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e406e660 con 0x7fe3e415a980 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3ea200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e415aee0 con 0x7fe3e406d770 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3dbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3dbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37160/0 (socket says 172.21.15.146:37160) 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.006+0000 7fe3dbe00640 1 -- 172.21.15.146:0/962133775 learned_addr learned my addr 172.21.15.146:0/962133775 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 -- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3e406d770 msgr2=0x7fe3e415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3e406d770 0x7fe3e415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 -- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3e415a980 msgr2=0x7fe3e40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3e415a980 0x7fe3e40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 -- 172.21.15.146:0/962133775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e415d9e0 con 0x7fe3e40d0240 2024-04-24T23:07:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3dbe00640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c430 tx=0x7fe3cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0074e0 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc007680 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e415dcc0 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.007+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004a00 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.008+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e41430f0 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.009+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e41432f0 con 0x7fe3e40d0240 2024-04-24T23:07:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.009+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3cc01a020 con 0x7fe3e40d0240 2024-04-24T23:07:05.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.010+0000 7fe3e1600640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.010+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7fe3cc08a4b0 con 0x7fe3e40d0240 2024-04-24T23:07:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.011+0000 7fe3e8e00640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.012+0000 7fe3e8e00640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 0x7fe3c006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006fd0 tx=0x7fe3d4006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.014+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3e41432f0 con 0x7fe3e40d0240 2024-04-24T23:07:05.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.214+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3e415de90 con 0x7fe3e40d0240 2024-04-24T23:07:05.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.215+0000 7fe3e1600640 1 -- 172.21.15.146:0/962133775 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13188 (secure 0 0 0) 0x7fe3e40ccb10 con 0x7fe3e40d0240 2024-04-24T23:07:05.217 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:05.217 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":64,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:07:04.286045+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:05.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 msgr2=0x7fe3c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 0x7fe3c006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006fd0 tx=0x7fe3d4006bc0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 msgr2=0x7fe3e41e7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c430 tx=0x7fe3cc00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 shutdown_connections 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3e415a980 0x7fe3e40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e40d0240 0x7fe3e41e7260 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3c006be30 0x7fe3c006e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 --2- 172.21.15.146:0/962133775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3e406d770 0x7fe3e415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 >> 172.21.15.146:0/962133775 conn(0x7fe3e406b320 msgr2=0x7fe3e40b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.218+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 shutdown_connections 2024-04-24T23:07:05.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.219+0000 7fe3ea200640 1 -- 172.21.15.146:0/962133775 wait complete. 2024-04-24T23:07:05.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:07:05.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:07:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.428+0000 7f1e89000640 1 Processor -- start 2024-04-24T23:07:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.428+0000 7f1e89000640 1 -- start start 2024-04-24T23:07:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.429+0000 7f1e89000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e8406ec10 0x7f1e840cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.429+0000 7f1e89000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1e84071b30 0x7f1e84150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e89000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8415b530 con 0x7f1e8415ed20 2024-04-24T23:07:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e89000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1e840cf8d0 con 0x7f1e8406ec10 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e89000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1e8415b810 con 0x7f1e84071b30 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e8406ec10 0x7f1e840cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e8406ec10 0x7f1e840cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37172/0 (socket says 172.21.15.146:37172) 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 -- 172.21.15.146:0/2240532477 learned_addr learned my addr 172.21.15.146:0/2240532477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e79400640 1 --1- 172.21.15.146:0/2240532477 >> v1:172.21.15.146:6789/0 conn(0x7f1e8415ed20 0x7f1e84071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60564/0 (socket says 172.21.15.146:60564) 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 -- 172.21.15.146:0/2240532477 >> v2:172.21.15.203:3300/0 conn(0x7f1e84071b30 msgr2=0x7f1e84150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 --2- 172.21.15.146:0/2240532477 >> v2:172.21.15.203:3300/0 conn(0x7f1e84071b30 0x7f1e84150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 -- 172.21.15.146:0/2240532477 >> v1:172.21.15.146:6789/0 conn(0x7f1e8415ed20 legacy=0x7f1e84071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81e00640 1 -- 172.21.15.146:0/2240532477 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8415e240 con 0x7f1e8406ec10 2024-04-24T23:07:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.430+0000 7f1e81400640 1 -- 172.21.15.146:0/2240532477 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924990409 0 0) 0x7f1e8415b530 con 0x7f1e8415ed20 2024-04-24T23:07:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.431+0000 7f1e81e00640 1 --2- 172.21.15.146:0/2240532477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e840cf390 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b2ef0 tx=0x7f1e7402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be804cdab88e6f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e81400640 1 -- 172.21.15.146:0/2240532477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74037070 con 0x7f1e8406ec10 2024-04-24T23:07:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e81400640 1 -- 172.21.15.146:0/2240532477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e74032440 con 0x7f1e8406ec10 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e81400640 1 -- 172.21.15.146:0/2240532477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74032810 con 0x7f1e8406ec10 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 -- 172.21.15.146:0/2240532477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 msgr2=0x7f1e840cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 --2- 172.21.15.146:0/2240532477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e840cf390 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b2ef0 tx=0x7f1e7402a200 comp rx=0 tx=0).stop 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 -- 172.21.15.146:0/2240532477 shutdown_connections 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 --2- 172.21.15.146:0/2240532477 >> v2:172.21.15.203:3300/0 conn(0x7f1e84071b30 0x7f1e84150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 --2- 172.21.15.146:0/2240532477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e840cf390 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.432+0000 7f1e89000640 1 -- 172.21.15.146:0/2240532477 >> 172.21.15.146:0/2240532477 conn(0x7f1e840b17b0 msgr2=0x7f1e840b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.433+0000 7f1e89000640 1 -- 172.21.15.146:0/2240532477 shutdown_connections 2024-04-24T23:07:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.433+0000 7f1e89000640 1 -- 172.21.15.146:0/2240532477 wait complete. 2024-04-24T23:07:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.434+0000 7f1e89000640 1 Processor -- start 2024-04-24T23:07:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.434+0000 7f1e89000640 1 -- start start 2024-04-24T23:07:05.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 0x7f1e8414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 0x7f1e84158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840b4b00 con 0x7f1e8406ec10 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8415e800 con 0x7f1e84071b30 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.435+0000 7f1e89000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1e840b4c80 con 0x7f1e8415ed20 2024-04-24T23:07:05.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37188/0 (socket says 172.21.15.146:37188) 2024-04-24T23:07:05.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 -- 172.21.15.146:0/1666151392 learned_addr learned my addr 172.21.15.146:0/1666151392 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:05.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e79400640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 0x7f1e8414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 -- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 msgr2=0x7f1e84158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e82800640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 0x7f1e84158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 0x7f1e84158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 -- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 msgr2=0x7f1e8414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 0x7f1e8414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e81e00640 1 -- 172.21.15.146:0/1666151392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8415c7e0 con 0x7f1e8406ec10 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e79400640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 0x7f1e8414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.436+0000 7f1e82800640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 0x7f1e84158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e81e00640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74041070 con 0x7f1e8406ec10 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7403c870 con 0x7f1e8406ec10 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74037040 con 0x7f1e8406ec10 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8415cac0 con 0x7f1e8406ec10 2024-04-24T23:07:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.437+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8415d080 con 0x7f1e8406ec10 2024-04-24T23:07:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.438+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8404f5a0 con 0x7f1e8406ec10 2024-04-24T23:07:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.439+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e74044070 con 0x7f1e8406ec10 2024-04-24T23:07:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.440+0000 7f1e7aa00640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.440+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f1e740ab910 con 0x7f1e8406ec10 2024-04-24T23:07:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.441+0000 7f1e79400640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.442+0000 7f1e79400640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 0x7f1e6006e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1e8415ac50 tx=0x7f1e6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.445+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1e7407a470 con 0x7f1e8406ec10 2024-04-24T23:07:05.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.634+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1e840b2fc0 con 0x7f1e8406ec10 2024-04-24T23:07:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.635+0000 7f1e7aa00640 1 -- 172.21.15.146:0/1666151392 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f1e74079d70 con 0x7f1e8406ec10 2024-04-24T23:07:05.636 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 msgr2=0x7f1e6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 0x7f1e6006e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1e8415ac50 tx=0x7f1e6c009040 comp rx=0 tx=0).stop 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 msgr2=0x7f1e84148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e740046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 shutdown_connections 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e6006be30 0x7f1e6006e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e8415ed20 0x7f1e84158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e84071b30 0x7f1e8414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 --2- 172.21.15.146:0/1666151392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e8406ec10 0x7f1e84148c50 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 >> 172.21.15.146:0/1666151392 conn(0x7f1e840b17b0 msgr2=0x7f1e8406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:05.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 shutdown_connections 2024-04-24T23:07:05.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.638+0000 7f1e89000640 1 -- 172.21.15.146:0/1666151392 wait complete. 2024-04-24T23:07:05.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:07:05.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.853+0000 7fc302800640 1 Processor -- start 2024-04-24T23:07:05.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.853+0000 7fc302800640 1 -- start start 2024-04-24T23:07:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.854+0000 7fc302800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2fc0d0240 0x7fc2fc06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.854+0000 7fc302800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2fc0ccb10 con 0x7fc2fc15a980 2024-04-24T23:07:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc302800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2fc06ddc0 con 0x7fc2fc071dd0 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc302800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc2fc072240 con 0x7fc2fc0d0240 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc300a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2fc0d0240 0x7fc2fc06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc301400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc2fc15a980 0x7fc2fc0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60566/0 (socket says 172.21.15.146:60566) 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc301400640 1 -- 172.21.15.146:0/1635425902 learned_addr learned my addr 172.21.15.146:0/1635425902 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc300a00640 1 -- 172.21.15.146:0/1635425902 >> v1:172.21.15.203:6789/0 conn(0x7fc2fc071dd0 legacy=0x7fc2fc0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc300a00640 1 -- 172.21.15.146:0/1635425902 >> v1:172.21.15.146:6789/0 conn(0x7fc2fc15a980 legacy=0x7fc2fc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc300a00640 1 -- 172.21.15.146:0/1635425902 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc06e0a0 con 0x7fc2fc0d0240 2024-04-24T23:07:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.855+0000 7fc2fbe00640 1 -- 172.21.15.146:0/1635425902 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860903126 0 0) 0x7fc2f0001110 con 0x7fc2fc15a980 2024-04-24T23:07:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc300a00640 1 --2- 172.21.15.146:0/1635425902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc06d770 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7df30befc826d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc2fbe00640 1 -- 172.21.15.146:0/1635425902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8037070 con 0x7fc2fc0d0240 2024-04-24T23:07:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc2fbe00640 1 -- 172.21.15.146:0/1635425902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e802ae50 con 0x7fc2fc0d0240 2024-04-24T23:07:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc2fbe00640 1 -- 172.21.15.146:0/1635425902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8032660 con 0x7fc2fc0d0240 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc302800640 1 -- 172.21.15.146:0/1635425902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 msgr2=0x7fc2fc06d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.857+0000 7fc302800640 1 --2- 172.21.15.146:0/1635425902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc06d770 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e802a140 comp rx=0 tx=0).stop 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.858+0000 7fc302800640 1 -- 172.21.15.146:0/1635425902 shutdown_connections 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.858+0000 7fc302800640 1 --2- 172.21.15.146:0/1635425902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc06d770 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.858+0000 7fc302800640 1 -- 172.21.15.146:0/1635425902 >> 172.21.15.146:0/1635425902 conn(0x7fc2fc06b320 msgr2=0x7fc2fc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.858+0000 7fc302800640 1 -- 172.21.15.146:0/1635425902 shutdown_connections 2024-04-24T23:07:05.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.858+0000 7fc302800640 1 -- 172.21.15.146:0/1635425902 wait complete. 2024-04-24T23:07:05.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.859+0000 7fc302800640 1 Processor -- start 2024-04-24T23:07:05.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.859+0000 7fc302800640 1 -- start start 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2fc071dd0 0x7fc2fc144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2fc15a980 0x7fc2fc0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc06e660 con 0x7fc2fc0d0240 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc0aede0 con 0x7fc2fc071dd0 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.860+0000 7fc302800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2fc15ad60 con 0x7fc2fc15a980 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37198/0 (socket says 172.21.15.146:37198) 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 -- 172.21.15.146:0/157154802 learned_addr learned my addr 172.21.15.146:0/157154802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc301400640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2fc071dd0 0x7fc2fc144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 -- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2fc15a980 msgr2=0x7fc2fc0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2fc15a980 0x7fc2fc0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 -- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2fc071dd0 msgr2=0x7fc2fc144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2fc071dd0 0x7fc2fc144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.861+0000 7fc300a00640 1 -- 172.21.15.146:0/157154802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc145760 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc300a00640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8042070 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e803e670 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc145a40 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8037040 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.862+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc146000 con 0x7fc2fc0d0240 2024-04-24T23:07:05.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.863+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc04f500 con 0x7fc2fc0d0240 2024-04-24T23:07:05.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.864+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2e8045070 con 0x7fc2fc0d0240 2024-04-24T23:07:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.865+0000 7fc2f9600640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.865+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7fc2e80ab360 con 0x7fc2fc0d0240 2024-04-24T23:07:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.866+0000 7fc301400640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:05.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.867+0000 7fc301400640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000f60 tx=0x7fc2f0007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:05.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:05.869+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc2e8079f50 con 0x7fc2fc0d0240 2024-04-24T23:07:06.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.070+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc2fc0ae710 con 0x7fc2fc0d0240 2024-04-24T23:07:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.071+0000 7fc2f9600640 1 -- 172.21.15.146:0/157154802 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7fc2e8079850 con 0x7fc2fc0d0240 2024-04-24T23:07:06.072 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:06.072 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T23:07:06.072 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:07:06.072 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T23:07:06.073 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T23:07:06.073 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:07:06.073 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T23:07:06.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 msgr2=0x7fc2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000f60 tx=0x7fc2f0007970 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 msgr2=0x7fc2fc0ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e80046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 shutdown_connections 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2fc15a980 0x7fc2fc0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2fc0d0240 0x7fc2fc0ad8c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 --2- 172.21.15.146:0/157154802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2fc071dd0 0x7fc2fc144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.074+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 >> 172.21.15.146:0/157154802 conn(0x7fc2fc06b320 msgr2=0x7fc2fc0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.075+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 shutdown_connections 2024-04-24T23:07:06.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.075+0000 7fc302800640 1 -- 172.21.15.146:0/157154802 wait complete. 2024-04-24T23:07:06.093 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:07:06.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:07:06.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.285+0000 7fb366c00640 1 Processor -- start 2024-04-24T23:07:06.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.285+0000 7fb366c00640 1 -- start start 2024-04-24T23:07:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb366c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb36015add0 0x7fb360070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb366c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb36006cb80 0x7fb360071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb366c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600b3d60 con 0x7fb360072340 2024-04-24T23:07:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb366c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb3600b4970 con 0x7fb36006cb80 2024-04-24T23:07:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb366c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb3600b4040 con 0x7fb36015add0 2024-04-24T23:07:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb35f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb360072340 0x7fb3600b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60576/0 (socket says 172.21.15.146:60576) 2024-04-24T23:07:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb35f400640 1 -- 172.21.15.146:0/1639198786 learned_addr learned my addr 172.21.15.146:0/1639198786 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb364c00640 1 --2- 172.21.15.146:0/1639198786 >> v2:172.21.15.146:3300/0 conn(0x7fb36006cb80 0x7fb360071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb35fe00640 1 --2- 172.21.15.146:0/1639198786 >> v2:172.21.15.203:3300/0 conn(0x7fb36015add0 0x7fb360070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.289+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255774866 0 0) 0x7fb3600b3d60 con 0x7fb360072340 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb344003520 con 0x7fb360072340 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2918737098 0 0) 0x7fb344003520 con 0x7fb360072340 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 >> v2:172.21.15.203:3300/0 conn(0x7fb36015add0 msgr2=0x7fb360070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 --2- 172.21.15.146:0/1639198786 >> v2:172.21.15.203:3300/0 conn(0x7fb36015add0 0x7fb360070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 >> v2:172.21.15.146:3300/0 conn(0x7fb36006cb80 msgr2=0x7fb360071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 --2- 172.21.15.146:0/1639198786 >> v2:172.21.15.146:3300/0 conn(0x7fb36006cb80 0x7fb360071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600b4320 con 0x7fb360072340 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fb34c001670 con 0x7fb360072340 2024-04-24T23:07:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 >> v1:172.21.15.146:6789/0 conn(0x7fb360072340 legacy=0x7fb3600b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb344003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb344004800 0x7fb344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3440051c0 0x7fb34400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600b4970 con 0x7fb3440039b0 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600b4040 con 0x7fb3440051c0 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb344010410 con 0x7fb344004800 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb364c00640 1 --2- 172.21.15.146:0/1639198786 >> v2:172.21.15.146:3300/0 conn(0x7fb36006cb80 0x7fb360071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.290+0000 7fb35fe00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb344003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35fe00640 1 -- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb344004800 msgr2=0x7fb344004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35f400640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb344004800 0x7fb344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35fe00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb344004800 0x7fb344004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35fe00640 1 -- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3440051c0 msgr2=0x7fb34400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35fe00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3440051c0 0x7fb34400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35fe00640 1 -- 172.21.15.146:0/1639198786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344003520 con 0x7fb3440039b0 2024-04-24T23:07:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb364c00640 1 -- 172.21.15.146:0/1639198786 reap_dead start 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.291+0000 7fb35f400640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb344004800 0x7fb344004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.292+0000 7fb35fe00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb344003dd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb35000ba30 tx=0x7fb344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23596ed2fbc4f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.292+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350030070 con 0x7fb3440039b0 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35002acc0 con 0x7fb3440039b0 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb35ea00640 1 -- 172.21.15.146:0/1639198786 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35000b600 con 0x7fb3440039b0 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 -- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 msgr2=0x7fb344003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb344003dd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb35000ba30 tx=0x7fb344005830 comp rx=0 tx=0).stop 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 -- 172.21.15.146:0/1639198786 shutdown_connections 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 --2- 172.21.15.146:0/1639198786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb344003dd0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 -- 172.21.15.146:0/1639198786 >> 172.21.15.146:0/1639198786 conn(0x7fb3600b16b0 msgr2=0x7fb3600b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 -- 172.21.15.146:0/1639198786 shutdown_connections 2024-04-24T23:07:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.293+0000 7fb366c00640 1 -- 172.21.15.146:0/1639198786 wait complete. 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.295+0000 7fb366c00640 1 Processor -- start 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.295+0000 7fb366c00640 1 -- start start 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb36014cab0 0x7fb3601549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb360154f10 0x7fb36014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb360070de0 con 0x7fb3440039b0 2024-04-24T23:07:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb36015b1b0 con 0x7fb36014cab0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb366c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb360070f60 con 0x7fb360154f10 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.296+0000 7fb35fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37218/0 (socket says 172.21.15.146:37218) 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 -- 172.21.15.146:0/2274637693 learned_addr learned my addr 172.21.15.146:0/2274637693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 -- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb360154f10 msgr2=0x7fb36014d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb360154f10 0x7fb36014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 -- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb36014cab0 msgr2=0x7fb3601549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb36014cab0 0x7fb3601549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 -- 172.21.15.146:0/2274637693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3601553c0 con 0x7fb3440039b0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb35fe00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb35002a7b0 tx=0x7fb350004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350043020 con 0x7fb3440039b0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35003f680 con 0x7fb3440039b0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35000b600 con 0x7fb3440039b0 2024-04-24T23:07:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.297+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3601556a0 con 0x7fb3440039b0 2024-04-24T23:07:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.298+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb36014dba0 con 0x7fb3440039b0 2024-04-24T23:07:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.299+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360068190 con 0x7fb3440039b0 2024-04-24T23:07:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.300+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb350046020 con 0x7fb3440039b0 2024-04-24T23:07:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.301+0000 7fb357e00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.301+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7fb3500ab880 con 0x7fb3440039b0 2024-04-24T23:07:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.301+0000 7fb35f400640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.303+0000 7fb35f400640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 0x7fb34006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb36015e640 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.305+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb35004d030 con 0x7fb3440039b0 2024-04-24T23:07:06.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:06.504+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb3600b3840 con 0x7fb3440039b0 2024-04-24T23:07:07.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.301+0000 7fb357e00640 1 -- 172.21.15.146:0/2274637693 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7fb35007a480 con 0x7fb3440039b0 2024-04-24T23:07:07.303 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T23:07:07.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 msgr2=0x7fb34006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 0x7fb34006e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb36015e640 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2024-04-24T23:07:07.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 msgr2=0x7fb360142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb35002a7b0 tx=0x7fb350004730 comp rx=0 tx=0).stop 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 shutdown_connections 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb34006be30 0x7fb34006e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb360154f10 0x7fb36014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb36014cab0 0x7fb3601549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 --2- 172.21.15.146:0/2274637693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3440039b0 0x7fb360142370 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.305+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 >> 172.21.15.146:0/2274637693 conn(0x7fb3600b16b0 msgr2=0x7fb3601581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:07.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.306+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 shutdown_connections 2024-04-24T23:07:07.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.306+0000 7fb366c00640 1 -- 172.21.15.146:0/2274637693 wait complete. 2024-04-24T23:07:07.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:07:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.534+0000 7ff621600640 1 Processor -- start 2024-04-24T23:07:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.534+0000 7ff621600640 1 -- start start 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.535+0000 7ff621600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff61c1619c0 0x7ff61c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff621600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0cf7a0 con 0x7ff61c0d2c60 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff621600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0cfa40 con 0x7ff61c0b5590 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff621600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c0b6dc0 con 0x7ff61c1619c0 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff61c1619c0 0x7ff61c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff61c1619c0 0x7ff61c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37224/0 (socket says 172.21.15.146:37224) 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 -- 172.21.15.146:0/162628718 learned_addr learned my addr 172.21.15.146:0/162628718 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61b400640 1 --1- 172.21.15.146:0/162628718 >> v1:172.21.15.146:6789/0 conn(0x7ff61c0d2c60 0x7ff61c0b7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60578/0 (socket says 172.21.15.146:60578) 2024-04-24T23:07:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 -- 172.21.15.146:0/162628718 >> v1:172.21.15.203:6789/0 conn(0x7ff61c0b5590 legacy=0x7ff61c0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 -- 172.21.15.146:0/162628718 >> v1:172.21.15.146:6789/0 conn(0x7ff61c0d2c60 legacy=0x7ff61c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.536+0000 7ff61aa00640 1 -- 172.21.15.146:0/162628718 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c0cfd20 con 0x7ff61c1619c0 2024-04-24T23:07:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.537+0000 7ff61aa00640 1 --2- 172.21.15.146:0/162628718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c1619c0 0x7ff61c0b5050 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009870 tx=0x7ff60c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa241587257509bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff619600640 1 -- 172.21.15.146:0/162628718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c037070 con 0x7ff61c1619c0 2024-04-24T23:07:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff619600640 1 -- 172.21.15.146:0/162628718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c032440 con 0x7ff61c1619c0 2024-04-24T23:07:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff619600640 1 -- 172.21.15.146:0/162628718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c032810 con 0x7ff61c1619c0 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff621600640 1 -- 172.21.15.146:0/162628718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c1619c0 msgr2=0x7ff61c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff621600640 1 --2- 172.21.15.146:0/162628718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c1619c0 0x7ff61c0b5050 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009870 tx=0x7ff60c02a180 comp rx=0 tx=0).stop 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff621600640 1 -- 172.21.15.146:0/162628718 shutdown_connections 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff621600640 1 --2- 172.21.15.146:0/162628718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c1619c0 0x7ff61c0b5050 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.538+0000 7ff621600640 1 -- 172.21.15.146:0/162628718 >> 172.21.15.146:0/162628718 conn(0x7ff61c0d3f70 msgr2=0x7ff61c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.539+0000 7ff621600640 1 -- 172.21.15.146:0/162628718 shutdown_connections 2024-04-24T23:07:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.539+0000 7ff621600640 1 -- 172.21.15.146:0/162628718 wait complete. 2024-04-24T23:07:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.540+0000 7ff621600640 1 Processor -- start 2024-04-24T23:07:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.540+0000 7ff621600640 1 -- start start 2024-04-24T23:07:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff61c0d2c60 0x7ff61c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff61c1619c0 0x7ff61c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c161da0 con 0x7ff61c0b5590 2024-04-24T23:07:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0d1f70 con 0x7ff61c0d2c60 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.541+0000 7ff621600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c161f20 con 0x7ff61c1619c0 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37238/0 (socket says 172.21.15.146:37238) 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 -- 172.21.15.146:0/2377156771 learned_addr learned my addr 172.21.15.146:0/2377156771 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 -- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff61c1619c0 msgr2=0x7ff61c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff61c1619c0 0x7ff61c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 -- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff61c0d2c60 msgr2=0x7ff61c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff61c0d2c60 0x7ff61c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 -- 172.21.15.146:0/2377156771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c1f3ed0 con 0x7ff61c0b5590 2024-04-24T23:07:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.542+0000 7ff61aa00640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009870 tx=0x7ff60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.543+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c041020 con 0x7ff61c0b5590 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.543+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c030970 con 0x7ff61c0b5590 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.543+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c037040 con 0x7ff61c0b5590 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.543+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1f41b0 con 0x7ff61c0b5590 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.543+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c1f4770 con 0x7ff61c0b5590 2024-04-24T23:07:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.544+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c1f3c40 con 0x7ff61c0b5590 2024-04-24T23:07:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.545+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff60c044020 con 0x7ff61c0b5590 2024-04-24T23:07:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.546+0000 7ff612a00640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.546+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5619+0+0 (secure 0 0 0) 0x7ff60c0abc70 con 0x7ff61c0b5590 2024-04-24T23:07:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.547+0000 7ff61a000640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.548+0000 7ff61a000640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 0x7ff5fc06e320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff608006fd0 tx=0x7ff608006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:07.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.551+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff60c04b030 con 0x7ff61c0b5590 2024-04-24T23:07:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:07.750+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff61c0d2310 con 0x7ff61c0b5590 2024-04-24T23:07:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.308+0000 7ff612a00640 1 -- 172.21.15.146:0/2377156771 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7ff60c0313a0 con 0x7ff61c0b5590 2024-04-24T23:07:08.311 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T23:07:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.312+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 msgr2=0x7ff5fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.312+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 0x7ff5fc06e320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff608006fd0 tx=0x7ff608006bc0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.312+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 msgr2=0x7ff61c0c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.312+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009870 tx=0x7ff60c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 shutdown_connections 2024-04-24T23:07:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff61c1619c0 0x7ff61c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff61c0d2c60 0x7ff61c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 --2- 172.21.15.146:0/2377156771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff61c0b5590 0x7ff61c0c98c0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.313+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 >> 172.21.15.146:0/2377156771 conn(0x7ff61c0d3f70 msgr2=0x7ff61c1605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:08.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.314+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 shutdown_connections 2024-04-24T23:07:08.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.315+0000 7ff621600640 1 -- 172.21.15.146:0/2377156771 wait complete. 2024-04-24T23:07:08.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:07:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.525+0000 7f2d73000640 1 Processor -- start 2024-04-24T23:07:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.525+0000 7f2d73000640 1 -- start start 2024-04-24T23:07:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d73000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c13ef30 0x7f2d6c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d73000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d6c0ce770 0x7f2d6c071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d73000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6c0ced40 con 0x7f2d6c141ab0 2024-04-24T23:07:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d73000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c1423d0 con 0x7f2d6c0ce770 2024-04-24T23:07:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d73000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c070f80 con 0x7f2d6c13ef30 2024-04-24T23:07:08.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d6b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d6c141ab0 0x7f2d6c0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33090/0 (socket says 172.21.15.146:33090) 2024-04-24T23:07:08.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d6b400640 1 -- 172.21.15.146:0/2884460683 learned_addr learned my addr 172.21.15.146:0/2884460683 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:08.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d71000640 1 --2- 172.21.15.146:0/2884460683 >> v2:172.21.15.146:3300/0 conn(0x7f2d6c0ce770 0x7f2d6c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.527+0000 7f2d6be00640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c13ef30 0x7f2d6c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.528+0000 7f2d71000640 1 -- 172.21.15.146:0/2884460683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c13ef30 msgr2=0x7f2d6c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.528+0000 7f2d71000640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c13ef30 0x7f2d6c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.528+0000 7f2d71000640 1 -- 172.21.15.146:0/2884460683 >> v1:172.21.15.146:6789/0 conn(0x7f2d6c141ab0 legacy=0x7f2d6c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.528+0000 7f2d6aa00640 1 -- 172.21.15.146:0/2884460683 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433000701 0 0) 0x7f2d6c0ced40 con 0x7f2d6c141ab0 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.528+0000 7f2d71000640 1 -- 172.21.15.146:0/2884460683 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c0cf020 con 0x7f2d6c0ce770 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.529+0000 7f2d71000640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c0ce770 0x7f2d6c071410 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009d90 tx=0x7f2d6402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742bbeb1f73bf4dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.529+0000 7f2d6aa00640 1 -- 172.21.15.146:0/2884460683 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64007740 con 0x7f2d6c0ce770 2024-04-24T23:07:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.529+0000 7f2d6aa00640 1 -- 172.21.15.146:0/2884460683 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d640078e0 con 0x7f2d6c0ce770 2024-04-24T23:07:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.529+0000 7f2d6aa00640 1 -- 172.21.15.146:0/2884460683 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64007cb0 con 0x7f2d6c0ce770 2024-04-24T23:07:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 -- 172.21.15.146:0/2884460683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c0ce770 msgr2=0x7f2d6c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c0ce770 0x7f2d6c071410 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009d90 tx=0x7f2d6402a660 comp rx=0 tx=0).stop 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 -- 172.21.15.146:0/2884460683 shutdown_connections 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c0ce770 0x7f2d6c071410 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 --2- 172.21.15.146:0/2884460683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c13ef30 0x7f2d6c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 -- 172.21.15.146:0/2884460683 >> 172.21.15.146:0/2884460683 conn(0x7f2d6c0b17b0 msgr2=0x7f2d6c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 -- 172.21.15.146:0/2884460683 shutdown_connections 2024-04-24T23:07:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.530+0000 7f2d73000640 1 -- 172.21.15.146:0/2884460683 wait complete. 2024-04-24T23:07:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.532+0000 7f2d73000640 1 Processor -- start 2024-04-24T23:07:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.532+0000 7f2d73000640 1 -- start start 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c0ce770 0x7f2d6c139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d6c141ab0 0x7f2d6c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c071950 con 0x7f2d6c13ef30 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c070c10 con 0x7f2d6c141ab0 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d73000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c071ad0 con 0x7f2d6c0ce770 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33322/0 (socket says 172.21.15.146:33322) 2024-04-24T23:07:08.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 -- 172.21.15.146:0/3682288738 learned_addr learned my addr 172.21.15.146:0/3682288738 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6be00640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c0ce770 0x7f2d6c139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d71000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d6c141ab0 0x7f2d6c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 -- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c0ce770 msgr2=0x7f2d6c139ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c0ce770 0x7f2d6c139ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 -- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d6c141ab0 msgr2=0x7f2d6c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.533+0000 7f2d6b400640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d6c141ab0 0x7f2d6c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d6b400640 1 -- 172.21.15.146:0/3682288738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c0afb90 con 0x7f2d6c13ef30 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d6b400640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c430 tx=0x7f2d5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580074e0 con 0x7f2d6c13ef30 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d580047e0 con 0x7f2d6c13ef30 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58004bd0 con 0x7f2d6c13ef30 2024-04-24T23:07:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c0afe70 con 0x7f2d6c13ef30 2024-04-24T23:07:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.534+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c142560 con 0x7f2d6c13ef30 2024-04-24T23:07:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.535+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c04f5a0 con 0x7f2d6c13ef30 2024-04-24T23:07:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.536+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d58011070 con 0x7f2d6c13ef30 2024-04-24T23:07:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.537+0000 7f2d63e00640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 0x7f2d4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.537+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6001+0+0 (secure 0 0 0) 0x7f2d5808aca0 con 0x7f2d6c13ef30 2024-04-24T23:07:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.538+0000 7f2d6be00640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 0x7f2d4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:08.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.539+0000 7f2d6be00640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 0x7f2d4c06e320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.542+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d58059480 con 0x7f2d6c13ef30 2024-04-24T23:07:08.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:08.783+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2d6c074690 con 0x7f2d6c13ef30 2024-04-24T23:07:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.360+0000 7f2d63e00640 1 -- 172.21.15.146:0/3682288738 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v44) ==== 173+0+0 (secure 0 0 0) 0x7f2d58058d80 con 0x7f2d6c13ef30 2024-04-24T23:07:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 9 and data pool 10 2024-04-24T23:07:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.370+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 msgr2=0x7f2d4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.370+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 0x7f2d4c06e320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c008040 comp rx=0 tx=0).stop 2024-04-24T23:07:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.370+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 msgr2=0x7f2d6c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.370+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c430 tx=0x7f2d5800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 shutdown_connections 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d6c141ab0 0x7f2d6c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c13ef30 0x7f2d6c154110 secure :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c430 tx=0x7f2d5800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2d4c06be60 0x7f2d4c06e320 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 --2- 172.21.15.146:0/3682288738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d6c0ce770 0x7f2d6c139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.375+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 >> 172.21.15.146:0/3682288738 conn(0x7f2d6c0b17b0 msgr2=0x7f2d6c15eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.376+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 shutdown_connections 2024-04-24T23:07:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.379+0000 7f2d73000640 1 -- 172.21.15.146:0/3682288738 wait complete. 2024-04-24T23:07:09.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:09.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.577+0000 7fa62f200640 1 Processor -- start 2024-04-24T23:07:09.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.577+0000 7fa62f200640 1 -- start start 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa6300cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 0x7fa63015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6300cfb30 0x7fa6300cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa6300b4310 con 0x7fa6300cfb30 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa6300d04e0 con 0x7fa6300709d0 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa6301565a0 con 0x7fa6301561c0 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62e800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6300cfb30 0x7fa6300cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62e800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6300cfb30 0x7fa6300cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33336/0 (socket says 172.21.15.146:33336) 2024-04-24T23:07:09.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa62e800640 1 -- 172.21.15.146:0/3614266173 learned_addr learned my addr 172.21.15.146:0/3614266173 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:09.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.579+0000 7fa625400640 1 --2- 172.21.15.146:0/3614266173 >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 0x7fa63015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa62e800640 1 -- 172.21.15.146:0/3614266173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 msgr2=0x7fa6300cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa62e800640 1 --2- 172.21.15.146:0/3614266173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa6300cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa62e800640 1 -- 172.21.15.146:0/3614266173 >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 msgr2=0x7fa63015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa62e800640 1 --2- 172.21.15.146:0/3614266173 >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 0x7fa63015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa62e800640 1 -- 172.21.15.146:0/3614266173 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa630070f90 con 0x7fa6300cfb30 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.580+0000 7fa625400640 1 --2- 172.21.15.146:0/3614266173 >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 0x7fa63015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.581+0000 7fa62e800640 1 --2- 172.21.15.146:0/3614266173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6300cffa0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa630067d20 tx=0x7fa62802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b90943a53adce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.581+0000 7fa62d400640 1 -- 172.21.15.146:0/3614266173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628036070 con 0x7fa6300cfb30 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.581+0000 7fa62d400640 1 -- 172.21.15.146:0/3614266173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa628031600 con 0x7fa6300cfb30 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.581+0000 7fa62d400640 1 -- 172.21.15.146:0/3614266173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6280319d0 con 0x7fa6300cfb30 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 -- 172.21.15.146:0/3614266173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 msgr2=0x7fa6300cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 --2- 172.21.15.146:0/3614266173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6300cffa0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa630067d20 tx=0x7fa62802a570 comp rx=0 tx=0).stop 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 -- 172.21.15.146:0/3614266173 shutdown_connections 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 --2- 172.21.15.146:0/3614266173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6300cffa0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 --2- 172.21.15.146:0/3614266173 >> v2:172.21.15.203:3300/0 conn(0x7fa6300709d0 0x7fa63015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 --2- 172.21.15.146:0/3614266173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa6300cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 -- 172.21.15.146:0/3614266173 >> 172.21.15.146:0/3614266173 conn(0x7fa63006b320 msgr2=0x7fa63006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 -- 172.21.15.146:0/3614266173 shutdown_connections 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.582+0000 7fa62f200640 1 -- 172.21.15.146:0/3614266173 wait complete. 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.583+0000 7fa62f200640 1 Processor -- start 2024-04-24T23:07:09.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 -- start start 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 0x7fa630140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa630157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa630071830 con 0x7fa6300cfb30 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa630071550 con 0x7fa6300709d0 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.584+0000 7fa62f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa6300b2c20 con 0x7fa6301561c0 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33344/0 (socket says 172.21.15.146:33344) 2024-04-24T23:07:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 -- 172.21.15.146:0/2417751808 learned_addr learned my addr 172.21.15.146:0/2417751808 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa62de00640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 0x7fa630140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa62e800640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa630157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 -- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 msgr2=0x7fa630157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa630157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 -- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 msgr2=0x7fa630140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 0x7fa630140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa625400640 1 -- 172.21.15.146:0/2417751808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa630141910 con 0x7fa6300cfb30 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.585+0000 7fa62de00640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 0x7fa630140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa625400640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c7f0 tx=0x7fa61800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618015070 con 0x7fa6300cfb30 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180079d0 con 0x7fa6300cfb30 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa630156af0 con 0x7fa6300cfb30 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618007da0 con 0x7fa6300cfb30 2024-04-24T23:07:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.586+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6301570b0 con 0x7fa6300cfb30 2024-04-24T23:07:09.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.587+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63004f500 con 0x7fa6300cfb30 2024-04-24T23:07:09.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.588+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa618018070 con 0x7fa6300cfb30 2024-04-24T23:07:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.589+0000 7fa626a00640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 0x7fa60c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.589+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fa61808aff0 con 0x7fa6300cfb30 2024-04-24T23:07:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.590+0000 7fa62de00640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 0x7fa60c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.591+0000 7fa62de00640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 0x7fa60c06e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa62000a870 tx=0x7fa620008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.594+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa618059700 con 0x7fa6300cfb30 2024-04-24T23:07:09.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.790+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6300b4b40 con 0x7fa6300cfb30 2024-04-24T23:07:09.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.791+0000 7fa626a00640 1 -- 172.21.15.146:0/2417751808 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16969 (secure 0 0 0) 0x7fa618059000 con 0x7fa6300cfb30 2024-04-24T23:07:09.794 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:09.794 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":67,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:07:08.785952+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 msgr2=0x7fa60c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 0x7fa60c06e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa62000a870 tx=0x7fa620008040 comp rx=0 tx=0).stop 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 msgr2=0x7fa6301505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c7f0 tx=0x7fa61800cbf0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 shutdown_connections 2024-04-24T23:07:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa60c06be60 0x7fa60c06e320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6301561c0 0x7fa630157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6300cfb30 0x7fa6301505d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 --2- 172.21.15.146:0/2417751808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6300709d0 0x7fa630140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 >> 172.21.15.146:0/2417751808 conn(0x7fa63006b320 msgr2=0x7fa6300ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 shutdown_connections 2024-04-24T23:07:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:09.794+0000 7fa62f200640 1 -- 172.21.15.146:0/2417751808 wait complete. 2024-04-24T23:07:09.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:10.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.012+0000 7f4477200640 1 Processor -- start 2024-04-24T23:07:10.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.013+0000 7f4477200640 1 -- start start 2024-04-24T23:07:10.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.014+0000 7f4477200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f4478071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.014+0000 7f4477200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44780ccb10 con 0x7f447815a980 2024-04-24T23:07:10.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.014+0000 7f4477200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447806ddc0 con 0x7f44780d0240 2024-04-24T23:07:10.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.014+0000 7f4477200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44780aede0 con 0x7f447806d770 2024-04-24T23:07:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f447815a980 0x7f44780cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33102/0 (socket says 172.21.15.146:33102) 2024-04-24T23:07:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475e00640 1 -- 172.21.15.146:0/3155353950 learned_addr learned my addr 172.21.15.146:0/3155353950 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4476800640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f4478071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302254971 0 0) 0x7f4468001490 con 0x7f447815a980 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f445c003520 con 0x7f447815a980 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178986404 0 0) 0x7f445c003520 con 0x7f447815a980 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 msgr2=0x7f4478071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f4478071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 >> v1:172.21.15.203:6789/0 conn(0x7f44780d0240 legacy=0x7f44780ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447806e0a0 con 0x7f447815a980 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f4468001bc0 con 0x7f447815a980 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.015+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 >> v1:172.21.15.146:6789/0 conn(0x7f447815a980 legacy=0x7f44780cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445c0039e0 0x7f445c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f445c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c004d40 0x7f445c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44780aede0 con 0x7f445c0039e0 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f445c00dde0 con 0x7f445c004d40 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f445c00dfe0 con 0x7f447806d770 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445c0039e0 0x7f445c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4476800640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c004d40 0x7f445c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f446d400640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f445c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 -- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 msgr2=0x7f445c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f447806d770 0x7f445c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 -- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c004d40 msgr2=0x7f445c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c004d40 0x7f445c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4475e00640 1 -- 172.21.15.146:0/3155353950 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c003520 con 0x7f445c0039e0 2024-04-24T23:07:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.016+0000 7f4476800640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c004d40 0x7f445c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:10.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.017+0000 7f4475e00640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445c0039e0 0x7f445c003e00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f446800aa20 tx=0x7f445c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0dace0076af520 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446800a640 con 0x7f445c0039e0 2024-04-24T23:07:10.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446802f070 con 0x7f445c0039e0 2024-04-24T23:07:10.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4475400640 1 -- 172.21.15.146:0/3155353950 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468034470 con 0x7f445c0039e0 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 -- 172.21.15.146:0/3155353950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445c0039e0 msgr2=0x7f445c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 --2- 172.21.15.146:0/3155353950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f445c0039e0 0x7f445c003e00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f446800aa20 tx=0x7f445c005830 comp rx=0 tx=0).stop 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4476800640 1 -- 172.21.15.146:0/3155353950 reap_dead start 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 -- 172.21.15.146:0/3155353950 shutdown_connections 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 -- 172.21.15.146:0/3155353950 >> 172.21.15.146:0/3155353950 conn(0x7f447806b320 msgr2=0x7f447806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 -- 172.21.15.146:0/3155353950 shutdown_connections 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.018+0000 7f4477200640 1 -- 172.21.15.146:0/3155353950 wait complete. 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.020+0000 7f4477200640 1 Processor -- start 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.020+0000 7f4477200640 1 -- start start 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c0039e0 0x7f44781e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4478156570 0x7f44781569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f447815ad60 con 0x7f447815b060 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f447806e660 con 0x7f445c0039e0 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f4477200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f447815aee0 con 0x7f4478156570 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f446d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f446d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33362/0 (socket says 172.21.15.146:33362) 2024-04-24T23:07:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.021+0000 7f446d400640 1 -- 172.21.15.146:0/1064054166 learned_addr learned my addr 172.21.15.146:0/1064054166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:10.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 -- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4478156570 msgr2=0x7f44781569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4478156570 0x7f44781569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f4475e00640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c0039e0 0x7f44781e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 -- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c0039e0 msgr2=0x7f44781e2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c0039e0 0x7f44781e2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 -- 172.21.15.146:0/1064054166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44781e3530 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446d400640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f446000d5a0 tx=0x7f446000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460005480 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4460017070 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460003810 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447815b5d0 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.022+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447815bb90 con 0x7f447815b060 2024-04-24T23:07:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.023+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447804f500 con 0x7f447815b060 2024-04-24T23:07:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.025+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44600039b0 con 0x7f447815b060 2024-04-24T23:07:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.026+0000 7f446ea00640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.026+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f446008ae10 con 0x7f447815b060 2024-04-24T23:07:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.027+0000 7f4475e00640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.028+0000 7f4475e00640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 0x7f445406e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4468033000 tx=0x7f4468038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.031+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4460059630 con 0x7f447815b060 2024-04-24T23:07:10.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.217+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44780720b0 con 0x7f447815b060 2024-04-24T23:07:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.220+0000 7f446ea00640 1 -- 172.21.15.146:0/1064054166 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16969 (secure 0 0 0) 0x7f4460058f30 con 0x7f447815b060 2024-04-24T23:07:10.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:10.222 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":67,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:07:08.785952+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 msgr2=0x7f445406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 0x7f445406e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4468033000 tx=0x7f4468038040 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 msgr2=0x7f44781412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f446000d5a0 tx=0x7f446000da60 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 shutdown_connections 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4478156570 0x7f44781569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447815b060 0x7f44781412a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 --2- 172.21.15.146:0/1064054166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f445c0039e0 0x7f44781e2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.222+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 >> 172.21.15.146:0/1064054166 conn(0x7f447806b320 msgr2=0x7f4478159460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.223+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 shutdown_connections 2024-04-24T23:07:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.223+0000 7f4477200640 1 -- 172.21.15.146:0/1064054166 wait complete. 2024-04-24T23:07:10.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:07:10.287 INFO:tasks.ceph.mds.d.smithi203.stderr:2024-04-24T23:07:10.285+0000 7f6d3ca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:07:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.444+0000 7f9028e00640 1 Processor -- start 2024-04-24T23:07:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.444+0000 7f9028e00640 1 -- start start 2024-04-24T23:07:10.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.445+0000 7f9028e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902413ef30 0x7f9024141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.445+0000 7f9028e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9024141ab0 0x7f90240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.445+0000 7f9028e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90240ced40 con 0x7f90240ce5a0 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9028e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f90241423d0 con 0x7f902413ef30 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9028e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9024070f80 con 0x7f9024141ab0 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902413ef30 0x7f9024141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902413ef30 0x7f9024141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33374/0 (socket says 172.21.15.146:33374) 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 -- 172.21.15.146:0/978912403 learned_addr learned my addr 172.21.15.146:0/978912403 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9022800640 1 --1- 172.21.15.146:0/978912403 >> v1:172.21.15.146:6789/0 conn(0x7f90240ce5a0 0x7f902415fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33112/0 (socket says 172.21.15.146:33112) 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9019400640 1 --2- 172.21.15.146:0/978912403 >> v2:172.21.15.203:3300/0 conn(0x7f9024141ab0 0x7f90240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 -- 172.21.15.146:0/978912403 >> v2:172.21.15.203:3300/0 conn(0x7f9024141ab0 msgr2=0x7f90240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 --2- 172.21.15.146:0/978912403 >> v2:172.21.15.203:3300/0 conn(0x7f9024141ab0 0x7f90240ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 -- 172.21.15.146:0/978912403 >> v1:172.21.15.146:6789/0 conn(0x7f90240ce5a0 legacy=0x7f902415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021e00640 1 -- 172.21.15.146:0/978912403 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90240cf020 con 0x7f902413ef30 2024-04-24T23:07:10.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.446+0000 7f9021400640 1 -- 172.21.15.146:0/978912403 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270214646 0 0) 0x7f90240ced40 con 0x7f90240ce5a0 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.447+0000 7f9021e00640 1 --2- 172.21.15.146:0/978912403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902413ef30 0x7f9024141570 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f90240cddd0 tx=0x7f901402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43cda02bd2a5a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9021400640 1 -- 172.21.15.146:0/978912403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014036070 con 0x7f902413ef30 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9021400640 1 -- 172.21.15.146:0/978912403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9014031600 con 0x7f902413ef30 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9021400640 1 -- 172.21.15.146:0/978912403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90140319d0 con 0x7f902413ef30 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 -- 172.21.15.146:0/978912403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902413ef30 msgr2=0x7f9024141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 --2- 172.21.15.146:0/978912403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902413ef30 0x7f9024141570 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f90240cddd0 tx=0x7f901402a730 comp rx=0 tx=0).stop 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 -- 172.21.15.146:0/978912403 shutdown_connections 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 --2- 172.21.15.146:0/978912403 >> v2:172.21.15.203:3300/0 conn(0x7f9024141ab0 0x7f90240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 --2- 172.21.15.146:0/978912403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902413ef30 0x7f9024141570 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.448+0000 7f9028e00640 1 -- 172.21.15.146:0/978912403 >> 172.21.15.146:0/978912403 conn(0x7f90240b17b0 msgr2=0x7f90240b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.449+0000 7f9028e00640 1 -- 172.21.15.146:0/978912403 shutdown_connections 2024-04-24T23:07:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.449+0000 7f9028e00640 1 -- 172.21.15.146:0/978912403 wait complete. 2024-04-24T23:07:10.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.450+0000 7f9028e00640 1 Processor -- start 2024-04-24T23:07:10.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.450+0000 7f9028e00640 1 -- start start 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902413ef30 0x7f902415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9024141ab0 0x7f9024144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90240cea30 con 0x7f90240ce5a0 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9024070c10 con 0x7f9024141ab0 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.451+0000 7f9028e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9024072420 con 0x7f902413ef30 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33384/0 (socket says 172.21.15.146:33384) 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 -- 172.21.15.146:0/1620015416 learned_addr learned my addr 172.21.15.146:0/1620015416 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 -- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902413ef30 msgr2=0x7f902415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902413ef30 0x7f902415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 -- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9024141ab0 msgr2=0x7f9024144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9024141ab0 0x7f9024144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 -- 172.21.15.146:0/1620015416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9024144ad0 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.452+0000 7f9021e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9014034040 tx=0x7f9014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.453+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014041020 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.453+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9014007820 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.453+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014036040 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.453+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9024144d70 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.453+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9024145330 con 0x7f90240ce5a0 2024-04-24T23:07:10.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.454+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902404f5a0 con 0x7f90240ce5a0 2024-04-24T23:07:10.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.455+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9014044020 con 0x7f90240ce5a0 2024-04-24T23:07:10.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.456+0000 7f901aa00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:10.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.456+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f90140abeb0 con 0x7f90240ce5a0 2024-04-24T23:07:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.457+0000 7f9019400640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.458+0000 7f9019400640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 0x7f900006e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9024143b30 tx=0x7f900c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.461+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f901404b030 con 0x7f90240ce5a0 2024-04-24T23:07:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:10.699+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9024072d30 con 0x7f90240ce5a0 2024-04-24T23:07:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.365+0000 7f901aa00640 1 -- 172.21.15.146:0/1620015416 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7f901407a5a0 con 0x7f90240ce5a0 2024-04-24T23:07:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 msgr2=0x7f900006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 0x7f900006e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9024143b30 tx=0x7f900c008040 comp rx=0 tx=0).stop 2024-04-24T23:07:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 msgr2=0x7f90240c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9014034040 tx=0x7f9014004a40 comp rx=0 tx=0).stop 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 shutdown_connections 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9024141ab0 0x7f9024144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f900006be30 0x7f900006e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902413ef30 0x7f902415e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 --2- 172.21.15.146:0/1620015416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90240ce5a0 0x7f90240c57c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 >> 172.21.15.146:0/1620015416 conn(0x7f90240b17b0 msgr2=0x7f902406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 shutdown_connections 2024-04-24T23:07:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.369+0000 7f9028e00640 1 -- 172.21.15.146:0/1620015416 wait complete. 2024-04-24T23:07:11.393 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:07:11.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:07:11.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.588+0000 7f3dd2c00640 1 Processor -- start 2024-04-24T23:07:11.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.589+0000 7f3dd2c00640 1 -- start start 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.590+0000 7f3dd2c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 0x7f3dcc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.590+0000 7f3dd2c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dcc071520 0x7f3dcc0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.590+0000 7f3dd2c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc15e3f0 con 0x7f3dcc06e620 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.590+0000 7f3dd2c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc06cd20 con 0x7f3dcc071520 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.590+0000 7f3dd2c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc15f440 con 0x7f3dcc15e010 2024-04-24T23:07:11.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dcc071520 0x7f3dcc0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dcc071520 0x7f3dcc0719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33394/0 (socket says 172.21.15.146:33394) 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 -- 172.21.15.146:0/2105223587 learned_addr learned my addr 172.21.15.146:0/2105223587 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 -- 172.21.15.146:0/2105223587 >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 msgr2=0x7f3dcc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dcbe00640 1 --2- 172.21.15.146:0/2105223587 >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 0x7f3dcc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 --2- 172.21.15.146:0/2105223587 >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 0x7f3dcc06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 -- 172.21.15.146:0/2105223587 >> v1:172.21.15.203:6789/0 conn(0x7f3dcc06e620 legacy=0x7f3dcc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dc3400640 1 -- 172.21.15.146:0/2105223587 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc071fe0 con 0x7f3dcc071520 2024-04-24T23:07:11.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.591+0000 7f3dcbe00640 1 --2- 172.21.15.146:0/2105223587 >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 0x7f3dcc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:11.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.592+0000 7f3dc3400640 1 --2- 172.21.15.146:0/2105223587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc071520 0x7f3dcc0719d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204fdd7e356e24dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:11.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dcb400640 1 -- 172.21.15.146:0/2105223587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4037070 con 0x7f3dcc071520 2024-04-24T23:07:11.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dcb400640 1 -- 172.21.15.146:0/2105223587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db4032440 con 0x7f3dcc071520 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dcb400640 1 -- 172.21.15.146:0/2105223587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4032810 con 0x7f3dcc071520 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 -- 172.21.15.146:0/2105223587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc071520 msgr2=0x7f3dcc0719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/2105223587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc071520 0x7f3dcc0719d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db402a250 comp rx=0 tx=0).stop 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 -- 172.21.15.146:0/2105223587 shutdown_connections 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/2105223587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc071520 0x7f3dcc0719d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/2105223587 >> v2:172.21.15.203:3300/0 conn(0x7f3dcc15e010 0x7f3dcc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 -- 172.21.15.146:0/2105223587 >> 172.21.15.146:0/2105223587 conn(0x7f3dcc0b17b0 msgr2=0x7f3dcc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 -- 172.21.15.146:0/2105223587 shutdown_connections 2024-04-24T23:07:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.593+0000 7f3dd2c00640 1 -- 172.21.15.146:0/2105223587 wait complete. 2024-04-24T23:07:11.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.595+0000 7f3dd2c00640 1 Processor -- start 2024-04-24T23:07:11.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.595+0000 7f3dd2c00640 1 -- start start 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dcc06e620 0x7f3dcc1f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 0x7f3dcc15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc06d580 con 0x7f3dcc15e010 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc06d2a0 con 0x7f3dcc071520 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd2c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc06d860 con 0x7f3dcc06e620 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33410/0 (socket says 172.21.15.146:33410) 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.596+0000 7f3dd0c00640 1 -- 172.21.15.146:0/936431773 learned_addr learned my addr 172.21.15.146:0/936431773 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dc3400640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 0x7f3dcc15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dcbe00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dcc06e620 0x7f3dcc1f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 -- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dcc06e620 msgr2=0x7f3dcc1f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dcc06e620 0x7f3dcc1f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 -- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 msgr2=0x7f3dcc15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 0x7f3dcc15f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 -- 172.21.15.146:0/936431773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc15fdf0 con 0x7f3dcc15e010 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dc3400640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 0x7f3dcc15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd0c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b970 tx=0x7f3dc400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4019070 con 0x7f3dcc15e010 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc400cb40 con 0x7f3dcc15e010 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc1600d0 con 0x7f3dcc15e010 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.597+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4014440 con 0x7f3dcc15e010 2024-04-24T23:07:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.598+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc160690 con 0x7f3dcc15e010 2024-04-24T23:07:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.599+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dcc04f5a0 con 0x7f3dcc15e010 2024-04-24T23:07:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.600+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dc401c070 con 0x7f3dcc15e010 2024-04-24T23:07:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.601+0000 7f3dc8c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.601+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3dc408ac30 con 0x7f3dcc15e010 2024-04-24T23:07:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.602+0000 7f3dcbe00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.603+0000 7f3dcbe00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 0x7f3da806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0b4500 tx=0x7f3dbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.606+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3dc40594e0 con 0x7f3dcc15e010 2024-04-24T23:07:11.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:11.845+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3dcc0b3950 con 0x7f3dcc15e010 2024-04-24T23:07:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.376+0000 7f3dc8c00640 1 -- 172.21.15.146:0/936431773 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7f3dc4058de0 con 0x7f3dcc15e010 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.379+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 msgr2=0x7f3da806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.379+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 0x7f3da806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0b4500 tx=0x7f3dbc008040 comp rx=0 tx=0).stop 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.379+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 msgr2=0x7f3dcc1f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.379+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b970 tx=0x7f3dc400be30 comp rx=0 tx=0).stop 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 shutdown_connections 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc15e010 0x7f3dcc1f1060 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dcc071520 0x7f3dcc15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 --2- 172.21.15.146:0/936431773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dcc06e620 0x7f3dcc1f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 >> 172.21.15.146:0/936431773 conn(0x7f3dcc0b17b0 msgr2=0x7f3dcc15c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 shutdown_connections 2024-04-24T23:07:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.380+0000 7f3dd2c00640 1 -- 172.21.15.146:0/936431773 wait complete. 2024-04-24T23:07:12.403 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:07:12.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:12.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.594+0000 7f2333400640 1 Processor -- start 2024-04-24T23:07:12.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.595+0000 7f2333400640 1 -- start start 2024-04-24T23:07:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.596+0000 7f2333400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f232c0b44f0 0x7f232c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.596+0000 7f2333400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 0x7f232c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.596+0000 7f2333400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232c0aec70 con 0x7f232c15e250 2024-04-24T23:07:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.596+0000 7f2333400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f232c0d10a0 con 0x7f232c0b44f0 2024-04-24T23:07:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.596+0000 7f2333400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f232c0aef50 con 0x7f232c0b0a40 2024-04-24T23:07:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f232c0b44f0 0x7f232c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f232c0b44f0 0x7f232c06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33422/0 (socket says 172.21.15.146:33422) 2024-04-24T23:07:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 -- 172.21.15.146:0/2918927153 learned_addr learned my addr 172.21.15.146:0/2918927153 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2331400640 1 --2- 172.21.15.146:0/2918927153 >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 0x7f232c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 -- 172.21.15.146:0/2918927153 >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 msgr2=0x7f232c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 --2- 172.21.15.146:0/2918927153 >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 0x7f232c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 -- 172.21.15.146:0/2918927153 >> v1:172.21.15.203:6789/0 conn(0x7f232c15e250 legacy=0x7f232c0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2323e00640 1 -- 172.21.15.146:0/2918927153 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c0af230 con 0x7f232c0b44f0 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.597+0000 7f2331400640 1 --2- 172.21.15.146:0/2918927153 >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 0x7f232c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:12.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.598+0000 7f2323e00640 1 --2- 172.21.15.146:0/2918927153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c0b44f0 0x7f232c06c7f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f232c072ab0 tx=0x7f231402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f64032940888ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.598+0000 7f232be00640 1 -- 172.21.15.146:0/2918927153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314037070 con 0x7f232c0b44f0 2024-04-24T23:07:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f232be00640 1 -- 172.21.15.146:0/2918927153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314032440 con 0x7f232c0b44f0 2024-04-24T23:07:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f232be00640 1 -- 172.21.15.146:0/2918927153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314032810 con 0x7f232c0b44f0 2024-04-24T23:07:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 -- 172.21.15.146:0/2918927153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c0b44f0 msgr2=0x7f232c06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 --2- 172.21.15.146:0/2918927153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c0b44f0 0x7f232c06c7f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f232c072ab0 tx=0x7f231402a230 comp rx=0 tx=0).stop 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 -- 172.21.15.146:0/2918927153 shutdown_connections 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 --2- 172.21.15.146:0/2918927153 >> v2:172.21.15.203:3300/0 conn(0x7f232c0b0a40 0x7f232c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 --2- 172.21.15.146:0/2918927153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c0b44f0 0x7f232c06c7f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 -- 172.21.15.146:0/2918927153 >> 172.21.15.146:0/2918927153 conn(0x7f232c0b3860 msgr2=0x7f232c0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 -- 172.21.15.146:0/2918927153 shutdown_connections 2024-04-24T23:07:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.599+0000 7f2333400640 1 -- 172.21.15.146:0/2918927153 wait complete. 2024-04-24T23:07:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.601+0000 7f2333400640 1 Processor -- start 2024-04-24T23:07:12.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.601+0000 7f2333400640 1 -- start start 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f232c0b0a40 0x7f232c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f232c0b44f0 0x7f232c0b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f232c167da0 con 0x7f232c15e250 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f232c167c20 con 0x7f232c0b0a40 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2333400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f232c167f20 con 0x7f232c0b44f0 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2331400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2331400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33428/0 (socket says 172.21.15.146:33428) 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.602+0000 7f2331400640 1 -- 172.21.15.146:0/1229039724 learned_addr learned my addr 172.21.15.146:0/1229039724 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 -- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f232c0b44f0 msgr2=0x7f232c0b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f232c0b44f0 0x7f232c0b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 -- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f232c0b0a40 msgr2=0x7f232c14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f232c0b0a40 0x7f232c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 -- 172.21.15.146:0/1229039724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c14d880 con 0x7f232c15e250 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2331400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f232400cef0 tx=0x7f232400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232401a070 con 0x7f232c15e250 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232400d860 con 0x7f232c15e250 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232400dc50 con 0x7f232c15e250 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.603+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c14c500 con 0x7f232c15e250 2024-04-24T23:07:12.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.604+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c14cac0 con 0x7f232c15e250 2024-04-24T23:07:12.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.605+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c068190 con 0x7f232c15e250 2024-04-24T23:07:12.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.606+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f232401d070 con 0x7f232c15e250 2024-04-24T23:07:12.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.607+0000 7f2329600640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 0x7f230806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:12.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.607+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f232408b960 con 0x7f232c15e250 2024-04-24T23:07:12.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.607+0000 7f2330a00640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 0x7f230806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:12.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.608+0000 7f2330a00640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 0x7f230806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f231c006fd0 tx=0x7f231c006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:12.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.611+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f232c14d880 con 0x7f232c15e250 2024-04-24T23:07:12.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.846+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f232c06fdb0 con 0x7f232c15e250 2024-04-24T23:07:12.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.848+0000 7f2329600640 1 -- 172.21.15.146:0/1229039724 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5191 (secure 0 0 0) 0x7f232405a1a0 con 0x7f232c15e250 2024-04-24T23:07:12.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:12.850 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:11.847584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6666]},"id":4}]} 2024-04-24T23:07:12.850 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 47 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.850+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 msgr2=0x7f230806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.850+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 0x7f230806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f231c006fd0 tx=0x7f231c006bc0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.850+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 msgr2=0x7f232c15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.850+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f232400cef0 tx=0x7f232400a710 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 shutdown_connections 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f232c15e250 0x7f232c15c270 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f230806be30 0x7f230806e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f232c0b44f0 0x7f232c0b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 --2- 172.21.15.146:0/1229039724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f232c0b0a40 0x7f232c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 >> 172.21.15.146:0/1229039724 conn(0x7f232c0b3860 msgr2=0x7f232c1572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 shutdown_connections 2024-04-24T23:07:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:12.851+0000 7f2333400640 1 -- 172.21.15.146:0/1229039724 wait complete. 2024-04-24T23:07:12.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:13.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.070+0000 7f11c2000640 1 Processor -- start 2024-04-24T23:07:13.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.070+0000 7f11c2000640 1 -- start start 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc15ddd0 0x7f11bc070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c2000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11bc072920 0x7f11bc0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c2000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc15e1b0 con 0x7f11bc0d0070 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c2000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc0713b0 con 0x7f11bc072920 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c2000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc071690 con 0x7f11bc15ddd0 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11bbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11bc072920 0x7f11bc0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11bbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11bc072920 0x7f11bc0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33442/0 (socket says 172.21.15.146:33442) 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11bbe00640 1 -- 172.21.15.146:0/2384949491 learned_addr learned my addr 172.21.15.146:0/2384949491 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:13.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.072+0000 7f11c1600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f11bc0d0070 0x7f11bc0ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33122/0 (socket says 172.21.15.146:33122) 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11c0c00640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc15ddd0 0x7f11bc070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11bbe00640 1 -- 172.21.15.146:0/2384949491 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc15ddd0 msgr2=0x7f11bc070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11bbe00640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc15ddd0 0x7f11bc070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11bbe00640 1 -- 172.21.15.146:0/2384949491 >> v1:172.21.15.146:6789/0 conn(0x7f11bc0d0070 legacy=0x7f11bc0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11bb400640 1 -- 172.21.15.146:0/2384949491 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134824988 0 0) 0x7f11bc15e1b0 con 0x7f11bc0d0070 2024-04-24T23:07:13.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.073+0000 7f11bbe00640 1 -- 172.21.15.146:0/2384949491 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc071970 con 0x7f11bc072920 2024-04-24T23:07:13.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.074+0000 7f11bbe00640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc072920 0x7f11bc0cfb30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5ac750903e8dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.074+0000 7f11bb400640 1 -- 172.21.15.146:0/2384949491 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037070 con 0x7f11bc072920 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.074+0000 7f11bb400640 1 -- 172.21.15.146:0/2384949491 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a8032440 con 0x7f11bc072920 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.074+0000 7f11bb400640 1 -- 172.21.15.146:0/2384949491 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8032810 con 0x7f11bc072920 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 -- 172.21.15.146:0/2384949491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc072920 msgr2=0x7f11bc0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc072920 0x7f11bc0cfb30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a250 comp rx=0 tx=0).stop 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 -- 172.21.15.146:0/2384949491 shutdown_connections 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc072920 0x7f11bc0cfb30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 --2- 172.21.15.146:0/2384949491 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc15ddd0 0x7f11bc070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 -- 172.21.15.146:0/2384949491 >> 172.21.15.146:0/2384949491 conn(0x7f11bc06b320 msgr2=0x7f11bc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 -- 172.21.15.146:0/2384949491 shutdown_connections 2024-04-24T23:07:13.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.075+0000 7f11c2000640 1 -- 172.21.15.146:0/2384949491 wait complete. 2024-04-24T23:07:13.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.077+0000 7f11c2000640 1 Processor -- start 2024-04-24T23:07:13.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.077+0000 7f11c2000640 1 -- start start 2024-04-24T23:07:13.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc072920 0x7f11bc0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 0x7f11bc15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0b3c10 con 0x7f11bc15ddd0 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0710a0 con 0x7f11bc0d0070 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.078+0000 7f11c2000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc0b3d90 con 0x7f11bc072920 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33454/0 (socket says 172.21.15.146:33454) 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 -- 172.21.15.146:0/3201953343 learned_addr learned my addr 172.21.15.146:0/3201953343 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c0c00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc072920 0x7f11bc0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11bbe00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 0x7f11bc15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 -- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc072920 msgr2=0x7f11bc0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc072920 0x7f11bc0b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 -- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 msgr2=0x7f11bc15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 0x7f11bc15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11c1600640 1 -- 172.21.15.146:0/3201953343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc0cc510 con 0x7f11bc15ddd0 2024-04-24T23:07:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.079+0000 7f11bbe00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 0x7f11bc15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11c1600640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c4b0 tx=0x7f11b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4018070 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b40074a0 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc0cc7f0 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4007690 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.080+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc0ccdb0 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.081+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc04f500 con 0x7f11bc15ddd0 2024-04-24T23:07:13.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.082+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11b401b070 con 0x7f11bc15ddd0 2024-04-24T23:07:13.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.083+0000 7f11b8c00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 0x7f119c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.083+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f11b408a220 con 0x7f11bc15ddd0 2024-04-24T23:07:13.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.084+0000 7f11c0c00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 0x7f119c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.085+0000 7f11c0c00640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 0x7f119c06e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009a60 tx=0x7f11ac003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.087+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11b4058a40 con 0x7f11bc15ddd0 2024-04-24T23:07:13.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.285+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11bc15b330 con 0x7f11bc15ddd0 2024-04-24T23:07:13.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.287+0000 7f11b8c00640 1 -- 172.21.15.146:0/3201953343 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16956 (secure 0 0 0) 0x7f11b4058340 con 0x7f11bc15ddd0 2024-04-24T23:07:13.289 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:13.290 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":68,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:07:10.330333+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 msgr2=0x7f119c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 0x7f119c06e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009a60 tx=0x7f11ac003990 comp rx=0 tx=0).stop 2024-04-24T23:07:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 msgr2=0x7f11bc14efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c4b0 tx=0x7f11b400c970 comp rx=0 tx=0).stop 2024-04-24T23:07:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 shutdown_connections 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11bc15ddd0 0x7f11bc14efe0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc0d0070 0x7f11bc15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f119c06be30 0x7f119c06e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 --2- 172.21.15.146:0/3201953343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11bc072920 0x7f11bc0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 >> 172.21.15.146:0/3201953343 conn(0x7f11bc06b320 msgr2=0x7f11bc15bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 shutdown_connections 2024-04-24T23:07:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.290+0000 7f11c2000640 1 -- 172.21.15.146:0/3201953343 wait complete. 2024-04-24T23:07:13.312 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:07:13.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:07:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.505+0000 7fe886600640 1 Processor -- start 2024-04-24T23:07:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.506+0000 7fe886600640 1 -- start start 2024-04-24T23:07:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe886600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8801445e0 0x7fe8800cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe886600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe8800728c0 0x7fe8800d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe886600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8801449c0 con 0x7fe880070c10 2024-04-24T23:07:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe886600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe880072430 con 0x7fe8801445e0 2024-04-24T23:07:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe886600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe8800b2d70 con 0x7fe8800728c0 2024-04-24T23:07:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.507+0000 7fe87f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8801445e0 0x7fe8800cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8801445e0 0x7fe8800cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33456/0 (socket says 172.21.15.146:33456) 2024-04-24T23:07:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 -- 172.21.15.146:0/3925265842 learned_addr learned my addr 172.21.15.146:0/3925265842 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 -- 172.21.15.146:0/3925265842 >> v2:172.21.15.203:3300/0 conn(0x7fe8800728c0 msgr2=0x7fe8800d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 --2- 172.21.15.146:0/3925265842 >> v2:172.21.15.203:3300/0 conn(0x7fe8800728c0 0x7fe8800d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 -- 172.21.15.146:0/3925265842 >> v1:172.21.15.203:6789/0 conn(0x7fe880070c10 legacy=0x7fe88015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.508+0000 7fe87f400640 1 -- 172.21.15.146:0/3925265842 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe880071820 con 0x7fe8801445e0 2024-04-24T23:07:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.509+0000 7fe87f400640 1 --2- 172.21.15.146:0/3925265842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe8800cfc90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe8800b4700 tx=0x7fe87002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56be593ffab2ec13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.509+0000 7fe87ea00640 1 -- 172.21.15.146:0/3925265842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870037070 con 0x7fe8801445e0 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.509+0000 7fe87ea00640 1 -- 172.21.15.146:0/3925265842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870032440 con 0x7fe8801445e0 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.509+0000 7fe87ea00640 1 -- 172.21.15.146:0/3925265842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870032810 con 0x7fe8801445e0 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 -- 172.21.15.146:0/3925265842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 msgr2=0x7fe8800cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 --2- 172.21.15.146:0/3925265842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe8800cfc90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe8800b4700 tx=0x7fe87002a230 comp rx=0 tx=0).stop 2024-04-24T23:07:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 -- 172.21.15.146:0/3925265842 shutdown_connections 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 --2- 172.21.15.146:0/3925265842 >> v2:172.21.15.203:3300/0 conn(0x7fe8800728c0 0x7fe8800d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 --2- 172.21.15.146:0/3925265842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe8800cfc90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 -- 172.21.15.146:0/3925265842 >> 172.21.15.146:0/3925265842 conn(0x7fe88006b320 msgr2=0x7fe88006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 -- 172.21.15.146:0/3925265842 shutdown_connections 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.510+0000 7fe886600640 1 -- 172.21.15.146:0/3925265842 wait complete. 2024-04-24T23:07:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.512+0000 7fe886600640 1 Processor -- start 2024-04-24T23:07:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.512+0000 7fe886600640 1 -- start start 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe880070c10 0x7fe8801f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8800728c0 0x7fe88012b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8800720c0 con 0x7fe8801445e0 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe880071de0 con 0x7fe8800728c0 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe886600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe880071080 con 0x7fe880070c10 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe87fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe87fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33464/0 (socket says 172.21.15.146:33464) 2024-04-24T23:07:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.513+0000 7fe87fe00640 1 -- 172.21.15.146:0/2474739988 learned_addr learned my addr 172.21.15.146:0/2474739988 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 -- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe880070c10 msgr2=0x7fe8801f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe880070c10 0x7fe8801f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 -- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8800728c0 msgr2=0x7fe88012b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8800728c0 0x7fe88012b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 -- 172.21.15.146:0/2474739988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801f4070 con 0x7fe8801445e0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe87fe00640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878017070 con 0x7fe8801445e0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878003da0 con 0x7fe8801445e0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780052b0 con 0x7fe8801445e0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88015dcc0 con 0x7fe8801445e0 2024-04-24T23:07:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.514+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801f42f0 con 0x7fe8801445e0 2024-04-24T23:07:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.516+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880068190 con 0x7fe8801445e0 2024-04-24T23:07:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.516+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe878005450 con 0x7fe8801445e0 2024-04-24T23:07:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.517+0000 7fe877400640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 0x7fe85c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.517+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fe87808a5e0 con 0x7fe8801445e0 2024-04-24T23:07:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.518+0000 7fe87f400640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 0x7fe85c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.519+0000 7fe87f400640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 0x7fe85c06e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe870034000 tx=0x7fe87002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.522+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe8801f4070 con 0x7fe8801445e0 2024-04-24T23:07:13.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.703+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe88006eab0 con 0x7fe85c06be30 2024-04-24T23:07:13.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.721+0000 7fe877400640 1 -- 172.21.15.146:0/2474739988 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241744 (secure 0 0 0) 0x7fe88006eab0 con 0x7fe85c06be30 2024-04-24T23:07:13.726 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:07:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.727+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 msgr2=0x7fe85c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.727+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 0x7fe85c06e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe870034000 tx=0x7fe87002c000 comp rx=0 tx=0).stop 2024-04-24T23:07:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.727+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 msgr2=0x7fe88015d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.727+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).stop 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 shutdown_connections 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8801445e0 0x7fe88015d2c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8800728c0 0x7fe88012b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe85c06be30 0x7fe85c06e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 --2- 172.21.15.146:0/2474739988 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe880070c10 0x7fe8801f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 >> 172.21.15.146:0/2474739988 conn(0x7fe88006b320 msgr2=0x7fe8800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 shutdown_connections 2024-04-24T23:07:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.728+0000 7fe886600640 1 -- 172.21.15.146:0/2474739988 wait complete. 2024-04-24T23:07:13.747 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-04-24T23:07:11.750843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252540,"kb_used_data":7236,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722180,"statfs":{"total":773094113280,"available":772835512320,"internally_reserved":0,"allocated":7409664,"data_stored":3941146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.445682"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931750+0000","last_change":"2024-04-24T23:07:09.385110+0000","last_active":"2024-04-24T23:07:10.931750+0000","last_peered":"2024-04-24T23:07:10.931750+0000","last_clean":"2024-04-24T23:07:10.931750+0000","last_became_active":"2024-04-24T23:07:09.384841+0000","last_became_peered":"2024-04-24T23:07:09.384841+0000","last_unstale":"2024-04-24T23:07:10.931750+0000","last_undegraded":"2024-04-24T23:07:10.931750+0000","last_fullsized":"2024-04-24T23:07:10.931750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:53.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930247+0000","last_change":"2024-04-24T23:07:09.385843+0000","last_active":"2024-04-24T23:07:10.930247+0000","last_peered":"2024-04-24T23:07:10.930247+0000","last_clean":"2024-04-24T23:07:10.930247+0000","last_became_active":"2024-04-24T23:07:09.385499+0000","last_became_peered":"2024-04-24T23:07:09.385499+0000","last_unstale":"2024-04-24T23:07:10.930247+0000","last_undegraded":"2024-04-24T23:07:10.930247+0000","last_fullsized":"2024-04-24T23:07:10.930247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:29.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931052+0000","last_change":"2024-04-24T23:07:09.380547+0000","last_active":"2024-04-24T23:07:10.931052+0000","last_peered":"2024-04-24T23:07:10.931052+0000","last_clean":"2024-04-24T23:07:10.931052+0000","last_became_active":"2024-04-24T23:07:09.380263+0000","last_became_peered":"2024-04-24T23:07:09.380263+0000","last_unstale":"2024-04-24T23:07:10.931052+0000","last_undegraded":"2024-04-24T23:07:10.931052+0000","last_fullsized":"2024-04-24T23:07:10.931052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:02:42.155720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.315812+0000","last_change":"2024-04-24T23:07:07.315812+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.315812+0000","last_undegraded":"2024-04-24T23:07:07.315812+0000","last_fullsized":"2024-04-24T23:07:07.315812+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.315224+0000","last_change":"2024-04-24T23:07:07.315224+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.315224+0000","last_undegraded":"2024-04-24T23:07:07.315224+0000","last_fullsized":"2024-04-24T23:07:07.315224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932133+0000","last_change":"2024-04-24T23:07:09.386252+0000","last_active":"2024-04-24T23:07:10.932133+0000","last_peered":"2024-04-24T23:07:10.932133+0000","last_clean":"2024-04-24T23:07:10.932133+0000","last_became_active":"2024-04-24T23:07:09.385997+0000","last_became_peered":"2024-04-24T23:07:09.385997+0000","last_unstale":"2024-04-24T23:07:10.932133+0000","last_undegraded":"2024-04-24T23:07:10.932133+0000","last_fullsized":"2024-04-24T23:07:10.932133+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:46.308652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.315815+0000","last_change":"2024-04-24T23:07:07.315815+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.315815+0000","last_undegraded":"2024-04-24T23:07:07.315815+0000","last_fullsized":"2024-04-24T23:07:07.315815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930915+0000","last_change":"2024-04-24T23:07:08.351767+0000","last_active":"2024-04-24T23:07:10.930915+0000","last_peered":"2024-04-24T23:07:10.930915+0000","last_clean":"2024-04-24T23:07:10.930915+0000","last_became_active":"2024-04-24T23:07:08.350972+0000","last_became_peered":"2024-04-24T23:07:08.350972+0000","last_unstale":"2024-04-24T23:07:10.930915+0000","last_undegraded":"2024-04-24T23:07:10.930915+0000","last_fullsized":"2024-04-24T23:07:10.930915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:34.244407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.321714+0000","last_change":"2024-04-24T23:07:07.321714+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.321714+0000","last_undegraded":"2024-04-24T23:07:07.321714+0000","last_fullsized":"2024-04-24T23:07:07.321714+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931054+0000","last_change":"2024-04-24T23:07:08.345939+0000","last_active":"2024-04-24T23:07:10.931054+0000","last_peered":"2024-04-24T23:07:10.931054+0000","last_clean":"2024-04-24T23:07:10.931054+0000","last_became_active":"2024-04-24T23:07:08.345638+0000","last_became_peered":"2024-04-24T23:07:08.345638+0000","last_unstale":"2024-04-24T23:07:10.931054+0000","last_undegraded":"2024-04-24T23:07:10.931054+0000","last_fullsized":"2024-04-24T23:07:10.931054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:11.127294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.315042+0000","last_change":"2024-04-24T23:07:07.315042+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.315042+0000","last_undegraded":"2024-04-24T23:07:07.315042+0000","last_fullsized":"2024-04-24T23:07:07.315042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.329875+0000","last_change":"2024-04-24T23:07:07.329875+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.329875+0000","last_undegraded":"2024-04-24T23:07:07.329875+0000","last_fullsized":"2024-04-24T23:07:07.329875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.332868+0000","last_change":"2024-04-24T23:07:07.332868+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.332868+0000","last_undegraded":"2024-04-24T23:07:07.332868+0000","last_fullsized":"2024-04-24T23:07:07.332868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.308717+0000","last_change":"2024-04-24T23:07:07.308717+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.308717+0000","last_undegraded":"2024-04-24T23:07:07.308717+0000","last_fullsized":"2024-04-24T23:07:07.308717+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.318608+0000","last_change":"2024-04-24T23:07:07.318608+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.318608+0000","last_undegraded":"2024-04-24T23:07:07.318608+0000","last_fullsized":"2024-04-24T23:07:07.318608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931199+0000","last_change":"2024-04-24T23:07:08.352073+0000","last_active":"2024-04-24T23:07:10.931199+0000","last_peered":"2024-04-24T23:07:10.931199+0000","last_clean":"2024-04-24T23:07:10.931199+0000","last_became_active":"2024-04-24T23:07:08.351758+0000","last_became_peered":"2024-04-24T23:07:08.351758+0000","last_unstale":"2024-04-24T23:07:10.931199+0000","last_undegraded":"2024-04-24T23:07:10.931199+0000","last_fullsized":"2024-04-24T23:07:10.931199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:46:44.687789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.330345+0000","last_change":"2024-04-24T23:07:07.330345+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.330345+0000","last_undegraded":"2024-04-24T23:07:07.330345+0000","last_fullsized":"2024-04-24T23:07:07.330345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.309792+0000","last_change":"2024-04-24T23:07:07.309792+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.309792+0000","last_undegraded":"2024-04-24T23:07:07.309792+0000","last_fullsized":"2024-04-24T23:07:07.309792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.316107+0000","last_change":"2024-04-24T23:07:07.316107+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.316107+0000","last_undegraded":"2024-04-24T23:07:07.316107+0000","last_fullsized":"2024-04-24T23:07:07.316107+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.309627+0000","last_change":"2024-04-24T23:07:07.309627+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.309627+0000","last_undegraded":"2024-04-24T23:07:07.309627+0000","last_fullsized":"2024-04-24T23:07:07.309627+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.331742+0000","last_change":"2024-04-24T23:07:07.331742+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.331742+0000","last_undegraded":"2024-04-24T23:07:07.331742+0000","last_fullsized":"2024-04-24T23:07:07.331742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.331849+0000","last_change":"2024-04-24T23:07:07.331849+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.331849+0000","last_undegraded":"2024-04-24T23:07:07.331849+0000","last_fullsized":"2024-04-24T23:07:07.331849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.317780+0000","last_change":"2024-04-24T23:07:07.317780+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.317780+0000","last_undegraded":"2024-04-24T23:07:07.317780+0000","last_fullsized":"2024-04-24T23:07:07.317780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.314022+0000","last_change":"2024-04-24T23:07:07.314022+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.314022+0000","last_undegraded":"2024-04-24T23:07:07.314022+0000","last_fullsized":"2024-04-24T23:07:07.314022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931315+0000","last_change":"2024-04-24T23:07:09.383240+0000","last_active":"2024-04-24T23:07:10.931315+0000","last_peered":"2024-04-24T23:07:10.931315+0000","last_clean":"2024-04-24T23:07:10.931315+0000","last_became_active":"2024-04-24T23:07:09.382970+0000","last_became_peered":"2024-04-24T23:07:09.382970+0000","last_unstale":"2024-04-24T23:07:10.931315+0000","last_undegraded":"2024-04-24T23:07:10.931315+0000","last_fullsized":"2024-04-24T23:07:10.931315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:07.866812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932385+0000","last_change":"2024-04-24T23:07:08.349494+0000","last_active":"2024-04-24T23:07:10.932385+0000","last_peered":"2024-04-24T23:07:10.932385+0000","last_clean":"2024-04-24T23:07:10.932385+0000","last_became_active":"2024-04-24T23:07:08.349166+0000","last_became_peered":"2024-04-24T23:07:08.349166+0000","last_unstale":"2024-04-24T23:07:10.932385+0000","last_undegraded":"2024-04-24T23:07:10.932385+0000","last_fullsized":"2024-04-24T23:07:10.932385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:07.577678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.309148+0000","last_change":"2024-04-24T23:07:07.309148+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.309148+0000","last_undegraded":"2024-04-24T23:07:07.309148+0000","last_fullsized":"2024-04-24T23:07:07.309148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929798+0000","last_change":"2024-04-24T23:07:08.348566+0000","last_active":"2024-04-24T23:07:10.929798+0000","last_peered":"2024-04-24T23:07:10.929798+0000","last_clean":"2024-04-24T23:07:10.929798+0000","last_became_active":"2024-04-24T23:07:08.348291+0000","last_became_peered":"2024-04-24T23:07:08.348291+0000","last_unstale":"2024-04-24T23:07:10.929798+0000","last_undegraded":"2024-04-24T23:07:10.929798+0000","last_fullsized":"2024-04-24T23:07:10.929798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:33.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.330544+0000","last_change":"2024-04-24T23:07:07.330544+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.330544+0000","last_undegraded":"2024-04-24T23:07:07.330544+0000","last_fullsized":"2024-04-24T23:07:07.330544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.330022+0000","last_change":"2024-04-24T23:07:07.330022+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.330022+0000","last_undegraded":"2024-04-24T23:07:07.330022+0000","last_fullsized":"2024-04-24T23:07:07.330022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931873+0000","last_change":"2024-04-24T23:07:08.349722+0000","last_active":"2024-04-24T23:07:10.931873+0000","last_peered":"2024-04-24T23:07:10.931873+0000","last_clean":"2024-04-24T23:07:10.931873+0000","last_became_active":"2024-04-24T23:07:08.348161+0000","last_became_peered":"2024-04-24T23:07:08.348161+0000","last_unstale":"2024-04-24T23:07:10.931873+0000","last_undegraded":"2024-04-24T23:07:10.931873+0000","last_fullsized":"2024-04-24T23:07:10.931873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:33.118085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.310985+0000","last_change":"2024-04-24T23:07:07.310985+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.310985+0000","last_undegraded":"2024-04-24T23:07:07.310985+0000","last_fullsized":"2024-04-24T23:07:07.310985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.309040+0000","last_change":"2024-04-24T23:07:07.309040+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.309040+0000","last_undegraded":"2024-04-24T23:07:07.309040+0000","last_fullsized":"2024-04-24T23:07:07.309040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.315187+0000","last_change":"2024-04-24T23:07:07.315187+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.315187+0000","last_undegraded":"2024-04-24T23:07:07.315187+0000","last_fullsized":"2024-04-24T23:07:07.315187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930661+0000","last_change":"2024-04-24T23:07:09.377443+0000","last_active":"2024-04-24T23:07:10.930661+0000","last_peered":"2024-04-24T23:07:10.930661+0000","last_clean":"2024-04-24T23:07:10.930661+0000","last_became_active":"2024-04-24T23:07:09.377164+0000","last_became_peered":"2024-04-24T23:07:09.377164+0000","last_unstale":"2024-04-24T23:07:10.930661+0000","last_undegraded":"2024-04-24T23:07:10.930661+0000","last_fullsized":"2024-04-24T23:07:10.930661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:54.085122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-24T23:07:07.310991+0000","last_change":"2024-04-24T23:07:07.310991+0000","last_active":"2024-04-24T23:07:07.287118+0000","last_peered":"2024-04-24T23:07:07.287118+0000","last_clean":"2024-04-24T23:07:07.287118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:07.310991+0000","last_undegraded":"2024-04-24T23:07:07.310991+0000","last_fullsized":"2024-04-24T23:07:07.310991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929970+0000","last_change":"2024-04-24T23:07:08.347253+0000","last_active":"2024-04-24T23:07:10.929970+0000","last_peered":"2024-04-24T23:07:10.929970+0000","last_clean":"2024-04-24T23:07:10.929970+0000","last_became_active":"2024-04-24T23:07:08.345809+0000","last_became_peered":"2024-04-24T23:07:08.345809+0000","last_unstale":"2024-04-24T23:07:10.929970+0000","last_undegraded":"2024-04-24T23:07:10.929970+0000","last_fullsized":"2024-04-24T23:07:10.929970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:48:42.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-24T23:07:08.302520+0000","last_change":"2024-04-24T23:07:08.302520+0000","last_active":"2024-04-24T23:07:08.302520+0000","last_peered":"2024-04-24T23:07:08.302520+0000","last_clean":"2024-04-24T23:07:08.302520+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:07:08.302520+0000","last_undegraded":"2024-04-24T23:07:08.302520+0000","last_fullsized":"2024-04-24T23:07:08.302520+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930215+0000","last_change":"2024-04-24T23:07:08.351614+0000","last_active":"2024-04-24T23:07:10.930215+0000","last_peered":"2024-04-24T23:07:10.930215+0000","last_clean":"2024-04-24T23:07:10.930215+0000","last_became_active":"2024-04-24T23:07:08.351175+0000","last_became_peered":"2024-04-24T23:07:08.351175+0000","last_unstale":"2024-04-24T23:07:10.930215+0000","last_undegraded":"2024-04-24T23:07:10.930215+0000","last_fullsized":"2024-04-24T23:07:10.930215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:44.519105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":253,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-24T23:07:07.307695+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:07:07.307695+0000","last_peered":"2024-04-24T23:07:07.307695+0000","last_clean":"2024-04-24T23:07:07.307695+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:07:07.307695+0000","last_undegraded":"2024-04-24T23:07:07.307695+0000","last_fullsized":"2024-04-24T23:07:07.307695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":340002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":340002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":778240,"data_stored":346211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":340002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":340002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":936579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":346211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":952137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:07:13.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:07:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.989+0000 7faf61400640 1 Processor -- start 2024-04-24T23:07:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.989+0000 7faf61400640 1 -- start start 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.990+0000 7faf61400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 0x7faf5c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.990+0000 7faf61400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5c1449c0 con 0x7faf5c071320 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.990+0000 7faf61400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5c071820 con 0x7faf5c0728c0 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.990+0000 7faf61400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c072430 con 0x7faf5c1445e0 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.991+0000 7faf5b200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faf5c071320 0x7faf5c0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33136/0 (socket says 172.21.15.146:33136) 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.991+0000 7faf5b200640 1 -- 172.21.15.146:0/3334303171 learned_addr learned my addr 172.21.15.146:0/3334303171 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.991+0000 7faf5a800640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 0x7faf5c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.991+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345949348 0 0) 0x7faf5c1449c0 con 0x7faf5c071320 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.991+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf40003420 con 0x7faf5c071320 2024-04-24T23:07:15.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2611280355 0 0) 0x7faf40003420 con 0x7faf5c071320 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 msgr2=0x7faf5c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 0x7faf5c0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 >> v1:172.21.15.203:6789/0 conn(0x7faf5c0728c0 legacy=0x7faf5c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c071b00 con 0x7faf5c071320 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7faf54001670 con 0x7faf5c071320 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 >> v1:172.21.15.146:6789/0 conn(0x7faf5c071320 legacy=0x7faf5c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf40004ac0 0x7faf40004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 0x7faf400036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40003de0 0x7faf4000fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c072430 con 0x7faf40004ac0 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf400044e0 con 0x7faf40003de0 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf400100b0 con 0x7faf5c1445e0 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.992+0000 7faf5a800640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf40004ac0 0x7faf40004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5a800640 1 -- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 msgr2=0x7faf400036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5b200640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40003de0 0x7faf4000fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5a800640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1445e0 0x7faf400036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5a800640 1 -- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40003de0 msgr2=0x7faf4000fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5a800640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40003de0 0x7faf4000fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.993+0000 7faf5a800640 1 -- 172.21.15.146:0/3334303171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf40003420 con 0x7faf40004ac0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf5a800640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf40004ac0 0x7faf40004ee0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009af0 tx=0x7faf40004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaf99fce692cf76 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c036070 con 0x7faf40004ac0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c031400 con 0x7faf40004ac0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf59e00640 1 -- 172.21.15.146:0/3334303171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c009690 con 0x7faf40004ac0 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf61400640 1 -- 172.21.15.146:0/3334303171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf40004ac0 msgr2=0x7faf40004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf61400640 1 --2- 172.21.15.146:0/3334303171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf40004ac0 0x7faf40004ee0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009af0 tx=0x7faf40004720 comp rx=0 tx=0).stop 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.994+0000 7faf5b200640 1 -- 172.21.15.146:0/3334303171 reap_dead start 2024-04-24T23:07:15.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.995+0000 7faf61400640 1 -- 172.21.15.146:0/3334303171 shutdown_connections 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.995+0000 7faf61400640 1 -- 172.21.15.146:0/3334303171 >> 172.21.15.146:0/3334303171 conn(0x7faf5c06b320 msgr2=0x7faf5c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.995+0000 7faf61400640 1 -- 172.21.15.146:0/3334303171 shutdown_connections 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.995+0000 7faf61400640 1 -- 172.21.15.146:0/3334303171 wait complete. 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.996+0000 7faf61400640 1 Processor -- start 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 -- start start 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40004ac0 0x7faf5c139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1e3280 0x7faf5c137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0720c0 con 0x7faf5c1efd30 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0b2d70 con 0x7faf40004ac0 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.997+0000 7faf61400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0cd5e0 con 0x7faf5c1e3280 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33490/0 (socket says 172.21.15.146:33490) 2024-04-24T23:07:15.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 -- 172.21.15.146:0/2664815597 learned_addr learned my addr 172.21.15.146:0/2664815597 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 -- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1e3280 msgr2=0x7faf5c137fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5a800640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40004ac0 0x7faf5c139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf51e00640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1e3280 0x7faf5c137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1e3280 0x7faf5c137fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 -- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40004ac0 msgr2=0x7faf5c139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40004ac0 0x7faf5c139b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.998+0000 7faf5b200640 1 -- 172.21.15.146:0/2664815597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c1e3700 con 0x7faf5c1efd30 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf5b200640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d4c0 tx=0x7faf5400d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54007440 con 0x7faf5c1efd30 2024-04-24T23:07:15.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf54007600 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54004a20 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c1384f0 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:13.999+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c13abc0 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.000+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c068190 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.002+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf5401b020 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.002+0000 7faf53400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 0x7faf3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.003+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7faf5408ab30 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.003+0000 7faf5a800640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 0x7faf3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.004+0000 7faf5a800640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 0x7faf3806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faf4c033000 tx=0x7faf4c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.007+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faf54059220 con 0x7faf5c1efd30 2024-04-24T23:07:15.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.202+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf5c06eab0 con 0x7faf3806be30 2024-04-24T23:07:15.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.223+0000 7faf53400640 1 -- 172.21.15.146:0/2664815597 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252021 (secure 0 0 0) 0x7faf5c06eab0 con 0x7faf3806be30 2024-04-24T23:07:15.243 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:15.244 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 msgr2=0x7faf3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 0x7faf3806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faf4c033000 tx=0x7faf4c008030 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 msgr2=0x7faf5c1f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d4c0 tx=0x7faf5400d980 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 shutdown_connections 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5c1efd30 0x7faf5c1f2500 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faf3806be30 0x7faf3806e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf5c1e3280 0x7faf5c137fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 --2- 172.21.15.146:0/2664815597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf40004ac0 0x7faf5c139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 >> 172.21.15.146:0/2664815597 conn(0x7faf5c06b320 msgr2=0x7faf5c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:15.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 shutdown_connections 2024-04-24T23:07:15.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:14.229+0000 7faf61400640 1 -- 172.21.15.146:0/2664815597 wait complete. 2024-04-24T23:07:15.248 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-24T23:07:13.751711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257044,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717676,"statfs":{"total":773094113280,"available":772830900224,"internally_reserved":0,"allocated":7761920,"data_stored":4112760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002174"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932327+0000","last_change":"2024-04-24T23:07:09.384465+0000","last_active":"2024-04-24T23:07:10.932327+0000","last_peered":"2024-04-24T23:07:10.932327+0000","last_clean":"2024-04-24T23:07:10.932327+0000","last_became_active":"2024-04-24T23:07:09.384180+0000","last_became_peered":"2024-04-24T23:07:09.384180+0000","last_unstale":"2024-04-24T23:07:10.932327+0000","last_undegraded":"2024-04-24T23:07:10.932327+0000","last_fullsized":"2024-04-24T23:07:10.932327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:15:43.129294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931750+0000","last_change":"2024-04-24T23:07:09.385110+0000","last_active":"2024-04-24T23:07:10.931750+0000","last_peered":"2024-04-24T23:07:10.931750+0000","last_clean":"2024-04-24T23:07:10.931750+0000","last_became_active":"2024-04-24T23:07:09.384841+0000","last_became_peered":"2024-04-24T23:07:09.384841+0000","last_unstale":"2024-04-24T23:07:10.931750+0000","last_undegraded":"2024-04-24T23:07:10.931750+0000","last_fullsized":"2024-04-24T23:07:10.931750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:46:53.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929534+0000","last_change":"2024-04-24T23:07:09.374641+0000","last_active":"2024-04-24T23:07:10.929534+0000","last_peered":"2024-04-24T23:07:10.929534+0000","last_clean":"2024-04-24T23:07:10.929534+0000","last_became_active":"2024-04-24T23:07:09.374337+0000","last_became_peered":"2024-04-24T23:07:09.374337+0000","last_unstale":"2024-04-24T23:07:10.929534+0000","last_undegraded":"2024-04-24T23:07:10.929534+0000","last_fullsized":"2024-04-24T23:07:10.929534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:30.316190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383340+0000","last_change":"2024-04-24T23:07:09.365261+0000","last_active":"2024-04-24T23:07:10.383340+0000","last_peered":"2024-04-24T23:07:10.383340+0000","last_clean":"2024-04-24T23:07:10.383340+0000","last_became_active":"2024-04-24T23:07:09.364906+0000","last_became_peered":"2024-04-24T23:07:09.364906+0000","last_unstale":"2024-04-24T23:07:10.383340+0000","last_undegraded":"2024-04-24T23:07:10.383340+0000","last_fullsized":"2024-04-24T23:07:10.383340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:54.596286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929714+0000","last_change":"2024-04-24T23:07:09.366305+0000","last_active":"2024-04-24T23:07:10.929714+0000","last_peered":"2024-04-24T23:07:10.929714+0000","last_clean":"2024-04-24T23:07:10.929714+0000","last_became_active":"2024-04-24T23:07:09.364757+0000","last_became_peered":"2024-04-24T23:07:09.364757+0000","last_unstale":"2024-04-24T23:07:10.929714+0000","last_undegraded":"2024-04-24T23:07:10.929714+0000","last_fullsized":"2024-04-24T23:07:10.929714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:27.992234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930247+0000","last_change":"2024-04-24T23:07:09.385843+0000","last_active":"2024-04-24T23:07:10.930247+0000","last_peered":"2024-04-24T23:07:10.930247+0000","last_clean":"2024-04-24T23:07:10.930247+0000","last_became_active":"2024-04-24T23:07:09.385499+0000","last_became_peered":"2024-04-24T23:07:09.385499+0000","last_unstale":"2024-04-24T23:07:10.930247+0000","last_undegraded":"2024-04-24T23:07:10.930247+0000","last_fullsized":"2024-04-24T23:07:10.930247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:29.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930346+0000","last_change":"2024-04-24T23:07:09.367976+0000","last_active":"2024-04-24T23:07:10.930346+0000","last_peered":"2024-04-24T23:07:10.930346+0000","last_clean":"2024-04-24T23:07:10.930346+0000","last_became_active":"2024-04-24T23:07:09.367686+0000","last_became_peered":"2024-04-24T23:07:09.367686+0000","last_unstale":"2024-04-24T23:07:10.930346+0000","last_undegraded":"2024-04-24T23:07:10.930346+0000","last_fullsized":"2024-04-24T23:07:10.930346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:24.976418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929628+0000","last_change":"2024-04-24T23:07:09.365320+0000","last_active":"2024-04-24T23:07:10.929628+0000","last_peered":"2024-04-24T23:07:10.929628+0000","last_clean":"2024-04-24T23:07:10.929628+0000","last_became_active":"2024-04-24T23:07:09.364943+0000","last_became_peered":"2024-04-24T23:07:09.364943+0000","last_unstale":"2024-04-24T23:07:10.929628+0000","last_undegraded":"2024-04-24T23:07:10.929628+0000","last_fullsized":"2024-04-24T23:07:10.929628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:18.923335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382959+0000","last_change":"2024-04-24T23:07:09.367599+0000","last_active":"2024-04-24T23:07:10.382959+0000","last_peered":"2024-04-24T23:07:10.382959+0000","last_clean":"2024-04-24T23:07:10.382959+0000","last_became_active":"2024-04-24T23:07:09.367301+0000","last_became_peered":"2024-04-24T23:07:09.367301+0000","last_unstale":"2024-04-24T23:07:10.382959+0000","last_undegraded":"2024-04-24T23:07:10.382959+0000","last_fullsized":"2024-04-24T23:07:10.382959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:17.371439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.339221+0000","last_change":"2024-04-24T23:07:09.372443+0000","last_active":"2024-04-24T23:07:10.339221+0000","last_peered":"2024-04-24T23:07:10.339221+0000","last_clean":"2024-04-24T23:07:10.339221+0000","last_became_active":"2024-04-24T23:07:09.372142+0000","last_became_peered":"2024-04-24T23:07:09.372142+0000","last_unstale":"2024-04-24T23:07:10.339221+0000","last_undegraded":"2024-04-24T23:07:10.339221+0000","last_fullsized":"2024-04-24T23:07:10.339221+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:53.419007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382664+0000","last_change":"2024-04-24T23:07:09.377412+0000","last_active":"2024-04-24T23:07:10.382664+0000","last_peered":"2024-04-24T23:07:10.382664+0000","last_clean":"2024-04-24T23:07:10.382664+0000","last_became_active":"2024-04-24T23:07:09.377095+0000","last_became_peered":"2024-04-24T23:07:09.377095+0000","last_unstale":"2024-04-24T23:07:10.382664+0000","last_undegraded":"2024-04-24T23:07:10.382664+0000","last_fullsized":"2024-04-24T23:07:10.382664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:05.158658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383307+0000","last_change":"2024-04-24T23:07:09.369830+0000","last_active":"2024-04-24T23:07:10.383307+0000","last_peered":"2024-04-24T23:07:10.383307+0000","last_clean":"2024-04-24T23:07:10.383307+0000","last_became_active":"2024-04-24T23:07:09.369546+0000","last_became_peered":"2024-04-24T23:07:09.369546+0000","last_unstale":"2024-04-24T23:07:10.383307+0000","last_undegraded":"2024-04-24T23:07:10.383307+0000","last_fullsized":"2024-04-24T23:07:10.383307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:35.823078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534144+0000","last_change":"2024-04-24T23:07:09.376730+0000","last_active":"2024-04-24T23:07:10.534144+0000","last_peered":"2024-04-24T23:07:10.534144+0000","last_clean":"2024-04-24T23:07:10.534144+0000","last_became_active":"2024-04-24T23:07:09.376292+0000","last_became_peered":"2024-04-24T23:07:09.376292+0000","last_unstale":"2024-04-24T23:07:10.534144+0000","last_undegraded":"2024-04-24T23:07:10.534144+0000","last_fullsized":"2024-04-24T23:07:10.534144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:59.276861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534448+0000","last_change":"2024-04-24T23:07:09.378346+0000","last_active":"2024-04-24T23:07:10.534448+0000","last_peered":"2024-04-24T23:07:10.534448+0000","last_clean":"2024-04-24T23:07:10.534448+0000","last_became_active":"2024-04-24T23:07:09.378053+0000","last_became_peered":"2024-04-24T23:07:09.378053+0000","last_unstale":"2024-04-24T23:07:10.534448+0000","last_undegraded":"2024-04-24T23:07:10.534448+0000","last_fullsized":"2024-04-24T23:07:10.534448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:34.007501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338548+0000","last_change":"2024-04-24T23:07:09.373510+0000","last_active":"2024-04-24T23:07:10.338548+0000","last_peered":"2024-04-24T23:07:10.338548+0000","last_clean":"2024-04-24T23:07:10.338548+0000","last_became_active":"2024-04-24T23:07:09.373159+0000","last_became_peered":"2024-04-24T23:07:09.373159+0000","last_unstale":"2024-04-24T23:07:10.338548+0000","last_undegraded":"2024-04-24T23:07:10.338548+0000","last_fullsized":"2024-04-24T23:07:10.338548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:35.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.340835+0000","last_change":"2024-04-24T23:07:09.370360+0000","last_active":"2024-04-24T23:07:10.340835+0000","last_peered":"2024-04-24T23:07:10.340835+0000","last_clean":"2024-04-24T23:07:10.340835+0000","last_became_active":"2024-04-24T23:07:09.370067+0000","last_became_peered":"2024-04-24T23:07:09.370067+0000","last_unstale":"2024-04-24T23:07:10.340835+0000","last_undegraded":"2024-04-24T23:07:10.340835+0000","last_fullsized":"2024-04-24T23:07:10.340835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:04.767751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.344936+0000","last_change":"2024-04-24T23:07:09.384028+0000","last_active":"2024-04-24T23:07:10.344936+0000","last_peered":"2024-04-24T23:07:10.344936+0000","last_clean":"2024-04-24T23:07:10.344936+0000","last_became_active":"2024-04-24T23:07:09.383722+0000","last_became_peered":"2024-04-24T23:07:09.383722+0000","last_unstale":"2024-04-24T23:07:10.344936+0000","last_undegraded":"2024-04-24T23:07:10.344936+0000","last_fullsized":"2024-04-24T23:07:10.344936+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:01.732581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382598+0000","last_change":"2024-04-24T23:07:09.368878+0000","last_active":"2024-04-24T23:07:10.382598+0000","last_peered":"2024-04-24T23:07:10.382598+0000","last_clean":"2024-04-24T23:07:10.382598+0000","last_became_active":"2024-04-24T23:07:09.368565+0000","last_became_peered":"2024-04-24T23:07:09.368565+0000","last_unstale":"2024-04-24T23:07:10.382598+0000","last_undegraded":"2024-04-24T23:07:10.382598+0000","last_fullsized":"2024-04-24T23:07:10.382598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:00:25.493273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382559+0000","last_change":"2024-04-24T23:07:09.376804+0000","last_active":"2024-04-24T23:07:10.382559+0000","last_peered":"2024-04-24T23:07:10.382559+0000","last_clean":"2024-04-24T23:07:10.382559+0000","last_became_active":"2024-04-24T23:07:09.376010+0000","last_became_peered":"2024-04-24T23:07:09.376010+0000","last_unstale":"2024-04-24T23:07:10.382559+0000","last_undegraded":"2024-04-24T23:07:10.382559+0000","last_fullsized":"2024-04-24T23:07:10.382559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:36:51.113076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.342675+0000","last_change":"2024-04-24T23:07:09.372085+0000","last_active":"2024-04-24T23:07:10.342675+0000","last_peered":"2024-04-24T23:07:10.342675+0000","last_clean":"2024-04-24T23:07:10.342675+0000","last_became_active":"2024-04-24T23:07:09.371646+0000","last_became_peered":"2024-04-24T23:07:09.371646+0000","last_unstale":"2024-04-24T23:07:10.342675+0000","last_undegraded":"2024-04-24T23:07:10.342675+0000","last_fullsized":"2024-04-24T23:07:10.342675+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:03.765634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534347+0000","last_change":"2024-04-24T23:07:09.375166+0000","last_active":"2024-04-24T23:07:10.534347+0000","last_peered":"2024-04-24T23:07:10.534347+0000","last_clean":"2024-04-24T23:07:10.534347+0000","last_became_active":"2024-04-24T23:07:09.374803+0000","last_became_peered":"2024-04-24T23:07:09.374803+0000","last_unstale":"2024-04-24T23:07:10.534347+0000","last_undegraded":"2024-04-24T23:07:10.534347+0000","last_fullsized":"2024-04-24T23:07:10.534347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:53.419007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931052+0000","last_change":"2024-04-24T23:07:09.380547+0000","last_active":"2024-04-24T23:07:10.931052+0000","last_peered":"2024-04-24T23:07:10.931052+0000","last_clean":"2024-04-24T23:07:10.931052+0000","last_became_active":"2024-04-24T23:07:09.380263+0000","last_became_peered":"2024-04-24T23:07:09.380263+0000","last_unstale":"2024-04-24T23:07:10.931052+0000","last_undegraded":"2024-04-24T23:07:10.931052+0000","last_fullsized":"2024-04-24T23:07:10.931052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:02:42.155720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.340799+0000","last_change":"2024-04-24T23:07:09.384632+0000","last_active":"2024-04-24T23:07:10.340799+0000","last_peered":"2024-04-24T23:07:10.340799+0000","last_clean":"2024-04-24T23:07:10.340799+0000","last_became_active":"2024-04-24T23:07:09.384328+0000","last_became_peered":"2024-04-24T23:07:09.384328+0000","last_unstale":"2024-04-24T23:07:10.340799+0000","last_undegraded":"2024-04-24T23:07:10.340799+0000","last_fullsized":"2024-04-24T23:07:10.340799+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:35.546456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929671+0000","last_change":"2024-04-24T23:07:09.370886+0000","last_active":"2024-04-24T23:07:10.929671+0000","last_peered":"2024-04-24T23:07:10.929671+0000","last_clean":"2024-04-24T23:07:10.929671+0000","last_became_active":"2024-04-24T23:07:09.370543+0000","last_became_peered":"2024-04-24T23:07:09.370543+0000","last_unstale":"2024-04-24T23:07:10.929671+0000","last_undegraded":"2024-04-24T23:07:10.929671+0000","last_fullsized":"2024-04-24T23:07:10.929671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:54:22.667870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.535042+0000","last_change":"2024-04-24T23:07:09.380023+0000","last_active":"2024-04-24T23:07:10.535042+0000","last_peered":"2024-04-24T23:07:10.535042+0000","last_clean":"2024-04-24T23:07:10.535042+0000","last_became_active":"2024-04-24T23:07:09.379755+0000","last_became_peered":"2024-04-24T23:07:09.379755+0000","last_unstale":"2024-04-24T23:07:10.535042+0000","last_undegraded":"2024-04-24T23:07:10.535042+0000","last_fullsized":"2024-04-24T23:07:10.535042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:22.056715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929339+0000","last_change":"2024-04-24T23:07:09.355085+0000","last_active":"2024-04-24T23:07:10.929339+0000","last_peered":"2024-04-24T23:07:10.929339+0000","last_clean":"2024-04-24T23:07:10.929339+0000","last_became_active":"2024-04-24T23:07:09.354490+0000","last_became_peered":"2024-04-24T23:07:09.354490+0000","last_unstale":"2024-04-24T23:07:10.929339+0000","last_undegraded":"2024-04-24T23:07:10.929339+0000","last_fullsized":"2024-04-24T23:07:10.929339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:01.732581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534930+0000","last_change":"2024-04-24T23:07:09.373588+0000","last_active":"2024-04-24T23:07:10.534930+0000","last_peered":"2024-04-24T23:07:10.534930+0000","last_clean":"2024-04-24T23:07:10.534930+0000","last_became_active":"2024-04-24T23:07:09.373224+0000","last_became_peered":"2024-04-24T23:07:09.373224+0000","last_unstale":"2024-04-24T23:07:10.534930+0000","last_undegraded":"2024-04-24T23:07:10.534930+0000","last_fullsized":"2024-04-24T23:07:10.534930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:19.855286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931026+0000","last_change":"2024-04-24T23:07:09.370605+0000","last_active":"2024-04-24T23:07:10.931026+0000","last_peered":"2024-04-24T23:07:10.931026+0000","last_clean":"2024-04-24T23:07:10.931026+0000","last_became_active":"2024-04-24T23:07:09.370172+0000","last_became_peered":"2024-04-24T23:07:09.370172+0000","last_unstale":"2024-04-24T23:07:10.931026+0000","last_undegraded":"2024-04-24T23:07:10.931026+0000","last_fullsized":"2024-04-24T23:07:10.931026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:07.673750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383771+0000","last_change":"2024-04-24T23:07:09.377255+0000","last_active":"2024-04-24T23:07:10.383771+0000","last_peered":"2024-04-24T23:07:10.383771+0000","last_clean":"2024-04-24T23:07:10.383771+0000","last_became_active":"2024-04-24T23:07:09.376569+0000","last_became_peered":"2024-04-24T23:07:09.376569+0000","last_unstale":"2024-04-24T23:07:10.383771+0000","last_undegraded":"2024-04-24T23:07:10.383771+0000","last_fullsized":"2024-04-24T23:07:10.383771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:40.719420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382571+0000","last_change":"2024-04-24T23:07:09.371021+0000","last_active":"2024-04-24T23:07:10.382571+0000","last_peered":"2024-04-24T23:07:10.382571+0000","last_clean":"2024-04-24T23:07:10.382571+0000","last_became_active":"2024-04-24T23:07:09.369659+0000","last_became_peered":"2024-04-24T23:07:09.369659+0000","last_unstale":"2024-04-24T23:07:10.382571+0000","last_undegraded":"2024-04-24T23:07:10.382571+0000","last_fullsized":"2024-04-24T23:07:10.382571+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:15:43.129294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929891+0000","last_change":"2024-04-24T23:07:09.370053+0000","last_active":"2024-04-24T23:07:10.929891+0000","last_peered":"2024-04-24T23:07:10.929891+0000","last_clean":"2024-04-24T23:07:10.929891+0000","last_became_active":"2024-04-24T23:07:09.369712+0000","last_became_peered":"2024-04-24T23:07:09.369712+0000","last_unstale":"2024-04-24T23:07:10.929891+0000","last_undegraded":"2024-04-24T23:07:10.929891+0000","last_fullsized":"2024-04-24T23:07:10.929891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:50.188429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930265+0000","last_change":"2024-04-24T23:07:09.377684+0000","last_active":"2024-04-24T23:07:10.930265+0000","last_peered":"2024-04-24T23:07:10.930265+0000","last_clean":"2024-04-24T23:07:10.930265+0000","last_became_active":"2024-04-24T23:07:09.376175+0000","last_became_peered":"2024-04-24T23:07:09.376175+0000","last_unstale":"2024-04-24T23:07:10.930265+0000","last_undegraded":"2024-04-24T23:07:10.930265+0000","last_fullsized":"2024-04-24T23:07:10.930265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:01.496052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383586+0000","last_change":"2024-04-24T23:07:09.372507+0000","last_active":"2024-04-24T23:07:10.383586+0000","last_peered":"2024-04-24T23:07:10.383586+0000","last_clean":"2024-04-24T23:07:10.383586+0000","last_became_active":"2024-04-24T23:07:09.372000+0000","last_became_peered":"2024-04-24T23:07:09.372000+0000","last_unstale":"2024-04-24T23:07:10.383586+0000","last_undegraded":"2024-04-24T23:07:10.383586+0000","last_fullsized":"2024-04-24T23:07:10.383586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:14:13.979970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932215+0000","last_change":"2024-04-24T23:07:08.346317+0000","last_active":"2024-04-24T23:07:10.932215+0000","last_peered":"2024-04-24T23:07:10.932215+0000","last_clean":"2024-04-24T23:07:10.932215+0000","last_became_active":"2024-04-24T23:07:08.346050+0000","last_became_peered":"2024-04-24T23:07:08.346050+0000","last_unstale":"2024-04-24T23:07:10.932215+0000","last_undegraded":"2024-04-24T23:07:10.932215+0000","last_fullsized":"2024-04-24T23:07:10.932215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:34.319252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930104+0000","last_change":"2024-04-24T23:07:09.362584+0000","last_active":"2024-04-24T23:07:10.930104+0000","last_peered":"2024-04-24T23:07:10.930104+0000","last_clean":"2024-04-24T23:07:10.930104+0000","last_became_active":"2024-04-24T23:07:09.362127+0000","last_became_peered":"2024-04-24T23:07:09.362127+0000","last_unstale":"2024-04-24T23:07:10.930104+0000","last_undegraded":"2024-04-24T23:07:10.930104+0000","last_fullsized":"2024-04-24T23:07:10.930104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:09:43.030023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931855+0000","last_change":"2024-04-24T23:07:08.348595+0000","last_active":"2024-04-24T23:07:10.931855+0000","last_peered":"2024-04-24T23:07:10.931855+0000","last_clean":"2024-04-24T23:07:10.931855+0000","last_became_active":"2024-04-24T23:07:08.348267+0000","last_became_peered":"2024-04-24T23:07:08.348267+0000","last_unstale":"2024-04-24T23:07:10.931855+0000","last_undegraded":"2024-04-24T23:07:10.931855+0000","last_fullsized":"2024-04-24T23:07:10.931855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:58.261459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932133+0000","last_change":"2024-04-24T23:07:09.386252+0000","last_active":"2024-04-24T23:07:10.932133+0000","last_peered":"2024-04-24T23:07:10.932133+0000","last_clean":"2024-04-24T23:07:10.932133+0000","last_became_active":"2024-04-24T23:07:09.385997+0000","last_became_peered":"2024-04-24T23:07:09.385997+0000","last_unstale":"2024-04-24T23:07:10.932133+0000","last_undegraded":"2024-04-24T23:07:10.932133+0000","last_fullsized":"2024-04-24T23:07:10.932133+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:46.308652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932231+0000","last_change":"2024-04-24T23:07:08.342551+0000","last_active":"2024-04-24T23:07:10.932231+0000","last_peered":"2024-04-24T23:07:10.932231+0000","last_clean":"2024-04-24T23:07:10.932231+0000","last_became_active":"2024-04-24T23:07:08.342159+0000","last_became_peered":"2024-04-24T23:07:08.342159+0000","last_unstale":"2024-04-24T23:07:10.932231+0000","last_undegraded":"2024-04-24T23:07:10.932231+0000","last_fullsized":"2024-04-24T23:07:10.932231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:27:58.167821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383165+0000","last_change":"2024-04-24T23:07:09.361765+0000","last_active":"2024-04-24T23:07:10.383165+0000","last_peered":"2024-04-24T23:07:10.383165+0000","last_clean":"2024-04-24T23:07:10.383165+0000","last_became_active":"2024-04-24T23:07:09.360493+0000","last_became_peered":"2024-04-24T23:07:09.360493+0000","last_unstale":"2024-04-24T23:07:10.383165+0000","last_undegraded":"2024-04-24T23:07:10.383165+0000","last_fullsized":"2024-04-24T23:07:10.383165+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:46.736054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930915+0000","last_change":"2024-04-24T23:07:08.351767+0000","last_active":"2024-04-24T23:07:10.930915+0000","last_peered":"2024-04-24T23:07:10.930915+0000","last_clean":"2024-04-24T23:07:10.930915+0000","last_became_active":"2024-04-24T23:07:08.350972+0000","last_became_peered":"2024-04-24T23:07:08.350972+0000","last_unstale":"2024-04-24T23:07:10.930915+0000","last_undegraded":"2024-04-24T23:07:10.930915+0000","last_fullsized":"2024-04-24T23:07:10.930915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:34.244407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.341953+0000","last_change":"2024-04-24T23:07:09.374306+0000","last_active":"2024-04-24T23:07:10.341953+0000","last_peered":"2024-04-24T23:07:10.341953+0000","last_clean":"2024-04-24T23:07:10.341953+0000","last_became_active":"2024-04-24T23:07:09.372858+0000","last_became_peered":"2024-04-24T23:07:09.372858+0000","last_unstale":"2024-04-24T23:07:10.341953+0000","last_undegraded":"2024-04-24T23:07:10.341953+0000","last_fullsized":"2024-04-24T23:07:10.341953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:49:31.460525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.342879+0000","last_change":"2024-04-24T23:07:08.340331+0000","last_active":"2024-04-24T23:07:10.342879+0000","last_peered":"2024-04-24T23:07:10.342879+0000","last_clean":"2024-04-24T23:07:10.342879+0000","last_became_active":"2024-04-24T23:07:08.340012+0000","last_became_peered":"2024-04-24T23:07:08.340012+0000","last_unstale":"2024-04-24T23:07:10.342879+0000","last_undegraded":"2024-04-24T23:07:10.342879+0000","last_fullsized":"2024-04-24T23:07:10.342879+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:33.829550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930671+0000","last_change":"2024-04-24T23:07:09.370923+0000","last_active":"2024-04-24T23:07:10.930671+0000","last_peered":"2024-04-24T23:07:10.930671+0000","last_clean":"2024-04-24T23:07:10.930671+0000","last_became_active":"2024-04-24T23:07:09.370604+0000","last_became_peered":"2024-04-24T23:07:09.370604+0000","last_unstale":"2024-04-24T23:07:10.930671+0000","last_undegraded":"2024-04-24T23:07:10.930671+0000","last_fullsized":"2024-04-24T23:07:10.930671+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:51.665328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931054+0000","last_change":"2024-04-24T23:07:08.345939+0000","last_active":"2024-04-24T23:07:10.931054+0000","last_peered":"2024-04-24T23:07:10.931054+0000","last_clean":"2024-04-24T23:07:10.931054+0000","last_became_active":"2024-04-24T23:07:08.345638+0000","last_became_peered":"2024-04-24T23:07:08.345638+0000","last_unstale":"2024-04-24T23:07:10.931054+0000","last_undegraded":"2024-04-24T23:07:10.931054+0000","last_fullsized":"2024-04-24T23:07:10.931054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:11.127294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338756+0000","last_change":"2024-04-24T23:07:09.384225+0000","last_active":"2024-04-24T23:07:10.338756+0000","last_peered":"2024-04-24T23:07:10.338756+0000","last_clean":"2024-04-24T23:07:10.338756+0000","last_became_active":"2024-04-24T23:07:09.381527+0000","last_became_peered":"2024-04-24T23:07:09.381527+0000","last_unstale":"2024-04-24T23:07:10.338756+0000","last_undegraded":"2024-04-24T23:07:10.338756+0000","last_fullsized":"2024-04-24T23:07:10.338756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:02.428072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930751+0000","last_change":"2024-04-24T23:07:08.346707+0000","last_active":"2024-04-24T23:07:10.930751+0000","last_peered":"2024-04-24T23:07:10.930751+0000","last_clean":"2024-04-24T23:07:10.930751+0000","last_became_active":"2024-04-24T23:07:08.346356+0000","last_became_peered":"2024-04-24T23:07:08.346356+0000","last_unstale":"2024-04-24T23:07:10.930751+0000","last_undegraded":"2024-04-24T23:07:10.930751+0000","last_fullsized":"2024-04-24T23:07:10.930751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:01.412670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.342735+0000","last_change":"2024-04-24T23:07:09.356811+0000","last_active":"2024-04-24T23:07:10.342735+0000","last_peered":"2024-04-24T23:07:10.342735+0000","last_clean":"2024-04-24T23:07:10.342735+0000","last_became_active":"2024-04-24T23:07:09.356185+0000","last_became_peered":"2024-04-24T23:07:09.356185+0000","last_unstale":"2024-04-24T23:07:10.342735+0000","last_undegraded":"2024-04-24T23:07:10.342735+0000","last_fullsized":"2024-04-24T23:07:10.342735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:15.518971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382270+0000","last_change":"2024-04-24T23:07:08.340327+0000","last_active":"2024-04-24T23:07:10.382270+0000","last_peered":"2024-04-24T23:07:10.382270+0000","last_clean":"2024-04-24T23:07:10.382270+0000","last_became_active":"2024-04-24T23:07:08.339133+0000","last_became_peered":"2024-04-24T23:07:08.339133+0000","last_unstale":"2024-04-24T23:07:10.382270+0000","last_undegraded":"2024-04-24T23:07:10.382270+0000","last_fullsized":"2024-04-24T23:07:10.382270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:44.511984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931398+0000","last_change":"2024-04-24T23:07:09.378504+0000","last_active":"2024-04-24T23:07:10.931398+0000","last_peered":"2024-04-24T23:07:10.931398+0000","last_clean":"2024-04-24T23:07:10.931398+0000","last_became_active":"2024-04-24T23:07:09.377327+0000","last_became_peered":"2024-04-24T23:07:09.377327+0000","last_unstale":"2024-04-24T23:07:10.931398+0000","last_undegraded":"2024-04-24T23:07:10.931398+0000","last_fullsized":"2024-04-24T23:07:10.931398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:22.906699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383102+0000","last_change":"2024-04-24T23:07:08.350278+0000","last_active":"2024-04-24T23:07:10.383102+0000","last_peered":"2024-04-24T23:07:10.383102+0000","last_clean":"2024-04-24T23:07:10.383102+0000","last_became_active":"2024-04-24T23:07:08.349481+0000","last_became_peered":"2024-04-24T23:07:08.349481+0000","last_unstale":"2024-04-24T23:07:10.383102+0000","last_undegraded":"2024-04-24T23:07:10.383102+0000","last_fullsized":"2024-04-24T23:07:10.383102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:34.319252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.343339+0000","last_change":"2024-04-24T23:07:09.363769+0000","last_active":"2024-04-24T23:07:10.343339+0000","last_peered":"2024-04-24T23:07:10.343339+0000","last_clean":"2024-04-24T23:07:10.343339+0000","last_became_active":"2024-04-24T23:07:09.362998+0000","last_became_peered":"2024-04-24T23:07:09.362998+0000","last_unstale":"2024-04-24T23:07:10.343339+0000","last_undegraded":"2024-04-24T23:07:10.343339+0000","last_fullsized":"2024-04-24T23:07:10.343339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:27.236145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.535004+0000","last_change":"2024-04-24T23:07:08.344727+0000","last_active":"2024-04-24T23:07:10.535004+0000","last_peered":"2024-04-24T23:07:10.535004+0000","last_clean":"2024-04-24T23:07:10.535004+0000","last_became_active":"2024-04-24T23:07:08.344266+0000","last_became_peered":"2024-04-24T23:07:08.344266+0000","last_unstale":"2024-04-24T23:07:10.535004+0000","last_undegraded":"2024-04-24T23:07:10.535004+0000","last_fullsized":"2024-04-24T23:07:10.535004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:29.316462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534802+0000","last_change":"2024-04-24T23:07:09.375650+0000","last_active":"2024-04-24T23:07:10.534802+0000","last_peered":"2024-04-24T23:07:10.534802+0000","last_clean":"2024-04-24T23:07:10.534802+0000","last_became_active":"2024-04-24T23:07:09.375333+0000","last_became_peered":"2024-04-24T23:07:09.375333+0000","last_unstale":"2024-04-24T23:07:10.534802+0000","last_undegraded":"2024-04-24T23:07:10.534802+0000","last_fullsized":"2024-04-24T23:07:10.534802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:00.716168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929678+0000","last_change":"2024-04-24T23:07:08.343321+0000","last_active":"2024-04-24T23:07:10.929678+0000","last_peered":"2024-04-24T23:07:10.929678+0000","last_clean":"2024-04-24T23:07:10.929678+0000","last_became_active":"2024-04-24T23:07:08.343020+0000","last_became_peered":"2024-04-24T23:07:08.343020+0000","last_unstale":"2024-04-24T23:07:10.929678+0000","last_undegraded":"2024-04-24T23:07:10.929678+0000","last_fullsized":"2024-04-24T23:07:10.929678+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:18.946038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929646+0000","last_change":"2024-04-24T23:07:09.379037+0000","last_active":"2024-04-24T23:07:10.929646+0000","last_peered":"2024-04-24T23:07:10.929646+0000","last_clean":"2024-04-24T23:07:10.929646+0000","last_became_active":"2024-04-24T23:07:09.378746+0000","last_became_peered":"2024-04-24T23:07:09.378746+0000","last_unstale":"2024-04-24T23:07:10.929646+0000","last_undegraded":"2024-04-24T23:07:10.929646+0000","last_fullsized":"2024-04-24T23:07:10.929646+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:47:58.919018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931199+0000","last_change":"2024-04-24T23:07:08.352073+0000","last_active":"2024-04-24T23:07:10.931199+0000","last_peered":"2024-04-24T23:07:10.931199+0000","last_clean":"2024-04-24T23:07:10.931199+0000","last_became_active":"2024-04-24T23:07:08.351758+0000","last_became_peered":"2024-04-24T23:07:08.351758+0000","last_unstale":"2024-04-24T23:07:10.931199+0000","last_undegraded":"2024-04-24T23:07:10.931199+0000","last_fullsized":"2024-04-24T23:07:10.931199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:46:44.687789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338261+0000","last_change":"2024-04-24T23:07:09.371301+0000","last_active":"2024-04-24T23:07:10.338261+0000","last_peered":"2024-04-24T23:07:10.338261+0000","last_clean":"2024-04-24T23:07:10.338261+0000","last_became_active":"2024-04-24T23:07:09.366280+0000","last_became_peered":"2024-04-24T23:07:09.366280+0000","last_unstale":"2024-04-24T23:07:10.338261+0000","last_undegraded":"2024-04-24T23:07:10.338261+0000","last_fullsized":"2024-04-24T23:07:10.338261+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:54.425653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382261+0000","last_change":"2024-04-24T23:07:08.326962+0000","last_active":"2024-04-24T23:07:10.382261+0000","last_peered":"2024-04-24T23:07:10.382261+0000","last_clean":"2024-04-24T23:07:10.382261+0000","last_became_active":"2024-04-24T23:07:08.326636+0000","last_became_peered":"2024-04-24T23:07:08.326636+0000","last_unstale":"2024-04-24T23:07:10.382261+0000","last_undegraded":"2024-04-24T23:07:10.382261+0000","last_fullsized":"2024-04-24T23:07:10.382261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:34.531054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338975+0000","last_change":"2024-04-24T23:07:09.361024+0000","last_active":"2024-04-24T23:07:10.338975+0000","last_peered":"2024-04-24T23:07:10.338975+0000","last_clean":"2024-04-24T23:07:10.338975+0000","last_became_active":"2024-04-24T23:07:09.360723+0000","last_became_peered":"2024-04-24T23:07:09.360723+0000","last_unstale":"2024-04-24T23:07:10.338975+0000","last_undegraded":"2024-04-24T23:07:10.338975+0000","last_fullsized":"2024-04-24T23:07:10.338975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:59.276861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338501+0000","last_change":"2024-04-24T23:07:08.338431+0000","last_active":"2024-04-24T23:07:10.338501+0000","last_peered":"2024-04-24T23:07:10.338501+0000","last_clean":"2024-04-24T23:07:10.338501+0000","last_became_active":"2024-04-24T23:07:08.338014+0000","last_became_peered":"2024-04-24T23:07:08.338014+0000","last_unstale":"2024-04-24T23:07:10.338501+0000","last_undegraded":"2024-04-24T23:07:10.338501+0000","last_fullsized":"2024-04-24T23:07:10.338501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:29.316462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338559+0000","last_change":"2024-04-24T23:07:09.386695+0000","last_active":"2024-04-24T23:07:10.338559+0000","last_peered":"2024-04-24T23:07:10.338559+0000","last_clean":"2024-04-24T23:07:10.338559+0000","last_became_active":"2024-04-24T23:07:09.386269+0000","last_became_peered":"2024-04-24T23:07:09.386269+0000","last_unstale":"2024-04-24T23:07:10.338559+0000","last_undegraded":"2024-04-24T23:07:10.338559+0000","last_fullsized":"2024-04-24T23:07:10.338559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:46:48.011178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929152+0000","last_change":"2024-04-24T23:07:08.345503+0000","last_active":"2024-04-24T23:07:10.929152+0000","last_peered":"2024-04-24T23:07:10.929152+0000","last_clean":"2024-04-24T23:07:10.929152+0000","last_became_active":"2024-04-24T23:07:08.345182+0000","last_became_peered":"2024-04-24T23:07:08.345182+0000","last_unstale":"2024-04-24T23:07:10.929152+0000","last_undegraded":"2024-04-24T23:07:10.929152+0000","last_fullsized":"2024-04-24T23:07:10.929152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:19:01.955888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931005+0000","last_change":"2024-04-24T23:07:09.371365+0000","last_active":"2024-04-24T23:07:10.931005+0000","last_peered":"2024-04-24T23:07:10.931005+0000","last_clean":"2024-04-24T23:07:10.931005+0000","last_became_active":"2024-04-24T23:07:09.370737+0000","last_became_peered":"2024-04-24T23:07:09.370737+0000","last_unstale":"2024-04-24T23:07:10.931005+0000","last_undegraded":"2024-04-24T23:07:10.931005+0000","last_fullsized":"2024-04-24T23:07:10.931005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:20.019693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338125+0000","last_change":"2024-04-24T23:07:08.333806+0000","last_active":"2024-04-24T23:07:10.338125+0000","last_peered":"2024-04-24T23:07:10.338125+0000","last_clean":"2024-04-24T23:07:10.338125+0000","last_became_active":"2024-04-24T23:07:08.329847+0000","last_became_peered":"2024-04-24T23:07:08.329847+0000","last_unstale":"2024-04-24T23:07:10.338125+0000","last_undegraded":"2024-04-24T23:07:10.338125+0000","last_fullsized":"2024-04-24T23:07:10.338125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:50.726423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383743+0000","last_change":"2024-04-24T23:07:09.373139+0000","last_active":"2024-04-24T23:07:10.383743+0000","last_peered":"2024-04-24T23:07:10.383743+0000","last_clean":"2024-04-24T23:07:10.383743+0000","last_became_active":"2024-04-24T23:07:09.372841+0000","last_became_peered":"2024-04-24T23:07:09.372841+0000","last_unstale":"2024-04-24T23:07:10.383743+0000","last_undegraded":"2024-04-24T23:07:10.383743+0000","last_fullsized":"2024-04-24T23:07:10.383743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:32.288310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383227+0000","last_change":"2024-04-24T23:07:08.346000+0000","last_active":"2024-04-24T23:07:10.383227+0000","last_peered":"2024-04-24T23:07:10.383227+0000","last_clean":"2024-04-24T23:07:10.383227+0000","last_became_active":"2024-04-24T23:07:08.345769+0000","last_became_peered":"2024-04-24T23:07:08.345769+0000","last_unstale":"2024-04-24T23:07:10.383227+0000","last_undegraded":"2024-04-24T23:07:10.383227+0000","last_fullsized":"2024-04-24T23:07:10.383227+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:46:46.995776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534916+0000","last_change":"2024-04-24T23:07:09.378371+0000","last_active":"2024-04-24T23:07:10.534916+0000","last_peered":"2024-04-24T23:07:10.534916+0000","last_clean":"2024-04-24T23:07:10.534916+0000","last_became_active":"2024-04-24T23:07:09.378030+0000","last_became_peered":"2024-04-24T23:07:09.378030+0000","last_unstale":"2024-04-24T23:07:10.534916+0000","last_undegraded":"2024-04-24T23:07:10.534916+0000","last_fullsized":"2024-04-24T23:07:10.534916+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:52:15.751766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382749+0000","last_change":"2024-04-24T23:07:08.333189+0000","last_active":"2024-04-24T23:07:10.382749+0000","last_peered":"2024-04-24T23:07:10.382749+0000","last_clean":"2024-04-24T23:07:10.382749+0000","last_became_active":"2024-04-24T23:07:08.330912+0000","last_became_peered":"2024-04-24T23:07:08.330912+0000","last_unstale":"2024-04-24T23:07:10.382749+0000","last_undegraded":"2024-04-24T23:07:10.382749+0000","last_fullsized":"2024-04-24T23:07:10.382749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:03.752349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.535090+0000","last_change":"2024-04-24T23:07:09.374329+0000","last_active":"2024-04-24T23:07:10.535090+0000","last_peered":"2024-04-24T23:07:10.535090+0000","last_clean":"2024-04-24T23:07:10.535090+0000","last_became_active":"2024-04-24T23:07:09.373805+0000","last_became_peered":"2024-04-24T23:07:09.373805+0000","last_unstale":"2024-04-24T23:07:10.535090+0000","last_undegraded":"2024-04-24T23:07:10.535090+0000","last_fullsized":"2024-04-24T23:07:10.535090+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:01.496052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929985+0000","last_change":"2024-04-24T23:07:08.348743+0000","last_active":"2024-04-24T23:07:10.929985+0000","last_peered":"2024-04-24T23:07:10.929985+0000","last_clean":"2024-04-24T23:07:10.929985+0000","last_became_active":"2024-04-24T23:07:08.348461+0000","last_became_peered":"2024-04-24T23:07:08.348461+0000","last_unstale":"2024-04-24T23:07:10.929985+0000","last_undegraded":"2024-04-24T23:07:10.929985+0000","last_fullsized":"2024-04-24T23:07:10.929985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:56.582367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929786+0000","last_change":"2024-04-24T23:07:09.359422+0000","last_active":"2024-04-24T23:07:10.929786+0000","last_peered":"2024-04-24T23:07:10.929786+0000","last_clean":"2024-04-24T23:07:10.929786+0000","last_became_active":"2024-04-24T23:07:09.358991+0000","last_became_peered":"2024-04-24T23:07:09.358991+0000","last_unstale":"2024-04-24T23:07:10.929786+0000","last_undegraded":"2024-04-24T23:07:10.929786+0000","last_fullsized":"2024-04-24T23:07:10.929786+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:37.352572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.341487+0000","last_change":"2024-04-24T23:07:08.340131+0000","last_active":"2024-04-24T23:07:10.341487+0000","last_peered":"2024-04-24T23:07:10.341487+0000","last_clean":"2024-04-24T23:07:10.341487+0000","last_became_active":"2024-04-24T23:07:08.339798+0000","last_became_peered":"2024-04-24T23:07:08.339798+0000","last_unstale":"2024-04-24T23:07:10.341487+0000","last_undegraded":"2024-04-24T23:07:10.341487+0000","last_fullsized":"2024-04-24T23:07:10.341487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:29.316462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931315+0000","last_change":"2024-04-24T23:07:09.383240+0000","last_active":"2024-04-24T23:07:10.931315+0000","last_peered":"2024-04-24T23:07:10.931315+0000","last_clean":"2024-04-24T23:07:10.931315+0000","last_became_active":"2024-04-24T23:07:09.382970+0000","last_became_peered":"2024-04-24T23:07:09.382970+0000","last_unstale":"2024-04-24T23:07:10.931315+0000","last_undegraded":"2024-04-24T23:07:10.931315+0000","last_fullsized":"2024-04-24T23:07:10.931315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:07.866812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.932385+0000","last_change":"2024-04-24T23:07:08.349494+0000","last_active":"2024-04-24T23:07:10.932385+0000","last_peered":"2024-04-24T23:07:10.932385+0000","last_clean":"2024-04-24T23:07:10.932385+0000","last_became_active":"2024-04-24T23:07:08.349166+0000","last_became_peered":"2024-04-24T23:07:08.349166+0000","last_unstale":"2024-04-24T23:07:10.932385+0000","last_undegraded":"2024-04-24T23:07:10.932385+0000","last_fullsized":"2024-04-24T23:07:10.932385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:07.577678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534521+0000","last_change":"2024-04-24T23:07:09.374519+0000","last_active":"2024-04-24T23:07:10.534521+0000","last_peered":"2024-04-24T23:07:10.534521+0000","last_clean":"2024-04-24T23:07:10.534521+0000","last_became_active":"2024-04-24T23:07:09.372169+0000","last_became_peered":"2024-04-24T23:07:09.372169+0000","last_unstale":"2024-04-24T23:07:10.534521+0000","last_undegraded":"2024-04-24T23:07:10.534521+0000","last_fullsized":"2024-04-24T23:07:10.534521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:20.207441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338741+0000","last_change":"2024-04-24T23:07:08.342267+0000","last_active":"2024-04-24T23:07:10.338741+0000","last_peered":"2024-04-24T23:07:10.338741+0000","last_clean":"2024-04-24T23:07:10.338741+0000","last_became_active":"2024-04-24T23:07:08.342004+0000","last_became_peered":"2024-04-24T23:07:08.342004+0000","last_unstale":"2024-04-24T23:07:10.338741+0000","last_undegraded":"2024-04-24T23:07:10.338741+0000","last_fullsized":"2024-04-24T23:07:10.338741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:16.828241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382759+0000","last_change":"2024-04-24T23:07:09.363849+0000","last_active":"2024-04-24T23:07:10.382759+0000","last_peered":"2024-04-24T23:07:10.382759+0000","last_clean":"2024-04-24T23:07:10.382759+0000","last_became_active":"2024-04-24T23:07:09.363494+0000","last_became_peered":"2024-04-24T23:07:09.363494+0000","last_unstale":"2024-04-24T23:07:10.382759+0000","last_undegraded":"2024-04-24T23:07:10.382759+0000","last_fullsized":"2024-04-24T23:07:10.382759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:00.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929798+0000","last_change":"2024-04-24T23:07:08.348566+0000","last_active":"2024-04-24T23:07:10.929798+0000","last_peered":"2024-04-24T23:07:10.929798+0000","last_clean":"2024-04-24T23:07:10.929798+0000","last_became_active":"2024-04-24T23:07:08.348291+0000","last_became_peered":"2024-04-24T23:07:08.348291+0000","last_unstale":"2024-04-24T23:07:10.929798+0000","last_undegraded":"2024-04-24T23:07:10.929798+0000","last_fullsized":"2024-04-24T23:07:10.929798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:33.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.343236+0000","last_change":"2024-04-24T23:07:09.372018+0000","last_active":"2024-04-24T23:07:10.343236+0000","last_peered":"2024-04-24T23:07:10.343236+0000","last_clean":"2024-04-24T23:07:10.343236+0000","last_became_active":"2024-04-24T23:07:09.371197+0000","last_became_peered":"2024-04-24T23:07:09.371197+0000","last_unstale":"2024-04-24T23:07:10.343236+0000","last_undegraded":"2024-04-24T23:07:10.343236+0000","last_fullsized":"2024-04-24T23:07:10.343236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:47.128422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383365+0000","last_change":"2024-04-24T23:07:08.340236+0000","last_active":"2024-04-24T23:07:10.383365+0000","last_peered":"2024-04-24T23:07:10.383365+0000","last_clean":"2024-04-24T23:07:10.383365+0000","last_became_active":"2024-04-24T23:07:08.339554+0000","last_became_peered":"2024-04-24T23:07:08.339554+0000","last_unstale":"2024-04-24T23:07:10.383365+0000","last_undegraded":"2024-04-24T23:07:10.383365+0000","last_fullsized":"2024-04-24T23:07:10.383365+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:01.412670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.343418+0000","last_change":"2024-04-24T23:07:09.374698+0000","last_active":"2024-04-24T23:07:10.343418+0000","last_peered":"2024-04-24T23:07:10.343418+0000","last_clean":"2024-04-24T23:07:10.343418+0000","last_became_active":"2024-04-24T23:07:09.373309+0000","last_became_peered":"2024-04-24T23:07:09.373309+0000","last_unstale":"2024-04-24T23:07:10.343418+0000","last_undegraded":"2024-04-24T23:07:10.343418+0000","last_fullsized":"2024-04-24T23:07:10.343418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:45:47.505634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.383066+0000","last_change":"2024-04-24T23:07:08.341292+0000","last_active":"2024-04-24T23:07:10.383066+0000","last_peered":"2024-04-24T23:07:10.383066+0000","last_clean":"2024-04-24T23:07:10.383066+0000","last_became_active":"2024-04-24T23:07:08.340905+0000","last_became_peered":"2024-04-24T23:07:08.340905+0000","last_unstale":"2024-04-24T23:07:10.383066+0000","last_undegraded":"2024-04-24T23:07:10.383066+0000","last_fullsized":"2024-04-24T23:07:10.383066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:53.410251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929478+0000","last_change":"2024-04-24T23:07:09.365314+0000","last_active":"2024-04-24T23:07:10.929478+0000","last_peered":"2024-04-24T23:07:10.929478+0000","last_clean":"2024-04-24T23:07:10.929478+0000","last_became_active":"2024-04-24T23:07:09.365018+0000","last_became_peered":"2024-04-24T23:07:09.365018+0000","last_unstale":"2024-04-24T23:07:10.929478+0000","last_undegraded":"2024-04-24T23:07:10.929478+0000","last_fullsized":"2024-04-24T23:07:10.929478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:02.062899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931873+0000","last_change":"2024-04-24T23:07:08.349722+0000","last_active":"2024-04-24T23:07:10.931873+0000","last_peered":"2024-04-24T23:07:10.931873+0000","last_clean":"2024-04-24T23:07:10.931873+0000","last_became_active":"2024-04-24T23:07:08.348161+0000","last_became_peered":"2024-04-24T23:07:08.348161+0000","last_unstale":"2024-04-24T23:07:10.931873+0000","last_undegraded":"2024-04-24T23:07:10.931873+0000","last_fullsized":"2024-04-24T23:07:10.931873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:33.118085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930069+0000","last_change":"2024-04-24T23:07:09.351209+0000","last_active":"2024-04-24T23:07:10.930069+0000","last_peered":"2024-04-24T23:07:10.930069+0000","last_clean":"2024-04-24T23:07:10.930069+0000","last_became_active":"2024-04-24T23:07:09.350529+0000","last_became_peered":"2024-04-24T23:07:09.350529+0000","last_unstale":"2024-04-24T23:07:10.930069+0000","last_undegraded":"2024-04-24T23:07:10.930069+0000","last_fullsized":"2024-04-24T23:07:10.930069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:14.286001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.341733+0000","last_change":"2024-04-24T23:07:08.349439+0000","last_active":"2024-04-24T23:07:10.341733+0000","last_peered":"2024-04-24T23:07:10.341733+0000","last_clean":"2024-04-24T23:07:10.341733+0000","last_became_active":"2024-04-24T23:07:08.349111+0000","last_became_peered":"2024-04-24T23:07:08.349111+0000","last_unstale":"2024-04-24T23:07:10.341733+0000","last_undegraded":"2024-04-24T23:07:10.341733+0000","last_fullsized":"2024-04-24T23:07:10.341733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:16.828241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.382443+0000","last_change":"2024-04-24T23:07:09.377008+0000","last_active":"2024-04-24T23:07:10.382443+0000","last_peered":"2024-04-24T23:07:10.382443+0000","last_clean":"2024-04-24T23:07:10.382443+0000","last_became_active":"2024-04-24T23:07:09.376735+0000","last_became_peered":"2024-04-24T23:07:09.376735+0000","last_unstale":"2024-04-24T23:07:10.382443+0000","last_undegraded":"2024-04-24T23:07:10.382443+0000","last_fullsized":"2024-04-24T23:07:10.382443+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:22.906699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534713+0000","last_change":"2024-04-24T23:07:08.343568+0000","last_active":"2024-04-24T23:07:10.534713+0000","last_peered":"2024-04-24T23:07:10.534713+0000","last_clean":"2024-04-24T23:07:10.534713+0000","last_became_active":"2024-04-24T23:07:08.343252+0000","last_became_peered":"2024-04-24T23:07:08.343252+0000","last_unstale":"2024-04-24T23:07:10.534713+0000","last_undegraded":"2024-04-24T23:07:10.534713+0000","last_fullsized":"2024-04-24T23:07:10.534713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:16.828241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.534733+0000","last_change":"2024-04-24T23:07:09.374828+0000","last_active":"2024-04-24T23:07:10.534733+0000","last_peered":"2024-04-24T23:07:10.534733+0000","last_clean":"2024-04-24T23:07:10.534733+0000","last_became_active":"2024-04-24T23:07:09.374198+0000","last_became_peered":"2024-04-24T23:07:09.374198+0000","last_unstale":"2024-04-24T23:07:10.534733+0000","last_undegraded":"2024-04-24T23:07:10.534733+0000","last_fullsized":"2024-04-24T23:07:10.534733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.931342+0000","last_change":"2024-04-24T23:07:08.348607+0000","last_active":"2024-04-24T23:07:10.931342+0000","last_peered":"2024-04-24T23:07:10.931342+0000","last_clean":"2024-04-24T23:07:10.931342+0000","last_became_active":"2024-04-24T23:07:08.348312+0000","last_became_peered":"2024-04-24T23:07:08.348312+0000","last_unstale":"2024-04-24T23:07:10.931342+0000","last_undegraded":"2024-04-24T23:07:10.931342+0000","last_fullsized":"2024-04-24T23:07:10.931342+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:46:46.995776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930661+0000","last_change":"2024-04-24T23:07:09.377443+0000","last_active":"2024-04-24T23:07:10.930661+0000","last_peered":"2024-04-24T23:07:10.930661+0000","last_clean":"2024-04-24T23:07:10.930661+0000","last_became_active":"2024-04-24T23:07:09.377164+0000","last_became_peered":"2024-04-24T23:07:09.377164+0000","last_unstale":"2024-04-24T23:07:10.930661+0000","last_undegraded":"2024-04-24T23:07:10.930661+0000","last_fullsized":"2024-04-24T23:07:10.930661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:54.085122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.340736+0000","last_change":"2024-04-24T23:07:08.345355+0000","last_active":"2024-04-24T23:07:10.340736+0000","last_peered":"2024-04-24T23:07:10.340736+0000","last_clean":"2024-04-24T23:07:10.340736+0000","last_became_active":"2024-04-24T23:07:08.345081+0000","last_became_peered":"2024-04-24T23:07:08.345081+0000","last_unstale":"2024-04-24T23:07:10.340736+0000","last_undegraded":"2024-04-24T23:07:10.340736+0000","last_fullsized":"2024-04-24T23:07:10.340736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:09:59.165264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.342811+0000","last_change":"2024-04-24T23:07:09.369926+0000","last_active":"2024-04-24T23:07:10.342811+0000","last_peered":"2024-04-24T23:07:10.342811+0000","last_clean":"2024-04-24T23:07:10.342811+0000","last_became_active":"2024-04-24T23:07:09.369547+0000","last_became_peered":"2024-04-24T23:07:09.369547+0000","last_unstale":"2024-04-24T23:07:10.342811+0000","last_undegraded":"2024-04-24T23:07:10.342811+0000","last_fullsized":"2024-04-24T23:07:10.342811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:15:48.134403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.929970+0000","last_change":"2024-04-24T23:07:08.347253+0000","last_active":"2024-04-24T23:07:10.929970+0000","last_peered":"2024-04-24T23:07:10.929970+0000","last_clean":"2024-04-24T23:07:10.929970+0000","last_became_active":"2024-04-24T23:07:08.345809+0000","last_became_peered":"2024-04-24T23:07:08.345809+0000","last_unstale":"2024-04-24T23:07:10.929970+0000","last_undegraded":"2024-04-24T23:07:10.929970+0000","last_fullsized":"2024-04-24T23:07:10.929970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:48:42.078682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338785+0000","last_change":"2024-04-24T23:07:09.373800+0000","last_active":"2024-04-24T23:07:10.338785+0000","last_peered":"2024-04-24T23:07:10.338785+0000","last_clean":"2024-04-24T23:07:10.338785+0000","last_became_active":"2024-04-24T23:07:09.373512+0000","last_became_peered":"2024-04-24T23:07:09.373512+0000","last_unstale":"2024-04-24T23:07:10.338785+0000","last_undegraded":"2024-04-24T23:07:10.338785+0000","last_fullsized":"2024-04-24T23:07:10.338785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:08.302520+0000","last_clean_scrub_stamp":"2024-04-24T23:07:08.302520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:27:59.183223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.930215+0000","last_change":"2024-04-24T23:07:08.351614+0000","last_active":"2024-04-24T23:07:10.930215+0000","last_peered":"2024-04-24T23:07:10.930215+0000","last_clean":"2024-04-24T23:07:10.930215+0000","last_became_active":"2024-04-24T23:07:08.351175+0000","last_became_peered":"2024-04-24T23:07:08.351175+0000","last_unstale":"2024-04-24T23:07:10.930215+0000","last_undegraded":"2024-04-24T23:07:10.930215+0000","last_fullsized":"2024-04-24T23:07:10.930215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:07:07.287118+0000","last_clean_scrub_stamp":"2024-04-24T23:07:07.287118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:44.519105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":259,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T23:07:10.338278+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:07:10.338278+0000","last_peered":"2024-04-24T23:07:10.338278+0000","last_clean":"2024-04-24T23:07:10.338278+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:07:10.338278+0000","last_undegraded":"2024-04-24T23:07:10.338278+0000","last_fullsized":"2024-04-24T23:07:10.338278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509532,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":366737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509533,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":369001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":367319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509533,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":366897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":366793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":957139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509532,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":366737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":952137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:07:15.252 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:07:15.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:07:15.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.471+0000 7f2d22600640 1 Processor -- start 2024-04-24T23:07:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.471+0000 7f2d22600640 1 -- start start 2024-04-24T23:07:15.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d22600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d1c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d22600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d1c0ced40 con 0x7f2d1c13ef30 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d22600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d1c0cf020 con 0x7f2d1c0ce5a0 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d22600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1c1423d0 con 0x7f2d1c141c80 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d1b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d1c13ef30 0x7f2d1c141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33146/0 (socket says 172.21.15.146:33146) 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.473+0000 7f2d1b400640 1 -- 172.21.15.146:0/2627088617 learned_addr learned my addr 172.21.15.146:0/2627088617 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d12a00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d1c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376960962 0 0) 0x7f2d1c0ced40 con 0x7f2d1c13ef30 2024-04-24T23:07:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d00003520 con 0x7f2d1c13ef30 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 940389509 0 0) 0x7f2d00003520 con 0x7f2d1c13ef30 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 msgr2=0x7f2d1c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d1c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 >> v1:172.21.15.203:6789/0 conn(0x7f2d1c0ce5a0 legacy=0x7f2d1c071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c0cf300 con 0x7f2d1c13ef30 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f2d0c001670 con 0x7f2d1c13ef30 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 >> v1:172.21.15.146:6789/0 conn(0x7f2d1c13ef30 legacy=0x7f2d1c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d000039e0 0x7f2d00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d00004800 0x7f2d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0000ba70 con 0x7f2d000039e0 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0000bbf0 con 0x7f2d00004800 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.474+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0000bdf0 con 0x7f2d1c141c80 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d000039e0 0x7f2d00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d12a00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d00004800 0x7f2d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1be00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 -- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 msgr2=0x7f2d000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 -- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d00004800 msgr2=0x7f2d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d00004800 0x7f2d00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1b400640 1 -- 172.21.15.146:0/2627088617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d00003520 con 0x7f2d000039e0 2024-04-24T23:07:15.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.475+0000 7f2d1be00640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1c141c80 0x7f2d000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:15.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.476+0000 7f2d1b400640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d000039e0 0x7f2d00003e00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001050 tx=0x7f2d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42e817f41b8214f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.476+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007d30 con 0x7f2d000039e0 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.476+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c005af0 con 0x7f2d000039e0 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.476+0000 7f2d1aa00640 1 -- 172.21.15.146:0/2627088617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007070 con 0x7f2d000039e0 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 -- 172.21.15.146:0/2627088617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d000039e0 msgr2=0x7f2d00003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 --2- 172.21.15.146:0/2627088617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d000039e0 0x7f2d00003e00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001050 tx=0x7f2d00005830 comp rx=0 tx=0).stop 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d1be00640 1 -- 172.21.15.146:0/2627088617 reap_dead start 2024-04-24T23:07:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 -- 172.21.15.146:0/2627088617 shutdown_connections 2024-04-24T23:07:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 -- 172.21.15.146:0/2627088617 >> 172.21.15.146:0/2627088617 conn(0x7f2d1c0b17b0 msgr2=0x7f2d1c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 -- 172.21.15.146:0/2627088617 shutdown_connections 2024-04-24T23:07:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.477+0000 7f2d22600640 1 -- 172.21.15.146:0/2627088617 wait complete. 2024-04-24T23:07:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.479+0000 7f2d22600640 1 Processor -- start 2024-04-24T23:07:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.479+0000 7f2d22600640 1 -- start start 2024-04-24T23:07:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d000039e0 0x7f2d1c143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d1c144d20 0x7f2d1c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c0cea50 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c070f80 con 0x7f2d1c144d20 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d22600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1c0ce060 con 0x7f2d000039e0 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d1be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d1be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33512/0 (socket says 172.21.15.146:33512) 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.480+0000 7f2d1be00640 1 -- 172.21.15.146:0/3326687145 learned_addr learned my addr 172.21.15.146:0/3326687145 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1b400640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d000039e0 0x7f2d1c143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d12a00640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d1c144d20 0x7f2d1c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 -- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d000039e0 msgr2=0x7f2d1c143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d000039e0 0x7f2d1c143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 -- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d1c144d20 msgr2=0x7f2d1c1451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d1c144d20 0x7f2d1c1451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 -- 172.21.15.146:0/3326687145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c1f2500 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d1be00640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c145b70 tx=0x7f2d1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14006d50 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.481+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d14003970 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.482+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c13afb0 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.482+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14003da0 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.482+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c13b570 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.483+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c04f5a0 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.484+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d1401b020 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.485+0000 7f2d13e00640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 0x7f2cf806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.485+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f2d1408ac10 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.485+0000 7f2d1b400640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 0x7f2cf806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:15.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.486+0000 7f2d1b400640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 0x7f2cf806e370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d000057e0 tx=0x7f2d0c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:15.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.490+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d1401ce40 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.770+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2d1c145950 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.774+0000 7f2d13e00640 1 -- 172.21.15.146:0/3326687145 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f2d140594a0 con 0x7f2d1c1f1b10 2024-04-24T23:07:15.776 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T23:07:15.776 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T23:07:15.777 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-04-24T23:07:15.777 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-04-24T23:07:15.777 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:07:15.777 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 msgr2=0x7f2cf806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 0x7f2cf806e370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d000057e0 tx=0x7f2d0c009030 comp rx=0 tx=0).stop 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 msgr2=0x7f2d1c1f1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c145b70 tx=0x7f2d1400dc00 comp rx=0 tx=0).stop 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 shutdown_connections 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d1c1f1b10 0x7f2d1c1f1fc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d1c144d20 0x7f2d1c1451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf806beb0 0x7f2cf806e370 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 --2- 172.21.15.146:0/3326687145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d000039e0 0x7f2d1c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.777+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 >> 172.21.15.146:0/3326687145 conn(0x7f2d1c0b17b0 msgr2=0x7f2d1c1395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.778+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 shutdown_connections 2024-04-24T23:07:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:15.778+0000 7f2d22600640 1 -- 172.21.15.146:0/3326687145 wait complete. 2024-04-24T23:07:15.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.003+0000 7fcb4f000640 1 Processor -- start 2024-04-24T23:07:16.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.004+0000 7fcb4f000640 1 -- start start 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.005+0000 7fcb4f000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb481561c0 0x7fcb480cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.005+0000 7fcb4f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb480d0240 0x7fcb4815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.005+0000 7fcb4f000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb48070f90 con 0x7fcb480709d0 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.005+0000 7fcb4f000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480b4310 con 0x7fcb481561c0 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.005+0000 7fcb4f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb481565a0 con 0x7fcb480d0240 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb481561c0 0x7fcb480cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb481561c0 0x7fcb480cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33516/0 (socket says 172.21.15.146:33516) 2024-04-24T23:07:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 -- 172.21.15.146:0/2873460020 learned_addr learned my addr 172.21.15.146:0/2873460020 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4d200640 1 --1- 172.21.15.146:0/2873460020 >> v1:172.21.15.146:6789/0 conn(0x7fcb480709d0 0x7fcb480cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33150/0 (socket says 172.21.15.146:33150) 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4e600640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb480d0240 0x7fcb4815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 -- 172.21.15.146:0/2873460020 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb480d0240 msgr2=0x7fcb4815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb480d0240 0x7fcb4815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 -- 172.21.15.146:0/2873460020 >> v1:172.21.15.146:6789/0 conn(0x7fcb480709d0 legacy=0x7fcb480cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb47e00640 1 -- 172.21.15.146:0/2873460020 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791621767 0 0) 0x7fcb48070f90 con 0x7fcb480709d0 2024-04-24T23:07:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.006+0000 7fcb4dc00640 1 -- 172.21.15.146:0/2873460020 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48071270 con 0x7fcb481561c0 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.007+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb481561c0 0x7fcb480cdbf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3681743803dbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb47e00640 1 -- 172.21.15.146:0/2873460020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c037070 con 0x7fcb481561c0 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb47e00640 1 -- 172.21.15.146:0/2873460020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c032440 con 0x7fcb481561c0 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb47e00640 1 -- 172.21.15.146:0/2873460020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c032810 con 0x7fcb481561c0 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 -- 172.21.15.146:0/2873460020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb481561c0 msgr2=0x7fcb480cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb481561c0 0x7fcb480cdbf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c02a130 comp rx=0 tx=0).stop 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 -- 172.21.15.146:0/2873460020 shutdown_connections 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb480d0240 0x7fcb4815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2873460020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb481561c0 0x7fcb480cdbf0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 -- 172.21.15.146:0/2873460020 >> 172.21.15.146:0/2873460020 conn(0x7fcb4806b320 msgr2=0x7fcb4806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.008+0000 7fcb4f000640 1 -- 172.21.15.146:0/2873460020 shutdown_connections 2024-04-24T23:07:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.009+0000 7fcb4f000640 1 -- 172.21.15.146:0/2873460020 wait complete. 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.010+0000 7fcb4f000640 1 Processor -- start 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.011+0000 7fcb4f000640 1 -- start start 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.011+0000 7fcb4f000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 0x7fcb4814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.011+0000 7fcb4f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb481561c0 0x7fcb481433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b2c20 con 0x7fcb480d0240 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4f000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48071830 con 0x7fcb480709d0 2024-04-24T23:07:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480b2da0 con 0x7fcb481561c0 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33530/0 (socket says 172.21.15.146:33530) 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 -- 172.21.15.146:0/2586054219 learned_addr learned my addr 172.21.15.146:0/2586054219 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 0x7fcb4814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4e600640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb481561c0 0x7fcb481433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 -- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb481561c0 msgr2=0x7fcb481433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb481561c0 0x7fcb481433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 -- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 msgr2=0x7fcb4814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 0x7fcb4814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4d200640 1 -- 172.21.15.146:0/2586054219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4806d880 con 0x7fcb480d0240 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.012+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 0x7fcb4814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:07:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb4d200640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c4d0 tx=0x7fcb3400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34018070 con 0x7fcb480d0240 2024-04-24T23:07:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb34007500 con 0x7fcb480d0240 2024-04-24T23:07:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34004a20 con 0x7fcb480d0240 2024-04-24T23:07:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4806db60 con 0x7fcb480d0240 2024-04-24T23:07:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.013+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4806e120 con 0x7fcb480d0240 2024-04-24T23:07:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.014+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4804f500 con 0x7fcb480d0240 2024-04-24T23:07:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.015+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb34004bc0 con 0x7fcb480d0240 2024-04-24T23:07:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.016+0000 7fcb45600640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 0x7fcb2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.016+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fcb3408a2c0 con 0x7fcb480d0240 2024-04-24T23:07:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.017+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 0x7fcb2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.018+0000 7fcb4dc00640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 0x7fcb2806e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c034000 tx=0x7fcb3c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.021+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb34058ad0 con 0x7fcb480d0240 2024-04-24T23:07:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.251+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb4815ec60 con 0x7fcb480d0240 2024-04-24T23:07:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.252+0000 7fcb45600640 1 -- 172.21.15.146:0/2586054219 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5191 (secure 0 0 0) 0x7fcb340583d0 con 0x7fcb480d0240 2024-04-24T23:07:16.254 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:16.254 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:11.847584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6666]},"id":4}]} 2024-04-24T23:07:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 47 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 msgr2=0x7fcb2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 0x7fcb2806e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c034000 tx=0x7fcb3c02e000 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 msgr2=0x7fcb4806d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c4d0 tx=0x7fcb3400c990 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 shutdown_connections 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb2806be30 0x7fcb2806e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb481561c0 0x7fcb481433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480d0240 0x7fcb4806d050 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.254+0000 7fcb4f000640 1 --2- 172.21.15.146:0/2586054219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480709d0 0x7fcb4814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.255+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 >> 172.21.15.146:0/2586054219 conn(0x7fcb4806b320 msgr2=0x7fcb48072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.255+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 shutdown_connections 2024-04-24T23:07:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.255+0000 7fcb4f000640 1 -- 172.21.15.146:0/2586054219 wait complete. 2024-04-24T23:07:16.665 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:07:16.673 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:07:16.677 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:07:08.786511+0000', 'modified': '2024-04-24T23:07:11.847584+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6666}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6666': {'gid': 6666, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/4094476555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 4094476555}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 4094476555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6666, 'qdb_cluster': [6666]} 2024-04-24T23:07:16.677 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:07:16.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-24T23:07:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.901+0000 7f118a600640 1 Processor -- start 2024-04-24T23:07:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.901+0000 7f118a600640 1 -- start start 2024-04-24T23:07:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.902+0000 7f118a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.902+0000 7f118a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 0x7f11840718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f118a600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118415c1a0 con 0x7f11840ae830 2024-04-24T23:07:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f118a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f11840cc5d0 con 0x7f118415cd80 2024-04-24T23:07:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f118a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11840cf6b0 con 0x7f118415bdc0 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f1189200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f1189200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:52770/0 (socket says 172.21.15.146:52770) 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f1189200640 1 -- 172.21.15.146:0/3600865785 learned_addr learned my addr 172.21.15.146:0/3600865785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.903+0000 7f1183e00640 1 --2- 172.21.15.146:0/3600865785 >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 0x7f11840718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.904+0000 7f1189200640 1 -- 172.21.15.146:0/3600865785 >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 msgr2=0x7f11840718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.904+0000 7f1189200640 1 --2- 172.21.15.146:0/3600865785 >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 0x7f11840718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.904+0000 7f1189200640 1 -- 172.21.15.146:0/3600865785 >> v1:172.21.15.203:6789/0 conn(0x7f11840ae830 legacy=0x7f11840cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.904+0000 7f1189200640 1 -- 172.21.15.146:0/3600865785 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1184072c70 con 0x7f118415bdc0 2024-04-24T23:07:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.904+0000 7f1183e00640 1 --2- 172.21.15.146:0/3600865785 >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 0x7f11840718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:07:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.906+0000 7f1189200640 1 --2- 172.21.15.146:0/3600865785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1178009870 tx=0x7f117802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7983cc21918feb12 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.906+0000 7f1183400640 1 -- 172.21.15.146:0/3600865785 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178037070 con 0x7f118415bdc0 2024-04-24T23:07:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.906+0000 7f1183400640 1 -- 172.21.15.146:0/3600865785 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178032440 con 0x7f118415bdc0 2024-04-24T23:07:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.906+0000 7f1183400640 1 -- 172.21.15.146:0/3600865785 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178032810 con 0x7f118415bdc0 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 -- 172.21.15.146:0/3600865785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 msgr2=0x7f1184072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 --2- 172.21.15.146:0/3600865785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1178009870 tx=0x7f117802a1c0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 -- 172.21.15.146:0/3600865785 shutdown_connections 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 --2- 172.21.15.146:0/3600865785 >> v2:172.21.15.203:3300/0 conn(0x7f118415cd80 0x7f11840718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 --2- 172.21.15.146:0/3600865785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f1184072690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 -- 172.21.15.146:0/3600865785 >> 172.21.15.146:0/3600865785 conn(0x7f11840b1560 msgr2=0x7f11840b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 -- 172.21.15.146:0/3600865785 shutdown_connections 2024-04-24T23:07:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.907+0000 7f118a600640 1 -- 172.21.15.146:0/3600865785 wait complete. 2024-04-24T23:07:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.908+0000 7f118a600640 1 Processor -- start 2024-04-24T23:07:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 -- start start 2024-04-24T23:07:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11840ae830 0x7f118414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f11840a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1184070de0 con 0x7f118415cd80 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1184071e00 con 0x7f11840ae830 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.909+0000 7f118a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11840710c0 con 0x7f118415bdc0 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33532/0 (socket says 172.21.15.146:33532) 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 -- 172.21.15.146:0/166476662 learned_addr learned my addr 172.21.15.146:0/166476662 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189200640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11840ae830 0x7f118414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1183e00640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f11840a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 -- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 msgr2=0x7f11840a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f11840a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 -- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11840ae830 msgr2=0x7f118414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11840ae830 0x7f118414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.910+0000 7f1189c00640 1 -- 172.21.15.146:0/166476662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11840ae600 con 0x7f118415cd80 2024-04-24T23:07:16.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f1189c00640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c7d0 tx=0x7f117c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f1180c00640 1 -- 172.21.15.146:0/166476662 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c003b70 con 0x7f118415cd80 2024-04-24T23:07:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f1180c00640 1 -- 172.21.15.146:0/166476662 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c003d30 con 0x7f118415cd80 2024-04-24T23:07:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f1180c00640 1 -- 172.21.15.146:0/166476662 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00aa90 con 0x7f118415cd80 2024-04-24T23:07:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841e5460 con 0x7f118415cd80 2024-04-24T23:07:16.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.911+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11841e5a20 con 0x7f118415cd80 2024-04-24T23:07:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.913+0000 7f1180c00640 1 -- 172.21.15.146:0/166476662 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f117c00ac30 con 0x7f118415cd80 2024-04-24T23:07:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.914+0000 7f1180c00640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 0x7f116406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.914+0000 7f1180c00640 1 -- 172.21.15.146:0/166476662 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f117c08afa0 con 0x7f118415cd80 2024-04-24T23:07:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.915+0000 7f118e9d6740 1 Processor -- start 2024-04-24T23:07:16.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.915+0000 7f118e9d6740 1 -- start start 2024-04-24T23:07:16.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.915+0000 7f1189200640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 0x7f116406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 0x55a93d9ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 0x55a93d976b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a93d876ed0 con 0x55a93d977070 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a93d8d9df0 con 0x55a93d973300 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a93d8828d0 con 0x55a93d972f20 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189200640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 0x7f116406e320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1178034000 tx=0x7f117802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33536/0 (socket says 172.21.15.146:33536) 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 -- 172.21.15.146:0/3388830174 learned_addr learned my addr 172.21.15.146:0/3388830174 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1183e00640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 0x55a93d976b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189200640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 0x55a93d9ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 -- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 msgr2=0x55a93d9ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 0x55a93d9ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 -- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 msgr2=0x55a93d976b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 0x55a93d976b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189c00640 1 -- 172.21.15.146:0/3388830174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93d5ee2d0 con 0x55a93d977070 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1183e00640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 0x55a93d976b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.916+0000 7f1189200640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 0x55a93d9ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f1189c00640 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f117c055480 tx=0x7f117c058f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b2b557b077eb70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f1175600640 1 -- 172.21.15.146:0/3388830174 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c05d3d0 con 0x55a93d977070 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f1175600640 1 -- 172.21.15.146:0/3388830174 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c061c00 con 0x55a93d977070 2024-04-24T23:07:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f1175600640 1 -- 172.21.15.146:0/3388830174 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c057320 con 0x55a93d977070 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f118e9d6740 1 -- 172.21.15.146:0/3388830174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 msgr2=0x55a93d9b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.917+0000 7f118e9d6740 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f117c055480 tx=0x7f117c058f20 comp rx=0 tx=0).stop 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 -- 172.21.15.146:0/3388830174 shutdown_connections 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d977070 0x55a93d9b2a80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d973300 0x55a93d976b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 --2- 172.21.15.146:0/3388830174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d972f20 0x55a93d9ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 -- 172.21.15.146:0/3388830174 >> 172.21.15.146:0/3388830174 conn(0x55a93d973d30 msgr2=0x55a93d9bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 -- 172.21.15.146:0/3388830174 shutdown_connections 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 -- 172.21.15.146:0/3388830174 wait complete. 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 -- start start 2024-04-24T23:07:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.918+0000 7f118e9d6740 1 Processor -- start 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d998620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 0x55a93d9a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a93d895d20 con 0x55a93d9a5250 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a93d8d5db0 con 0x55a93d977070 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.919+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a93d99ed40 con 0x55a93d9a31e0 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f118e9d6740 10 client.0 _ll_register_callbacks cb 0x55a93d8d0f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33542/0 (socket says 172.21.15.146:33542) 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 -- 172.21.15.146:0/858639900 learned_addr learned my addr 172.21.15.146:0/858639900 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189200640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d998620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 -- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 msgr2=0x55a93d9a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1183e00640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 0x55a93d9a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 0x55a93d9a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 -- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 msgr2=0x55a93d998620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d998620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 -- 172.21.15.146:0/858639900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a93d6b86b0 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1183e00640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 0x55a93d9a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189200640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d998620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f1189c00640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f117c00a430 tx=0x7f117c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b19247612ee3fbd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.920+0000 7f116a000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c010dc0 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f117c055690 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117c061c00 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f117c07f050 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 10 client.6816 fetch_fsmap learned FSMap version 47 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a93d99a7c0 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c061e50 con 0x55a93d9a5250 2024-04-24T23:07:16.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 47) ==== 3494+0+0 (secure 0 0 0) 0x7f117c082020 con 0x55a93d9a5250 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 10 client.6816 fetch_fsmap finished waiting for FSMap version 47 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 10 client.6816 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 20 client.6816 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93d9bf030 0x55a93d9bf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 4 client.6816 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.921+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 --> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a93d8e7330 con 0x55a93d9bf030 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.922+0000 7f1189200640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93d9bf030 0x55a93d9bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.923+0000 7f1189200640 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93d9bf030 0x55a93d9bf410 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7c9d633e907fbf server_cookie=e4296b9b260ce66 in_seq=0 out_seq=0 2024-04-24T23:07:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.923+0000 7f116a000640 10 client.6816 ms_handle_connect on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f116a000640 1 -- 172.21.15.146:0/858639900 <== mds.0 v2:172.21.15.203:6835/4094476555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a93d8e7330 con 0x55a93d9bf030 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f116a000640 10 client.6816 handle_command_reply: tid=0 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 client.6816 shutdown 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 msgr2=0x55a93d99b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f117c00a430 tx=0x7f117c001250 comp rx=0 tx=0).stop 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 shutdown_connections 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93d9bf030 0x55a93d9bf410 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a5250 0x55a93d99b580 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a31e0 0x55a93d9a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f116a000640 0 client.6816 ms_handle_reset on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.926+0000 7f118e9d6740 1 --2- 172.21.15.146:0/858639900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d998620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.927+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 >> 172.21.15.146:0/858639900 conn(0x55a93d972f20 msgr2=0x55a93d978600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.927+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 shutdown_connections 2024-04-24T23:07:16.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.927+0000 7f118e9d6740 1 -- 172.21.15.146:0/858639900 wait complete. 2024-04-24T23:07:16.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.927+0000 7f118e9d6740 20 client.6816 trim_cache size 0 max 16384 2024-04-24T23:07:16.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.946+0000 7f118e9d6740 1 Processor -- start 2024-04-24T23:07:16.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.946+0000 7f118e9d6740 1 -- start start 2024-04-24T23:07:16.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d977070 0x55a93d9c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 0x55a93d9756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11841fc7f0 con 0x55a93d9a31e0 2024-04-24T23:07:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11840b3f70 con 0x55a93d9a5250 2024-04-24T23:07:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11841f60d0 con 0x55a93d977070 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f1183e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f1183e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33550/0 (socket says 172.21.15.146:33550) 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f1183e00640 1 -- 172.21.15.146:0/2146998015 learned_addr learned my addr 172.21.15.146:0/2146998015 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f1189200640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d977070 0x55a93d9c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.947+0000 7f1189c00640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 0x55a93d9756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 -- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d977070 msgr2=0x55a93d9c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d977070 0x55a93d9c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 -- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 msgr2=0x55a93d9756c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 0x55a93d9756c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 -- 172.21.15.146:0/2146998015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93d99b8e0 con 0x55a93d9a31e0 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1189c00640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 0x55a93d9756c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1183e00640 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f11840ce990 tx=0x7f1170009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bb78a7caf24657 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1174c00640 1 -- 172.21.15.146:0/2146998015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170013d40 con 0x55a93d9a31e0 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.948+0000 7f1174c00640 1 -- 172.21.15.146:0/2146998015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117001e480 con 0x55a93d9a31e0 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f1174c00640 1 -- 172.21.15.146:0/2146998015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117001e870 con 0x55a93d9a31e0 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 -- 172.21.15.146:0/2146998015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 msgr2=0x55a93d9c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f11840ce990 tx=0x7f1170009190 comp rx=0 tx=0).stop 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 -- 172.21.15.146:0/2146998015 shutdown_connections 2024-04-24T23:07:16.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d9a5250 0x55a93d9756c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9c99a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 --2- 172.21.15.146:0/2146998015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d977070 0x55a93d9c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 -- 172.21.15.146:0/2146998015 >> 172.21.15.146:0/2146998015 conn(0x55a93d972f20 msgr2=0x55a93d997580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 -- 172.21.15.146:0/2146998015 shutdown_connections 2024-04-24T23:07:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.949+0000 7f118e9d6740 1 -- 172.21.15.146:0/2146998015 wait complete. 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.950+0000 7f118e9d6740 1 -- start start 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.950+0000 7f118e9d6740 1 Processor -- start 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d9a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a5250 0x55a93d9a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a93d895d20 con 0x55a93d9a31e0 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a93d99ed40 con 0x55a93d977070 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a93d8d5db0 con 0x55a93d9a5250 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f118e9d6740 10 client.0 _ll_register_callbacks cb 0x7f117c071050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f1183e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f1183e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33566/0 (socket says 172.21.15.146:33566) 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.951+0000 7f1183e00640 1 -- 172.21.15.146:0/687449382 learned_addr learned my addr 172.21.15.146:0/687449382 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 -- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a5250 msgr2=0x55a93d9a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1189c00640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a5250 0x55a93d9a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1189200640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d9a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a5250 0x55a93d9a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 -- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 msgr2=0x55a93d9a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d9a3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 -- 172.21.15.146:0/687449382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a93d9be370 con 0x55a93d9a31e0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f1183e00640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f1170008010 tx=0x7f1170004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e84291173393b1b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f116a000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117002f060 con 0x55a93d9a31e0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f117002a440 con 0x55a93d9a31e0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.952+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117001e480 con 0x55a93d9a31e0 2024-04-24T23:07:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f1170035050 con 0x55a93d9a31e0 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 10 client.6822 fetch_fsmap learned FSMap version 47 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a93da40ba0 con 0x55a93d9a31e0 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117001e480 con 0x55a93d9a31e0 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 47) ==== 3494+0+0 (secure 0 0 0) 0x7f1170038020 con 0x55a93d9a31e0 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 10 client.6822 fetch_fsmap finished waiting for FSMap version 47 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 10 client.6822 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 20 client.6822 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93da40790 0x55a93d99d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 4 client.6822 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.953+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 --> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] -- command(tid 0: {"prefix": "status"}) -- 0x55a93d8e1680 con 0x55a93da40790 2024-04-24T23:07:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.954+0000 7f1189200640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93da40790 0x55a93d99d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.955+0000 7f1189200640 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93da40790 0x55a93d99d4e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7bac1738d243d0 server_cookie=9d732325ee470808 in_seq=0 out_seq=0 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.955+0000 7f116a000640 10 client.6822 ms_handle_connect on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.955+0000 7f116a000640 1 -- 172.21.15.146:0/687449382 <== mds.0 v2:172.21.15.203:6835/4094476555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a93d8e1680 con 0x55a93da40790 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.955+0000 7f116a000640 10 client.6822 handle_command_reply: tid=0 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.955+0000 7f118e9d6740 1 client.6822 shutdown 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 msgr2=0x55a93d9a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f1170008010 tx=0x7f1170004730 comp rx=0 tx=0).stop 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 shutdown_connections 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x55a93da40790 0x55a93d99d4e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a93d9a5250 0x55a93d9a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a93d9a31e0 0x55a93d9a1500 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 --2- 172.21.15.146:0/687449382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a93d977070 0x55a93d9a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 >> 172.21.15.146:0/687449382 conn(0x55a93d972f20 msgr2=0x55a93d9c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f116a000640 0 client.6822 ms_handle_reset on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 shutdown_connections 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 1 -- 172.21.15.146:0/687449382 wait complete. 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118e9d6740 20 client.6822 trim_cache size 0 max 16384 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6666, 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:07:16.961 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 7.5923248780000003, 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 47, 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 68, 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 68, 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.053867802999999 2024-04-24T23:07:16.962 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 msgr2=0x7f116406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.956+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 0x7f116406e320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1178034000 tx=0x7f117802e000 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 msgr2=0x7f11840ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c7d0 tx=0x7f117c00cc90 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 shutdown_connections 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118415cd80 0x7f11840ab430 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f116406be60 0x7f116406e320 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f118415bdc0 0x7f11840a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 --2- 172.21.15.146:0/166476662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11840ae830 0x7f118414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 >> 172.21.15.146:0/166476662 conn(0x7f11840b1560 msgr2=0x7f1184159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 shutdown_connections 2024-04-24T23:07:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:16.957+0000 7f118a600640 1 -- 172.21.15.146:0/166476662 wait complete. 2024-04-24T23:07:16.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:07:17.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.170+0000 7efe15c00640 1 Processor -- start 2024-04-24T23:07:17.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.170+0000 7efe15c00640 1 -- start start 2024-04-24T23:07:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe15c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe10145640 0x7efe1015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe15c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 0x7efe100ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe15c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe100cdf70 con 0x7efe100b2a20 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe15c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7efe1015d360 con 0x7efe10145640 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe15c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe10145a20 con 0x7efe100d03a0 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe10145640 0x7efe1015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe10145640 0x7efe1015ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33574/0 (socket says 172.21.15.146:33574) 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 -- 172.21.15.146:0/3631946842 learned_addr learned my addr 172.21.15.146:0/3631946842 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0f400640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 0x7efe100ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 -- 172.21.15.146:0/3631946842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 msgr2=0x7efe100ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 0x7efe100ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 -- 172.21.15.146:0/3631946842 >> v1:172.21.15.146:6789/0 conn(0x7efe100b2a20 legacy=0x7efe100cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.172+0000 7efe0ea00640 1 -- 172.21.15.146:0/3631946842 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1006d140 con 0x7efe10145640 2024-04-24T23:07:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.173+0000 7efe0f400640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 0x7efe100ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe0ea00640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe10145640 0x7efe1015ce20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe0002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab35f7a21b5b65d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe0d600640 1 -- 172.21.15.146:0/3631946842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00037070 con 0x7efe10145640 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe0d600640 1 -- 172.21.15.146:0/3631946842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00032440 con 0x7efe10145640 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe0d600640 1 -- 172.21.15.146:0/3631946842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00032810 con 0x7efe10145640 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe15c00640 1 -- 172.21.15.146:0/3631946842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe10145640 msgr2=0x7efe1015ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.174+0000 7efe15c00640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe10145640 0x7efe1015ce20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe0002a250 comp rx=0 tx=0).stop 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 -- 172.21.15.146:0/3631946842 shutdown_connections 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100d03a0 0x7efe100ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 --2- 172.21.15.146:0/3631946842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe10145640 0x7efe1015ce20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 -- 172.21.15.146:0/3631946842 >> 172.21.15.146:0/3631946842 conn(0x7efe1006b320 msgr2=0x7efe1006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 -- 172.21.15.146:0/3631946842 shutdown_connections 2024-04-24T23:07:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.175+0000 7efe15c00640 1 -- 172.21.15.146:0/3631946842 wait complete. 2024-04-24T23:07:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.176+0000 7efe15c00640 1 Processor -- start 2024-04-24T23:07:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.177+0000 7efe15c00640 1 -- start start 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.177+0000 7efe15c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.177+0000 7efe15c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100d03a0 0x7efe10142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe15c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe10145640 0x7efe10142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe15c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efe1006d9e0 con 0x7efe100b2a20 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe15c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe1006d700 con 0x7efe100d03a0 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe15c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe1006cbc0 con 0x7efe10145640 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33590/0 (socket says 172.21.15.146:33590) 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 -- 172.21.15.146:0/1406512207 learned_addr learned my addr 172.21.15.146:0/1406512207 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0e000640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100d03a0 0x7efe10142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:17.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 -- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe10145640 msgr2=0x7efe10142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe10145640 0x7efe10142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 -- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100d03a0 msgr2=0x7efe10142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100d03a0 0x7efe10142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 -- 172.21.15.146:0/1406512207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe10133f30 con 0x7efe100b2a20 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.178+0000 7efe0ea00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7efe00000c00 tx=0x7efe000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.179+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00037040 con 0x7efe100b2a20 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.179+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00042070 con 0x7efe100b2a20 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.179+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00030bb0 con 0x7efe100b2a20 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.179+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe10134210 con 0x7efe100b2a20 2024-04-24T23:07:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.179+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1013b7c0 con 0x7efe100b2a20 2024-04-24T23:07:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.180+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe10068190 con 0x7efe100b2a20 2024-04-24T23:07:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.181+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe00047460 con 0x7efe100b2a20 2024-04-24T23:07:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.182+0000 7efe06a00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 0x7efdf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.183+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7efe000abd90 con 0x7efe100b2a20 2024-04-24T23:07:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.183+0000 7efe0e000640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 0x7efdf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.184+0000 7efe0e000640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 0x7efdf006e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efe1015f0d0 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:17.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.187+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efe0007a510 con 0x7efe100b2a20 2024-04-24T23:07:17.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.432+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efe10158b50 con 0x7efe100b2a20 2024-04-24T23:07:17.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.433+0000 7efe06a00640 1 -- 172.21.15.146:0/1406512207 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7efe00079e10 con 0x7efe100b2a20 2024-04-24T23:07:17.435 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:07:17.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.435+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 msgr2=0x7efdf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.435+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 0x7efdf006e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efe1015f0d0 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2024-04-24T23:07:17.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.435+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 msgr2=0x7efe1013b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:17.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.435+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7efe00000c00 tx=0x7efe000046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 shutdown_connections 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efdf006be30 0x7efdf006e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe10145640 0x7efe10142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100d03a0 0x7efe10142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 --2- 172.21.15.146:0/1406512207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe100b2a20 0x7efe1013b280 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 >> 172.21.15.146:0/1406512207 conn(0x7efe1006b320 msgr2=0x7efe100b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 shutdown_connections 2024-04-24T23:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17.436+0000 7efe15c00640 1 -- 172.21.15.146:0/1406512207 wait complete. 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:07:17.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:07:17.457 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:07:17.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:17.457 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.507 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:07:17.508 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:07:17.509 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:07:17.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:17.510 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:07:17.587 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:07:17.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:17.591 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:07:17.641 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:07:17.641 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:07:17.641 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:07:17.642 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:07:17.642 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:07:17.642 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:07:17.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:07:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:07:17.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:17.851 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:07:17.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:07:17.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:07:17.898 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:07:17.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:17.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:07:18.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:07:18.028 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:07:18.080 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:07:18.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:07:18.080 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:07:18.130 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:07:18.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:18.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:07:18.262 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:07:18.262 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:07:18.297 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:07:18.297 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:07:18.297 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:07:18.298 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:07:18.298 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:07:18.300 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:07:18.301 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:07:18.301 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:07:18.301 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:07:18.301 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:07:18.304 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:07:18.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:18.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:07:18.372 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:07:18.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:07:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:07:18.511 INFO:teuthology.orchestra.run.smithi146.stdout:client6834 2024-04-24T23:07:18.511 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:07:18.512 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:18.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-24T23:07:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.770+0000 7f97cd000640 1 Processor -- start 2024-04-24T23:07:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.771+0000 7f97cd000640 1 -- start start 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f97c813ef30 0x7f97c8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97c8141ab0 0x7f97c80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c80ce5a0 0x7f97c815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f97c81423d0 con 0x7f97c8141ab0 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f97c8070f80 con 0x7f97c813ef30 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.772+0000 7f97cd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f97c80ced40 con 0x7f97c80ce5a0 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97c8141ab0 0x7f97c80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97c8141ab0 0x7f97c80ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35844/0 (socket says 172.21.15.146:35844) 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 -- 172.21.15.146:0/3966389241 learned_addr learned my addr 172.21.15.146:0/3966389241 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5e00640 1 --2- 172.21.15.146:0/3966389241 >> v2:172.21.15.203:3300/0 conn(0x7f97c813ef30 0x7f97c8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c6800640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c80ce5a0 0x7f97c815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 -- 172.21.15.146:0/3966389241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c80ce5a0 msgr2=0x7f97c815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c80ce5a0 0x7f97c815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 -- 172.21.15.146:0/3966389241 >> v2:172.21.15.203:3300/0 conn(0x7f97c813ef30 msgr2=0x7f97c8141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 --2- 172.21.15.146:0/3966389241 >> v2:172.21.15.203:3300/0 conn(0x7f97c813ef30 0x7f97c8141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.773+0000 7f97c5400640 1 -- 172.21.15.146:0/3966389241 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80cf020 con 0x7f97c8141ab0 2024-04-24T23:07:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.774+0000 7f97c5400640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c8141ab0 0x7f97c80ce060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f97c80707a0 tx=0x7f97b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e659b46efd46b381 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:18.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97c4a00640 1 -- 172.21.15.146:0/3966389241 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0036070 con 0x7f97c8141ab0 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97c4a00640 1 -- 172.21.15.146:0/3966389241 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b0031600 con 0x7f97c8141ab0 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97c4a00640 1 -- 172.21.15.146:0/3966389241 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00319d0 con 0x7f97c8141ab0 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 -- 172.21.15.146:0/3966389241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c8141ab0 msgr2=0x7f97c80ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c8141ab0 0x7f97c80ce060 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f97c80707a0 tx=0x7f97b002a6a0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 -- 172.21.15.146:0/3966389241 shutdown_connections 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c8141ab0 0x7f97c80ce060 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 --2- 172.21.15.146:0/3966389241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c80ce5a0 0x7f97c815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 --2- 172.21.15.146:0/3966389241 >> v2:172.21.15.203:3300/0 conn(0x7f97c813ef30 0x7f97c8141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.775+0000 7f97cd000640 1 -- 172.21.15.146:0/3966389241 >> 172.21.15.146:0/3966389241 conn(0x7f97c80b17b0 msgr2=0x7f97c80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.776+0000 7f97cd000640 1 -- 172.21.15.146:0/3966389241 shutdown_connections 2024-04-24T23:07:18.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.776+0000 7f97cd000640 1 -- 172.21.15.146:0/3966389241 wait complete. 2024-04-24T23:07:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.777+0000 7f97cd000640 1 Processor -- start 2024-04-24T23:07:18.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.777+0000 7f97cd000640 1 -- start start 2024-04-24T23:07:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97c80ce5a0 0x7f97c80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c8141ab0 0x7f97c813f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80cea30 con 0x7f97c813ef30 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f97c8070c10 con 0x7f97c80ce5a0 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.778+0000 7f97cd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f97c815ff40 con 0x7f97c8141ab0 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35860/0 (socket says 172.21.15.146:35860) 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 -- 172.21.15.146:0/2903131001 learned_addr learned my addr 172.21.15.146:0/2903131001 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c6800640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c8141ab0 0x7f97c813f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5e00640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97c80ce5a0 0x7f97c80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 -- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c8141ab0 msgr2=0x7f97c813f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c8141ab0 0x7f97c813f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 -- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97c80ce5a0 msgr2=0x7f97c80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97c80ce5a0 0x7f97c80adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.779+0000 7f97c5400640 1 -- 172.21.15.146:0/2903131001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c8155890 con 0x7f97c813ef30 2024-04-24T23:07:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97c5400640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009e20 tx=0x7f97b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0041020 con 0x7f97c813ef30 2024-04-24T23:07:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b0007820 con 0x7f97c813ef30 2024-04-24T23:07:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c8155b70 con 0x7f97c813ef30 2024-04-24T23:07:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0036040 con 0x7f97c813ef30 2024-04-24T23:07:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.780+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c8156130 con 0x7f97c813ef30 2024-04-24T23:07:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.781+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c80ce200 con 0x7f97c813ef30 2024-04-24T23:07:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.782+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97b0044020 con 0x7f97c813ef30 2024-04-24T23:07:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.783+0000 7f97be000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.783+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f97b00abd40 con 0x7f97c813ef30 2024-04-24T23:07:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.784+0000 7f97c5e00640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.785+0000 7f97c5e00640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:18.788+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f97c80ce200 con 0x7f97c813ef30 2024-04-24T23:07:19.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.027+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f97c8141570 con 0x7f97c813ef30 2024-04-24T23:07:19.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.414+0000 7f97be000640 1 -- 172.21.15.146:0/2903131001 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v48) ==== 105+0+0 (secure 0 0 0) 0x7f97c8141570 con 0x7f97c813ef30 2024-04-24T23:07:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 msgr2=0x7f97a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8008040 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 msgr2=0x7f97c8144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009e20 tx=0x7f97b0004a40 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 shutdown_connections 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f97c8141ab0 0x7f97c813f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c813ef30 0x7f97c8144cd0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 --2- 172.21.15.146:0/2903131001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97c80ce5a0 0x7f97c80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.418+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 >> 172.21.15.146:0/2903131001 conn(0x7f97c80b17b0 msgr2=0x7f97c8140950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.419+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 shutdown_connections 2024-04-24T23:07:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.419+0000 7f97cd000640 1 -- 172.21.15.146:0/2903131001 wait complete. 2024-04-24T23:07:19.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.627+0000 7f55abe00640 1 Processor -- start 2024-04-24T23:07:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.627+0000 7f55abe00640 1 -- start start 2024-04-24T23:07:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.628+0000 7f55abe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f55a4145640 0x7f55a415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.628+0000 7f55abe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.628+0000 7f55abe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a40cdf70 con 0x7f55a406cbc0 2024-04-24T23:07:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.628+0000 7f55abe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f55a415d360 con 0x7f55a4145640 2024-04-24T23:07:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.628+0000 7f55abe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f55a4145a20 con 0x7f55a40b2a20 2024-04-24T23:07:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.629+0000 7f55a8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.629+0000 7f55a8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:53488/0 (socket says 172.21.15.146:53488) 2024-04-24T23:07:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.629+0000 7f55a8a00640 1 -- 172.21.15.146:0/1825140719 learned_addr learned my addr 172.21.15.146:0/1825140719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.629+0000 7f55a9400640 1 --2- 172.21.15.146:0/1825140719 >> v2:172.21.15.203:3300/0 conn(0x7f55a4145640 0x7f55a415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.630+0000 7f55a8a00640 1 -- 172.21.15.146:0/1825140719 >> v2:172.21.15.203:3300/0 conn(0x7f55a4145640 msgr2=0x7f55a415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.630+0000 7f55a8a00640 1 --2- 172.21.15.146:0/1825140719 >> v2:172.21.15.203:3300/0 conn(0x7f55a4145640 0x7f55a415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.630+0000 7f55a8a00640 1 -- 172.21.15.146:0/1825140719 >> v1:172.21.15.203:6789/0 conn(0x7f55a406cbc0 legacy=0x7f55a415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.630+0000 7f55a8a00640 1 -- 172.21.15.146:0/1825140719 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a406d140 con 0x7f55a40b2a20 2024-04-24T23:07:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.631+0000 7f55a8a00640 1 --2- 172.21.15.146:0/1825140719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab29bd44d5edc1b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.631+0000 7f55a3e00640 1 -- 172.21.15.146:0/1825140719 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590037070 con 0x7f55a40b2a20 2024-04-24T23:07:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.631+0000 7f55a3e00640 1 -- 172.21.15.146:0/1825140719 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5590032440 con 0x7f55a40b2a20 2024-04-24T23:07:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.631+0000 7f55a3e00640 1 -- 172.21.15.146:0/1825140719 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590032810 con 0x7f55a40b2a20 2024-04-24T23:07:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 -- 172.21.15.146:0/1825140719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 msgr2=0x7f55a40cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 --2- 172.21.15.146:0/1825140719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559002a270 comp rx=0 tx=0).stop 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 -- 172.21.15.146:0/1825140719 shutdown_connections 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 --2- 172.21.15.146:0/1825140719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a40b2a20 0x7f55a40cfc90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 --2- 172.21.15.146:0/1825140719 >> v2:172.21.15.203:3300/0 conn(0x7f55a4145640 0x7f55a415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 -- 172.21.15.146:0/1825140719 >> 172.21.15.146:0/1825140719 conn(0x7f55a406b320 msgr2=0x7f55a406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 -- 172.21.15.146:0/1825140719 shutdown_connections 2024-04-24T23:07:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.632+0000 7f55abe00640 1 -- 172.21.15.146:0/1825140719 wait complete. 2024-04-24T23:07:19.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.634+0000 7f55abe00640 1 Processor -- start 2024-04-24T23:07:19.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.634+0000 7f55abe00640 1 -- start start 2024-04-24T23:07:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a406cbc0 0x7f55a4141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a4145640 0x7f55a41f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406d9e0 con 0x7f55a40b2a20 2024-04-24T23:07:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406d700 con 0x7f55a4145640 2024-04-24T23:07:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55abe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f55a40d01d0 con 0x7f55a406cbc0 2024-04-24T23:07:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.635+0000 7f55a8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35868/0 (socket says 172.21.15.146:35868) 2024-04-24T23:07:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 -- 172.21.15.146:0/2773150667 learned_addr learned my addr 172.21.15.146:0/2773150667 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a9400640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a406cbc0 0x7f55a4141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a9e00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a4145640 0x7f55a41f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 -- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a406cbc0 msgr2=0x7f55a4141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a406cbc0 0x7f55a4141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 -- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a4145640 msgr2=0x7f55a41f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a4145640 0x7f55a41f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 -- 172.21.15.146:0/2773150667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41553a0 con 0x7f55a40b2a20 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.636+0000 7f55a8a00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f559002a2b0 tx=0x7f55900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.637+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590037040 con 0x7f55a40b2a20 2024-04-24T23:07:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.637+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5590042070 con 0x7f55a40b2a20 2024-04-24T23:07:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.637+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590030880 con 0x7f55a40b2a20 2024-04-24T23:07:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.637+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41407a0 con 0x7f55a40b2a20 2024-04-24T23:07:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.637+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a4140d60 con 0x7f55a40b2a20 2024-04-24T23:07:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.638+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a4068190 con 0x7f55a40b2a20 2024-04-24T23:07:19.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.639+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5590030a20 con 0x7f55a40b2a20 2024-04-24T23:07:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.640+0000 7f55a1600640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 0x7f558406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.640+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f55900ab7c0 con 0x7f55a40b2a20 2024-04-24T23:07:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.641+0000 7f55a9400640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 0x7f558406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.642+0000 7f55a9400640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 0x7f558406e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b1490 tx=0x7f5598008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.645+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f559007a070 con 0x7f55a40b2a20 2024-04-24T23:07:19.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.882+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55a40d05a0 con 0x7f55a40b2a20 2024-04-24T23:07:19.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.884+0000 7f55a1600640 1 -- 172.21.15.146:0/2773150667 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5207 (secure 0 0 0) 0x7f5590079970 con 0x7f55a40b2a20 2024-04-24T23:07:19.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:19.886 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:19.419290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666,"mds_1":6660},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6660":{"gid":6660,"name":"c","rank":1,"incarnation":49,"state":"up:creating","state_seq":1,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6666]},"id":4}]} 2024-04-24T23:07:19.886 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 49 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 msgr2=0x7f558406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 0x7f558406e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b1490 tx=0x7f5598008040 comp rx=0 tx=0).stop 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 msgr2=0x7f55a41f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f559002a2b0 tx=0x7f55900046c0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 shutdown_connections 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a4145640 0x7f55a41f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a40b2a20 0x7f55a41f3180 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f558406be30 0x7f558406e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 --2- 172.21.15.146:0/2773150667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55a406cbc0 0x7f55a4141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 >> 172.21.15.146:0/2773150667 conn(0x7f55a406b320 msgr2=0x7f55a406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 shutdown_connections 2024-04-24T23:07:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:19.887+0000 7f55abe00640 1 -- 172.21.15.146:0/2773150667 wait complete. 2024-04-24T23:07:20.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:07:08.786511+0000', 'modified': '2024-04-24T23:07:19.419290+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6666, 'mds_1': 6660}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6660': {'gid': 6660, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.146:6834/896278918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 896278918}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 896278918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6666': {'gid': 6666, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/4094476555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 4094476555}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 4094476555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6666, 'qdb_cluster': [6666]} 2024-04-24T23:07:20.311 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6660:up:creating 2024-04-24T23:07:21.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:21.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.521+0000 7f0a9a600640 1 Processor -- start 2024-04-24T23:07:21.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.521+0000 7f0a9a600640 1 -- start start 2024-04-24T23:07:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.522+0000 7f0a9a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a9415a980 0x7f0a9406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.522+0000 7f0a9a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.522+0000 7f0a9a600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940ccb10 con 0x7f0a94071dd0 2024-04-24T23:07:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.522+0000 7f0a9a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0a94072230 con 0x7f0a9415a980 2024-04-24T23:07:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.522+0000 7f0a9a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a940aede0 con 0x7f0a940d0240 2024-04-24T23:07:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.523+0000 7f0a99c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.523+0000 7f0a99200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a9415a980 0x7f0a9406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.523+0000 7f0a99c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:53508/0 (socket says 172.21.15.146:53508) 2024-04-24T23:07:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.523+0000 7f0a99c00640 1 -- 172.21.15.146:0/858373801 learned_addr learned my addr 172.21.15.146:0/858373801 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.523+0000 7f0a8be00640 1 --1- 172.21.15.146:0/858373801 >> v1:172.21.15.203:6789/0 conn(0x7f0a94071dd0 0x7f0a940cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:46546/0 (socket says 172.21.15.146:46546) 2024-04-24T23:07:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.524+0000 7f0a99c00640 1 -- 172.21.15.146:0/858373801 >> v2:172.21.15.203:3300/0 conn(0x7f0a9415a980 msgr2=0x7f0a9406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.524+0000 7f0a99c00640 1 --2- 172.21.15.146:0/858373801 >> v2:172.21.15.203:3300/0 conn(0x7f0a9415a980 0x7f0a9406d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.524+0000 7f0a99c00640 1 -- 172.21.15.146:0/858373801 >> v1:172.21.15.203:6789/0 conn(0x7f0a94071dd0 legacy=0x7f0a940cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.524+0000 7f0a99c00640 1 -- 172.21.15.146:0/858373801 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9406ddc0 con 0x7f0a940d0240 2024-04-24T23:07:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.525+0000 7f0a99c00640 1 --2- 172.21.15.146:0/858373801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009e50 tx=0x7f0a8c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7166c1be5d05d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:21.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.526+0000 7f0a93e00640 1 -- 172.21.15.146:0/858373801 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c036070 con 0x7f0a940d0240 2024-04-24T23:07:21.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.526+0000 7f0a93e00640 1 -- 172.21.15.146:0/858373801 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c031600 con 0x7f0a940d0240 2024-04-24T23:07:21.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.526+0000 7f0a93e00640 1 -- 172.21.15.146:0/858373801 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0319d0 con 0x7f0a940d0240 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 -- 172.21.15.146:0/858373801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 msgr2=0x7f0a940ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 --2- 172.21.15.146:0/858373801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009e50 tx=0x7f0a8c02a680 comp rx=0 tx=0).stop 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 -- 172.21.15.146:0/858373801 shutdown_connections 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 --2- 172.21.15.146:0/858373801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a940ccfd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 --2- 172.21.15.146:0/858373801 >> v2:172.21.15.203:3300/0 conn(0x7f0a9415a980 0x7f0a9406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 -- 172.21.15.146:0/858373801 >> 172.21.15.146:0/858373801 conn(0x7f0a9406b320 msgr2=0x7f0a9406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 -- 172.21.15.146:0/858373801 shutdown_connections 2024-04-24T23:07:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.527+0000 7f0a9a600640 1 -- 172.21.15.146:0/858373801 wait complete. 2024-04-24T23:07:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.529+0000 7f0a9a600640 1 Processor -- start 2024-04-24T23:07:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.529+0000 7f0a9a600640 1 -- start start 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a94071dd0 0x7f0a9415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a94135310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9406e660 con 0x7f0a9415a980 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9406e380 con 0x7f0a94071dd0 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.530+0000 7f0a9a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9415ad60 con 0x7f0a940d0240 2024-04-24T23:07:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35878/0 (socket says 172.21.15.146:35878) 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 -- 172.21.15.146:0/1482523334 learned_addr learned my addr 172.21.15.146:0/1482523334 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99200640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a94071dd0 0x7f0a9415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a8be00640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a94135310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 -- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 msgr2=0x7f0a94135310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a94135310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 -- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a94071dd0 msgr2=0x7f0a9415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a94071dd0 0x7f0a9415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.531+0000 7f0a99c00640 1 -- 172.21.15.146:0/1482523334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9414f480 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a99c00640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c034040 tx=0x7f0a8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c036050 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c042070 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9414de20 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c009510 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.532+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9414e3e0 con 0x7f0a9415a980 2024-04-24T23:07:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.533+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9404f500 con 0x7f0a9415a980 2024-04-24T23:07:21.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.534+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a8c007bf0 con 0x7f0a9415a980 2024-04-24T23:07:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.535+0000 7f0a91600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 0x7f0a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.535+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f0a8c0abf50 con 0x7f0a9415a980 2024-04-24T23:07:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.536+0000 7f0a99200640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 0x7f0a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:21.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.537+0000 7f0a99200640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 0x7f0a7006e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009ad0 tx=0x7f0a84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.541+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a8c045360 con 0x7f0a9415a980 2024-04-24T23:07:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.786+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a940cbb00 con 0x7f0a9415a980 2024-04-24T23:07:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.787+0000 7f0a91600640 1 -- 172.21.15.146:0/1482523334 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5210 (secure 0 0 0) 0x7f0a8c07a6d0 con 0x7f0a9415a980 2024-04-24T23:07:21.791 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:21.791 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:20.425117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666,"mds_1":6660},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6660":{"gid":6660,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6660,6666]},"id":4}]} 2024-04-24T23:07:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 50 2024-04-24T23:07:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 msgr2=0x7f0a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 0x7f0a7006e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009ad0 tx=0x7f0a84008040 comp rx=0 tx=0).stop 2024-04-24T23:07:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 msgr2=0x7f0a94135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c034040 tx=0x7f0a8c004a40 comp rx=0 tx=0).stop 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 shutdown_connections 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a9415a980 0x7f0a94135850 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0a7006be30 0x7f0a7006e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a940d0240 0x7f0a94135310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 --2- 172.21.15.146:0/1482523334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a94071dd0 0x7f0a9415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 >> 172.21.15.146:0/1482523334 conn(0x7f0a9406b320 msgr2=0x7f0a940b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.790+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 shutdown_connections 2024-04-24T23:07:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:21.791+0000 7f0a9a600640 1 -- 172.21.15.146:0/1482523334 wait complete. 2024-04-24T23:07:22.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:07:08.786511+0000', 'modified': '2024-04-24T23:07:20.425117+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6666, 'mds_1': 6660}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6660': {'gid': 6660, 'name': 'c', 'rank': 1, 'incarnation': 49, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.146:6834/896278918', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 896278918}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 896278918}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6666': {'gid': 6666, 'name': 'd', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/4094476555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 4094476555}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 4094476555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6666, 'qdb_cluster': [6660, 6666]} 2024-04-24T23:07:22.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-24T23:07:22.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:07:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.426+0000 7fc874a00640 1 Processor -- start 2024-04-24T23:07:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.427+0000 7fc874a00640 1 -- start start 2024-04-24T23:07:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc874a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8700b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc874a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8700d4a50 con 0x7fc87015e050 2024-04-24T23:07:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc874a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8700b33e0 con 0x7fc8700d2720 2024-04-24T23:07:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc874a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8700d4800 con 0x7fc8700d0d20 2024-04-24T23:07:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc86f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc87015e050 0x7fc8700d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43438/0 (socket says 172.21.15.146:43438) 2024-04-24T23:07:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.428+0000 7fc86f400640 1 -- 172.21.15.146:0/443926057 learned_addr learned my addr 172.21.15.146:0/443926057 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86fe00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8700b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184373673 0 0) 0x7fc8700d4a50 con 0x7fc87015e050 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc850003520 con 0x7fc87015e050 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399765187 0 0) 0x7fc850003520 con 0x7fc87015e050 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 msgr2=0x7fc8700b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8700b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 >> v1:172.21.15.203:6789/0 conn(0x7fc8700d2720 legacy=0x7fc8700b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87015e430 con 0x7fc87015e050 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fc860001670 con 0x7fc87015e050 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86fe00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8700b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 >> v1:172.21.15.146:6789/0 conn(0x7fc87015e050 legacy=0x7fc8700d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850003fd0 0x7fc850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc850004d40 0x7fc8500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700d4800 con 0x7fc850003fd0 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc85000bbb0 con 0x7fc850004d40 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.429+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc85000bdb0 con 0x7fc8700d0d20 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850003fd0 0x7fc850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86fe00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc850004d40 0x7fc8500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86f400640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 -- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 msgr2=0x7fc8500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 -- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc850004d40 msgr2=0x7fc8500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc850004d40 0x7fc8500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86ea00640 1 -- 172.21.15.146:0/443926057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850003520 con 0x7fc850003fd0 2024-04-24T23:07:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86f400640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc8700d0d20 0x7fc8500039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.430+0000 7fc86fe00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc850004d40 0x7fc8500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.431+0000 7fc86ea00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850003fd0 0x7fc850004800 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc858001e50 tx=0x7fc850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4697f7aa2c376c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.431+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858001a70 con 0x7fc850003fd0 2024-04-24T23:07:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.431+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc858003970 con 0x7fc850003fd0 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.431+0000 7fc86e000640 1 -- 172.21.15.146:0/443926057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858003d60 con 0x7fc850003fd0 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 -- 172.21.15.146:0/443926057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850003fd0 msgr2=0x7fc850004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 --2- 172.21.15.146:0/443926057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850003fd0 0x7fc850004800 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc858001e50 tx=0x7fc850005830 comp rx=0 tx=0).stop 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc86fe00640 1 -- 172.21.15.146:0/443926057 reap_dead start 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 -- 172.21.15.146:0/443926057 shutdown_connections 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 -- 172.21.15.146:0/443926057 >> 172.21.15.146:0/443926057 conn(0x7fc8700d3ce0 msgr2=0x7fc8700d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 -- 172.21.15.146:0/443926057 shutdown_connections 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.432+0000 7fc874a00640 1 -- 172.21.15.146:0/443926057 wait complete. 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.434+0000 7fc874a00640 1 Processor -- start 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.434+0000 7fc874a00640 1 -- start start 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc850003fd0 0x7fc87015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc870160f30 0x7fc870153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700b3190 con 0x7fc87015b930 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700cfc80 con 0x7fc870160f30 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc874a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8700b3750 con 0x7fc850003fd0 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35892/0 (socket says 172.21.15.146:35892) 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.435+0000 7fc86fe00640 1 -- 172.21.15.146:0/3858220143 learned_addr learned my addr 172.21.15.146:0/3858220143 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86f400640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc850003fd0 0x7fc87015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86ea00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc870160f30 0x7fc870153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 -- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc850003fd0 msgr2=0x7fc87015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc850003fd0 0x7fc87015f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 -- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc870160f30 msgr2=0x7fc870153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc870160f30 0x7fc870153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 -- 172.21.15.146:0/3858220143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870157410 con 0x7fc87015b930 2024-04-24T23:07:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc86fe00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b9d90 tx=0x7fc86800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc867400640 1 -- 172.21.15.146:0/3858220143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868004230 con 0x7fc87015b930 2024-04-24T23:07:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc867400640 1 -- 172.21.15.146:0/3858220143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86801a070 con 0x7fc87015b930 2024-04-24T23:07:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc867400640 1 -- 172.21.15.146:0/3858220143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868003610 con 0x7fc87015b930 2024-04-24T23:07:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.436+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc870153f10 con 0x7fc87015b930 2024-04-24T23:07:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.437+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701544d0 con 0x7fc87015b930 2024-04-24T23:07:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.439+0000 7fc867400640 1 -- 172.21.15.146:0/3858220143 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc868012070 con 0x7fc87015b930 2024-04-24T23:07:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.440+0000 7fc867400640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 0x7fc84c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.440+0000 7fc867400640 1 -- 172.21.15.146:0/3858220143 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fc86808ab00 con 0x7fc87015b930 2024-04-24T23:07:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.440+0000 7fc86f400640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 0x7fc84c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.440+0000 7fc878e12740 1 Processor -- start 2024-04-24T23:07:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.441+0000 7fc878e12740 1 -- start start 2024-04-24T23:07:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.441+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c9219fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.441+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.441+0000 7fc878e12740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc878e12740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c92074ed0 con 0x556c92175400 2024-04-24T23:07:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c920d7df0 con 0x556c9219f720 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x556c920808d0 con 0x556c921bcfc0 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86f400640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 0x7fc84c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8600017e0 tx=0x7fc860009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35902/0 (socket says 172.21.15.146:35902) 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 -- 172.21.15.146:0/4275837705 learned_addr learned my addr 172.21.15.146:0/4275837705 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86ea00640 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86f400640 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c9219fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 -- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 msgr2=0x556c921bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 -- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 msgr2=0x556c9219fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c9219fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.442+0000 7fc86fe00640 1 -- 172.21.15.146:0/4275837705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c91dec2d0 con 0x556c92175400 2024-04-24T23:07:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.443+0000 7fc86fe00640 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc868088d40 tx=0x7fc8680585e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691530b1b80c9bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.445+0000 7fc85f400640 1 -- 172.21.15.146:0/4275837705 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868061760 con 0x556c92175400 2024-04-24T23:07:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.445+0000 7fc85f400640 1 -- 172.21.15.146:0/4275837705 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868056e80 con 0x556c92175400 2024-04-24T23:07:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.445+0000 7fc85f400640 1 -- 172.21.15.146:0/4275837705 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868057fd0 con 0x556c92175400 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 -- 172.21.15.146:0/4275837705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 msgr2=0x556c921bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc868088d40 tx=0x7fc8680585e0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 -- 172.21.15.146:0/4275837705 shutdown_connections 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92175400 0x556c921bb680 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 --2- 172.21.15.146:0/4275837705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c9219fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 -- 172.21.15.146:0/4275837705 >> 172.21.15.146:0/4275837705 conn(0x556c92171d30 msgr2=0x556c921ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 -- 172.21.15.146:0/4275837705 shutdown_connections 2024-04-24T23:07:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.446+0000 7fc878e12740 1 -- 172.21.15.146:0/4275837705 wait complete. 2024-04-24T23:07:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.447+0000 7fc878e12740 1 -- start start 2024-04-24T23:07:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.447+0000 7fc878e12740 1 Processor -- start 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c921b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921a28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c92093d20 con 0x556c92191600 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c920d3db0 con 0x556c9219f720 2024-04-24T23:07:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x556c921761a0 con 0x556c921bcfc0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc878e12740 10 client.0 _ll_register_callbacks cb 0x556c920cef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35904/0 (socket says 172.21.15.146:35904) 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.448+0000 7fc86fe00640 1 -- 172.21.15.146:0/920278131 learned_addr learned my addr 172.21.15.146:0/920278131 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86f400640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c921b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86ea00640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921a28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 -- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 msgr2=0x556c921a28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921a28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 -- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 msgr2=0x556c921b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c921b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 -- 172.21.15.146:0/920278131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c91eb66b0 con 0x556c92191600 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc86fe00640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc86805d0f0 tx=0x7fc868014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9216eb69f519ac09 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.449+0000 7fc857e00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:22.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.451+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868061760 con 0x556c92191600 2024-04-24T23:07:22.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.451+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fc8680581e0 con 0x556c92191600 2024-04-24T23:07:22.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.451+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc868056e80 con 0x556c92191600 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc86805f140 con 0x556c92191600 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 10 client.6858 fetch_fsmap learned FSMap version 50 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x556c9218e980 con 0x556c92191600 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868056e80 con 0x556c92191600 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 50) ==== 3514+0+0 (secure 0 0 0) 0x7fc86805f2e0 con 0x556c92191600 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 10 client.6858 fetch_fsmap finished waiting for FSMap version 50 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 10 client.6858 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 20 client.6858 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921ce190 0x556c921a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 4 client.6858 mds_command: new command op to 6660 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 --> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c920e5330 con 0x556c921ce190 2024-04-24T23:07:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.452+0000 7fc86f400640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921ce190 0x556c921a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.453+0000 7fc86f400640 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921ce190 0x556c921a12b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da8c44ae73b4969b server_cookie=d66aba7e984e5f6 in_seq=0 out_seq=0 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.453+0000 7fc857e00640 10 client.6858 ms_handle_connect on v2:172.21.15.146:6832/896278918 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc857e00640 1 -- 172.21.15.146:0/920278131 <== mds.1 v2:172.21.15.146:6832/896278918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556c920e5330 con 0x556c921ce190 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc857e00640 10 client.6858 handle_command_reply: tid=0 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 client.6858 shutdown 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 msgr2=0x556c921a2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc86805d0f0 tx=0x7fc868014000 comp rx=0 tx=0).stop 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 shutdown_connections 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921ce190 0x556c921a12b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c92191600 0x556c921a2df0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c921bcfc0 0x556c921a28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 --2- 172.21.15.146:0/920278131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c9219f720 0x556c921b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 >> 172.21.15.146:0/920278131 conn(0x556c92175400 msgr2=0x556c921bdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc857e00640 0 client.6858 ms_handle_reset on v2:172.21.15.146:6832/896278918 2024-04-24T23:07:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.454+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 shutdown_connections 2024-04-24T23:07:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.455+0000 7fc878e12740 1 -- 172.21.15.146:0/920278131 wait complete. 2024-04-24T23:07:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.455+0000 7fc878e12740 20 client.6858 trim_cache size 0 max 16384 2024-04-24T23:07:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.474+0000 7fc878e12740 1 Processor -- start 2024-04-24T23:07:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 -- start start 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 0x556c9219ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c9219f720 0x556c921b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc870201400 con 0x556c921bcfc0 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8701ff780 con 0x556c92191600 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.475+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc8701ffdd0 con 0x556c9219f720 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35914/0 (socket says 172.21.15.146:35914) 2024-04-24T23:07:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 -- 172.21.15.146:0/2897423943 learned_addr learned my addr 172.21.15.146:0/2897423943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86f400640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 0x556c9219ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86ea00640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c9219f720 0x556c921b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 -- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c9219f720 msgr2=0x556c921b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c9219f720 0x556c921b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 -- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 msgr2=0x556c9219ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 0x556c9219ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86fe00640 1 -- 172.21.15.146:0/2897423943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c92170330 con 0x556c921bcfc0 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.476+0000 7fc86f400640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 0x556c9219ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.477+0000 7fc86fe00640 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc868058880 tx=0x7fc868084070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f102d2421c8d6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.477+0000 7fc85ea00640 1 -- 172.21.15.146:0/2897423943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868061760 con 0x556c921bcfc0 2024-04-24T23:07:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.477+0000 7fc85ea00640 1 -- 172.21.15.146:0/2897423943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868086020 con 0x556c921bcfc0 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.477+0000 7fc85ea00640 1 -- 172.21.15.146:0/2897423943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8680581e0 con 0x556c921bcfc0 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 -- 172.21.15.146:0/2897423943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 msgr2=0x556c921bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc868058880 tx=0x7fc868084070 comp rx=0 tx=0).stop 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 -- 172.21.15.146:0/2897423943 shutdown_connections 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c921bcfc0 0x556c921bc8d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c9219f720 0x556c921b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 --2- 172.21.15.146:0/2897423943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c92191600 0x556c9219ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 -- 172.21.15.146:0/2897423943 >> 172.21.15.146:0/2897423943 conn(0x556c92175400 msgr2=0x556c921b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 -- 172.21.15.146:0/2897423943 shutdown_connections 2024-04-24T23:07:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.478+0000 7fc878e12740 1 -- 172.21.15.146:0/2897423943 wait complete. 2024-04-24T23:07:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.479+0000 7fc878e12740 1 -- start start 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.479+0000 7fc878e12740 1 Processor -- start 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c92191600 0x556c9221d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c921bcfc0 0x556c921a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c92093d20 con 0x556c9219f720 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556c921761a0 con 0x556c921bcfc0 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x556c920d3db0 con 0x556c92191600 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc878e12740 10 client.0 _ll_register_callbacks cb 0x7fc8680584e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc86ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc86ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35920/0 (socket says 172.21.15.146:35920) 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.480+0000 7fc86ea00640 1 -- 172.21.15.146:0/1019857056 learned_addr learned my addr 172.21.15.146:0/1019857056 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86fe00640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c921bcfc0 0x556c921a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86f400640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c92191600 0x556c9221d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 -- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c92191600 msgr2=0x556c9221d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c92191600 0x556c9221d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 -- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c921bcfc0 msgr2=0x556c921a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c921bcfc0 0x556c921a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 -- 172.21.15.146:0/1019857056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c921742e0 con 0x556c9219f720 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc86ea00640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc85802a920 tx=0x7fc858001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113c7525eb6ca251 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc857e00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858006e60 con 0x556c9219f720 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fc858003970 con 0x556c9219f720 2024-04-24T23:07:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc868086020 con 0x556c9219f720 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.481+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc85804c050 con 0x556c9219f720 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 10 client.6864 fetch_fsmap learned FSMap version 50 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x556c92173ae0 con 0x556c9219f720 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868086020 con 0x556c9219f720 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 50) ==== 3514+0+0 (secure 0 0 0) 0x7fc85804f020 con 0x556c9219f720 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 10 client.6864 fetch_fsmap finished waiting for FSMap version 50 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 10 client.6864 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 20 client.6864 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921dd110 0x556c921a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 4 client.6864 mds_command: new command op to 6660 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 --> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] -- command(tid 0: {"prefix": "status"}) -- 0x556c920df680 con 0x556c921dd110 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.482+0000 7fc86f400640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921dd110 0x556c921a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc86f400640 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921dd110 0x556c921a2990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10822557debb2606 server_cookie=c6f0736e8c9645fe in_seq=0 out_seq=0 2024-04-24T23:07:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc857e00640 10 client.6864 ms_handle_connect on v2:172.21.15.146:6832/896278918 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc857e00640 1 -- 172.21.15.146:0/1019857056 <== mds.1 v2:172.21.15.146:6832/896278918 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556c920df680 con 0x556c921dd110 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc857e00640 10 client.6864 handle_command_reply: tid=0 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 client.6864 shutdown 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 msgr2=0x556c921cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc85802a920 tx=0x7fc858001510 comp rx=0 tx=0).stop 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 shutdown_connections 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:6832/896278918,v1:172.21.15.146:6834/896278918] conn(0x556c921dd110 0x556c921a2990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556c921bcfc0 0x556c921a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c9219f720 0x556c921cc430 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc857e00640 0 client.6864 ms_handle_reset on v2:172.21.15.146:6832/896278918 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 --2- 172.21.15.146:0/1019857056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x556c92191600 0x556c9221d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.483+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 >> 172.21.15.146:0/1019857056 conn(0x556c92175400 msgr2=0x556c9216ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 shutdown_connections 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc878e12740 1 -- 172.21.15.146:0/1019857056 wait complete. 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc878e12740 20 client.6864 trim_cache size 0 max 16384 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 1, 2024-04-24T23:07:22.490 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6660, 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 3.0586076439999998, 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 50, 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 68, 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 68, 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 18.605351770999999 2024-04-24T23:07:22.491 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:07:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 msgr2=0x7fc84c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 0x7fc84c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8600017e0 tx=0x7fc860009040 comp rx=0 tx=0).stop 2024-04-24T23:07:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 msgr2=0x7fc87015bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b9d90 tx=0x7fc86800f670 comp rx=0 tx=0).stop 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 shutdown_connections 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87015b930 0x7fc87015bdb0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc870160f30 0x7fc870153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc84c06be30 0x7fc84c06e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 --2- 172.21.15.146:0/3858220143 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc850003fd0 0x7fc87015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.484+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 >> 172.21.15.146:0/3858220143 conn(0x7fc8700d3ce0 msgr2=0x7fc87006cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.485+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 shutdown_connections 2024-04-24T23:07:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.485+0000 7fc874a00640 1 -- 172.21.15.146:0/3858220143 wait complete. 2024-04-24T23:07:22.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-24T23:07:22.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.692+0000 7ff029c00640 1 Processor -- start 2024-04-24T23:07:22.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.692+0000 7ff029c00640 1 -- start start 2024-04-24T23:07:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.693+0000 7ff029c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff02406e370 0x7ff0240710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.693+0000 7ff029c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff0240b3020 0x7ff0240b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.693+0000 7ff029c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0240af0a0 con 0x7ff02415ae50 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.693+0000 7ff029c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff0240b2860 con 0x7ff02406e370 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.693+0000 7ff029c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff02406cbe0 con 0x7ff0240b3020 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff023e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff02415ae50 0x7ff0240709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43448/0 (socket says 172.21.15.146:43448) 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff01b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff02406e370 0x7ff0240710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff023e00640 1 -- 172.21.15.146:0/205501936 learned_addr learned my addr 172.21.15.146:0/205501936 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff029200640 1 --2- 172.21.15.146:0/205501936 >> v2:172.21.15.203:3300/0 conn(0x7ff0240b3020 0x7ff0240b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff01b400640 1 -- 172.21.15.146:0/205501936 >> v2:172.21.15.203:3300/0 conn(0x7ff0240b3020 msgr2=0x7ff0240b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff01b400640 1 --2- 172.21.15.146:0/205501936 >> v2:172.21.15.203:3300/0 conn(0x7ff0240b3020 0x7ff0240b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff01b400640 1 -- 172.21.15.146:0/205501936 >> v1:172.21.15.146:6789/0 conn(0x7ff02415ae50 legacy=0x7ff0240709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.694+0000 7ff01b400640 1 -- 172.21.15.146:0/205501936 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02406cec0 con 0x7ff02406e370 2024-04-24T23:07:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.695+0000 7ff01b400640 1 --2- 172.21.15.146:0/205501936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff0240710e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff02406c250 tx=0x7ff00c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db83b33ad8cc71b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.696+0000 7ff023400640 1 -- 172.21.15.146:0/205501936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c037070 con 0x7ff02406e370 2024-04-24T23:07:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.696+0000 7ff023400640 1 -- 172.21.15.146:0/205501936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00c032440 con 0x7ff02406e370 2024-04-24T23:07:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.696+0000 7ff023400640 1 -- 172.21.15.146:0/205501936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c032810 con 0x7ff02406e370 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.696+0000 7ff029c00640 1 -- 172.21.15.146:0/205501936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 msgr2=0x7ff0240710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.696+0000 7ff029c00640 1 --2- 172.21.15.146:0/205501936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff0240710e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff02406c250 tx=0x7ff00c02a1a0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 -- 172.21.15.146:0/205501936 shutdown_connections 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 --2- 172.21.15.146:0/205501936 >> v2:172.21.15.203:3300/0 conn(0x7ff0240b3020 0x7ff0240b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 --2- 172.21.15.146:0/205501936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff0240710e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 -- 172.21.15.146:0/205501936 >> 172.21.15.146:0/205501936 conn(0x7ff0240b1560 msgr2=0x7ff0240b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 -- 172.21.15.146:0/205501936 shutdown_connections 2024-04-24T23:07:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.697+0000 7ff029c00640 1 -- 172.21.15.146:0/205501936 wait complete. 2024-04-24T23:07:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.699+0000 7ff029c00640 1 Processor -- start 2024-04-24T23:07:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.699+0000 7ff029c00640 1 -- start start 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0240b3020 0x7ff02415d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff02415ae50 0x7ff02415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0240b39f0 con 0x7ff02406e370 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff024071830 con 0x7ff02415ae50 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff029c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff0240b3b70 con 0x7ff0240b3020 2024-04-24T23:07:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff023e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff023e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35934/0 (socket says 172.21.15.146:35934) 2024-04-24T23:07:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.700+0000 7ff023e00640 1 -- 172.21.15.146:0/1733830581 learned_addr learned my addr 172.21.15.146:0/1733830581 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 -- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0240b3020 msgr2=0x7ff02415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff029200640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff02415ae50 0x7ff02415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff01b400640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0240b3020 0x7ff02415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0240b3020 0x7ff02415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 -- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff02415ae50 msgr2=0x7ff02415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff02415ae50 0x7ff02415d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 -- 172.21.15.146:0/1733830581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02414f460 con 0x7ff02406e370 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff023e00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c3c0 tx=0x7ff01400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff020c00640 1 -- 172.21.15.146:0/1733830581 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014017070 con 0x7ff02406e370 2024-04-24T23:07:22.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff020c00640 1 -- 172.21.15.146:0/1733830581 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff014005ce0 con 0x7ff02406e370 2024-04-24T23:07:22.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff020c00640 1 -- 172.21.15.146:0/1733830581 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140072f0 con 0x7ff02406e370 2024-04-24T23:07:22.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02415be90 con 0x7ff02406e370 2024-04-24T23:07:22.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.701+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02415c450 con 0x7ff02406e370 2024-04-24T23:07:22.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.703+0000 7ff020c00640 1 -- 172.21.15.146:0/1733830581 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff01401a070 con 0x7ff02406e370 2024-04-24T23:07:22.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.704+0000 7ff020c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.704+0000 7ff020c00640 1 -- 172.21.15.146:0/1733830581 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7ff01408a2f0 con 0x7ff02406e370 2024-04-24T23:07:22.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.705+0000 7ff01b400640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.705+0000 7ff02e05c740 1 Processor -- start 2024-04-24T23:07:22.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.705+0000 7ff02e05c740 1 -- start start 2024-04-24T23:07:22.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff01b400640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 0x7ff00006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff00c034000 tx=0x7ff00c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560ef001a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 0x560eeffee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560eefeefed0 con 0x560ef0017cd0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560eeff52df0 con 0x560ef001aa70 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.706+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560eefefb8d0 con 0x560ef00180b0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35938/0 (socket says 172.21.15.146:35938) 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 -- 172.21.15.146:0/1799180404 learned_addr learned my addr 172.21.15.146:0/1799180404 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff01b400640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560ef001a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff029200640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 0x560eeffee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 -- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 msgr2=0x560ef001a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560ef001a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 -- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 msgr2=0x560eeffee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 0x560eeffee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 -- 172.21.15.146:0/1799180404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eefc672d0 con 0x560ef0017cd0 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff029200640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 0x560eeffee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.707+0000 7ff023e00640 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff014088720 tx=0x7ff014058560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc97cbddb13656d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff018c00640 1 -- 172.21.15.146:0/1799180404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014056540 con 0x560ef0017cd0 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff018c00640 1 -- 172.21.15.146:0/1799180404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0140567a0 con 0x560ef0017cd0 2024-04-24T23:07:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff018c00640 1 -- 172.21.15.146:0/1799180404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014007490 con 0x560ef0017cd0 2024-04-24T23:07:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff02e05c740 1 -- 172.21.15.146:0/1799180404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 msgr2=0x560eefff0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff014088720 tx=0x7ff014058560 comp rx=0 tx=0).stop 2024-04-24T23:07:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.708+0000 7ff02e05c740 1 -- 172.21.15.146:0/1799180404 shutdown_connections 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef001aa70 0x560eeffee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560ef001a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1799180404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef0017cd0 0x560eefff0330 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 -- 172.21.15.146:0/1799180404 >> 172.21.15.146:0/1799180404 conn(0x560eeffecd30 msgr2=0x560ef0035530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 -- 172.21.15.146:0/1799180404 shutdown_connections 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 -- 172.21.15.146:0/1799180404 wait complete. 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.709+0000 7ff02e05c740 1 -- start start 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.710+0000 7ff02e05c740 1 Processor -- start 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560ef001ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef00167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560eeff0ed20 con 0x560ef001aa70 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560eeff4edb0 con 0x560ef00180b0 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560ef0034ce0 con 0x560ef0007d30 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff02e05c740 10 client.0 _ll_register_callbacks cb 0x560eeff49f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35946/0 (socket says 172.21.15.146:35946) 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 -- 172.21.15.146:0/1159107531 learned_addr learned my addr 172.21.15.146:0/1159107531 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff023e00640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560ef001ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff029200640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef00167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 -- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 msgr2=0x560ef00167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef00167b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 -- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 msgr2=0x560ef001ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560ef001ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.711+0000 7ff01b400640 1 -- 172.21.15.146:0/1159107531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eefd316b0 con 0x560ef001aa70 2024-04-24T23:07:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff01b400640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff00c02a790 tx=0x7ff00c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89191a9179dc7abb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff011600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c04e060 con 0x560ef001aa70 2024-04-24T23:07:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7ff00c03e870 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0140567a0 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.712+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff00c054050 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 10 client.6879 fetch_fsmap learned FSMap version 50 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x560ef001e8a0 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0140567a0 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 50) ==== 3514+0+0 (secure 0 0 0) 0x7ff00c057020 con 0x560ef001aa70 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 10 client.6879 fetch_fsmap finished waiting for FSMap version 50 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 10 client.6879 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 20 client.6879 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef001ca20 0x560ef00343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 4 client.6879 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:07:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.713+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 --> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eeff60330 con 0x560ef001ca20 2024-04-24T23:07:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.714+0000 7ff023e00640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef001ca20 0x560ef00343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.715+0000 7ff023e00640 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef001ca20 0x560ef00343b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b6232ae4a69b62 server_cookie=c1f571e5aa3eb448 in_seq=0 out_seq=0 2024-04-24T23:07:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.715+0000 7ff011600640 10 client.6879 ms_handle_connect on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.716+0000 7ff011600640 1 -- 172.21.15.146:0/1159107531 <== mds.0 v2:172.21.15.203:6835/4094476555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560eeff60330 con 0x560ef001ca20 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.716+0000 7ff011600640 10 client.6879 handle_command_reply: tid=0 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.716+0000 7ff02e05c740 1 client.6879 shutdown 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 msgr2=0x560ef0016270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff00c02a790 tx=0x7ff00c004730 comp rx=0 tx=0).stop 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 shutdown_connections 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef001ca20 0x560ef00343b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef00167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560ef0016270 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 --2- 172.21.15.146:0/1159107531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560ef001ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 >> 172.21.15.146:0/1159107531 conn(0x560ef0017cd0 msgr2=0x560eeffee2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff011600640 0 client.6879 ms_handle_reset on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 shutdown_connections 2024-04-24T23:07:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 1 -- 172.21.15.146:0/1159107531 wait complete. 2024-04-24T23:07:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.717+0000 7ff02e05c740 20 client.6879 trim_cache size 0 max 16384 2024-04-24T23:07:22.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 Processor -- start 2024-04-24T23:07:22.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 -- start start 2024-04-24T23:07:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef002c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0241fc6c0 con 0x560ef001aa70 2024-04-24T23:07:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff024152150 con 0x560ef00180b0 2024-04-24T23:07:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.737+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff0241527a0 con 0x560ef0007d30 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff023e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef002c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35960/0 (socket says 172.21.15.146:35960) 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 -- 172.21.15.146:0/4098974680 learned_addr learned my addr 172.21.15.146:0/4098974680 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff01b400640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 -- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 msgr2=0x560ef002c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef002c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 -- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 msgr2=0x560eeffee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.738+0000 7ff029200640 1 -- 172.21.15.146:0/4098974680 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ef001e4e0 con 0x560ef001aa70 2024-04-24T23:07:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff023e00640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef002c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:07:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff01b400640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff029200640 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009e90 tx=0x7ff01c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d994243ab36019ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff013e00640 1 -- 172.21.15.146:0/4098974680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c01a020 con 0x560ef001aa70 2024-04-24T23:07:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff013e00640 1 -- 172.21.15.146:0/4098974680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c016890 con 0x560ef001aa70 2024-04-24T23:07:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.739+0000 7ff013e00640 1 -- 172.21.15.146:0/4098974680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c016c80 con 0x560ef001aa70 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 -- 172.21.15.146:0/4098974680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 msgr2=0x560eeffee810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009e90 tx=0x7ff01c007700 comp rx=0 tx=0).stop 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 -- 172.21.15.146:0/4098974680 shutdown_connections 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 --2- 172.21.15.146:0/4098974680 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef0007d30 0x560ef002c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 -- 172.21.15.146:0/4098974680 >> 172.21.15.146:0/4098974680 conn(0x560ef0017cd0 msgr2=0x560ef001b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 -- 172.21.15.146:0/4098974680 shutdown_connections 2024-04-24T23:07:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.740+0000 7ff02e05c740 1 -- 172.21.15.146:0/4098974680 wait complete. 2024-04-24T23:07:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.741+0000 7ff02e05c740 1 -- start start 2024-04-24T23:07:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.741+0000 7ff02e05c740 1 Processor -- start 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef0007d30 0x560ef00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560ef001c8a0 con 0x560ef001aa70 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560ef0034a80 con 0x560ef0007d30 2024-04-24T23:07:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560ef001cef0 con 0x560ef00180b0 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff02e05c740 10 client.0 _ll_register_callbacks cb 0x7ff00c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.742+0000 7ff029200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35976/0 (socket says 172.21.15.146:35976) 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 -- 172.21.15.146:0/894648967 learned_addr learned my addr 172.21.15.146:0/894648967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 -- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 msgr2=0x560eeffee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff023e00640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef0007d30 0x560ef00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 -- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef0007d30 msgr2=0x560ef00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef0007d30 0x560ef00b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 -- 172.21.15.146:0/894648967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ef001b220 con 0x560ef001aa70 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff029200640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x560eeffedbe0 tx=0x7ff01c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbee0c2d231718a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.743+0000 7ff011600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c009a60 con 0x560ef001aa70 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7ff01c003990 con 0x560ef001aa70 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff01c016890 con 0x560ef001aa70 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff01c032050 con 0x560ef001aa70 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 10 client.6885 fetch_fsmap learned FSMap version 50 2024-04-24T23:07:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x560ef0007680 con 0x560ef001aa70 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c016890 con 0x560ef001aa70 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 50) ==== 3514+0+0 (secure 0 0 0) 0x7ff01c035020 con 0x560ef001aa70 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 10 client.6885 fetch_fsmap finished waiting for FSMap version 50 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 10 client.6885 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 20 client.6885 populate_metadata read hostname 'smithi146' 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef004c6f0 0x560ef00b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 4 client.6885 mds_command: new command op to 6666 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.744+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 --> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] -- command(tid 0: {"prefix": "status"}) -- 0x560eeff5a680 con 0x560ef004c6f0 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.745+0000 7ff023e00640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef004c6f0 0x560ef00b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.746+0000 7ff023e00640 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef004c6f0 0x560ef00b68c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81f8af8053b38bdc server_cookie=c2c70604a59f6315 in_seq=0 out_seq=0 2024-04-24T23:07:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.746+0000 7ff011600640 10 client.6885 ms_handle_connect on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff011600640 1 -- 172.21.15.146:0/894648967 <== mds.0 v2:172.21.15.203:6835/4094476555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x560eeff5a680 con 0x560ef004c6f0 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff011600640 10 client.6885 handle_command_reply: tid=0 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 client.6885 shutdown 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 msgr2=0x560eeffee810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x560eeffedbe0 tx=0x7ff01c004ab0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 shutdown_connections 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:6835/4094476555,v1:172.21.15.203:6837/4094476555] conn(0x560ef004c6f0 0x560ef00b68c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ef001aa70 0x560eeffee810 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560ef00180b0 0x560eeffee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 --2- 172.21.15.146:0/894648967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ef0007d30 0x560ef00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff011600640 0 client.6885 ms_handle_reset on v2:172.21.15.203:6835/4094476555 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 >> 172.21.15.146:0/894648967 conn(0x560ef0017cd0 msgr2=0x560ef002d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 shutdown_connections 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 1 -- 172.21.15.146:0/894648967 wait complete. 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.747+0000 7ff02e05c740 20 client.6885 trim_cache size 0 max 16384 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6666, 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:07:22.752 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 13.383614396, 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 50, 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 68, 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 68, 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 18.845159267 2024-04-24T23:07:22.753 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 msgr2=0x7ff00006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 0x7ff00006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff00c034000 tx=0x7ff00c02e000 comp rx=0 tx=0).stop 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 msgr2=0x7ff02414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c3c0 tx=0x7ff01400c880 comp rx=0 tx=0).stop 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 shutdown_connections 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff02415ae50 0x7ff02415d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff0240b3020 0x7ff02415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 --2- 172.21.15.146:0/1733830581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff02406e370 0x7ff02414ef20 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 >> 172.21.15.146:0/1733830581 conn(0x7ff0240b1560 msgr2=0x7ff0240ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 shutdown_connections 2024-04-24T23:07:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.748+0000 7ff029c00640 1 -- 172.21.15.146:0/1733830581 wait complete. 2024-04-24T23:07:22.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable false 2024-04-24T23:07:22.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.963+0000 7fe8a4400640 1 Processor -- start 2024-04-24T23:07:22.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.963+0000 7fe8a4400640 1 -- start start 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a4400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe89c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a4400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c15e3f0 con 0x7fe89c071520 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a4400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c06cd20 con 0x7fe89c06ed30 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a4400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe89c15f440 con 0x7fe89c15e010 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a1000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe89c071520 0x7fe89c06e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43460/0 (socket says 172.21.15.146:43460) 2024-04-24T23:07:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a1000640 1 -- 172.21.15.146:0/320296273 learned_addr learned my addr 172.21.15.146:0/320296273 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:22.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.965+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe89c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748292208 0 0) 0x7fe89c15e3f0 con 0x7fe89c071520 2024-04-24T23:07:22.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe884003520 con 0x7fe89c071520 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1675122326 0 0) 0x7fe884003520 con 0x7fe89c071520 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 msgr2=0x7fe89c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe89c06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 >> v1:172.21.15.203:6789/0 conn(0x7fe89c06ed30 legacy=0x7fe89c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c071fe0 con 0x7fe89c071520 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe88c001670 con 0x7fe89c071520 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 >> v1:172.21.15.146:6789/0 conn(0x7fe89c071520 legacy=0x7fe89c06e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8840039e0 0x7fe884003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe884004390 0x7fe884004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe8840050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c15f440 con 0x7fe8840039e0 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe88400b9c0 con 0x7fe884004390 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.966+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe88400bbc0 con 0x7fe89c15e010 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8840039e0 0x7fe884003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a2400640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe8840050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 -- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 msgr2=0x7fe8840050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe8840050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 -- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe884004390 msgr2=0x7fe884004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe884004390 0x7fe884004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a1a00640 1 -- 172.21.15.146:0/320296273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe884003520 con 0x7fe8840039e0 2024-04-24T23:07:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.967+0000 7fe8a2400640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe89c15e010 0x7fe8840050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.968+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8840039e0 0x7fe884003dc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ac0 tx=0x7fe884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a54e44b8d90886 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.968+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890036070 con 0x7fe8840039e0 2024-04-24T23:07:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.968+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe890031400 con 0x7fe8840039e0 2024-04-24T23:07:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.968+0000 7fe89be00640 1 -- 172.21.15.146:0/320296273 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890009690 con 0x7fe8840039e0 2024-04-24T23:07:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 -- 172.21.15.146:0/320296273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8840039e0 msgr2=0x7fe884003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 --2- 172.21.15.146:0/320296273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8840039e0 0x7fe884003dc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ac0 tx=0x7fe884005830 comp rx=0 tx=0).stop 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a2400640 1 -- 172.21.15.146:0/320296273 reap_dead start 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 -- 172.21.15.146:0/320296273 shutdown_connections 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 -- 172.21.15.146:0/320296273 >> 172.21.15.146:0/320296273 conn(0x7fe89c0b17b0 msgr2=0x7fe89c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 -- 172.21.15.146:0/320296273 shutdown_connections 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.969+0000 7fe8a4400640 1 -- 172.21.15.146:0/320296273 wait complete. 2024-04-24T23:07:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.971+0000 7fe8a4400640 1 Processor -- start 2024-04-24T23:07:22.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.971+0000 7fe8a4400640 1 -- start start 2024-04-24T23:07:22.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8840039e0 0x7fe89c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe89c14b290 0x7fe89c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c06d580 con 0x7fe89c1f79d0 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c06d2a0 con 0x7fe89c14b290 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a4400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe89c06d860 con 0x7fe8840039e0 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.972+0000 7fe8a2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35990/0 (socket says 172.21.15.146:35990) 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 -- 172.21.15.146:0/3774385960 learned_addr learned my addr 172.21.15.146:0/3774385960 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8840039e0 0x7fe89c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a1000640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe89c14b290 0x7fe89c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 -- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8840039e0 msgr2=0x7fe89c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8840039e0 0x7fe89c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 -- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe89c14b290 msgr2=0x7fe89c144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe89c14b290 0x7fe89c144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 -- 172.21.15.146:0/3774385960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c14b710 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.973+0000 7fe8a2400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0707a0 tx=0x7fe89400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.974+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894018070 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.974+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe894003da0 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.974+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8940052b0 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.974+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c158e80 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.974+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c1f74b0 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.975+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89c0b1560 con 0x7fe89c1f79d0 2024-04-24T23:07:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.976+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe89401b070 con 0x7fe89c1f79d0 2024-04-24T23:07:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.977+0000 7fe899600640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 0x7fe88006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.977+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fe89408a6c0 con 0x7fe89c1f79d0 2024-04-24T23:07:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.977+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 0x7fe88006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:22.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.978+0000 7fe8a1a00640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 0x7fe88006e320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ac0 tx=0x7fe890008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:22.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:22.981+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe89c0b1560 con 0x7fe89c1f79d0 2024-04-24T23:07:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.217+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"} v 0) -- 0x7fe89c1f76b0 con 0x7fe89c1f79d0 2024-04-24T23:07:23.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.453+0000 7fe899600640 1 -- 172.21.15.146:0/3774385960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"}]=0 cephfs marked not joinable; MDS cannot join as newly active. v51) ==== 170+0+0 (secure 0 0 0) 0x7fe89c1f76b0 con 0x7fe89c1f79d0 2024-04-24T23:07:23.455 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join as newly active. 2024-04-24T23:07:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 msgr2=0x7fe88006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 0x7fe88006e320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ac0 tx=0x7fe890008030 comp rx=0 tx=0).stop 2024-04-24T23:07:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 msgr2=0x7fe89c15c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0707a0 tx=0x7fe89400dc00 comp rx=0 tx=0).stop 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 shutdown_connections 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe89c1f79d0 0x7fe89c15c7e0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe89c14b290 0x7fe89c144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe88006be60 0x7fe88006e320 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 --2- 172.21.15.146:0/3774385960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8840039e0 0x7fe89c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.457+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 >> 172.21.15.146:0/3774385960 conn(0x7fe89c0b17b0 msgr2=0x7fe89c0add60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:23.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.458+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 shutdown_connections 2024-04-24T23:07:23.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23.458+0000 7fe8a4400640 1 -- 172.21.15.146:0/3774385960 wait complete. 2024-04-24T23:07:23.481 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir {alpha,bravo} && touch {alpha,bravo}/file') 2024-04-24T23:07:23.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:07:23.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:07:23.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:23.638 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 alpha/) 2024-04-24T23:07:23.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:23.696 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 bravo/) 2024-04-24T23:07:23.752 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-04-24T23:07:23.979 INFO:teuthology.orchestra.run.smithi203.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-24T23:07:23.980 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-24T23:07:23.980 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-04-24T23:07:25.981 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-04-24T23:07:26.211 INFO:teuthology.orchestra.run.smithi203.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-24T23:07:26.212 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-24T23:07:26.212 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-04-24T23:07:28.213 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-04-24T23:07:28.440 INFO:teuthology.orchestra.run.smithi203.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-24T23:07:28.440 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-24T23:07:28.440 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-04-24T23:07:30.442 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-04-24T23:07:30.672 INFO:teuthology.orchestra.run.smithi203.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"14","version":"14","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/bravo","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-04-24T23:07:30.673 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/bravo", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-24T23:07:30.673 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0), ('/bravo', 1)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-04-24T23:07:30.673 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:07:30.673 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/alpha/file" 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-04-24T23:07:30.732 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2024-04-24T23:07:30.733 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-24T23:07:30.734 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:30.734 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-04-24T23:07:30.734 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-04-24T23:07:30.734 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-04-24T23:07:30.734 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:07:33.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:07:33.989 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:07:33.990 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-04-24T23:07:34.135 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/bravo/file" 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-04-24T23:07:34.136 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-04-24T23:07:34.137 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-04-24T23:07:39.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:07:39.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.522+0000 7f720f000640 1 Processor -- start 2024-04-24T23:07:39.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.523+0000 7f720f000640 1 -- start start 2024-04-24T23:07:39.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f7208162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720f000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f72080715f0 0x7f7208071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720f000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7208162990 con 0x7f72080cfc90 2024-04-24T23:07:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720f000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7208158970 con 0x7f72080715f0 2024-04-24T23:07:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7208070c10 con 0x7f7208158590 2024-04-24T23:07:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.524+0000 7f720d000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f72080cfc90 0x7f720815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44038/0 (socket says 172.21.15.146:44038) 2024-04-24T23:07:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f720d000640 1 -- 172.21.15.146:0/3651805081 learned_addr learned my addr 172.21.15.146:0/3651805081 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f71ff400640 1 --2- 172.21.15.146:0/3651805081 >> v2:172.21.15.203:3300/0 conn(0x7f72080715f0 0x7f7208071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207e00640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f7208162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412520249 0 0) 0x7f7200001490 con 0x7f72080cfc90 2024-04-24T23:07:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ec003520 con 0x7f72080cfc90 2024-04-24T23:07:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2732587309 0 0) 0x7f71ec003520 con 0x7f72080cfc90 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 msgr2=0x7f7208162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f7208162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 >> v2:172.21.15.203:3300/0 conn(0x7f72080715f0 msgr2=0x7f7208071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 --2- 172.21.15.146:0/3651805081 >> v2:172.21.15.203:3300/0 conn(0x7f72080715f0 0x7f7208071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7208070ef0 con 0x7f72080cfc90 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7200001bc0 con 0x7f72080cfc90 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.525+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 >> v1:172.21.15.146:6789/0 conn(0x7f72080cfc90 legacy=0x7f720815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71ec0039b0 0x7f71ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f71ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec004d40 0x7f71ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7208158970 con 0x7f71ec004d40 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7208070c10 con 0x7f71ec0039b0 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f71ec00b9c0 con 0x7f7208158590 2024-04-24T23:07:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec004d40 0x7f71ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f7207e00640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71ec0039b0 0x7f71ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f71ff400640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f71ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 -- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 msgr2=0x7f71ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7208158590 0x7f71ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 -- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71ec0039b0 msgr2=0x7f71ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71ec0039b0 0x7f71ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.526+0000 7f720d000640 1 -- 172.21.15.146:0/3651805081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec003520 con 0x7f71ec004d40 2024-04-24T23:07:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.527+0000 7f720d000640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec004d40 0x7f71ec0051c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f720000aa60 tx=0x7f71ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9eca704f7e3360f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720000a6b0 con 0x7f71ec004d40 2024-04-24T23:07:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720002f070 con 0x7f71ec004d40 2024-04-24T23:07:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f7207400640 1 -- 172.21.15.146:0/3651805081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200034470 con 0x7f71ec004d40 2024-04-24T23:07:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f720f000640 1 -- 172.21.15.146:0/3651805081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec004d40 msgr2=0x7f71ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f720f000640 1 --2- 172.21.15.146:0/3651805081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec004d40 0x7f71ec0051c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f720000aa60 tx=0x7f71ec005830 comp rx=0 tx=0).stop 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f720d000640 1 -- 172.21.15.146:0/3651805081 reap_dead start 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f720f000640 1 -- 172.21.15.146:0/3651805081 shutdown_connections 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.528+0000 7f720f000640 1 -- 172.21.15.146:0/3651805081 >> 172.21.15.146:0/3651805081 conn(0x7f720806b320 msgr2=0x7f720806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.529+0000 7f720f000640 1 -- 172.21.15.146:0/3651805081 shutdown_connections 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.529+0000 7f720f000640 1 -- 172.21.15.146:0/3651805081 wait complete. 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.530+0000 7f720f000640 1 Processor -- start 2024-04-24T23:07:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.530+0000 7f720f000640 1 -- start start 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71ec004d40 0x7f720815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72080b1d20 0x7f72080b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7208161f30 con 0x7f720815c050 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7208161c50 con 0x7f72080b1d20 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.531+0000 7f720f000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7208162450 con 0x7f71ec004d40 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44404/0 (socket says 172.21.15.146:44404) 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 -- 172.21.15.146:0/3340729608 learned_addr learned my addr 172.21.15.146:0/3340729608 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f7207e00640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71ec004d40 0x7f720815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 -- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71ec004d40 msgr2=0x7f720815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71ec004d40 0x7f720815ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 -- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72080b1d20 msgr2=0x7f72080b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72080b1d20 0x7f72080b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.532+0000 7f720d000640 1 -- 172.21.15.146:0/3340729608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720815dec0 con 0x7f720815c050 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f720d000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7200007040 tx=0x7f7200001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200043070 con 0x7f720815c050 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7200004d60 con 0x7f720815c050 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720813ef80 con 0x7f720815c050 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200039070 con 0x7f720815c050 2024-04-24T23:07:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.533+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720815e440 con 0x7f720815c050 2024-04-24T23:07:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.534+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7208068190 con 0x7f720815c050 2024-04-24T23:07:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.535+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7200034670 con 0x7f720815c050 2024-04-24T23:07:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.536+0000 7f7204c00640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.536+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6304+0+0 (secure 0 0 0) 0x7f72000aac70 con 0x7f720815c050 2024-04-24T23:07:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.537+0000 7f7207e00640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:39.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.538+0000 7f7207e00640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 0x7f71e406e320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009a10 tx=0x7f71f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:39.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.541+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7208162990 con 0x7f720815c050 2024-04-24T23:07:39.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.779+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7208157810 con 0x7f720815c050 2024-04-24T23:07:39.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.781+0000 7f7204c00640 1 -- 172.21.15.146:0/3340729608 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5212 (secure 0 0 0) 0x7f72000792c0 con 0x7f720815c050 2024-04-24T23:07:39.783 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:39.783 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":52,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:28.908168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666,"mds_1":6660},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6660":{"gid":6660,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6660,6666]},"id":4}]} 2024-04-24T23:07:39.783 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 52 2024-04-24T23:07:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 msgr2=0x7f71e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 0x7f71e406e320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009a10 tx=0x7f71f8008040 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 msgr2=0x7f720815c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7200007040 tx=0x7f7200001360 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 shutdown_connections 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720815c050 0x7f720815c4d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72080b1d20 0x7f72080b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 --2- 172.21.15.146:0/3340729608 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71ec004d40 0x7f720815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.783+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 >> 172.21.15.146:0/3340729608 conn(0x7f720806b320 msgr2=0x7f720815f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.784+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 shutdown_connections 2024-04-24T23:07:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:39.784+0000 7f720f000640 1 -- 172.21.15.146:0/3340729608 wait complete. 2024-04-24T23:07:39.805 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-24T23:07:40.247 INFO:teuthology.orchestra.run.smithi203.stdout:{"message":"","return_code":0} 2024-04-24T23:07:40.247 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-24T23:07:40.247 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:07:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.419+0000 7fcaaa800640 1 Processor -- start 2024-04-24T23:07:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.419+0000 7fcaaa800640 1 -- start start 2024-04-24T23:07:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaaa800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaa40d03a0 0x7fcaa4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaaa800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa4158970 con 0x7fcaa40715f0 2024-04-24T23:07:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaaa800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa4070c10 con 0x7fcaa4158590 2024-04-24T23:07:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaaa800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa4070ef0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fca9aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcaa40715f0 0x7fcaa40cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44042/0 (socket says 172.21.15.146:44042) 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fca9aa00640 1 -- 172.21.15.146:0/2848049017 learned_addr learned my addr 172.21.15.146:0/2848049017 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaa3e00640 1 --2- 172.21.15.146:0/2848049017 >> v2:172.21.15.146:3300/0 conn(0x7fcaa40d03a0 0x7fcaa4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.421+0000 7fcaa2a00640 1 -- 172.21.15.146:0/2848049017 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338481507 0 0) 0x7fcaa4158970 con 0x7fcaa40715f0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.422+0000 7fcaa2a00640 1 -- 172.21.15.146:0/2848049017 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca88003520 con 0x7fcaa40715f0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.422+0000 7fcaa3e00640 1 -- 172.21.15.146:0/2848049017 >> v1:172.21.15.203:6789/0 conn(0x7fcaa4158590 legacy=0x7fcaa4162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.422+0000 7fcaa3e00640 1 -- 172.21.15.146:0/2848049017 >> v1:172.21.15.146:6789/0 conn(0x7fcaa40715f0 legacy=0x7fcaa40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.422+0000 7fcaa3e00640 1 -- 172.21.15.146:0/2848049017 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa40711d0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.423+0000 7fcaa3e00640 1 --2- 172.21.15.146:0/2848049017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa4071a70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009d90 tx=0x7fca9c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9542320e06711a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.423+0000 7fcaa2a00640 1 -- 172.21.15.146:0/2848049017 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c037070 con 0x7fcaa40d03a0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.423+0000 7fcaa2a00640 1 -- 172.21.15.146:0/2848049017 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c007740 con 0x7fcaa40d03a0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.423+0000 7fcaa2a00640 1 -- 172.21.15.146:0/2848049017 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007b10 con 0x7fcaa40d03a0 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 -- 172.21.15.146:0/2848049017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 msgr2=0x7fcaa4071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 --2- 172.21.15.146:0/2848049017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa4071a70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009d90 tx=0x7fca9c02a780 comp rx=0 tx=0).stop 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 -- 172.21.15.146:0/2848049017 shutdown_connections 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 --2- 172.21.15.146:0/2848049017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa4071a70 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 -- 172.21.15.146:0/2848049017 >> 172.21.15.146:0/2848049017 conn(0x7fcaa406b320 msgr2=0x7fcaa406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 -- 172.21.15.146:0/2848049017 shutdown_connections 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.424+0000 7fcaaa800640 1 -- 172.21.15.146:0/2848049017 wait complete. 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.425+0000 7fcaaa800640 1 Processor -- start 2024-04-24T23:07:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.426+0000 7fcaaa800640 1 -- start start 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.426+0000 7fcaaa800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 0x7fcaa4151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaaa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaaa800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaa4158590 0x7fcaa40b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaaa800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa415e4e0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaaa800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4161f30 con 0x7fcaa40715f0 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaaa800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa415e660 con 0x7fcaa4158590 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44414/0 (socket says 172.21.15.146:44414) 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 -- 172.21.15.146:0/1826900204 learned_addr learned my addr 172.21.15.146:0/1826900204 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaa3400640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 0x7fcaa4151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 -- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaa4158590 msgr2=0x7fcaa40b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaa4158590 0x7fcaa40b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 -- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 msgr2=0x7fcaa4151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 0x7fcaa4151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fca9aa00640 1 -- 172.21.15.146:0/1826900204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4158df0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.427+0000 7fcaa3400640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 0x7fcaa4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fca9aa00640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c500 tx=0x7fca8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c017070 con 0x7fcaa40d03a0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c005ce0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c007330 con 0x7fcaa40d03a0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa41590d0 con 0x7fcaa40d03a0 2024-04-24T23:07:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.428+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa4152420 con 0x7fcaa40d03a0 2024-04-24T23:07:40.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.429+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4068190 con 0x7fcaa40d03a0 2024-04-24T23:07:40.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.430+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca8c01a070 con 0x7fcaa40d03a0 2024-04-24T23:07:40.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.431+0000 7fca9be00640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:40.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.431+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6304+0+0 (secure 0 0 0) 0x7fca8c08a550 con 0x7fcaa40d03a0 2024-04-24T23:07:40.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.432+0000 7fcaa3400640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:40.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.433+0000 7fcaa3400640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 0x7fca8006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca94000f60 tx=0x7fca94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:40.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.436+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fca8c058d80 con 0x7fcaa40d03a0 2024-04-24T23:07:40.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.674+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa4071c80 con 0x7fcaa40d03a0 2024-04-24T23:07:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.675+0000 7fca9be00640 1 -- 172.21.15.146:0/1826900204 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5212 (secure 0 0 0) 0x7fca8c058680 con 0x7fcaa40d03a0 2024-04-24T23:07:40.677 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:40.677 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":52,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:07:28.908168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666,"mds_1":6660},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6660":{"gid":6660,"name":"c","rank":1,"incarnation":49,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6834/896278918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":896278918},{"type":"v1","addr":"172.21.15.146:6834","nonce":896278918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6660,6666]},"id":4}]} 2024-04-24T23:07:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 52 2024-04-24T23:07:40.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 msgr2=0x7fca8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 0x7fca8006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca94000f60 tx=0x7fca94009040 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 msgr2=0x7fcaa40af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c500 tx=0x7fca8c00c9c0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 shutdown_connections 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaa4158590 0x7fcaa40b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa40d03a0 0x7fcaa40af690 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 --2- 172.21.15.146:0/1826900204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaa40715f0 0x7fcaa4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 >> 172.21.15.146:0/1826900204 conn(0x7fcaa406b320 msgr2=0x7fcaa40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 shutdown_connections 2024-04-24T23:07:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:40.678+0000 7fcaaa800640 1 -- 172.21.15.146:0/1826900204 wait complete. 2024-04-24T23:07:40.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-24T23:07:41.161 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-04-24T23:07:41.162 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-24T23:07:41.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 4:1 2024-04-24T23:07:41.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.323+0000 7faaac000640 1 Processor -- start 2024-04-24T23:07:41.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.323+0000 7faaac000640 1 -- start start 2024-04-24T23:07:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 0x7faaa40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa40b5590 0x7faaa40d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa40d2a90 0x7faaa40d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faaa40d2f00 con 0x7faaa40d2a90 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7faaa40b6dc0 con 0x7faaa41619c0 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.324+0000 7faaac000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faaa40cf7a0 con 0x7faaa40b5590 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa40d2a90 0x7faaa40d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa40d2a90 0x7faaa40d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44416/0 (socket says 172.21.15.146:44416) 2024-04-24T23:07:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 -- 172.21.15.146:0/4056854547 learned_addr learned my addr 172.21.15.146:0/4056854547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaa9600640 1 --2- 172.21.15.146:0/4056854547 >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 0x7faaa40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaa8c00640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa40b5590 0x7faaa40d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 -- 172.21.15.146:0/4056854547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa40b5590 msgr2=0x7faaa40d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa40b5590 0x7faaa40d2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 -- 172.21.15.146:0/4056854547 >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 msgr2=0x7faaa40b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 --2- 172.21.15.146:0/4056854547 >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 0x7faaa40b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaaa000640 1 -- 172.21.15.146:0/4056854547 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa40cfa40 con 0x7faaa40d2a90 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.325+0000 7faaa9600640 1 --2- 172.21.15.146:0/4056854547 >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 0x7faaa40b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.326+0000 7faaaa000640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40d0630 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7faaa40732d0 tx=0x7faa9c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b83d3898996b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.326+0000 7faaa3e00640 1 -- 172.21.15.146:0/4056854547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c036070 con 0x7faaa40d2a90 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.326+0000 7faaa3e00640 1 -- 172.21.15.146:0/4056854547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c031600 con 0x7faaa40d2a90 2024-04-24T23:07:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.326+0000 7faaa3e00640 1 -- 172.21.15.146:0/4056854547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0319d0 con 0x7faaa40d2a90 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 -- 172.21.15.146:0/4056854547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 msgr2=0x7faaa40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40d0630 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7faaa40732d0 tx=0x7faa9c02a570 comp rx=0 tx=0).stop 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 -- 172.21.15.146:0/4056854547 shutdown_connections 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40d0630 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 --2- 172.21.15.146:0/4056854547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa40b5590 0x7faaa40d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 --2- 172.21.15.146:0/4056854547 >> v2:172.21.15.203:3300/0 conn(0x7faaa41619c0 0x7faaa40b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 -- 172.21.15.146:0/4056854547 >> 172.21.15.146:0/4056854547 conn(0x7faaa40d3f70 msgr2=0x7faaa40d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 -- 172.21.15.146:0/4056854547 shutdown_connections 2024-04-24T23:07:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.327+0000 7faaac000640 1 -- 172.21.15.146:0/4056854547 wait complete. 2024-04-24T23:07:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.329+0000 7faaac000640 1 Processor -- start 2024-04-24T23:07:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.329+0000 7faaac000640 1 -- start start 2024-04-24T23:07:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 0x7faaa40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa41619c0 0x7faaa40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faaa40d1f70 con 0x7faaa40d2a90 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faaa40b7010 con 0x7faaa40b5590 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaac000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faaa4161da0 con 0x7faaa41619c0 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.330+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44426/0 (socket says 172.21.15.146:44426) 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 -- 172.21.15.146:0/1707428427 learned_addr learned my addr 172.21.15.146:0/1707428427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaaa000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa41619c0 0x7faaa40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa9600640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 0x7faaa40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 -- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa41619c0 msgr2=0x7faaa40c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa41619c0 0x7faaa40c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 -- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 msgr2=0x7faaa40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 0x7faaa40cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 -- 172.21.15.146:0/1707428427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa40c8f40 con 0x7faaa40d2a90 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa9600640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 0x7faaa40cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa8c00640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c5a0 tx=0x7faa9000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90015070 con 0x7faaa40d2a90 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90004220 con 0x7faaa40d2a90 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.331+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa40c91e0 con 0x7faaa40d2a90 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.332+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90003610 con 0x7faaa40d2a90 2024-04-24T23:07:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.332+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa40c97a0 con 0x7faaa40d2a90 2024-04-24T23:07:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.333+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa404f5a0 con 0x7faaa40d2a90 2024-04-24T23:07:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.334+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa900037b0 con 0x7faaa40d2a90 2024-04-24T23:07:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.334+0000 7faaa1600640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 0x7faa8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.335+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6304+0+0 (secure 0 0 0) 0x7faa9008aeb0 con 0x7faaa40d2a90 2024-04-24T23:07:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.335+0000 7faaa9600640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 0x7faa8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.336+0000 7faaa9600640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 0x7faa8406e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa98006fd0 tx=0x7faa98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.339+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa90059590 con 0x7faaa40d2a90 2024-04-24T23:07:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.600+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "4:1"} v 0) -- 0x7faaa4160fc0 con 0x7faaa40d2a90 2024-04-24T23:07:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.605+0000 7faaa1600640 1 -- 172.21.15.146:0/1707428427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "4:1"}]=0 failed mds gid 6660 v53) ==== 97+0+0 (secure 0 0 0) 0x7faa90058e90 con 0x7faaa40d2a90 2024-04-24T23:07:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6660 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 msgr2=0x7faa8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 0x7faa8406e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa98006fd0 tx=0x7faa98008040 comp rx=0 tx=0).stop 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 msgr2=0x7faaa40cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c5a0 tx=0x7faa9000ca60 comp rx=0 tx=0).stop 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 shutdown_connections 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faa8406be60 0x7faa8406e320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.608+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaa41619c0 0x7faaa40c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.609+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa40d2a90 0x7faaa40cd340 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.609+0000 7faaac000640 1 --2- 172.21.15.146:0/1707428427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaa40b5590 0x7faaa40cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.609+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 >> 172.21.15.146:0/1707428427 conn(0x7faaa40d3f70 msgr2=0x7faaa40b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.609+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 shutdown_connections 2024-04-24T23:07:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.609+0000 7faaac000640 1 -- 172.21.15.146:0/1707428427 wait complete. 2024-04-24T23:07:41.630 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-04-24T23:07:41.715 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:07:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.715+0000 7f9469521f40 1 Processor -- start 2024-04-24T23:07:41.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.716+0000 7f9469521f40 1 -- start start 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a50f61d0 0x55d8a5177240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a5180790 0x55d8a5177eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d8a504f640 con 0x55d8a5179980 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d8a50a9660 con 0x55d8a50f61d0 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9469521f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d8a5172950 con 0x55d8a5180790 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9465e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9465e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44446/0 (socket says 172.21.15.146:44446) 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.717+0000 7f9465e00640 1 -- 172.21.15.146:0/2921965148 learned_addr learned my addr 172.21.15.146:0/2921965148 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 -- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a5180790 msgr2=0x55d8a5177eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a5180790 0x55d8a5177eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 -- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a50f61d0 msgr2=0x55d8a5177240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a50f61d0 0x55d8a5177240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 -- 172.21.15.146:0/2921965148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a4fd4b30 con 0x55d8a5179980 2024-04-24T23:07:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9465e00640 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f945400a460 tx=0x7f945400a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d086d86d4a7c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9464a00640 1 -- 172.21.15.146:0/2921965148 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400b920 con 0x55d8a5179980 2024-04-24T23:07:41.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9464a00640 1 -- 172.21.15.146:0/2921965148 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f945400f070 con 0x55d8a5179980 2024-04-24T23:07:41.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.718+0000 7f9464a00640 1 -- 172.21.15.146:0/2921965148 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400bd20 con 0x55d8a5179980 2024-04-24T23:07:41.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 -- 172.21.15.146:0/2921965148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 msgr2=0x55d8a5181e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f945400a460 tx=0x7f945400a920 comp rx=0 tx=0).stop 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 -- 172.21.15.146:0/2921965148 shutdown_connections 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a5180790 0x55d8a5177eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5181e00 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 --2- 172.21.15.146:0/2921965148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a50f61d0 0x55d8a5177240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 -- 172.21.15.146:0/2921965148 >> 172.21.15.146:0/2921965148 conn(0x55d8a50961f0 msgr2=0x55d8a50f21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 -- 172.21.15.146:0/2921965148 shutdown_connections 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.719+0000 7f9469521f40 1 -- 172.21.15.146:0/2921965148 wait complete. 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.720+0000 7f9469521f40 1 Processor -- start 2024-04-24T23:07:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.720+0000 7f9469521f40 1 -- start start 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a50f61d0 0x55d8a51780a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5219cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a5180790 0x55d8a521a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d8a516f110 con 0x55d8a5179980 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d8a5172bb0 con 0x55d8a5180790 2024-04-24T23:07:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.721+0000 7f9469521f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d8a516f540 con 0x55d8a50f61d0 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5219cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5219cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44464/0 (socket says 172.21.15.146:44464) 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 learned_addr learned my addr 172.21.15.146:0/830921135 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a50f61d0 0x55d8a51780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a5180790 0x55d8a521a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a50f61d0 msgr2=0x55d8a51780a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d8a50f61d0 0x55d8a51780a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a5180790 msgr2=0x55d8a521a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a5180790 0x55d8a521a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a516e0b0 con 0x55d8a5179980 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d8a5180790 0x55d8a521a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.722+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5219cf0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x55d8a5176610 tx=0x7f9454002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.723+0000 7f945f400640 1 -- 172.21.15.146:0/830921135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400ce60 con 0x55d8a5179980 2024-04-24T23:07:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.723+0000 7f945f400640 1 -- 172.21.15.146:0/830921135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9454024070 con 0x55d8a5179980 2024-04-24T23:07:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.723+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8a5175660 con 0x55d8a5179980 2024-04-24T23:07:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.723+0000 7f945f400640 1 -- 172.21.15.146:0/830921135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454014ae0 con 0x55d8a5179980 2024-04-24T23:07:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.723+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a517f2b0 con 0x55d8a5179980 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.725+0000 7f945f400640 1 -- 172.21.15.146:0/830921135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9454014c80 con 0x55d8a5179980 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.725+0000 7f945f400640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f944806a810 0x7f944806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.726+0000 7f945f400640 1 -- 172.21.15.146:0/830921135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f945408b620 con 0x55d8a5179980 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.726+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d8a516ea90 0x55d8a520eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.726+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.726+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f944806a810 0x7f944806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.727+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d8a516ea90 0x55d8a520eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.727+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f944806a810 0x7f944806ccd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94580030a0 tx=0x7f94580059a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.728+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d8a516ea90 0x55d8a520eaa0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.734+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 [pgnls start_epoch 71 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94600519e0 con 0x55d8a516ea90 2024-04-24T23:07:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.734+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f946005a040 0x7f946005a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.734+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:2 9.10 9:08000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946005a040 2024-04-24T23:07:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.734+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f946005a040 0x7f946005a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.735+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f946005a040 0x7f946005a420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.735+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(2 [pgnls start_epoch 71 out=201b] v70'12 uv12 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f9458014070 con 0x7f946005a040 2024-04-24T23:07:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.735+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 9.8 9:10000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.736+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 [pgnls start_epoch 71 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f94600519e0 con 0x55d8a516ea90 2024-04-24T23:07:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.736+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f94600503e0 0x7f9460050840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.736+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 9.18 9:18000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.736+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f94600503e0 0x7f9460050840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.737+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f94600503e0 0x7f9460050840 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.739+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 [pgnls start_epoch 71 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.739+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9454059930 0x7f9454058590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.739+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:5 9.4 9:20000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9454059930 2024-04-24T23:07:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.740+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9454059930 0x7f9454058590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.741+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9454059930 0x7f9454058590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.748+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(5 [pgnls start_epoch 71 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9460068040 con 0x7f9454059930 2024-04-24T23:07:41.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.748+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.14 9:28000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.749+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(6 [pgnls start_epoch 71 out=149b] v70'24 uv24 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.749+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9454059930 2024-04-24T23:07:41.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.750+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 [pgnls start_epoch 71 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9460068040 con 0x7f9454059930 2024-04-24T23:07:41.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.750+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1c 9:38000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.751+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(8 [pgnls start_epoch 71 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.751+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f946006b3c0 0x7f946006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.751+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.2 9:40000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946006b3c0 2024-04-24T23:07:41.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.752+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f946006b3c0 0x7f946006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.753+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f946006b3c0 0x7f946006b820 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 [pgnls start_epoch 71 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9458023040 con 0x7f946006b3c0 2024-04-24T23:07:41.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:10 9.12 9:48000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946005a040 2024-04-24T23:07:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(10 [pgnls start_epoch 71 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9458023040 con 0x7f946005a040 2024-04-24T23:07:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:11 9.a 9:50000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946005a040 2024-04-24T23:07:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(11 [pgnls start_epoch 71 out=77b] v70'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f9458023040 con 0x7f946005a040 2024-04-24T23:07:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.760+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.1a 9:58000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.761+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(12 [pgnls start_epoch 71 out=49b] v67'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.761+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 9.6 9:60000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.762+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(13 [pgnls start_epoch 71 out=77b] v70'10 uv10 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.762+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9454061e20 0x7f945405fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.762+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 9.16 9:68000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9454061e20 2024-04-24T23:07:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.762+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9454061e20 0x7f945405fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.763+0000 7f9465e00640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9454061e20 0x7f945405fc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.766+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(14 [pgnls start_epoch 71 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9454055d40 con 0x7f9454061e20 2024-04-24T23:07:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.766+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:15 9.e 9:70000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.767+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(15 [pgnls start_epoch 71 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.767+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1e 9:78000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946006b3c0 2024-04-24T23:07:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.768+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(16 [pgnls start_epoch 71 out=49b] v67'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9458023040 con 0x7f946006b3c0 2024-04-24T23:07:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.768+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 9.1 9:80000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9454059930 2024-04-24T23:07:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.769+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(17 [pgnls start_epoch 71 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9460068040 con 0x7f9454059930 2024-04-24T23:07:41.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.769+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f94600598c0 0x7f946006a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.769+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:18 9.11 9:88000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600598c0 2024-04-24T23:07:41.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.769+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f94600598c0 0x7f946006a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.770+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f94600598c0 0x7f946006a350 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.770+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(18 [pgnls start_epoch 71 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9460068040 con 0x7f94600598c0 2024-04-24T23:07:41.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.770+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 9.9 9:90000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.771+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 [pgnls start_epoch 71 out=97b] v68'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.771+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:20 9.19 9:98000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946006b3c0 2024-04-24T23:07:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.772+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(20 [pgnls start_epoch 71 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9458023040 con 0x7f946006b3c0 2024-04-24T23:07:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.772+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.773+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(21 [pgnls start_epoch 71 out=73b] v68'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.774+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 9.15 9:a8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600598c0 2024-04-24T23:07:41.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.774+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 [pgnls start_epoch 71 out=127b] v68'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9460068040 con 0x7f94600598c0 2024-04-24T23:07:41.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.774+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 9.d 9:b0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600598c0 2024-04-24T23:07:41.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.775+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 [pgnls start_epoch 71 out=74b] v67'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9460068040 con 0x7f94600598c0 2024-04-24T23:07:41.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.775+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1d 9:b8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946006b3c0 2024-04-24T23:07:41.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.776+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(24 [pgnls start_epoch 71 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9458023040 con 0x7f946006b3c0 2024-04-24T23:07:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.776+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:25 9.3 9:c0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9454061e20 2024-04-24T23:07:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.776+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(25 [pgnls start_epoch 71 out=100b] v70'3 uv3 ondisk = 1) ==== 144+0+100 (crc 0 0 0) 0x7f9454055d40 con 0x7f9454061e20 2024-04-24T23:07:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.776+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 9.13 9:c8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.776+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(26 [pgnls start_epoch 71 out=122b] v70'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.777+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.b 9:d0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x55d8a516ea90 2024-04-24T23:07:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.778+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 [pgnls start_epoch 71 out=100b] v70'5 uv5 ondisk = 1) ==== 144+0+100 (crc 0 0 0) 0x7f9460068040 con 0x55d8a516ea90 2024-04-24T23:07:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.778+0000 7f9467200640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9460087040 0x7f9460087930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.778+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:28 9.1b 9:d8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f9460087040 2024-04-24T23:07:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.779+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9460087040 0x7f9460087930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.780+0000 7f9466800640 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9460087040 0x7f9460087930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.781+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(28 [pgnls start_epoch 71 out=122b] v70'18 uv18 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f9458023040 con 0x7f9460087040 2024-04-24T23:07:41.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.781+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 9.7 9:e0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(29 [pgnls start_epoch 71 out=129b] v70'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:30 9.17 9:e8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(30 [pgnls start_epoch 71 out=97b] v70'7 uv7 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:31 9.f 9:f0000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f94600503e0 2024-04-24T23:07:41.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(31 [pgnls start_epoch 71 out=73b] v67'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9454055d40 con 0x7f94600503e0 2024-04-24T23:07:41.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.782+0000 7f9465e00640 1 -- 172.21.15.146:0/830921135 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:32 9.1f 9:f8000000::::head [pgnls start_epoch 71 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71) -- 0x55d8a51785e0 con 0x7f946006b3c0 2024-04-24T23:07:41.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.783+0000 7f9466800640 1 -- 172.21.15.146:0/830921135 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(32 [pgnls start_epoch 71 out=101b] v70'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f9458023040 con 0x7f946006b3c0 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:601.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:602.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:10000000000.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:600.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:603.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:60a.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:613.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000.inode 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:610.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:606.00000000 2024-04-24T23:07:41.786 INFO:teuthology.orchestra.run.smithi146.stdout:607.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:60e.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:mds1_openfiles.0 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_openfiles.0 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:60f.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:608.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:501.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:612.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:401.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:604.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000.inode 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:500.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:mds_snaptable 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:605.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000 2024-04-24T23:07:41.787 INFO:teuthology.orchestra.run.smithi146.stdout:mds1_sessionmap 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_inotable 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:611.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_sessionmap 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:60c.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:201.00000001 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:mds1_inotable 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000002 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:609.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:10000000001.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:60b.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:60d.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:201.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:400.00000000 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000.inode 2024-04-24T23:07:41.788 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000 2024-04-24T23:07:41.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9454061e20 msgr2=0x7f945405fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9454061e20 0x7f945405fc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f946005a040 msgr2=0x7f946005a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f946005a040 0x7f946005a420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f94600503e0 msgr2=0x7f9460050840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f94600503e0 0x7f9460050840 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f94600598c0 msgr2=0x7f946006a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f94600598c0 0x7f946006a350 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9460087040 msgr2=0x7f9460087930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9460087040 0x7f9460087930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 reap_dead start 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 reap_dead start 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d8a516ea90 msgr2=0x55d8a520eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55d8a516ea90 0x55d8a520eaa0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f946006b3c0 msgr2=0x7f946006b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f946006b3c0 0x7f946006b820 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9454059930 msgr2=0x7f9454058590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9454059930 0x7f9454058590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f944806a810 msgr2=0x7f944806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f944806a810 0x7f944806ccd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94580030a0 tx=0x7f94580059a0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 msgr2=0x55d8a5219cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 --2- 172.21.15.146:0/830921135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d8a5179980 0x55d8a5219cf0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x55d8a5176610 tx=0x7f9454002f70 comp rx=0 tx=0).stop 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 reap_dead start 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9467200640 1 -- 172.21.15.146:0/830921135 reap_dead start 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 shutdown_connections 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 >> 172.21.15.146:0/830921135 conn(0x55d8a50961f0 msgr2=0x55d8a50a8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 shutdown_connections 2024-04-24T23:07:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.784+0000 7f9469521f40 1 -- 172.21.15.146:0/830921135 wait complete. 2024-04-24T23:07:41.792 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_openfiles.0 2024-04-24T23:07:41.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.885+0000 7f3d43f08f40 1 Processor -- start 2024-04-24T23:07:41.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.885+0000 7f3d43f08f40 1 -- start start 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d240022d0 0x55e03bd18c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e03bc87500 0x55e03bbfb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e03bb57640 con 0x55e03bbdf450 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e03bb5b680 con 0x55e03bc87500 2024-04-24T23:07:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e03bbfd230 con 0x7f3d240022d0 2024-04-24T23:07:41.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d40800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d40800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44484/0 (socket says 172.21.15.146:44484) 2024-04-24T23:07:41.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.886+0000 7f3d40800640 1 -- 172.21.15.146:0/3693495879 learned_addr learned my addr 172.21.15.146:0/3693495879 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 -- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d240022d0 msgr2=0x55e03bd18c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d240022d0 0x55e03bd18c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 -- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e03bc87500 msgr2=0x55e03bbfb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e03bc87500 0x55e03bbfb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 -- 172.21.15.146:0/3693495879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03bc6a390 con 0x55e03bbdf450 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d40800640 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c3b0 tx=0x7f3d2c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec240fb13677e085 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d3f400640 1 -- 172.21.15.146:0/3693495879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00e540 con 0x55e03bbdf450 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d3f400640 1 -- 172.21.15.146:0/3693495879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00e6e0 con 0x55e03bbdf450 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.887+0000 7f3d3f400640 1 -- 172.21.15.146:0/3693495879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00e8b0 con 0x55e03bbdf450 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3693495879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 msgr2=0x55e03bd17bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c3b0 tx=0x7f3d2c00c870 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3693495879 shutdown_connections 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e03bc87500 0x55e03bbfb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bd17bf0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3693495879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d240022d0 0x55e03bd18c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3693495879 >> 172.21.15.146:0/3693495879 conn(0x55e03bbfdc30 msgr2=0x55e03bc6de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3693495879 shutdown_connections 2024-04-24T23:07:41.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.888+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3693495879 wait complete. 2024-04-24T23:07:41.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.889+0000 7f3d43f08f40 1 Processor -- start 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.889+0000 7f3d43f08f40 1 -- start start 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bc82630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e03bc87500 0x55e03bc699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d240022d0 0x55e03bbfb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e03bc6f240 con 0x55e03bbdf450 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e03bc6f980 con 0x7f3d240022d0 2024-04-24T23:07:41.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d43f08f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e03bd18130 con 0x55e03bc87500 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d41200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bc82630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d41200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bc82630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44498/0 (socket says 172.21.15.146:44498) 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.890+0000 7f3d41200640 1 -- 172.21.15.146:0/3410498905 learned_addr learned my addr 172.21.15.146:0/3410498905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 -- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e03bc87500 msgr2=0x55e03bc699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e03bc87500 0x55e03bc699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 -- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d240022d0 msgr2=0x55e03bbfb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d240022d0 0x55e03bbfb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 -- 172.21.15.146:0/3410498905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03bbe0c60 con 0x55e03bbdf450 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d41200640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bc82630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3d38025fd0 tx=0x7f3d380068d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d3e000640 1 -- 172.21.15.146:0/3410498905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38006270 con 0x55e03bbdf450 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d3e000640 1 -- 172.21.15.146:0/3410498905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3804d830 con 0x55e03bbdf450 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e03bbe0f40 con 0x55e03bbdf450 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d3e000640 1 -- 172.21.15.146:0/3410498905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3804dbe0 con 0x55e03bbdf450 2024-04-24T23:07:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.891+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e03bbe1500 con 0x55e03bbdf450 2024-04-24T23:07:41.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.893+0000 7f3d3e000640 1 -- 172.21.15.146:0/3410498905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d38056470 con 0x55e03bbdf450 2024-04-24T23:07:41.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.894+0000 7f3d3e000640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d2006a810 0x7f3d2006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.894+0000 7f3d3e000640 1 -- 172.21.15.146:0/3410498905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f3d380cd570 con 0x55e03bbdf450 2024-04-24T23:07:41.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.895+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55e03bd1e490 0x55e03bc81120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.895+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 9.a 9:54ba6923:::mds1_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e71) -- 0x55e03bbdecf0 con 0x55e03bd1e490 2024-04-24T23:07:41.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.895+0000 7f3d40800640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d2006a810 0x7f3d2006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.895+0000 7f3d41c00640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55e03bd1e490 0x55e03bc81120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.896+0000 7f3d41c00640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55e03bd1e490 0x55e03bc81120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.896+0000 7f3d40800640 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d2006a810 0x7f3d2006ccd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55e03bd219a0 tx=0x7f3d2c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.902+0000 7f3d41c00640 1 -- 172.21.15.146:0/3410498905 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds1_openfiles.0 [delete] v71'8 uv8 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f3d30009470 con 0x55e03bd1e490 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.902+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55e03bd1e490 msgr2=0x55e03bc81120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.902+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55e03bd1e490 0x55e03bc81120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.902+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d2006a810 msgr2=0x7f3d2006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d2006a810 0x7f3d2006ccd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55e03bd219a0 tx=0x7f3d2c009000 comp rx=0 tx=0).stop 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 msgr2=0x55e03bc82630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 --2- 172.21.15.146:0/3410498905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e03bbdf450 0x55e03bc82630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3d38025fd0 tx=0x7f3d380068d0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d41c00640 1 -- 172.21.15.146:0/3410498905 reap_dead start 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 shutdown_connections 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 >> 172.21.15.146:0/3410498905 conn(0x55e03bbfdc30 msgr2=0x55e03bc6dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 shutdown_connections 2024-04-24T23:07:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.903+0000 7f3d43f08f40 1 -- 172.21.15.146:0/3410498905 wait complete. 2024-04-24T23:07:41.909 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_sessionmap 2024-04-24T23:07:41.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.988+0000 7f005e3c2f40 1 Processor -- start 2024-04-24T23:07:41.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.988+0000 7f005e3c2f40 1 -- start start 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc17e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18b3ce0 0x559dc182db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559dc1789640 con 0x559dc18ac520 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559dc178d680 con 0x7f00400022d0 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559dc182b620 con 0x559dc18b3ce0 2024-04-24T23:07:41.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44518/0 (socket says 172.21.15.146:44518) 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005ac00640 1 -- 172.21.15.146:0/3458462589 learned_addr learned my addr 172.21.15.146:0/3458462589 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.989+0000 7f005c000640 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18b3ce0 0x559dc182db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005b600640 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc17e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 -- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18b3ce0 msgr2=0x559dc182db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18b3ce0 0x559dc182db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 -- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 msgr2=0x559dc17e2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc17e2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 -- 172.21.15.146:0/3458462589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc1812a90 con 0x559dc18ac520 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f005ac00640 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0048002580 tx=0x7f0048002a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b877efbbb25b4ac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f0059800640 1 -- 172.21.15.146:0/3458462589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048016070 con 0x559dc18ac520 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f0059800640 1 -- 172.21.15.146:0/3458462589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004800e690 con 0x559dc18ac520 2024-04-24T23:07:41.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.990+0000 7f0059800640 1 -- 172.21.15.146:0/3458462589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004800ea80 con 0x559dc18ac520 2024-04-24T23:07:41.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3458462589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 msgr2=0x559dc18b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0048002580 tx=0x7f0048002a40 comp rx=0 tx=0).stop 2024-04-24T23:07:41.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3458462589 shutdown_connections 2024-04-24T23:07:41.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18b3ce0 0x559dc182db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18ac520 0x559dc18b37a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3458462589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc17e2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3458462589 >> 172.21.15.146:0/3458462589 conn(0x559dc1811a20 msgr2=0x559dc182ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3458462589 shutdown_connections 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3458462589 wait complete. 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.991+0000 7f005e3c2f40 1 Processor -- start 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 -- start start 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18ac520 0x559dc18aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 0x559dc17e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc182db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559dc18b4fc0 con 0x559dc18b3ce0 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559dc18bc550 con 0x7f00400022d0 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.992+0000 7f005e3c2f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559dc1813050 con 0x559dc18ac520 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 0x559dc17e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 0x559dc17e2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44534/0 (socket says 172.21.15.146:44534) 2024-04-24T23:07:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 -- 172.21.15.146:0/3278636190 learned_addr learned my addr 172.21.15.146:0/3278636190 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005b600640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18ac520 0x559dc18aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 -- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18ac520 msgr2=0x559dc18aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005c000640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc182db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559dc18ac520 0x559dc18aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 -- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 msgr2=0x559dc182db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00400022d0 0x559dc182db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.993+0000 7f005ac00640 1 -- 172.21.15.146:0/3278636190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc18b6ef0 con 0x559dc18b3ce0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f005ac00640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 0x559dc17e2ce0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0048002a80 tx=0x7f0048002360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f0053e00640 1 -- 172.21.15.146:0/3278636190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048021020 con 0x559dc18b3ce0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f0053e00640 1 -- 172.21.15.146:0/3278636190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0048005440 con 0x559dc18b3ce0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f0053e00640 1 -- 172.21.15.146:0/3278636190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048016030 con 0x559dc18b3ce0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dc18b71d0 con 0x559dc18b3ce0 2024-04-24T23:07:41.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.994+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc18b7790 con 0x559dc18b3ce0 2024-04-24T23:07:41.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.996+0000 7f0053e00640 1 -- 172.21.15.146:0/3278636190 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0048024020 con 0x559dc18b3ce0 2024-04-24T23:07:41.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.997+0000 7f0053e00640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f003c06a810 0x7f003c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:41.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.997+0000 7f0053e00640 1 -- 172.21.15.146:0/3278636190 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f004808b4b0 con 0x559dc18b3ce0 2024-04-24T23:07:42.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.997+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x559dc1814870 0x559dc18b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.997+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:1 9.3 9:c27f454c:::mds1_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e71) -- 0x559dc18b62d0 con 0x559dc1814870 2024-04-24T23:07:42.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.998+0000 7f005c000640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x559dc1814870 0x559dc18b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.998+0000 7f005b600640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f003c06a810 0x7f003c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.998+0000 7f005c000640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x559dc1814870 0x559dc18b5d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:41.999+0000 7f005b600640 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f003c06a810 0x7f003c06ccd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f004c056000 tx=0x7f004c051000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005c000640 1 -- 172.21.15.146:0/3278636190 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(1 mds1_sessionmap [delete] v71'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f00540073f0 con 0x559dc1814870 2024-04-24T23:07:42.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x559dc1814870 msgr2=0x559dc18b5d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x559dc1814870 0x559dc18b5d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f003c06a810 msgr2=0x7f003c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f003c06a810 0x7f003c06ccd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f004c056000 tx=0x7f004c051000 comp rx=0 tx=0).stop 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 msgr2=0x559dc17e2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 --2- 172.21.15.146:0/3278636190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559dc18b3ce0 0x559dc17e2ce0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0048002a80 tx=0x7f0048002360 comp rx=0 tx=0).stop 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005c000640 1 -- 172.21.15.146:0/3278636190 reap_dead start 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 shutdown_connections 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 >> 172.21.15.146:0/3278636190 conn(0x559dc1811a20 msgr2=0x559dc182ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 shutdown_connections 2024-04-24T23:07:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.001+0000 7f005e3c2f40 1 -- 172.21.15.146:0/3278636190 wait complete. 2024-04-24T23:07:42.008 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_inotable 2024-04-24T23:07:42.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.091+0000 7f59e0195f40 1 Processor -- start 2024-04-24T23:07:42.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.091+0000 7f59e0195f40 1 -- start start 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3adcd40 0x55fdd3ac1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3b4e860 0x55fdd3ac1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fdd3ade230 con 0x55fdd3ac4730 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fdd3a38640 con 0x55fdd3b4e860 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59e0195f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fdd3add310 con 0x55fdd3adcd40 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59dd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59dd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44548/0 (socket says 172.21.15.146:44548) 2024-04-24T23:07:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.092+0000 7f59dd400640 1 -- 172.21.15.146:0/2002917442 learned_addr learned my addr 172.21.15.146:0/2002917442 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 -- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3adcd40 msgr2=0x55fdd3ac1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3adcd40 0x55fdd3ac1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 -- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3b4e860 msgr2=0x55fdd3ac1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3b4e860 0x55fdd3ac1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 -- 172.21.15.146:0/2002917442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd39bdb30 con 0x55fdd3ac4730 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59dd400640 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009570 tx=0x7f59d0009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4aea0c776e6a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59d7400640 1 -- 172.21.15.146:0/2002917442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0017070 con 0x55fdd3ac4730 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59d7400640 1 -- 172.21.15.146:0/2002917442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d0006600 con 0x55fdd3ac4730 2024-04-24T23:07:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.093+0000 7f59d7400640 1 -- 172.21.15.146:0/2002917442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00069f0 con 0x55fdd3ac4730 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 -- 172.21.15.146:0/2002917442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 msgr2=0x55fdd3b6a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009570 tx=0x7f59d0009a30 comp rx=0 tx=0).stop 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 -- 172.21.15.146:0/2002917442 shutdown_connections 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3b4e860 0x55fdd3ac1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3adcd40 0x55fdd3ac1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 --2- 172.21.15.146:0/2002917442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3ac4730 0x55fdd3b6a6b0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 -- 172.21.15.146:0/2002917442 >> 172.21.15.146:0/2002917442 conn(0x55fdd3adec30 msgr2=0x55fdd3b691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 -- 172.21.15.146:0/2002917442 shutdown_connections 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 -- 172.21.15.146:0/2002917442 wait complete. 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.094+0000 7f59e0195f40 1 Processor -- start 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 -- start start 2024-04-24T23:07:42.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3ac4730 0x55fdd3b4d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3adcd40 0x55fdd3b5f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 0x55fdd3b65120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fdd3adb100 con 0x55fdd3b4e860 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fdd3adf3d0 con 0x55fdd3adcd40 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.095+0000 7f59e0195f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55fdd3b69b80 con 0x55fdd3ac4730 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 0x55fdd3b65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 0x55fdd3b65120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44560/0 (socket says 172.21.15.146:44560) 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 -- 172.21.15.146:0/1074111004 learned_addr learned my addr 172.21.15.146:0/1074111004 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 -- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3ac4730 msgr2=0x55fdd3b4d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dd400640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3ac4730 0x55fdd3b4d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55fdd3ac4730 0x55fdd3b4d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 -- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3adcd40 msgr2=0x55fdd3b5f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dca00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3adcd40 0x55fdd3b5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fdd3adcd40 0x55fdd3b5f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 -- 172.21.15.146:0/1074111004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd3ac3aa0 con 0x55fdd3b4e860 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.096+0000 7f59dde00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 0x55fdd3b65120 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f59d800a190 tx=0x7f59d8005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.097+0000 7f59d6000640 1 -- 172.21.15.146:0/1074111004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8065020 con 0x55fdd3b4e860 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.097+0000 7f59d6000640 1 -- 172.21.15.146:0/1074111004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d8061470 con 0x55fdd3b4e860 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.097+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdd3abf3a0 con 0x55fdd3b4e860 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.097+0000 7f59d6000640 1 -- 172.21.15.146:0/1074111004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d805b040 con 0x55fdd3b4e860 2024-04-24T23:07:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.097+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdd3b5f900 con 0x55fdd3b4e860 2024-04-24T23:07:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.099+0000 7f59d6000640 1 -- 172.21.15.146:0/1074111004 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59d8068020 con 0x55fdd3b4e860 2024-04-24T23:07:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.100+0000 7f59d6000640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f59c006a840 0x7f59c006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.100+0000 7f59d6000640 1 -- 172.21.15.146:0/1074111004 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f59d80cdeb0 con 0x55fdd3b4e860 2024-04-24T23:07:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.100+0000 7f59e0195f40 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdd3b65660 0x55fdd3b610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.100+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:1 9.1b 9:dbae76b5:::mds1_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e71) -- 0x55fdd3abfd30 con 0x55fdd3b65660 2024-04-24T23:07:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.100+0000 7f59dd400640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f59c006a840 0x7f59c006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.101+0000 7f59dca00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdd3b65660 0x55fdd3b610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.102+0000 7f59dd400640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f59c006a840 0x7f59c006cd00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55fdd3b67f90 tx=0x7f59d000f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.102+0000 7f59dca00640 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdd3b65660 0x55fdd3b610f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.105+0000 7f59dca00640 1 -- 172.21.15.146:0/1074111004 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(1 mds1_inotable [delete] v71'19 uv19 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f59cc00e330 con 0x55fdd3b65660 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.105+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdd3b65660 msgr2=0x55fdd3b610f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55fdd3b65660 0x55fdd3b610f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f59c006a840 msgr2=0x7f59c006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f59c006a840 0x7f59c006cd00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55fdd3b67f90 tx=0x7f59d000f000 comp rx=0 tx=0).stop 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 msgr2=0x55fdd3b65120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 --2- 172.21.15.146:0/1074111004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fdd3b4e860 0x55fdd3b65120 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f59d800a190 tx=0x7f59d8005c30 comp rx=0 tx=0).stop 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59dde00640 1 -- 172.21.15.146:0/1074111004 reap_dead start 2024-04-24T23:07:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 shutdown_connections 2024-04-24T23:07:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 >> 172.21.15.146:0/1074111004 conn(0x55fdd3adec30 msgr2=0x55fdd3adbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 shutdown_connections 2024-04-24T23:07:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:07:42.106+0000 7f59e0195f40 1 -- 172.21.15.146:0/1074111004 wait complete. 2024-04-24T23:07:42.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:07:42.113 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-04-24T23:07:42.118 INFO:tasks.cephfs.test_journal_repair:Sleeping to check ls is blocked... 2024-04-24T23:07:42.209 INFO:teuthology.orchestra.run.smithi146.stdout:.: 2024-04-24T23:07:42.209 INFO:teuthology.orchestra.run.smithi146.stdout:alpha 2024-04-24T23:07:42.209 INFO:teuthology.orchestra.run.smithi146.stdout:bravo 2024-04-24T23:07:42.209 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:./alpha: 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_0 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_1 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_10 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_100 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_101 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_102 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_103 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_104 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_105 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_106 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_107 2024-04-24T23:07:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:file_108 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_109 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_11 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_110 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_111 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_112 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_113 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_114 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_115 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_116 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_117 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_118 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_119 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_12 2024-04-24T23:07:42.211 INFO:teuthology.orchestra.run.smithi146.stdout:file_120 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_121 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_122 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_123 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_124 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_125 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_126 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_127 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_128 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_129 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_13 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_130 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_131 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_132 2024-04-24T23:07:42.212 INFO:teuthology.orchestra.run.smithi146.stdout:file_133 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_134 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_135 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_136 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_137 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_138 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_139 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_14 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_140 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_141 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_142 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_143 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_144 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_145 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_146 2024-04-24T23:07:42.213 INFO:teuthology.orchestra.run.smithi146.stdout:file_147 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_148 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_149 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_15 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_150 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_151 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_152 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_153 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_154 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_155 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_156 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_157 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_158 2024-04-24T23:07:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:file_159 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_16 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_160 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_161 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_162 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_163 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_164 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_165 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_166 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_167 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_168 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_169 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_17 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_170 2024-04-24T23:07:42.215 INFO:teuthology.orchestra.run.smithi146.stdout:file_171 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_172 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_173 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_174 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_175 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_176 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_177 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_178 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_179 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_18 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_180 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_181 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_182 2024-04-24T23:07:42.216 INFO:teuthology.orchestra.run.smithi146.stdout:file_183 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_184 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_185 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_186 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_187 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_188 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_189 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_19 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_190 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_191 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_192 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_193 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_194 2024-04-24T23:07:42.217 INFO:teuthology.orchestra.run.smithi146.stdout:file_195 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_196 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_197 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_198 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_199 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_2 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_20 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_200 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_201 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_202 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_203 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_204 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_205 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_206 2024-04-24T23:07:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:file_207 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_208 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_209 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_21 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_210 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_211 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_212 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_213 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_214 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_215 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_216 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_217 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_218 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_219 2024-04-24T23:07:42.219 INFO:teuthology.orchestra.run.smithi146.stdout:file_22 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_220 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_221 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_222 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_223 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_224 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_225 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_226 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_227 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_228 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_229 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_23 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_230 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_231 2024-04-24T23:07:42.220 INFO:teuthology.orchestra.run.smithi146.stdout:file_232 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_233 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_234 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_235 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_236 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_237 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_238 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_239 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_24 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_240 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_241 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_242 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_243 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_244 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_245 2024-04-24T23:07:42.221 INFO:teuthology.orchestra.run.smithi146.stdout:file_246 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_247 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_248 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_249 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_25 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_250 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_251 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_252 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_253 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_254 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_255 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_256 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_257 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_258 2024-04-24T23:07:42.222 INFO:teuthology.orchestra.run.smithi146.stdout:file_259 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_26 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_260 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_261 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_262 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_263 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_264 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_265 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_266 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_267 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_268 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_269 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_27 2024-04-24T23:07:42.223 INFO:teuthology.orchestra.run.smithi146.stdout:file_270 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_271 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_272 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_273 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_274 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_275 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_276 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_277 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_278 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_279 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_28 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_280 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_281 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_282 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_283 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_284 2024-04-24T23:07:42.224 INFO:teuthology.orchestra.run.smithi146.stdout:file_285 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_286 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_287 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_288 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_289 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_29 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_290 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_291 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_292 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_293 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_294 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_295 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_296 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_297 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_298 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_299 2024-04-24T23:07:42.225 INFO:teuthology.orchestra.run.smithi146.stdout:file_3 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_30 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_300 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_301 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_302 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_303 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_304 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_305 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_306 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_307 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_308 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_309 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_31 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_310 2024-04-24T23:07:42.226 INFO:teuthology.orchestra.run.smithi146.stdout:file_311 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_312 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_313 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_314 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_315 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_316 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_317 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_318 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_319 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_32 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_320 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_321 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_322 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_323 2024-04-24T23:07:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:file_324 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_325 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_326 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_327 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_328 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_329 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_33 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_330 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_331 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_332 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_333 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_334 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_335 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_336 2024-04-24T23:07:42.228 INFO:teuthology.orchestra.run.smithi146.stdout:file_337 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_338 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_339 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_34 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_340 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_341 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_342 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_343 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_344 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_345 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_346 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_347 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_348 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_349 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_35 2024-04-24T23:07:42.229 INFO:teuthology.orchestra.run.smithi146.stdout:file_350 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_351 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_352 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_353 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_354 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_355 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_356 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_357 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_358 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_359 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_36 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_360 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_361 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_362 2024-04-24T23:07:42.230 INFO:teuthology.orchestra.run.smithi146.stdout:file_363 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_364 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_365 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_366 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_367 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_368 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_369 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_37 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_370 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_371 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_372 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_373 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_374 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_375 2024-04-24T23:07:42.231 INFO:teuthology.orchestra.run.smithi146.stdout:file_376 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_377 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_378 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_379 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_38 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_380 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_381 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_382 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_383 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_384 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_385 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_386 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_387 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_388 2024-04-24T23:07:42.232 INFO:teuthology.orchestra.run.smithi146.stdout:file_389 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_39 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_390 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_391 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_392 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_393 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_394 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_395 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_396 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_397 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_398 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_399 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_4 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_40 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_400 2024-04-24T23:07:42.233 INFO:teuthology.orchestra.run.smithi146.stdout:file_401 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_402 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_403 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_404 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_405 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_406 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_407 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_408 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_409 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_41 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_410 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_411 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_412 2024-04-24T23:07:42.234 INFO:teuthology.orchestra.run.smithi146.stdout:file_413 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_414 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_415 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_416 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_417 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_418 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_419 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_42 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_420 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_421 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_422 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_423 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_424 2024-04-24T23:07:42.235 INFO:teuthology.orchestra.run.smithi146.stdout:file_425 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_426 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_427 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_428 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_429 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_43 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_430 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_431 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_432 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_433 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_434 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_435 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_436 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_437 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_438 2024-04-24T23:07:42.236 INFO:teuthology.orchestra.run.smithi146.stdout:file_439 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_44 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_440 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_441 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_442 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_443 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_444 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_445 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_446 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_447 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_448 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_449 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_45 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_450 2024-04-24T23:07:42.237 INFO:teuthology.orchestra.run.smithi146.stdout:file_451 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_452 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_453 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_454 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_455 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_456 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_457 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_458 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_459 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_46 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_460 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_461 2024-04-24T23:07:42.238 INFO:teuthology.orchestra.run.smithi146.stdout:file_462 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_463 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_464 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_465 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_466 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_467 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_468 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_469 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_47 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_470 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_471 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_472 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_473 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_474 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_475 2024-04-24T23:07:42.239 INFO:teuthology.orchestra.run.smithi146.stdout:file_476 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_477 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_478 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_479 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_48 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_480 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_481 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_482 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_483 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_484 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_485 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_486 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_487 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_488 2024-04-24T23:07:42.240 INFO:teuthology.orchestra.run.smithi146.stdout:file_489 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_49 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_490 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_491 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_492 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_493 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_494 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_495 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_496 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_497 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_498 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_499 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_5 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_50 2024-04-24T23:07:42.241 INFO:teuthology.orchestra.run.smithi146.stdout:file_500 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_501 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_502 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_503 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_504 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_505 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_506 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_507 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_508 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_509 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_51 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_510 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_511 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_512 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_513 2024-04-24T23:07:42.242 INFO:teuthology.orchestra.run.smithi146.stdout:file_514 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_515 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_516 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_517 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_518 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_519 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_52 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_520 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_521 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_522 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_523 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_524 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_525 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_526 2024-04-24T23:07:42.243 INFO:teuthology.orchestra.run.smithi146.stdout:file_527 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_528 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_529 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_53 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_530 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_531 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_532 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_533 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_534 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_535 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_536 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_537 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_538 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_539 2024-04-24T23:07:42.244 INFO:teuthology.orchestra.run.smithi146.stdout:file_54 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_540 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_541 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_542 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_543 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_544 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_545 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_546 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_547 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_548 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_549 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_55 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_550 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_551 2024-04-24T23:07:42.245 INFO:teuthology.orchestra.run.smithi146.stdout:file_552 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_553 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_554 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_555 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_556 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_557 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_558 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_559 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_56 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_560 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_561 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_562 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_563 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_564 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_565 2024-04-24T23:07:42.246 INFO:teuthology.orchestra.run.smithi146.stdout:file_566 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_567 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_568 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_569 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_57 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_570 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_571 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_572 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_573 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_574 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_575 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_576 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_577 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_578 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_579 2024-04-24T23:07:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:file_58 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_580 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_581 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_582 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_583 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_584 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_585 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_586 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_587 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_588 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_589 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_59 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_590 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_591 2024-04-24T23:07:42.248 INFO:teuthology.orchestra.run.smithi146.stdout:file_592 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_593 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_594 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_595 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_596 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_597 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_598 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_599 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_6 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_60 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_600 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_601 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_602 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_603 2024-04-24T23:07:42.249 INFO:teuthology.orchestra.run.smithi146.stdout:file_604 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_605 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_606 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_607 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_608 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_609 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_61 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_610 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_611 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_612 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_613 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_614 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_615 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_616 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_617 2024-04-24T23:07:42.250 INFO:teuthology.orchestra.run.smithi146.stdout:file_618 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_619 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_62 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_620 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_621 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_622 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_623 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_624 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_625 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_626 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_627 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_628 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_629 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_63 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_630 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_631 2024-04-24T23:07:42.251 INFO:teuthology.orchestra.run.smithi146.stdout:file_632 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_633 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_634 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_635 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_636 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_637 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_638 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_639 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_64 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_640 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_641 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_642 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_643 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_644 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_645 2024-04-24T23:07:42.252 INFO:teuthology.orchestra.run.smithi146.stdout:file_646 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_647 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_648 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_649 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_65 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_650 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_651 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_652 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_653 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_654 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_655 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_656 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_657 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_658 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_659 2024-04-24T23:07:42.253 INFO:teuthology.orchestra.run.smithi146.stdout:file_66 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_660 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_661 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_662 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_663 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_664 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_665 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_666 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_667 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_668 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_669 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_67 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_670 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_671 2024-04-24T23:07:42.254 INFO:teuthology.orchestra.run.smithi146.stdout:file_672 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_673 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_674 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_675 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_676 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_677 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_678 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_679 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_68 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_680 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_681 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_682 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_683 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_684 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_685 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_686 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_687 2024-04-24T23:07:42.255 INFO:teuthology.orchestra.run.smithi146.stdout:file_688 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_689 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_69 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_690 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_691 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_692 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_693 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_694 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_695 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_696 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_697 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_698 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_699 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_7 2024-04-24T23:07:42.256 INFO:teuthology.orchestra.run.smithi146.stdout:file_70 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_700 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_701 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_702 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_703 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_704 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_705 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_706 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_707 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_708 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_709 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_71 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_710 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_711 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_712 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_713 2024-04-24T23:07:42.257 INFO:teuthology.orchestra.run.smithi146.stdout:file_714 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_715 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_716 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_717 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_718 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_719 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_72 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_720 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_721 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_722 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_723 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_724 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_725 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_726 2024-04-24T23:07:42.258 INFO:teuthology.orchestra.run.smithi146.stdout:file_727 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_728 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_729 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_73 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_730 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_731 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_732 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_733 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_734 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_735 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_736 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_737 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_738 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_739 2024-04-24T23:07:42.259 INFO:teuthology.orchestra.run.smithi146.stdout:file_74 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_740 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_741 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_742 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_743 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_744 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_745 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_746 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_747 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_748 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_749 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_75 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_750 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_751 2024-04-24T23:07:42.260 INFO:teuthology.orchestra.run.smithi146.stdout:file_752 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_753 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_754 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_755 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_756 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_757 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_758 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_759 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_76 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_760 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_761 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_762 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_763 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_764 2024-04-24T23:07:42.261 INFO:teuthology.orchestra.run.smithi146.stdout:file_765 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_766 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_767 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_768 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_769 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_77 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_770 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_771 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_772 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_773 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_774 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_775 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_776 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_777 2024-04-24T23:07:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:file_778 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_779 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_78 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_780 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_781 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_782 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_783 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_784 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_785 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_786 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_787 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_788 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_789 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_79 2024-04-24T23:07:42.263 INFO:teuthology.orchestra.run.smithi146.stdout:file_790 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_791 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_792 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_793 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_794 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_795 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_796 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_797 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_798 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_799 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_8 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_80 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_800 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_801 2024-04-24T23:07:42.264 INFO:teuthology.orchestra.run.smithi146.stdout:file_802 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_803 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_804 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_805 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_806 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_807 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_808 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_809 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_81 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_810 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_811 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_812 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_813 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_814 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_815 2024-04-24T23:07:42.265 INFO:teuthology.orchestra.run.smithi146.stdout:file_816 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_817 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_818 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_819 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_82 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_820 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_821 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_822 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_823 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_824 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_825 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_826 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_827 2024-04-24T23:07:42.266 INFO:teuthology.orchestra.run.smithi146.stdout:file_828 2024-04-24T23:07:42.267 INFO:teuthology.orchestra.run.smithi146.stdout:file_829 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_83 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_830 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_831 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_832 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_833 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_834 2024-04-24T23:07:42.269 INFO:teuthology.orchestra.run.smithi146.stdout:file_835 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_836 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_837 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_838 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_839 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_84 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_840 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_841 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_842 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_843 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_844 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_845 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_846 2024-04-24T23:07:42.270 INFO:teuthology.orchestra.run.smithi146.stdout:file_847 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_848 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_849 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_85 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_850 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_851 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_852 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_853 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_854 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_855 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_856 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_857 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_858 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_859 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_86 2024-04-24T23:07:42.271 INFO:teuthology.orchestra.run.smithi146.stdout:file_860 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_861 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_862 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_863 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_864 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_865 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_866 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_867 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_868 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_869 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_87 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_870 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_871 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_872 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_873 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_874 2024-04-24T23:07:42.272 INFO:teuthology.orchestra.run.smithi146.stdout:file_875 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_876 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_877 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_878 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_879 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_88 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_880 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_881 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_882 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_883 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_884 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_885 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_886 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_887 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_888 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_889 2024-04-24T23:07:42.273 INFO:teuthology.orchestra.run.smithi146.stdout:file_89 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_890 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_891 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_892 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_893 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_894 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_895 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_896 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_897 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_898 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_899 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_9 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_90 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_900 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_901 2024-04-24T23:07:42.274 INFO:teuthology.orchestra.run.smithi146.stdout:file_902 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_903 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_904 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_905 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_906 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_907 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_908 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_909 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_91 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_910 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_911 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_912 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_913 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_914 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_915 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_916 2024-04-24T23:07:42.275 INFO:teuthology.orchestra.run.smithi146.stdout:file_917 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_918 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_919 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_92 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_920 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_921 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_922 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_923 2024-04-24T23:07:42.276 INFO:teuthology.orchestra.run.smithi146.stdout:file_924 2024-04-24T23:07:46.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:07:46.805 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:08:16.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:08:16.936 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:08:42.219 INFO:tasks.cephfs.test_journal_repair:Killing mount, it's blocked on the MDS we killed 2024-04-24T23:08:42.219 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi146.front.sepia.ceph.com... 2024-04-24T23:08:42.219 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:08:42.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:42.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 down 2024-04-24T23:08:42.318 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:08:42.318 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:08:42.318 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:08:42.371 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:08:42.371 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:08:42.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:08:42.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.623+0000 7f5d13000640 1 Processor -- start 2024-04-24T23:08:42.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.623+0000 7f5d13000640 1 -- start start 2024-04-24T23:08:42.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d13000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5d0c0715f0 0x7f5d0c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d13000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5d0c0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d13000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d0c158970 con 0x7f5d0c158590 2024-04-24T23:08:42.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d13000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0c070c10 con 0x7f5d0c0715f0 2024-04-24T23:08:42.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d13000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0c070ef0 con 0x7f5d0c0cfc90 2024-04-24T23:08:42.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d0be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5d0c158590 0x7f5d0c162450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60176/0 (socket says 172.21.15.146:60176) 2024-04-24T23:08:42.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.625+0000 7f5d0be00640 1 -- 172.21.15.146:0/2217172870 learned_addr learned my addr 172.21.15.146:0/2217172870 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d11000640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5d0c0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d03400640 1 --2- 172.21.15.146:0/2217172870 >> v2:172.21.15.203:3300/0 conn(0x7f5d0c0715f0 0x7f5d0c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125152804 0 0) 0x7f5d0c158970 con 0x7f5d0c158590 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cf0003520 con 0x7f5d0c158590 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815705423 0 0) 0x7f5cf0003520 con 0x7f5d0c158590 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 msgr2=0x7f5d0c0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5d0c0d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 >> v2:172.21.15.203:3300/0 conn(0x7f5d0c0715f0 msgr2=0x7f5d0c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.626+0000 7f5d0b400640 1 --2- 172.21.15.146:0/2217172870 >> v2:172.21.15.203:3300/0 conn(0x7f5d0c0715f0 0x7f5d0c071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c0711d0 con 0x7f5d0c158590 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f5cfc001670 con 0x7f5d0c158590 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 >> v1:172.21.15.146:6789/0 conn(0x7f5d0c158590 legacy=0x7f5d0c162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5cf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cf0004d40 0x7f5cf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c070c10 con 0x7f5cf00039b0 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c070ef0 con 0x7f5cf0004d40 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf000b9c0 con 0x7f5d0c0cfc90 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0be00640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d03400640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5cf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d11000640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cf0004d40 0x7f5cf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.627+0000 7f5d0be00640 1 -- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 msgr2=0x7f5cf0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.628+0000 7f5d0be00640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c0cfc90 0x7f5cf0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.628+0000 7f5d0be00640 1 -- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cf0004d40 msgr2=0x7f5cf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.628+0000 7f5d0be00640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5cf0004d40 0x7f5cf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.628+0000 7f5d0be00640 1 -- 172.21.15.146:0/2217172870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf0003520 con 0x7f5cf00039b0 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.629+0000 7f5d0be00640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c210 tx=0x7f5cf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531631a6dfd42b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.629+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc007d50 con 0x7f5cf00039b0 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.629+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc005ad0 con 0x7f5cf00039b0 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.629+0000 7f5d0b400640 1 -- 172.21.15.146:0/2217172870 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc007070 con 0x7f5cf00039b0 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 -- 172.21.15.146:0/2217172870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 msgr2=0x7f5cf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 --2- 172.21.15.146:0/2217172870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c210 tx=0x7f5cf0005830 comp rx=0 tx=0).stop 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d11000640 1 -- 172.21.15.146:0/2217172870 reap_dead start 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 -- 172.21.15.146:0/2217172870 shutdown_connections 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 -- 172.21.15.146:0/2217172870 >> 172.21.15.146:0/2217172870 conn(0x7f5d0c06b320 msgr2=0x7f5d0c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 -- 172.21.15.146:0/2217172870 shutdown_connections 2024-04-24T23:08:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.630+0000 7f5d13000640 1 -- 172.21.15.146:0/2217172870 wait complete. 2024-04-24T23:08:42.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.632+0000 7f5d13000640 1 Processor -- start 2024-04-24T23:08:42.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.632+0000 7f5d13000640 1 -- start start 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.633+0000 7f5d13000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d13000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 0x7f5d0c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d13000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c15a190 0x7f5d0c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d13000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c0d0120 con 0x7f5cf00039b0 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d13000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c161f30 con 0x7f5d0c1489e0 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d13000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0c0d02a0 con 0x7f5d0c15a190 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d0be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d0be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54444/0 (socket says 172.21.15.146:54444) 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d0be00640 1 -- 172.21.15.146:0/3757186137 learned_addr learned my addr 172.21.15.146:0/3757186137 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d03400640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 0x7f5d0c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.634+0000 7f5d11000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c15a190 0x7f5d0c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 -- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c15a190 msgr2=0x7f5d0c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c15a190 0x7f5d0c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 -- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 msgr2=0x7f5d0c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 0x7f5d0c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 -- 172.21.15.146:0/3757186137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c15c7c0 con 0x7f5cf00039b0 2024-04-24T23:08:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d03400640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 0x7f5d0c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d0be00640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c210 tx=0x7f5cfc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc042070 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc007480 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc001c90 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.635+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0c15caa0 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.636+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0c15d850 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.637+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0c068190 con 0x7f5cf00039b0 2024-04-24T23:08:42.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.638+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cfc045070 con 0x7f5cf00039b0 2024-04-24T23:08:42.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.639+0000 7f5d08c00640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 0x7f5ce806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:42.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.639+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f5cfc0abd00 con 0x7f5cf00039b0 2024-04-24T23:08:42.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.639+0000 7f5d03400640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 0x7f5ce806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:42.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.640+0000 7f5d03400640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 0x7f5ce806e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40099f0 tx=0x7f5cf4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:42.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.643+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cfc04c030 con 0x7f5cf00039b0 2024-04-24T23:08:42.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.842+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d0c148dc0 con 0x7f5cf00039b0 2024-04-24T23:08:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.845+0000 7f5d08c00640 1 -- 172.21.15.146:0/3757186137 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+17422 (secure 0 0 0) 0x7f5cfc080030 con 0x7f5cf00039b0 2024-04-24T23:08:42.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":71,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:07:41.602546+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.34","mappings":[{"from":2,"to":7}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:08:42.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 msgr2=0x7f5ce806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 0x7f5ce806e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40099f0 tx=0x7f5cf4008040 comp rx=0 tx=0).stop 2024-04-24T23:08:42.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 msgr2=0x7f5d0c152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:42.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c210 tx=0x7f5cfc001a40 comp rx=0 tx=0).stop 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 shutdown_connections 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5ce806be60 0x7f5ce806e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d0c15a190 0x7f5d0c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d0c1489e0 0x7f5d0c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 --2- 172.21.15.146:0/3757186137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cf00039b0 0x7f5d0c152ae0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 >> 172.21.15.146:0/3757186137 conn(0x7f5d0c06b320 msgr2=0x7f5d0c0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 shutdown_connections 2024-04-24T23:08:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:42.848+0000 7f5d13000640 1 -- 172.21.15.146:0/3757186137 wait complete. 2024-04-24T23:08:42.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:07:06.558364+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:07:07.805671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:08:42.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:08:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.071+0000 7fe4c2200640 1 Processor -- start 2024-04-24T23:08:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.071+0000 7fe4c2200640 1 -- start start 2024-04-24T23:08:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4bc158300 0x7fe4bc0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc162580 0x7fe4bc0d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe4bc15e310 0x7fe4bc15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc0b2ae0 con 0x7fe4bc158300 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc15f070 con 0x7fe4bc15e310 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc161aa0 con 0x7fe4bc162580 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4bc158300 0x7fe4bc0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4bc158300 0x7fe4bc0cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54450/0 (socket says 172.21.15.146:54450) 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c0e00640 1 -- 172.21.15.146:0/1880701709 learned_addr learned my addr 172.21.15.146:0/1880701709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c0e00640 1 -- 172.21.15.146:0/1880701709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc162580 msgr2=0x7fe4bc0d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.073+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/1880701709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc162580 0x7fe4bc0d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.074+0000 7fe4c0e00640 1 -- 172.21.15.146:0/1880701709 >> v2:172.21.15.203:3300/0 conn(0x7fe4bc15e310 msgr2=0x7fe4bc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.074+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/1880701709 >> v2:172.21.15.203:3300/0 conn(0x7fe4bc15e310 0x7fe4bc15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.074+0000 7fe4c0e00640 1 -- 172.21.15.146:0/1880701709 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc161d80 con 0x7fe4bc158300 2024-04-24T23:08:43.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.075+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/1880701709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc158300 0x7fe4bc0cfcc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc15bee0 tx=0x7fe4b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13518d92513a0cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.075+0000 7fe4bb400640 1 -- 172.21.15.146:0/1880701709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0037070 con 0x7fe4bc158300 2024-04-24T23:08:43.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.075+0000 7fe4bb400640 1 -- 172.21.15.146:0/1880701709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0032440 con 0x7fe4bc158300 2024-04-24T23:08:43.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.075+0000 7fe4bb400640 1 -- 172.21.15.146:0/1880701709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0032810 con 0x7fe4bc158300 2024-04-24T23:08:43.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 -- 172.21.15.146:0/1880701709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc158300 msgr2=0x7fe4bc0cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 --2- 172.21.15.146:0/1880701709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc158300 0x7fe4bc0cfcc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc15bee0 tx=0x7fe4b002a270 comp rx=0 tx=0).stop 2024-04-24T23:08:43.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 -- 172.21.15.146:0/1880701709 shutdown_connections 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 --2- 172.21.15.146:0/1880701709 >> v2:172.21.15.203:3300/0 conn(0x7fe4bc15e310 0x7fe4bc15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 --2- 172.21.15.146:0/1880701709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc162580 0x7fe4bc0d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 --2- 172.21.15.146:0/1880701709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc158300 0x7fe4bc0cfcc0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 -- 172.21.15.146:0/1880701709 >> 172.21.15.146:0/1880701709 conn(0x7fe4bc06b560 msgr2=0x7fe4bc06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 -- 172.21.15.146:0/1880701709 shutdown_connections 2024-04-24T23:08:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.076+0000 7fe4c2200640 1 -- 172.21.15.146:0/1880701709 wait complete. 2024-04-24T23:08:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.078+0000 7fe4c2200640 1 Processor -- start 2024-04-24T23:08:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.078+0000 7fe4c2200640 1 -- start start 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc158300 0x7fe4bc14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 0x7fe4bc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc15ec80 con 0x7fe4bc162580 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1586e0 con 0x7fe4bc15e310 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc15ee00 con 0x7fe4bc158300 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54464/0 (socket says 172.21.15.146:54464) 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.079+0000 7fe4c1800640 1 -- 172.21.15.146:0/2728343571 learned_addr learned my addr 172.21.15.146:0/2728343571 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc158300 0x7fe4bc14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4bbe00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 0x7fe4bc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 -- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc158300 msgr2=0x7fe4bc14f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc158300 0x7fe4bc14f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 -- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 msgr2=0x7fe4bc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 0x7fe4bc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 -- 172.21.15.146:0/2728343571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc160360 con 0x7fe4bc162580 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4bbe00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 0x7fe4bc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c1800640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400b9a0 tx=0x7fe4b400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4019070 con 0x7fe4bc162580 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b400cbc0 con 0x7fe4bc162580 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc160640 con 0x7fe4bc162580 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.080+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4014440 con 0x7fe4bc162580 2024-04-24T23:08:43.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.081+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc1560e0 con 0x7fe4bc162580 2024-04-24T23:08:43.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.082+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc04f500 con 0x7fe4bc162580 2024-04-24T23:08:43.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.083+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4b401c070 con 0x7fe4bc162580 2024-04-24T23:08:43.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.084+0000 7fe4b8c00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 0x7fe49c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.084+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7fe4b408ae50 con 0x7fe4bc162580 2024-04-24T23:08:43.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.084+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 0x7fe49c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.085+0000 7fe4c0e00640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 0x7fe49c06e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0034000 tx=0x7fe4b002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.088+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe4b4059540 con 0x7fe4bc162580 2024-04-24T23:08:43.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.286+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe4bc0b4dd0 con 0x7fe4bc162580 2024-04-24T23:08:43.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.287+0000 7fe4b8c00640 1 -- 172.21.15.146:0/2728343571 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7fe4b4058e40 con 0x7fe4bc162580 2024-04-24T23:08:43.289 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:08:43.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 msgr2=0x7fe49c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 0x7fe49c06e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0034000 tx=0x7fe4b002e000 comp rx=0 tx=0).stop 2024-04-24T23:08:43.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 msgr2=0x7fe4bc15d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400b9a0 tx=0x7fe4b400be60 comp rx=0 tx=0).stop 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 shutdown_connections 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc162580 0x7fe4bc15d700 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4bc15e310 0x7fe4bc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe49c06be60 0x7fe49c06e320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 --2- 172.21.15.146:0/2728343571 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4bc158300 0x7fe4bc14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 >> 172.21.15.146:0/2728343571 conn(0x7fe4bc06b560 msgr2=0x7fe4bc0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 shutdown_connections 2024-04-24T23:08:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.290+0000 7fe4c2200640 1 -- 172.21.15.146:0/2728343571 wait complete. 2024-04-24T23:08:43.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:08:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.508+0000 7f3dd7e00640 1 Processor -- start 2024-04-24T23:08:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.508+0000 7f3dd7e00640 1 -- start start 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd7e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3dd013ef30 0x7f3dd0141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd7e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3dd0071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd7e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd00ced40 con 0x7f3dd0141ab0 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd7e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd01423d0 con 0x7f3dd013ef30 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd7e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd0070f80 con 0x7f3dd00ce770 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd4a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3dd0141ab0 0x7f3dd00ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60182/0 (socket says 172.21.15.146:60182) 2024-04-24T23:08:43.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd4a00640 1 -- 172.21.15.146:0/859357632 learned_addr learned my addr 172.21.15.146:0/859357632 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:43.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd5400640 1 --2- 172.21.15.146:0/859357632 >> v2:172.21.15.203:3300/0 conn(0x7f3dd013ef30 0x7f3dd0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.510+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3dd0071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018198878 0 0) 0x7f3dd00ced40 con 0x7f3dd0141ab0 2024-04-24T23:08:43.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3db8003520 con 0x7f3dd0141ab0 2024-04-24T23:08:43.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430945163 0 0) 0x7f3db8003520 con 0x7f3dd0141ab0 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 msgr2=0x7f3dd0071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3dd0071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 >> v2:172.21.15.203:3300/0 conn(0x7f3dd013ef30 msgr2=0x7f3dd0141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 --2- 172.21.15.146:0/859357632 >> v2:172.21.15.203:3300/0 conn(0x7f3dd013ef30 0x7f3dd0141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd00cf020 con 0x7f3dd0141ab0 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f3dbc001670 con 0x7f3dd0141ab0 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 >> v1:172.21.15.146:6789/0 conn(0x7f3dd0141ab0 legacy=0x7f3dd00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3db80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db8003f30 0x7f3db8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3db80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0070f80 con 0x7f3db8004d40 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3db800b9c0 con 0x7f3db8003f30 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.511+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3db800bb40 con 0x7f3dd00ce770 2024-04-24T23:08:43.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3db80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd4a00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db8003f30 0x7f3db8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5400640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3db80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 -- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 msgr2=0x7f3db80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00ce770 0x7f3db80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 -- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db8003f30 msgr2=0x7f3db8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3db8003f30 0x7f3db8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.512+0000 7f3dd5e00640 1 -- 172.21.15.146:0/859357632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db8003520 con 0x7f3db8004d40 2024-04-24T23:08:43.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.513+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3db80051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009fc0 tx=0x7f3db8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca19c6a99ca5a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.513+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8009c10 con 0x7f3db8004d40 2024-04-24T23:08:43.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8036070 con 0x7f3db8004d40 2024-04-24T23:08:43.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dcfe00640 1 -- 172.21.15.146:0/859357632 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8031670 con 0x7f3db8004d40 2024-04-24T23:08:43.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 -- 172.21.15.146:0/859357632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 msgr2=0x7f3db80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/859357632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3db80051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009fc0 tx=0x7f3db8005830 comp rx=0 tx=0).stop 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd5e00640 1 -- 172.21.15.146:0/859357632 reap_dead start 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 -- 172.21.15.146:0/859357632 shutdown_connections 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 -- 172.21.15.146:0/859357632 >> 172.21.15.146:0/859357632 conn(0x7f3dd00b17b0 msgr2=0x7f3dd00b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 -- 172.21.15.146:0/859357632 shutdown_connections 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.514+0000 7f3dd7e00640 1 -- 172.21.15.146:0/859357632 wait complete. 2024-04-24T23:08:43.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.516+0000 7f3dd7e00640 1 Processor -- start 2024-04-24T23:08:43.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.516+0000 7f3dd7e00640 1 -- start start 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 0x7f3dd00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00add40 0x7f3dd00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0071410 con 0x7f3db8004d40 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0070c10 con 0x7f3dd00ad8c0 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.517+0000 7f3dd7e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd0071590 con 0x7f3dd00add40 2024-04-24T23:08:43.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54478/0 (socket says 172.21.15.146:54478) 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 -- 172.21.15.146:0/303449816 learned_addr learned my addr 172.21.15.146:0/303449816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd4a00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 0x7f3dd00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 -- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00add40 msgr2=0x7f3dd00cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00add40 0x7f3dd00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00add40 0x7f3dd00cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 -- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 msgr2=0x7f3dd00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 0x7f3dd00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd5400640 1 -- 172.21.15.146:0/303449816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd00ae310 con 0x7f3db8004d40 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.518+0000 7f3dd4a00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 0x7f3dd00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dd5400640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40116d0 tx=0x7f3dc4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400f9c0 con 0x7f3db8004d40 2024-04-24T23:08:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc400fb60 con 0x7f3db8004d40 2024-04-24T23:08:43.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd00ae5f0 con 0x7f3db8004d40 2024-04-24T23:08:43.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4015460 con 0x7f3db8004d40 2024-04-24T23:08:43.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.519+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd0130bb0 con 0x7f3db8004d40 2024-04-24T23:08:43.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.520+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd004f5a0 con 0x7f3db8004d40 2024-04-24T23:08:43.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.521+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dc4015600 con 0x7f3db8004d40 2024-04-24T23:08:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.522+0000 7f3dcd600640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 0x7f3db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.522+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f3dc408bba0 con 0x7f3db8004d40 2024-04-24T23:08:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.523+0000 7f3dd4a00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 0x7f3db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.524+0000 7f3dd4a00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 0x7f3db006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3dd013e840 tx=0x7f3dbc001df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.526+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3dc4019030 con 0x7f3db8004d40 2024-04-24T23:08:43.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.727+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3dd0072d30 con 0x7f3db8004d40 2024-04-24T23:08:43.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.728+0000 7f3dcd600640 1 -- 172.21.15.146:0/303449816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) ==== 104+0+11 (secure 0 0 0) 0x7f3dc405a200 con 0x7f3db8004d40 2024-04-24T23:08:43.730 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:08:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 msgr2=0x7f3db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 0x7f3db006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3dd013e840 tx=0x7f3dbc001df0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 msgr2=0x7f3dd0152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40116d0 tx=0x7f3dc4011b90 comp rx=0 tx=0).stop 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 shutdown_connections 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3db006be30 0x7f3db006e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3dd00add40 0x7f3dd00cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dd00ad8c0 0x7f3dd00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 --2- 172.21.15.146:0/303449816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db8004d40 0x7f3dd0152d10 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 >> 172.21.15.146:0/303449816 conn(0x7f3dd00b17b0 msgr2=0x7f3dd0141320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 shutdown_connections 2024-04-24T23:08:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.731+0000 7f3dd7e00640 1 -- 172.21.15.146:0/303449816 wait complete. 2024-04-24T23:08:43.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:08:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.949+0000 7fb902c00640 1 Processor -- start 2024-04-24T23:08:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.949+0000 7fb902c00640 1 -- start start 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb902c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8fc155460 0x7fb8fc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb902c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb8fc0b2ab0 0x7fb8fc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb902c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8fc0b3250 con 0x7fb8fc06e870 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb902c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc0723f0 con 0x7fb8fc155460 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb902c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc06ecc0 con 0x7fb8fc0b2ab0 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb8fbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8fc155460 0x7fb8fc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb8fbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8fc155460 0x7fb8fc15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54490/0 (socket says 172.21.15.146:54490) 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb8fbe00640 1 -- 172.21.15.146:0/97871783 learned_addr learned my addr 172.21.15.146:0/97871783 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.951+0000 7fb8f3400640 1 --2- 172.21.15.146:0/97871783 >> v2:172.21.15.203:3300/0 conn(0x7fb8fc0b2ab0 0x7fb8fc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.952+0000 7fb8fbe00640 1 -- 172.21.15.146:0/97871783 >> v2:172.21.15.203:3300/0 conn(0x7fb8fc0b2ab0 msgr2=0x7fb8fc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.952+0000 7fb8fbe00640 1 --2- 172.21.15.146:0/97871783 >> v2:172.21.15.203:3300/0 conn(0x7fb8fc0b2ab0 0x7fb8fc06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.952+0000 7fb8fbe00640 1 -- 172.21.15.146:0/97871783 >> v1:172.21.15.203:6789/0 conn(0x7fb8fc06e870 legacy=0x7fb8fc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.952+0000 7fb8fbe00640 1 -- 172.21.15.146:0/97871783 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0b3530 con 0x7fb8fc155460 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.953+0000 7fb8fbe00640 1 --2- 172.21.15.146:0/97871783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc155460 0x7fb8fc15be40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06f010 tx=0x7fb8ec02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e70e3c59132974d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.953+0000 7fb8fb400640 1 -- 172.21.15.146:0/97871783 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0325a0 con 0x7fb8fc155460 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.953+0000 7fb8fb400640 1 -- 172.21.15.146:0/97871783 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec038070 con 0x7fb8fc155460 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.953+0000 7fb8fb400640 1 -- 172.21.15.146:0/97871783 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec032960 con 0x7fb8fc155460 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 -- 172.21.15.146:0/97871783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc155460 msgr2=0x7fb8fc15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 --2- 172.21.15.146:0/97871783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc155460 0x7fb8fc15be40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06f010 tx=0x7fb8ec02c8e0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 -- 172.21.15.146:0/97871783 shutdown_connections 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 --2- 172.21.15.146:0/97871783 >> v2:172.21.15.203:3300/0 conn(0x7fb8fc0b2ab0 0x7fb8fc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 --2- 172.21.15.146:0/97871783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc155460 0x7fb8fc15be40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 -- 172.21.15.146:0/97871783 >> 172.21.15.146:0/97871783 conn(0x7fb8fc0b17b0 msgr2=0x7fb8fc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 -- 172.21.15.146:0/97871783 shutdown_connections 2024-04-24T23:08:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.954+0000 7fb902c00640 1 -- 172.21.15.146:0/97871783 wait complete. 2024-04-24T23:08:43.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.955+0000 7fb902c00640 1 Processor -- start 2024-04-24T23:08:43.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.956+0000 7fb902c00640 1 -- start start 2024-04-24T23:08:43.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.956+0000 7fb902c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb902c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8fc0b2ab0 0x7fb8fc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb902c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8fc155460 0x7fb8fc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb902c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b2f60 con 0x7fb8fc06e870 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb902c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc070ec0 con 0x7fb8fc155460 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb902c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b3af0 con 0x7fb8fc0b2ab0 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54504/0 (socket says 172.21.15.146:54504) 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 -- 172.21.15.146:0/1124291925 learned_addr learned my addr 172.21.15.146:0/1124291925 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb900c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8fc155460 0x7fb8fc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8f3400640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8fc0b2ab0 0x7fb8fc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 -- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8fc0b2ab0 msgr2=0x7fb8fc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8fc0b2ab0 0x7fb8fc06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 -- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8fc155460 msgr2=0x7fb8fc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8fc155460 0x7fb8fc06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.957+0000 7fb8fbe00640 1 -- 172.21.15.146:0/1124291925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc1f4350 con 0x7fb8fc06e870 2024-04-24T23:08:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb8fbe00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00b2c0 tx=0x7fb8ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec043070 con 0x7fb8fc06e870 2024-04-24T23:08:43.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec033c70 con 0x7fb8fc06e870 2024-04-24T23:08:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec03c660 con 0x7fb8fc06e870 2024-04-24T23:08:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc1f4630 con 0x7fb8fc06e870 2024-04-24T23:08:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.958+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1f4bf0 con 0x7fb8fc06e870 2024-04-24T23:08:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.959+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc04f5a0 con 0x7fb8fc06e870 2024-04-24T23:08:43.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.960+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8ec046070 con 0x7fb8fc06e870 2024-04-24T23:08:43.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.961+0000 7fb8f8c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:43.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.961+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7fb8ec030020 con 0x7fb8fc06e870 2024-04-24T23:08:43.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.962+0000 7fb8f3400640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:43.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.963+0000 7fb8f3400640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:43.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:43.966+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8ec04d030 con 0x7fb8fc06e870 2024-04-24T23:08:44.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.170+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb8fc06ce50 con 0x7fb8fc06e870 2024-04-24T23:08:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.171+0000 7fb8f8c00640 1 -- 172.21.15.146:0/1124291925 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) ==== 100+0+11 (secure 0 0 0) 0x7fb8ec033e20 con 0x7fb8fc06e870 2024-04-24T23:08:44.173 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 msgr2=0x7fb8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4008040 comp rx=0 tx=0).stop 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 msgr2=0x7fb8fc151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00b2c0 tx=0x7fb8ec004730 comp rx=0 tx=0).stop 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 shutdown_connections 2024-04-24T23:08:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8fc155460 0x7fb8fc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8fc0b2ab0 0x7fb8fc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 --2- 172.21.15.146:0/1124291925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8fc06e870 0x7fb8fc151970 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 >> 172.21.15.146:0/1124291925 conn(0x7fb8fc0b17b0 msgr2=0x7fb8fc1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 shutdown_connections 2024-04-24T23:08:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.175+0000 7fb902c00640 1 -- 172.21.15.146:0/1124291925 wait complete. 2024-04-24T23:08:44.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:08:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.382+0000 7fccbf600640 1 Processor -- start 2024-04-24T23:08:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.382+0000 7fccbf600640 1 -- start start 2024-04-24T23:08:44.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbf600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccb80aee30 0x7fccb8072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbf600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 0x7fccb8071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbf600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb80af210 con 0x7fccb8072060 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbf600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fccb8072c60 con 0x7fccb80aee30 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbf600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fccb8071040 con 0x7fccb80b3550 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccb80aee30 0x7fccb8072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccb80aee30 0x7fccb8072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54516/0 (socket says 172.21.15.146:54516) 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 -- 172.21.15.146:0/2401957325 learned_addr learned my addr 172.21.15.146:0/2401957325 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccafe00640 1 --2- 172.21.15.146:0/2401957325 >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 0x7fccb8071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 -- 172.21.15.146:0/2401957325 >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 msgr2=0x7fccb8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 --2- 172.21.15.146:0/2401957325 >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 0x7fccb8071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.384+0000 7fccbcc00640 1 -- 172.21.15.146:0/2401957325 >> v1:172.21.15.203:6789/0 conn(0x7fccb8072060 legacy=0x7fccb8161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.385+0000 7fccbcc00640 1 -- 172.21.15.146:0/2401957325 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb8071320 con 0x7fccb80aee30 2024-04-24T23:08:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.385+0000 7fccafe00640 1 --2- 172.21.15.146:0/2401957325 >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 0x7fccb8071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.386+0000 7fccbcc00640 1 --2- 172.21.15.146:0/2401957325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80aee30 0x7fccb8072680 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fccb80af490 tx=0x7fcca802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f90cbe798494a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.386+0000 7fccb7e00640 1 -- 172.21.15.146:0/2401957325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8037070 con 0x7fccb80aee30 2024-04-24T23:08:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.386+0000 7fccb7e00640 1 -- 172.21.15.146:0/2401957325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8032440 con 0x7fccb80aee30 2024-04-24T23:08:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.386+0000 7fccb7e00640 1 -- 172.21.15.146:0/2401957325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8032810 con 0x7fccb80aee30 2024-04-24T23:08:44.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 -- 172.21.15.146:0/2401957325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80aee30 msgr2=0x7fccb8072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 --2- 172.21.15.146:0/2401957325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80aee30 0x7fccb8072680 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fccb80af490 tx=0x7fcca802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 -- 172.21.15.146:0/2401957325 shutdown_connections 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 --2- 172.21.15.146:0/2401957325 >> v2:172.21.15.203:3300/0 conn(0x7fccb80b3550 0x7fccb8071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 --2- 172.21.15.146:0/2401957325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80aee30 0x7fccb8072680 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 -- 172.21.15.146:0/2401957325 >> 172.21.15.146:0/2401957325 conn(0x7fccb806b140 msgr2=0x7fccb806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 -- 172.21.15.146:0/2401957325 shutdown_connections 2024-04-24T23:08:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.387+0000 7fccbf600640 1 -- 172.21.15.146:0/2401957325 wait complete. 2024-04-24T23:08:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.389+0000 7fccbf600640 1 Processor -- start 2024-04-24T23:08:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.389+0000 7fccbf600640 1 -- start start 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 0x7fccb8146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 0x7fccb80b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80b39c0 con 0x7fccb80b3550 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fccb81623c0 con 0x7fccb80aee30 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbf600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fccb8151130 con 0x7fccb8072060 2024-04-24T23:08:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54522/0 (socket says 172.21.15.146:54522) 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.390+0000 7fccbd600640 1 -- 172.21.15.146:0/1883065345 learned_addr learned my addr 172.21.15.146:0/1883065345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbcc00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 0x7fccb8146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccafe00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 0x7fccb80b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 -- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 msgr2=0x7fccb8146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 0x7fccb8146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 -- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 msgr2=0x7fccb80b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 0x7fccb80b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 -- 172.21.15.146:0/1883065345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb8151380 con 0x7fccb80b3550 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbcc00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 0x7fccb8146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccafe00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 0x7fccb80b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:44.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.391+0000 7fccbd600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c700 tx=0x7fccb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:44.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.392+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0016020 con 0x7fccb80b3550 2024-04-24T23:08:44.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.392+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb000aa50 con 0x7fccb80b3550 2024-04-24T23:08:44.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.392+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb8151660 con 0x7fccb80b3550 2024-04-24T23:08:44.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.392+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000ce10 con 0x7fccb80b3550 2024-04-24T23:08:44.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.392+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb8151c20 con 0x7fccb80b3550 2024-04-24T23:08:44.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.393+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb804f5a0 con 0x7fccb80b3550 2024-04-24T23:08:44.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.394+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccb0019020 con 0x7fccb80b3550 2024-04-24T23:08:44.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.395+0000 7fccb5600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 0x7fcc9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:44.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.395+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7fccb008b4d0 con 0x7fccb80b3550 2024-04-24T23:08:44.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.396+0000 7fccbcc00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 0x7fcc9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.397+0000 7fccbcc00640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 0x7fcc9406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcca8034000 tx=0x7fcca802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.400+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fccb0020020 con 0x7fccb80b3550 2024-04-24T23:08:44.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.614+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fccb80b45a0 con 0x7fccb80b3550 2024-04-24T23:08:44.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.614+0000 7fccb5600640 1 -- 172.21.15.146:0/1883065345 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v71) ==== 80+0+122 (secure 0 0 0) 0x7fccb0059b30 con 0x7fccb80b3550 2024-04-24T23:08:44.617 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6834/896278918 2024-04-25T23:07:41.602501+0000 2024-04-24T23:08:44.617 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6832/896278918 2024-04-25T23:07:41.602501+0000 2024-04-24T23:08:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-04-24T23:08:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 msgr2=0x7fcc9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 0x7fcc9406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcca8034000 tx=0x7fcca802e000 comp rx=0 tx=0).stop 2024-04-24T23:08:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 msgr2=0x7fccb80b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c700 tx=0x7fccb000cbc0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 shutdown_connections 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb80b3550 0x7fccb80b0df0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb80aee30 0x7fccb80b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc9406be30 0x7fcc9406e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 --2- 172.21.15.146:0/1883065345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb8072060 0x7fccb8146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 >> 172.21.15.146:0/1883065345 conn(0x7fccb806b140 msgr2=0x7fccb80af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 shutdown_connections 2024-04-24T23:08:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:44.617+0000 7fccbf600640 1 -- 172.21.15.146:0/1883065345 wait complete. 2024-04-24T23:08:44.638 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:08:44.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:44.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-24T23:08:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:umount: /home/ubuntu/cephtest/mnt.0: target is busy. 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_925 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_926 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_927 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_928 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_929 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_93 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_930 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_931 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_932 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_933 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_934 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_935 2024-04-24T23:08:44.729 INFO:teuthology.orchestra.run.smithi146.stdout:file_936 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_937 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_938 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_939 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_94 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_940 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_941 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_942 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_943 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_944 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_945 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_946 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_947 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_948 2024-04-24T23:08:44.730 INFO:teuthology.orchestra.run.smithi146.stdout:file_949 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_95 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_950 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_951 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_952 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_953 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_954 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_955 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_956 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_957 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_958 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_959 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_96 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_960 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_961 2024-04-24T23:08:44.731 INFO:teuthology.orchestra.run.smithi146.stdout:file_962 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_963 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_964 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_965 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_966 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_967 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_968 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_969 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_97 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_970 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_971 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_972 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_973 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_974 2024-04-24T23:08:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:file_975 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_976 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_977 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_978 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_979 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_98 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_980 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_981 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_982 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_983 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_984 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_985 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_986 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_987 2024-04-24T23:08:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:file_988 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_989 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_99 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_990 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_991 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_992 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_993 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_994 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_995 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_996 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_997 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_998 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:file_999 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:./bravo: 2024-04-24T23:08:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:ls: reading directory './bravo': Input/output error 2024-04-24T23:08:44.736 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-24T23:08:44.736 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2024-04-24T23:08:44.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:44.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-04-24T23:08:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:lsof: WARNING: can't stat() ceph file system /home/ubuntu/cephtest/mnt.0 2024-04-24T23:08:44.837 INFO:teuthology.orchestra.run.smithi146.stderr: Output information may be incomplete. 2024-04-24T23:08:47.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:08:47.058 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:08:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-04-24T23:08:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root txt REG 8,1 98216 18583 /usr/lib/systemd/systemd 2024-04-24T23:08:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 598426 850 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 21219 62136 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 2157904 46429 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 4u a_inode 0,15 0 50 [eventpoll:5,6,8,9,11,14,15,16,17,18,19,44,45,49,81,82,86,92,95,96,97,100,101,102,103,104,111,112,114,115,116,130...] 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 5u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 6r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 7r DIR 0,26 0 1 /sys/fs/cgroup 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 8u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 9u a_inode 0,15 0 50 [eventpoll:10,13] 2024-04-24T23:08:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 10r REG 0,21 0 5445 /proc/1/mountinfo 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 11r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 12u netlink 0t0 6303 AUDIT 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 13r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 14r REG 0,21 0 4026532078 /proc/swaps 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 15u netlink 0t0 6295 KOBJECT_UEVENT 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 16u unix 0xffff88810be29e00 0t0 6297 /run/systemd/private type=STREAM (LISTEN) 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 17u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 18r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 19r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 20u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 21u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 23u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 24u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 25u unix 0xffff88810be2da00 0t0 6347 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 26u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 27r CHR 10,235 0t0 110 /dev/autofs 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 28u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 29u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 30u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 31u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 32u a_inode 0,15 0 50 bpf-prog 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 44u unix 0xffff8881092ca580 0t0 5453 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 45u unix 0xffff8881092c9e00 0t0 5452 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 49u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 60u unix 0xffff88810216b480 0t0 8657 type=STREAM (CONNECTED) 2024-04-24T23:08:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 81u unix 0xffff8881092c8000 0t0 5447 /run/systemd/notify type=DGRAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 82u unix 0xffff8881092c8780 0t0 5448 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 83u unix 0xffff8881092c8f00 0t0 5449 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 86u unix 0xffff88810be2ad00 0t0 6307 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 87u unix 0xffff88810fb6bc00 0t0 4048 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 92u unix 0xffff88810bd8f800 0t0 62398 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 94u unix 0xffff888102168000 0t0 9533 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 95u unix 0xffff88817d1d9680 0t0 9236 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 96u unix 0xffff88810be2d280 0t0 4892 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 97u unix 0xffff8881092cc380 0t0 4889 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 98u unix 0xffff88810fc4f080 0t0 7590 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 99u unix 0xffff88810bd88000 0t0 7587 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 100u unix 0xffff88810fb6a580 0t0 4697 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 101u unix 0xffff88810bd8ad00 0t0 4694 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 102u unix 0xffff8881092cf800 0t0 4675 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 103u unix 0xffff88810fc48000 0t0 4622 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 104u unix 0xffff88810bd8f080 0t0 3966 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 109u unix 0xffff88810bd50f00 0t0 4222 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 110u unix 0xffff88810bd51680 0t0 4224 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 111u unix 0xffff88810216bc00 0t0 8641 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 112u FIFO 0,25 0t0 429 /run/initctl 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 113u unix 0xffff88810be2c380 0t0 6321 /run/udev/control type=SEQPACKET (LISTEN) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 114r FIFO 0,14 0t0 8492 pipe 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 115u FIFO 0,25 0t0 423 /run/dmeventd-server 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 116u FIFO 0,25 0t0 424 /run/dmeventd-client 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 117u netlink 0t0 6323 KOBJECT_UEVENT 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 122u unix 0xffff88810bd50780 0t0 4220 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 125u unix 0xffff88810be2b480 0t0 6309 /run/rpcbind.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 126u IPv4 248 0t0 TCP *:sunrpc (LISTEN) 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 127u IPv4 254 0t0 UDP *:sunrpc 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 128u IPv6 3939 0t0 TCP *:sunrpc (LISTEN) 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 129u IPv6 260 0t0 UDP *:sunrpc 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 1 root 130u unix 0xffff88810be2bc00 0t0 6319 /run/systemd/coredump type=SEQPACKET (LISTEN) 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kthreadd 2 root txt unknown /proc/2/exe 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:pool_work 3 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:pool_work 3 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:pool_work 3 root txt unknown /proc/3/exe 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 4 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 4 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 4 root txt unknown /proc/4/exe 2024-04-24T23:08:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 5 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 5 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 5 root txt unknown /proc/5/exe 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 6 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 6 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 6 root txt unknown /proc/6/exe 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 9 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 9 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 9 root txt unknown /proc/9/exe 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 10 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 10 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 10 root txt unknown /proc/10/exe 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 11 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 11 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 11 root txt unknown /proc/11/exe 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_preem 16 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_preem 16 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_preem 16 root txt unknown /proc/16/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_p 17 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_p 17 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_p 17 root txt unknown /proc/17/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_g 18 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_g 18 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:rcu_exp_g 18 root txt unknown /proc/18/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:migration 19 root txt unknown /proc/19/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/0 20 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/0 20 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/0 20 root txt unknown /proc/20/exe 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/1 21 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/1 21 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/1 21 root txt unknown /proc/21/exe 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:migration 22 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:migration 22 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:migration 22 root txt unknown /proc/22/exe 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 23 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 23 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 23 root txt unknown /proc/23/exe 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 25 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 25 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 25 root txt unknown /proc/25/exe 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/2 26 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/2 26 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/2 26 root txt unknown /proc/26/exe 2024-04-24T23:08:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:migration 27 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:migration 27 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:migration 27 root txt unknown /proc/27/exe 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 28 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 28 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 28 root txt unknown /proc/28/exe 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 30 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 30 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 30 root txt unknown /proc/30/exe 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/3 31 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/3 31 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/3 31 root txt unknown /proc/31/exe 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:migration 32 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:migration 32 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:migration 32 root txt unknown /proc/32/exe 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 33 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 33 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 33 root txt unknown /proc/33/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 35 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 35 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 35 root txt unknown /proc/35/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/4 36 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/4 36 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/4 36 root txt unknown /proc/36/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:migration 37 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:migration 37 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:migration 37 root txt unknown /proc/37/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 38 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 38 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 38 root txt unknown /proc/38/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 40 root txt unknown /proc/40/exe 2024-04-24T23:08:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/5 41 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/5 41 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/5 41 root txt unknown /proc/41/exe 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:migration 42 root txt unknown /proc/42/exe 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 45 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 45 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 45 root txt unknown /proc/45/exe 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/6 46 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/6 46 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/6 46 root txt unknown /proc/46/exe 2024-04-24T23:08:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:migration 47 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:migration 47 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:migration 47 root txt unknown /proc/47/exe 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 48 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 48 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 48 root txt unknown /proc/48/exe 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 50 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 50 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 50 root txt unknown /proc/50/exe 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/7 51 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/7 51 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:cpuhp/7 51 root txt unknown /proc/51/exe 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:migration 52 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:migration 52 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:migration 52 root txt unknown /proc/52/exe 2024-04-24T23:08:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 53 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 53 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:ksoftirqd 53 root txt unknown /proc/53/exe 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 55 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 55 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 55 root txt unknown /proc/55/exe 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kdevtmpfs 56 root cwd DIR 0,6 3320 1 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kdevtmpfs 56 root rtd DIR 0,6 3320 1 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kdevtmpfs 56 root txt unknown /proc/56/exe 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 57 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 57 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 57 root txt unknown /proc/57/exe 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kauditd 58 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kauditd 58 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:kauditd 58 root txt unknown /proc/58/exe 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:khungtask 59 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:khungtask 59 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:khungtask 59 root txt unknown /proc/59/exe 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:oom_reape 61 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:oom_reape 61 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:oom_reape 61 root txt unknown /proc/61/exe 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 63 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 63 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 63 root txt unknown /proc/63/exe 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kcompactd 64 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kcompactd 64 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:kcompactd 64 root txt unknown /proc/64/exe 2024-04-24T23:08:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:ksmd 65 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:ksmd 65 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:ksmd 65 root txt unknown /proc/65/exe 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:khugepage 66 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:khugepage 66 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:khugepage 66 root txt unknown /proc/66/exe 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 67 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 67 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 67 root txt unknown /proc/67/exe 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 68 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 68 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 68 root txt unknown /proc/68/exe 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 69 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 69 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 69 root txt unknown /proc/69/exe 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 70 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 70 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 70 root txt unknown /proc/70/exe 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:irq/9-acp 78 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:irq/9-acp 78 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:irq/9-acp 78 root txt unknown /proc/78/exe 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 79 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 79 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 79 root txt unknown /proc/79/exe 2024-04-24T23:08:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 80 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 80 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 80 root txt unknown /proc/80/exe 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 81 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 81 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 81 root txt unknown /proc/81/exe 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 82 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 82 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 82 root txt unknown /proc/82/exe 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 83 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 83 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 83 root txt unknown /proc/83/exe 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:watchdogd 84 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:watchdogd 84 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:watchdogd 84 root txt unknown /proc/84/exe 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 85 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 85 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 85 root txt unknown /proc/85/exe 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kswapd0 86 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kswapd0 86 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kswapd0 86 root txt unknown /proc/86/exe 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 88 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 88 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 88 root txt unknown /proc/88/exe 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 91 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 91 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 91 root txt unknown /proc/91/exe 2024-04-24T23:08:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_0 92 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_0 92 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_0 92 root txt unknown /proc/92/exe 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 93 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 93 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 93 root txt unknown /proc/93/exe 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_1 94 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_1 94 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_1 94 root txt unknown /proc/94/exe 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 95 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 95 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 95 root txt unknown /proc/95/exe 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_2 96 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_2 96 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_2 96 root txt unknown /proc/96/exe 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 97 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 97 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 97 root txt unknown /proc/97/exe 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_3 98 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_3 98 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_3 98 root txt unknown /proc/98/exe 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 99 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 99 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 99 root txt unknown /proc/99/exe 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 100 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 100 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 100 root txt unknown /proc/100/exe 2024-04-24T23:08:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 101 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 101 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 101 root txt unknown /proc/101/exe 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_4 103 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_4 103 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_4 103 root txt unknown /proc/103/exe 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 104 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 104 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 104 root txt unknown /proc/104/exe 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_5 105 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_5 105 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_5 105 root txt unknown /proc/105/exe 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 106 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 106 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 106 root txt unknown /proc/106/exe 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_6 107 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_6 107 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_6 107 root txt unknown /proc/107/exe 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 108 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 108 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 108 root txt unknown /proc/108/exe 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_7 109 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_7 109 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_7 109 root txt unknown /proc/109/exe 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 110 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 110 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 110 root txt unknown /proc/110/exe 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_8 111 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_8 111 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_8 111 root txt unknown /proc/111/exe 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 112 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 112 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 112 root txt unknown /proc/112/exe 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_9 113 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_9 113 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:scsi_eh_9 113 root txt unknown /proc/113/exe 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 114 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 114 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 114 root txt unknown /proc/114/exe 2024-04-24T23:08:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 116 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 116 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 116 root txt unknown /proc/116/exe 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 119 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 119 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 119 root txt unknown /proc/119/exe 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 128 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 128 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 128 root txt unknown /proc/128/exe 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 129 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 129 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 129 root txt unknown /proc/129/exe 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 130 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 130 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 130 root txt unknown /proc/130/exe 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 131 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 131 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 131 root txt unknown /proc/131/exe 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 132 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 132 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 132 root txt unknown /proc/132/exe 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 140 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 140 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 140 root txt unknown /proc/140/exe 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 210 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 210 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 210 root txt unknown /proc/210/exe 2024-04-24T23:08:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 212 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 212 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 212 root txt unknown /proc/212/exe 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 252 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 252 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 252 root txt unknown /proc/252/exe 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 263 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 263 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 263 root txt unknown /proc/263/exe 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 299 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 299 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 299 root txt unknown /proc/299/exe 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 403 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 403 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 403 root txt unknown /proc/403/exe 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 404 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 404 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 404 root txt unknown /proc/404/exe 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 411 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 411 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 411 root txt unknown /proc/411/exe 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 433 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 433 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 433 root txt unknown /proc/433/exe 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:jbd2/sda1 444 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:jbd2/sda1 444 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:jbd2/sda1 444 root txt unknown /proc/444/exe 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 445 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 445 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 445 root txt unknown /proc/445/exe 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root txt REG 8,1 185640 18590 /usr/lib/systemd/systemd-journald 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root mem REG 0,25 8 56 /run/systemd/journal/kernel-seqnum 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 3u unix 0xffff88810bd50780 0t0 4220 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-04-24T23:08:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 4u unix 0xffff88810bd50f00 0t0 4222 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 5u unix 0xffff88810bd51680 0t0 4224 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 6w CHR 1,11 0t0 10 /dev/kmsg 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 7u a_inode 0,15 0 50 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,22,23,24,27,28,30,31] 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 8u CHR 1,11 0t0 10 /dev/kmsg 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 9u unix 0xffff88810fc4d280 0t0 2275 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 10r REG 0,21 0 3775 /proc/sys/kernel/hostname 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 11u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 12u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 13u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 14u unix 0xffff88810fc4cb00 0t0 2276 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 15u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 16u REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 17u unix 0xffff88810bd8f080 0t0 3966 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 18u unix 0xffff8881092cf800 0t0 4675 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 19u unix 0xffff88810bd8ad00 0t0 4694 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 20u unix 0xffff88810fc48000 0t0 4622 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 21u unix 0xffff888102168000 0t0 9533 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 22u unix 0xffff88810fc4f080 0t0 7590 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 23u unix 0xffff88810fb6a580 0t0 4697 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 24u unix 0xffff88810bd88000 0t0 7587 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 27u unix 0xffff8881092cc380 0t0 4889 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 28u unix 0xffff88810be2d280 0t0 4892 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 30u unix 0xffff88817d1d9680 0t0 9236 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-j 523 root 31u unix 0xffff88810bd8f800 0t0 62398 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:ext4lazyi 531 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:ext4lazyi 531 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:ext4lazyi 531 root txt unknown /proc/531/exe 2024-04-24T23:08:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root txt REG 8,1 598008 9078 /usr/bin/udevadm 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 11730661 64009 /etc/udev/hwdb.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 598426 850 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 10610 264155 /usr/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 285055 264154 /usr/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 553079 264151 /usr/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 176703 264149 /usr/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-24T23:08:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 21219 62136 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 1u unix 0xffff88810bd8e900 0t0 304 type=STREAM (CONNECTED) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 2u unix 0xffff88810bd8e900 0t0 304 type=STREAM (CONNECTED) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 3u unix 0xffff88810be2c380 0t0 6321 /run/udev/control type=SEQPACKET (LISTEN) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 4u netlink 0t0 6323 KOBJECT_UEVENT 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 5u unix 0xffff88810bd8d280 0t0 316 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 6u unix 0xffff88810bd8cb00 0t0 320 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 7u unix 0xffff88810bd8c380 0t0 321 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 9u a_inode 0,15 0 50 [eventpoll:3,4,6,8,10,11,14] 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 10u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 11u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 12r REG 8,1 11730661 64009 /etc/udev/hwdb.bin 2024-04-24T23:08:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-u 538 root 14u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc txt REG 8,1 61400 13830 /usr/bin/rpcbind 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 196224 8914 /usr/lib64/libtirpc.so.3.0.0 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 1u unix 0xffff88810fc48780 0t0 2342 type=STREAM (CONNECTED) 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 2u unix 0xffff88810fc48780 0t0 2342 type=STREAM (CONNECTED) 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 3u unix 0xffff88810be2b480 0t0 6309 /run/rpcbind.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 4u IPv4 248 0t0 TCP *:sunrpc (LISTEN) 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 5u IPv4 254 0t0 UDP *:sunrpc 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 6u IPv6 3939 0t0 TCP *:sunrpc (LISTEN) 2024-04-24T23:08:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 7u IPv6 260 0t0 UDP *:sunrpc 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:rpcbind 598 rpc 8rW REG 0,25 0 975 /run/rpcbind/rpcbind.lock 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 602 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 602 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 602 root txt unknown /proc/602/exe 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kipmi0 610 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kipmi0 610 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:kipmi0 610 root txt unknown /proc/610/exe 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root txt REG 8,1 140632 9260 /usr/sbin/auditd 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 147792 7213 /usr/lib64/libauparse.so.0.0.0 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 3u netlink 0t0 4635 AUDIT 2024-04-24T23:08:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 4w REG 8,1 3755427 64048 /var/log/audit/audit.log 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 6u unix 0xffff88810bd56900 0t0 4638 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 7u unix 0xffff88810bd57080 0t0 4637 type=STREAM (CONNECTED) 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 8u unix 0xffff88810bd56180 0t0 4639 type=STREAM (CONNECTED) 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 9u unix 0xffff88810bd54380 0t0 4640 type=STREAM (CONNECTED) 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 root 10u a_inode 0,15 0 50 [eventfd:0] 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root txt REG 8,1 140632 9260 /usr/sbin/auditd 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 147792 7213 /usr/lib64/libauparse.so.0.0.0 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 3u netlink 0t0 4635 AUDIT 2024-04-24T23:08:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 4w REG 8,1 3755427 64048 /var/log/audit/audit.log 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 6u unix 0xffff88810bd56900 0t0 4638 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 7u unix 0xffff88810bd57080 0t0 4637 type=STREAM (CONNECTED) 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 8u unix 0xffff88810bd56180 0t0 4639 type=STREAM (CONNECTED) 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 9u unix 0xffff88810bd54380 0t0 4640 type=STREAM (CONNECTED) 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 612 auditd root 10u a_inode 0,15 0 50 [eventfd:0] 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root txt REG 8,1 140632 9260 /usr/sbin/auditd 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 147792 7213 /usr/lib64/libauparse.so.0.0.0 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 3u netlink 0t0 4635 AUDIT 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 4w REG 8,1 3755427 64048 /var/log/audit/audit.log 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 6u unix 0xffff88810bd56900 0t0 4638 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 7u unix 0xffff88810bd57080 0t0 4637 type=STREAM (CONNECTED) 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 8u unix 0xffff88810bd56180 0t0 4639 type=STREAM (CONNECTED) 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 9u unix 0xffff88810bd54380 0t0 4640 type=STREAM (CONNECTED) 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:auditd 611 614 auditd root 10u a_inode 0,15 0 50 [eventfd:0] 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root txt REG 8,1 19624 9398 /usr/sbin/sedispatch 2024-04-24T23:08:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 147792 7213 /usr/lib64/libauparse.so.0.0.0 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 343752 7611 /usr/lib64/libdbus-1.so.3.19.13 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root 0u unix 0xffff88810bd57800 0t0 4636 type=STREAM (CONNECTED) 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:sedispatc 613 root 3u unix 0xffff88810fc4a580 0t0 2609 type=STREAM (CONNECTED) 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 619 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 619 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 619 root txt unknown /proc/619/exe 2024-04-24T23:08:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 620 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 620 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 620 root txt unknown /proc/620/exe 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus txt REG 8,1 131896 8696 /usr/bin/dbus-broker-launch 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus DEL REG 0,1 2048 /memfd:dbus-broker-log 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 1u unix 0xffff8881092cf080 0t0 5580 type=STREAM (CONNECTED) 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 2u unix 0xffff8881092cf080 0t0 5580 type=STREAM (CONNECTED) 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 3u unix 0xffff88810fb6bc00 0t0 4048 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 4u unix 0xffff88810fd74b00 0t0 7581 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 5u a_inode 0,15 0 50 [eventpoll:6,7,8,9,10,11] 2024-04-24T23:08:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 6u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 7r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 8u unix 0xffff88810fd73c00 0t0 7583 type=STREAM (CONNECTED) 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 9u unix 0xffff88810fd71e00 0t0 7585 type=STREAM (CONNECTED) 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 10u REG 0,5 0 957 pidfd 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 11u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 639 dbus 12u REG 0,1 2097152 2048 /memfd:dbus-broker-log (deleted) 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus txt REG 8,1 236336 8695 /usr/bin/dbus-broker 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 1u unix 0xffff8881092cf080 0t0 5580 type=STREAM (CONNECTED) 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 2u unix 0xffff8881092cf080 0t0 5580 type=STREAM (CONNECTED) 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 3u sock 0,9 0t0 4683 protocol: NETLINK 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 4u unix 0xffff88810fd74b00 0t0 7581 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 5u a_inode 0,15 0 50 [eventpoll:6,7,8,9,10,11,12,14,15,16,19] 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 6u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 7u unix 0xffff88810fb6bc00 0t0 4048 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 8u unix 0xffff88810216a580 0t0 4684 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 9u unix 0xffff88810fd73480 0t0 7584 type=STREAM (CONNECTED) 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 10u unix 0xffff88810fd71680 0t0 4686 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 11u unix 0xffff88810fc4ad00 0t0 7591 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 12u unix 0xffff88810bd51e00 0t0 6511 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 14u unix 0xffff88810be28000 0t0 4090 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 15u unix 0xffff88810216ad00 0t0 12447 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 16u unix 0xffff88810fc49e00 0t0 7937 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:dbus-brok 657 dbus 19u unix 0xffff888104419680 0t0 61099 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root txt REG 8,1 3748632 9116 /usr/sbin/NetworkManager 2024-04-24T23:08:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 317672 50025 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 343752 7611 /usr/lib64/libdbus-1.so.3.19.13 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 62456 7265 /usr/lib64/libjansson.so.4.14.0 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 31792 8437 /usr/lib64/libteamdctl.so.0.1.5 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 57128 48336 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-device-plugin-team.so 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root DEL REG 8,1 7492 /usr/lib64/libssl.so.3.0.7 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 626240 7471 /usr/lib64/libhogweed.so.6.8 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 94112 7384 /usr/lib64/libtasn1.so.6.6.0 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 2337504 7477 /usr/lib64/libgnutls.so.30.37.1 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 32408 8817 /usr/lib64/libndp.so.0.2.0 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 1u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 2u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 3u a_inode 0,15 0 50 [eventfd:3] 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 4u a_inode 0,15 0 50 [eventfd:4] 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 5u unix 0xffff88810bd54b00 0t0 4710 type=DGRAM (UNCONNECTED) 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 6u unix 0xffff88810bd55a00 0t0 4711 type=STREAM (CONNECTED) 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 7u a_inode 0,15 0 50 [eventfd:5] 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 8r REG 0,4 0 4026531840 net 2024-04-24T23:08:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 9r REG 0,4 0 4026532500 mnt 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 10u netlink 0t0 4715 KOBJECT_UEVENT 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 11u netlink 0t0 4716 GENERIC 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 12u netlink 0t0 4717 GENERIC 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 13u netlink 0t0 4718 ROUTE 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 14r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 15r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 16u netlink 0t0 4794 KOBJECT_UEVENT 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 17u unix 0xffff88810be28780 0t0 6515 type=STREAM (CONNECTED) 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 18u a_inode 0,15 0 50 [eventpoll] 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 19u a_inode 0,15 0 50 [eventpoll:21,26] 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 20w FIFO 0,25 0t0 1093 /run/systemd/inhibit/1.ref 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 21u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 23u a_inode 0,15 0 50 [eventpoll:24,25] 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 24u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 25u pack 6536 0t0 ARP type=SOCK_DGRAM 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 root 26u IPv4 6537 0t0 UDP smithi146.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root txt REG 8,1 3748632 9116 /usr/sbin/NetworkManager 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 317672 50025 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 343752 7611 /usr/lib64/libdbus-1.so.3.19.13 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 62456 7265 /usr/lib64/libjansson.so.4.14.0 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 31792 8437 /usr/lib64/libteamdctl.so.0.1.5 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 57128 48336 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-device-plugin-team.so 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root DEL REG 8,1 7492 /usr/lib64/libssl.so.3.0.7 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 626240 7471 /usr/lib64/libhogweed.so.6.8 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 94112 7384 /usr/lib64/libtasn1.so.6.6.0 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 2337504 7477 /usr/lib64/libgnutls.so.30.37.1 2024-04-24T23:08:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 32408 8817 /usr/lib64/libndp.so.0.2.0 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 1u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 2u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 3u a_inode 0,15 0 50 [eventfd:3] 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 4u a_inode 0,15 0 50 [eventfd:4] 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 5u unix 0xffff88810bd54b00 0t0 4710 type=DGRAM (UNCONNECTED) 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 6u unix 0xffff88810bd55a00 0t0 4711 type=STREAM (CONNECTED) 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 7u a_inode 0,15 0 50 [eventfd:5] 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 8r REG 0,4 0 4026531840 net 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 9r REG 0,4 0 4026532500 mnt 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 10u netlink 0t0 4715 KOBJECT_UEVENT 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 11u netlink 0t0 4716 GENERIC 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 12u netlink 0t0 4717 GENERIC 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 13u netlink 0t0 4718 ROUTE 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 14r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 15r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 16u netlink 0t0 4794 KOBJECT_UEVENT 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 17u unix 0xffff88810be28780 0t0 6515 type=STREAM (CONNECTED) 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 18u a_inode 0,15 0 50 [eventpoll] 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 19u a_inode 0,15 0 50 [eventpoll:21,26] 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 20w FIFO 0,25 0t0 1093 /run/systemd/inhibit/1.ref 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 21u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 23u a_inode 0,15 0 50 [eventpoll:24,25] 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 24u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 25u pack 6536 0t0 ARP type=SOCK_DGRAM 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 673 gmain root 26u IPv4 6537 0t0 UDP smithi146.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root txt REG 8,1 3748632 9116 /usr/sbin/NetworkManager 2024-04-24T23:08:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 317672 50025 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 343752 7611 /usr/lib64/libdbus-1.so.3.19.13 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 62456 7265 /usr/lib64/libjansson.so.4.14.0 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 31792 8437 /usr/lib64/libteamdctl.so.0.1.5 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 57128 48336 /usr/lib64/NetworkManager/1.47.4-1.el9/libnm-device-plugin-team.so 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root DEL REG 8,1 7492 /usr/lib64/libssl.so.3.0.7 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 626240 7471 /usr/lib64/libhogweed.so.6.8 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 94112 7384 /usr/lib64/libtasn1.so.6.6.0 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 2337504 7477 /usr/lib64/libgnutls.so.30.37.1 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 32408 8817 /usr/lib64/libndp.so.0.2.0 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 1u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 2u unix 0xffff88810bd8bc00 0t0 392 type=STREAM (CONNECTED) 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 3u a_inode 0,15 0 50 [eventfd:3] 2024-04-24T23:08:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 4u a_inode 0,15 0 50 [eventfd:4] 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 5u unix 0xffff88810bd54b00 0t0 4710 type=DGRAM (UNCONNECTED) 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 6u unix 0xffff88810bd55a00 0t0 4711 type=STREAM (CONNECTED) 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 7u a_inode 0,15 0 50 [eventfd:5] 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 8r REG 0,4 0 4026531840 net 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 9r REG 0,4 0 4026532500 mnt 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 10u netlink 0t0 4715 KOBJECT_UEVENT 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 11u netlink 0t0 4716 GENERIC 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 12u netlink 0t0 4717 GENERIC 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 13u netlink 0t0 4718 ROUTE 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 14r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 15r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 16u netlink 0t0 4794 KOBJECT_UEVENT 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 17u unix 0xffff88810be28780 0t0 6515 type=STREAM (CONNECTED) 2024-04-24T23:08:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 18u a_inode 0,15 0 50 [eventpoll] 2024-04-24T23:08:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 19u a_inode 0,15 0 50 [eventpoll:21,26] 2024-04-24T23:08:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 20w FIFO 0,25 0t0 1093 /run/systemd/inhibit/1.ref 2024-04-24T23:08:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 21u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 23u a_inode 0,15 0 50 [eventpoll:24,25] 2024-04-24T23:08:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 24u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 25u pack 6536 0t0 ARP type=SOCK_DGRAM 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:NetworkMa 658 674 gdbus root 26u IPv4 6537 0t0 UDP smithi146.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root txt REG 8,1 61904 9699 /usr/sbin/irqbalance 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 1u unix 0xffff88810fb69e00 0t0 4061 type=STREAM (CONNECTED) 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 2u unix 0xffff88810fb69e00 0t0 4061 type=STREAM (CONNECTED) 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 3u a_inode 0,15 0 50 [eventfd:1] 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 4u a_inode 0,15 0 50 [eventfd:2] 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 5u unix 0xffff88810fb6c380 0t0 4074 /run/irqbalance/irqbalance661.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 root 6u unix 0xffff888106ad6180 0t0 559 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root txt REG 8,1 61904 9699 /usr/sbin/irqbalance 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 1u unix 0xffff88810fb69e00 0t0 4061 type=STREAM (CONNECTED) 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 2u unix 0xffff88810fb69e00 0t0 4061 type=STREAM (CONNECTED) 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 3u a_inode 0,15 0 50 [eventfd:1] 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 4u a_inode 0,15 0 50 [eventfd:2] 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 5u unix 0xffff88810fb6c380 0t0 4074 /run/irqbalance/irqbalance661.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:irqbalanc 661 666 gmain root 6u unix 0xffff888106ad6180 0t0 559 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt txt REG 8,1 32280 8775 /usr/bin/lsmd 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt mem REG 8,1 56912 8294 /usr/lib64/libconfig.so.11.0.2 2024-04-24T23:08:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 1u unix 0xffff88810bd89e00 0t0 401 type=STREAM (CONNECTED) 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 2u unix 0xffff88810bd89e00 0t0 401 type=STREAM (CONNECTED) 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 3uW REG 0,25 0 1054 /run/lsm/ipc/.lsmd-ipc-lock 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 5u unix 0xffff88810bd8a580 0t0 404 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:lsmd 662 libstoragemgmt 6u unix 0xffff88810bd88f00 0t0 405 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root txt REG 8,1 630408 9978 /usr/sbin/smartd 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:smartd 663 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root txt REG 8,1 303000 18592 /usr/lib/systemd/systemd-logind 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root DEL REG 8,1 62167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root DEL REG 8,1 596 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 1u unix 0xffff88810fc4da00 0t0 2385 type=STREAM (CONNECTED) 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 2u unix 0xffff88810fc4da00 0t0 2385 type=STREAM (CONNECTED) 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 3u unix 0xffff88810fc4f800 0t0 2410 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 4u a_inode 0,15 0 50 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 5u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 6u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 7r REG 0,22 4096 25240 /sys/devices/virtual/tty/tty0/active 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 8u netlink 0t0 2421 KOBJECT_UEVENT 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 9r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 10r FIFO 0,25 0t0 1093 /run/systemd/inhibit/1.ref 2024-04-24T23:08:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 11u netlink 0t0 2422 KOBJECT_UEVENT 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 12u netlink 0t0 2423 KOBJECT_UEVENT 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 13u netlink 0t0 2424 KOBJECT_UEVENT 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 14u unix 0xffff88810fc4e900 0t0 2425 type=STREAM (CONNECTED) 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 15u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 16u CHR 13,65 0t0 136 /dev/input/event1 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 17u CHR 13,64 0t0 135 /dev/input/event0 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 18u CHR 13,66 0t0 157 /dev/input/event2 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 19u CHR 4,6 0t0 25 /dev/tty6 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:systemd-l 665 root 20r FIFO 0,25 0t0 1491 /run/systemd/sessions/4.ref 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root txt REG 8,1 968944 12006 /usr/sbin/sshd 2024-04-24T23:08:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root 1u unix 0xffff88810be2a580 0t0 6526 type=STREAM (CONNECTED) 2024-04-24T23:08:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root 2u unix 0xffff88810be2a580 0t0 6526 type=STREAM (CONNECTED) 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root 3u IPv4 8749 0t0 TCP *:ssh (LISTEN) 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 708 root 4u IPv6 8751 0t0 TCP *:ssh (LISTEN) 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 713 gssproxy root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 714 gssproxy root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 715 gssproxy root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 716 gssproxy root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root txt REG 8,1 127680 13852 /usr/sbin/gssproxy 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 70960 13842 /usr/lib64/libev.so.4.0.0 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 16168 13849 /usr/lib64/libverto-libev.so.1.0.0 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 15912 7247 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 20304 7451 /usr/lib64/libpath_utils.so.1.0.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 58392 7249 /usr/lib64/libcollection.so.4.1.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 142168 8878 /usr/lib64/libgssrpc.so.4.2 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 16056 7251 /usr/lib64/libref_array.so.1.2.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 120640 7453 /usr/lib64/libini_config.so.5.2.1 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 28472 8875 /usr/lib64/libverto.so.1.0.0 2024-04-24T23:08:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 58368 7172 /usr/lib64/libpopt.so.0.0.1 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 1u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 2u unix 0xffff8881092ccb00 0t0 5614 type=STREAM (CONNECTED) 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 3u unix 0xffff888106ad0000 0t0 446 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 4r FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 5u a_inode 0,15 0 50 [eventpoll:4,6,7,8] 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 6u a_inode 0,15 0 50 [eventfd:12] 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 7u unix 0xffff888106ad0780 0t0 447 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 8u unix 0xffff888106ad0f00 0t0 448 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:gssproxy 712 717 gssproxy root 9w FIFO 0,14 0t0 451 pipe 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root cwd DIR 8,1 4096 62221 /var/spool/at 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root txt REG 8,1 32680 9927 /usr/sbin/atd 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:atd 719 root 3uW REG 0,25 4 1113 /run/atd.pid 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root txt REG 8,1 78168 8715 /usr/sbin/crond 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 1u unix 0xffff88817d1d8f00 0t0 4907 type=STREAM (CONNECTED) 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 2u unix 0xffff88817d1d8f00 0t0 4907 type=STREAM (CONNECTED) 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 3uW REG 0,25 4 1114 /run/crond.pid 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 4u unix 0xffff88817d1d9e00 0t0 4910 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:crond 721 root 5r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe txt REG 8,1 80984 9093 /usr/sbin/nrpe 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe DEL REG 8,1 7492 /usr/lib64/libssl.so.3.0.7 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 3u IPv4 4944 0t0 TCP *:nrpe (LISTEN) 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 4u unix 0xffff88817d1db480 0t0 4936 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:nrpe 745 nrpe 5u IPv6 4945 0t0 TCP *:nrpe (LISTEN) 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root txt REG 8,1 58248 11941 /usr/sbin/agetty 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root 0u CHR 4,1 0t0 20 /dev/tty1 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root 1u CHR 4,1 0t0 20 /dev/tty1 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root 2u CHR 4,1 0t0 20 /dev/tty1 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1065 root 4r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root txt REG 8,1 58248 11941 /usr/sbin/agetty 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root 0u CHR 4,65 0t0 113 /dev/ttyS1 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root 1u CHR 4,65 0t0 113 /dev/ttyS1 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root 2u CHR 4,65 0t0 113 /dev/ttyS1 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:agetty 1067 root 4r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu txt REG 8,1 98216 18583 /usr/lib/systemd/systemd 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu DEL REG 8,1 62167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu DEL REG 8,1 596 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 2157904 46429 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-24T23:08:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 1u unix 0xffff888102168f00 0t0 11458 type=STREAM (CONNECTED) 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 2u unix 0xffff888102168f00 0t0 11458 type=STREAM (CONNECTED) 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 3u unix 0xffff888102169e00 0t0 11486 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 4u a_inode 0,15 0 50 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 5u a_inode 0,15 0 50 [signalfd] 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 6r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 7r DIR 0,26 0 3581 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 8u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 9u a_inode 0,15 0 50 [eventpoll:10,13] 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 10r REG 0,21 0 11475 /proc/4211/mountinfo 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 11r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 12u unix 0xffff888102168780 0t0 11508 /run/user/1000/bus type=STREAM (LISTEN) 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 13r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 14r REG 0,21 0 4026532078 /proc/swaps 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 15u netlink 0t0 11490 KOBJECT_UEVENT 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 16u unix 0xffff88810216e900 0t0 11495 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 17u unix 0xffff88810216f080 0t0 11496 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 18u unix 0xffff88810216f800 0t0 11497 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 19u unix 0xffff88810216cb00 0t0 11498 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 20u unix 0xffff88810216c380 0t0 11500 type=STREAM (CONNECTED) 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:systemd 4211 ubuntu 21u a_inode 0,15 0 50 [timerfd] 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu txt REG 8,1 98216 18583 /usr/lib/systemd/systemd 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 44264 30088 /usr/lib64/security/pam_namespace.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 15296 30106 /usr/lib64/security/pam_umask.so 2024-04-24T23:08:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 27720 30096 /usr/lib64/security/pam_selinux.so 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu DEL REG 8,1 846 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 15360 30084 /usr/lib64/security/pam_loginuid.so 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 3785856 46432 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 2157904 46429 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 28552 7287 /usr/lib64/libattr.so.1.1.2501 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 40496 7288 /usr/lib64/libacl.so.1.1.2301 2024-04-24T23:08:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 107424 7663 /usr/lib64/libkmod.so.2.3.6 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu DEL REG 8,1 848 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 1u unix 0xffff888102168f00 0t0 11458 type=STREAM (CONNECTED) 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 2u unix 0xffff888102168f00 0t0 11458 type=STREAM (CONNECTED) 2024-04-24T23:08:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 3u a_inode 0,15 0 50 [eventfd:6] 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 4u a_inode 0,15 0 50 [eventfd:7] 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 6w FIFO 0,14 0t0 11462 pipe 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:(sd-pam) 4213 ubuntu 7u unix 0xffff88810216e180 0t0 11478 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root txt REG 8,1 800352 9743 /usr/sbin/rsyslogd 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 37784 54075 /usr/lib64/rsyslog/imjournal.so 2024-04-24T23:08:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 42336 54082 /usr/lib64/rsyslog/imuxsock.so 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 32904 54083 /usr/lib64/rsyslog/lmnet.so 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 52856 9685 /usr/lib64/libfastjson.so.4.3.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 16032 9684 /usr/lib64/libestr.so.0.0.0 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 4u unix 0xffff88810be2f080 0t0 7093 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 5w REG 8,1 850577 62207 /var/log/secure 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 6w REG 8,1 1639073 62206 /var/log/messages 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 7r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 8w REG 8,1 1734 61764 /var/log/cron 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 root 9r REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root txt REG 8,1 800352 9743 /usr/sbin/rsyslogd 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 37784 54075 /usr/lib64/rsyslog/imjournal.so 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 42336 54082 /usr/lib64/rsyslog/imuxsock.so 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 32904 54083 /usr/lib64/rsyslog/lmnet.so 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 52856 9685 /usr/lib64/libfastjson.so.4.3.0 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 16032 9684 /usr/lib64/libestr.so.0.0.0 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 4u unix 0xffff88810be2f080 0t0 7093 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 5w REG 8,1 850577 62207 /var/log/secure 2024-04-24T23:08:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 6w REG 8,1 1639073 62206 /var/log/messages 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 7r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 8w REG 8,1 1734 61764 /var/log/cron 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4459 in:imjour root 9r REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root txt REG 8,1 800352 9743 /usr/sbin/rsyslogd 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 37784 54075 /usr/lib64/rsyslog/imjournal.so 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 42336 54082 /usr/lib64/rsyslog/imuxsock.so 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 32904 54083 /usr/lib64/rsyslog/lmnet.so 2024-04-24T23:08:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 52856 9685 /usr/lib64/libfastjson.so.4.3.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 16032 9684 /usr/lib64/libestr.so.0.0.0 2024-04-24T23:08:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 4u unix 0xffff88810be2f080 0t0 7093 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 5w REG 8,1 850577 62207 /var/log/secure 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 6w REG 8,1 1639073 62206 /var/log/messages 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 7r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 8w REG 8,1 1734 61764 /var/log/cron 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:rsyslogd 4456 4460 rs:main root 9r REG 0,25 8388608 59 /run/log/journal/7fc8828e06d0482694bcf4a447d13cb6/system.journal 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17404 gmain polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.771 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.772 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.773 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17405 gdbus polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17406 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17407 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17408 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17409 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17410 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17411 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17412 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17413 JS\x20Hel polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd txt REG 8,1 145440 46534 /usr/lib/polkit-1/polkitd 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 489696 7483 /usr/lib64/libpcre.so.1.2.12 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 29097776 34975 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 291512 7639 /usr/lib64/libmount.so.1.1.0 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 19592 7652 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 1303216 7650 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 375264 7654 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-24T23:08:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 1945176 7648 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 131296 7661 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 3r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 4u a_inode 0,15 0 50 [eventfd:13] 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 5u a_inode 0,15 0 50 [eventfd:14] 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 6u unix 0xffff888104418f00 0t0 64521 type=STREAM (CONNECTED) 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 7u a_inode 0,15 0 50 [eventfd:15] 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 8r a_inode 0,15 0 50 inotify 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 9u a_inode 0,15 0 50 [eventfd:16] 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:polkitd 17402 17414 polkitd polkitd 10u unix 0xffff88810441a580 0t0 64522 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17842 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17842 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17842 root txt unknown /proc/17842/exe 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17872 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17872 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17872 root txt unknown /proc/17872/exe 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17901 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17901 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17901 root txt unknown /proc/17901/exe 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17930 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17930 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17930 root txt unknown /proc/17930/exe 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17959 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17959 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 17959 root txt unknown /proc/17959/exe 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18123 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18123 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18123 root txt unknown /proc/18123/exe 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18124 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18124 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18124 root txt unknown /proc/18124/exe 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18125 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18125 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18125 root txt unknown /proc/18125/exe 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18126 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18126 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18126 root txt unknown /proc/18126/exe 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18127 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18127 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18127 root txt unknown /proc/18127/exe 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18128 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18128 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18128 root txt unknown /proc/18128/exe 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18129 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18129 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18129 root txt unknown /proc/18129/exe 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18130 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18130 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18130 root txt unknown /proc/18130/exe 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18131 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18131 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 18131 root txt unknown /proc/18131/exe 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 18132 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 18132 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 18132 root txt unknown /proc/18132/exe 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root txt REG 8,1 968944 12006 /usr/sbin/sshd 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 19632 30080 /usr/lib64/security/pam_lastlog.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15296 30106 /usr/lib64/security/pam_umask.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15376 30087 /usr/lib64/security/pam_motd.so 2024-04-24T23:08:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 44264 30088 /usr/lib64/security/pam_namespace.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 27720 30096 /usr/lib64/security/pam_selinux.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15360 30084 /usr/lib64/security/pam_loginuid.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15344 30089 /usr/lib64/security/pam_nologin.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 19472 30098 /usr/lib64/security/pam_sepermit.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 3u unix 0xffff888106ad2580 0t0 69299 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 4u IPv4 69972 0t0 TCP smithi146.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:51660 (ESTABLISHED) 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 6u unix 0xffff888109ba8f00 0t0 62182 type=STREAM (CONNECTED) 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 7w FIFO 0,25 0t0 1491 /run/systemd/sessions/4.ref 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19050 root 8u unix 0xffff888106ad4b00 0t0 69303 type=STREAM (CONNECTED) 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu txt REG 8,1 968944 12006 /usr/sbin/sshd 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 19632 30080 /usr/lib64/security/pam_lastlog.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15296 30106 /usr/lib64/security/pam_umask.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15376 30087 /usr/lib64/security/pam_motd.so 2024-04-24T23:08:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 44264 30088 /usr/lib64/security/pam_namespace.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 27720 30096 /usr/lib64/security/pam_selinux.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15360 30084 /usr/lib64/security/pam_loginuid.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15344 30089 /usr/lib64/security/pam_nologin.so 2024-04-24T23:08:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 19472 30098 /usr/lib64/security/pam_sepermit.so 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 153600 7292 /usr/lib64/libgpg-error.so.0.32.0 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 882376 7182 /usr/lib64/libzstd.so.1.5.1 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 1288504 7366 /usr/lib64/libgcrypt.so.20.4.0 2024-04-24T23:08:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu DEL REG 8,1 7490 /usr/lib64/libcrypto.so.3.0.7 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 915856 7605 /usr/lib64/libsystemd.so.0.35.0 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 3u unix 0xffff888106ad2580 0t0 69299 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 4u IPv4 69972 0t0 TCP smithi146.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:51660 (ESTABLISHED) 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 5u unix 0xffff888106ad5a00 0t0 69302 type=STREAM (CONNECTED) 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 6u unix 0xffff888109ba8f00 0t0 62182 type=STREAM (CONNECTED) 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 7w FIFO 0,25 0t0 1491 /run/systemd/sessions/4.ref 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 11w FIFO 0,14 0t0 89588 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 12r FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 13w FIFO 0,14 0t0 89592 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 14r FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 15r FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 16w FIFO 0,14 0t0 93287 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 17r FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 18r FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 19w FIFO 0,14 0t0 93291 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 20r FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 21r FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 22w FIFO 0,14 0t0 93295 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 23r FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 24r FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 25w FIFO 0,14 0t0 93299 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 26r FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 27r FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 28w FIFO 0,14 0t0 128679 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 29r FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 30r FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 31w FIFO 0,14 0t0 128683 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 32r FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 33r FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 35r FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 36r FIFO 0,14 0t0 134076 pipe 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:sshd 19053 ubuntu 38r FIFO 0,14 0t0 134077 pipe 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony txt REG 8,1 370264 9943 /usr/sbin/chronyd 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 626240 7471 /usr/lib64/libhogweed.so.6.8 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 94112 7384 /usr/lib64/libtasn1.so.6.6.0 2024-04-24T23:08:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 2337504 7477 /usr/lib64/libgnutls.so.30.37.1 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 127680 7455 /usr/lib64/libseccomp.so.2.5.2 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 2u CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 3u unix 0xffff88810fd75a00 0t0 64008 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 5u IPv4 64013 0t0 UDP localhost:323 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 6u IPv6 64014 0t0 UDP localhost:323 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 7u unix 0xffff88810fd76900 0t0 64015 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:chronyd 19114 chrony 8u sock 0,9 0t0 125308 protocol: UDP 2024-04-24T23:08:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph 1u unix 0xffff88810bd8e180 0t0 71386 type=STREAM (CONNECTED) 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-cras 19451 ceph 2u unix 0xffff88810bd8e180 0t0 71386 type=STREAM (CONNECTED) 2024-04-24T23:08:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20090 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20090 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20090 root txt unknown /proc/20090/exe 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20168 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20168 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/2 20168 root txt unknown /proc/20168/exe 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27561 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27561 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27561 root txt unknown /proc/27561/exe 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27562 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27562 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27562 root txt unknown /proc/27562/exe 2024-04-24T23:08:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27563 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27563 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27563 root txt unknown /proc/27563/exe 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27564 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27564 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27564 root txt unknown /proc/27564/exe 2024-04-24T23:08:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27565 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27565 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27565 root txt unknown /proc/27565/exe 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27566 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27566 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27566 root txt unknown /proc/27566/exe 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27567 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27567 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27567 root txt unknown /proc/27567/exe 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27568 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27568 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27568 root txt unknown /proc/27568/exe 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27682 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27682 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27682 root txt unknown /proc/27682/exe 2024-04-24T23:08:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27683 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27683 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27683 root txt unknown /proc/27683/exe 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27684 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27684 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27684 root txt unknown /proc/27684/exe 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27685 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27685 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27685 root txt unknown /proc/27685/exe 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27686 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27686 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27686 root txt unknown /proc/27686/exe 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27687 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27687 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27687 root txt unknown /proc/27687/exe 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27688 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27688 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27688 root txt unknown /proc/27688/exe 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27689 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27689 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27689 root txt unknown /proc/27689/exe 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27773 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27773 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27773 root txt unknown /proc/27773/exe 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27774 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27774 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27774 root txt unknown /proc/27774/exe 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27775 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27775 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27775 root txt unknown /proc/27775/exe 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27776 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27776 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27776 root txt unknown /proc/27776/exe 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27777 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27777 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27777 root txt unknown /proc/27777/exe 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27778 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27778 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27778 root txt unknown /proc/27778/exe 2024-04-24T23:08:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27779 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27779 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27779 root txt unknown /proc/27779/exe 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27780 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27780 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27780 root txt unknown /proc/27780/exe 2024-04-24T23:08:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27858 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27858 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27858 root txt unknown /proc/27858/exe 2024-04-24T23:08:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27859 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27859 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27859 root txt unknown /proc/27859/exe 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27860 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27860 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27860 root txt unknown /proc/27860/exe 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27861 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27861 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27861 root txt unknown /proc/27861/exe 2024-04-24T23:08:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27862 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27862 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27862 root txt unknown /proc/27862/exe 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27863 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27863 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27863 root txt unknown /proc/27863/exe 2024-04-24T23:08:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27864 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27864 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27864 root txt unknown /proc/27864/exe 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27865 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27865 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:xfsaild/d 27865 root txt unknown /proc/27865/exe 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27911 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27911 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 27911 root txt unknown /proc/27911/exe 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 29073 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 29073 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 29073 root txt unknown /proc/29073/exe 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 30235 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 30235 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 30235 root txt unknown /proc/30235/exe 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 31397 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 31397 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 31397 root txt unknown /proc/31397/exe 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 0r FIFO 0,14 0t0 89588 pipe 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 3r FIFO 0,14 0t0 91332 pipe 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 4w FIFO 0,14 0t0 91332 pipe 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 5u netlink 0t0 91337 AUDIT 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33196 root 6u unix 0xffff88810c5b0f00 0t0 91338 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 0r FIFO 0,14 0t0 89592 pipe 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 3r FIFO 0,14 0t0 88400 pipe 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 4w FIFO 0,14 0t0 88400 pipe 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 5u netlink 0t0 88405 AUDIT 2024-04-24T23:08:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33203 root 6u unix 0xffff888107fd4380 0t0 88406 type=DGRAM (CONNECTED) 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root 0r FIFO 0,14 0t0 89588 pipe 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33245 root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root 0r FIFO 0,14 0t0 89592 pipe 2024-04-24T23:08:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33248 root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33254 log root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33255 service root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33256 admin_soc root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33257 signal_ha root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33258 rocksdb:l root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33259 rocksdb:h root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33275 ceph-mon root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33276 fn_monsto root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33277 msgr-work root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33278 msgr-work root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33279 msgr-work root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33280 OpHistory root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33289 fin root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33290 safe_time root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33291 cpu_tp root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33292 cpu_tp root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33293 cpu_tp root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33294 cpu_tp root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33295 ms_dispat root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33296 ms_local root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33297 safe_time root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33298 ms_dispat root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 33299 ms_local root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root txt REG 8,1 11289392 63410 /usr/bin/ceph-mon 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 0,15 93209 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 1w FIFO 0,14 0t0 89589 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 2w FIFO 0,14 0t0 89590 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 3r FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 4w FIFO 0,14 0t0 93204 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 5w REG 8,1 42179945 393337 /var/log/ceph/ceph-mon.a.log 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 6uW REG 0,25 6 1618 /run/ceph/ceph-mon.a.pid 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 7r FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 8w FIFO 0,14 0t0 93206 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 9u unix 0xffff888106ad7800 0t0 93207 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 10r FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 11w FIFO 0,14 0t0 93208 pipe 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 12u a_inode 0,15 0 93209 [io_uring] 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 13r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 14uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 15r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 16w REG 253,4 102922 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 18w REG 253,4 661 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 19u a_inode 0,15 0 50 [eventpoll:20,28,29,35,42,45] 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 20r FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 21w FIFO 0,14 0t0 93215 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 22u a_inode 0,15 0 50 [eventpoll:23,39,46] 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 23r FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 24w FIFO 0,14 0t0 93216 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 25u a_inode 0,15 0 50 [eventpoll:26,38,41,44] 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 26r FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 27w FIFO 0,14 0t0 93217 pipe 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 28u IPv4 88418 0t0 TCP smithi146.front.sepia.ceph.com:3300 (LISTEN) 2024-04-24T23:08:48.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 29u IPv4 88419 0t0 TCP smithi146.front.sepia.ceph.com:smc-https (LISTEN) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 30w REG 8,1 118515 393340 /var/log/ceph/ceph.audit.log 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 31r FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 32w FIFO 0,14 0t0 93218 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 33r FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 34w FIFO 0,14 0t0 93219 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 35u IPv4 90326 0t0 TCP smithi146.front.sepia.ceph.com:58038->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 36r FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 37w FIFO 0,14 0t0 93220 pipe 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 38u IPv4 88426 0t0 TCP smithi146.front.sepia.ceph.com:49812->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 39u IPv4 88005 0t0 TCP smithi146.front.sepia.ceph.com:39484->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 40w REG 8,1 77827 393338 /var/log/ceph/ceph.log 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 41u IPv4 90030 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:60304 (ESTABLISHED) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 42u IPv4 90636 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:54692 (ESTABLISHED) 2024-04-24T23:08:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 43r REG 253,4 3426175 33816716 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 44u IPv4 134872 0t0 TCP smithi146.front.sepia.ceph.com:3300->192.168.0.1:40496 (ESTABLISHED) 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 45u IPv4 130017 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi203.front.sepia.ceph.com:35346 (ESTABLISHED) 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mon 33252 59003 rstore_co root 46u IPv4 135852 0t0 TCP smithi146.front.sepia.ceph.com:3300->smithi146.front.sepia.ceph.com:44452 (ESTABLISHED) 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33281 log root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33283 msgr-work root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33284 msgr-work root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33285 msgr-work root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33394 service root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33395 admin_soc root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33396 ceph_time root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33397 fn_anonym root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33398 signal_ha root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33399 mgrsb-fin root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33400 ms_dispat root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33401 ms_local root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33402 io_contex root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33403 io_contex root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33404 safe_time root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33405 safe_time root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33406 safe_time root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33407 fn_anonym root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33408 flusher root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root txt REG 8,1 4748616 63473 /usr/bin/ceph-mgr 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 783584 401088 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 654400 401099 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 41112936 63082 /usr/lib64/libopenblaso-r0.3.21.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 331936 401066 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 7042240 400457 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 2883944 62666 /usr/lib64/libgfortran.so.5.0.0 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 3870704 63094 /usr/lib64/libflexiblas.so.3.0 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 3784896 400507 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 78952 39964 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 294392 7381 /usr/lib64/libgomp.so.1.0.0 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 382824 400458 /usr/lib64/flexiblas/libflexiblas_netlib.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 299944 62662 /usr/lib64/libquadmath.so.0.0.0 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 8227888 63245 /usr/lib64/librbd.so.1.19.0 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 384760 8947 /usr/lib64/libdevmapper.so.1.02 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 554440 8737 /usr/lib64/libcryptsetup.so.12.9.0 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1129576 63248 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 357336 7473 /usr/lib64/libnettle.so.8.8 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 2168960 62337 /usr/lib64/libcephfs.so.2.0.0 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 721976 524819 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 2154416 524821 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 65240 401753 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 60264 401093 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 70784 401090 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 237384 401068 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 177920 401094 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 283680 36207 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 87608 401091 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 155704 400976 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 96304 401089 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 132136 400506 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 73976 400874 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 130560 36204 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 40328 400455 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 198064 7258 /usr/lib64/libexpat.so.1.8.10 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 75928 7267 /usr/lib64/libjson-c.so.5.0.0 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 32104 39986 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 136336 62282 /usr/lib64/ossl-modules/legacy.so 2024-04-24T23:08:48.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 20504 400977 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 20952 36211 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 71536 36221 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 124280 39969 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 64328 36190 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 15464 36201 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 16192 393822 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 213488 39975 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 20648 39971 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1116976 39987 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 38856 36203 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 136048 9292 /usr/lib64/libyaml-0.so.2.0.9 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 246392 56894 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 41496 36217 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 515320 62674 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 198136 63458 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 49328 525562 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1129032 62339 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 24272 39972 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 16104 36192 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 69168 36209 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 36440 7195 /usr/lib64/libuuid.so.1.3.0 2024-04-24T23:08:48.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 97064 39974 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 50344 39959 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 15624 39977 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 68120 36216 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 101336 39973 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 107864 36206 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 50168 39966 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 15680 36212 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1954488 62334 /usr/lib64/librados.so.2.0.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 1294816 7203 /usr/lib64/libsqlite3.so.0.8.6 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 435584 62625 /usr/lib64/libcephsqlite.so 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 1w FIFO 0,14 0t0 89593 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 2w FIFO 0,14 0t0 89594 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 3r FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 4w FIFO 0,14 0t0 94209 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,24] 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 6r FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 7w FIFO 0,14 0t0 94211 pipe 2024-04-24T23:08:48.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,23] 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 9r FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 10w FIFO 0,14 0t0 94212 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 12r FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 13w FIFO 0,14 0t0 94213 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 14w REG 8,1 705289 393339 /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 15uW REG 0,25 6 1621 /run/ceph/ceph-mgr.y.pid 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 16r FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 17w FIFO 0,14 0t0 94243 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 18u unix 0xffff888107a65280 0t0 94244 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 19r FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 20w FIFO 0,14 0t0 94248 pipe 2024-04-24T23:08:48.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 21r FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 22w FIFO 0,14 0t0 94249 pipe 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 23u IPv4 92473 0t0 TCP smithi146.front.sepia.ceph.com:39494->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mgr 33253 33409 safe_time root 24u IPv4 92353 0t0 TCP smithi146.front.sepia.ceph.com:53510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:48.292 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.293 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:48.294 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.295 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 0r FIFO 0,14 0t0 93287 pipe 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 3r FIFO 0,14 0t0 91382 pipe 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 4w FIFO 0,14 0t0 91382 pipe 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 5u netlink 0t0 93309 AUDIT 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33421 root 6u unix 0xffff888106ad5280 0t0 93310 type=DGRAM (CONNECTED) 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.296 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:48.297 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.298 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 0r FIFO 0,14 0t0 93291 pipe 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 3r FIFO 0,14 0t0 87811 pipe 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 4w FIFO 0,14 0t0 87811 pipe 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 5u netlink 0t0 87816 AUDIT 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33423 root 6u unix 0xffff88810fd70f00 0t0 87817 type=DGRAM (CONNECTED) 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.302 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.303 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:48.304 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 0r FIFO 0,14 0t0 93295 pipe 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 3r FIFO 0,14 0t0 92372 pipe 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 4w FIFO 0,14 0t0 92372 pipe 2024-04-24T23:08:48.305 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 5u netlink 0t0 89836 AUDIT 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33429 root 6u unix 0xffff888109baf800 0t0 89837 type=DGRAM (CONNECTED) 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:48.306 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.307 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:48.308 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:48.309 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 0r FIFO 0,14 0t0 93299 pipe 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 3r FIFO 0,14 0t0 89831 pipe 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 4w FIFO 0,14 0t0 89831 pipe 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 5u netlink 0t0 92379 AUDIT 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 33438 root 6u unix 0xffff88817d1d8780 0t0 92380 type=DGRAM (CONNECTED) 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.310 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.311 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root 0r FIFO 0,14 0t0 93291 pipe 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33491 root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.312 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.313 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root 0r FIFO 0,14 0t0 93287 pipe 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33493 root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.314 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root 0r FIFO 0,14 0t0 93295 pipe 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33504 root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.315 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root 0r FIFO 0,14 0t0 93299 pipe 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 33505 root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 14w REG 8,1 138074798 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 14w REG 8,1 138011828 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33521 log root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 14w REG 8,1 138011828 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33523 msgr-work root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 14w REG 8,1 138011828 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33524 msgr-work root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 14w REG 8,1 138011828 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33525 msgr-work root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 14w REG 8,1 138012113 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33529 service root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 14w REG 8,1 138012113 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33530 admin_soc root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 14w REG 8,1 138012113 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33591 signal_ha root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 14w REG 8,1 138012113 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33592 io_contex root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 14w REG 8,1 138012113 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33593 io_contex root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 14w REG 8,1 138022265 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33607 OpHistory root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 14w REG 8,1 138053003 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33608 ceph_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 14w REG 8,1 138065963 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33636 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 14w REG 8,1 138068773 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33666 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 14w REG 8,1 138068773 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33676 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 14w REG 8,1 138068773 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33684 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 14w REG 8,1 138068773 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33693 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33700 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33708 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33907 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33908 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33909 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33910 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 14w REG 8,1 138069058 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33912 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33913 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33914 fn_anonym root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33975 rocksdb:l root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33979 rocksdb:l root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33981 rocksdb:l root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 14w REG 8,1 138069343 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 33983 rocksdb:h root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 14w REG 8,1 138069628 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 35577 bstore_ai root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 14w REG 8,1 138069628 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36167 bstore_ai root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 14w REG 8,1 138069628 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36703 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 14w REG 8,1 138069628 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36711 cfin root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 14w REG 8,1 138069628 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36712 bstore_kv root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 14w REG 8,1 138072761 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36713 bstore_kv root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 14w REG 8,1 138072761 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36714 bstore_me root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36725 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36726 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36727 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36728 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36729 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36730 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 14w REG 8,1 138073046 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36731 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36732 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36733 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36734 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36735 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36736 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:48.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:48.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:48.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36737 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:48.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:48.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:48.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:48.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:48.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:48.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 14w REG 8,1 138073331 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:48.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:48.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:48.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36738 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36739 ms_dispat root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36740 ms_local root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36741 fn_anonym root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36742 finisher root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36743 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36744 safe_time root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 14w REG 8,1 138073616 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36745 ceph-osd root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36746 osd_srv_a root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36747 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36748 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36749 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36750 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36751 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 14w REG 8,1 138074017 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36752 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 14w REG 8,1 138074302 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36753 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 14w REG 8,1 138074302 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36754 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 14w REG 8,1 138074302 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36755 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 14w REG 8,1 138074302 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36756 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 14w REG 8,1 138074302 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36757 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 14w REG 8,1 138074513 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36758 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 14w REG 8,1 138074513 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36759 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 14w REG 8,1 138074798 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36760 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 14w REG 8,1 138074798 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36761 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 14w REG 8,1 138074798 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36762 tp_osd_tp root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root DEL REG 0,18 94281 /[aio] 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root DEL REG 0,18 93463 /[aio] 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 0,15 94271 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 1w FIFO 0,14 0t0 93292 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 2w FIFO 0,14 0t0 93293 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 3r FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 4w FIFO 0,14 0t0 87836 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,75,78,79,80,81,82,83,86,89,92,94,100,101] 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 6r FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 7w FIFO 0,14 0t0 87838 pipe 2024-04-24T23:08:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 8u a_inode 0,15 0 50 [eventpoll:9,68,69,70,71,72,73,76,84,87,90,93,96,98,102,105] 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 9r FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 10w FIFO 0,14 0t0 87839 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 11u a_inode 0,15 0 50 [eventpoll:12,60,64,65,66,67,74,77,85,88,91,95,97,99,103] 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 12r FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 13w FIFO 0,14 0t0 87840 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 14w REG 8,1 138074798 393334 /var/log/ceph/ceph-osd.1.log 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 15uW REG 0,25 6 1623 /run/ceph/ceph-osd.1.pid 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 16r FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 17w FIFO 0,14 0t0 87842 pipe 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 18u unix 0xffff88810fd70780 0t0 87843 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 19u IPv4 92401 0t0 TCP *:6800 (LISTEN) 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 20u IPv4 92403 0t0 TCP *:acnet (LISTEN) 2024-04-24T23:08:49.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 21u IPv4 92406 0t0 TCP *:6802 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 22u IPv4 92410 0t0 TCP *:6803 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 23u IPv4 92415 0t0 TCP *:6804 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 24u IPv4 92421 0t0 TCP *:6805 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 25u IPv4 92428 0t0 TCP *:6806 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 26u IPv4 92436 0t0 TCP *:6807 (LISTEN) 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 27r FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 28w FIFO 0,14 0t0 87860 pipe 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 29r FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 30w FIFO 0,14 0t0 87861 pipe 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 31u sock 0,9 0t0 88579 protocol: UDPv6 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 58u a_inode 0,15 0 94271 [io_uring] 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 59r FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 60u IPv4 88017 0t0 TCP smithi146.front.sepia.ceph.com:54692->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 61w FIFO 0,14 0t0 93468 pipe 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 62r FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 63w FIFO 0,14 0t0 93469 pipe 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 64u IPv4 88598 0t0 TCP smithi146.front.sepia.ceph.com:48722->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 65u IPv4 88599 0t0 TCP smithi146.front.sepia.ceph.com:45574->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 66u IPv4 88600 0t0 TCP smithi146.front.sepia.ceph.com:33736->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 67u IPv4 88601 0t0 TCP smithi146.front.sepia.ceph.com:41076->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 68u IPv4 93482 0t0 TCP smithi146.front.sepia.ceph.com:42314->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 69u IPv4 93483 0t0 TCP smithi146.front.sepia.ceph.com:39852->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 70u IPv4 93484 0t0 TCP smithi146.front.sepia.ceph.com:43060->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 71u IPv4 93485 0t0 TCP smithi146.front.sepia.ceph.com:60342->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 72u IPv4 93486 0t0 TCP smithi146.front.sepia.ceph.com:53110->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 73u IPv4 88023 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49626 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 74u IPv4 88024 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50242 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 75u IPv4 88025 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50248 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 76u IPv4 88028 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54302 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 77u IPv4 88029 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44798 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 78u IPv4 88030 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44800 (ESTABLISHED) 2024-04-24T23:08:49.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 79u IPv4 88033 0t0 TCP smithi146.front.sepia.ceph.com:43886->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 80u IPv4 88034 0t0 TCP smithi146.front.sepia.ceph.com:44218->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 81u IPv4 88035 0t0 TCP smithi146.front.sepia.ceph.com:43732->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 82u IPv4 88036 0t0 TCP smithi146.front.sepia.ceph.com:37130->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 83u IPv4 88037 0t0 TCP smithi146.front.sepia.ceph.com:50448->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 84u IPv4 88038 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54308 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 85u IPv4 88041 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49638 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 86u IPv4 88044 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi146.front.sepia.ceph.com:54322 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 87u IPv4 88052 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi146.front.sepia.ceph.com:49648 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 88u IPv4 93497 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44806 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 89u IPv4 94324 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50258 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 90u IPv4 93502 0t0 TCP smithi146.front.sepia.ceph.com:60038->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 91u IPv4 94330 0t0 TCP smithi146.front.sepia.ceph.com:37552->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 92u IPv4 94331 0t0 TCP smithi146.front.sepia.ceph.com:38308->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 93u IPv4 88622 0t0 TCP smithi146.front.sepia.ceph.com:37958->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 94u IPv4 90708 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:50996 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 95u IPv4 90711 0t0 TCP smithi146.front.sepia.ceph.com:6806->smithi203.front.sepia.ceph.com:50266 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 96u IPv4 90714 0t0 TCP smithi146.front.sepia.ceph.com:6804->smithi203.front.sepia.ceph.com:44814 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 97u IPv4 91527 0t0 TCP smithi146.front.sepia.ceph.com:53296->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 98u IPv4 94341 0t0 TCP smithi146.front.sepia.ceph.com:6802->smithi146.front.sepia.ceph.com:51002 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 99u IPv4 88635 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42420 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 100u IPv4 94345 0t0 TCP smithi146.front.sepia.ceph.com:37408->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 101u IPv4 88638 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42436 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 102u IPv4 88663 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:42440 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 103u IPv4 131805 0t0 TCP smithi146.front.sepia.ceph.com:6800->smithi203.front.sepia.ceph.com:60346 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33513 36763 osd_srv_h root 105u IPv4 132082 0t0 TCP smithi146.front.sepia.ceph.com:6800->192.168.0.1:46178 (ESTABLISHED) 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 14w REG 8,1 148103971 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33533 log root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 14w REG 8,1 148103971 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33535 msgr-work root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 14w REG 8,1 148103971 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33536 msgr-work root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 14w REG 8,1 148103971 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33537 msgr-work root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 14w REG 8,1 148103971 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33557 service root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33558 admin_soc root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33598 signal_ha root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33599 io_contex root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33600 io_contex root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33614 OpHistory root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33616 ceph_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 14w REG 8,1 148104255 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33640 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33669 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33674 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33681 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33686 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33692 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33702 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 14w REG 8,1 148104539 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33710 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33711 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33712 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33713 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33714 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33715 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33716 fn_anonym root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33723 rocksdb:l root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 14w REG 8,1 148104823 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33724 rocksdb:l root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33725 rocksdb:l root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 33726 rocksdb:h root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35214 bstore_ai root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35396 bstore_ai root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35592 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35601 cfin root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 14w REG 8,1 148105107 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35603 bstore_kv root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35605 bstore_kv root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 35607 bstore_me root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36128 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36129 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36130 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 14w REG 8,1 148105391 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36131 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36132 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36133 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36134 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36135 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36136 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36137 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 14w REG 8,1 148105675 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36138 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:49.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:49.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:49.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:49.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36139 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:49.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:49.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:49.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:49.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36140 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36141 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36142 ms_dispat root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36143 ms_local root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36144 fn_anonym root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36145 finisher root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 14w REG 8,1 148105959 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36146 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36147 safe_time root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36148 ceph-osd root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36149 osd_srv_a root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36150 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36151 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36152 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 14w REG 8,1 148106243 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36153 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36154 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36155 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36156 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36157 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36158 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36159 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 14w REG 8,1 148106527 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36160 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 14w REG 8,1 148106811 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36161 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36162 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36163 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36164 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36165 tp_osd_tp root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root DEL REG 0,18 91474 /[aio] 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root DEL REG 0,18 92484 /[aio] 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 0,15 92474 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 1w FIFO 0,14 0t0 93296 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 2w FIFO 0,14 0t0 93297 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 3r FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 4w FIFO 0,14 0t0 90524 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,61,68,70,71,77,78,79,86,89,92,95,98,101] 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 6r FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 7w FIFO 0,14 0t0 90526 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,73,74,75,76,81,87,90,93,96,99] 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 9r FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 10w FIFO 0,14 0t0 90527 pipe 2024-04-24T23:08:50.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 11u a_inode 0,15 0 50 [eventpoll:12,65,67,72,80,82,83,84,85,88,91,94,97,100,103] 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 12r FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 13w FIFO 0,14 0t0 90528 pipe 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 14w REG 8,1 148111043 393335 /var/log/ceph/ceph-osd.2.log 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 15uW REG 0,25 6 1625 /run/ceph/ceph-osd.2.pid 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 16r FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 17w FIFO 0,14 0t0 87849 pipe 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 18u unix 0xffff88810fd72d00 0t0 87850 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 19u IPv4 93346 0t0 TCP *:6809 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 20u IPv4 87874 0t0 TCP *:6813 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 21u IPv4 93366 0t0 TCP *:6816 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 22u IPv4 93386 0t0 TCP *:6819 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 23u IPv4 93409 0t0 TCP *:6822 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 24u IPv4 93435 0t0 TCP *:6825 (LISTEN) 2024-04-24T23:08:50.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 25u IPv4 90575 0t0 TCP *:6828 (LISTEN) 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 26u IPv4 90606 0t0 TCP *:6830 (LISTEN) 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 27r FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 28w FIFO 0,14 0t0 88546 pipe 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 29r FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 30w FIFO 0,14 0t0 88547 pipe 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 31u sock 0,9 0t0 88571 protocol: UDPv6 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 58u a_inode 0,15 0 92474 [io_uring] 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 59r FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 60w FIFO 0,14 0t0 88019 pipe 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 61u IPv4 93465 0t0 TCP smithi146.front.sepia.ceph.com:60304->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 62r FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 63w FIFO 0,14 0t0 88020 pipe 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 64u IPv4 90051 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48708 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 65u IPv4 90054 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39846 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 66u IPv4 93475 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48722 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 67u IPv4 93476 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:55992 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 68u IPv4 93479 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56584 (ESTABLISHED) 2024-04-24T23:08:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 69u IPv4 94321 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39852 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 70u IPv4 90660 0t0 TCP smithi146.front.sepia.ceph.com:54308->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 71u IPv4 90661 0t0 TCP smithi146.front.sepia.ceph.com:60358->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 72u IPv4 93487 0t0 TCP smithi146.front.sepia.ceph.com:49638->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 73u IPv4 93488 0t0 TCP smithi146.front.sepia.ceph.com:45576->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 74u IPv4 93489 0t0 TCP smithi146.front.sepia.ceph.com:33752->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 75u IPv4 93490 0t0 TCP smithi146.front.sepia.ceph.com:41088->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 76u IPv4 93491 0t0 TCP smithi146.front.sepia.ceph.com:43074->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 77u IPv4 90665 0t0 TCP smithi146.front.sepia.ceph.com:53112->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 78u IPv4 90666 0t0 TCP smithi146.front.sepia.ceph.com:44222->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 79u IPv4 90667 0t0 TCP smithi146.front.sepia.ceph.com:43896->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 80u IPv4 93492 0t0 TCP smithi146.front.sepia.ceph.com:43744->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 81u IPv4 90668 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi146.front.sepia.ceph.com:48738 (ESTABLISHED) 2024-04-24T23:08:50.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 82u IPv4 93493 0t0 TCP smithi146.front.sepia.ceph.com:37150->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 83u IPv4 93495 0t0 TCP smithi146.front.sepia.ceph.com:42330->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 84u IPv4 93494 0t0 TCP smithi146.front.sepia.ceph.com:50458->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 85u IPv4 90671 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56594 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 86u IPv4 90672 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi146.front.sepia.ceph.com:39854 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 87u IPv4 90675 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56000 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 88u IPv4 90678 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56008 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 89u IPv4 88602 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56602 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 90u IPv4 94329 0t0 TCP smithi146.front.sepia.ceph.com:60022->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 91u IPv4 88060 0t0 TCP smithi146.front.sepia.ceph.com:37542->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 92u IPv4 88061 0t0 TCP smithi146.front.sepia.ceph.com:38316->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 93u IPv4 93511 0t0 TCP smithi146.front.sepia.ceph.com:37970->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 94u IPv4 92537 0t0 TCP smithi146.front.sepia.ceph.com:50996->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 95u IPv4 88626 0t0 TCP smithi146.front.sepia.ceph.com:6828->smithi203.front.sepia.ceph.com:56612 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 96u IPv4 88629 0t0 TCP smithi146.front.sepia.ceph.com:6822->smithi203.front.sepia.ceph.com:56016 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 97u IPv4 93515 0t0 TCP smithi146.front.sepia.ceph.com:37424->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:50.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 98u IPv4 90095 0t0 TCP smithi146.front.sepia.ceph.com:36534->smithi146.front.sepia.ceph.com:6812 (ESTABLISHED) 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 99u IPv4 93516 0t0 TCP smithi146.front.sepia.ceph.com:53310->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 100u IPv4 95257 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:58782 (ESTABLISHED) 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 101u IPv4 130803 0t0 TCP smithi146.front.sepia.ceph.com:6809->smithi203.front.sepia.ceph.com:50728 (ESTABLISHED) 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33516 36166 osd_srv_h root 103u IPv4 135791 0t0 TCP smithi146.front.sepia.ceph.com:6809->192.168.0.1:45438 (ESTABLISHED) 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 14w REG 8,1 133807439 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 14w REG 8,1 133796557 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33543 log root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 14w REG 8,1 133796557 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33551 msgr-work root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 14w REG 8,1 133796557 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33552 msgr-work root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33553 msgr-work root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33561 service root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33563 admin_soc root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33601 signal_ha root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33602 io_contex root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33603 io_contex root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 14w REG 8,1 133796841 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33610 OpHistory root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33611 ceph_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33638 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33668 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33678 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33688 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33696 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 14w REG 8,1 133797125 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33706 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 14w REG 8,1 133797409 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 33721 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 14w REG 8,1 133797409 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34006 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 14w REG 8,1 133797409 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34015 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 14w REG 8,1 133797409 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34017 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 14w REG 8,1 133799991 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34019 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 14w REG 8,1 133799991 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34021 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 14w REG 8,1 133799991 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34022 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34024 fn_anonym root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.688 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34262 rocksdb:l root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.706 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34266 rocksdb:l root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.707 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.709 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.710 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.712 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.716 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.719 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34270 rocksdb:l root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.722 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.723 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.724 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.725 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.726 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.727 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.728 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.729 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.730 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.731 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 34276 rocksdb:h root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.732 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.733 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.735 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.737 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.739 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 35587 bstore_ai root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 14w REG 8,1 133800275 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36174 bstore_ai root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36720 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36721 cfin root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36722 bstore_kv root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36723 bstore_kv root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36724 bstore_me root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36764 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 14w REG 8,1 133800559 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36765 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36766 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36767 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36768 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36769 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36770 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36771 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36772 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 14w REG 8,1 133800843 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:50.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:50.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36773 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:50.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:50.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:50.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:50.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:50.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:50.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36774 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36775 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36776 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36777 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36778 ms_dispat root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 14w REG 8,1 133801127 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36779 ms_local root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 14w REG 8,1 133803715 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36780 fn_anonym root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36781 finisher root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.096 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.097 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36782 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36783 safe_time root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36784 ceph-osd root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36785 osd_srv_a root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36786 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 14w REG 8,1 133803999 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36787 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36788 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36789 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36790 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36792 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36793 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36795 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 14w REG 8,1 133804283 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36797 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 14w REG 8,1 133804567 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36799 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 14w REG 8,1 133804567 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36800 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 14w REG 8,1 133807155 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36801 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 14w REG 8,1 133807155 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36804 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 14w REG 8,1 133807155 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36805 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 14w REG 8,1 133807155 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36807 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 14w REG 8,1 133807155 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36809 tp_osd_tp root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root DEL REG 0,18 88582 /[aio] 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root DEL REG 0,18 90028 /[aio] 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 0,15 90625 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 1w FIFO 0,14 0t0 93288 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 2w FIFO 0,14 0t0 93289 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 3r FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 4w FIFO 0,14 0t0 91420 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,74,75,76,77,78,84,89,92,93,101] 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 6r FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 7w FIFO 0,14 0t0 91422 pipe 2024-04-24T23:08:51.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 8u a_inode 0,15 0 50 [eventpoll:9,64,66,69,70,71,72,73,80,87,90,95,97,99,102] 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 9r FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 10w FIFO 0,14 0t0 91423 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 11u a_inode 0,15 0 50 [eventpoll:12,60,67,79,81,82,83,85,86,88,91,94,96,98,103] 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 12r FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 13w FIFO 0,14 0t0 91424 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 14w REG 8,1 133807439 393333 /var/log/ceph/ceph-osd.0.log 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 15uW REG 0,25 6 1628 /run/ceph/ceph-osd.0.pid 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 16r FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 17w FIFO 0,14 0t0 87851 pipe 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 18u unix 0xffff88810fd72580 0t0 87852 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 19u IPv4 89880 0t0 TCP *:6811 (LISTEN) 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 20u IPv4 87875 0t0 TCP *:6814 (LISTEN) 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 21u IPv4 88524 0t0 TCP *:pentbox-sim (LISTEN) 2024-04-24T23:08:51.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 22u IPv4 88545 0t0 TCP *:6820 (LISTEN) 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 23u IPv4 87901 0t0 TCP *:6823 (LISTEN) 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 24u IPv4 87928 0t0 TCP *:6826 (LISTEN) 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 25u IPv4 87958 0t0 TCP *:6829 (LISTEN) 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 26u IPv4 93444 0t0 TCP *:ambit-lm (LISTEN) 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 27r FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 28w FIFO 0,14 0t0 92451 pipe 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 29r FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 30w FIFO 0,14 0t0 92452 pipe 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 31u sock 0,9 0t0 90622 protocol: UDPv6 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 58u a_inode 0,15 0 90625 [io_uring] 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 59r FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 60u IPv4 92488 0t0 TCP smithi146.front.sepia.ceph.com:38786->smithi203.front.sepia.ceph.com:3301 (ESTABLISHED) 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 61w FIFO 0,14 0t0 90044 pipe 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 62r FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 63w FIFO 0,14 0t0 90045 pipe 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 64u IPv4 94314 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43876 (ESTABLISHED) 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 65u IPv4 94317 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34710 (ESTABLISHED) 2024-04-24T23:08:51.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 66u IPv4 94318 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42302 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 67u IPv4 91492 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48636 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 68u IPv4 91495 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42314 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 69u IPv4 92504 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43886 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 70u IPv4 90069 0t0 TCP smithi146.front.sepia.ceph.com:37140->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 71u IPv4 90070 0t0 TCP smithi146.front.sepia.ceph.com:43070->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 72u IPv4 90071 0t0 TCP smithi146.front.sepia.ceph.com:45586->smithi146.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 73u IPv4 90072 0t0 TCP smithi146.front.sepia.ceph.com:33756->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 74u IPv4 92507 0t0 TCP smithi146.front.sepia.ceph.com:54322->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 75u IPv4 92508 0t0 TCP smithi146.front.sepia.ceph.com:44234->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 76u IPv4 92509 0t0 TCP smithi146.front.sepia.ceph.com:48738->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 77u IPv4 92510 0t0 TCP smithi146.front.sepia.ceph.com:60372->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 78u IPv4 92511 0t0 TCP smithi146.front.sepia.ceph.com:50456->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 79u IPv4 88047 0t0 TCP smithi146.front.sepia.ceph.com:49648->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 80u IPv4 92512 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi146.front.sepia.ceph.com:43896 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 81u IPv4 88048 0t0 TCP smithi146.front.sepia.ceph.com:53126->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 82u IPv4 88049 0t0 TCP smithi146.front.sepia.ceph.com:39854->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 83u IPv4 92515 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34720 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 84u IPv4 92516 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi146.front.sepia.ceph.com:42330 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 85u IPv4 88050 0t0 TCP smithi146.front.sepia.ceph.com:43758->smithi146.front.sepia.ceph.com:6818 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 86u IPv4 88051 0t0 TCP smithi146.front.sepia.ceph.com:41092->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 87u IPv4 92519 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48652 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 88u IPv4 92522 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48668 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 89u IPv4 92525 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34728 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 90u IPv4 90088 0t0 TCP smithi146.front.sepia.ceph.com:60014->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 91u IPv4 90692 0t0 TCP smithi146.front.sepia.ceph.com:37534->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 92u IPv4 95233 0t0 TCP smithi146.front.sepia.ceph.com:6829->smithi203.front.sepia.ceph.com:34730 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 93u IPv4 94346 0t0 TCP smithi146.front.sepia.ceph.com:6823->smithi203.front.sepia.ceph.com:48670 (ESTABLISHED) 2024-04-24T23:08:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 94u IPv4 91525 0t0 TCP smithi146.front.sepia.ceph.com:53294->smithi203.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 95u IPv4 90697 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38308 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 96u IPv4 90698 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38324 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 97u IPv4 90699 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi146.front.sepia.ceph.com:38316 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 98u IPv4 90700 0t0 TCP smithi146.front.sepia.ceph.com:pentbox-sim->smithi203.front.sepia.ceph.com:58278 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 99u IPv4 90731 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37750 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 101u IPv4 90705 0t0 TCP smithi146.front.sepia.ceph.com:37954->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 102u IPv4 135794 0t0 TCP smithi146.front.sepia.ceph.com:6811->192.168.0.1:41816 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33518 36811 osd_srv_h root 103u IPv4 132842 0t0 TCP smithi146.front.sepia.ceph.com:6811->smithi203.front.sepia.ceph.com:37116 (ESTABLISHED) 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.356 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.357 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.358 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.359 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.360 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.364 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.365 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.366 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.367 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.368 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.370 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.372 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.374 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 14w REG 8,1 141503484 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33541 log root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 14w REG 8,1 141503695 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33545 msgr-work root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 14w REG 8,1 141503695 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33546 msgr-work root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 14w REG 8,1 141503695 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33547 msgr-work root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 14w REG 8,1 141503695 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33560 service root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 14w REG 8,1 141503695 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33562 admin_soc root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33595 signal_ha root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33596 io_contex root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33597 io_contex root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33613 OpHistory root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33615 ceph_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33641 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 14w REG 8,1 141503980 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33672 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33680 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.550 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.551 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.552 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.553 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.554 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.555 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33690 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.558 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.559 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.560 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.561 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.562 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.563 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.566 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.567 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33697 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.568 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.571 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.573 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.574 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.575 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.576 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.578 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.579 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33704 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.581 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.586 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33719 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.593 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.594 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.595 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.596 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.597 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.599 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.600 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.601 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.602 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33932 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.605 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.606 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.608 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.609 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.610 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 14w REG 8,1 141504265 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.611 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.612 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.613 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.614 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.616 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.617 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33940 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.618 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.619 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.620 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.621 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.622 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.623 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.624 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.625 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.627 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.629 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33942 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.630 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.631 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.632 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.634 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.635 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.637 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.638 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.639 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.640 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33944 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.642 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.643 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.644 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.645 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.646 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.647 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.648 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.650 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.651 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.653 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.654 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33946 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.655 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.656 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.657 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.659 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.661 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.662 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.663 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.665 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33948 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.667 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.668 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.669 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.670 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.671 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.672 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.674 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.675 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.676 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 33950 fn_anonym root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.679 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.680 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.682 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.684 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.686 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.687 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.689 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.690 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34195 rocksdb:l root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.693 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.694 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.695 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.697 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 14w REG 8,1 141504550 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.700 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.701 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.702 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.703 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.704 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.705 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34204 rocksdb:l root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.742 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.743 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.744 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.745 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.746 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.747 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.748 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.749 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.750 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.751 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.752 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.753 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34207 rocksdb:l root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.754 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.755 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.756 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.757 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.758 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.760 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.762 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.763 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.764 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.766 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 34212 rocksdb:h root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.767 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.768 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.769 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.770 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.771 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.772 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.773 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.774 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.775 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.776 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.777 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.778 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.779 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 35579 bstore_ai root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.780 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.781 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.782 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.784 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.785 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.789 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.790 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.791 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36168 bstore_ai root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.792 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.793 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.794 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.797 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.800 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.801 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.802 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.803 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.804 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36715 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.805 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.806 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.809 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.810 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.811 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.812 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.814 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.815 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.816 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.817 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36716 cfin root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.820 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.821 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.822 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.823 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.824 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 14w REG 8,1 141504835 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.825 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.826 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.828 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.829 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.830 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36717 bstore_kv root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.831 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.833 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.835 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.836 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.837 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.838 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.839 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.841 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.842 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.843 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36718 bstore_kv root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.845 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.852 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.856 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36719 bstore_me root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.857 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.860 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.861 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.862 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.863 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.864 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.865 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.866 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.868 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36791 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.869 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.870 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.871 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.872 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.873 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.875 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.876 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.877 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.878 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.879 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.880 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.881 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36794 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.882 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.884 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.885 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.888 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.889 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.890 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.891 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.893 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.894 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36796 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.895 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.896 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.897 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.899 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.902 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.903 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.904 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.905 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.906 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.907 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36798 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.909 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.910 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.911 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.912 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.913 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 14w REG 8,1 141505120 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.914 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.915 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.916 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.917 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.918 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.919 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36802 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.920 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.921 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.922 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.923 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.924 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.925 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.927 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.928 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.930 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.931 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.932 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36803 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.933 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.934 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.935 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.937 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.939 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.940 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.941 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.942 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.944 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.945 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36806 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.946 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.947 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.948 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.949 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.952 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.953 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.954 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.956 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36808 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.960 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.962 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.963 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.964 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.966 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.969 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.970 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36810 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.971 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.972 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.973 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.974 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.975 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.976 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.977 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.978 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.979 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.980 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.981 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36812 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.986 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:51.987 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:51.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:51.989 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:51.990 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.991 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:51.993 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:51.994 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:51.995 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36813 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:51.996 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:51.997 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:51.998 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:51.999 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.000 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.001 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 14w REG 8,1 141505405 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.003 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.004 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.005 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.006 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36814 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.009 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.010 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.011 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.012 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.013 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.014 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 14w REG 8,1 141505690 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.015 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.017 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.019 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36815 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.025 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.026 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 14w REG 8,1 141505690 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.028 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.029 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.030 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.031 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.032 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.033 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36816 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.034 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.036 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.039 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.040 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 14w REG 8,1 141505690 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.041 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.042 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.043 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.044 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.046 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36817 ms_dispat root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.047 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.048 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.049 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.050 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.051 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.052 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 14w REG 8,1 141505690 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.053 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.054 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.055 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.056 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.057 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36818 ms_local root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.059 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.060 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.061 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.062 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.063 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.064 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.065 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 14w REG 8,1 141505690 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.068 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.071 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36819 fn_anonym root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.072 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.073 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.074 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.075 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.076 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 14w REG 8,1 141509297 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.080 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.081 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.082 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.083 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36820 finisher root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.085 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.087 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.088 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.089 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.090 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 14w REG 8,1 141509297 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.092 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.093 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.094 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.099 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.100 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36821 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.101 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.102 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.103 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.104 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.105 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.106 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.108 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.109 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.110 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.112 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.113 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36822 safe_time root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.114 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.115 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.116 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.118 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.119 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.120 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.121 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.122 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.123 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.124 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36823 ceph-osd root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.126 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.128 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.129 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.130 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.131 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.136 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.138 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36824 osd_srv_a root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.139 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.141 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.142 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.143 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.144 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.145 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.146 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.147 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.148 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.149 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.150 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.151 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36825 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.152 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.153 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.154 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.155 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.156 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.157 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.158 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.163 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36826 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.164 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.165 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.166 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.167 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.168 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.169 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.170 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.176 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36827 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.182 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 14w REG 8,1 141509582 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.184 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.185 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.186 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.187 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36828 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.189 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.190 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.191 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.192 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.194 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.195 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.196 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.197 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.198 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.199 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.200 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36829 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.202 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.204 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.205 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.206 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.207 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.208 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.210 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.211 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.212 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36830 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.215 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.216 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.217 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.218 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.219 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.222 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.223 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.224 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.225 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.226 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36831 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.227 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.229 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.230 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.232 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.233 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.234 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.235 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.236 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.237 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36832 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.242 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.244 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.246 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.247 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.248 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.249 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.250 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.251 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36833 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.253 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.254 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.255 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.256 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.257 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.260 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.261 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36834 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.265 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.267 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.268 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.269 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.270 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 14w REG 8,1 141509867 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.274 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.275 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.276 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.277 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36835 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.278 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.279 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.280 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.281 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.283 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.284 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.286 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.287 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.288 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.290 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36836 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.291 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.294 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.295 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.296 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.297 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.298 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.299 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.300 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.301 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.302 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.303 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.304 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36837 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.305 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.306 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.308 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.309 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.310 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.312 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.315 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.316 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.317 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36838 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.318 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.319 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.321 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.322 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.324 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.325 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.327 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.328 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36839 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.330 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.335 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.336 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.337 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.339 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.340 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.341 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.342 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36840 tp_osd_tp root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root txt REG 8,1 25096944 63419 /usr/bin/ceph-osd 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 74504 403829 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 1334576 403853 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 86632 403868 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-24T23:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 124744 403808 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 41168 403814 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 95312 403844 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 45184 403865 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 37064 403823 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 74928 403811 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 83008 403826 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 70536 403817 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 208184 403820 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 69736 62649 /usr/lib64/liboath.so.0.1.3 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 70432 403841 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 49416 403832 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 120512 403856 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 864224 403850 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-24T23:08:52.344 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 409312 403847 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 36976 403871 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 32512 403838 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 32664 403776 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root DEL REG 0,18 91477 /[aio] 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 1493744 403798 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 0,15 88007 anon_inode:[io_uring] (stat: No such file or directory) 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 357472 403794 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 74680 403804 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root DEL REG 0,18 91475 /[aio] 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.346 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 144120 7350 /usr/lib64/liblz4.so.1.9.3 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 49744 8296 /usr/lib64/libsnappy.so.1.1.8 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 16448 7362 /usr/lib64/libaio.so.1.0.1 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 270800 7447 /usr/lib64/libfuse.so.2.9.9 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.348 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 1w FIFO 0,14 0t0 93300 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 2w FIFO 0,14 0t0 93301 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 3r FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 4w FIFO 0,14 0t0 93330 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,21,22,23,24,25,26,65,68,71,75,77,80,83,86,89,92,95,99,101] 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 6r FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 7w FIFO 0,14 0t0 93332 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 8u a_inode 0,15 0 50 [eventpoll:9,59,66,67,70,73,78,81,84,87,90,93,96,98] 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 9r FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 10w FIFO 0,14 0t0 93333 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 11u a_inode 0,15 0 50 [eventpoll:12,64,69,72,74,76,79,82,85,88,91,94,97,100,103] 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 12r FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 13w FIFO 0,14 0t0 93334 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 14w REG 8,1 141510152 393336 /var/log/ceph/ceph-osd.3.log 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 15uW REG 0,25 6 1627 /run/ceph/ceph-osd.3.pid 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 16r FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.349 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 17w FIFO 0,14 0t0 89862 pipe 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 18u unix 0xffff888109ba8000 0t0 89863 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 19u IPv4 91450 0t0 TCP *:6808 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 20u IPv4 92440 0t0 TCP *:6810 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 21u IPv4 93359 0t0 TCP *:6812 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 22u IPv4 92450 0t0 TCP *:6815 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 23u IPv4 89925 0t0 TCP *:6818 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 24u IPv4 89947 0t0 TCP *:6821 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 25u IPv4 89972 0t0 TCP *:6824 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 26u IPv4 90000 0t0 TCP *:6827 (LISTEN) 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 27r FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 28w FIFO 0,14 0t0 91463 pipe 2024-04-24T23:08:52.350 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 29r FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 30w FIFO 0,14 0t0 91464 pipe 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 31u sock 0,9 0t0 93459 protocol: UDPv6 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.351 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 58u a_inode 0,15 0 88007 [io_uring] 2024-04-24T23:08:52.352 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 59u IPv4 90039 0t0 TCP smithi146.front.sepia.ceph.com:51510->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 60r FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 61w FIFO 0,14 0t0 91483 pipe 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 62r FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 63w FIFO 0,14 0t0 91484 pipe 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 64u IPv4 92499 0t0 TCP smithi146.front.sepia.ceph.com:39846->smithi146.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 65u IPv4 90649 0t0 TCP smithi146.front.sepia.ceph.com:48708->smithi146.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 66u IPv4 91488 0t0 TCP smithi146.front.sepia.ceph.com:60336->smithi203.front.sepia.ceph.com:6819 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 67u IPv4 91489 0t0 TCP smithi146.front.sepia.ceph.com:53096->smithi203.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 68u IPv4 90650 0t0 TCP smithi146.front.sepia.ceph.com:37116->smithi203.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 69u IPv4 92500 0t0 TCP smithi146.front.sepia.ceph.com:33720->smithi203.front.sepia.ceph.com:6816 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 70u IPv4 91490 0t0 TCP smithi146.front.sepia.ceph.com:44216->smithi203.front.sepia.ceph.com:6830 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 71u IPv4 90651 0t0 TCP smithi146.front.sepia.ceph.com:50438->smithi203.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 72u IPv4 92501 0t0 TCP smithi146.front.sepia.ceph.com:41070->smithi203.front.sepia.ceph.com:6822 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 73u IPv4 91491 0t0 TCP smithi146.front.sepia.ceph.com:43876->smithi146.front.sepia.ceph.com:6823 (ESTABLISHED) 2024-04-24T23:08:52.353 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 74u IPv4 92502 0t0 TCP smithi146.front.sepia.ceph.com:43056->smithi203.front.sepia.ceph.com:6828 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 75u IPv4 90652 0t0 TCP smithi146.front.sepia.ceph.com:42302->smithi146.front.sepia.ceph.com:6829 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 76u IPv4 92503 0t0 TCP smithi146.front.sepia.ceph.com:49626->smithi146.front.sepia.ceph.com:6806 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 77u IPv4 90653 0t0 TCP smithi146.front.sepia.ceph.com:54302->smithi146.front.sepia.ceph.com:6804 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 78u IPv4 90654 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51070 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 79u IPv4 90657 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45574 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 80u IPv4 90057 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51074 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 81u IPv4 90060 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45850 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 82u IPv4 90063 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45858 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 83u IPv4 90066 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43732 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 84u IPv4 90662 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45576 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 85u IPv4 90073 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi146.front.sepia.ceph.com:45586 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 86u IPv4 90076 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43744 (ESTABLISHED) 2024-04-24T23:08:52.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 87u IPv4 90079 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi146.front.sepia.ceph.com:43758 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 88u IPv4 90082 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51080 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 89u IPv4 90085 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45870 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 90u IPv4 88059 0t0 TCP smithi146.front.sepia.ceph.com:60032->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 91u IPv4 88620 0t0 TCP smithi146.front.sepia.ceph.com:37568->smithi203.front.sepia.ceph.com:6826 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 92u IPv4 93506 0t0 TCP smithi146.front.sepia.ceph.com:38324->smithi146.front.sepia.ceph.com:pentbox-sim (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 93u IPv4 90093 0t0 TCP smithi146.front.sepia.ceph.com:37980->smithi203.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 94u IPv4 94340 0t0 TCP smithi146.front.sepia.ceph.com:51002->smithi146.front.sepia.ceph.com:6802 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 95u IPv4 90717 0t0 TCP smithi146.front.sepia.ceph.com:6818->smithi203.front.sepia.ceph.com:51092 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 96u IPv4 90720 0t0 TCP smithi146.front.sepia.ceph.com:6824->smithi203.front.sepia.ceph.com:45876 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 97u IPv4 92538 0t0 TCP smithi146.front.sepia.ceph.com:37426->smithi203.front.sepia.ceph.com:6813 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 98u IPv4 90105 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58070 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 99u IPv4 133623 0t0 TCP smithi146.front.sepia.ceph.com:6808->smithi203.front.sepia.ceph.com:58260 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 100u IPv4 90727 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi146.front.sepia.ceph.com:36534 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 101u IPv4 90728 0t0 TCP smithi146.front.sepia.ceph.com:6812->smithi203.front.sepia.ceph.com:60198 (ESTABLISHED) 2024-04-24T23:08:52.355 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-osd 33520 36841 osd_srv_h root 103u IPv4 137381 0t0 TCP smithi146.front.sepia.ceph.com:6808->192.168.0.1:46078 (ESTABLISHED) 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 36965 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 36965 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 36965 root txt unknown /proc/36965/exe 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37108 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37108 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37108 root txt unknown /proc/37108/exe 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37129 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37129 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37129 root txt unknown /proc/37129/exe 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37288 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37288 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/3 37288 root txt unknown /proc/37288/exe 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37713 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37713 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37713 root txt unknown /proc/37713/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 37815 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 37815 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 37815 root txt unknown /proc/37815/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37854 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37854 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 37854 root txt unknown /proc/37854/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 37978 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 37978 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 37978 root txt unknown /proc/37978/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 38015 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 38015 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 38015 root txt unknown /proc/38015/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38072 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38072 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38072 root txt unknown /proc/38072/exe 2024-04-24T23:08:52.357 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38076 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38076 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 38076 root txt unknown /proc/38076/exe 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38217 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38217 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38217 root txt unknown /proc/38217/exe 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38244 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38244 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38244 root txt unknown /proc/38244/exe 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38266 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38266 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/4 38266 root txt unknown /proc/38266/exe 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38317 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38317 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38317 root txt unknown /proc/38317/exe 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38319 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38319 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 38319 root txt unknown /proc/38319/exe 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 43318 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 43318 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 43318 root txt unknown /proc/43318/exe 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root cwd DIR 8,1 4096 61687 /var/spool/anacron 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root txt REG 8,1 40648 9746 /usr/sbin/anacron 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:52.359 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.360 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 3uW REG 8,1 0 61689 /var/spool/anacron/cron.daily 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 4u unix 0xffff888106ad3c00 0t0 108880 type=DGRAM (CONNECTED) 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 5uW REG 8,1 0 61690 /var/spool/anacron/cron.weekly 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:anacron 44894 root 6uW REG 8,1 0 61691 /var/spool/anacron/cron.monthly 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 48763 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 48763 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 48763 root txt unknown /proc/48763/exe 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 54001 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 54001 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/0 54001 root txt unknown /proc/54001/exe 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 54003 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 54003 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/1 54003 root txt unknown /proc/54003/exe 2024-04-24T23:08:52.361 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 55434 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 55434 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/5 55434 root txt unknown /proc/55434/exe 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 56329 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 56329 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/7 56329 root txt unknown /proc/56329/exe 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:52.362 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 0r FIFO 0,14 0t0 128679 pipe 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 3r FIFO 0,14 0t0 132389 pipe 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 4w FIFO 0,14 0t0 132389 pipe 2024-04-24T23:08:52.366 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 5u netlink 0t0 132395 AUDIT 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57034 root 6u unix 0xffff8881ba58bc00 0t0 132396 type=DGRAM (CONNECTED) 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:52.367 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.368 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:52.369 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:52.370 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 0r FIFO 0,14 0t0 128683 pipe 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 3r FIFO 0,14 0t0 128696 pipe 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 4w FIFO 0,14 0t0 128696 pipe 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 5u netlink 0t0 129995 AUDIT 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 57036 root 6u unix 0xffff888107fd0780 0t0 129996 type=DGRAM (CONNECTED) 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:52.371 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.372 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root 0r FIFO 0,14 0t0 128679 pipe 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57084 root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root txt REG 8,1 15624 7981 /usr/bin/python3.9 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 178728 7177 /usr/lib64/liblzma.so.5.2.5 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 76792 7184 /usr/lib64/libbz2.so.1.0.8 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 67640 39982 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 23912 36213 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 56520 36214 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 46688 36210 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 29336 39960 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 41880 36225 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 3486536 11950 /usr/lib64/libpython3.9.so.1.0 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 20120 39981 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 37712 36223 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 23952 36218 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 28176 39965 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root 0r FIFO 0,14 0t0 128683 pipe 2024-04-24T23:08:52.374 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:daemon-he 57085 root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.377 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.380 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.385 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57094 log root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.386 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.387 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.388 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.390 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57098 msgr-work root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.391 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.392 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.393 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.394 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.395 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.396 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57100 msgr-work root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.397 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.398 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.399 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.400 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57102 msgr-work root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.402 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.403 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.404 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.405 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.406 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.407 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57112 service root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.408 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.409 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.410 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.411 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.412 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57113 admin_soc root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.413 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.414 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.416 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.417 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57120 signal_ha root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.418 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.419 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.420 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.421 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.423 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57121 io_contex root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.424 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.425 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.426 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.427 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57122 io_contex root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.429 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.430 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.431 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.433 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.434 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57123 ms_dispat root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.436 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.439 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57124 ms_local root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.441 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.442 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.443 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.444 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.445 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57125 safe_time root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.446 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.447 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.448 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.449 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.450 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57128 safe_time root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.452 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.455 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.456 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57129 ceph-mds root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.459 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 1w FIFO 0,14 0t0 128680 pipe 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 2w FIFO 0,14 0t0 128681 pipe 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 3r FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.460 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 4w FIFO 0,14 0t0 131726 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20,27] 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 6r FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 7w FIFO 0,14 0t0 131728 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 9r FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 10w FIFO 0,14 0t0 131729 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12] 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 12r FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 13w FIFO 0,14 0t0 131730 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 14w REG 8,1 10782635 393346 /var/log/ceph/ceph-mds.a.log 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 15uW REG 0,25 6 1637 /run/ceph/ceph-mds.a.pid 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 16r FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 17w FIFO 0,14 0t0 130007 pipe 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 18u unix 0xffff888107fd1680 0t0 130008 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 19u IPv4 134508 0t0 TCP *:6833 (LISTEN) 2024-04-24T23:08:52.461 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 20u IPv4 134544 0t0 TCP *:6835 (LISTEN) 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 21r FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 22w FIFO 0,14 0t0 130011 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 23r FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 24w FIFO 0,14 0t0 130012 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 25r FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 26w FIFO 0,14 0t0 134546 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 27u IPv4 134545 0t0 TCP smithi146.front.sepia.ceph.com:36630->smithi203.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 28r FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 29w FIFO 0,14 0t0 134547 pipe 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57092 57251 safe_time root 30u IPv4 133588 0t0 TCP smithi146.front.sepia.ceph.com:53582->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.462 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.463 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.464 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.465 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.467 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.468 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.469 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.472 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58817 log root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.473 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.474 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.477 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58819 msgr-work root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.478 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.479 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.480 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.481 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.482 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58820 msgr-work root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.483 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.487 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.488 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58821 msgr-work root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.490 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.492 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.493 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58833 service root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.494 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.497 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.498 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58834 admin_soc root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.500 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.501 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.502 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.503 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.504 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.505 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58839 signal_ha root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.506 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.507 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.508 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.509 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58840 io_contex root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.511 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.512 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.513 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.514 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.515 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58842 io_contex root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58843 ms_dispat root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.523 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58844 ms_local root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.530 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.532 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58845 safe_time root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.535 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.537 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58848 safe_time root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.539 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.541 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.542 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.543 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58849 ceph-mds root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root txt REG 8,1 7613504 63432 /usr/bin/ceph-mds 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 45480 9348 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 41360 9346 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 53816 7480 /usr/lib64/libnuma.so.1.0.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 53272 62319 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 138712 7373 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 1591920 7217 /usr/lib64/libunistring.so.2.1.0 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 53048 7375 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.545 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 483832 8964 /usr/lib64/libssh.so.4.9.4 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 130952 7255 /usr/lib64/libidn2.so.0.3.7 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 168672 8859 /usr/lib64/libnghttp2.so.14.20.1 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 617664 7302 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 2314576 7174 /usr/lib64/libstdc++.so.6.0.29 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 146376 7294 /usr/lib64/libnl-3.so.200.26.0 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 639224 62286 /usr/lib64/libthrift-0.15.0.so 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 666496 8968 /usr/lib64/libcurl.so.4.7.0 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 112536 10463 /usr/lib64/librdmacm.so.1.3.48.0 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 200248 7607 /usr/lib64/libudev.so.1.7.5 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 10140408 393526 /usr/lib64/ceph/libceph-common.so.2 2024-04-24T23:08:52.546 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 77488 7371 /usr/lib64/libpsl.so.5.3.3 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 229432 7609 /usr/lib64/libblkid.so.1.1.0 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 326760 7748 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 137720 8081 /usr/lib64/libibverbs.so.1.14.48.0 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 61880 7738 /usr/lib64/libunwind.so.8.0.1 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 287296 7233 /usr/lib64/liblua-5.4.so 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 24248 9350 /usr/lib64/liburcu-common.so.6.1.0 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 1w FIFO 0,14 0t0 128684 pipe 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 2w FIFO 0,14 0t0 128685 pipe 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 3r FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.547 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 4w FIFO 0,14 0t0 133953 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 5u a_inode 0,15 0 50 [eventpoll:6,19,20] 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 6r FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 7w FIFO 0,14 0t0 133954 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 8u a_inode 0,15 0 50 [eventpoll:9,30] 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 9r FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 10w FIFO 0,14 0t0 133955 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 11u a_inode 0,15 0 50 [eventpoll:12,26] 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 12r FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 13w FIFO 0,14 0t0 133956 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 14w REG 8,1 82129560 393345 /var/log/ceph/ceph-mds.c.log 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 15uW REG 0,25 6 1635 /run/ceph/ceph-mds.c.pid 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 16r FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 17w FIFO 0,14 0t0 134999 pipe 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 18u unix 0xffff88817d1dcb00 0t0 135000 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 19u IPv4 137464 0t0 TCP *:6832 (LISTEN) 2024-04-24T23:08:52.548 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 20u IPv4 137499 0t0 TCP *:6834 (LISTEN) 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 21r FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 22w FIFO 0,14 0t0 135002 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 23r FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 24w FIFO 0,14 0t0 135003 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 25r FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 26u IPv4 138271 0t0 TCP smithi146.front.sepia.ceph.com:44452->smithi146.front.sepia.ceph.com:3300 (ESTABLISHED) 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 27w FIFO 0,14 0t0 135004 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 28r FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 29w FIFO 0,14 0t0 135005 pipe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-mds 57093 58983 safe_time root 30u IPv4 137528 0t0 TCP smithi146.front.sepia.ceph.com:56624->smithi203.front.sepia.ceph.com:6832 (ESTABLISHED) 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58167 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58167 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58167 root txt unknown /proc/58167/exe 2024-04-24T23:08:52.549 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58168 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58168 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/R 58168 root txt unknown /proc/58168/exe 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 58984 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 58984 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/6 58984 root txt unknown /proc/58984/exe 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59300 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59300 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59300 root txt unknown /proc/59300/exe 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59301 root cwd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59301 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:kworker/u 59301 root txt unknown /proc/59301/exe 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu txt REG 8,1 1389072 7149 /usr/bin/bash 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 195080 7147 /usr/lib64/libtinfo.so.6.2 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.551 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu 0r FIFO 0,14 0t0 134075 pipe 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu 1w FIFO 0,14 0t0 134076 pipe 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:bash 59302 ubuntu 2w FIFO 0,14 0t0 134077 pipe 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root txt REG 8,1 185464 9243 /usr/bin/sudo 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 353408 7603 /usr/lib64/libnss_systemd.so.2 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 44784 7268 /usr/lib64/libffi.so.8.1.0 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 108136 10561 /usr/lib64/libgcc_s-11-20231218.so.1 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 1714208 7271 /usr/lib64/libp11-kit.so.0.3.1 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 36296 7185 /usr/lib64/libcap.so.2.48 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 19712 8450 /usr/lib64/libpam_misc.so.0.82.1 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 19520 30102 /usr/lib64/security/pam_succeed_if.so 2024-04-24T23:08:52.552 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 514368 33785 /usr/lib64/security/pam_systemd.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 27648 30081 /usr/lib64/security/pam_limits.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 48392 7711 /usr/lib64/libcrack.so.2.9.0 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 32608 8444 /usr/lib64/libpwquality.so.1.0.2 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 15464 30079 /usr/lib64/security/pam_keyinit.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 15840 30061 /usr/lib64/security/pam_pwquality.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 15040 30067 /usr/lib64/security/pam_deny.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 56824 30107 /usr/lib64/security/pam_unix.so 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 201808 7179 /usr/lib64/libcrypt.so.2.0.0 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 957456 62280 /usr/lib64/libssl.so.3.2.1 2024-04-24T23:08:52.553 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 128416 8898 /usr/lib64/libsasl2.so.3.0.0 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 914368 7110 /usr/lib64/libm.so.6 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 2586930 16078 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 15304 30071 /usr/lib64/security/pam_faildelay.so 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 366424 7894 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 70400 8902 /usr/lib64/liblber.so.2.0.200 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 417712 8906 /usr/lib64/libldap_r.so.2.0.200 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 69592 8448 /usr/lib64/libpam.so.0.85.1 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 472552 47567 /usr/libexec/sudo/sudoers.so 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 40424 8439 /usr/lib64/libeconf.so.0.4.1 2024-04-24T23:08:52.554 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 19568 30069 /usr/lib64/security/pam_env.so 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 54 16081 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 3284 28786 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 286 28783 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 57 26536 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 34 28836 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 77 16080 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 167 28778 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 59 28785 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 32528 7206 /usr/lib64/libcap-ng.so.0.0.0 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 128024 47563 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 138848 7210 /usr/lib64/libaudit.so.1.0.0 2024-04-24T23:08:52.555 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 23 28782 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root mem REG 8,1 369 28781 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 0r FIFO 0,14 0t0 134075 pipe 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 1w FIFO 0,14 0t0 134076 pipe 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 2w FIFO 0,14 0t0 134077 pipe 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 3r FIFO 0,14 0t0 137651 pipe 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 4w FIFO 0,14 0t0 137651 pipe 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 5u netlink 0t0 137657 AUDIT 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:sudo 59318 root 6u unix 0xffff888106ad7080 0t0 137658 type=DGRAM (CONNECTED) 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root txt REG 8,1 179232 9797 /usr/bin/lsof 2024-04-24T23:08:52.556 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 196224 8914 /usr/lib64/libtirpc.so.3.0.0 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.557 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 0r FIFO 0,14 0t0 134075 pipe 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 1w FIFO 0,14 0t0 134076 pipe 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 2w FIFO 0,14 0t0 134077 pipe 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 3r DIR 0,21 0 1 /proc 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 4r DIR 0,21 7 134087 /proc/59320/fd 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 5w FIFO 0,14 0t0 134092 pipe 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59320 root 6r FIFO 0,14 0t0 134093 pipe 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root cwd DIR 8,1 4096 61580 /home/ubuntu 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root rtd DIR 8,1 4096 2 / 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root txt REG 8,1 179232 9797 /usr/bin/lsof 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 5431656 62278 /usr/lib64/libcrypto.so.3.2.1 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 346132 28859 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 102672 7169 /usr/lib64/libz.so.1.2.11 2024-04-24T23:08:52.558 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 70928 7116 /usr/lib64/libresolv.so.2 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 23992 7243 /usr/lib64/libkeyutils.so.1.10 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 906256 8886 /usr/lib64/libkrb5.so.3.3 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 358448 8876 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 2592488 7107 /usr/lib64/libc.so.6 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 66192 8888 /usr/lib64/libkrb5support.so.0.1 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 23872 7193 /usr/lib64/libcom_err.so.2.1 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 98992 8880 /usr/lib64/libk5crypto.so.3.1 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 636848 7222 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 196224 8914 /usr/lib64/libtirpc.so.3.0.0 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 175752 7307 /usr/lib64/libselinux.so.1 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 26988 27963 /usr/lib64/gconv/gconv-modules.cache 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root mem REG 8,1 867384 11866 /usr/lib64/ld-linux-x86-64.so.2 2024-04-24T23:08:52.559 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root 4r FIFO 0,14 0t0 134092 pipe 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:lsof 59321 root 7w FIFO 0,14 0t0 134093 pipe 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 2 0.0 0.0 0 0 ? S 22:50 0:00 [kthreadd] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 3 0.0 0.0 0 0 ? S 22:50 0:00 \_ [pool_workqueue_release] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 4 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-rcu_g] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 5 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-slub_] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 6 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-netns] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 9 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/0:0H-events_highpri] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 10 0.2 0.0 0 0 ? I 22:50 0:02 \_ [kworker/u32:0-xfs-cil/dm-4] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 11 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-mm_pe] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 12 0.0 0.0 0 0 ? I 22:50 0:00 \_ [rcu_tasks_kthread] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 13 0.0 0.0 0 0 ? I 22:50 0:00 \_ [rcu_tasks_rude_kthread] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 14 0.0 0.0 0 0 ? I 22:50 0:00 \_ [rcu_tasks_trace_kthread] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 15 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/0] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 16 0.2 0.0 0 0 ? I 22:50 0:02 \_ [rcu_preempt] 2024-04-24T23:08:52.560 INFO:teuthology.orchestra.run.smithi146.stdout:root 17 0.0 0.0 0 0 ? S 22:50 0:00 \_ [rcu_exp_par_gp_kthread_worker/0] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 18 0.0 0.0 0 0 ? S 22:50 0:00 \_ [rcu_exp_gp_kthread_worker] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 19 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/0] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 20 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/0] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 21 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/1] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 22 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/1] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 23 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/1] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 25 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/1:0H-events_highpri] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 26 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/2] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 27 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/2] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 28 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/2] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 30 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/2:0H-kblockd] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 31 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/3] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 32 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/3] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 33 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/3] 2024-04-24T23:08:52.561 INFO:teuthology.orchestra.run.smithi146.stdout:root 35 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/3:0H-events_highpri] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 36 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/4] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 37 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/4] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 38 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/4] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 40 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/4:0H-events_highpri] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 41 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/5] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 42 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/5] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 43 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/5] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 45 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/5:0H-events_highpri] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 46 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/6] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 47 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/6] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 48 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/6] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 50 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/6:0H-events_highpri] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 51 0.0 0.0 0 0 ? S 22:50 0:00 \_ [cpuhp/7] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 52 0.0 0.0 0 0 ? S 22:50 0:00 \_ [migration/7] 2024-04-24T23:08:52.562 INFO:teuthology.orchestra.run.smithi146.stdout:root 53 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ksoftirqd/7] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 55 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/7:0H-events_highpri] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 56 0.0 0.0 0 0 ? S 22:50 0:00 \_ [kdevtmpfs] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 57 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-inet_] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 58 0.0 0.0 0 0 ? S 22:50 0:00 \_ [kauditd] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 59 0.0 0.0 0 0 ? S 22:50 0:00 \_ [khungtaskd] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 61 0.0 0.0 0 0 ? S 22:50 0:00 \_ [oom_reaper] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 63 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-write] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 64 0.0 0.0 0 0 ? S 22:50 0:00 \_ [kcompactd0] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 65 0.0 0.0 0 0 ? SN 22:50 0:00 \_ [ksmd] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 66 0.0 0.0 0 0 ? SN 22:50 0:00 \_ [khugepaged] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 67 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-crypt] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 68 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-kinte] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 69 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-kbloc] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 70 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-blkcg] 2024-04-24T23:08:52.563 INFO:teuthology.orchestra.run.smithi146.stdout:root 78 0.0 0.0 0 0 ? S 22:50 0:00 \_ [irq/9-acpi] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 79 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-ata_s] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 80 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-md] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 81 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-md_bi] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 82 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-edac-] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 83 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-devfr] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 84 0.0 0.0 0 0 ? S 22:50 0:00 \_ [watchdogd] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 85 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/0:1H-xfs-log/dm-4] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 86 0.0 0.0 0 0 ? S 22:50 0:00 \_ [kswapd0] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 88 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-kthro] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 91 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-acpi_] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 92 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_0] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 93 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 94 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_1] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 95 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.564 INFO:teuthology.orchestra.run.smithi146.stdout:root 96 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_2] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 97 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 98 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_3] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 99 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 100 0.1 0.0 0 0 ? I 22:50 0:01 \_ [kworker/u32:3-ceph-inode] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 101 0.1 0.0 0 0 ? I 22:50 0:01 \_ [kworker/u32:4-ceph-inode] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 103 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_4] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 104 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 105 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_5] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 106 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 107 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_6] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 108 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 109 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_7] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 110 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.565 INFO:teuthology.orchestra.run.smithi146.stdout:root 111 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_8] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 112 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 113 0.0 0.0 0 0 ? S 22:50 0:00 \_ [scsi_eh_9] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 114 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-scsi_] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 116 0.2 0.0 0 0 ? I 22:50 0:02 \_ [kworker/u32:7-ceph-inode] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 119 0.3 0.0 0 0 ? I 22:50 0:03 \_ [kworker/u32:10-flush-253:4] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 128 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-dm_bu] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 129 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/2:1H-kblockd] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 130 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-mld] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 131 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/4:1H-xfs-log/dm-4] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 132 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-ipv6_] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 140 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/u33:0] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 210 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/3:1H-xfs-log/dm-4] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 212 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/7:1H-kblockd] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 252 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2024-04-24T23:08:52.566 INFO:teuthology.orchestra.run.smithi146.stdout:root 263 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/6:1H-xfs-log/dm-4] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 299 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/5:1H-kblockd] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 403 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-nvme-] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 404 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-nvme-] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 411 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-nvme-] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 433 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-ixgbe] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 444 0.0 0.0 0 0 ? S 22:50 0:00 \_ [jbd2/sda1-8] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 445 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-ext4-] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 531 0.0 0.0 0 0 ? S 22:50 0:00 \_ [ext4lazyinit] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 602 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-ipmi-] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 610 0.0 0.0 0 0 ? SN 22:50 0:00 \_ [kipmi0] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 619 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-rpcio] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 620 0.0 0.0 0 0 ? I< 22:50 0:00 \_ [kworker/R-xprti] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 17842 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-kdmfl] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 17872 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-kdmfl] 2024-04-24T23:08:52.567 INFO:teuthology.orchestra.run.smithi146.stdout:root 17901 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-kdmfl] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 17930 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-kdmfl] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 17959 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-kdmfl] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18123 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfsal] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18124 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs_m] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18125 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18126 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18127 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-r] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18128 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18129 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-i] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18130 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-l] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18131 0.0 0.0 0 0 ? I< 22:55 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 18132 0.0 0.0 0 0 ? S 22:55 0:00 \_ [xfsaild/dm-4] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 20090 0.0 0.0 0 0 ? I 22:58 0:00 \_ [kworker/2:8-inet_frag_wq] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 20168 0.0 0.0 0 0 ? I 22:58 0:00 \_ [kworker/2:86-mm_percpu_wq] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 27561 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.568 INFO:teuthology.orchestra.run.smithi146.stdout:root 27562 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27563 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-r] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27564 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27565 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-i] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27566 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-l] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27567 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27568 0.0 0.0 0 0 ? S 22:58 0:00 \_ [xfsaild/dm-0] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27682 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27683 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27684 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-r] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27685 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27686 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-i] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27687 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-l] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27688 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27689 0.0 0.0 0 0 ? S 22:58 0:00 \_ [xfsaild/dm-1] 2024-04-24T23:08:52.569 INFO:teuthology.orchestra.run.smithi146.stdout:root 27773 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27774 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27775 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-r] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27776 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27777 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-i] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27778 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-l] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27779 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27780 0.0 0.0 0 0 ? S 22:58 0:00 \_ [xfsaild/dm-2] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27858 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27859 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27860 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-r] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27861 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-b] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27862 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-i] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27863 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-l] 2024-04-24T23:08:52.570 INFO:teuthology.orchestra.run.smithi146.stdout:root 27864 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-xfs-c] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 27865 0.0 0.0 0 0 ? S 22:58 0:00 \_ [xfsaild/dm-3] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 27911 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-dio/d] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 29073 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-dio/d] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 30235 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-dio/d] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 31397 0.0 0.0 0 0 ? I< 22:58 0:00 \_ [kworker/R-dio/d] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 36965 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/5:65-dio/dm-0] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37108 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/3:92-dio/dm-0] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37129 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/3:113-cgroup_destroy] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37288 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/3:208-xfs-inodegc/dm-4] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37713 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/7:151-dio/dm-3] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37815 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/5:221-events] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37854 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/7:218-events] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 37978 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/0:69-mm_percpu_wq] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 38015 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/0:106-mm_percpu_wq] 2024-04-24T23:08:52.571 INFO:teuthology.orchestra.run.smithi146.stdout:root 38072 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/1:154-mm_percpu_wq] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38076 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/1:158-events] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38217 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/4:172-events] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38244 0.1 0.0 0 0 ? I 22:59 0:00 \_ [kworker/4:192-events_freezable] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38266 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/4:203-cgroup_destroy] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38317 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/6:327-ceph-msgr] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 38319 0.0 0.0 0 0 ? I 22:59 0:00 \_ [kworker/6:329-dio/dm-1] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 43318 0.0 0.0 0 0 ? I< 23:00 0:00 \_ [kworker/R-ceph-] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 48763 0.0 0.0 0 0 ? I 23:01 0:00 \_ [kworker/u32:1-ceph-inode] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 54001 0.0 0.0 0 0 ? I 23:05 0:00 \_ [kworker/0:0-events] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 54003 0.0 0.0 0 0 ? I 23:05 0:00 \_ [kworker/1:0-mm_percpu_wq] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 55434 0.0 0.0 0 0 ? I 23:05 0:00 \_ [kworker/5:0-events] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 56329 0.2 0.0 0 0 ? I 23:06 0:00 \_ [kworker/7:0-mm_percpu_wq] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 58167 0.0 0.0 0 0 ? I< 23:07 0:00 \_ [kworker/R-ceph-] 2024-04-24T23:08:52.572 INFO:teuthology.orchestra.run.smithi146.stdout:root 58168 0.0 0.0 0 0 ? I< 23:07 0:00 \_ [kworker/R-ceph-] 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 58984 0.0 0.0 0 0 ? I 23:07 0:00 \_ [kworker/6:0-xfs-conv/dm-4] 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 59300 0.0 0.0 0 0 ? I 23:08 0:00 \_ [kworker/u32:2-ceph-inode] 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 59301 0.0 0.0 0 0 ? I 23:08 0:00 \_ [kworker/u32:5-ceph-inode] 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 1 0.6 0.0 176540 19848 ? Ss 22:50 0:06 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 523 0.2 0.0 27404 15744 ? Ss 22:50 0:03 /usr/lib/systemd/systemd-journald 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 538 0.0 0.0 37164 15200 ? Ss 22:50 0:00 /usr/lib/systemd/systemd-udevd 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:rpc 598 0.0 0.0 13248 5248 ? Ss 22:50 0:00 /usr/bin/rpcbind -w -f 2024-04-24T23:08:52.573 INFO:teuthology.orchestra.run.smithi146.stdout:root 611 0.1 0.0 91936 2300 ? S sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-04-24T23:08:52.669 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:08:52.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:52.670 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:08:52.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:08:52.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-24T23:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.916+0000 7f4a32000640 1 Processor -- start 2024-04-24T23:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.916+0000 7f4a32000640 1 -- start start 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a32000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4a2c141c80 0x7f4a2c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a32000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a2c0ce5a0 0x7f4a2c071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a32000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c0ced40 con 0x7f4a2c13ef30 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a32000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2c1423d0 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a32000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2c070f80 con 0x7f4a2c141c80 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a2be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a2c0ce5a0 0x7f4a2c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a2be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a2c0ce5a0 0x7f4a2c071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56672/0 (socket says 172.21.15.146:56672) 2024-04-24T23:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a2be00640 1 -- 172.21.15.146:0/1482118389 learned_addr learned my addr 172.21.15.146:0/1482118389 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a2be00640 1 -- 172.21.15.146:0/1482118389 >> v2:172.21.15.203:3300/0 conn(0x7f4a2c141c80 msgr2=0x7f4a2c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.918+0000 7f4a22a00640 1 --2- 172.21.15.146:0/1482118389 >> v2:172.21.15.203:3300/0 conn(0x7f4a2c141c80 0x7f4a2c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.919+0000 7f4a2be00640 1 --2- 172.21.15.146:0/1482118389 >> v2:172.21.15.203:3300/0 conn(0x7f4a2c141c80 0x7f4a2c0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.919+0000 7f4a2be00640 1 -- 172.21.15.146:0/1482118389 >> v1:172.21.15.203:6789/0 conn(0x7f4a2c13ef30 legacy=0x7f4a2c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.919+0000 7f4a2be00640 1 -- 172.21.15.146:0/1482118389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c0cf020 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a2be00640 1 --2- 172.21.15.146:0/1482118389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0ce5a0 0x7f4a2c071410 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cddd0 tx=0x7f4a2402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a231409618f435 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a2aa00640 1 -- 172.21.15.146:0/1482118389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24037070 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a2aa00640 1 -- 172.21.15.146:0/1482118389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a24032440 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a2aa00640 1 -- 172.21.15.146:0/1482118389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24032810 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a32000640 1 -- 172.21.15.146:0/1482118389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0ce5a0 msgr2=0x7f4a2c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.920+0000 7f4a32000640 1 --2- 172.21.15.146:0/1482118389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0ce5a0 0x7f4a2c071410 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cddd0 tx=0x7f4a2402a230 comp rx=0 tx=0).stop 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 -- 172.21.15.146:0/1482118389 shutdown_connections 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 --2- 172.21.15.146:0/1482118389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0ce5a0 0x7f4a2c071410 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 --2- 172.21.15.146:0/1482118389 >> v2:172.21.15.203:3300/0 conn(0x7f4a2c141c80 0x7f4a2c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 -- 172.21.15.146:0/1482118389 >> 172.21.15.146:0/1482118389 conn(0x7f4a2c0b17b0 msgr2=0x7f4a2c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 -- 172.21.15.146:0/1482118389 shutdown_connections 2024-04-24T23:08:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.921+0000 7f4a32000640 1 -- 172.21.15.146:0/1482118389 wait complete. 2024-04-24T23:08:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.923+0000 7f4a32000640 1 Processor -- start 2024-04-24T23:08:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.923+0000 7f4a32000640 1 -- start start 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 0x7f4a2c142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2c13ef30 0x7f4a2c0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c0cea30 con 0x7f4a2c141c80 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c070c10 con 0x7f4a2c13ef30 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.924+0000 7f4a32000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c071950 con 0x7f4a2c0ce5a0 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56674/0 (socket says 172.21.15.146:56674) 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 -- 172.21.15.146:0/3258696396 learned_addr learned my addr 172.21.15.146:0/3258696396 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a22a00640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2c13ef30 0x7f4a2c0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2b400640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 0x7f4a2c142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 -- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 msgr2=0x7f4a2c142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 0x7f4a2c142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 -- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2c13ef30 msgr2=0x7f4a2c0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2c13ef30 0x7f4a2c0b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 -- 172.21.15.146:0/3258696396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c1f2190 con 0x7f4a2c141c80 2024-04-24T23:08:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2b400640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 0x7f4a2c142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.925+0000 7f4a2be00640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4a2402a270 tx=0x7f4a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.926+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24037040 con 0x7f4a2c141c80 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.926+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a24042070 con 0x7f4a2c141c80 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.926+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c1f2470 con 0x7f4a2c141c80 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.926+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24030bd0 con 0x7f4a2c141c80 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.926+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1f2a30 con 0x7f4a2c141c80 2024-04-24T23:08:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.927+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c04f5a0 con 0x7f4a2c141c80 2024-04-24T23:08:52.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.928+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a24047460 con 0x7f4a2c141c80 2024-04-24T23:08:52.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.929+0000 7f4a23e00640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 0x7f4a0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.929+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6390+0+0 (secure 0 0 0) 0x7f4a240abd90 con 0x7f4a2c141c80 2024-04-24T23:08:52.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.930+0000 7f4a2b400640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 0x7f4a0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.931+0000 7f4a2b400640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 0x7f4a0806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b1780 tx=0x7f4a1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:52.934+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4a2407a3f0 con 0x7f4a2c141c80 2024-04-24T23:08:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.172+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f4a2c13f3b0 con 0x7f4a2c141c80 2024-04-24T23:08:53.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.513+0000 7f4a23e00640 1 -- 172.21.15.146:0/3258696396 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v55) ==== 162+0+0 (secure 0 0 0) 0x7f4a24079cf0 con 0x7f4a2c141c80 2024-04-24T23:08:53.515 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-24T23:08:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 msgr2=0x7f4a0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 0x7f4a0806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b1780 tx=0x7f4a1c009040 comp rx=0 tx=0).stop 2024-04-24T23:08:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 msgr2=0x7f4a2c1397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4a2402a270 tx=0x7f4a240046c0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 shutdown_connections 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c141c80 0x7f4a2c1397f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2c13ef30 0x7f4a2c0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4a0806be30 0x7f4a0806e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 --2- 172.21.15.146:0/3258696396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4a2c0ce5a0 0x7f4a2c142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 >> 172.21.15.146:0/3258696396 conn(0x7f4a2c0b17b0 msgr2=0x7f4a2c06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 shutdown_connections 2024-04-24T23:08:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.517+0000 7f4a32000640 1 -- 172.21.15.146:0/3258696396 wait complete. 2024-04-24T23:08:53.528 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:08:53.526+0000 7f4f25800640 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-04-24T23:08:53.528 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:08:53.526+0000 7f4f25800640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-04-24T23:08:53.528 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:08:53.527+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-04-24T23:08:53.542 INFO:tasks.ceph.mds.c.smithi146.stderr: -33> 2024-04-24T23:08:53.526+0000 7f4f25800640 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-04-24T23:08:53.542 INFO:tasks.ceph.mds.c.smithi146.stderr: -32> 2024-04-24T23:08:53.526+0000 7f4f25800640 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-04-24T23:08:53.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:08:53.588 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.717+0000 7f5ca5c00640 1 Processor -- start 2024-04-24T23:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.717+0000 7f5ca5c00640 1 -- start start 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5ca5c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5ca0145640 0x7f5ca015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5ca5c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ca00d03a0 0x7f5ca00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5ca5c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca00cdf70 con 0x7f5ca00b2a20 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5ca5c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca015d360 con 0x7f5ca00d03a0 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5ca5c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca0145a20 con 0x7f5ca0145640 2024-04-24T23:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5c96000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5ca00b2a20 0x7f5ca00cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60482/0 (socket says 172.21.15.146:60482) 2024-04-24T23:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5c96000640 1 -- 172.21.15.146:0/1713737680 learned_addr learned my addr 172.21.15.146:0/1713737680 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.719+0000 7f5c9f400640 1 --2- 172.21.15.146:0/1713737680 >> v2:172.21.15.146:3300/0 conn(0x7f5ca00d03a0 0x7f5ca00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9ea00640 1 --2- 172.21.15.146:0/1713737680 >> v2:172.21.15.203:3300/0 conn(0x7f5ca0145640 0x7f5ca015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9f400640 1 -- 172.21.15.146:0/1713737680 >> v2:172.21.15.203:3300/0 conn(0x7f5ca0145640 msgr2=0x7f5ca015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9e000640 1 -- 172.21.15.146:0/1713737680 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350083098 0 0) 0x7f5ca00cdf70 con 0x7f5ca00b2a20 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9f400640 1 --2- 172.21.15.146:0/1713737680 >> v2:172.21.15.203:3300/0 conn(0x7f5ca0145640 0x7f5ca015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9f400640 1 -- 172.21.15.146:0/1713737680 >> v1:172.21.15.146:6789/0 conn(0x7f5ca00b2a20 legacy=0x7f5ca00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.720+0000 7f5c9f400640 1 -- 172.21.15.146:0/1713737680 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca006d140 con 0x7f5ca00d03a0 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.721+0000 7f5c9f400640 1 --2- 172.21.15.146:0/1713737680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca00ce450 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00cfa20 tx=0x7f5c9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7f9530f2398fff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.721+0000 7f5c9e000640 1 -- 172.21.15.146:0/1713737680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98007740 con 0x7f5ca00d03a0 2024-04-24T23:08:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.721+0000 7f5c9e000640 1 -- 172.21.15.146:0/1713737680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c980078e0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.721+0000 7f5c9e000640 1 -- 172.21.15.146:0/1713737680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98007cb0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 -- 172.21.15.146:0/1713737680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 msgr2=0x7f5ca00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/1713737680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca00ce450 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00cfa20 tx=0x7f5c9802a680 comp rx=0 tx=0).stop 2024-04-24T23:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 -- 172.21.15.146:0/1713737680 shutdown_connections 2024-04-24T23:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/1713737680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca00ce450 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/1713737680 >> v2:172.21.15.203:3300/0 conn(0x7f5ca0145640 0x7f5ca015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 -- 172.21.15.146:0/1713737680 >> 172.21.15.146:0/1713737680 conn(0x7f5ca006b320 msgr2=0x7f5ca006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 -- 172.21.15.146:0/1713737680 shutdown_connections 2024-04-24T23:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.722+0000 7f5ca5c00640 1 -- 172.21.15.146:0/1713737680 wait complete. 2024-04-24T23:08:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.724+0000 7f5ca5c00640 1 Processor -- start 2024-04-24T23:08:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.724+0000 7f5ca5c00640 1 -- start start 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca00b2a20 0x7f5ca015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0145640 0x7f5ca013e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca006d9e0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca006d700 con 0x7f5ca0145640 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5ca5c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca006cbc0 con 0x7f5ca00b2a20 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5c96000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5c96000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56700/0 (socket says 172.21.15.146:56700) 2024-04-24T23:08:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.725+0000 7f5c96000640 1 -- 172.21.15.146:0/163514005 learned_addr learned my addr 172.21.15.146:0/163514005 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 -- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca00b2a20 msgr2=0x7f5ca015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca00b2a20 0x7f5ca015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c9f400640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0145640 0x7f5ca013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 -- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0145640 msgr2=0x7f5ca013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0145640 0x7f5ca013e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 -- 172.21.15.146:0/163514005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca013d2f0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c96000640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c4d0 tx=0x7f5c8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88017070 con 0x7f5ca00d03a0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c88005d00 con 0x7f5ca00d03a0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880072b0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.726+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca013d590 con 0x7f5ca00d03a0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.727+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca013db50 con 0x7f5ca00d03a0 2024-04-24T23:08:53.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.728+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0068190 con 0x7f5ca00d03a0 2024-04-24T23:08:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.729+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c8801a070 con 0x7f5ca00d03a0 2024-04-24T23:08:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.730+0000 7f5c97400640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 0x7f5c7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.730+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6476+0+0 (secure 0 0 0) 0x7f5c8808a540 con 0x7f5ca00d03a0 2024-04-24T23:08:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.731+0000 7f5c9ea00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 0x7f5c7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.732+0000 7f5c9ea00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 0x7f5c7c06e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5c90006fd0 tx=0x7f5c90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.734+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5c88058be0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.975+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ca015cfa0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.976+0000 7f5c97400640 1 -- 172.21.15.146:0/163514005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+4371 (secure 0 0 0) 0x7f5c880584e0 con 0x7f5ca00d03a0 2024-04-24T23:08:53.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:53.979 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:08:53.528354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6666]},"id":4}]} 2024-04-24T23:08:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 57 2024-04-24T23:08:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 msgr2=0x7f5c7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 0x7f5c7c06e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5c90006fd0 tx=0x7f5c90008040 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 msgr2=0x7f5ca0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c4d0 tx=0x7f5c8800c990 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 shutdown_connections 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca0145640 0x7f5ca013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca00d03a0 0x7f5ca0158e90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c7c06be30 0x7f5c7c06e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 --2- 172.21.15.146:0/163514005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca00b2a20 0x7f5ca015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 >> 172.21.15.146:0/163514005 conn(0x7f5ca006b320 msgr2=0x7f5ca00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.979+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 shutdown_connections 2024-04-24T23:08:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:53.980+0000 7f5ca5c00640 1 -- 172.21.15.146:0/163514005 wait complete. 2024-04-24T23:08:54.001 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-24T23:08:54.001 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:08:54.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 Processor -- start 2024-04-24T23:08:54.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 -- start start 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3815e640 0x7fde3815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fde380d2450 0x7fde3815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde380cf240 con 0x7fde380ce4d0 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fde380cf010 con 0x7fde3815e640 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.248+0000 7fde3ce00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fde380d1720 con 0x7fde380d2450 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3815e640 0x7fde3815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3815e640 0x7fde3815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56714/0 (socket says 172.21.15.146:56714) 2024-04-24T23:08:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 -- 172.21.15.146:0/27208719 learned_addr learned my addr 172.21.15.146:0/27208719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:54.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 -- 172.21.15.146:0/27208719 >> v2:172.21.15.203:3300/0 conn(0x7fde380d2450 msgr2=0x7fde3815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 --2- 172.21.15.146:0/27208719 >> v2:172.21.15.203:3300/0 conn(0x7fde380d2450 0x7fde3815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 -- 172.21.15.146:0/27208719 >> v1:172.21.15.203:6789/0 conn(0x7fde380ce4d0 legacy=0x7fde380ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.249+0000 7fde37400640 1 -- 172.21.15.146:0/27208719 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde380d1970 con 0x7fde3815e640 2024-04-24T23:08:54.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.250+0000 7fde37400640 1 --2- 172.21.15.146:0/27208719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3815e640 0x7fde3815ea20 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fde3806bef0 tx=0x7fde2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88ab1b7710ba3bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde36000640 1 -- 172.21.15.146:0/27208719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28037070 con 0x7fde3815e640 2024-04-24T23:08:54.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde36000640 1 -- 172.21.15.146:0/27208719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde28032440 con 0x7fde3815e640 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde36000640 1 -- 172.21.15.146:0/27208719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28032810 con 0x7fde3815e640 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 -- 172.21.15.146:0/27208719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3815e640 msgr2=0x7fde3815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 --2- 172.21.15.146:0/27208719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3815e640 0x7fde3815ea20 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fde3806bef0 tx=0x7fde2802a230 comp rx=0 tx=0).stop 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 -- 172.21.15.146:0/27208719 shutdown_connections 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 --2- 172.21.15.146:0/27208719 >> v2:172.21.15.203:3300/0 conn(0x7fde380d2450 0x7fde3815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 --2- 172.21.15.146:0/27208719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3815e640 0x7fde3815ea20 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.251+0000 7fde3ce00640 1 -- 172.21.15.146:0/27208719 >> 172.21.15.146:0/27208719 conn(0x7fde3809aa50 msgr2=0x7fde3809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.252+0000 7fde3ce00640 1 -- 172.21.15.146:0/27208719 shutdown_connections 2024-04-24T23:08:54.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.252+0000 7fde3ce00640 1 -- 172.21.15.146:0/27208719 wait complete. 2024-04-24T23:08:54.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.254+0000 7fde3ce00640 1 Processor -- start 2024-04-24T23:08:54.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.254+0000 7fde3ce00640 1 -- start start 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde380d2450 0x7fde380cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3815e640 0x7fde38149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde380d1f30 con 0x7fde380ce4d0 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde3815f4a0 con 0x7fde380d2450 2024-04-24T23:08:54.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde3ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fde38167bf0 con 0x7fde3815e640 2024-04-24T23:08:54.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde37400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde37400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56716/0 (socket says 172.21.15.146:56716) 2024-04-24T23:08:54.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.255+0000 7fde37400640 1 -- 172.21.15.146:0/2953431007 learned_addr learned my addr 172.21.15.146:0/2953431007 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 -- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3815e640 msgr2=0x7fde38149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3815e640 0x7fde38149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 -- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde380d2450 msgr2=0x7fde380cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde380d2450 0x7fde380cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 -- 172.21.15.146:0/2953431007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde380cc6e0 con 0x7fde380ce4d0 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde37400640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fde28000c00 tx=0x7fde280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28041070 con 0x7fde380ce4d0 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2803c870 con 0x7fde380ce4d0 2024-04-24T23:08:54.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde380cc980 con 0x7fde380ce4d0 2024-04-24T23:08:54.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28037040 con 0x7fde380ce4d0 2024-04-24T23:08:54.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.256+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde380ccf40 con 0x7fde380ce4d0 2024-04-24T23:08:54.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.257+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3804f500 con 0x7fde380ce4d0 2024-04-24T23:08:54.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.259+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde28044070 con 0x7fde380ce4d0 2024-04-24T23:08:54.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.259+0000 7fde2f400640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.260+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6476+0+0 (secure 0 0 0) 0x7fde280abd60 con 0x7fde380ce4d0 2024-04-24T23:08:54.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.260+0000 7fde36a00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.261+0000 7fde36a00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 0x7fde1806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fde38149a30 tx=0x7fde24006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.266+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde2807a400 con 0x7fde380ce4d0 2024-04-24T23:08:54.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.507+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde381611e0 con 0x7fde380ce4d0 2024-04-24T23:08:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.509+0000 7fde2f400640 1 -- 172.21.15.146:0/2953431007 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+4371 (secure 0 0 0) 0x7fde28079d00 con 0x7fde380ce4d0 2024-04-24T23:08:54.511 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:54.511 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:07:08.786511+0000","modified":"2024-04-24T23:08:53.528354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":72,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6666},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/4094476555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4094476555},{"type":"v1","addr":"172.21.15.203:6837","nonce":4094476555}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6666,"qdb_cluster":[6666]},"id":4}]} 2024-04-24T23:08:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 57 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.511+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 msgr2=0x7fde1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.511+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 0x7fde1806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fde38149a30 tx=0x7fde24006c90 comp rx=0 tx=0).stop 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.511+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 msgr2=0x7fde3814a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.511+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fde28000c00 tx=0x7fde280046c0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 shutdown_connections 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fde1806be30 0x7fde1806e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3815e640 0x7fde38149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde380d2450 0x7fde380cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 --2- 172.21.15.146:0/2953431007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde380ce4d0 0x7fde3814a6d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 >> 172.21.15.146:0/2953431007 conn(0x7fde3809aa50 msgr2=0x7fde3814c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 shutdown_connections 2024-04-24T23:08:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.512+0000 7fde3ce00640 1 -- 172.21.15.146:0/2953431007 wait complete. 2024-04-24T23:08:54.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:08:54.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.716+0000 7f4f55800640 1 Processor -- start 2024-04-24T23:08:54.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.716+0000 7f4f55800640 1 -- start start 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f55800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 0x7f4f5006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f55800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f5015e8b0 0x7f4f5015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f55800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f50071960 con 0x7f4f5015f220 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f55800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4f50071c40 con 0x7f4f5015e8b0 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f55800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4f50071f20 con 0x7f4f5015abb0 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f5015e8b0 0x7f4f5015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f5015e8b0 0x7f4f5015ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56722/0 (socket says 172.21.15.146:56722) 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 -- 172.21.15.146:0/1926491045 learned_addr learned my addr 172.21.15.146:0/1926491045 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f4ea00640 1 --2- 172.21.15.146:0/1926491045 >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 0x7f4f5006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 -- 172.21.15.146:0/1926491045 >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 msgr2=0x7f4f5006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 --2- 172.21.15.146:0/1926491045 >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 0x7f4f5006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 -- 172.21.15.146:0/1926491045 >> v1:172.21.15.203:6789/0 conn(0x7f4f5015f220 legacy=0x7f4f5015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f46000640 1 -- 172.21.15.146:0/1926491045 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50072200 con 0x7f4f5015e8b0 2024-04-24T23:08:54.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.719+0000 7f4f4ea00640 1 --2- 172.21.15.146:0/1926491045 >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 0x7f4f5006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:54.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.720+0000 7f4f46000640 1 --2- 172.21.15.146:0/1926491045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5015ece0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4f500d0b20 tx=0x7f4f3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2793e18e1f8004 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.720+0000 7f4f4e000640 1 -- 172.21.15.146:0/1926491045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38037070 con 0x7f4f5015e8b0 2024-04-24T23:08:54.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.720+0000 7f4f4e000640 1 -- 172.21.15.146:0/1926491045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f38032440 con 0x7f4f5015e8b0 2024-04-24T23:08:54.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.720+0000 7f4f4e000640 1 -- 172.21.15.146:0/1926491045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38032810 con 0x7f4f5015e8b0 2024-04-24T23:08:54.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 -- 172.21.15.146:0/1926491045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 msgr2=0x7f4f5015ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 --2- 172.21.15.146:0/1926491045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5015ece0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4f500d0b20 tx=0x7f4f3802a230 comp rx=0 tx=0).stop 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 -- 172.21.15.146:0/1926491045 shutdown_connections 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 --2- 172.21.15.146:0/1926491045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5015ece0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 --2- 172.21.15.146:0/1926491045 >> v2:172.21.15.203:3300/0 conn(0x7f4f5015abb0 0x7f4f5006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 -- 172.21.15.146:0/1926491045 >> 172.21.15.146:0/1926491045 conn(0x7f4f5006b140 msgr2=0x7f4f5006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 -- 172.21.15.146:0/1926491045 shutdown_connections 2024-04-24T23:08:54.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.721+0000 7f4f55800640 1 -- 172.21.15.146:0/1926491045 wait complete. 2024-04-24T23:08:54.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.723+0000 7f4f55800640 1 Processor -- start 2024-04-24T23:08:54.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.723+0000 7f4f55800640 1 -- start start 2024-04-24T23:08:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5015abb0 0x7f4f500ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f5015f220 0x7f4f5014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5015d7c0 con 0x7f4f5015e8b0 2024-04-24T23:08:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5015f650 con 0x7f4f5015abb0 2024-04-24T23:08:54.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f55800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5015d940 con 0x7f4f5015f220 2024-04-24T23:08:54.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f46000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f46000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56734/0 (socket says 172.21.15.146:56734) 2024-04-24T23:08:54.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.724+0000 7f4f46000640 1 -- 172.21.15.146:0/3189424792 learned_addr learned my addr 172.21.15.146:0/3189424792 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:54.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f4ea00640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5015abb0 0x7f4f500ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f4f400640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f5015f220 0x7f4f5014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 -- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f5015f220 msgr2=0x7f4f5014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f5015f220 0x7f4f5014e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 -- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5015abb0 msgr2=0x7f4f500ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5015abb0 0x7f4f500ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 -- 172.21.15.146:0/3189424792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5014fd30 con 0x7f4f5015e8b0 2024-04-24T23:08:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f46000640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4f38000c00 tx=0x7f4f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38041020 con 0x7f4f5015e8b0 2024-04-24T23:08:54.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f38030970 con 0x7f4f5015e8b0 2024-04-24T23:08:54.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.725+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38037040 con 0x7f4f5015e8b0 2024-04-24T23:08:54.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.726+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f50150010 con 0x7f4f5015e8b0 2024-04-24T23:08:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.726+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f500ce420 con 0x7f4f5015e8b0 2024-04-24T23:08:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.727+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5004f5a0 con 0x7f4f5015e8b0 2024-04-24T23:08:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.728+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f38044020 con 0x7f4f5015e8b0 2024-04-24T23:08:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.729+0000 7f4f47400640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.729+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6476+0+0 (secure 0 0 0) 0x7f4f380abb40 con 0x7f4f5015e8b0 2024-04-24T23:08:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.729+0000 7f4f4ea00640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.730+0000 7f4f4ea00640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000a990 tx=0x7f4f40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.733+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4f3804b030 con 0x7f4f5015e8b0 2024-04-24T23:08:54.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.970+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4f50153970 con 0x7f4f5015e8b0 2024-04-24T23:08:54.973 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:08:54.972+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:08:54.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.976+0000 7f4f47400640 1 -- 172.21.15.146:0/3189424792 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7f4f3807a1f0 con 0x7f4f5015e8b0 2024-04-24T23:08:54.978 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.978+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 msgr2=0x7f4f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.978+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000a990 tx=0x7f4f40008040 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.978+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 msgr2=0x7f4f5014e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.978+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4f38000c00 tx=0x7f4f380046c0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 shutdown_connections 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4f2c06be30 0x7f4f2c06e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f5015f220 0x7f4f5014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f5015e8b0 0x7f4f5014e260 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 --2- 172.21.15.146:0/3189424792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5015abb0 0x7f4f500ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 >> 172.21.15.146:0/3189424792 conn(0x7f4f5006b140 msgr2=0x7f4f5015af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 shutdown_connections 2024-04-24T23:08:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:54.979+0000 7f4f55800640 1 -- 172.21.15.146:0/3189424792 wait complete. 2024-04-24T23:08:54.999 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries summary 2024-04-24T23:08:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.090+0000 7f764bfce280 1 -- start start 2024-04-24T23:08:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.090+0000 7f764bfce280 1 Processor -- start 2024-04-24T23:08:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559eaf9ec00 0x5559eb00a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559eaf9f800 0x5559eb00ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02300 con 0x5559eaf9fc00 2024-04-24T23:08:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02480 con 0x5559eaf9ec00 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5559ebd02600 con 0x5559eaf9f800 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56742/0 (socket says 172.21.15.146:56742) 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764aa00640 1 -- 172.21.15.146:0/4261272183 learned_addr learned my addr 172.21.15.146:0/4261272183 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f764a000640 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559eaf9ec00 0x5559eb00a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.091+0000 7f7649600640 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559eaf9f800 0x5559eb00ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 -- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559eaf9f800 msgr2=0x5559eb00ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559eaf9f800 0x5559eb00ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 -- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559eaf9ec00 msgr2=0x5559eb00a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559eaf9ec00 0x5559eb00a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 -- 172.21.15.146:0/4261272183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559eafd2780 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764aa00640 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x5559ebdbf380 tx=0x5559ebd32120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edf564235b66be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f7646e00640 1 -- 172.21.15.146:0/4261272183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc4680 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559eafd23c0 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f7646e00640 1 -- 172.21.15.146:0/4261272183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559eafca700 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f7646e00640 1 -- 172.21.15.146:0/4261272183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc4b60 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5559eafd3680 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.092+0000 7f7646e00640 1 -- 172.21.15.146:0/4261272183 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5559ebd6c600 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.093+0000 7f7646e00640 1 -- 172.21.15.146:0/4261272183 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 59) ==== 2901+0+0 (secure 0 0 0) 0x5559eaff9180 con 0x5559eaf9fc00 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.093+0000 7f764bfce280 1 Processor -- start 2024-04-24T23:08:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 -- start start 2024-04-24T23:08:55.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f400 0x5559eb00b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7fc00 0x5559eb00c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02780 con 0x5559ebd7f800 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02900 con 0x5559ebd7f400 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.094+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5559eb000900 con 0x5559ebd7fc00 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56752/0 (socket says 172.21.15.146:56752) 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 -- 172.21.15.146:0/992927214 learned_addr learned my addr 172.21.15.146:0/992927214 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f7649600640 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f400 0x5559eb00b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 -- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7fc00 msgr2=0x5559eb00c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7fc00 0x5559eb00c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 -- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f400 msgr2=0x5559eb00b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f400 0x5559eb00b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 -- 172.21.15.146:0/992927214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559eafd34a0 con 0x5559ebd7f800 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.095+0000 7f764a000640 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7e690 tx=0x5559ebe81800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f713c21f080fc989 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f7644600640 1 -- 172.21.15.146:0/992927214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc4680 con 0x5559ebd7f800 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f7644600640 1 -- 172.21.15.146:0/992927214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559eafcafc0 con 0x5559ebd7f800 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f7644600640 1 -- 172.21.15.146:0/992927214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc4b60 con 0x5559ebd7f800 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 -- 172.21.15.146:0/992927214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 msgr2=0x5559eb00bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7e690 tx=0x5559ebe81800 comp rx=0 tx=0).stop 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 -- 172.21.15.146:0/992927214 shutdown_connections 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7fc00 0x5559eb00c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7f800 0x5559eb00bb80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 --2- 172.21.15.146:0/992927214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f400 0x5559eb00b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 -- 172.21.15.146:0/992927214 >> 172.21.15.146:0/992927214 conn(0x5559ebd7f000 msgr2=0x5559eb083000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 -- 172.21.15.146:0/992927214 shutdown_connections 2024-04-24T23:08:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.096+0000 7f764bfce280 1 -- 172.21.15.146:0/992927214 wait complete. 2024-04-24T23:08:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.097+0000 7f764bfce280 1 Processor -- start 2024-04-24T23:08:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.097+0000 7f764bfce280 1 -- start start 2024-04-24T23:08:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7f400 0x5559eb00d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f800 0x5559eb00cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02780 con 0x5559ebd7fc00 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5559ebd02900 con 0x5559ebd7f800 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764bfce280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5559ebd03500 con 0x5559ebd7f400 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f7649600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f7649600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56760/0 (socket says 172.21.15.146:56760) 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 learned_addr learned my addr 172.21.15.146:0/1348227868 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f764a000640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f800 0x5559eb00cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.098+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7f400 0x5559eb00d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7f400 msgr2=0x5559eb00d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559ebd7f400 0x5559eb00d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f800 msgr2=0x5559eb00cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559ebd7f800 0x5559eb00cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559eafd2780 con 0x5559ebd7fc00 2024-04-24T23:08:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7f3e0 tx=0x5559ebd30ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7642800640 1 -- 172.21.15.146:0/1348227868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc49c0 con 0x5559ebd7fc00 2024-04-24T23:08:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7642800640 1 -- 172.21.15.146:0/1348227868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5559eafcac40 con 0x5559ebd7fc00 2024-04-24T23:08:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559eafd23c0 con 0x5559ebd7fc00 2024-04-24T23:08:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f7642800640 1 -- 172.21.15.146:0/1348227868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5559eafc4680 con 0x5559ebd7fc00 2024-04-24T23:08:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.099+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559eafd2000 con 0x5559ebd7fc00 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.101+0000 7f7642800640 1 -- 172.21.15.146:0/1348227868 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5559ebedec00 con 0x5559ebd7fc00 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.101+0000 7f7642800640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 0x5559eb00d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.102+0000 7f7642800640 1 -- 172.21.15.146:0/1348227868 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5559ebed8c00 con 0x5559ebd7fc00 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.102+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5559ebed7000 0x5559eb00c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.102+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7400 con 0x5559ebed7000 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.102+0000 7f764a000640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 0x5559eb00d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.102+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5559ebed7000 0x5559eb00c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.103+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5559ebed7000 0x5559eb00c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.103+0000 7f764a000640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 0x5559eb00d700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7e690 tx=0x5559eb01b0e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.106+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.106+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5559ebed7800 0x5559eb00bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.106+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7c00 con 0x5559ebed7800 2024-04-24T23:08:55.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.106+0000 7f764aa00640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5559ebed7800 0x5559eb00bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.109 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:08:55.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.107+0000 7f764aa00640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5559ebed7800 0x5559eb00bb80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.107+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv25 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.108+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5559eb318000 0x5559eb00b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.108+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 9.1b 9:ddb4e4d7:::200.00000002:head [read 5177~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb318400 con 0x5559eb318000 2024-04-24T23:08:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.108+0000 7f764a000640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5559eb318000 0x5559eb00b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.109+0000 7f764a000640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5559eb318000 0x5559eb00b600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.109+0000 7f764a000640 1 -- 172.21.15.146:0/1348227868 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(3 200.00000002 [read 5177~9012 out=9012b] v0'0 uv20 ondisk = 0) ==== 156+0+9012 (crc 0 0 0) 0x5559eb07a780 con 0x5559eb318000 2024-04-24T23:08:55.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.110+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:4 9.b 9:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb318800 con 0x5559ebed7800 2024-04-24T23:08:55.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.110+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.110+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5559eb318c00 0x5559eb324000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.110+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:5 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319000 con 0x5559eb318c00 2024-04-24T23:08:55.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.111+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5559eb318c00 0x5559eb324000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.111+0000 7f7649600640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5559eb318c00 0x5559eb324000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:6 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319400 con 0x5559eb318c00 2024-04-24T23:08:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=583b] v0'0 uv6 ondisk = 0) ==== 154+0+583 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:7 9.13 9:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319800 con 0x5559ebed7000 2024-04-24T23:08:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:8 9.13 9:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319c00 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.116+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:9 9.7 9:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319000 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:10 9.7 9:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319400 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:11 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319800 con 0x5559eb318c00 2024-04-24T23:08:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.117+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:12 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7400 con 0x5559eb318c00 2024-04-24T23:08:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.119+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v73'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.119+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:13 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd85400 con 0x5559eb318c00 2024-04-24T23:08:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.120+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.120+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:14 9.14 9:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd85400 con 0x5559ebed7800 2024-04-24T23:08:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.120+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(14 1.00000000.inode [read 0~582 out=582b] v0'0 uv20 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.121+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:15 9.14 9:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7400 con 0x5559ebed7800 2024-04-24T23:08:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.123+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(15 1.00000000.inode [writefull 0~582] v73'26 uv26 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.123+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319c00 con 0x5559eb318c00 2024-04-24T23:08:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.125+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 6 ==== osd_op_reply(16 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.125+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:17 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319000 con 0x5559eb318c00 2024-04-24T23:08:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.125+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 7 ==== osd_op_reply(17 1.00000000 [omap-set-header] v73'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.126+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:18 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319400 con 0x5559eb318c00 2024-04-24T23:08:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.126+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 8 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=583b] v0'0 uv8 ondisk = 0) ==== 154+0+583 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.126+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:19 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-vals in=567b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319800 con 0x5559eb318c00 2024-04-24T23:08:55.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.129+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 9 ==== osd_op_reply(19 1.00000000 [omap-set-vals] v73'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.129+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:20 9.14 9:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7c00 con 0x5559ebed7800 2024-04-24T23:08:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.129+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(20 1.00000000.inode [read 0~582 out=582b] v0'0 uv26 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.129+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.14 9:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559ebed7400 con 0x5559ebed7800 2024-04-24T23:08:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.135+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(21 1.00000000.inode [writefull 0~582] v73'27 uv27 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.135+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:22 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd85400 con 0x5559eb318c00 2024-04-24T23:08:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.135+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 10 ==== osd_op_reply(22 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.135+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:23 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb318800 con 0x5559eb318c00 2024-04-24T23:08:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.138+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 11 ==== osd_op_reply(23 1.00000000 [omap-set-header] v73'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.138+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd7e800 con 0x5559eb318c00 2024-04-24T23:08:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.138+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 12 ==== osd_op_reply(24 1.00000000 [omap-get-vals-by-keys out=567b] v0'0 uv10 ondisk = 0) ==== 154+0+567 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.138+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:25 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-vals in=567b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd7e800 con 0x5559eb318c00 2024-04-24T23:08:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.140+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 13 ==== osd_op_reply(25 1.00000000 [omap-set-vals] v73'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.140+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:26 9.14 9:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319c00 con 0x5559ebed7800 2024-04-24T23:08:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.141+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(26 1.00000000.inode [read 0~582 out=582b] v0'0 uv27 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.141+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.14 9:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319000 con 0x5559ebed7800 2024-04-24T23:08:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.145+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 1.00000000.inode [writefull 0~582] v73'28 uv28 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.145+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:28 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319400 con 0x5559eb318c00 2024-04-24T23:08:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.145+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 14 ==== osd_op_reply(28 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.145+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:29 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb319800 con 0x5559eb318c00 2024-04-24T23:08:55.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.146+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 15 ==== osd_op_reply(29 1.00000000 [omap-set-header] v73'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.147+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:30 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb318800 con 0x5559eb318c00 2024-04-24T23:08:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.147+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 16 ==== osd_op_reply(30 1.00000000 [omap-get-vals-by-keys out=583b] v0'0 uv12 ondisk = 0) ==== 154+0+583 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.148+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:31 9.1f 9:ff5b34d6:::1.00000000:head [omap-set-vals in=567b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559ebd85400 con 0x5559eb318c00 2024-04-24T23:08:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.150+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.6 v2:172.21.15.203:6807/3736386787 17 ==== osd_op_reply(31 1.00000000 [omap-set-vals] v73'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5559eb07a000 con 0x5559eb318c00 2024-04-24T23:08:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.150+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5559eb336000 0x5559eb324580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.150+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:32 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb336400 con 0x5559eb336000 2024-04-24T23:08:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.150+0000 7f764aa00640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5559eb336000 0x5559eb324580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.151+0000 7f764aa00640 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5559eb336000 0x5559eb324580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.152+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(32 10000000000.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5559eb07a500 con 0x5559eb336000 2024-04-24T23:08:55.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.152+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:33 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb336800 con 0x5559eb336000 2024-04-24T23:08:55.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.154+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(33 10000000000.00000000 [omap-set-header] v73'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559eb336000 2024-04-24T23:08:55.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.154+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:34 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb336c00 con 0x5559eb336000 2024-04-24T23:08:55.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.155+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(34 10000000000.00000000 [omap-get-vals-by-keys out=620b] v0'0 uv13 ondisk = 0) ==== 164+0+620 (crc 0 0 0) 0x5559eb07a500 con 0x5559eb336000 2024-04-24T23:08:55.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.155+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:35 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=574b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb337000 con 0x5559eb336000 2024-04-24T23:08:55.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.158+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.1 v2:172.21.15.146:6800/2440725071 4 ==== osd_op_reply(35 10000000000.00000000 [omap-set-vals] v73'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559eb336000 2024-04-24T23:08:55.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.159+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:36 9.14 9:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb337400 con 0x5559ebed7800 2024-04-24T23:08:55.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.159+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 9 ==== osd_op_reply(36 1.00000000.inode [read 0~582 out=582b] v0'0 uv28 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.160+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:37 9.14 9:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5559eb337800 con 0x5559ebed7800 2024-04-24T23:08:55.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.164+0000 7f764aa00640 1 -- 172.21.15.146:0/1348227868 <== osd.5 v2:172.21.15.203:6800/1152275008 10 ==== osd_op_reply(37 1.00000000.inode [writefull 0~582] v73'29 uv29 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x5559eb07a500 con 0x5559ebed7800 2024-04-24T23:08:55.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.164+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:38 9.13 9:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb337c00 con 0x5559ebed7000 2024-04-24T23:08:55.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.164+0000 7f7649600640 1 -- 172.21.15.146:0/1348227868 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(38 mds0_inotable [read 0~34 out=34b] v0'0 uv5 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5559eb07a000 con 0x5559ebed7000 2024-04-24T23:08:55.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.164+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:39 9.1b 9:dbae76b5:::mds1_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5559eb336400 con 0x5559eb318000 2024-04-24T23:08:55.167 INFO:teuthology.orchestra.run.smithi146.stdout:Events by type: 2024-04-24T23:08:55.167 INFO:teuthology.orchestra.run.smithi146.stdout: SUBTREEMAP: 1 2024-04-24T23:08:55.167 INFO:teuthology.orchestra.run.smithi146.stdout: UPDATE: 4 2024-04-24T23:08:55.167 INFO:teuthology.orchestra.run.smithi146.stdout:Errors: 0 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764a000640 1 -- 172.21.15.146:0/1348227868 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(39 mds1_inotable [read 0~4194304] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x5559eb07a780 con 0x5559eb318000 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 -1 consume_inos: unable to read inotable 'mds1_inotable': (2) No such file or directory 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 main_event: Error updating InoTable for 3 consume inos: (2) No such file or directory 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5559eb336000 msgr2=0x5559eb324580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x5559eb336000 0x5559eb324580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5559ebed7000 msgr2=0x5559eb00c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5559ebed7000 0x5559eb00c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5559eb318000 msgr2=0x5559eb00b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5559eb318000 0x5559eb00b600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5559ebed7800 msgr2=0x5559eb00bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5559ebed7800 0x5559eb00bb80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5559eb318c00 msgr2=0x5559eb324000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5559eb318c00 0x5559eb324000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764a000640 1 -- 172.21.15.146:0/1348227868 reap_dead start 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764a000640 1 -- 172.21.15.146:0/1348227868 reap_dead start 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 msgr2=0x5559eb00d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 0x5559eb00d700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7e690 tx=0x5559eb01b0e0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 msgr2=0x5559eb00c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x5559ebe7f3e0 tx=0x5559ebd30ae0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 shutdown_connections 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559ebd7fc00 0x5559eb00c680 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 --2- 172.21.15.146:0/1348227868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5559ebed6c00 0x5559eb00d700 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 >> 172.21.15.146:0/1348227868 conn(0x5559ebd7f000 msgr2=0x5559eb083000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 shutdown_connections 2024-04-24T23:08:55.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.166+0000 7f764bfce280 1 -- 172.21.15.146:0/1348227868 wait complete. 2024-04-24T23:08:55.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 msgr2=0x5559eb00b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x5559ebdbf380 tx=0x5559ebd32120 comp rx=0 tx=0).stop 2024-04-24T23:08:55.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 shutdown_connections 2024-04-24T23:08:55.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5559eaf9fc00 0x5559eb00b080 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5559eaf9f800 0x5559eb00ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 --2- 172.21.15.146:0/4261272183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559eaf9ec00 0x5559eb00a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.167+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 >> 172.21.15.146:0/4261272183 conn(0x5559eaf9f000 msgr2=0x5559eb082800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.168+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 shutdown_connections 2024-04-24T23:08:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.168+0000 7f764bfce280 1 -- 172.21.15.146:0/4261272183 wait complete. 2024-04-24T23:08:55.178 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'summary'] in time 0:00:00.179301, result: Events by type: SUBTREEMAP: 1 UPDATE: 4 Errors: 0 2024-04-24T23:08:55.178 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:1 event recover_dentries summary 2024-04-24T23:08:55.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.279+0000 7fabc2f38280 1 -- start start 2024-04-24T23:08:55.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.279+0000 7fabc2f38280 1 Processor -- start 2024-04-24T23:08:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 0x55e945f58580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e945eedc00 0x55e945f59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc2180 con 0x55e945eed800 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc2300 con 0x55e945eecc00 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e946cc2480 con 0x55e945eedc00 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc0600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc0600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56784/0 (socket says 172.21.15.146:56784) 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc0600640 1 -- 172.21.15.146:0/2137591211 learned_addr learned my addr 172.21.15.146:0/2137591211 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc1000640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 0x55e945f58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.280+0000 7fabc1a00640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e945eedc00 0x55e945f59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 -- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e945eedc00 msgr2=0x55e945f59080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e945eedc00 0x55e945f59080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 -- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 msgr2=0x55e945f58580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 0x55e945f58580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 -- 172.21.15.146:0/2137591211 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e945f20780 con 0x55e945eed800 2024-04-24T23:08:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc1000640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 0x55e945f58580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:55.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc0600640 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x55e946d0f380 tx=0x55e946c80120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c4909398d09c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabbde00640 1 -- 172.21.15.146:0/2137591211 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f12680 con 0x55e945eed800 2024-04-24T23:08:55.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabbde00640 1 -- 172.21.15.146:0/2137591211 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e945f18fc0 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabbde00640 1 -- 172.21.15.146:0/2137591211 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f12b60 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e945f203c0 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.281+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e945f21680 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.282+0000 7fabbde00640 1 -- 172.21.15.146:0/2137591211 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x55e946db6600 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.282+0000 7fabbde00640 1 -- 172.21.15.146:0/2137591211 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 59) ==== 2901+0+0 (secure 0 0 0) 0x55e945f47180 con 0x55e945eed800 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.283+0000 7fabc2f38280 1 Processor -- start 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.283+0000 7fabc2f38280 1 -- start start 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5800 0x55e945f59b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5c00 0x55e945f5a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc2600 con 0x55e946da5400 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc2780 con 0x55e946da5c00 2024-04-24T23:08:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e946cc2900 con 0x55e946da5800 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56788/0 (socket says 172.21.15.146:56788) 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 -- 172.21.15.146:0/376441694 learned_addr learned my addr 172.21.15.146:0/376441694 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1000640 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5800 0x55e945f59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 -- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5800 msgr2=0x55e945f59b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5800 0x55e945f59b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 -- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5c00 msgr2=0x55e945f5a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5c00 0x55e945f5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.284+0000 7fabc1a00640 1 -- 172.21.15.146:0/376441694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e945f214a0 con 0x55e946da5400 2024-04-24T23:08:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc1a00640 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x55e946dc4840 tx=0x55e946dc7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664e326f966b53ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabbb600640 1 -- 172.21.15.146:0/376441694 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f12680 con 0x55e946da5400 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabbb600640 1 -- 172.21.15.146:0/376441694 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e945f18a80 con 0x55e946da5400 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabbb600640 1 -- 172.21.15.146:0/376441694 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f12b60 con 0x55e946da5400 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 -- 172.21.15.146:0/376441694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 msgr2=0x55e945f59600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x55e946dc4840 tx=0x55e946dc7800 comp rx=0 tx=0).stop 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 -- 172.21.15.146:0/376441694 shutdown_connections 2024-04-24T23:08:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5c00 0x55e945f5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5800 0x55e945f59b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 --2- 172.21.15.146:0/376441694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5400 0x55e945f59600 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.285+0000 7fabc2f38280 1 -- 172.21.15.146:0/376441694 >> 172.21.15.146:0/376441694 conn(0x55e946da5000 msgr2=0x55e945fd1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.286+0000 7fabc2f38280 1 -- 172.21.15.146:0/376441694 shutdown_connections 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.286+0000 7fabc2f38280 1 -- 172.21.15.146:0/376441694 wait complete. 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.286+0000 7fabc2f38280 1 Processor -- start 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.286+0000 7fabc2f38280 1 -- start start 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5400 0x55e945f5b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5c00 0x55e945f5a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc3c80 con 0x55e946da5800 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e946cc3b00 con 0x55e946da5400 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.287+0000 7fabc2f38280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e946cc3980 con 0x55e946da5c00 2024-04-24T23:08:55.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56790/0 (socket says 172.21.15.146:56790) 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 learned_addr learned my addr 172.21.15.146:0/1587190847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5400 0x55e945f5b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5c00 msgr2=0x55e945f5a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e946da5c00 0x55e945f5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5400 msgr2=0x55e945f5b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e946da5400 0x55e945f5b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e945f20780 con 0x55e946da5800 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.288+0000 7fabc1000640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x55e946dc5470 tx=0x55e946c7e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.289+0000 7fabb9800640 1 -- 172.21.15.146:0/1587190847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f129c0 con 0x55e946da5800 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.289+0000 7fabb9800640 1 -- 172.21.15.146:0/1587190847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e945f18e00 con 0x55e946da5800 2024-04-24T23:08:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.289+0000 7fabb9800640 1 -- 172.21.15.146:0/1587190847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e945f12680 con 0x55e946da5800 2024-04-24T23:08:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.289+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e945f203c0 con 0x55e946da5800 2024-04-24T23:08:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.289+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e945f20000 con 0x55e946da5800 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.290+0000 7fabb9800640 1 -- 172.21.15.146:0/1587190847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55e946e28c00 con 0x55e946da5800 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.291+0000 7fabb9800640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 0x55e945f5b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.291+0000 7fabb9800640 1 -- 172.21.15.146:0/1587190847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x55e946e22c00 con 0x55e946da5800 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.291+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e946e21000 0x55e945f5a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.291+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.5 9:a6e36b3f:::401.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946e21400 con 0x55e946e21000 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.292+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 0x55e945f5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.292+0000 7fabc0600640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e946e21000 0x55e945f5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.293+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 0x55e945f5b700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55e946dc4840 tx=0x55e946c7e6c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.293+0000 7fabc0600640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e946e21000 0x55e945f5a100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc0600640 1 -- 172.21.15.146:0/1587190847 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 401.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55e945fc8000 con 0x55e946e21000 2024-04-24T23:08:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55e946e21800 0x55e945f59b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:2 9.17 9:ea85266a:::201.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946e21c00 con 0x55e946e21800 2024-04-24T23:08:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55e946e21800 0x55e945f59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55e946e21800 0x55e945f59b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc1a00640 1 -- 172.21.15.146:0/1587190847 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(2 201.00000000 [read 0~90 out=90b] v0'0 uv7 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55e945fc8500 con 0x55e946e21800 2024-04-24T23:08:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e946260000 0x55e945f59600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.295+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 9.1b 9:db457a8a:::201.00000001:head [read 1176843~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946260400 con 0x55e946260000 2024-04-24T23:08:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.296+0000 7fabc1000640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e946260000 0x55e945f59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.297+0000 7fabc1000640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e946260000 0x55e945f59600 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.298+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(3 201.00000001 [read 1176843~1801 out=1801b] v0'0 uv15 ondisk = 0) ==== 156+0+1801 (crc 0 0 0) 0x55e945fc8780 con 0x55e946260000 2024-04-24T23:08:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.298+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:4 9.1b 9:d80f8093:::201.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946260800 con 0x55e946260000 2024-04-24T23:08:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.299+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== osd_op_reply(4 201.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55e945fc8780 con 0x55e946260000 2024-04-24T23:08:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.299+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x55e946260c00 0x55e94626e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.299+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:5 9.3 9:c112adae:::101.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946261000 con 0x55e946260c00 2024-04-24T23:08:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.300+0000 7fabc0600640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x55e946260c00 0x55e94626e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.300+0000 7fabc0600640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x55e946260c00 0x55e94626e000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.300+0000 7fabc0600640 1 -- 172.21.15.146:0/1587190847 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(5 101.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x55e945fc8000 con 0x55e946260c00 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.300+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:6 9.3 9:c112adae:::101.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946261400 con 0x55e946260c00 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.301+0000 7fabc0600640 1 -- 172.21.15.146:0/1587190847 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(6 101.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x55e945fc8000 con 0x55e946260c00 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.301+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e946261800 0x55e94626e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.301+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:7 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e946261c00 con 0x55e946261800 2024-04-24T23:08:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.301+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e946261800 0x55e94626e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.302+0000 7fabc1a00640 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e946261800 0x55e94626e580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.303+0000 7fabc1a00640 1 -- 172.21.15.146:0/1587190847 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(7 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x55e945fc8500 con 0x55e946261800 2024-04-24T23:08:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.303+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:8 9.1f 9:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e94627a000 con 0x55e946261800 2024-04-24T23:08:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.304+0000 7fabc1a00640 1 -- 172.21.15.146:0/1587190847 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(8 1.00000000 [omap-get-vals-by-keys out=567b] v0'0 uv13 ondisk = 0) ==== 154+0+567 (crc 0 0 0) 0x55e945fc8500 con 0x55e946261800 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.304+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:9 9.7 9:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e94627a400 con 0x55e946e21800 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.304+0000 7fabc1a00640 1 -- 172.21.15.146:0/1587190847 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55e945fc8500 con 0x55e946e21800 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.304+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:10 9.7 9:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x55e94627a800 con 0x55e946e21800 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc1a00640 1 -- 172.21.15.146:0/1587190847 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55e945fc8500 con 0x55e946e21800 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stdout:Events by type: 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stdout: SUBTREEMAP: 1 2024-04-24T23:08:55.307 INFO:teuthology.orchestra.run.smithi146.stdout:Errors: 0 2024-04-24T23:08:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x55e946260c00 msgr2=0x55e94626e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x55e946260c00 0x55e94626e000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55e946e21800 msgr2=0x55e945f59b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55e946e21800 0x55e945f59b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e946260000 msgr2=0x55e945f59600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55e946260000 0x55e945f59600 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e946e21000 msgr2=0x55e945f5a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55e946e21000 0x55e945f5a100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e946261800 msgr2=0x55e94626e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e946261800 0x55e94626e580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 reap_dead start 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc1000640 1 -- 172.21.15.146:0/1587190847 reap_dead start 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 msgr2=0x55e945f5b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 0x55e945f5b700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55e946dc4840 tx=0x55e946c7e6c0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 msgr2=0x55e945f5ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x55e946dc5470 tx=0x55e946c7e960 comp rx=0 tx=0).stop 2024-04-24T23:08:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 shutdown_connections 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e946e20c00 0x55e945f5b700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 --2- 172.21.15.146:0/1587190847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e946da5800 0x55e945f5ac00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 >> 172.21.15.146:0/1587190847 conn(0x55e946da5000 msgr2=0x55e945fd1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 shutdown_connections 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.305+0000 7fabc2f38280 1 -- 172.21.15.146:0/1587190847 wait complete. 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 msgr2=0x55e945f58b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x55e946d0f380 tx=0x55e946c80120 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 shutdown_connections 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e945eedc00 0x55e945f59080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e945eed800 0x55e945f58b00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 --2- 172.21.15.146:0/2137591211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e945eecc00 0x55e945f58580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 >> 172.21.15.146:0/2137591211 conn(0x55e945eed000 msgr2=0x55e945fd0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 shutdown_connections 2024-04-24T23:08:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.306+0000 7fabc2f38280 1 -- 172.21.15.146:0/2137591211 wait complete. 2024-04-24T23:08:55.313 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:1', 'event', 'recover_dentries', 'summary'] in time 0:00:00.134521, result: Events by type: SUBTREEMAP: 1 Errors: 0 2024-04-24T23:08:55.313 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 reset session 2024-04-24T23:08:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.400+0000 7fd668538280 1 -- start start 2024-04-24T23:08:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.400+0000 7fd668538280 1 Processor -- start 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 0x5648d0bb3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192dc00 0x5648d0bb3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a6000 con 0x5648d192c800 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a6180 con 0x5648d192c400 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5648d18a6300 con 0x5648d192dc00 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56800/0 (socket says 172.21.15.146:56800) 2024-04-24T23:08:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 -- 172.21.15.146:0/2003380624 learned_addr learned my addr 172.21.15.146:0/2003380624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd666600640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 0x5648d0bb3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd667000640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192dc00 0x5648d0bb3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 -- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192dc00 msgr2=0x5648d0bb3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192dc00 0x5648d0bb3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.401+0000 7fd665c00640 1 -- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 msgr2=0x5648d0bb3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd665c00640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 0x5648d0bb3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd665c00640 1 -- 172.21.15.146:0/2003380624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d0b7a780 con 0x5648d192c800 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd666600640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 0x5648d0bb3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd665c00640 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x5648d1973140 tx=0x5648d18da180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1024aa316de62ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd663400640 1 -- 172.21.15.146:0/2003380624 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6cd00 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd663400640 1 -- 172.21.15.146:0/2003380624 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5648d0b72a80 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd663400640 1 -- 172.21.15.146:0/2003380624 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6c680 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d0b7a000 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5648d0b7b860 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd668538280 4 waiting for MDS map... 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.402+0000 7fd663400640 1 -- 172.21.15.146:0/2003380624 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5648d1952600 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.403+0000 7fd663400640 1 -- 172.21.15.146:0/2003380624 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 59) ==== 2901+0+0 (secure 0 0 0) 0x5648d0ba1180 con 0x5648d192c800 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.403+0000 7fd668538280 4 Got MDS map 59 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.403+0000 7fd668538280 10 main: main 2024-04-24T23:08:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.403+0000 7fd668538280 4 main: connecting to RADOS... 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.403+0000 7fd668538280 1 Processor -- start 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 -- start start 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192d800 0x5648d0bb3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d1955400 0x5648d0bb4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a6480 con 0x5648d1955000 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a6600 con 0x5648d1955400 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.404+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5648d18a6780 con 0x5648d192d800 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56808/0 (socket says 172.21.15.146:56808) 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 -- 172.21.15.146:0/1213646464 learned_addr learned my addr 172.21.15.146:0/1213646464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd667000640 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192d800 0x5648d0bb3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd665c00640 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d1955400 0x5648d0bb4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 -- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192d800 msgr2=0x5648d0bb3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192d800 0x5648d0bb3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 -- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d1955400 msgr2=0x5648d0bb4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d1955400 0x5648d0bb4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 -- 172.21.15.146:0/1213646464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d0b7ba40 con 0x5648d1955000 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.405+0000 7fd666600640 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x5648d1a587b0 tx=0x5648d1a1d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9826911fb7f98b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd660c00640 1 -- 172.21.15.146:0/1213646464 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6cd00 con 0x5648d1955000 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd660c00640 1 -- 172.21.15.146:0/1213646464 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5648d0b72e00 con 0x5648d1955000 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd660c00640 1 -- 172.21.15.146:0/1213646464 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6c680 con 0x5648d1955000 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 -- 172.21.15.146:0/1213646464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 msgr2=0x5648d0bb2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x5648d1a587b0 tx=0x5648d1a1d8c0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 -- 172.21.15.146:0/1213646464 shutdown_connections 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d1955400 0x5648d0bb4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955000 0x5648d0bb2580 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 --2- 172.21.15.146:0/1213646464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192d800 0x5648d0bb3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 -- 172.21.15.146:0/1213646464 >> 172.21.15.146:0/1213646464 conn(0x5648d192d400 msgr2=0x5648d0c3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 -- 172.21.15.146:0/1213646464 shutdown_connections 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.406+0000 7fd668538280 1 -- 172.21.15.146:0/1213646464 wait complete. 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.407+0000 7fd668538280 1 Processor -- start 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.407+0000 7fd668538280 1 -- start start 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192d800 0x5648d0bb5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d1955000 0x5648d0bb4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 0x5648d0bb4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a7e00 con 0x5648d1955400 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648d18a7c80 con 0x5648d192d800 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd668538280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5648d18a7b00 con 0x5648d1955000 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd665c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 0x5648d0bb4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd665c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 0x5648d0bb4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56810/0 (socket says 172.21.15.146:56810) 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.408+0000 7fd665c00640 1 -- 172.21.15.146:0/1992759311 learned_addr learned my addr 172.21.15.146:0/1992759311 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd667000640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192d800 0x5648d0bb5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd666600640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d1955000 0x5648d0bb4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 -- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d1955000 msgr2=0x5648d0bb4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d1955000 0x5648d0bb4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 -- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192d800 msgr2=0x5648d0bb5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192d800 0x5648d0bb5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 -- 172.21.15.146:0/1992759311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d0b7a780 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd667000640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192d800 0x5648d0bb5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd665c00640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 0x5648d0bb4680 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x5648d1a58720 tx=0x5648d18d8a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd65ee00640 1 -- 172.21.15.146:0/1992759311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6c820 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd65ee00640 1 -- 172.21.15.146:0/1992759311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5648d0b721c0 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd65ee00640 1 -- 172.21.15.146:0/1992759311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5648d0b6cd00 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.409+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648d0b7a000 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.410+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d0b7bc20 con 0x5648d1955400 2024-04-24T23:08:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.410+0000 7fd668538280 4 main: resolving pool 9 2024-04-24T23:08:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.411+0000 7fd65ee00640 1 -- 172.21.15.146:0/1992759311 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5648d1a74c00 con 0x5648d1955400 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd65ee00640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5648d1a6dc00 0x5648d0bb5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd65ee00640 1 -- 172.21.15.146:0/1992759311 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5648d1a72a00 con 0x5648d1955400 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd668538280 4 main: creating IoCtx.. 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd668538280 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5648d1955800 0x5648d0bb4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.b 9:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5648d1955c00 con 0x5648d1955800 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.412+0000 7fd667000640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5648d1a6dc00 0x5648d0bb5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.414+0000 7fd666600640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5648d1955800 0x5648d0bb4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.414+0000 7fd667000640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5648d1a6dc00 0x5648d0bb5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5648d0bd7a10 tx=0x5648d18d8540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.414+0000 7fd666600640 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5648d1955800 0x5648d0bb4100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.419 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:08:55.419 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:08:55.419 INFO:teuthology.orchestra.run.smithi146.stdout: "data": {}, 2024-04-24T23:08:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:08:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:08:55.420 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:08:55.420 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.416+0000 7fd666600640 1 -- 172.21.15.146:0/1992759311 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v73'6 uv6 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x5648d18c8000 con 0x5648d1955800 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5648d1955800 msgr2=0x5648d0bb4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5648d1955800 0x5648d0bb4100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5648d1a6dc00 msgr2=0x5648d0bb5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5648d1a6dc00 0x5648d0bb5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5648d0bd7a10 tx=0x5648d18d8540 comp rx=0 tx=0).stop 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 msgr2=0x5648d0bb4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/1992759311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d1955400 0x5648d0bb4680 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x5648d1a58720 tx=0x5648d18d8a20 comp rx=0 tx=0).stop 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd666600640 1 -- 172.21.15.146:0/1992759311 reap_dead start 2024-04-24T23:08:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 shutdown_connections 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 >> 172.21.15.146:0/1992759311 conn(0x5648d192d400 msgr2=0x5648d0c3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 shutdown_connections 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/1992759311 wait complete. 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 msgr2=0x5648d0bb2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x5648d1973140 tx=0x5648d18da180 comp rx=0 tx=0).stop 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 shutdown_connections 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5648d192dc00 0x5648d0bb3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d192c800 0x5648d0bb2b00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 --2- 172.21.15.146:0/2003380624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648d192c400 0x5648d0bb3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.417+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 >> 172.21.15.146:0/2003380624 conn(0x5648d0b47000 msgr2=0x5648d0c3a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.418+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 shutdown_connections 2024-04-24T23:08:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.418+0000 7fd668538280 1 -- 172.21.15.146:0/2003380624 wait complete. 2024-04-24T23:08:55.425 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'reset', 'session'] in time 0:00:00.111689, result: { "0": { "data": {}, "result": 0 } } 2024-04-24T23:08:55.425 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-24T23:08:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.507+0000 7f25d9e32280 1 -- start start 2024-04-24T23:08:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.507+0000 7f25d9e32280 1 Processor -- start 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cfde2000 0x5600cf0bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cf053c00 0x5600cf0beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5600cff10000 con 0x5600cfde2800 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600cff10180 con 0x5600cfde2000 2024-04-24T23:08:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5600cff10300 con 0x5600cf053c00 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56822/0 (socket says 172.21.15.146:56822) 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 -- 172.21.15.146:0/1782498837 learned_addr learned my addr 172.21.15.146:0/1782498837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 -- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cf053c00 msgr2=0x5600cf0beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cf053c00 0x5600cf0beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 -- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cfde2000 msgr2=0x5600cf0bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cfde2000 0x5600cf0bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 -- 172.21.15.146:0/1782498837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cf086780 con 0x5600cfde2800 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d8800640 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x5600cfe734a0 tx=0x5600cfde5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4adfc87c288646e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d4c00640 1 -- 172.21.15.146:0/1782498837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078d00 con 0x5600cfde2800 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d4c00640 1 -- 172.21.15.146:0/1782498837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5600cf07e700 con 0x5600cfde2800 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d4c00640 1 -- 172.21.15.146:0/1782498837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078680 con 0x5600cfde2800 2024-04-24T23:08:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cf087860 con 0x5600cfde2800 2024-04-24T23:08:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5600cf087680 con 0x5600cfde2800 2024-04-24T23:08:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d9e32280 4 waiting for MDS map... 2024-04-24T23:08:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.509+0000 7f25d4c00640 1 -- 172.21.15.146:0/1782498837 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5600cff22600 con 0x5600cfde2800 2024-04-24T23:08:55.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.510+0000 7f25d4c00640 1 -- 172.21.15.146:0/1782498837 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 59) ==== 2901+0+0 (secure 0 0 0) 0x5600cf0ad180 con 0x5600cfde2800 2024-04-24T23:08:55.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.510+0000 7f25d9e32280 4 Got MDS map 59 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.510+0000 7f25d9e32280 10 main: JournalTool::main 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.510+0000 7f25d9e32280 4 main: JournalTool: connecting to RADOS... 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.510+0000 7f25d9e32280 1 Processor -- start 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 -- start start 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff24c00 0x5600cf0bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5600cff10480 con 0x5600cff25000 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600cff10600 con 0x5600cff24c00 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.511+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5600cff10780 con 0x5600cff25400 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56824/0 (socket says 172.21.15.146:56824) 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 -- 172.21.15.146:0/1143419883 learned_addr learned my addr 172.21.15.146:0/1143419883 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 -- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 msgr2=0x5600cf0c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7400640 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7400640 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff24c00 0x5600cf0bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 -- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff24c00 msgr2=0x5600cf0bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff24c00 0x5600cf0bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 -- 172.21.15.146:0/1143419883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cf0863c0 con 0x5600cff25000 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d7e00640 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x5600cfe72d80 tx=0x5600cff30d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282981b659604d1a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.512+0000 7f25d2400640 1 -- 172.21.15.146:0/1143419883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078b60 con 0x5600cff25000 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d2400640 1 -- 172.21.15.146:0/1143419883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5600cf07ee00 con 0x5600cff25000 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d2400640 1 -- 172.21.15.146:0/1143419883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078d00 con 0x5600cff25000 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 -- 172.21.15.146:0/1143419883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 msgr2=0x5600cf0be580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x5600cfe72d80 tx=0x5600cff30d20 comp rx=0 tx=0).stop 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 -- 172.21.15.146:0/1143419883 shutdown_connections 2024-04-24T23:08:55.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25000 0x5600cf0be580 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1143419883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff24c00 0x5600cf0bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 -- 172.21.15.146:0/1143419883 >> 172.21.15.146:0/1143419883 conn(0x5600cfde2400 msgr2=0x5600cf145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 -- 172.21.15.146:0/1143419883 shutdown_connections 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.513+0000 7f25d9e32280 1 -- 172.21.15.146:0/1143419883 wait complete. 2024-04-24T23:08:55.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.514+0000 7f25d9e32280 1 Processor -- start 2024-04-24T23:08:55.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.514+0000 7f25d9e32280 1 -- start start 2024-04-24T23:08:55.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff25000 0x5600cf0c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5600cff11c80 con 0x5600cff24c00 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600cff11b00 con 0x5600cff25000 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5600cff11980 con 0x5600cff25400 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56830/0 (socket says 172.21.15.146:56830) 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 -- 172.21.15.146:0/4166941587 learned_addr learned my addr 172.21.15.146:0/4166941587 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7e00640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff25000 0x5600cf0c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 -- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 msgr2=0x5600cf0c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 -- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff25000 msgr2=0x5600cf0c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff25000 0x5600cf0c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.515+0000 7f25d7400640 1 -- 172.21.15.146:0/4166941587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cf086780 con 0x5600cff24c00 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d7400640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x5600cff2d590 tx=0x5600cff31bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d0600640 1 -- 172.21.15.146:0/4166941587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078b60 con 0x5600cff24c00 2024-04-24T23:08:55.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d0600640 1 -- 172.21.15.146:0/4166941587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5600cf07e1c0 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d0600640 1 -- 172.21.15.146:0/4166941587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078d00 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600cf087860 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cf087680 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.516+0000 7f25d9e32280 4 main: JournalTool: resolving pool 9 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.518+0000 7f25d0600640 1 -- 172.21.15.146:0/4166941587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5600cfe4ec00 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.518+0000 7f25d0600640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 0x5600cf0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.518+0000 7f25d0600640 1 -- 172.21.15.146:0/4166941587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5600cfe4ca00 con 0x5600cff24c00 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.518+0000 7f25d9e32280 4 main: JournalTool: creating IoCtx.. 2024-04-24T23:08:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.518+0000 7f25d9e32280 4 main: Executing for rank 0 2024-04-24T23:08:55.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.519+0000 7f25d7e00640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 0x5600cf0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.519+0000 7f25d9e32280 1 -- start start 2024-04-24T23:08:55.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.519+0000 7f25d9e32280 1 Processor -- start 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d7e00640 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 0x5600cf0c1700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5600cfe72d80 tx=0x5600cff30c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 0x5600cf0c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff87000 0x5600cf0be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff87400 0x5600cf0bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5600cff11680 con 0x5600cff25c00 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600cff11500 con 0x5600cff87400 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d9e32280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5600cff10480 con 0x5600cff87000 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.520+0000 7f25d8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 0x5600cf0c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 0x5600cf0c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56832/0 (socket says 172.21.15.146:56832) 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 -- 172.21.15.146:0/742501532 learned_addr learned my addr 172.21.15.146:0/742501532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d7e00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff87000 0x5600cf0be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d7400640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff87400 0x5600cf0bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff87000 msgr2=0x5600cf0be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff87000 0x5600cf0be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff87400 msgr2=0x5600cf0bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff87400 0x5600cf0bf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cf086000 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d7400640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff87400 0x5600cf0bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25d8800640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 0x5600cf0c0100 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x5600cf36b7d0 tx=0x5600cfdd75c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be1f72650cbdb89 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.521+0000 7f25cca00640 1 -- 172.21.15.146:0/742501532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cf078820 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25cca00640 1 -- 172.21.15.146:0/742501532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5600cf07e540 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25cca00640 1 -- 172.21.15.146:0/742501532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5600cffbfba0 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cf0874a0 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5600cf086960 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 4 waiting for MDS map... 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25cca00640 1 -- 172.21.15.146:0/742501532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x5600cf424200 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25cca00640 1 -- 172.21.15.146:0/742501532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 59) ==== 2901+0+0 (secure 0 0 0) 0x5600cf0ad500 con 0x5600cff25c00 2024-04-24T23:08:55.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 4 Got MDS map 59 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5600cff87800 0x5600cf442000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5600cff87c00 con 0x5600cff87800 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.522+0000 7f25d7e00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5600cff87800 0x5600cf442000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.523+0000 7f25d7e00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5600cff87800 0x5600cf442000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=a67faaf6756646bb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.523+0000 7f25d7e00640 1 -- 172.21.15.146:0/742501532 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5600cfdd4000 con 0x5600cff87800 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.523+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5600cf43c400 0x5600cf442580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.523+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43c800 con 0x5600cf43c400 2024-04-24T23:08:55.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.524+0000 7f25d7400640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5600cf43c400 0x5600cf442580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.525+0000 7f25d7400640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5600cf43c400 0x5600cf442580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=220ed1cc6da4af33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.526+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv25 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.526+0000 7f25cac00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5600cf456000 0x5600cf444680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.526+0000 7f25cac00640 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:3 9.1b 9:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e73) -- 0x5600cf456400 con 0x5600cf456000 2024-04-24T23:08:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.526+0000 7f25cac00640 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:4 9.b 9:d5c7a900:::200.00000003:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e73) -- 0x5600cf456800 con 0x5600cf43c400 2024-04-24T23:08:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.526+0000 7f25d8800640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5600cf456000 0x5600cf444680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.528+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(4 200.00000003 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.528+0000 7f25d8800640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5600cf456000 0x5600cf444680 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=3cc0c449b42b5d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.528+0000 7f25d8800640 1 -- 172.21.15.146:0/742501532 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv20 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5600cfdd4780 con 0x5600cf456000 2024-04-24T23:08:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:old journal was 8393785~9012 2024-04-24T23:08:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:new journal start will be 12582912 (4180115 bytes past old end) 2024-04-24T23:08:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:writing journal head 2024-04-24T23:08:55.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.528+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:5 9.14 9:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43cc00 con 0x5600cf43c400 2024-04-24T23:08:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:writing EResetJournal entry 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v73'30 uv30 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.b 9:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43d000 con 0x5600cf43c400 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5600cf43d400 0x5600cf442b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:7 9.1f 9:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43d800 con 0x5600cf43d400 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1a 9:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43dc00 con 0x5600cf43c400 2024-04-24T23:08:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.1e 9:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf456800 con 0x5600cf43d400 2024-04-24T23:08:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:10 9.1d 9:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf456c00 con 0x5600cf43d400 2024-04-24T23:08:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:11 9.1d 9:bf8dcf43:::200.00000008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf457000 con 0x5600cf43d400 2024-04-24T23:08:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.533+0000 7f25d7e00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5600cf43d400 0x5600cf442b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.535+0000 7f25d7e00640 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5600cf43d400 0x5600cf442b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=4ff867ed3afdaa22 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.536+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(6 200.00000003 [delete] v73'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.539+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(8 200.00000005 [delete] v73'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.540+0000 7f25d7e00640 1 -- 172.21.15.146:0/742501532 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 200.00000006 [delete] v73'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4000 con 0x5600cf43d400 2024-04-24T23:08:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.540+0000 7f25d7e00640 1 -- 172.21.15.146:0/742501532 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(7 200.00000004 [delete] v73'14 uv13 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4000 con 0x5600cf43d400 2024-04-24T23:08:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.540+0000 7f25cac00640 1 -- 172.21.15.146:0/742501532 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.b 9:d5c7a900:::200.00000003:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x5600cf43d800 con 0x5600cf43c400 2024-04-24T23:08:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.542+0000 7f25d7e00640 1 -- 172.21.15.146:0/742501532 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(10 200.00000007 [delete] v73'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4000 con 0x5600cf43d400 2024-04-24T23:08:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.544+0000 7f25d7e00640 1 -- 172.21.15.146:0/742501532 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(11 200.00000008 [delete] v73'5 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4000 con 0x5600cf43d400 2024-04-24T23:08:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.544+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(12 200.00000003 [write 0~48] v73'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5600cfdd4500 con 0x5600cf43c400 2024-04-24T23:08:55.547 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5600cff87800 msgr2=0x5600cf442000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x5600cff87800 0x5600cf442000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5600cf456000 msgr2=0x5600cf444680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x5600cf456000 0x5600cf444680 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5600cf43c400 msgr2=0x5600cf442580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5600cf43c400 0x5600cf442580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5600cf43d400 msgr2=0x5600cf442b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5600cf43d400 0x5600cf442b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 reap_dead start 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 msgr2=0x5600cf0c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 --2- 172.21.15.146:0/742501532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff25c00 0x5600cf0c0100 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x5600cf36b7d0 tx=0x5600cfdd75c0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d7400640 1 -- 172.21.15.146:0/742501532 reap_dead start 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 shutdown_connections 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 >> 172.21.15.146:0/742501532 conn(0x5600cff25800 msgr2=0x5600cf144800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 shutdown_connections 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.545+0000 7f25d9e32280 1 -- 172.21.15.146:0/742501532 wait complete. 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 msgr2=0x5600cf0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 0x5600cf0c1700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5600cfe72d80 tx=0x5600cff30c00 comp rx=0 tx=0).stop 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 msgr2=0x5600cf0c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x5600cff2d590 tx=0x5600cff31bc0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 shutdown_connections 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5600cff86c00 0x5600cf0c1700 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cff25400 0x5600cf0c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cff25000 0x5600cf0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/4166941587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cff24c00 0x5600cf0c1180 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 >> 172.21.15.146:0/4166941587 conn(0x5600cfde2400 msgr2=0x5600cf145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 shutdown_connections 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/4166941587 wait complete. 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 msgr2=0x5600cf0bfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.546+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x5600cfe734a0 tx=0x5600cfde5e00 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 shutdown_connections 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5600cfde2800 0x5600cf0bfb80 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5600cf053c00 0x5600cf0beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 --2- 172.21.15.146:0/1782498837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5600cfde2000 0x5600cf0bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 >> 172.21.15.146:0/1782498837 conn(0x5600cf053000 msgr2=0x5600cf146000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 shutdown_connections 2024-04-24T23:08:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.547+0000 7f25d9e32280 1 -- 172.21.15.146:0/1782498837 wait complete. 2024-04-24T23:08:55.554 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.128704, result: old journal was 8393785~9012 new journal start will be 12582912 (4180115 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-24T23:08:55.554 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-04-24T23:08:55.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.644+0000 7f2a07b97f40 1 Processor -- start 2024-04-24T23:08:55.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.644+0000 7f2a07b97f40 1 -- start start 2024-04-24T23:08:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f29e8003ab0 0x55ba78a9e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba789d34e0 0x55ba789d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ba7897c640 con 0x55ba78aa57b0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba78980680 con 0x55ba789d34e0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55ba78a06620 con 0x7f29e8003ab0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a05800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a05800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56842/0 (socket says 172.21.15.146:56842) 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a05800640 1 -- 172.21.15.146:0/2927494851 learned_addr learned my addr 172.21.15.146:0/2927494851 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a04e00640 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f29e8003ab0 0x55ba78a9e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.646+0000 7f2a04400640 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba789d34e0 0x55ba789d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 -- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f29e8003ab0 msgr2=0x55ba78a9e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f29e8003ab0 0x55ba78a9e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 -- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba789d34e0 msgr2=0x55ba789d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba789d34e0 0x55ba789d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 -- 172.21.15.146:0/2927494851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba78a048f0 con 0x55ba78aa57b0 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a05800640 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0258a0 tx=0x7f29fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae548d8fa917a56 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a03000640 1 -- 172.21.15.146:0/2927494851 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc000ed0 con 0x55ba78aa57b0 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a03000640 1 -- 172.21.15.146:0/2927494851 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc055440 con 0x55ba78aa57b0 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.647+0000 7f2a03000640 1 -- 172.21.15.146:0/2927494851 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc055a50 con 0x55ba78aa57b0 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- 172.21.15.146:0/2927494851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 msgr2=0x55ba789d40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0258a0 tx=0x7f29fc051000 comp rx=0 tx=0).stop 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- 172.21.15.146:0/2927494851 shutdown_connections 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ba78aa57b0 0x55ba789d40a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba789d34e0 0x55ba789d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/2927494851 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f29e8003ab0 0x55ba78a9e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- 172.21.15.146:0/2927494851 >> 172.21.15.146:0/2927494851 conn(0x55ba789da9f0 msgr2=0x55ba78aa6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- 172.21.15.146:0/2927494851 shutdown_connections 2024-04-24T23:08:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- 172.21.15.146:0/2927494851 wait complete. 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 Processor -- start 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.648+0000 7f2a07b97f40 1 -- start start 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55ba78aa57b0 0x55ba78a923b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 0x55ba78a9d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba78a92b80 0x55ba78a959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ba78a04b90 con 0x7f29e8003ab0 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba789d5140 con 0x55ba78a92b80 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a07b97f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55ba789d3020 con 0x55ba78aa57b0 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a04400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 0x55ba78a9d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a04400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 0x55ba78a9d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56850/0 (socket says 172.21.15.146:56850) 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 learned_addr learned my addr 172.21.15.146:0/1675200365 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55ba78aa57b0 0x55ba78a923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.649+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba78a92b80 0x55ba78a959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55ba78aa57b0 msgr2=0x55ba78a923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55ba78aa57b0 0x55ba78a923b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba78a92b80 msgr2=0x55ba78a959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba78a92b80 0x55ba78a959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba78a9de70 con 0x7f29e8003ab0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 0x55ba78a9d390 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009f10 tx=0x7f29f0005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a01c00640 1 -- 172.21.15.146:0/1675200365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0019070 con 0x7f29e8003ab0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a01c00640 1 -- 172.21.15.146:0/1675200365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f0014400 con 0x7f29e8003ab0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a01c00640 1 -- 172.21.15.146:0/1675200365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00147b0 con 0x7f29e8003ab0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba78a93220 con 0x7f29e8003ab0 2024-04-24T23:08:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.650+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba78a937e0 con 0x7f29e8003ab0 2024-04-24T23:08:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.653+0000 7f2a01c00640 1 -- 172.21.15.146:0/1675200365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f001c070 con 0x7f29e8003ab0 2024-04-24T23:08:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.653+0000 7f2a01c00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29e406a810 0x7f29e406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.654+0000 7f2a01c00640 1 -- 172.21.15.146:0/1675200365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f29f00893e0 con 0x7f29e8003ab0 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.654+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55ba78a96070 0x55ba78a94210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.654+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.654+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29e406a810 0x7f29e406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.656+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55ba78a96070 0x55ba78a94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.656+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29e406a810 0x7f29e406ccd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x55ba78aaf100 tx=0x7f29f40012b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.656+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55ba78a96070 0x55ba78a94210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.658+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc055830 con 0x55ba78a96070 2024-04-24T23:08:55.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.658+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55ba78a06950 0x7f29fc063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.658+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:2 9.10 9:08000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a06950 2024-04-24T23:08:55.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.658+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55ba78a06950 0x7f29fc063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.659+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55ba78a06950 0x7f29fc063940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.659+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(2 [pgnls start_epoch 73 out=201b] v73'14 uv14 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f29f4015970 con 0x55ba78a06950 2024-04-24T23:08:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.659+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 9.8 9:10000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.660+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29fc055830 con 0x55ba78a96070 2024-04-24T23:08:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.660+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55ba78a21fd0 0x7f29fc0628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.660+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 9.18 9:18000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55ba78a21fd0 0x7f29fc0628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55ba78a21fd0 0x7f29fc0628f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f29f001e060 0x7f29f0056290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:5 9.4 9:20000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29f001e060 2024-04-24T23:08:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.661+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f29f001e060 0x7f29f0056290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.662+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f29f001e060 0x7f29f0056290 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.663+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(5 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc055830 con 0x7f29f001e060 2024-04-24T23:08:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.663+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.14 9:28000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.664+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(6 [pgnls start_epoch 73 out=149b] v73'30 uv30 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f29fc055830 con 0x55ba78a96070 2024-04-24T23:08:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.664+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29f001e060 2024-04-24T23:08:55.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.665+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc07a040 con 0x7f29f001e060 2024-04-24T23:08:55.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.665+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1c 9:38000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.667+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(8 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78a96070 2024-04-24T23:08:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.667+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f29fc07d060 0x7f29fc0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.667+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.2 9:40000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29fc07d060 2024-04-24T23:08:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.667+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f29fc07d060 0x7f29fc0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.668+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f29fc07d060 0x7f29fc0713b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f4015970 con 0x7f29fc07d060 2024-04-24T23:08:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:10 9.12 9:48000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a06950 2024-04-24T23:08:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(10 [pgnls start_epoch 73 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f4015970 con 0x55ba78a06950 2024-04-24T23:08:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:11 9.a 9:50000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a06950 2024-04-24T23:08:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(11 [pgnls start_epoch 73 out=49b] v71'8 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f4015970 con 0x55ba78a06950 2024-04-24T23:08:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.670+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.1a 9:58000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.672+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(12 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78a96070 2024-04-24T23:08:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.672+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 9.6 9:60000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.672+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(13 [pgnls start_epoch 73 out=77b] v71'11 uv11 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.672+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f29f0057630 0x7f29f0087970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.672+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 9.16 9:68000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29f0057630 2024-04-24T23:08:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f29f0057630 0x7f29f0087970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f29f0057630 0x7f29f0087970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(14 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f001b030 con 0x7f29f0057630 2024-04-24T23:08:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:15 9.e 9:70000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(15 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.673+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1e 9:78000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29fc07d060 2024-04-24T23:08:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(16 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f4015970 con 0x7f29fc07d060 2024-04-24T23:08:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 9.1 9:80000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29f001e060 2024-04-24T23:08:55.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(17 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc07a040 con 0x7f29f001e060 2024-04-24T23:08:55.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55ba78aa6d50 0x7f29fc07f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:18 9.11 9:88000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78aa6d50 2024-04-24T23:08:55.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.675+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55ba78aa6d50 0x7f29fc07f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.677+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55ba78aa6d50 0x7f29fc07f450 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.678+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(18 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78aa6d50 2024-04-24T23:08:55.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.678+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 9.9 9:90000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.678+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 [pgnls start_epoch 73 out=97b] v68'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78a96070 2024-04-24T23:08:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.678+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:20 9.19 9:98000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29fc07d060 2024-04-24T23:08:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.679+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(20 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f4015970 con 0x7f29fc07d060 2024-04-24T23:08:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.679+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.680+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(21 [pgnls start_epoch 73 out=73b] v68'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78a96070 2024-04-24T23:08:55.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.680+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 9.15 9:a8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78aa6d50 2024-04-24T23:08:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.680+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 [pgnls start_epoch 73 out=127b] v68'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78aa6d50 2024-04-24T23:08:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.680+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 9.d 9:b0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78aa6d50 2024-04-24T23:08:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.680+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 [pgnls start_epoch 73 out=74b] v67'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78aa6d50 2024-04-24T23:08:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.682+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1d 9:b8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29fc07d060 2024-04-24T23:08:55.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.682+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(24 [pgnls start_epoch 73 out=73b] v73'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f4015970 con 0x7f29fc07d060 2024-04-24T23:08:55.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.682+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:25 9.3 9:c0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29f0057630 2024-04-24T23:08:55.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.682+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(25 [pgnls start_epoch 73 out=73b] v71'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f001b030 con 0x7f29f0057630 2024-04-24T23:08:55.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.682+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 9.13 9:c8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.683+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(26 [pgnls start_epoch 73 out=122b] v70'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.683+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.b 9:d0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a96070 2024-04-24T23:08:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.684+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 [pgnls start_epoch 73 out=124b] v73'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f29fc07a040 con 0x55ba78a96070 2024-04-24T23:08:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.684+0000 7f2a05800640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f29e80022a0 0x7f29fc0543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.684+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:28 9.1b 9:d8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29e80022a0 2024-04-24T23:08:55.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.685+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f29e80022a0 0x7f29fc0543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.687+0000 7f2a04e00640 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f29e80022a0 0x7f29fc0543e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.688+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(28 [pgnls start_epoch 73 out=97b] v71'20 uv20 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f29f4015970 con 0x7f29e80022a0 2024-04-24T23:08:55.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.688+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 9.7 9:e0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(29 [pgnls start_epoch 73 out=129b] v70'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:30 9.17 9:e8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(30 [pgnls start_epoch 73 out=97b] v70'7 uv7 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:31 9.f 9:f0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x55ba78a21fd0 2024-04-24T23:08:55.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(31 [pgnls start_epoch 73 out=73b] v67'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f29f001b030 con 0x55ba78a21fd0 2024-04-24T23:08:55.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.689+0000 7f2a04400640 1 -- 172.21.15.146:0/1675200365 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:32 9.1f 9:f8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55ba78a94750 con 0x7f29fc07d060 2024-04-24T23:08:55.692 INFO:teuthology.orchestra.run.smithi146.stdout:601.00000000 2024-04-24T23:08:55.692 INFO:teuthology.orchestra.run.smithi146.stdout:602.00000000 2024-04-24T23:08:55.692 INFO:teuthology.orchestra.run.smithi146.stdout:10000000000.00000000 2024-04-24T23:08:55.692 INFO:teuthology.orchestra.run.smithi146.stdout:600.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:603.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:60a.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:613.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000.inode 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:610.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:606.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:607.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stdout:60e.00000000 2024-04-24T23:08:55.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a04e00640 1 -- 172.21.15.146:0/1675200365 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(32 [pgnls start_epoch 73 out=101b] v73'14 uv13 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f29f4015970 con 0x7f29fc07d060 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_openfiles.0 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:60f.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:608.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:501.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:612.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:401.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:604.00000000 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000.inode 2024-04-24T23:08:55.694 INFO:teuthology.orchestra.run.smithi146.stdout:500.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:mds_snaptable 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:605.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_inotable 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:611.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_sessionmap 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000003 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:60c.00000000 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:201.00000001 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000002 2024-04-24T23:08:55.695 INFO:teuthology.orchestra.run.smithi146.stdout:609.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:10000000001.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:60b.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:60d.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:201.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:400.00000000 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000.inode 2024-04-24T23:08:55.696 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f29f0057630 msgr2=0x7f29f0087970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f29f0057630 0x7f29f0087970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55ba78a06950 msgr2=0x7f29fc063940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55ba78a06950 0x7f29fc063940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55ba78a21fd0 msgr2=0x7f29fc0628f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x55ba78a21fd0 0x7f29fc0628f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55ba78aa6d50 msgr2=0x7f29fc07f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x55ba78aa6d50 0x7f29fc07f450 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f29e80022a0 msgr2=0x7f29fc0543e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f29e80022a0 0x7f29fc0543e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55ba78a96070 msgr2=0x55ba78a94210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55ba78a96070 0x55ba78a94210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f29fc07d060 msgr2=0x7f29fc0713b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f29fc07d060 0x7f29fc0713b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f29f001e060 msgr2=0x7f29f0056290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f29f001e060 0x7f29f0056290 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29e406a810 msgr2=0x7f29e406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f29e406a810 0x7f29e406ccd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x55ba78aaf100 tx=0x7f29f40012b0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 msgr2=0x55ba78a9d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 --2- 172.21.15.146:0/1675200365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8003ab0 0x55ba78a9d390 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009f10 tx=0x7f29f0005f60 comp rx=0 tx=0).stop 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a05800640 1 -- 172.21.15.146:0/1675200365 reap_dead start 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 shutdown_connections 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 >> 172.21.15.146:0/1675200365 conn(0x55ba789da9f0 msgr2=0x55ba78a218a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 shutdown_connections 2024-04-24T23:08:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.691+0000 7f2a07b97f40 1 -- 172.21.15.146:0/1675200365 wait complete. 2024-04-24T23:08:55.700 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000001 2024-04-24T23:08:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.806+0000 7fc75bd1df40 1 Processor -- start 2024-04-24T23:08:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.806+0000 7fc75bd1df40 1 -- start start 2024-04-24T23:08:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 0x55db21cc8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55db21c3e970 con 0x55db21cc8860 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55db21c58230 con 0x55db21c56d40 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.807+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55db21c57310 con 0x55db21c3e560 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56862/0 (socket says 172.21.15.146:56862) 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 -- 172.21.15.146:0/3130911525 learned_addr learned my addr 172.21.15.146:0/3130911525 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759000640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc753e00640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 0x55db21cc8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 -- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 msgr2=0x55db21cc77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 -- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 msgr2=0x55db21cc8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 0x55db21cc8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 -- 172.21.15.146:0/3130911525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db21b4d070 con 0x55db21cc8860 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc753e00640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 0x55db21cc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759000640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.808+0000 7fc759a00640 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc754025ab0 tx=0x7fc754050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a546d181056bed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc752a00640 1 -- 172.21.15.146:0/3130911525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754051c30 con 0x55db21cc8860 2024-04-24T23:08:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc752a00640 1 -- 172.21.15.146:0/3130911525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754051df0 con 0x55db21cc8860 2024-04-24T23:08:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc752a00640 1 -- 172.21.15.146:0/3130911525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75405a690 con 0x55db21cc8860 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 -- 172.21.15.146:0/3130911525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 msgr2=0x55db21c38860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc754025ab0 tx=0x7fc754050000 comp rx=0 tx=0).stop 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 -- 172.21.15.146:0/3130911525 shutdown_connections 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21cc8860 0x55db21c38860 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21c56d40 0x55db21cc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/3130911525 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 -- 172.21.15.146:0/3130911525 >> 172.21.15.146:0/3130911525 conn(0x55db21c58c30 msgr2=0x55db21c3d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 -- 172.21.15.146:0/3130911525 shutdown_connections 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.809+0000 7fc75bd1df40 1 -- 172.21.15.146:0/3130911525 wait complete. 2024-04-24T23:08:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.810+0000 7fc75bd1df40 1 Processor -- start 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.810+0000 7fc75bd1df40 1 -- start start 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 0x55db21c55d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21cc8860 0x55db21cde880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55db21cdd230 con 0x55db21c56d40 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55db21ce2830 con 0x55db21cc8860 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.811+0000 7fc75bd1df40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55db21cc9460 con 0x55db21c3e560 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 0x55db21c55d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 0x55db21c55d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56870/0 (socket says 172.21.15.146:56870) 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 -- 172.21.15.146:0/2888262144 learned_addr learned my addr 172.21.15.146:0/2888262144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc759a00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21cc8860 0x55db21cde880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 -- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 msgr2=0x55db21cc6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55db21c3e560 0x55db21cc6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 -- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21cc8860 msgr2=0x55db21cde880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21cc8860 0x55db21cde880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 -- 172.21.15.146:0/2888262144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db21b37b30 con 0x55db21c56d40 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc759a00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db21cc8860 0x55db21cde880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.812+0000 7fc753e00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 0x55db21c55d80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc74400bf70 tx=0x7fc7440074b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.813+0000 7fc751600640 1 -- 172.21.15.146:0/2888262144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744019070 con 0x55db21c56d40 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.813+0000 7fc751600640 1 -- 172.21.15.146:0/2888262144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc744007c80 con 0x55db21c56d40 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.813+0000 7fc751600640 1 -- 172.21.15.146:0/2888262144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744014650 con 0x55db21c56d40 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.813+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db21cc96b0 con 0x55db21c56d40 2024-04-24T23:08:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.813+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db21ce60a0 con 0x55db21c56d40 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.815+0000 7fc751600640 1 -- 172.21.15.146:0/2888262144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc74401c070 con 0x55db21c56d40 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.816+0000 7fc751600640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc73806a810 0x7fc73806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.816+0000 7fc751600640 1 -- 172.21.15.146:0/2888262144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fc7440890a0 con 0x55db21c56d40 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.816+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55db21cc8c40 0x55db21ce6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.816+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:1 9.1b 9:db457a8a:::201.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e73) -- 0x55db21c562c0 con 0x55db21cc8c40 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.816+0000 7fc759000640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc73806a810 0x7fc73806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.817+0000 7fc759a00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55db21cc8c40 0x55db21ce6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.818+0000 7fc759000640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc73806a810 0x7fc73806ccd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005630 tx=0x7fc74c0054e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.818+0000 7fc759a00640 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55db21cc8c40 0x55db21ce6ad0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc759a00640 1 -- 172.21.15.146:0/2888262144 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(1 201.00000001 [delete] v73'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fc754051b50 con 0x55db21cc8c40 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55db21cc8c40 msgr2=0x55db21ce6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x55db21cc8c40 0x55db21ce6ad0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc73806a810 msgr2=0x7fc73806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc73806a810 0x7fc73806ccd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005630 tx=0x7fc74c0054e0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 msgr2=0x55db21c55d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 --2- 172.21.15.146:0/2888262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55db21c56d40 0x55db21c55d80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc74400bf70 tx=0x7fc7440074b0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc759a00640 1 -- 172.21.15.146:0/2888262144 reap_dead start 2024-04-24T23:08:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 shutdown_connections 2024-04-24T23:08:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.822+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 >> 172.21.15.146:0/2888262144 conn(0x55db21c58c30 msgr2=0x55db21c3c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.823+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 shutdown_connections 2024-04-24T23:08:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.823+0000 7fc75bd1df40 1 -- 172.21.15.146:0/2888262144 wait complete. 2024-04-24T23:08:55.828 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000000 2024-04-24T23:08:55.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.922+0000 7f3cd160bf40 1 Processor -- start 2024-04-24T23:08:55.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.922+0000 7f3cd160bf40 1 -- start start 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cb40030f0 0x55932752d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x5593274a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559327418640 con 0x5593274a3020 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55932741c680 con 0x7f3cb40030f0 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.923+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5593274be230 con 0x55932754cc30 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56890/0 (socket says 172.21.15.146:56890) 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 -- 172.21.15.146:0/3691966717 learned_addr learned my addr 172.21.15.146:0/3691966717 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccdc00640 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cb40030f0 0x55932752d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 -- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 msgr2=0x5593274a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x5593274a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 -- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cb40030f0 msgr2=0x55932752d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cb40030f0 0x55932752d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 -- 172.21.15.146:0/3691966717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55932752dc20 con 0x5593274a3020 2024-04-24T23:08:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.924+0000 7f3ccd200640 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8057040 tx=0x7f3cb804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d89299b7d93b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cc7400640 1 -- 172.21.15.146:0/3691966717 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8001630 con 0x5593274a3020 2024-04-24T23:08:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cc7400640 1 -- 172.21.15.146:0/3691966717 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8066070 con 0x5593274a3020 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cc7400640 1 -- 172.21.15.146:0/3691966717 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8061650 con 0x5593274a3020 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 -- 172.21.15.146:0/3691966717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 msgr2=0x55932754c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8057040 tx=0x7f3cb804f000 comp rx=0 tx=0).stop 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 -- 172.21.15.146:0/3691966717 shutdown_connections 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x5593274a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593274a3020 0x55932754c6f0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/3691966717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cb40030f0 0x55932752d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 -- 172.21.15.146:0/3691966717 >> 172.21.15.146:0/3691966717 conn(0x5593274bec30 msgr2=0x5593274a3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.925+0000 7f3cd160bf40 1 -- 172.21.15.146:0/3691966717 shutdown_connections 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.926+0000 7f3cd160bf40 1 -- 172.21.15.146:0/3691966717 wait complete. 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.926+0000 7f3cd160bf40 1 Processor -- start 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.926+0000 7f3cd160bf40 1 -- start start 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593274a3020 0x559327547560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x55932752c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 0x55932752c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5593274a0130 con 0x7f3cb40030f0 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593274a03d0 con 0x5593274a3020 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.927+0000 7f3cd160bf40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559327543510 con 0x55932754cc30 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 0x55932752c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 0x55932752c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56898/0 (socket says 172.21.15.146:56898) 2024-04-24T23:08:55.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 -- 172.21.15.146:0/999241526 learned_addr learned my addr 172.21.15.146:0/999241526 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3ccdc00640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593274a3020 0x559327547560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 -- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 msgr2=0x55932752c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3ccd200640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x55932752c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55932754cc30 0x55932752c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 -- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593274a3020 msgr2=0x559327547560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593274a3020 0x559327547560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 -- 172.21.15.146:0/999241526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559327543230 con 0x7f3cb40030f0 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3ccdc00640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593274a3020 0x559327547560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.928+0000 7f3cce600640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 0x55932752c740 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x5593274789e0 tx=0x7f3cc800b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.929+0000 7f3cc6000640 1 -- 172.21.15.146:0/999241526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8016070 con 0x7f3cb40030f0 2024-04-24T23:08:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.929+0000 7f3cc6000640 1 -- 172.21.15.146:0/999241526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc800bd90 con 0x7f3cb40030f0 2024-04-24T23:08:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.929+0000 7f3cc6000640 1 -- 172.21.15.146:0/999241526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8004670 con 0x7f3cb40030f0 2024-04-24T23:08:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.929+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5593274a1af0 con 0x7f3cb40030f0 2024-04-24T23:08:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.929+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593274a22f0 con 0x7f3cb40030f0 2024-04-24T23:08:55.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.931+0000 7f3cc6000640 1 -- 172.21.15.146:0/999241526 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cc8019070 con 0x7f3cb40030f0 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3cc6000640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cac06a840 0x7f3cac06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3cc6000640 1 -- 172.21.15.146:0/999241526 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f3cc8088e00 con 0x7f3cb40030f0 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559327547aa0 0x559327542590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:1 9.17 9:ea85266a:::201.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e73) -- 0x55932753fa10 con 0x559327547aa0 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3ccdc00640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cac06a840 0x7f3cac06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.932+0000 7f3ccd200640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559327547aa0 0x559327542590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.933+0000 7f3ccd200640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559327547aa0 0x559327542590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.934+0000 7f3ccdc00640 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cac06a840 0x7f3cac06cd00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005fd0 tx=0x7f3cc000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.935+0000 7f3ccd200640 1 -- 172.21.15.146:0/999241526 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(1 201.00000000 [delete] v73'8 uv8 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f3cb8061450 con 0x559327547aa0 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559327547aa0 msgr2=0x559327542590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559327547aa0 0x559327542590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cac06a840 msgr2=0x7f3cac06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cac06a840 0x7f3cac06cd00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005fd0 tx=0x7f3cc000b040 comp rx=0 tx=0).stop 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 msgr2=0x55932752c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 --2- 172.21.15.146:0/999241526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40030f0 0x55932752c740 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x5593274789e0 tx=0x7f3cc800b4b0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cce600640 1 -- 172.21.15.146:0/999241526 reap_dead start 2024-04-24T23:08:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 shutdown_connections 2024-04-24T23:08:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 >> 172.21.15.146:0/999241526 conn(0x5593274bec30 msgr2=0x55932754c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 shutdown_connections 2024-04-24T23:08:55.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:55.936+0000 7f3cd160bf40 1 -- 172.21.15.146:0/999241526 wait complete. 2024-04-24T23:08:55.941 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-04-24T23:08:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.025+0000 7ffb13d97f40 1 Processor -- start 2024-04-24T23:08:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.025+0000 7ffb13d97f40 1 -- start start 2024-04-24T23:08:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 0x5617f2ab2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 0x5617f2ac9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617f29ed550 con 0x5617f2ac58e0 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617f2995640 con 0x5617f2ac5500 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.026+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5617f29ed7f0 con 0x5617f29f0d00 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56922/0 (socket says 172.21.15.146:56922) 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 -- 172.21.15.146:0/2965366942 learned_addr learned my addr 172.21.15.146:0/2965366942 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 -- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 msgr2=0x5617f2ab2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb10600640 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 0x5617f2ac9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 0x5617f2ab2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 -- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 msgr2=0x5617f2ac9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 0x5617f2ac9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 -- 172.21.15.146:0/2965366942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f291ab30 con 0x5617f2ac58e0 2024-04-24T23:08:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb10600640 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 0x5617f2ac9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.027+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009540 tx=0x7ffb08009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d6b39dbbfadd8b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb0f200640 1 -- 172.21.15.146:0/2965366942 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08006600 con 0x5617f2ac58e0 2024-04-24T23:08:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb0f200640 1 -- 172.21.15.146:0/2965366942 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080067c0 con 0x5617f2ac58e0 2024-04-24T23:08:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb0f200640 1 -- 172.21.15.146:0/2965366942 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08006bb0 con 0x5617f2ac58e0 2024-04-24T23:08:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2965366942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 msgr2=0x5617f2aba8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009540 tx=0x7ffb08009a00 comp rx=0 tx=0).stop 2024-04-24T23:08:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2965366942 shutdown_connections 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac58e0 0x5617f2aba8a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac5500 0x5617f2ac9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2965366942 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 0x5617f2ab2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2965366942 >> 172.21.15.146:0/2965366942 conn(0x5617f2a1b7b0 msgr2=0x5617f2a1bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2965366942 shutdown_connections 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.028+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2965366942 wait complete. 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.029+0000 7ffb13d97f40 1 Processor -- start 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.029+0000 7ffb13d97f40 1 -- start start 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 0x5617f29efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac58e0 0x5617f2a36d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617f2a342b0 con 0x5617f2ac5500 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617f2a34550 con 0x5617f2ac58e0 2024-04-24T23:08:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb13d97f40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5617f2a38b80 con 0x5617f29f0d00 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb10600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb10600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56938/0 (socket says 172.21.15.146:56938) 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.030+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 learned_addr learned my addr 172.21.15.146:0/2320049398 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 msgr2=0x5617f29efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5617f29f0d00 0x5617f29efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac58e0 msgr2=0x5617f2a36d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617f2ac58e0 0x5617f2a36d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f29f00c0 con 0x5617f2ac5500 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00cc40 tx=0x7ffafc00a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb0de00640 1 -- 172.21.15.146:0/2320049398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00e640 con 0x5617f2ac5500 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb0de00640 1 -- 172.21.15.146:0/2320049398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffafc00e7e0 con 0x5617f2ac5500 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617f2ab2a30 con 0x5617f2ac5500 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb0de00640 1 -- 172.21.15.146:0/2320049398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00ebf0 con 0x5617f2ac5500 2024-04-24T23:08:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.031+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f2ac2f10 con 0x5617f2ac5500 2024-04-24T23:08:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.033+0000 7ffb0de00640 1 -- 172.21.15.146:0/2320049398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffafc009030 con 0x5617f2ac5500 2024-04-24T23:08:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.034+0000 7ffb0de00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 0x7ffaf006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.034+0000 7ffb0de00640 1 -- 172.21.15.146:0/2320049398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7ffafc089fe0 con 0x5617f2ac5500 2024-04-24T23:08:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.035+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5617f2ab4d50 0x5617f2ab5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.035+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x5617f2ab4d50 2024-04-24T23:08:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.035+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 0x7ffaf006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.035+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5617f2ab4d50 0x5617f2ab5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.036+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5617f2ab4d50 0x5617f2ab5190 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.036+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 0x7ffaf006cd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb00057000 tx=0x7ffb0005a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.037+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.038+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7ffb08006c00 0x7ffb08012410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.038+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:2 9.10 9:08000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb08006c00 2024-04-24T23:08:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.038+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7ffb08006c00 0x7ffb08012410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.039+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7ffb08006c00 0x7ffb08012410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.039+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(2 [pgnls start_epoch 73 out=201b] v73'14 uv14 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb08006c00 2024-04-24T23:08:56.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.039+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 9.8 9:10000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x5617f2ab4d50 2024-04-24T23:08:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.040+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.040+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7ffb080073f0 0x7ffb08007830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.040+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 9.18 9:18000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb080073f0 2024-04-24T23:08:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.040+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7ffb080073f0 0x7ffb08007830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.041+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7ffb080073f0 0x7ffb08007830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.041+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc01c020 con 0x7ffb080073f0 2024-04-24T23:08:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.041+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7ffafc0581e0 0x7ffafc056e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.041+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:5 9.4 9:20000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffafc0581e0 2024-04-24T23:08:56.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.042+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7ffafc0581e0 0x7ffafc056e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.043+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7ffafc0581e0 0x7ffafc056e40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.044+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(5 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x7ffafc0581e0 2024-04-24T23:08:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.044+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.14 9:28000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x5617f2ab4d50 2024-04-24T23:08:56.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.045+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(6 [pgnls start_epoch 73 out=149b] v73'30 uv30 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.045+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffafc0581e0 2024-04-24T23:08:56.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.046+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x7ffafc0581e0 2024-04-24T23:08:56.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.046+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1c 9:38000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x5617f2ab4d50 2024-04-24T23:08:56.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.047+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(8 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.047+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7ffb0802c3c0 0x7ffb0802c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.047+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.2 9:40000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb0802c3c0 2024-04-24T23:08:56.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.048+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7ffb0802c3c0 0x7ffb0802c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.049+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7ffb0802c3c0 0x7ffb0802c840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.049+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb0802c3c0 2024-04-24T23:08:56.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.050+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:10 9.12 9:48000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb08006c00 2024-04-24T23:08:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.050+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(10 [pgnls start_epoch 73 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb08006c00 2024-04-24T23:08:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.050+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:11 9.a 9:50000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb08006c00 2024-04-24T23:08:56.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.051+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(11 [pgnls start_epoch 73 out=49b] v71'8 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb08006c00 2024-04-24T23:08:56.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.051+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.1a 9:58000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x5617f2ab4d50 2024-04-24T23:08:56.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(12 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 9.6 9:60000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb080073f0 2024-04-24T23:08:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(13 [pgnls start_epoch 73 out=77b] v71'11 uv11 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7ffafc01c020 con 0x7ffb080073f0 2024-04-24T23:08:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7ffafc0606d0 0x7ffafc058910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 9.16 9:68000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffafc0606d0 2024-04-24T23:08:56.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.052+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7ffafc0606d0 0x7ffafc058910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.053+0000 7ffb10600640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7ffafc0606d0 0x7ffafc058910 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.053+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(14 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffafc01c020 con 0x7ffafc0606d0 2024-04-24T23:08:56.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.053+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:15 9.e 9:70000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb080073f0 2024-04-24T23:08:56.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.054+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(15 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffafc01c020 con 0x7ffb080073f0 2024-04-24T23:08:56.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.054+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1e 9:78000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x5617f2ab56d0 con 0x7ffb0802c3c0 2024-04-24T23:08:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.055+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(16 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb0802c3c0 2024-04-24T23:08:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.055+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 9.1 9:80000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffafc0581e0 2024-04-24T23:08:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.056+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(17 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x7ffafc0581e0 2024-04-24T23:08:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.056+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7ffb080378d0 0x7ffb0801c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.056+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:18 9.11 9:88000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080378d0 2024-04-24T23:08:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.056+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7ffb080378d0 0x7ffb0801c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.057+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7ffb080378d0 0x7ffb0801c3a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.058+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(18 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb08006970 con 0x7ffb080378d0 2024-04-24T23:08:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.058+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 9.9 9:90000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x5617f2ab4d50 2024-04-24T23:08:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.059+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 [pgnls start_epoch 73 out=97b] v68'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.059+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:20 9.19 9:98000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb0802c3c0 2024-04-24T23:08:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.060+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(20 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb0802c3c0 2024-04-24T23:08:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.060+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x5617f2ab4d50 2024-04-24T23:08:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.062+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(21 [pgnls start_epoch 73 out=73b] v68'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.062+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 9.15 9:a8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080378d0 2024-04-24T23:08:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.062+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 [pgnls start_epoch 73 out=127b] v68'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7ffb08006970 con 0x7ffb080378d0 2024-04-24T23:08:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.062+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 9.d 9:b0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080378d0 2024-04-24T23:08:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.063+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 [pgnls start_epoch 73 out=74b] v67'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb08006970 con 0x7ffb080378d0 2024-04-24T23:08:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.063+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1d 9:b8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb0802c3c0 2024-04-24T23:08:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.064+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(24 [pgnls start_epoch 73 out=73b] v73'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb0802c3c0 2024-04-24T23:08:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.064+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:25 9.3 9:c0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffafc0606d0 2024-04-24T23:08:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.065+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(25 [pgnls start_epoch 73 out=73b] v71'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffafc01c020 con 0x7ffafc0606d0 2024-04-24T23:08:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.065+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 9.13 9:c8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080073f0 2024-04-24T23:08:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.065+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(26 [pgnls start_epoch 73 out=122b] v70'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7ffafc07f090 con 0x7ffb080073f0 2024-04-24T23:08:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.065+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.b 9:d0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x5617f2ab4d50 2024-04-24T23:08:56.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.067+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 [pgnls start_epoch 73 out=124b] v73'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7ffb08006970 con 0x5617f2ab4d50 2024-04-24T23:08:56.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.067+0000 7ffb11a00640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7ffb08047060 0x7ffb08047ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.067+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:28 9.1b 9:d8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb08047060 2024-04-24T23:08:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.068+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7ffb08047060 0x7ffb08047ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.069+0000 7ffb11000640 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7ffb08047060 0x7ffb08047ac0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.070+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(28 [pgnls start_epoch 73 out=73b] v73'21 uv21 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb08047060 2024-04-24T23:08:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.070+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 9.7 9:e0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080073f0 2024-04-24T23:08:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.070+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(29 [pgnls start_epoch 73 out=129b] v70'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7ffafc07f090 con 0x7ffb080073f0 2024-04-24T23:08:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.070+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:30 9.17 9:e8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080073f0 2024-04-24T23:08:56.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.071+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(30 [pgnls start_epoch 73 out=73b] v73'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffafc07f090 con 0x7ffb080073f0 2024-04-24T23:08:56.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.071+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:31 9.f 9:f0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb080073f0 2024-04-24T23:08:56.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.071+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(31 [pgnls start_epoch 73 out=73b] v67'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7ffafc07f090 con 0x7ffb080073f0 2024-04-24T23:08:56.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.071+0000 7ffb10600640 1 -- 172.21.15.146:0/2320049398 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:32 9.1f 9:f8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7ffb00079040 con 0x7ffb0802c3c0 2024-04-24T23:08:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb11000640 1 -- 172.21.15.146:0/2320049398 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(32 [pgnls start_epoch 73 out=101b] v73'14 uv13 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7ffb0004fa00 con 0x7ffb0802c3c0 2024-04-24T23:08:56.074 INFO:teuthology.orchestra.run.smithi146.stdout:601.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:602.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:10000000000.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:600.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:603.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:60a.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:613.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000.inode 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:610.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:606.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:607.00000000 2024-04-24T23:08:56.075 INFO:teuthology.orchestra.run.smithi146.stdout:60e.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_openfiles.0 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:60f.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:608.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:501.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:612.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:401.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:604.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000.inode 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:500.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:mds_snaptable 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:605.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_inotable 2024-04-24T23:08:56.076 INFO:teuthology.orchestra.run.smithi146.stdout:611.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_sessionmap 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000003 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:60c.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000002 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:609.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:10000000001.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:60b.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:60d.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:400.00000000 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000.inode 2024-04-24T23:08:56.077 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7ffafc0606d0 msgr2=0x7ffafc058910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7ffafc0606d0 0x7ffafc058910 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7ffb08006c00 msgr2=0x7ffb08012410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7ffb08006c00 0x7ffb08012410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7ffb080073f0 msgr2=0x7ffb08007830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7ffb080073f0 0x7ffb08007830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7ffb080378d0 msgr2=0x7ffb0801c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7ffb080378d0 0x7ffb0801c3a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7ffb08047060 msgr2=0x7ffb08047ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7ffb08047060 0x7ffb08047ac0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5617f2ab4d50 msgr2=0x5617f2ab5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x5617f2ab4d50 0x5617f2ab5190 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7ffb0802c3c0 msgr2=0x7ffb0802c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7ffb0802c3c0 0x7ffb0802c840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 reap_dead start 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7ffafc0581e0 msgr2=0x7ffafc056e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7ffafc0581e0 0x7ffafc056e40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 reap_dead start 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 reap_dead start 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.073+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 reap_dead start 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb11a00640 1 -- 172.21.15.146:0/2320049398 reap_dead start 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 msgr2=0x7ffaf006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 0x7ffaf006cd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb00057000 tx=0x7ffb0005a040 comp rx=0 tx=0).stop 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 msgr2=0x5617f2ab24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00cc40 tx=0x7ffafc00a6b0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 shutdown_connections 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617f2ac5500 0x5617f2ab24f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 --2- 172.21.15.146:0/2320049398 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf006a840 0x7ffaf006cd00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 >> 172.21.15.146:0/2320049398 conn(0x5617f2a1b7b0 msgr2=0x5617f2ac99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 shutdown_connections 2024-04-24T23:08:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.074+0000 7ffb13d97f40 1 -- 172.21.15.146:0/2320049398 wait complete. 2024-04-24T23:08:56.082 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-04-24T23:08:56.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.186+0000 7f9dea01ef40 1 Processor -- start 2024-04-24T23:08:56.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.186+0000 7f9dea01ef40 1 -- start start 2024-04-24T23:08:56.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82bd9d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82bd9d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c82bda14f0 con 0x55c82bda0950 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c82bd16640 con 0x55c82be40d50 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c82bda1670 con 0x55c82bdbbfd0 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9de6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9de6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56952/0 (socket says 172.21.15.146:56952) 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9de6600640 1 -- 172.21.15.146:0/2349861040 learned_addr learned my addr 172.21.15.146:0/2349861040 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9de7000640 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82bd9d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.187+0000 7f9de5c00640 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82bd9d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 -- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 msgr2=0x55c82bd9d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82bd9d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 -- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 msgr2=0x55c82bd9d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82bd9d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 -- 172.21.15.146:0/2349861040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c82bc9bb30 con 0x55c82bda0950 2024-04-24T23:08:56.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9de6600640 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001e60 tx=0x7f9dd800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ec7f43a37d0250 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9ddfe00640 1 -- 172.21.15.146:0/2349861040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8012020 con 0x55c82bda0950 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9ddfe00640 1 -- 172.21.15.146:0/2349861040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd800e670 con 0x55c82bda0950 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.188+0000 7f9ddfe00640 1 -- 172.21.15.146:0/2349861040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800ea60 con 0x55c82bda0950 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 -- 172.21.15.146:0/2349861040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 msgr2=0x55c82be27f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001e60 tx=0x7f9dd800b780 comp rx=0 tx=0).stop 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 -- 172.21.15.146:0/2349861040 shutdown_connections 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82bd9d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82bd9d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/2349861040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82be27f50 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 -- 172.21.15.146:0/2349861040 >> 172.21.15.146:0/2349861040 conn(0x55c82bd749f0 msgr2=0x55c82bd9dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 -- 172.21.15.146:0/2349861040 shutdown_connections 2024-04-24T23:08:56.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.189+0000 7f9dea01ef40 1 -- 172.21.15.146:0/2349861040 wait complete. 2024-04-24T23:08:56.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.190+0000 7f9dea01ef40 1 Processor -- start 2024-04-24T23:08:56.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.190+0000 7f9dea01ef40 1 -- start start 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82be3f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82be3fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c82be2d5f0 con 0x55c82bda0950 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c82be2d350 con 0x55c82be40d50 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9dea01ef40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c82be2d890 con 0x55c82bdbbfd0 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56962/0 (socket says 172.21.15.146:56962) 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 learned_addr learned my addr 172.21.15.146:0/3622166345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82be3f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82be3fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 msgr2=0x55c82be3f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c82bdbbfd0 0x55c82be3f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 msgr2=0x55c82be3fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82be3fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c82be2cd30 con 0x55c82bda0950 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.191+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c82be40d50 0x55c82be3fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001ed0 tx=0x7f9dd8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9ddea00640 1 -- 172.21.15.146:0/3622166345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800e470 con 0x55c82bda0950 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9ddea00640 1 -- 172.21.15.146:0/3622166345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd8017630 con 0x55c82bda0950 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9ddea00640 1 -- 172.21.15.146:0/3622166345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8017a20 con 0x55c82bda0950 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c82be2d010 con 0x55c82bda0950 2024-04-24T23:08:56.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.192+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c82be25950 con 0x55c82bda0950 2024-04-24T23:08:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.194+0000 7f9ddea00640 1 -- 172.21.15.146:0/3622166345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dd8015020 con 0x55c82bda0950 2024-04-24T23:08:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.195+0000 7f9ddea00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 0x7f9dc806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.195+0000 7f9ddea00640 1 -- 172.21.15.146:0/3622166345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f9dd808b850 con 0x55c82bda0950 2024-04-24T23:08:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.196+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55c82bd6f020 0x55c82be2a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.196+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.196+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 0x7f9dc806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.196+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55c82bd6f020 0x55c82be2a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.197+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 0x7f9dc806ccd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4057000 tx=0x7f9dd4052000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.197+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55c82bd6f020 0x55c82be2a560 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.198+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.198+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f9de0014040 0x7f9de0014930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.198+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:2 9.10 9:08000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0014040 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.199+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f9de0014040 0x7f9de0014930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.199+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f9de0014040 0x7f9de0014930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.200+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(2 [pgnls start_epoch 73 out=201b] v73'14 uv14 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0014040 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.200+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 9.8 9:10000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.201+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.201+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f9de00138c0 0x7f9de0012340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.201+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 9.18 9:18000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.201+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f9de00138c0 0x7f9de0012340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.201+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f9de00138c0 0x7f9de0012340 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.202+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd405d040 con 0x7f9de00138c0 2024-04-24T23:08:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.202+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9dd4060950 0x7f9dd405f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.202+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:5 9.4 9:20000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9dd4060950 2024-04-24T23:08:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.202+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9dd4060950 0x7f9dd405f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.203+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9dd4060950 0x7f9dd405f3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.204+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(5 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x7f9dd4060950 2024-04-24T23:08:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.204+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.14 9:28000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.205+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(6 [pgnls start_epoch 73 out=149b] v73'30 uv30 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.205+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9dd4060950 2024-04-24T23:08:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.206+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x7f9dd4060950 2024-04-24T23:08:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.206+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1c 9:38000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.207+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(8 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.207+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f9de0024940 0x7f9de00233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.207+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.2 9:40000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0024940 2024-04-24T23:08:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.208+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f9de0024940 0x7f9de00233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.209+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f9de0024940 0x7f9de00233c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.209+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0024940 2024-04-24T23:08:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.209+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:10 9.12 9:48000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0014040 2024-04-24T23:08:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.210+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(10 [pgnls start_epoch 73 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0014040 2024-04-24T23:08:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.210+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:11 9.a 9:50000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0014040 2024-04-24T23:08:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.210+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(11 [pgnls start_epoch 73 out=49b] v71'8 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0014040 2024-04-24T23:08:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.210+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.1a 9:58000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.211+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(12 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.211+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 9.6 9:60000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.212+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(13 [pgnls start_epoch 73 out=77b] v71'11 uv11 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f9dd405d040 con 0x7f9de00138c0 2024-04-24T23:08:56.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.212+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9dd4053360 0x7f9dd40537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.212+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 9.16 9:68000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9dd4053360 2024-04-24T23:08:56.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.212+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9dd4053360 0x7f9dd40537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.213+0000 7f9de5c00640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9dd4053360 0x7f9dd40537e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.213+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(14 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd405d040 con 0x7f9dd4053360 2024-04-24T23:08:56.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.213+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:15 9.e 9:70000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.214+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(15 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd405d040 con 0x7f9de00138c0 2024-04-24T23:08:56.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.214+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1e 9:78000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0024940 2024-04-24T23:08:56.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.215+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(16 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0024940 2024-04-24T23:08:56.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.215+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 9.1 9:80000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9dd4060950 2024-04-24T23:08:56.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.216+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(17 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x7f9dd4060950 2024-04-24T23:08:56.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.216+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9de002e3c0 0x7f9de002e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.216+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:18 9.11 9:88000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de002e3c0 2024-04-24T23:08:56.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.216+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9de002e3c0 0x7f9de002e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.217+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9de002e3c0 0x7f9de002e840 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.218+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(18 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de0011040 con 0x7f9de002e3c0 2024-04-24T23:08:56.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.218+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 9.9 9:90000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.219+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 [pgnls start_epoch 73 out=97b] v68'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.219+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:20 9.19 9:98000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0024940 2024-04-24T23:08:56.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.220+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(20 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0024940 2024-04-24T23:08:56.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.220+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.221+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(21 [pgnls start_epoch 73 out=73b] v68'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.221+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 9.15 9:a8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de002e3c0 2024-04-24T23:08:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.221+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 [pgnls start_epoch 73 out=127b] v68'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9de0011040 con 0x7f9de002e3c0 2024-04-24T23:08:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.221+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 9.d 9:b0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de002e3c0 2024-04-24T23:08:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.222+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 [pgnls start_epoch 73 out=74b] v67'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9de0011040 con 0x7f9de002e3c0 2024-04-24T23:08:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.222+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1d 9:b8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0024940 2024-04-24T23:08:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.223+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(24 [pgnls start_epoch 73 out=73b] v73'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0024940 2024-04-24T23:08:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.223+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:25 9.3 9:c0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9dd4053360 2024-04-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.224+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(25 [pgnls start_epoch 73 out=73b] v71'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd405d040 con 0x7f9dd4053360 2024-04-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.224+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 9.13 9:c8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.224+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(26 [pgnls start_epoch 73 out=122b] v70'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f9dd407b090 con 0x7f9de00138c0 2024-04-24T23:08:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.224+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.b 9:d0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x55c82bd6f020 2024-04-24T23:08:56.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.225+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 [pgnls start_epoch 73 out=124b] v73'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f9de0011040 con 0x55c82bd6f020 2024-04-24T23:08:56.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.225+0000 7f9de7000640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9de0032040 0x7f9de0031950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.225+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:28 9.1b 9:d8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0032040 2024-04-24T23:08:56.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.226+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9de0032040 0x7f9de0031950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.227+0000 7f9de6600640 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9de0032040 0x7f9de0031950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.228+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(28 [pgnls start_epoch 73 out=73b] v73'21 uv21 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0032040 2024-04-24T23:08:56.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.228+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 9.7 9:e0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.229+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(29 [pgnls start_epoch 73 out=129b] v70'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f9dd407b090 con 0x7f9de00138c0 2024-04-24T23:08:56.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.229+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:30 9.17 9:e8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.230+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(30 [pgnls start_epoch 73 out=73b] v73'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd407b090 con 0x7f9de00138c0 2024-04-24T23:08:56.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.230+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:31 9.f 9:f0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de00138c0 2024-04-24T23:08:56.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.230+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(31 [pgnls start_epoch 73 out=73b] v67'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f9dd407b090 con 0x7f9de00138c0 2024-04-24T23:08:56.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.230+0000 7f9de5c00640 1 -- 172.21.15.146:0/3622166345 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:32 9.1f 9:f8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x55c82be253e0 con 0x7f9de0024940 2024-04-24T23:08:56.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.231+0000 7f9de6600640 1 -- 172.21.15.146:0/3622166345 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(32 [pgnls start_epoch 73 out=101b] v73'14 uv13 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f9dd8029020 con 0x7f9de0024940 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:601.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:602.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:10000000000.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:600.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:603.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:60a.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:613.00000000 2024-04-24T23:08:56.233 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000.inode 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:610.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:606.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:607.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:60e.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_openfiles.0 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:60f.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:608.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:501.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:612.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:401.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:604.00000000 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000.inode 2024-04-24T23:08:56.234 INFO:teuthology.orchestra.run.smithi146.stdout:500.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:mds_snaptable 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:605.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_inotable 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:611.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_sessionmap 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000003 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:60c.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000002 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:609.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:10000000001.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:60b.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:60d.00000000 2024-04-24T23:08:56.235 INFO:teuthology.orchestra.run.smithi146.stdout:400.00000000 2024-04-24T23:08:56.236 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000.inode 2024-04-24T23:08:56.236 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9dd4053360 msgr2=0x7f9dd40537e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f9dd4053360 0x7f9dd40537e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f9de0014040 msgr2=0x7f9de0014930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f9de0014040 0x7f9de0014930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f9de00138c0 msgr2=0x7f9de0012340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f9de00138c0 0x7f9de0012340 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9de002e3c0 msgr2=0x7f9de002e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f9de002e3c0 0x7f9de002e840 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9de0032040 msgr2=0x7f9de0031950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f9de0032040 0x7f9de0031950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55c82bd6f020 msgr2=0x55c82be2a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x55c82bd6f020 0x55c82be2a560 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f9de0024940 msgr2=0x7f9de00233c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f9de0024940 0x7f9de00233c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9dd4060950 msgr2=0x7f9dd405f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f9dd4060950 0x7f9dd405f3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9de7000640 1 -- 172.21.15.146:0/3622166345 reap_dead start 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 msgr2=0x7f9dc806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 0x7f9dc806ccd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4057000 tx=0x7f9dd4052000 comp rx=0 tx=0).stop 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 msgr2=0x55c82bd6eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.232+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001ed0 tx=0x7f9dd8000bc0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 shutdown_connections 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806a810 0x7f9dc806ccd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 --2- 172.21.15.146:0/3622166345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c82bda0950 0x55c82bd6eae0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 >> 172.21.15.146:0/3622166345 conn(0x55c82bd749f0 msgr2=0x55c82be2f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 shutdown_connections 2024-04-24T23:08:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.233+0000 7f9dea01ef40 1 -- 172.21.15.146:0/3622166345 wait complete. 2024-04-24T23:08:56.241 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 401.00000000 2024-04-24T23:08:56.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.350+0000 7fa846d1ef40 1 Processor -- start 2024-04-24T23:08:56.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.350+0000 7fa846d1ef40 1 -- start start 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 0x56171cdff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cde0760 0x56171cdfcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56171cccb640 con 0x56171cdfd170 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56171cccf680 con 0x56171cddfa60 2024-04-24T23:08:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.351+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56171cd71230 con 0x56171cde0760 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56984/0 (socket says 172.21.15.146:56984) 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 -- 172.21.15.146:0/2768314974 learned_addr learned my addr 172.21.15.146:0/2768314974 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843400640 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 0x56171cdff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 -- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cde0760 msgr2=0x56171cdfcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cde0760 0x56171cdfcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 -- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 msgr2=0x56171cdff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 0x56171cdff020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843e00640 1 -- 172.21.15.146:0/2768314974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171cd56170 con 0x56171cdfd170 2024-04-24T23:08:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.352+0000 7fa843400640 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 0x56171cdff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa843e00640 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa83c025dd0 tx=0x7fa83c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf218a9c09c8bac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa841600640 1 -- 172.21.15.146:0/2768314974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c005030 con 0x56171cdfd170 2024-04-24T23:08:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa841600640 1 -- 172.21.15.146:0/2768314974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa83c065070 con 0x56171cdfd170 2024-04-24T23:08:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa841600640 1 -- 172.21.15.146:0/2768314974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0053f0 con 0x56171cdfd170 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2768314974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 msgr2=0x56171cd52630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa83c025dd0 tx=0x7fa83c04f000 comp rx=0 tx=0).stop 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2768314974 shutdown_connections 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.353+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cdfd170 0x56171cd52630 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cde0760 0x56171cdfcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2768314974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cddfa60 0x56171cdff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2768314974 >> 172.21.15.146:0/2768314974 conn(0x56171cd71c30 msgr2=0x56171cdffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2768314974 shutdown_connections 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2768314974 wait complete. 2024-04-24T23:08:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.354+0000 7fa846d1ef40 1 Processor -- start 2024-04-24T23:08:56.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.355+0000 7fa846d1ef40 1 -- start start 2024-04-24T23:08:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.355+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 0x56171cddc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cde0760 0x56171cdf3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa846d1ef40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cdfd170 0x56171cdfc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56171cde0390 con 0x56171cddfa60 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56171cdfb700 con 0x56171cde0760 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa846d1ef40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56171cdfbb90 con 0x56171cdfd170 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 0x56171cddc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 0x56171cddc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56986/0 (socket says 172.21.15.146:56986) 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 -- 172.21.15.146:0/2814388582 learned_addr learned my addr 172.21.15.146:0/2814388582 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 -- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cdfd170 msgr2=0x56171cdfc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56171cdfd170 0x56171cdfc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 -- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cde0760 msgr2=0x56171cdf3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56171cde0760 0x56171cdf3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.356+0000 7fa843400640 1 -- 172.21.15.146:0/2814388582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171cdf3970 con 0x56171cddfa60 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa843400640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 0x56171cddc660 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa83400eee0 tx=0x7fa83400c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa83be00640 1 -- 172.21.15.146:0/2814388582 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834015070 con 0x56171cddfa60 2024-04-24T23:08:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa83be00640 1 -- 172.21.15.146:0/2814388582 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8340113f0 con 0x56171cddfa60 2024-04-24T23:08:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa83be00640 1 -- 172.21.15.146:0/2814388582 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340117a0 con 0x56171cddfa60 2024-04-24T23:08:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56171cdf3c50 con 0x56171cddfa60 2024-04-24T23:08:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.357+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171cdf4210 con 0x56171cddfa60 2024-04-24T23:08:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.359+0000 7fa83be00640 1 -- 172.21.15.146:0/2814388582 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa834018070 con 0x56171cddfa60 2024-04-24T23:08:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.360+0000 7fa83be00640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa82406a840 0x7fa82406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.360+0000 7fa83be00640 1 -- 172.21.15.146:0/2814388582 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fa834089e40 con 0x56171cddfa60 2024-04-24T23:08:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.361+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56171cd54a10 0x56171cd54df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.361+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.5 9:a6e36b3f:::401.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e73) -- 0x56171cd55330 con 0x56171cd54a10 2024-04-24T23:08:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.361+0000 7fa842a00640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa82406a840 0x7fa82406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.361+0000 7fa843e00640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56171cd54a10 0x56171cd54df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.362+0000 7fa842a00640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa82406a840 0x7fa82406cd00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa830001cc0 tx=0x7fa8300011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.363+0000 7fa843e00640 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56171cd54a10 0x56171cd54df0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa843e00640 1 -- 172.21.15.146:0/2814388582 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 401.00000000 [delete] v73'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7fa83c005030 con 0x56171cd54a10 2024-04-24T23:08:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56171cd54a10 msgr2=0x56171cd54df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x56171cd54a10 0x56171cd54df0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa82406a840 msgr2=0x7fa82406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa82406a840 0x7fa82406cd00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa830001cc0 tx=0x7fa8300011a0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 msgr2=0x56171cddc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 --2- 172.21.15.146:0/2814388582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56171cddfa60 0x56171cddc660 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa83400eee0 tx=0x7fa83400c5c0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa843e00640 1 -- 172.21.15.146:0/2814388582 reap_dead start 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 shutdown_connections 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 >> 172.21.15.146:0/2814388582 conn(0x56171cd71c30 msgr2=0x56171cd24d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 shutdown_connections 2024-04-24T23:08:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.366+0000 7fa846d1ef40 1 -- 172.21.15.146:0/2814388582 wait complete. 2024-04-24T23:08:56.372 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-04-24T23:08:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.471+0000 7f498951df40 1 Processor -- start 2024-04-24T23:08:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.471+0000 7f498951df40 1 -- start start 2024-04-24T23:08:56.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 0x559a5444f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559a54456940 0x559a5444fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559a543b7f70 con 0x559a543864c0 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a5432d640 con 0x7f496c003630 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f498951df40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559a543b80f0 con 0x559a54456940 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57012/0 (socket says 172.21.15.146:57012) 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 -- 172.21.15.146:0/825273150 learned_addr learned my addr 172.21.15.146:0/825273150 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985c00640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 0x559a5444f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 -- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559a54456940 msgr2=0x559a5444fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4986600640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559a54456940 0x559a5444fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559a54456940 0x559a5444fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 -- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 msgr2=0x559a5444f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 0x559a5444f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985200640 1 -- 172.21.15.146:0/825273150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a542b2b30 con 0x559a543864c0 2024-04-24T23:08:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.472+0000 7f4985c00640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 0x559a5444f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:56.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f4985200640 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4970009790 tx=0x7f4970005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b39dc98fad1407 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f497f400640 1 -- 172.21.15.146:0/825273150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970008890 con 0x559a543864c0 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f497f400640 1 -- 172.21.15.146:0/825273150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970008a30 con 0x559a543864c0 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f497f400640 1 -- 172.21.15.146:0/825273150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970008e20 con 0x559a543864c0 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f498951df40 1 -- 172.21.15.146:0/825273150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 msgr2=0x559a54385c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.473+0000 7f498951df40 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4970009790 tx=0x7f4970005f90 comp rx=0 tx=0).stop 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 -- 172.21.15.146:0/825273150 shutdown_connections 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559a54456940 0x559a5444fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a54385c70 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 --2- 172.21.15.146:0/825273150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f496c003630 0x559a5444f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 -- 172.21.15.146:0/825273150 >> 172.21.15.146:0/825273150 conn(0x559a5438b9f0 msgr2=0x559a54384020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 -- 172.21.15.146:0/825273150 shutdown_connections 2024-04-24T23:08:56.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 -- 172.21.15.146:0/825273150 wait complete. 2024-04-24T23:08:56.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.474+0000 7f498951df40 1 Processor -- start 2024-04-24T23:08:56.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 -- start start 2024-04-24T23:08:56.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a54456940 0x559a543b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f496c003630 0x559a543b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559a543b52b0 con 0x559a543864c0 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a5445e690 con 0x559a54456940 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.475+0000 7f498951df40 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559a543b3b70 con 0x7f496c003630 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57024/0 (socket says 172.21.15.146:57024) 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 learned_addr learned my addr 172.21.15.146:0/151569730 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f496c003630 0x559a543b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f496c003630 msgr2=0x559a543b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f496c003630 0x559a543b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a54456940 msgr2=0x559a543b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a54456940 0x559a543b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.476+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a54450c10 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f497800d3f0 tx=0x7f497800d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f497e000640 1 -- 172.21.15.146:0/151569730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978018070 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f497e000640 1 -- 172.21.15.146:0/151569730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978003650 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a54450ef0 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f497e000640 1 -- 172.21.15.146:0/151569730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49780062e0 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.477+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a544514b0 con 0x559a543864c0 2024-04-24T23:08:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.479+0000 7f497e000640 1 -- 172.21.15.146:0/151569730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f497801b070 con 0x559a543864c0 2024-04-24T23:08:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.480+0000 7f497e000640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 0x7f496406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.480+0000 7f497e000640 1 -- 172.21.15.146:0/151569730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f4978089960 con 0x559a543864c0 2024-04-24T23:08:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.480+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559a54384020 0x559a544535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.480+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x559a5444ec40 con 0x559a54384020 2024-04-24T23:08:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.481+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 0x7f496406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.481+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559a54384020 0x559a544535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.482+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 0x7f496406ccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x559a543b4090 tx=0x7f497000d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.482+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559a54384020 0x559a544535f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.483+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== osd_op_reply(1 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.483+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559a543b7950 0x7f4980058910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.483+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:2 9.10 9:08000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543b7950 2024-04-24T23:08:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.483+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559a543b7950 0x7f4980058910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.484+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559a543b7950 0x7f4980058910 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.484+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(2 [pgnls start_epoch 73 out=201b] v73'14 uv14 ondisk = 1) ==== 144+0+201 (crc 0 0 0) 0x7f497801a030 con 0x559a543b7950 2024-04-24T23:08:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.484+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:3 9.8 9:10000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.485+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== osd_op_reply(3 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.485+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559a543d2fd0 0x7f498004e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.485+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:4 9.18 9:18000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.486+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559a543d2fd0 0x7f498004e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.486+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559a543d2fd0 0x7f498004e350 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.487+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== osd_op_reply(4 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4970008da0 con 0x559a543d2fd0 2024-04-24T23:08:56.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.487+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f497001f430 0x7f497001f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.487+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:5 9.4 9:20000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f497001f430 2024-04-24T23:08:56.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.487+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f497001f430 0x7f497001f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.488+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f497001f430 0x7f497001f870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.489+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(5 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x7f497001f430 2024-04-24T23:08:56.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.489+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:6 9.14 9:28000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.490+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 3 ==== osd_op_reply(6 [pgnls start_epoch 73 out=149b] v73'30 uv30 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.490+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f497001f430 2024-04-24T23:08:56.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.491+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== osd_op_reply(7 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x7f497001f430 2024-04-24T23:08:56.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.491+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:8 9.1c 9:38000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.492+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 4 ==== osd_op_reply(8 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.492+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x559a54457d50 0x7f498006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.492+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:9 9.2 9:40000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54457d50 2024-04-24T23:08:56.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.493+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x559a54457d50 0x7f498006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.494+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x559a54457d50 0x7f498006b970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.495+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(9 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497801a030 con 0x559a54457d50 2024-04-24T23:08:56.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.495+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:10 9.12 9:48000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543b7950 2024-04-24T23:08:56.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.496+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== osd_op_reply(10 [pgnls start_epoch 73 out=73b] v68'3 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f497801a030 con 0x559a543b7950 2024-04-24T23:08:56.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.496+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:11 9.a 9:50000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543b7950 2024-04-24T23:08:56.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.496+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.1 v2:172.21.15.146:6800/2440725071 3 ==== osd_op_reply(11 [pgnls start_epoch 73 out=49b] v71'8 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497801a030 con 0x559a543b7950 2024-04-24T23:08:56.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.496+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:12 9.1a 9:58000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.497+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 5 ==== osd_op_reply(12 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.497+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:13 9.6 9:60000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.497+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== osd_op_reply(13 [pgnls start_epoch 73 out=77b] v71'11 uv11 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.498+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f49700073e0 0x7f4970007860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.498+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:14 9.16 9:68000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f49700073e0 2024-04-24T23:08:56.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.498+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f49700073e0 0x7f4970007860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.498+0000 7f4985200640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f49700073e0 0x7f4970007860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.499+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== osd_op_reply(14 [pgnls start_epoch 73 out=73b] v68'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f4970022490 con 0x7f49700073e0 2024-04-24T23:08:56.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.499+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:15 9.e 9:70000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.499+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 3 ==== osd_op_reply(15 [pgnls start_epoch 73 out=73b] v67'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.499+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:16 9.1e 9:78000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54457d50 2024-04-24T23:08:56.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.501+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(16 [pgnls start_epoch 73 out=49b] v73'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497801a030 con 0x559a54457d50 2024-04-24T23:08:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.501+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:17 9.1 9:80000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f497001f430 2024-04-24T23:08:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.502+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.7 v2:172.21.15.203:6824/1423940067 3 ==== osd_op_reply(17 [pgnls start_epoch 73 out=49b] v68'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x7f497001f430 2024-04-24T23:08:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.502+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f496c002850 0x7f4980069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.502+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:18 9.11 9:88000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f496c002850 2024-04-24T23:08:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.502+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f496c002850 0x7f4980069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.503+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f496c002850 0x7f4980069950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.504+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== osd_op_reply(18 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x7f496c002850 2024-04-24T23:08:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.504+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:19 9.9 9:90000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.505+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 6 ==== osd_op_reply(19 [pgnls start_epoch 73 out=97b] v68'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.505+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:20 9.19 9:98000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54457d50 2024-04-24T23:08:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.506+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(20 [pgnls start_epoch 73 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497801a030 con 0x559a54457d50 2024-04-24T23:08:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.506+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.506+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 7 ==== osd_op_reply(21 [pgnls start_epoch 73 out=49b] v73'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.506+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:22 9.15 9:a8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f496c002850 2024-04-24T23:08:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.507+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== osd_op_reply(22 [pgnls start_epoch 73 out=127b] v68'4 uv4 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f498004f860 con 0x7f496c002850 2024-04-24T23:08:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.507+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- osd_op(unknown.0.0:23 9.d 9:b0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f496c002850 2024-04-24T23:08:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.507+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.3 v2:172.21.15.146:6808/1724749641 3 ==== osd_op_reply(23 [pgnls start_epoch 73 out=74b] v67'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f498004f860 con 0x7f496c002850 2024-04-24T23:08:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.507+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:24 9.1d 9:b8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54457d50 2024-04-24T23:08:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.508+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.6 v2:172.21.15.203:6807/3736386787 4 ==== osd_op_reply(24 [pgnls start_epoch 73 out=73b] v73'5 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f497801a030 con 0x559a54457d50 2024-04-24T23:08:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.508+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- osd_op(unknown.0.0:25 9.3 9:c0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f49700073e0 2024-04-24T23:08:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.509+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== osd_op_reply(25 [pgnls start_epoch 73 out=73b] v71'4 uv4 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f4970022490 con 0x7f49700073e0 2024-04-24T23:08:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.509+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:26 9.13 9:c8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.510+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 4 ==== osd_op_reply(26 [pgnls start_epoch 73 out=122b] v70'5 uv5 ondisk = 1) ==== 144+0+122 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.510+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- osd_op(unknown.0.0:27 9.b 9:d0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54384020 2024-04-24T23:08:56.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.511+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 <== osd.5 v2:172.21.15.203:6800/1152275008 8 ==== osd_op_reply(27 [pgnls start_epoch 73 out=124b] v73'8 uv8 ondisk = 1) ==== 144+0+124 (crc 0 0 0) 0x7f498004f860 con 0x559a54384020 2024-04-24T23:08:56.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.511+0000 7f4986600640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f498007dbf0 0x7f498008a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.511+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- osd_op(unknown.0.0:28 9.1b 9:d8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x7f498007dbf0 2024-04-24T23:08:56.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.512+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f498007dbf0 0x7f498008a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.513+0000 7f4985c00640 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f498007dbf0 0x7f498008a400 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.514+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== osd_op_reply(28 [pgnls start_epoch 73 out=73b] v73'21 uv21 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f497801a030 con 0x7f498007dbf0 2024-04-24T23:08:56.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.514+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:29 9.7 9:e0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.514+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 5 ==== osd_op_reply(29 [pgnls start_epoch 73 out=129b] v70'6 uv6 ondisk = 1) ==== 144+0+129 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.514+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:30 9.17 9:e8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.515+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 6 ==== osd_op_reply(30 [pgnls start_epoch 73 out=73b] v73'8 uv8 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.515+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- osd_op(unknown.0.0:31 9.f 9:f0000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a543d2fd0 2024-04-24T23:08:56.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.516+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 <== osd.2 v2:172.21.15.146:6809/29852179 7 ==== osd_op_reply(31 [pgnls start_epoch 73 out=73b] v67'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f4970022490 con 0x559a543d2fd0 2024-04-24T23:08:56.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.516+0000 7f4985200640 1 -- 172.21.15.146:0/151569730 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:32 9.1f 9:f8000000::::head [pgnls start_epoch 73 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73) -- 0x7f4980006380 con 0x559a54457d50 2024-04-24T23:08:56.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f4985c00640 1 -- 172.21.15.146:0/151569730 <== osd.6 v2:172.21.15.203:6807/3736386787 5 ==== osd_op_reply(32 [pgnls start_epoch 73 out=101b] v73'14 uv13 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f497801a030 con 0x559a54457d50 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:601.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:602.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:10000000000.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:600.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:603.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:60a.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:613.00000000 2024-04-24T23:08:56.518 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000.inode 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:610.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:606.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:607.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:60e.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_openfiles.0 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:60f.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:608.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:501.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:612.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:604.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000.inode 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:500.00000000 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:mds_snaptable 2024-04-24T23:08:56.519 INFO:teuthology.orchestra.run.smithi146.stdout:605.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:101.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_inotable 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:611.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:mds0_sessionmap 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000003 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:60c.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:200.00000002 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:609.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:10000000001.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:60b.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:60d.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:400.00000000 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:100.00000000.inode 2024-04-24T23:08:56.520 INFO:teuthology.orchestra.run.smithi146.stdout:1.00000000 2024-04-24T23:08:56.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f49700073e0 msgr2=0x7f4970007860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f49700073e0 0x7f4970007860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559a543b7950 msgr2=0x7f4980058910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559a543b7950 0x7f4980058910 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559a543d2fd0 msgr2=0x7f498004e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x559a543d2fd0 0x7f498004e350 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f496c002850 msgr2=0x7f4980069950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7f496c002850 0x7f4980069950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f498007dbf0 msgr2=0x7f498008a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f498007dbf0 0x7f498008a400 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559a54384020 msgr2=0x559a544535f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x559a54384020 0x559a544535f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 reap_dead start 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 reap_dead start 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x559a54457d50 msgr2=0x7f498006b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x559a54457d50 0x7f498006b970 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f497001f430 msgr2=0x7f497001f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f497001f430 0x7f497001f870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f4986600640 1 -- 172.21.15.146:0/151569730 reap_dead start 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 msgr2=0x7f496406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 0x7f496406ccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x559a543b4090 tx=0x7f497000d000 comp rx=0 tx=0).stop 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 msgr2=0x559a5444e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f497800d3f0 tx=0x7f497800d8b0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 shutdown_connections 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f496406a810 0x7f496406ccd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 --2- 172.21.15.146:0/151569730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a543864c0 0x559a5444e700 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.517+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 >> 172.21.15.146:0/151569730 conn(0x559a5438b9f0 msgr2=0x559a54385c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.518+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 shutdown_connections 2024-04-24T23:08:56.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.518+0000 7f498951df40 1 -- 172.21.15.146:0/151569730 wait complete. 2024-04-24T23:08:56.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2024-04-24T23:08:56.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.728+0000 7f3688200640 1 Processor -- start 2024-04-24T23:08:56.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.729+0000 7f3688200640 1 -- start start 2024-04-24T23:08:56.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.730+0000 7f3688200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36800ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.730+0000 7f3688200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36800ced40 con 0x7f36800ce5a0 2024-04-24T23:08:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.730+0000 7f3688200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36800cf020 con 0x7f368013ef30 2024-04-24T23:08:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.730+0000 7f3688200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36801423d0 con 0x7f3680141c80 2024-04-24T23:08:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.731+0000 7f3686200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f36800ce5a0 0x7f3680071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60550/0 (socket says 172.21.15.146:60550) 2024-04-24T23:08:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.731+0000 7f3686200640 1 -- 172.21.15.146:0/159191364 learned_addr learned my addr 172.21.15.146:0/159191364 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.731+0000 7f3684e00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36800ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.731+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076709028 0 0) 0x7f36800ced40 con 0x7f36800ce5a0 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.731+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3668003520 con 0x7f36800ce5a0 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 483131219 0 0) 0x7f3668003520 con 0x7f36800ce5a0 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 msgr2=0x7f36800ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36800ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 >> v1:172.21.15.203:6789/0 conn(0x7f368013ef30 legacy=0x7f3680141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36800cf300 con 0x7f36800ce5a0 2024-04-24T23:08:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f36780019f0 con 0x7f36800ce5a0 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 >> v1:172.21.15.146:6789/0 conn(0x7f36800ce5a0 legacy=0x7f3680071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3668003f60 0x7f3668004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004d40 0x7f36680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f366800ba70 con 0x7f3668004d40 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f366800bc20 con 0x7f3668003f60 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f366800be20 con 0x7f3680141c80 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f3686200640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004d40 0x7f36680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f3684e00640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3668003f60 0x7f3668004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.732+0000 7f3685800640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.733+0000 7f3686200640 1 -- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 msgr2=0x7f36680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.733+0000 7f3686200640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3680141c80 0x7f36680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.733+0000 7f3686200640 1 -- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3668003f60 msgr2=0x7f3668004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.733+0000 7f3686200640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3668003f60 0x7f3668004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.733+0000 7f3686200640 1 -- 172.21.15.146:0/159191364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3668003520 con 0x7f3668004d40 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f3686200640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004d40 0x7f36680051c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f367800a850 tx=0x7f3668005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3409eb9d1e702b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367800a4a0 con 0x7f3668004d40 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367802f070 con 0x7f3668004d40 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f367fe00640 1 -- 172.21.15.146:0/159191364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367802bd20 con 0x7f3668004d40 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f3688200640 1 -- 172.21.15.146:0/159191364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004d40 msgr2=0x7f36680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f3688200640 1 --2- 172.21.15.146:0/159191364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004d40 0x7f36680051c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f367800a850 tx=0x7f3668005830 comp rx=0 tx=0).stop 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f3686200640 1 -- 172.21.15.146:0/159191364 reap_dead start 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.734+0000 7f3688200640 1 -- 172.21.15.146:0/159191364 shutdown_connections 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.735+0000 7f3688200640 1 -- 172.21.15.146:0/159191364 >> 172.21.15.146:0/159191364 conn(0x7f36800b17b0 msgr2=0x7f36800b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.735+0000 7f3688200640 1 -- 172.21.15.146:0/159191364 shutdown_connections 2024-04-24T23:08:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.735+0000 7f3688200640 1 -- 172.21.15.146:0/159191364 wait complete. 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.736+0000 7f3688200640 1 Processor -- start 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.736+0000 7f3688200640 1 -- start start 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3668004d40 0x7f36801f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f368015eb00 0x7f368013b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36800cea50 con 0x7f36800cd290 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3680070f80 con 0x7f368015eb00 2024-04-24T23:08:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.737+0000 7f3688200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36800ce060 con 0x7f3668004d40 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57040/0 (socket says 172.21.15.146:57040) 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 -- 172.21.15.146:0/756461596 learned_addr learned my addr 172.21.15.146:0/756461596 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3685800640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3668004d40 0x7f36801f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3686200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f368015eb00 0x7f368013b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 -- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3668004d40 msgr2=0x7f36801f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3668004d40 0x7f36801f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 -- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f368015eb00 msgr2=0x7f368013b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f368015eb00 0x7f368013b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 -- 172.21.15.146:0/756461596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368013e540 con 0x7f36800cd290 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.738+0000 7f3684e00640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f366c011660 tx=0x7f366c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.739+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c00f960 con 0x7f36800cd290 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.739+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c00fb00 con 0x7f36800cd290 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.739+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c015460 con 0x7f36800cd290 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.739+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36800b0d10 con 0x7f36800cd290 2024-04-24T23:08:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.739+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368015f230 con 0x7f36800cd290 2024-04-24T23:08:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.740+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368013e2d0 con 0x7f36800cd290 2024-04-24T23:08:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.741+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f366c015600 con 0x7f36800cd290 2024-04-24T23:08:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.742+0000 7f367d600640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 0x7f366006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.742+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f366c08bb30 con 0x7f36800cd290 2024-04-24T23:08:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.743+0000 7f3685800640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 0x7f366006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:56.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.744+0000 7f3685800640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 0x7f366006e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3674007fd0 tx=0x7f3674009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.747+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f366c019030 con 0x7f36800cd290 2024-04-24T23:08:56.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:56.979+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f36800d06d0 con 0x7f36800cd290 2024-04-24T23:08:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.543+0000 7f367d600640 1 -- 172.21.15.146:0/756461596 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) ==== 107+0+0 (secure 0 0 0) 0x7f36800d06d0 con 0x7f36800cd290 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 msgr2=0x7f366006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 0x7f366006e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3674007fd0 tx=0x7f3674009040 comp rx=0 tx=0).stop 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 msgr2=0x7f368013ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f366c011660 tx=0x7f366c011b20 comp rx=0 tx=0).stop 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 shutdown_connections 2024-04-24T23:08:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f368015eb00 0x7f368013b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800cd290 0x7f368013ae50 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f366006be30 0x7f366006e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 --2- 172.21.15.146:0/756461596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3668004d40 0x7f36801f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 >> 172.21.15.146:0/756461596 conn(0x7f36800b17b0 msgr2=0x7f368015f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 shutdown_connections 2024-04-24T23:08:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.546+0000 7f3688200640 1 -- 172.21.15.146:0/756461596 wait complete. 2024-04-24T23:08:57.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-24T23:08:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.751+0000 7f2180a00640 1 Processor -- start 2024-04-24T23:08:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.751+0000 7f2180a00640 1 -- start start 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f2180a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f217c0d03d0 0x7f217c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f2180a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0b4df0 con 0x7f217c15cd60 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f2180a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0b4b10 con 0x7f217c15bcd0 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f2180a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f217c15c8d0 con 0x7f217c0d03d0 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f217aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f217c15cd60 0x7f217c0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60558/0 (socket says 172.21.15.146:60558) 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f217aa00640 1 -- 172.21.15.146:0/1339806100 learned_addr learned my addr 172.21.15.146:0/1339806100 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.753+0000 7f217be00640 1 --2- 172.21.15.146:0/1339806100 >> v2:172.21.15.146:3300/0 conn(0x7f217c0d03d0 0x7f217c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.754+0000 7f217a000640 1 -- 172.21.15.146:0/1339806100 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779646152 0 0) 0x7f217c0b4df0 con 0x7f217c15cd60 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.754+0000 7f217a000640 1 -- 172.21.15.146:0/1339806100 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003520 con 0x7f217c15cd60 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.754+0000 7f217be00640 1 -- 172.21.15.146:0/1339806100 >> v1:172.21.15.203:6789/0 conn(0x7f217c15bcd0 legacy=0x7f217c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.754+0000 7f217be00640 1 -- 172.21.15.146:0/1339806100 >> v1:172.21.15.146:6789/0 conn(0x7f217c15cd60 legacy=0x7f217c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.754+0000 7f217be00640 1 -- 172.21.15.146:0/1339806100 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c15c280 con 0x7f217c0d03d0 2024-04-24T23:08:57.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.755+0000 7f217be00640 1 --2- 172.21.15.146:0/1339806100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c0d03d0 0x7f217c166a80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2174009dc0 tx=0x7f217402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c56fadfd386dc20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:57.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.755+0000 7f217a000640 1 -- 172.21.15.146:0/1339806100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174007740 con 0x7f217c0d03d0 2024-04-24T23:08:57.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.755+0000 7f217a000640 1 -- 172.21.15.146:0/1339806100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21740078e0 con 0x7f217c0d03d0 2024-04-24T23:08:57.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.755+0000 7f217a000640 1 -- 172.21.15.146:0/1339806100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174007c90 con 0x7f217c0d03d0 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 -- 172.21.15.146:0/1339806100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c0d03d0 msgr2=0x7f217c166a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 --2- 172.21.15.146:0/1339806100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c0d03d0 0x7f217c166a80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2174009dc0 tx=0x7f217402a6d0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 -- 172.21.15.146:0/1339806100 shutdown_connections 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 --2- 172.21.15.146:0/1339806100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c0d03d0 0x7f217c166a80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 -- 172.21.15.146:0/1339806100 >> 172.21.15.146:0/1339806100 conn(0x7f217c06b560 msgr2=0x7f217c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 -- 172.21.15.146:0/1339806100 shutdown_connections 2024-04-24T23:08:57.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.756+0000 7f2180a00640 1 -- 172.21.15.146:0/1339806100 wait complete. 2024-04-24T23:08:57.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.757+0000 7f2180a00640 1 Processor -- start 2024-04-24T23:08:57.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.758+0000 7f2180a00640 1 -- start start 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.758+0000 7f2180a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 0x7f217c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.758+0000 7f2180a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.758+0000 7f2180a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 0x7f217c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.758+0000 7f2180a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0b4790 con 0x7f217c15bcd0 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f2180a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f217c06e590 con 0x7f217c15cd60 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f2180a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f217c166fc0 con 0x7f217c0d03d0 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57060/0 (socket says 172.21.15.146:57060) 2024-04-24T23:08:57.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 -- 172.21.15.146:0/2916626966 learned_addr learned my addr 172.21.15.146:0/2916626966 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217be00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 0x7f217c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 -- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 msgr2=0x7f217c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217b400640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 0x7f217c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 0x7f217c1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 -- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 msgr2=0x7f217c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 0x7f217c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217aa00640 1 -- 172.21.15.146:0/2916626966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c156b00 con 0x7f217c15bcd0 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217be00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 0x7f217c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.759+0000 7f217b400640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 0x7f217c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f217aa00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f216800c4d0 tx=0x7f216800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168017070 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2168005d00 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680072b0 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c156de0 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.760+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c157e00 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.761+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c04f500 con 0x7f217c15bcd0 2024-04-24T23:08:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.762+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f216801a070 con 0x7f217c15bcd0 2024-04-24T23:08:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.763+0000 7f2173400640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.763+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f216808a630 con 0x7f217c15bcd0 2024-04-24T23:08:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.764+0000 7f217b400640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.765+0000 7f217b400640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f216c003eb0 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:57.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:57.768+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2168058be0 con 0x7f217c15bcd0 2024-04-24T23:08:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.009+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f217c0cf030 con 0x7f217c15bcd0 2024-04-24T23:08:58.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.562+0000 7f2173400640 1 -- 172.21.15.146:0/2916626966 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v63) ==== 162+0+0 (secure 0 0 0) 0x7f21680584e0 con 0x7f217c15bcd0 2024-04-24T23:08:58.564 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 msgr2=0x7f215c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 0x7f215c06e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f216c003eb0 tx=0x7f216c009040 comp rx=0 tx=0).stop 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 msgr2=0x7f217c1f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f216800c4d0 tx=0x7f216800c990 comp rx=0 tx=0).stop 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 shutdown_connections 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f217c15cd60 0x7f217c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217c15bcd0 0x7f217c1f7ed0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f215c06be30 0x7f215c06e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 --2- 172.21.15.146:0/2916626966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f217c0d03d0 0x7f217c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 >> 172.21.15.146:0/2916626966 conn(0x7f217c06b560 msgr2=0x7f217c071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 shutdown_connections 2024-04-24T23:08:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.566+0000 7f2180a00640 1 -- 172.21.15.146:0/2916626966 wait complete. 2024-04-24T23:08:58.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:08:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.762+0000 7f070fe00640 1 Processor -- start 2024-04-24T23:08:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.763+0000 7f070fe00640 1 -- start start 2024-04-24T23:08:58.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0710072920 0x7f07100cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07100d0070 0x7f07100b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070fe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071015e1b0 con 0x7f071015ddd0 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f07100d04d0 con 0x7f0710072920 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f07100713b0 con 0x7f07100d0070 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f071015ddd0 0x7f0710070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44636/0 (socket says 172.21.15.146:44636) 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.764+0000 7f070ea00640 1 -- 172.21.15.146:0/2716464228 learned_addr learned my addr 172.21.15.146:0/2716464228 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f0706000640 1 --2- 172.21.15.146:0/2716464228 >> v2:172.21.15.146:3300/0 conn(0x7f0710072920 0x7f07100cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f070f400640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07100d0070 0x7f07100b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f0706000640 1 -- 172.21.15.146:0/2716464228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07100d0070 msgr2=0x7f07100b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f0706000640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07100d0070 0x7f07100b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f0706000640 1 -- 172.21.15.146:0/2716464228 >> v1:172.21.15.146:6789/0 conn(0x7f071015ddd0 legacy=0x7f0710070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f0706000640 1 -- 172.21.15.146:0/2716464228 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710071690 con 0x7f0710072920 2024-04-24T23:08:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.765+0000 7f070e000640 1 -- 172.21.15.146:0/2716464228 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080515538 0 0) 0x7f071015e1b0 con 0x7f071015ddd0 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.766+0000 7f0706000640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07100cfb30 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f06f80097a0 tx=0x7f06f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33716b6268bd2a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.766+0000 7f070e000640 1 -- 172.21.15.146:0/2716464228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8037070 con 0x7f0710072920 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.766+0000 7f070e000640 1 -- 172.21.15.146:0/2716464228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8032440 con 0x7f0710072920 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.766+0000 7f070e000640 1 -- 172.21.15.146:0/2716464228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8032810 con 0x7f0710072920 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 -- 172.21.15.146:0/2716464228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 msgr2=0x7f07100cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07100cfb30 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f06f80097a0 tx=0x7f06f802a180 comp rx=0 tx=0).stop 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 -- 172.21.15.146:0/2716464228 shutdown_connections 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07100d0070 0x7f07100b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 --2- 172.21.15.146:0/2716464228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07100cfb30 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 -- 172.21.15.146:0/2716464228 >> 172.21.15.146:0/2716464228 conn(0x7f071006b320 msgr2=0x7f071006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 -- 172.21.15.146:0/2716464228 shutdown_connections 2024-04-24T23:08:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.767+0000 7f070fe00640 1 -- 172.21.15.146:0/2716464228 wait complete. 2024-04-24T23:08:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.769+0000 7f070fe00640 1 Processor -- start 2024-04-24T23:08:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.769+0000 7f070fe00640 1 -- start start 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07100d0070 0x7f071015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f071015ddd0 0x7f071015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07100b3140 con 0x7f0710072920 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0710071c50 con 0x7f07100d0070 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f07100b32c0 con 0x7f071015ddd0 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50184/0 (socket says 172.21.15.146:50184) 2024-04-24T23:08:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 -- 172.21.15.146:0/4069787260 learned_addr learned my addr 172.21.15.146:0/4069787260 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:08:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 -- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f071015ddd0 msgr2=0x7f071015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f071015ddd0 0x7f071015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 -- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07100d0070 msgr2=0x7f071015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07100d0070 0x7f071015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.770+0000 7f070ea00640 1 -- 172.21.15.146:0/4069787260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07100cbe20 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f070ea00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f070000c430 tx=0x7f070000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700017070 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0700005ce0 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700007310 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07100cef40 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.771+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101f3cb0 con 0x7f0710072920 2024-04-24T23:08:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.772+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07101f37c0 con 0x7f0710072920 2024-04-24T23:08:58.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.773+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f070001a070 con 0x7f0710072920 2024-04-24T23:08:58.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.774+0000 7f0707e00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:58.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.774+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f070008a6a0 con 0x7f0710072920 2024-04-24T23:08:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.774+0000 7f0706000640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.775+0000 7f0706000640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034000 tx=0x7f06f802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:58.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:58.778+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0700058c50 con 0x7f0710072920 2024-04-24T23:08:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.014+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f071006ce00 con 0x7f0710072920 2024-04-24T23:08:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.015+0000 7f0707e00640 1 -- 172.21.15.146:0/4069787260 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5188 (secure 0 0 0) 0x7f0700058550 con 0x7f0710072920 2024-04-24T23:08:59.016 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:08:59.016 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:08:58.009896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-04-24T23:08:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 63 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 msgr2=0x7f06ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034000 tx=0x7f06f802c000 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 msgr2=0x7f07101f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f070000c430 tx=0x7f070000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 shutdown_connections 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f071015ddd0 0x7f071015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07100d0070 0x7f071015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 --2- 172.21.15.146:0/4069787260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0710072920 0x7f07101f0d10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 >> 172.21.15.146:0/4069787260 conn(0x7f071006b320 msgr2=0x7f0710074690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 shutdown_connections 2024-04-24T23:08:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:08:59.017+0000 7f070fe00640 1 -- 172.21.15.146:0/4069787260 wait complete. 2024-04-24T23:08:59.439 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:08:56.981468+0000', 'modified': '2024-04-24T23:08:58.009896+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6993}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_6993': {'gid': 6993, 'name': 'c', 'rank': 0, 'incarnation': 62, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.146:6834/1781418579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1781418579}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 1781418579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-24T23:08:59.439 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6993:up:reconnect 2024-04-24T23:09:00.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.696+0000 7fe3f2400640 1 Processor -- start 2024-04-24T23:09:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.696+0000 7fe3f2400640 1 -- start start 2024-04-24T23:09:00.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f2400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe3ec0709d0 0x7fe3ec15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f2400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec070f90 con 0x7fe3ec1561c0 2024-04-24T23:09:00.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f2400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe3ec0b4310 con 0x7fe3ec0d0240 2024-04-24T23:09:00.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f2400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe3ec1565a0 con 0x7fe3ec0709d0 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3ebe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f1000640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fe3ec1561c0 0x7fe3ec0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:45764/0 (socket says 172.21.15.146:45764) 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3ebe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50198/0 (socket says 172.21.15.146:50198) 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.698+0000 7fe3f1000640 1 -- 172.21.15.146:0/1302407137 learned_addr learned my addr 172.21.15.146:0/1302407137 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.699+0000 7fe3f1a00640 1 --2- 172.21.15.146:0/1302407137 >> v2:172.21.15.203:3300/0 conn(0x7fe3ec0709d0 0x7fe3ec15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.699+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1302407137 >> v2:172.21.15.203:3300/0 conn(0x7fe3ec0709d0 msgr2=0x7fe3ec15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.699+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1302407137 >> v2:172.21.15.203:3300/0 conn(0x7fe3ec0709d0 0x7fe3ec15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.699+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1302407137 >> v1:172.21.15.203:6789/0 conn(0x7fe3ec1561c0 legacy=0x7fe3ec0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.699+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1302407137 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec071270 con 0x7fe3ec0d0240 2024-04-24T23:09:00.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.700+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1302407137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec159c60 tx=0x7fe3d802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dfe3065be55e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.701+0000 7fe3eb400640 1 -- 172.21.15.146:0/1302407137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8037070 con 0x7fe3ec0d0240 2024-04-24T23:09:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.701+0000 7fe3eb400640 1 -- 172.21.15.146:0/1302407137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d802add0 con 0x7fe3ec0d0240 2024-04-24T23:09:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.701+0000 7fe3eb400640 1 -- 172.21.15.146:0/1302407137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8032660 con 0x7fe3ec0d0240 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 -- 172.21.15.146:0/1302407137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 msgr2=0x7fe3ec0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1302407137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec159c60 tx=0x7fe3d802a080 comp rx=0 tx=0).stop 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 -- 172.21.15.146:0/1302407137 shutdown_connections 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1302407137 >> v2:172.21.15.203:3300/0 conn(0x7fe3ec0709d0 0x7fe3ec15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1302407137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec0cdbf0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 -- 172.21.15.146:0/1302407137 >> 172.21.15.146:0/1302407137 conn(0x7fe3ec06b320 msgr2=0x7fe3ec06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 -- 172.21.15.146:0/1302407137 shutdown_connections 2024-04-24T23:09:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.702+0000 7fe3f2400640 1 -- 172.21.15.146:0/1302407137 wait complete. 2024-04-24T23:09:00.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.705+0000 7fe3f2400640 1 Processor -- start 2024-04-24T23:09:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.705+0000 7fe3f2400640 1 -- start start 2024-04-24T23:09:00.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 0x7fe3ec153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3ec1561c0 0x7fe3ec1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec0b2c20 con 0x7fe3ec0d0240 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec071830 con 0x7fe3ec0709d0 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.706+0000 7fe3f2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ec0b2da0 con 0x7fe3ec1561c0 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.707+0000 7fe3f1000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 0x7fe3ec153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.707+0000 7fe3f1000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 0x7fe3ec153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:60722/0 (socket says 172.21.15.146:60722) 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.707+0000 7fe3f1000640 1 -- 172.21.15.146:0/1869996852 learned_addr learned my addr 172.21.15.146:0/1869996852 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.707+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.707+0000 7fe3f1a00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3ec1561c0 0x7fe3ec1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3ec1561c0 msgr2=0x7fe3ec1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3ec1561c0 0x7fe3ec1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 msgr2=0x7fe3ec153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:00.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 0x7fe3ec153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 -- 172.21.15.146:0/1869996852 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec153540 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.708+0000 7fe3ebe00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec15d550 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8031000 tx=0x7fe3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.709+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8040020 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.709+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d8038040 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.709+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8037070 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.709+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec15dd80 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.710+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec15e340 con 0x7fe3ec0d0240 2024-04-24T23:09:00.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.711+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec1567f0 con 0x7fe3ec0d0240 2024-04-24T23:09:00.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.714+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3d8043020 con 0x7fe3ec0d0240 2024-04-24T23:09:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.715+0000 7fe3e8c00640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 0x7fe3cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:00.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.715+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fe3d80ab6a0 con 0x7fe3ec0d0240 2024-04-24T23:09:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.716+0000 7fe3f1000640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 0x7fe3cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:00.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.717+0000 7fe3f1000640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 0x7fe3cc06e370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0004e40 tx=0x7fe3e0007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:00.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.720+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3ec1567f0 con 0x7fe3ec0d0240 2024-04-24T23:09:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:00.997+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3ec06b950 con 0x7fe3ec0d0240 2024-04-24T23:09:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.003+0000 7fe3e8c00640 1 -- 172.21.15.146:0/1869996852 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5192 (secure 0 0 0) 0x7fe3d804a030 con 0x7fe3ec0d0240 2024-04-24T23:09:01.005 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:01.005 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:09:00.566872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6993,"qdb_cluster":[6993]},"id":4}]} 2024-04-24T23:09:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 65 2024-04-24T23:09:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 msgr2=0x7fe3cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 0x7fe3cc06e370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0004e40 tx=0x7fe3e0007f10 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 msgr2=0x7fe3ec15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec15d550 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8031000 tx=0x7fe3d80046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 shutdown_connections 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3cc06beb0 0x7fe3cc06e370 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3ec1561c0 0x7fe3ec1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0d0240 0x7fe3ec15d550 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 --2- 172.21.15.146:0/1869996852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3ec0709d0 0x7fe3ec153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 >> 172.21.15.146:0/1869996852 conn(0x7fe3ec06b320 msgr2=0x7fe3ec0cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.006+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 shutdown_connections 2024-04-24T23:09:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.007+0000 7fe3f2400640 1 -- 172.21.15.146:0/1869996852 wait complete. 2024-04-24T23:09:01.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:08:56.981468+0000', 'modified': '2024-04-24T23:09:00.566872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6993}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_6993': {'gid': 6993, 'name': 'c', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6834/1781418579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1781418579}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 1781418579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6993, 'qdb_cluster': [6993]} 2024-04-24T23:09:01.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:09:01.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:09:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.634+0000 7f0299000640 1 Processor -- start 2024-04-24T23:09:01.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.634+0000 7f0299000640 1 -- start start 2024-04-24T23:09:01.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f0299000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0294072960 0x7f029406f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f0299000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029406b140 0x7f029406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f0299000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0294072dc0 con 0x7f029415bcc0 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f0299000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f029406baf0 con 0x7f0294072960 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f0299000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02940afd70 con 0x7f029406b140 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.636+0000 7f028aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0294072960 0x7f029406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0294072960 0x7f029406f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50224/0 (socket says 172.21.15.146:50224) 2024-04-24T23:09:01.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 -- 172.21.15.146:0/2213932096 learned_addr learned my addr 172.21.15.146:0/2213932096 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f0293e00640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029406b140 0x7f029406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 -- 172.21.15.146:0/2213932096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029406b140 msgr2=0x7f029406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029406b140 0x7f029406b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 -- 172.21.15.146:0/2213932096 >> v1:172.21.15.203:6789/0 conn(0x7f029415bcc0 legacy=0x7f02940cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.637+0000 7f028aa00640 1 -- 172.21.15.146:0/2213932096 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02940d05d0 con 0x7f0294072960 2024-04-24T23:09:01.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.638+0000 7f028aa00640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0294072960 0x7f029406f390 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa939687f4eea16 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.638+0000 7f0292a00640 1 -- 172.21.15.146:0/2213932096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c037070 con 0x7f0294072960 2024-04-24T23:09:01.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.638+0000 7f0292a00640 1 -- 172.21.15.146:0/2213932096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c032440 con 0x7f0294072960 2024-04-24T23:09:01.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.638+0000 7f0292a00640 1 -- 172.21.15.146:0/2213932096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c032810 con 0x7f0294072960 2024-04-24T23:09:01.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 -- 172.21.15.146:0/2213932096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0294072960 msgr2=0x7f029406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0294072960 0x7f029406f390 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02a210 comp rx=0 tx=0).stop 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 -- 172.21.15.146:0/2213932096 shutdown_connections 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029406b140 0x7f029406b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 --2- 172.21.15.146:0/2213932096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0294072960 0x7f029406f390 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 -- 172.21.15.146:0/2213932096 >> 172.21.15.146:0/2213932096 conn(0x7f029406c250 msgr2=0x7f029406c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 -- 172.21.15.146:0/2213932096 shutdown_connections 2024-04-24T23:09:01.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.639+0000 7f0299000640 1 -- 172.21.15.146:0/2213932096 wait complete. 2024-04-24T23:09:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.641+0000 7f0299000640 1 Processor -- start 2024-04-24T23:09:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.641+0000 7f0299000640 1 -- start start 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0294072960 0x7f029415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029415bcc0 0x7f02941538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02940b02a0 con 0x7f029406b140 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f029406f8d0 con 0x7f0294072960 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0299000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02940d0870 con 0x7f029415bcc0 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.642+0000 7f0293400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50234/0 (socket says 172.21.15.146:50234) 2024-04-24T23:09:01.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 -- 172.21.15.146:0/868327905 learned_addr learned my addr 172.21.15.146:0/868327905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 -- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029415bcc0 msgr2=0x7f02941538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029415bcc0 0x7f02941538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f028aa00640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0294072960 0x7f029415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 -- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0294072960 msgr2=0x7f029415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0294072960 0x7f029415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 -- 172.21.15.146:0/868327905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0294149bb0 con 0x7f029406b140 2024-04-24T23:09:01.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f0293400640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f028400ba50 tx=0x7f028400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.643+0000 7f028be00640 1 -- 172.21.15.146:0/868327905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0284019070 con 0x7f029406b140 2024-04-24T23:09:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.644+0000 7f028be00640 1 -- 172.21.15.146:0/868327905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028400cc20 con 0x7f029406b140 2024-04-24T23:09:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.644+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029415ee70 con 0x7f029406b140 2024-04-24T23:09:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.644+0000 7f028be00640 1 -- 172.21.15.146:0/868327905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0284014440 con 0x7f029406b140 2024-04-24T23:09:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.644+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029406e510 con 0x7f029406b140 2024-04-24T23:09:01.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.646+0000 7f028be00640 1 -- 172.21.15.146:0/868327905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f028401c070 con 0x7f029406b140 2024-04-24T23:09:01.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.647+0000 7f028be00640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 0x7f027006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.647+0000 7f028be00640 1 -- 172.21.15.146:0/868327905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f028408aeb0 con 0x7f029406b140 2024-04-24T23:09:01.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.647+0000 7f028aa00640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 0x7f027006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.647+0000 7f029d39b740 1 Processor -- start 2024-04-24T23:09:01.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 -- start start 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacb2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacd0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c8cab87ed0 con 0x55c8cac88400 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c8cabeadf0 con 0x55c8caccffc0 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.648+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c8cab938d0 con 0x55c8cacb2720 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f028aa00640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 0x7f027006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f027c034000 tx=0x7f027c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50240/0 (socket says 172.21.15.146:50240) 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 -- 172.21.15.146:0/4256800780 learned_addr learned my addr 172.21.15.146:0/4256800780 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293400640 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacb2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f028aa00640 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacd0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 -- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 msgr2=0x55c8cacb2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacb2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 -- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 msgr2=0x55c8cacd0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacd0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.649+0000 7f0293e00640 1 -- 172.21.15.146:0/4256800780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ca8ff2d0 con 0x55c8cac88400 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f0293e00640 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f028c00a910 tx=0x7f028c00add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df779dd14e5948c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f0283e00640 1 -- 172.21.15.146:0/4256800780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c015070 con 0x55c8cac88400 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f0283e00640 1 -- 172.21.15.146:0/4256800780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c00cc00 con 0x55c8cac88400 2024-04-24T23:09:01.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f0283e00640 1 -- 172.21.15.146:0/4256800780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c004020 con 0x55c8cac88400 2024-04-24T23:09:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f029d39b740 1 -- 172.21.15.146:0/4256800780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 msgr2=0x55c8cacce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.650+0000 7f029d39b740 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f028c00a910 tx=0x7f028c00add0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 -- 172.21.15.146:0/4256800780 shutdown_connections 2024-04-24T23:09:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cac88400 0x55c8cacce680 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacd0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 --2- 172.21.15.146:0/4256800780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacb2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 -- 172.21.15.146:0/4256800780 >> 172.21.15.146:0/4256800780 conn(0x55c8cac84d30 msgr2=0x55c8caccd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 -- 172.21.15.146:0/4256800780 shutdown_connections 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 -- 172.21.15.146:0/4256800780 wait complete. 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.651+0000 7f029d39b740 1 -- start start 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.652+0000 7f029d39b740 1 Processor -- start 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacc45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacc68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c8caba6d20 con 0x55c8cace09c0 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c8cabe6db0 con 0x55c8caccffc0 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c8cac891a0 con 0x55c8cacb2720 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f029d39b740 10 client.0 _ll_register_callbacks cb 0x55c8cabe1f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:09:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50256/0 (socket says 172.21.15.146:50256) 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 -- 172.21.15.146:0/3870374558 learned_addr learned my addr 172.21.15.146:0/3870374558 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293400640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacc45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f028aa00640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacc68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 -- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 msgr2=0x55c8cacc45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacc45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 -- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 msgr2=0x55c8cacc68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacc68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.653+0000 7f0293e00640 1 -- 172.21.15.146:0/3870374558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ca9c96b0 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f0293e00640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f028c006fd0 tx=0x7f028c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd11aa6eb17843c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f0280c00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c028060 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f028c00ca00 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f028c00cc00 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.654+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f028c02e050 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 10 client.7176 fetch_fsmap learned FSMap version 65 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x55c8cacc5e50 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c00cc00 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 65) ==== 3498+0+0 (secure 0 0 0) 0x7f028c031020 con 0x55c8cace09c0 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 10 client.7176 fetch_fsmap finished waiting for FSMap version 65 2024-04-24T23:09:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 10 client.7176 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 20 client.7176 populate_metadata read hostname 'smithi146' 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacb40b0 0x55c8cacde2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 4 client.7176 mds_command: new command op to 6993 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 --> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8cabf8330 con 0x55c8cacb40b0 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.655+0000 7f0293400640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacb40b0 0x55c8cacde2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.656+0000 7f0293400640 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacb40b0 0x55c8cacde2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f836d52dcf07b90 server_cookie=d5669547ae0e6a33 in_seq=0 out_seq=0 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.656+0000 7f0280c00640 10 client.7176 ms_handle_connect on v2:172.21.15.146:6832/1781418579 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f0280c00640 1 -- 172.21.15.146:0/3870374558 <== mds.0 v2:172.21.15.146:6832/1781418579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c8cabf8330 con 0x55c8cacb40b0 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f0280c00640 10 client.7176 handle_command_reply: tid=0 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 client.7176 shutdown 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 msgr2=0x55c8cacc6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f028c006fd0 tx=0x7f028c00f000 comp rx=0 tx=0).stop 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 shutdown_connections 2024-04-24T23:09:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacb40b0 0x55c8cacde2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cacc6e10 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cacc68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 --2- 172.21.15.146:0/3870374558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8cacc45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f0280c00640 0 client.7176 ms_handle_reset on v2:172.21.15.146:6832/1781418579 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 >> 172.21.15.146:0/3870374558 conn(0x55c8cac88400 msgr2=0x55c8cacd1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 shutdown_connections 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.657+0000 7f029d39b740 1 -- 172.21.15.146:0/3870374558 wait complete. 2024-04-24T23:09:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.658+0000 7f029d39b740 20 client.7176 trim_cache size 0 max 16384 2024-04-24T23:09:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.678+0000 7f029d39b740 1 Processor -- start 2024-04-24T23:09:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.678+0000 7f029d39b740 1 -- start start 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8caccee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cac889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02942000b0 con 0x55c8cace09c0 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02941f8170 con 0x55c8caccffc0 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02941ffa20 con 0x55c8cacb2720 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f0293e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50268/0 (socket says 172.21.15.146:50268) 2024-04-24T23:09:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.679+0000 7f0293e00640 1 -- 172.21.15.146:0/1387775565 learned_addr learned my addr 172.21.15.146:0/1387775565 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293400640 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8caccee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f028aa00640 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cac889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 -- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 msgr2=0x55c8caccee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8caccee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 -- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 msgr2=0x55c8cac889d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cac889d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 -- 172.21.15.146:0/1387775565 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8cacb3750 con 0x55c8cace09c0 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0293e00640 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f028c000c00 tx=0x7f028c01c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ae40c9bd89e168 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0283400640 1 -- 172.21.15.146:0/1387775565 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c037070 con 0x55c8cace09c0 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0283400640 1 -- 172.21.15.146:0/1387775565 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c00ca00 con 0x55c8cace09c0 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.680+0000 7f0283400640 1 -- 172.21.15.146:0/1387775565 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c003870 con 0x55c8cace09c0 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 -- 172.21.15.146:0/1387775565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 msgr2=0x55c8cace6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f028c000c00 tx=0x7f028c01c070 comp rx=0 tx=0).stop 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 -- 172.21.15.146:0/1387775565 shutdown_connections 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8cace09c0 0x55c8cace6e00 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8caccffc0 0x55c8cac889d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 --2- 172.21.15.146:0/1387775565 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cacb2720 0x55c8caccee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 -- 172.21.15.146:0/1387775565 >> 172.21.15.146:0/1387775565 conn(0x55c8cac88400 msgr2=0x55c8cacb5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 -- 172.21.15.146:0/1387775565 shutdown_connections 2024-04-24T23:09:01.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.681+0000 7f029d39b740 1 -- 172.21.15.146:0/1387775565 wait complete. 2024-04-24T23:09:01.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.682+0000 7f029d39b740 1 -- start start 2024-04-24T23:09:01.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.682+0000 7f029d39b740 1 Processor -- start 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8cacb2720 0x55c8cad47730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 0x55c8cacf0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c8cacb3f30 con 0x55c8caccffc0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c8cacdea50 con 0x55c8cacb2720 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55c8cacb4580 con 0x55c8cace09c0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f029d39b740 10 client.0 _ll_register_callbacks cb 0x7f028c00a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f028aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f028aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50272/0 (socket says 172.21.15.146:50272) 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.683+0000 7f028aa00640 1 -- 172.21.15.146:0/746776213 learned_addr learned my addr 172.21.15.146:0/746776213 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0293400640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8cacb2720 0x55c8cad47730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0293e00640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 0x55c8cacf0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 -- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 msgr2=0x55c8cacf0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 0x55c8cacf0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 -- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8cacb2720 msgr2=0x55c8cad47730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8cacb2720 0x55c8cad47730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 -- 172.21.15.146:0/746776213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8cacc8320 con 0x55c8caccffc0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0293e00640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 0x55c8cacf0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f028aa00640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f027c009990 tx=0x7f027c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fab3f6968f40531 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0280c00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c04b030 con 0x55c8caccffc0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f027c03c7b0 con 0x55c8caccffc0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.684+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f028c00ca00 con 0x55c8caccffc0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f027c057050 con 0x55c8caccffc0 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 10 client.7182 fetch_fsmap learned FSMap version 65 2024-04-24T23:09:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x55c8cacdfb30 con 0x55c8caccffc0 2024-04-24T23:09:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c00ca00 con 0x55c8caccffc0 2024-04-24T23:09:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 65) ==== 3498+0+0 (secure 0 0 0) 0x7f027c05a020 con 0x55c8caccffc0 2024-04-24T23:09:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 10 client.7182 fetch_fsmap finished waiting for FSMap version 65 2024-04-24T23:09:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 10 client.7182 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:09:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 20 client.7182 populate_metadata read hostname 'smithi146' 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacf0fc0 0x55c8cac81890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 4 client.7182 mds_command: new command op to 6993 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 --> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] -- command(tid 0: {"prefix": "status"}) -- 0x55c8cabf2680 con 0x55c8cacf0fc0 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.685+0000 7f0293400640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacf0fc0 0x55c8cac81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f0293400640 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacf0fc0 0x55c8cac81890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3cb69e750017d28 server_cookie=8b8e7310bc110ef6 in_seq=0 out_seq=0 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f0280c00640 10 client.7182 ms_handle_connect on v2:172.21.15.146:6832/1781418579 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f0280c00640 1 -- 172.21.15.146:0/746776213 <== mds.0 v2:172.21.15.146:6832/1781418579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55c8cabf2680 con 0x55c8cacf0fc0 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f0280c00640 10 client.7182 handle_command_reply: tid=0 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f029d39b740 1 client.7182 shutdown 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 msgr2=0x55c8cacb0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.686+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f027c009990 tx=0x7f027c004730 comp rx=0 tx=0).stop 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 shutdown_connections 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:6832/1781418579,v1:172.21.15.146:6834/1781418579] conn(0x55c8cacf0fc0 0x55c8cac81890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55c8cace09c0 0x55c8cacf0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c8caccffc0 0x55c8cacb0df0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 --2- 172.21.15.146:0/746776213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c8cacb2720 0x55c8cad47730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f0280c00640 0 client.7182 ms_handle_reset on v2:172.21.15.146:6832/1781418579 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 >> 172.21.15.146:0/746776213 conn(0x55c8cac88400 msgr2=0x55c8cac889d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 shutdown_connections 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 1 -- 172.21.15.146:0/746776213 wait complete. 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f029d39b740 20 client.7182 trim_cache size 0 max 16384 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:09:01.691 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6993, 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.1323618, 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 65, 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 73, 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 73, 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 8.0952409070000009 2024-04-24T23:09:01.692 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 msgr2=0x7f027006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 0x7f027006e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f027c034000 tx=0x7f027c02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 msgr2=0x7f029415e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.687+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f028400ba50 tx=0x7f028400bf10 comp rx=0 tx=0).stop 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 shutdown_connections 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f027006be30 0x7f027006e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029415bcc0 0x7f02941538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0294072960 0x7f029415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 --2- 172.21.15.146:0/868327905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029406b140 0x7f029415e890 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 >> 172.21.15.146:0/868327905 conn(0x7f029406c250 msgr2=0x7f02940b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 shutdown_connections 2024-04-24T23:09:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.688+0000 7f0299000640 1 -- 172.21.15.146:0/868327905 wait complete. 2024-04-24T23:09:01.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:09:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.883+0000 7f9defe00640 1 Processor -- start 2024-04-24T23:09:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.884+0000 7f9defe00640 1 -- start start 2024-04-24T23:09:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9defe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9de80d4b60 0x7f9de80d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9defe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 0x7f9de80b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9defe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de80d0fd0 con 0x7f9de8161810 2024-04-24T23:09:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9defe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9de80d1870 con 0x7f9de80d4b60 2024-04-24T23:09:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9defe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9de80b39e0 con 0x7f9de80d2a10 2024-04-24T23:09:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.885+0000 7f9ded400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9de8161810 0x7f9de80d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44638/0 (socket says 172.21.15.146:44638) 2024-04-24T23:09:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9ded400640 1 -- 172.21.15.146:0/3243104352 learned_addr learned my addr 172.21.15.146:0/3243104352 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9dede00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 0x7f9de80b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9deca00640 1 --2- 172.21.15.146:0/3243104352 >> v2:172.21.15.203:3300/0 conn(0x7f9de80d4b60 0x7f9de80d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304172869 0 0) 0x7f9de80d0fd0 con 0x7f9de8161810 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd0003520 con 0x7f9de8161810 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4068349989 0 0) 0x7f9dd0003520 con 0x7f9de8161810 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 msgr2=0x7f9de80b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 0x7f9de80b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 >> v2:172.21.15.203:3300/0 conn(0x7f9de80d4b60 msgr2=0x7f9de80d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 --2- 172.21.15.146:0/3243104352 >> v2:172.21.15.203:3300/0 conn(0x7f9de80d4b60 0x7f9de80d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de80d12b0 con 0x7f9de8161810 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.886+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9ddc001670 con 0x7f9de8161810 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 >> v1:172.21.15.146:6789/0 conn(0x7f9de8161810 legacy=0x7f9de80d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 0x7f9dd00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dd0003f30 0x7f9dd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dd0004d40 0x7f9dd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80d1870 con 0x7f9dd0004d40 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80b39e0 con 0x7f9dd0003f30 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd000baa0 con 0x7f9de80d2a10 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dd0004d40 0x7f9dd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9deca00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dd0003f30 0x7f9dd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 -- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 msgr2=0x7f9dd00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9de80d2a10 0x7f9dd00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 -- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dd0003f30 msgr2=0x7f9dd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dd0003f30 0x7f9dd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.887+0000 7f9dede00640 1 -- 172.21.15.146:0/3243104352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0003520 con 0x7f9dd0004d40 2024-04-24T23:09:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.888+0000 7f9dede00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dd0004d40 0x7f9dd00051c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009fc0 tx=0x7f9dd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fdf019fb461f9a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.888+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009c10 con 0x7f9dd0004d40 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de0036070 con 0x7f9dd0004d40 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9de7e00640 1 -- 172.21.15.146:0/3243104352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de002d070 con 0x7f9dd0004d40 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 -- 172.21.15.146:0/3243104352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dd0004d40 msgr2=0x7f9dd00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 --2- 172.21.15.146:0/3243104352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dd0004d40 0x7f9dd00051c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009fc0 tx=0x7f9dd0005830 comp rx=0 tx=0).stop 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9dede00640 1 -- 172.21.15.146:0/3243104352 reap_dead start 2024-04-24T23:09:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 -- 172.21.15.146:0/3243104352 shutdown_connections 2024-04-24T23:09:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 -- 172.21.15.146:0/3243104352 >> 172.21.15.146:0/3243104352 conn(0x7f9de80d3ef0 msgr2=0x7f9de80d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 -- 172.21.15.146:0/3243104352 shutdown_connections 2024-04-24T23:09:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.889+0000 7f9defe00640 1 -- 172.21.15.146:0/3243104352 wait complete. 2024-04-24T23:09:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.891+0000 7f9defe00640 1 Processor -- start 2024-04-24T23:09:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.891+0000 7f9defe00640 1 -- start start 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dd0004d40 0x7f9de814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9de809ea20 0x7f9de80ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80b3ff0 con 0x7f9de809e090 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80b3e70 con 0x7f9de809ea20 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.892+0000 7f9defe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9de80b4170 con 0x7f9dd0004d40 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50284/0 (socket says 172.21.15.146:50284) 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 -- 172.21.15.146:0/3207086251 learned_addr learned my addr 172.21.15.146:0/3207086251 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9ded400640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dd0004d40 0x7f9de814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9deca00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9de809ea20 0x7f9de80ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 -- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dd0004d40 msgr2=0x7f9de814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dd0004d40 0x7f9de814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 -- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9de809ea20 msgr2=0x7f9de80ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9de809ea20 0x7f9de80ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 -- 172.21.15.146:0/3207086251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de814c130 con 0x7f9de809e090 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.893+0000 7f9dede00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9de0033040 tx=0x7f9de0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.894+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009c10 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.894+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de0003990 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.894+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0003d60 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.894+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de814c410 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.894+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de814c9d0 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.895+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8072d30 con 0x7f9de809e090 2024-04-24T23:09:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.896+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9de0005d10 con 0x7f9de809e090 2024-04-24T23:09:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.897+0000 7f9de5600640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.897+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f9de00ac2a0 con 0x7f9de809e090 2024-04-24T23:09:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.898+0000 7f9ded400640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.899+0000 7f9ded400640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 0x7f9dc806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0017e0 tx=0x7f9ddc0015f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:01.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:01.901+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9de8072d30 con 0x7f9de809e090 2024-04-24T23:09:02.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.145+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9de809ee00 con 0x7f9de809e090 2024-04-24T23:09:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.146+0000 7f9de5600640 1 -- 172.21.15.146:0/3207086251 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) ==== 53+0+73 (secure 0 0 0) 0x7f9de007a8e0 con 0x7f9de809e090 2024-04-24T23:09:02.150 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 msgr2=0x7f9dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 0x7f9dc806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0017e0 tx=0x7f9ddc0015f0 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 msgr2=0x7f9de81605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9de0033040 tx=0x7f9de0009750 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 shutdown_connections 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de809e090 0x7f9de81605a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9de809ea20 0x7f9de80ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9dc806be30 0x7f9dc806e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 --2- 172.21.15.146:0/3207086251 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dd0004d40 0x7f9de814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 >> 172.21.15.146:0/3207086251 conn(0x7f9de80d3ef0 msgr2=0x7f9de80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 shutdown_connections 2024-04-24T23:09:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02.149+0000 7f9defe00640 1 -- 172.21.15.146:0/3207086251 wait complete. 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:09:02.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:09:02.169 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:02.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.169 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:09:02.217 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:02.218 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42093sec preferred_lft 42093sec 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:09:02.219 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:09:02.220 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.221 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:09:02.292 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:09:02.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.297 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:09:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:09:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:09:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:09:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:09:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:09:02.348 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:09:02.349 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:09:02.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:09:02.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:09:02.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:09:02.349 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:09:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:09:02.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:09:02.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.554 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:09:02.603 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:09:02.604 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:09:02.605 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:02.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:09:02.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:09:02.687 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:02.734 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:02.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:09:02.734 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:02.782 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:09:02.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:02.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:02.909 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:02.909 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:09:03.478 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:03.479 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:09:03.479 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:09:03.479 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:09:03.479 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:09:03.482 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:09:03.482 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:09:03.482 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:09:03.482 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:09:03.482 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:09:03.487 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:09:03.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:03.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:03.569 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:09:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:09:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:09:03.684 INFO:teuthology.orchestra.run.smithi146.stdout:client5264 2024-04-24T23:09:03.685 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:03.685 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:03.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:03.736 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-04-24T23:09:03.867 INFO:teuthology.orchestra.run.smithi146.stdout:.: 2024-04-24T23:09:03.867 INFO:teuthology.orchestra.run.smithi146.stdout:alpha 2024-04-24T23:09:03.867 INFO:teuthology.orchestra.run.smithi146.stdout:bravo 2024-04-24T23:09:03.867 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:./alpha: 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_0 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_1 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_10 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_100 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_101 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_102 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_103 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_104 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_105 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_106 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_107 2024-04-24T23:09:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:file_108 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_109 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_11 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_110 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_111 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_112 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_113 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_114 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_115 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_116 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_117 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_118 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_119 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_12 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_120 2024-04-24T23:09:03.869 INFO:teuthology.orchestra.run.smithi146.stdout:file_121 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_122 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_123 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_124 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_125 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_126 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_127 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_128 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_129 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_13 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_130 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_131 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_132 2024-04-24T23:09:03.870 INFO:teuthology.orchestra.run.smithi146.stdout:file_133 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_134 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_135 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_136 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_137 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_138 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_139 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_14 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_140 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_141 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_142 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_143 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_144 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_145 2024-04-24T23:09:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:file_146 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_147 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_148 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_149 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_15 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_150 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_151 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_152 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_153 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_154 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_155 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_156 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_157 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_158 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_159 2024-04-24T23:09:03.872 INFO:teuthology.orchestra.run.smithi146.stdout:file_16 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_160 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_161 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_162 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_163 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_164 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_165 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_166 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_167 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_168 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_169 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_17 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_170 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_171 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_172 2024-04-24T23:09:03.873 INFO:teuthology.orchestra.run.smithi146.stdout:file_173 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_174 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_175 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_176 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_177 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_178 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_179 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_18 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_180 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_181 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_182 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_183 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_184 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_185 2024-04-24T23:09:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:file_186 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_187 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_188 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_189 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_19 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_190 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_191 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_192 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_193 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_194 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_195 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_196 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_197 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_198 2024-04-24T23:09:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:file_199 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_2 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_20 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_200 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_201 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_202 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_203 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_204 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_205 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_206 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_207 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_208 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_209 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_21 2024-04-24T23:09:03.876 INFO:teuthology.orchestra.run.smithi146.stdout:file_210 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_211 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_212 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_213 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_214 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_215 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_216 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_217 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_218 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_219 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_22 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_220 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_221 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_222 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_223 2024-04-24T23:09:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:file_224 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_225 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_226 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_227 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_228 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_229 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_23 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_230 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_231 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_232 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_233 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_234 2024-04-24T23:09:03.878 INFO:teuthology.orchestra.run.smithi146.stdout:file_235 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_236 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_237 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_238 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_239 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_24 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_240 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_241 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_242 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_243 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_244 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_245 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_246 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_247 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_248 2024-04-24T23:09:03.879 INFO:teuthology.orchestra.run.smithi146.stdout:file_249 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_25 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_250 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_251 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_252 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_253 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_254 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_255 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_256 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_257 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_258 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_259 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_26 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_260 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_261 2024-04-24T23:09:03.880 INFO:teuthology.orchestra.run.smithi146.stdout:file_262 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_263 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_264 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_265 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_266 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_267 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_268 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_269 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_27 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_270 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_271 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_272 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_273 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_274 2024-04-24T23:09:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:file_275 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_276 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_277 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_278 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_279 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_28 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_280 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_281 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_282 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_283 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_284 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_285 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_286 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_287 2024-04-24T23:09:03.882 INFO:teuthology.orchestra.run.smithi146.stdout:file_288 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_289 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_29 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_290 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_291 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_292 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_293 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_294 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_295 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_296 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_297 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_298 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_299 2024-04-24T23:09:03.883 INFO:teuthology.orchestra.run.smithi146.stdout:file_3 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_30 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_300 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_301 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_302 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_303 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_304 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_305 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_306 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_307 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_308 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_309 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_31 2024-04-24T23:09:03.884 INFO:teuthology.orchestra.run.smithi146.stdout:file_310 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_311 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_312 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_313 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_314 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_315 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_316 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_317 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_318 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_319 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_32 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_320 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_321 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_322 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_323 2024-04-24T23:09:03.885 INFO:teuthology.orchestra.run.smithi146.stdout:file_324 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_325 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_326 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_327 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_328 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_329 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_33 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_330 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_331 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_332 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_333 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_334 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_335 2024-04-24T23:09:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:file_336 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_337 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_338 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_339 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_34 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_340 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_341 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_342 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_343 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_344 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_345 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_346 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_347 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_348 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_349 2024-04-24T23:09:03.887 INFO:teuthology.orchestra.run.smithi146.stdout:file_35 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_350 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_351 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_352 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_353 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_354 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_355 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_356 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_357 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_358 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_359 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_36 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_360 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_361 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_362 2024-04-24T23:09:03.888 INFO:teuthology.orchestra.run.smithi146.stdout:file_363 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_364 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_365 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_366 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_367 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_368 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_369 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_37 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_370 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_371 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_372 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_373 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_374 2024-04-24T23:09:03.889 INFO:teuthology.orchestra.run.smithi146.stdout:file_375 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_376 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_377 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_378 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_379 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_38 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_380 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_381 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_382 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_383 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_384 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_385 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_386 2024-04-24T23:09:03.890 INFO:teuthology.orchestra.run.smithi146.stdout:file_387 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_388 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_389 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_39 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_390 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_391 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_392 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_393 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_394 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_395 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_396 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_397 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_398 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_399 2024-04-24T23:09:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:file_4 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_40 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_400 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_401 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_402 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_403 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_404 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_405 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_406 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_407 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_408 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_409 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_41 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_410 2024-04-24T23:09:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:file_411 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_412 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_413 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_414 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_415 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_416 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_417 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_418 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_419 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_42 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_420 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_421 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_422 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_423 2024-04-24T23:09:03.893 INFO:teuthology.orchestra.run.smithi146.stdout:file_424 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_425 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_426 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_427 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_428 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_429 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_43 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_430 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_431 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_432 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_433 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_434 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_435 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_436 2024-04-24T23:09:03.894 INFO:teuthology.orchestra.run.smithi146.stdout:file_437 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_438 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_439 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_44 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_440 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_441 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_442 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_443 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_444 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_445 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_446 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_447 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_448 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_449 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_45 2024-04-24T23:09:03.895 INFO:teuthology.orchestra.run.smithi146.stdout:file_450 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_451 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_452 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_453 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_454 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_455 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_456 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_457 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_458 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_459 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_46 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_460 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_461 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_462 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_463 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_464 2024-04-24T23:09:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:file_465 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_466 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_467 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_468 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_469 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_47 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_470 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_471 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_472 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_473 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_474 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_475 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_476 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_477 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_478 2024-04-24T23:09:03.897 INFO:teuthology.orchestra.run.smithi146.stdout:file_479 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_48 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_480 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_481 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_482 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_483 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_484 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_485 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_486 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_487 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_488 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_489 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_49 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_490 2024-04-24T23:09:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:file_491 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_492 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_493 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_494 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_495 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_496 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_497 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_498 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_499 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_5 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_50 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_500 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_501 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_502 2024-04-24T23:09:03.899 INFO:teuthology.orchestra.run.smithi146.stdout:file_503 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_504 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_505 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_506 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_507 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_508 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_509 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_51 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_510 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_511 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_512 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_513 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_514 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_515 2024-04-24T23:09:03.900 INFO:teuthology.orchestra.run.smithi146.stdout:file_516 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_517 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_518 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_519 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_52 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_520 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_521 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_522 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_523 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_524 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_525 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_526 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_527 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_528 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_529 2024-04-24T23:09:03.901 INFO:teuthology.orchestra.run.smithi146.stdout:file_53 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_530 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_531 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_532 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_533 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_534 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_535 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_536 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_537 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_538 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_539 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_54 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_540 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_541 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_542 2024-04-24T23:09:03.902 INFO:teuthology.orchestra.run.smithi146.stdout:file_543 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_544 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_545 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_546 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_547 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_548 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_549 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_55 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_550 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_551 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_552 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_553 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_554 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_555 2024-04-24T23:09:03.903 INFO:teuthology.orchestra.run.smithi146.stdout:file_556 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_557 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_558 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_559 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_56 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_560 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_561 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_562 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_563 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_564 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_565 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_566 2024-04-24T23:09:03.904 INFO:teuthology.orchestra.run.smithi146.stdout:file_567 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_568 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_569 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_57 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_570 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_571 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_572 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_573 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_574 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_575 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_576 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_577 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_578 2024-04-24T23:09:03.905 INFO:teuthology.orchestra.run.smithi146.stdout:file_579 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_58 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_580 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_581 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_582 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_583 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_584 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_585 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_586 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_587 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_588 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_589 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_59 2024-04-24T23:09:03.906 INFO:teuthology.orchestra.run.smithi146.stdout:file_590 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_591 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_592 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_593 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_594 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_595 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_596 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_597 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_598 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_599 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_6 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_60 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_600 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_601 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_602 2024-04-24T23:09:03.907 INFO:teuthology.orchestra.run.smithi146.stdout:file_603 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_604 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_605 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_606 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_607 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_608 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_609 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_61 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_610 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_611 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_612 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_613 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_614 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_615 2024-04-24T23:09:03.908 INFO:teuthology.orchestra.run.smithi146.stdout:file_616 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_617 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_618 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_619 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_62 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_620 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_621 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_622 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_623 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_624 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_625 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_626 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_627 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_628 2024-04-24T23:09:03.909 INFO:teuthology.orchestra.run.smithi146.stdout:file_629 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_63 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_630 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_631 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_632 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_633 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_634 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_635 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_636 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_637 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_638 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_639 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_64 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_640 2024-04-24T23:09:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:file_641 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_642 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_643 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_644 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_645 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_646 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_647 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_648 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_649 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_65 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_650 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_651 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_652 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_653 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_654 2024-04-24T23:09:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:file_655 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_656 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_657 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_658 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_659 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_66 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_660 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_661 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_662 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_663 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_664 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_665 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_666 2024-04-24T23:09:03.912 INFO:teuthology.orchestra.run.smithi146.stdout:file_667 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_668 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_669 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_67 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_670 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_671 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_672 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_673 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_674 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_675 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_676 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_677 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_678 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_679 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_68 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_680 2024-04-24T23:09:03.913 INFO:teuthology.orchestra.run.smithi146.stdout:file_681 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_682 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_683 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_684 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_685 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_686 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_687 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_688 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_689 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_69 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_690 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_691 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_692 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_693 2024-04-24T23:09:03.914 INFO:teuthology.orchestra.run.smithi146.stdout:file_694 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_695 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_696 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_697 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_698 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_699 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_7 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_70 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_700 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_701 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_702 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_703 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_704 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_705 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_706 2024-04-24T23:09:03.915 INFO:teuthology.orchestra.run.smithi146.stdout:file_707 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_708 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_709 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_71 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_710 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_711 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_712 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_713 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_714 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_715 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_716 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_717 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_718 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_719 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_72 2024-04-24T23:09:03.916 INFO:teuthology.orchestra.run.smithi146.stdout:file_720 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_721 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_722 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_723 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_724 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_725 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_726 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_727 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_728 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_729 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_73 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_730 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_731 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_732 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_733 2024-04-24T23:09:03.917 INFO:teuthology.orchestra.run.smithi146.stdout:file_734 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_735 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_736 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_737 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_738 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_739 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_74 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_740 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_741 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_742 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_743 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_744 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_745 2024-04-24T23:09:03.918 INFO:teuthology.orchestra.run.smithi146.stdout:file_746 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_747 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_748 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_749 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_75 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_750 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_751 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_752 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_753 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_754 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_755 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_756 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_757 2024-04-24T23:09:03.919 INFO:teuthology.orchestra.run.smithi146.stdout:file_758 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_759 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_76 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_760 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_761 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_762 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_763 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_764 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_765 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_766 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_767 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_768 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_769 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_77 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_770 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_771 2024-04-24T23:09:03.920 INFO:teuthology.orchestra.run.smithi146.stdout:file_772 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_773 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_774 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_775 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_776 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_777 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_778 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_779 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_78 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_780 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_781 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_782 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_783 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_784 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_785 2024-04-24T23:09:03.921 INFO:teuthology.orchestra.run.smithi146.stdout:file_786 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_787 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_788 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_789 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_79 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_790 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_791 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_792 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_793 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_794 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_795 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_796 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_797 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_798 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_799 2024-04-24T23:09:03.922 INFO:teuthology.orchestra.run.smithi146.stdout:file_8 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_80 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_800 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_801 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_802 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_803 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_804 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_805 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_806 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_807 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_808 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_809 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_81 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_810 2024-04-24T23:09:03.923 INFO:teuthology.orchestra.run.smithi146.stdout:file_811 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_812 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_813 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_814 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_815 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_816 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_817 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_818 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_819 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_82 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_820 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_821 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_822 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_823 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_824 2024-04-24T23:09:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:file_825 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_826 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_827 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_828 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_829 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_83 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_830 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_831 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_832 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_833 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_834 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_835 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_836 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_837 2024-04-24T23:09:03.925 INFO:teuthology.orchestra.run.smithi146.stdout:file_838 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_839 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_84 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_840 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_841 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_842 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_843 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_844 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_845 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_846 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_847 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_848 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_849 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_85 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_850 2024-04-24T23:09:03.926 INFO:teuthology.orchestra.run.smithi146.stdout:file_851 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_852 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_853 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_854 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_855 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_856 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_857 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_858 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_859 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_86 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_860 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_861 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_862 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_863 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_864 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_865 2024-04-24T23:09:03.927 INFO:teuthology.orchestra.run.smithi146.stdout:file_866 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_867 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_868 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_869 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_87 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_870 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_871 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_872 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_873 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_874 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_875 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_876 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_877 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_878 2024-04-24T23:09:03.928 INFO:teuthology.orchestra.run.smithi146.stdout:file_879 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_88 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_880 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_881 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_882 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_883 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_884 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_885 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_886 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_887 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_888 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_889 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_89 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_890 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_891 2024-04-24T23:09:03.929 INFO:teuthology.orchestra.run.smithi146.stdout:file_892 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_893 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_894 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_895 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_896 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_897 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_898 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_899 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_9 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_90 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_900 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_901 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_902 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_903 2024-04-24T23:09:03.930 INFO:teuthology.orchestra.run.smithi146.stdout:file_904 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_905 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_906 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_907 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_908 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_909 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_91 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_910 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_911 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_912 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_913 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_914 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_915 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_916 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_917 2024-04-24T23:09:03.931 INFO:teuthology.orchestra.run.smithi146.stdout:file_918 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_919 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_92 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_920 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_921 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_922 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_923 2024-04-24T23:09:03.932 INFO:teuthology.orchestra.run.smithi146.stdout:file_924 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_925 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_926 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_927 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_928 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_929 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_93 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_930 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_931 2024-04-24T23:09:03.961 INFO:teuthology.orchestra.run.smithi146.stdout:file_932 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_933 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_934 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_935 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_936 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_937 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_938 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_939 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_94 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_940 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_941 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_942 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_943 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_944 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_945 2024-04-24T23:09:03.962 INFO:teuthology.orchestra.run.smithi146.stdout:file_946 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_947 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_948 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_949 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_95 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_950 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_951 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_952 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_953 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_954 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_955 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_956 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_957 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_958 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_959 2024-04-24T23:09:03.963 INFO:teuthology.orchestra.run.smithi146.stdout:file_96 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_960 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_961 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_962 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_963 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_964 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_965 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_966 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_967 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_968 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_969 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_97 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_970 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_971 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_972 2024-04-24T23:09:03.964 INFO:teuthology.orchestra.run.smithi146.stdout:file_973 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_974 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_975 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_976 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_977 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_978 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_979 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_98 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_980 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_981 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_982 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_983 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_984 2024-04-24T23:09:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:file_985 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_986 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_987 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_988 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_989 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_99 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_990 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_991 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_992 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_993 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_994 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_995 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_996 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_997 2024-04-24T23:09:03.966 INFO:teuthology.orchestra.run.smithi146.stdout:file_998 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_999 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:./bravo: 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_0 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_1 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_10 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_100 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_101 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_102 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_103 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_104 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_105 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_106 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_107 2024-04-24T23:09:03.967 INFO:teuthology.orchestra.run.smithi146.stdout:file_108 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_109 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_11 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_110 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_111 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_112 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_113 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_114 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_115 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_116 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_117 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_118 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_119 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_12 2024-04-24T23:09:03.968 INFO:teuthology.orchestra.run.smithi146.stdout:file_120 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_121 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_122 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_123 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_124 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_125 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_126 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_127 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_128 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_129 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_13 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_130 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_131 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_132 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_133 2024-04-24T23:09:03.969 INFO:teuthology.orchestra.run.smithi146.stdout:file_134 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_135 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_136 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_137 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_138 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_139 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_14 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_140 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_141 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_142 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_143 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_144 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_145 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_146 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_147 2024-04-24T23:09:03.970 INFO:teuthology.orchestra.run.smithi146.stdout:file_148 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_149 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_15 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_150 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_151 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_152 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_153 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_154 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_155 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_156 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_157 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_158 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_159 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_16 2024-04-24T23:09:03.971 INFO:teuthology.orchestra.run.smithi146.stdout:file_160 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_161 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_162 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_163 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_164 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_165 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_166 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_167 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_168 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_169 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_17 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_170 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_171 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_172 2024-04-24T23:09:03.972 INFO:teuthology.orchestra.run.smithi146.stdout:file_173 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_174 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_175 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_176 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_177 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_178 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_179 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_18 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_180 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_181 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_182 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_183 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_184 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_185 2024-04-24T23:09:03.973 INFO:teuthology.orchestra.run.smithi146.stdout:file_186 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_187 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_188 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_189 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_19 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_190 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_191 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_192 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_193 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_194 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_195 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_196 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_197 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_198 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_199 2024-04-24T23:09:03.974 INFO:teuthology.orchestra.run.smithi146.stdout:file_2 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_20 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_200 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_201 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_202 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_203 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_204 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_205 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_206 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_207 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_208 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_209 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_21 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_210 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_211 2024-04-24T23:09:03.975 INFO:teuthology.orchestra.run.smithi146.stdout:file_212 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_213 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_214 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_215 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_216 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_217 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_218 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_219 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_22 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_220 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_221 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_222 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_223 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_224 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_225 2024-04-24T23:09:03.976 INFO:teuthology.orchestra.run.smithi146.stdout:file_226 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_227 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_228 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_229 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_23 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_230 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_231 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_232 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_233 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_234 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_235 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_236 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_237 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_238 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_239 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_24 2024-04-24T23:09:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:file_240 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_241 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_242 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_243 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_244 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_245 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_246 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_247 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_248 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_249 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_25 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_250 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_251 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_252 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_253 2024-04-24T23:09:03.978 INFO:teuthology.orchestra.run.smithi146.stdout:file_254 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_255 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_256 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_257 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_258 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_259 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_26 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_260 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_261 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_262 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_263 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_264 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_265 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_266 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_267 2024-04-24T23:09:03.979 INFO:teuthology.orchestra.run.smithi146.stdout:file_268 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_269 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_27 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_270 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_271 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_272 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_273 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_274 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_275 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_276 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_277 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_278 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_279 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_28 2024-04-24T23:09:03.980 INFO:teuthology.orchestra.run.smithi146.stdout:file_280 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_281 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_282 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_283 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_284 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_285 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_286 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_287 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_288 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_289 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_29 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_290 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_291 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_292 2024-04-24T23:09:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:file_293 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_294 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_295 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_296 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_297 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_298 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_299 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_3 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_30 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_300 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_301 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_302 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_303 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_304 2024-04-24T23:09:03.982 INFO:teuthology.orchestra.run.smithi146.stdout:file_305 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_306 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_307 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_308 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_309 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_31 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_310 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_311 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_312 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_313 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_314 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_315 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_316 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_317 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_318 2024-04-24T23:09:03.983 INFO:teuthology.orchestra.run.smithi146.stdout:file_319 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_32 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_320 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_321 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_322 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_323 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_324 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_325 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_326 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_327 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_328 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_329 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_33 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_330 2024-04-24T23:09:03.984 INFO:teuthology.orchestra.run.smithi146.stdout:file_331 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_332 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_333 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_334 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_335 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_336 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_337 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_338 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_339 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_34 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_340 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_341 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_342 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_343 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_344 2024-04-24T23:09:03.985 INFO:teuthology.orchestra.run.smithi146.stdout:file_345 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_346 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_347 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_348 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_349 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_35 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_350 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_351 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_352 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_353 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_354 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_355 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_356 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_357 2024-04-24T23:09:03.986 INFO:teuthology.orchestra.run.smithi146.stdout:file_358 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_359 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_36 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_360 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_361 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_362 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_363 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_364 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_365 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_366 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_367 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_368 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_369 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_37 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_370 2024-04-24T23:09:03.987 INFO:teuthology.orchestra.run.smithi146.stdout:file_371 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_372 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_373 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_374 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_375 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_376 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_377 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_378 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_379 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_38 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_380 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_381 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_382 2024-04-24T23:09:03.988 INFO:teuthology.orchestra.run.smithi146.stdout:file_383 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_384 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_385 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_386 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_387 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_388 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_389 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_39 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_390 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_391 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_392 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_393 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_394 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_395 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_396 2024-04-24T23:09:03.989 INFO:teuthology.orchestra.run.smithi146.stdout:file_397 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_398 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_399 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_4 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_40 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_400 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_401 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_402 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_403 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_404 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_405 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_406 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_407 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_408 2024-04-24T23:09:03.990 INFO:teuthology.orchestra.run.smithi146.stdout:file_409 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_41 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_410 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_411 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_412 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_413 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_414 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_415 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_416 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_417 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_418 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_419 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_42 2024-04-24T23:09:03.991 INFO:teuthology.orchestra.run.smithi146.stdout:file_420 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_421 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_422 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_423 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_424 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_425 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_426 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_427 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_428 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_429 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_43 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_430 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_431 2024-04-24T23:09:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:file_432 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_433 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_434 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_435 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_436 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_437 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_438 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_439 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_44 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_440 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_441 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_442 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_443 2024-04-24T23:09:03.993 INFO:teuthology.orchestra.run.smithi146.stdout:file_444 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_445 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_446 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_447 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_448 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_449 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_45 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_450 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_451 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_452 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_453 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_454 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_455 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_456 2024-04-24T23:09:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:file_457 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_458 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_459 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_46 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_460 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_461 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_462 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_463 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_464 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_465 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_466 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_467 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_468 2024-04-24T23:09:03.995 INFO:teuthology.orchestra.run.smithi146.stdout:file_469 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_47 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_470 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_471 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_472 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_473 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_474 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_475 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_476 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_477 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_478 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_479 2024-04-24T23:09:03.996 INFO:teuthology.orchestra.run.smithi146.stdout:file_48 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_480 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_481 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_482 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_483 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_484 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_485 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_486 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_487 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_488 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_489 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_49 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_490 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_491 2024-04-24T23:09:03.997 INFO:teuthology.orchestra.run.smithi146.stdout:file_492 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_493 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_494 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_495 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_496 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_497 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_498 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_499 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_5 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_50 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_500 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_501 2024-04-24T23:09:03.998 INFO:teuthology.orchestra.run.smithi146.stdout:file_502 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_503 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_504 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_505 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_506 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_507 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_508 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_509 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_51 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_510 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_511 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_512 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_513 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_514 2024-04-24T23:09:04.002 INFO:teuthology.orchestra.run.smithi146.stdout:file_515 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_516 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_517 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_518 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_519 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_52 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_520 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_521 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_522 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_523 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_524 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_525 2024-04-24T23:09:04.003 INFO:teuthology.orchestra.run.smithi146.stdout:file_526 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_527 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_528 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_529 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_53 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_530 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_531 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_532 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_533 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_534 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_535 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_536 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_537 2024-04-24T23:09:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:file_538 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_539 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_54 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_540 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_541 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_542 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_543 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_544 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_545 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_546 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_547 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_548 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_549 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_55 2024-04-24T23:09:04.005 INFO:teuthology.orchestra.run.smithi146.stdout:file_550 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_551 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_552 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_553 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_554 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_555 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_556 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_557 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_558 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_559 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_56 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_560 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_561 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_562 2024-04-24T23:09:04.006 INFO:teuthology.orchestra.run.smithi146.stdout:file_563 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_564 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_565 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_566 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_567 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_568 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_569 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_57 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_570 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_571 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_572 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_573 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_574 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_575 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_576 2024-04-24T23:09:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:file_577 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_578 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_579 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_58 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_580 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_581 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_582 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_583 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_584 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_585 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_586 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_587 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_588 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_589 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_59 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_590 2024-04-24T23:09:04.008 INFO:teuthology.orchestra.run.smithi146.stdout:file_591 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_592 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_593 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_594 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_595 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_596 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_597 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_598 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_599 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_6 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_60 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_600 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_601 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_602 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_603 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_604 2024-04-24T23:09:04.009 INFO:teuthology.orchestra.run.smithi146.stdout:file_605 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_606 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_607 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_608 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_609 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_61 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_610 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_611 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_612 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_613 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_614 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_615 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_616 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_617 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_618 2024-04-24T23:09:04.010 INFO:teuthology.orchestra.run.smithi146.stdout:file_619 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_62 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_620 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_621 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_622 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_623 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_624 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_625 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_626 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_627 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_628 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_629 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_63 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_630 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_631 2024-04-24T23:09:04.011 INFO:teuthology.orchestra.run.smithi146.stdout:file_632 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_633 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_634 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_635 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_636 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_637 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_638 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_639 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_64 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_640 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_641 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_642 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_643 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_644 2024-04-24T23:09:04.012 INFO:teuthology.orchestra.run.smithi146.stdout:file_645 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_646 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_647 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_648 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_649 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_65 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_650 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_651 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_652 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_653 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_654 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_655 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_656 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_657 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_658 2024-04-24T23:09:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:file_659 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_66 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_660 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_661 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_662 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_663 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_664 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_665 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_666 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_667 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_668 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_669 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_67 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_670 2024-04-24T23:09:04.014 INFO:teuthology.orchestra.run.smithi146.stdout:file_671 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_672 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_673 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_674 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_675 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_676 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_677 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_678 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_679 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_68 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_680 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_681 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_682 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_683 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_684 2024-04-24T23:09:04.015 INFO:teuthology.orchestra.run.smithi146.stdout:file_685 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_686 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_687 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_688 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_689 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_69 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_690 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_691 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_692 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_693 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_694 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_695 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_696 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_697 2024-04-24T23:09:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:file_698 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_699 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_7 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_70 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_700 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_701 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_702 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_703 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_704 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_705 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_706 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_707 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_708 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_709 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_71 2024-04-24T23:09:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:file_710 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_711 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_712 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_713 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_714 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_715 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_716 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_717 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_718 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_719 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_72 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_720 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_721 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_722 2024-04-24T23:09:04.018 INFO:teuthology.orchestra.run.smithi146.stdout:file_723 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_724 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_725 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_726 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_727 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_728 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_729 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_73 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_730 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_731 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_732 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_733 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_734 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_735 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_736 2024-04-24T23:09:04.019 INFO:teuthology.orchestra.run.smithi146.stdout:file_737 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_738 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_739 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_74 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_740 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_741 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_742 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_743 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_744 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_745 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_746 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_747 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_748 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_749 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_75 2024-04-24T23:09:04.020 INFO:teuthology.orchestra.run.smithi146.stdout:file_750 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_751 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_752 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_753 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_754 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_755 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_756 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_757 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_758 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_759 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_76 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_760 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_761 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_762 2024-04-24T23:09:04.021 INFO:teuthology.orchestra.run.smithi146.stdout:file_763 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_764 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_765 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_766 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_767 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_768 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_769 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_77 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_770 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_771 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_772 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_773 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_774 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_775 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_776 2024-04-24T23:09:04.022 INFO:teuthology.orchestra.run.smithi146.stdout:file_777 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_778 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_779 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_78 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_780 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_781 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_782 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_783 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_784 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_785 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_786 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_787 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_788 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_789 2024-04-24T23:09:04.023 INFO:teuthology.orchestra.run.smithi146.stdout:file_79 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_790 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_791 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_792 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_793 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_794 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_795 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_796 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_797 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_798 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_799 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_8 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_80 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_800 2024-04-24T23:09:04.024 INFO:teuthology.orchestra.run.smithi146.stdout:file_801 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_802 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_803 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_804 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_805 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_806 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_807 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_808 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_809 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_81 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_810 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_811 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_812 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_813 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_814 2024-04-24T23:09:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:file_815 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_816 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_817 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_818 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_819 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_82 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_820 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_821 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_822 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_823 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_824 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_825 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_826 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_827 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_828 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_829 2024-04-24T23:09:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:file_83 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_830 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_831 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_832 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_833 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_834 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_835 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_836 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_837 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_838 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_839 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_84 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_840 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_841 2024-04-24T23:09:04.027 INFO:teuthology.orchestra.run.smithi146.stdout:file_842 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_843 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_844 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_845 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_846 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_847 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_848 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_849 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_85 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_850 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_851 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_852 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_853 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_854 2024-04-24T23:09:04.028 INFO:teuthology.orchestra.run.smithi146.stdout:file_855 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_856 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_857 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_858 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_859 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_86 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_860 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_861 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_862 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_863 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_864 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_865 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_866 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_867 2024-04-24T23:09:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:file_868 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_869 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_87 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_870 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_871 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_872 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_873 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_874 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_875 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_876 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_877 2024-04-24T23:09:04.030 INFO:teuthology.orchestra.run.smithi146.stdout:file_878 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_879 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_88 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_880 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_881 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_882 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_883 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_884 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_885 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_886 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_887 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_888 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_889 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_89 2024-04-24T23:09:04.031 INFO:teuthology.orchestra.run.smithi146.stdout:file_890 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_891 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_892 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_893 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_894 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_895 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_896 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_897 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_898 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_899 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_9 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_90 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_900 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_901 2024-04-24T23:09:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:file_902 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_903 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_904 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_905 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_906 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_907 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_908 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_909 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_91 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_910 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_911 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_912 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_913 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_914 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_915 2024-04-24T23:09:04.033 INFO:teuthology.orchestra.run.smithi146.stdout:file_916 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_917 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_918 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_919 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_92 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_920 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_921 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_922 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_923 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_924 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_925 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_926 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_927 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_928 2024-04-24T23:09:04.034 INFO:teuthology.orchestra.run.smithi146.stdout:file_929 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_93 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_930 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_931 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_932 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_933 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_934 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_935 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_936 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_937 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_938 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_939 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_94 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_940 2024-04-24T23:09:04.035 INFO:teuthology.orchestra.run.smithi146.stdout:file_941 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_942 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_943 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_944 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_945 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_946 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_947 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_948 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_949 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_95 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_950 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_951 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_952 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_953 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_954 2024-04-24T23:09:04.036 INFO:teuthology.orchestra.run.smithi146.stdout:file_955 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_956 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_957 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_958 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_959 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_96 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_960 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_961 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_962 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_963 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_964 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_965 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_966 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_967 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_968 2024-04-24T23:09:04.037 INFO:teuthology.orchestra.run.smithi146.stdout:file_969 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_97 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_970 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_971 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_972 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_973 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_974 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_975 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_976 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_977 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_978 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_979 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_98 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_980 2024-04-24T23:09:04.038 INFO:teuthology.orchestra.run.smithi146.stdout:file_981 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_982 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_983 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_984 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_985 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_986 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_987 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_988 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_989 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_99 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_990 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_991 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_992 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_993 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_994 2024-04-24T23:09:04.039 INFO:teuthology.orchestra.run.smithi146.stdout:file_995 2024-04-24T23:09:04.040 INFO:teuthology.orchestra.run.smithi146.stdout:file_996 2024-04-24T23:09:04.040 INFO:teuthology.orchestra.run.smithi146.stdout:file_997 2024-04-24T23:09:04.040 INFO:teuthology.orchestra.run.smithi146.stdout:file_998 2024-04-24T23:09:04.040 INFO:teuthology.orchestra.run.smithi146.stdout:file_999 2024-04-24T23:09:04.041 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:09:04.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:04.153 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:04.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:09:04.267 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:04.268 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:04.268 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:04.326 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:04.327 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:04.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.623+0000 7f0906600640 1 Processor -- start 2024-04-24T23:09:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.624+0000 7f0906600640 1 -- start start 2024-04-24T23:09:04.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f0906600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09000d0fd0 0x7f09000b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f0906600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f09000cece0 0x7f090015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f0906600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09000cc240 con 0x7f09000b3180 2024-04-24T23:09:04.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f0906600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f09000b3560 con 0x7f09000d0fd0 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f0906600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f09000cc520 con 0x7f09000cece0 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.625+0000 7f08ffe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09000d0fd0 0x7f09000b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09000d0fd0 0x7f09000b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50294/0 (socket says 172.21.15.146:50294) 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 -- 172.21.15.146:0/2496440857 learned_addr learned my addr 172.21.15.146:0/2496440857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 -- 172.21.15.146:0/2496440857 >> v2:172.21.15.203:3300/0 conn(0x7f09000cece0 msgr2=0x7f090015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 --2- 172.21.15.146:0/2496440857 >> v2:172.21.15.203:3300/0 conn(0x7f09000cece0 0x7f090015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 -- 172.21.15.146:0/2496440857 >> v1:172.21.15.146:6789/0 conn(0x7f09000b3180 legacy=0x7f09000ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.626+0000 7f08ffe00640 1 -- 172.21.15.146:0/2496440857 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09000cc800 con 0x7f09000d0fd0 2024-04-24T23:09:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.627+0000 7f08ffe00640 1 --2- 172.21.15.146:0/2496440857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f09000b4a40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f090006e420 tx=0x7f08e802a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd1b0192bbbbd2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.627+0000 7f08ff400640 1 -- 172.21.15.146:0/2496440857 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8036070 con 0x7f09000d0fd0 2024-04-24T23:09:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f08ff400640 1 -- 172.21.15.146:0/2496440857 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e8031600 con 0x7f09000d0fd0 2024-04-24T23:09:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f08ff400640 1 -- 172.21.15.146:0/2496440857 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e80319d0 con 0x7f09000d0fd0 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 -- 172.21.15.146:0/2496440857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 msgr2=0x7f09000b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 --2- 172.21.15.146:0/2496440857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f09000b4a40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f090006e420 tx=0x7f08e802a6b0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 -- 172.21.15.146:0/2496440857 shutdown_connections 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 --2- 172.21.15.146:0/2496440857 >> v2:172.21.15.203:3300/0 conn(0x7f09000cece0 0x7f090015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 --2- 172.21.15.146:0/2496440857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f09000b4a40 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 -- 172.21.15.146:0/2496440857 >> 172.21.15.146:0/2496440857 conn(0x7f09000d1bf0 msgr2=0x7f09000d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 -- 172.21.15.146:0/2496440857 shutdown_connections 2024-04-24T23:09:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.628+0000 7f0906600640 1 -- 172.21.15.146:0/2496440857 wait complete. 2024-04-24T23:09:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.630+0000 7f0906600640 1 Processor -- start 2024-04-24T23:09:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.630+0000 7f0906600640 1 -- start start 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09000b3180 0x7f0900156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09000cece0 0x7f09001f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f090006c460 con 0x7f09000d0fd0 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f09000ccdc0 con 0x7f09000cece0 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.631+0000 7f0906600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f090006c5e0 con 0x7f09000b3180 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50304/0 (socket says 172.21.15.146:50304) 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 -- 172.21.15.146:0/3303423963 learned_addr learned my addr 172.21.15.146:0/3303423963 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:04.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f08ffe00640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09000cece0 0x7f09001f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:04.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905200640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09000b3180 0x7f0900156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 -- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09000b3180 msgr2=0x7f0900156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09000b3180 0x7f0900156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 -- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09000cece0 msgr2=0x7f09001f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09000cece0 0x7f09001f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.632+0000 7f0905c00640 1 -- 172.21.15.146:0/3303423963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090015bde0 con 0x7f09000d0fd0 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f0905c00640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f08f800b3f0 tx=0x7f08f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8015020 con 0x7f09000d0fd0 2024-04-24T23:09:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8011830 con 0x7f09000d0fd0 2024-04-24T23:09:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011c20 con 0x7f09000d0fd0 2024-04-24T23:09:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09001f84e0 con 0x7f09000d0fd0 2024-04-24T23:09:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.633+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090015c080 con 0x7f09000d0fd0 2024-04-24T23:09:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.634+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090004f500 con 0x7f09000d0fd0 2024-04-24T23:09:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.635+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08f8018020 con 0x7f09000d0fd0 2024-04-24T23:09:04.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.636+0000 7f08fcc00640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 0x7f08dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:04.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.636+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f08f808b1e0 con 0x7f09000d0fd0 2024-04-24T23:09:04.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.637+0000 7f0905200640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 0x7f08dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:04.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.638+0000 7f0905200640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 0x7f08dc06e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08f0001640 tx=0x7f08f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:04.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.641+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08f801f020 con 0x7f09000d0fd0 2024-04-24T23:09:04.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.841+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09000ce8b0 con 0x7f09000d0fd0 2024-04-24T23:09:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.843+0000 7f08fcc00640 1 -- 172.21.15.146:0/3303423963 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+17684 (secure 0 0 0) 0x7f08f80172c0 con 0x7f09000d0fd0 2024-04-24T23:09:04.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:04.845 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":73,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:08:54.973054+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.34","mappings":[{"from":2,"to":7}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.203:6835/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.203:6837/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 msgr2=0x7f08dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 0x7f08dc06e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08f0001640 tx=0x7f08f0009040 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 msgr2=0x7f090015c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f08f800b3f0 tx=0x7f08f800b8b0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 shutdown_connections 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000d0fd0 0x7f090015c880 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09000cece0 0x7f09001f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f08dc06be30 0x7f08dc06e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 --2- 172.21.15.146:0/3303423963 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09000b3180 0x7f0900156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.845+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 >> 172.21.15.146:0/3303423963 conn(0x7f09000d1bf0 msgr2=0x7f09000c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.846+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 shutdown_connections 2024-04-24T23:09:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:04.846+0000 7f0906600640 1 -- 172.21.15.146:0/3303423963 wait complete. 2024-04-24T23:09:04.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:07:06.558364+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:07:07.805671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:04.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.061+0000 7f106c800640 1 Processor -- start 2024-04-24T23:09:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.061+0000 7f106c800640 1 -- start start 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f10640cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106c800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1064071b30 0x7f1064150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106c800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f106415b530 con 0x7f106415ed20 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106c800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f10640cf8d0 con 0x7f1064071b30 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f106415b810 con 0x7f106406ec10 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f106a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1064071b30 0x7f1064150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f1069400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f106415ed20 0x7f1064071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44654/0 (socket says 172.21.15.146:44654) 2024-04-24T23:09:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f1069400640 1 -- 172.21.15.146:0/2677597177 learned_addr learned my addr 172.21.15.146:0/2677597177 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.063+0000 7f1069e00640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f10640cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.064+0000 7f106a800640 1 -- 172.21.15.146:0/2677597177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 msgr2=0x7f10640cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.064+0000 7f106a800640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f10640cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.064+0000 7f106a800640 1 -- 172.21.15.146:0/2677597177 >> v1:172.21.15.146:6789/0 conn(0x7f106415ed20 legacy=0x7f1064071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.064+0000 7f106a800640 1 -- 172.21.15.146:0/2677597177 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106415e240 con 0x7f1064071b30 2024-04-24T23:09:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.064+0000 7f1068a00640 1 -- 172.21.15.146:0/2677597177 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271888984 0 0) 0x7f106415b530 con 0x7f106415ed20 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f106a800640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f1064150cd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f106000a940 tx=0x7f106002b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32266257a36bea88 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f1068a00640 1 -- 172.21.15.146:0/2677597177 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000b040 con 0x7f1064071b30 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f1068a00640 1 -- 172.21.15.146:0/2677597177 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060030710 con 0x7f1064071b30 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f1068a00640 1 -- 172.21.15.146:0/2677597177 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060030ae0 con 0x7f1064071b30 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f106c800640 1 -- 172.21.15.146:0/2677597177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 msgr2=0x7f1064150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.065+0000 7f106c800640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f1064150cd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f106000a940 tx=0x7f106002b4c0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 -- 172.21.15.146:0/2677597177 shutdown_connections 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f1064150cd0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 --2- 172.21.15.146:0/2677597177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f10640cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 -- 172.21.15.146:0/2677597177 >> 172.21.15.146:0/2677597177 conn(0x7f10640b17b0 msgr2=0x7f10640b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 -- 172.21.15.146:0/2677597177 shutdown_connections 2024-04-24T23:09:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.066+0000 7f106c800640 1 -- 172.21.15.146:0/2677597177 wait complete. 2024-04-24T23:09:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.068+0000 7f106c800640 1 Processor -- start 2024-04-24T23:09:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.068+0000 7f106c800640 1 -- start start 2024-04-24T23:09:05.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f1064149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415ed20 0x7f1064159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f10640b4b00 con 0x7f1064071b30 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f106415e800 con 0x7f106415ed20 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10640b4c80 con 0x7f106406ec10 2024-04-24T23:09:05.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50312/0 (socket says 172.21.15.146:50312) 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 -- 172.21.15.146:0/3220594636 learned_addr learned my addr 172.21.15.146:0/3220594636 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069e00640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f1064149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f106a800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415ed20 0x7f1064159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 -- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 msgr2=0x7f1064149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f1064149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.069+0000 7f1069400640 1 -- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415ed20 msgr2=0x7f1064159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f1069400640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415ed20 0x7f1064159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f1069400640 1 -- 172.21.15.146:0/3220594636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106415da20 con 0x7f1064071b30 2024-04-24T23:09:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f1069e00640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f1064149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:05.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f1069400640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f105400c430 tx=0x7f105400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10540074e0 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10540047e0 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106415c980 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054004bd0 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.070+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f106415d220 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.071+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106404f5a0 con 0x7f1064071b30 2024-04-24T23:09:05.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.072+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1054011070 con 0x7f1064071b30 2024-04-24T23:09:05.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.073+0000 7f105a000640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 0x7f104806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.073+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f105408aec0 con 0x7f1064071b30 2024-04-24T23:09:05.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.074+0000 7f1069e00640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 0x7f104806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.075+0000 7f1069e00640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 0x7f104806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f105c007eb0 tx=0x7f105c007400 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.078+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f105400e280 con 0x7f1064071b30 2024-04-24T23:09:05.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.277+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10640b2fc0 con 0x7f1064071b30 2024-04-24T23:09:05.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.278+0000 7f105a000640 1 -- 172.21.15.146:0/3220594636 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f1054059470 con 0x7f1064071b30 2024-04-24T23:09:05.279 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 msgr2=0x7f104806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 0x7f104806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f105c007eb0 tx=0x7f105c007400 comp rx=0 tx=0).stop 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 msgr2=0x7f10640b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f105400c430 tx=0x7f105400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 shutdown_connections 2024-04-24T23:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f106415ed20 0x7f1064159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1064071b30 0x7f10640b0990 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f104806be30 0x7f104806e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 --2- 172.21.15.146:0/3220594636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f106406ec10 0x7f1064149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 >> 172.21.15.146:0/3220594636 conn(0x7f10640b17b0 msgr2=0x7f1064154710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 shutdown_connections 2024-04-24T23:09:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.281+0000 7f106c800640 1 -- 172.21.15.146:0/3220594636 wait complete. 2024-04-24T23:09:05.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:09:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.510+0000 7f5862600640 1 Processor -- start 2024-04-24T23:09:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.510+0000 7f5862600640 1 -- start start 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f5862600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f585c166d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f5862600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c0ced40 con 0x7f585c13ef30 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f5862600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c0cf020 con 0x7f585c141c80 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f5862600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f585c1423d0 con 0x7f585c072420 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f585b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f585c13ef30 0x7f585c141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44664/0 (socket says 172.21.15.146:44664) 2024-04-24T23:09:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f585b400640 1 -- 172.21.15.146:0/3422962468 learned_addr learned my addr 172.21.15.146:0/3422962468 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f585be00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f585c166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48462634 0 0) 0x7f585c0ced40 con 0x7f585c13ef30 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.512+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5840003520 con 0x7f585c13ef30 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827748485 0 0) 0x7f5840003520 con 0x7f585c13ef30 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 msgr2=0x7f585c166d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f585c166d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 >> v1:172.21.15.203:6789/0 conn(0x7f585c141c80 legacy=0x7f585c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c0cf300 con 0x7f585c13ef30 2024-04-24T23:09:05.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f584c001670 con 0x7f585c13ef30 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 >> v1:172.21.15.146:6789/0 conn(0x7f585c13ef30 legacy=0x7f585c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f58400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f5840004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5840004d40 0x7f58400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f584000b9f0 con 0x7f5840003f20 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f584000bba0 con 0x7f5840004d40 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f584000bda0 con 0x7f585c072420 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.513+0000 7f585aa00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f5840004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585b400640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f58400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585be00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5840004d40 0x7f58400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585aa00640 1 -- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 msgr2=0x7f58400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585aa00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c072420 0x7f58400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585aa00640 1 -- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5840004d40 msgr2=0x7f58400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:05.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585aa00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5840004d40 0x7f58400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585aa00640 1 -- 172.21.15.146:0/3422962468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5840003520 con 0x7f5840003f20 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.514+0000 7f585be00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5840004d40 0x7f58400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.515+0000 7f585aa00640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f5840004800 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5848001860 tx=0x7f5840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350c8be2c1365255 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.515+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848037070 con 0x7f5840003f20 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.515+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584802ab60 con 0x7f5840003f20 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.515+0000 7f585a000640 1 -- 172.21.15.146:0/3422962468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848001430 con 0x7f5840003f20 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 -- 172.21.15.146:0/3422962468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 msgr2=0x7f5840004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 --2- 172.21.15.146:0/3422962468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f5840004800 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5848001860 tx=0x7f5840005830 comp rx=0 tx=0).stop 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f585be00640 1 -- 172.21.15.146:0/3422962468 reap_dead start 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 -- 172.21.15.146:0/3422962468 shutdown_connections 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 -- 172.21.15.146:0/3422962468 >> 172.21.15.146:0/3422962468 conn(0x7f585c0b17b0 msgr2=0x7f585c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 -- 172.21.15.146:0/3422962468 shutdown_connections 2024-04-24T23:09:05.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.516+0000 7f5862600640 1 -- 172.21.15.146:0/3422962468 wait complete. 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.518+0000 7f5862600640 1 Processor -- start 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.518+0000 7f5862600640 1 -- start start 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c13c7d0 0x7f585c13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c140360 0x7f585c1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f585c0ce770 con 0x7f5840003f20 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f585c070f80 con 0x7f585c13c7d0 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f5862600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f585c0ce8f0 con 0x7f585c140360 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f585b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f585b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50322/0 (socket says 172.21.15.146:50322) 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.519+0000 7f585b400640 1 -- 172.21.15.146:0/2540446461 learned_addr learned my addr 172.21.15.146:0/2540446461 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 -- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c140360 msgr2=0x7f585c1407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c140360 0x7f585c1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 -- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c13c7d0 msgr2=0x7f585c13a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c13c7d0 0x7f585c13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 -- 172.21.15.146:0/2540446461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c13e050 con 0x7f5840003f20 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f585b400640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f584c00e860 tx=0x7f584c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c00ee50 con 0x7f5840003f20 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584c018070 con 0x7f5840003f20 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c13cfb0 con 0x7f5840003f20 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c00ca90 con 0x7f5840003f20 2024-04-24T23:09:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.520+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c13d570 con 0x7f5840003f20 2024-04-24T23:09:05.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.521+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c04f5a0 con 0x7f5840003f20 2024-04-24T23:09:05.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.522+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f584c00cc30 con 0x7f5840003f20 2024-04-24T23:09:05.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.524+0000 7f5853400640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 0x7f583c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.524+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f584c08af80 con 0x7f5840003f20 2024-04-24T23:09:05.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.525+0000 7f585aa00640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 0x7f583c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.526+0000 7f585aa00640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 0x7f583c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5848034000 tx=0x7f584802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.529+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f584c0595c0 con 0x7f5840003f20 2024-04-24T23:09:05.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.731+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f585c072d30 con 0x7f5840003f20 2024-04-24T23:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.732+0000 7f5853400640 1 -- 172.21.15.146:0/2540446461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) ==== 104+0+11 (secure 0 0 0) 0x7f584c058ec0 con 0x7f5840003f20 2024-04-24T23:09:05.733 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.734+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 msgr2=0x7f583c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.734+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 0x7f583c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5848034000 tx=0x7f584802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.734+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 msgr2=0x7f585c154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.734+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f584c00e860 tx=0x7f584c00ed20 comp rx=0 tx=0).stop 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 shutdown_connections 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f583c06be30 0x7f583c06e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f585c140360 0x7f585c1407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f585c13c7d0 0x7f585c13a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 --2- 172.21.15.146:0/2540446461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5840003f20 0x7f585c154bd0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 >> 172.21.15.146:0/2540446461 conn(0x7f585c0b17b0 msgr2=0x7f585c0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:05.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 shutdown_connections 2024-04-24T23:09:05.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.735+0000 7f5862600640 1 -- 172.21.15.146:0/2540446461 wait complete. 2024-04-24T23:09:05.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:09:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.961+0000 7fcc47200640 1 Processor -- start 2024-04-24T23:09:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.961+0000 7fcc47200640 1 -- start start 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc47200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4013ef30 0x7fcc40141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc47200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc400ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc47200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc400ced40 con 0x7fcc400ce5a0 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc47200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcc401423d0 con 0x7fcc4013ef30 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc47200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc40070f80 con 0x7fcc40141ab0 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc3fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4013ef30 0x7fcc40141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc3fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4013ef30 0x7fcc40141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50324/0 (socket says 172.21.15.146:50324) 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.963+0000 7fcc3fe00640 1 -- 172.21.15.146:0/1245268601 learned_addr learned my addr 172.21.15.146:0/1245268601 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3f400640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc400ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3fe00640 1 -- 172.21.15.146:0/1245268601 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 msgr2=0x7fcc400ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:05.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3fe00640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc400ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3fe00640 1 -- 172.21.15.146:0/1245268601 >> v1:172.21.15.146:6789/0 conn(0x7fcc400ce5a0 legacy=0x7fcc4015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3fe00640 1 -- 172.21.15.146:0/1245268601 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc400cf020 con 0x7fcc4013ef30 2024-04-24T23:09:05.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3f400640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc400ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:05.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.964+0000 7fcc3ea00640 1 -- 172.21.15.146:0/1245268601 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223929777 0 0) 0x7fcc400ced40 con 0x7fcc400ce5a0 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.965+0000 7fcc3fe00640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40141570 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009e50 tx=0x7fcc3002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31953f11b4a51bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.965+0000 7fcc3ea00640 1 -- 172.21.15.146:0/1245268601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30036070 con 0x7fcc4013ef30 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.965+0000 7fcc3ea00640 1 -- 172.21.15.146:0/1245268601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30031600 con 0x7fcc4013ef30 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.965+0000 7fcc3ea00640 1 -- 172.21.15.146:0/1245268601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc300319d0 con 0x7fcc4013ef30 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 -- 172.21.15.146:0/1245268601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 msgr2=0x7fcc40141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40141570 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009e50 tx=0x7fcc3002a710 comp rx=0 tx=0).stop 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 -- 172.21.15.146:0/1245268601 shutdown_connections 2024-04-24T23:09:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc400ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 --2- 172.21.15.146:0/1245268601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40141570 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 -- 172.21.15.146:0/1245268601 >> 172.21.15.146:0/1245268601 conn(0x7fcc400b17b0 msgr2=0x7fcc400b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:05.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 -- 172.21.15.146:0/1245268601 shutdown_connections 2024-04-24T23:09:05.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.966+0000 7fcc47200640 1 -- 172.21.15.146:0/1245268601 wait complete. 2024-04-24T23:09:05.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.968+0000 7fcc47200640 1 Processor -- start 2024-04-24T23:09:05.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.968+0000 7fcc47200640 1 -- start start 2024-04-24T23:09:05.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc400ce5a0 0x7fcc40144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc40142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc400cea30 con 0x7fcc4013ef30 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc40070c10 con 0x7fcc400ce5a0 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc47200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc40072420 con 0x7fcc40141ab0 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc3f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc3f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50338/0 (socket says 172.21.15.146:50338) 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc3f400640 1 -- 172.21.15.146:0/4175419779 learned_addr learned my addr 172.21.15.146:0/4175419779 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.969+0000 7fcc3fe00640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc400ce5a0 0x7fcc40144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc45200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc40142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 -- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 msgr2=0x7fcc40142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc40142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 -- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc400ce5a0 msgr2=0x7fcc40144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:05.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc400ce5a0 0x7fcc40144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:05.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 -- 172.21.15.146:0/4175419779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4013da20 con 0x7fcc4013ef30 2024-04-24T23:09:05.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc45200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc40142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc3f400640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c7f0 tx=0x7fcc2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28015070 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28007820 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28007bd0 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.970+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc401430d0 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.971+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc40143690 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.972+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc4004f5a0 con 0x7fcc4013ef30 2024-04-24T23:09:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.973+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc28018070 con 0x7fcc4013ef30 2024-04-24T23:09:05.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.974+0000 7fcc37e00640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 0x7fcc1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:05.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.974+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fcc2808b360 con 0x7fcc4013ef30 2024-04-24T23:09:05.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.974+0000 7fcc3fe00640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 0x7fcc1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:05.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.976+0000 7fcc3fe00640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 0x7fcc1c06e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcc30033000 tx=0x7fcc30009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:05.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:05.979+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc28059910 con 0x7fcc4013ef30 2024-04-24T23:09:06.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.178+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcc4006cc70 con 0x7fcc4013ef30 2024-04-24T23:09:06.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.179+0000 7fcc37e00640 1 -- 172.21.15.146:0/4175419779 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) ==== 100+0+11 (secure 0 0 0) 0x7fcc28059210 con 0x7fcc4013ef30 2024-04-24T23:09:06.180 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:09:06.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.181+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 msgr2=0x7fcc1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.181+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 0x7fcc1c06e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcc30033000 tx=0x7fcc30009000 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.181+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 msgr2=0x7fcc40142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.181+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c7f0 tx=0x7fcc2800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 shutdown_connections 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc1c06be30 0x7fcc1c06e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc40141ab0 0x7fcc40142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4013ef30 0x7fcc40142560 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 --2- 172.21.15.146:0/4175419779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc400ce5a0 0x7fcc40144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 >> 172.21.15.146:0/4175419779 conn(0x7fcc400b17b0 msgr2=0x7fcc4006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 shutdown_connections 2024-04-24T23:09:06.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.182+0000 7fcc47200640 1 -- 172.21.15.146:0/4175419779 wait complete. 2024-04-24T23:09:06.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:09:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.405+0000 7fe8fda00640 1 Processor -- start 2024-04-24T23:09:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.406+0000 7fe8fda00640 1 -- start start 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.407+0000 7fe8fda00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 0x7fe8f80c7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.407+0000 7fe8fda00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8f80d0eb0 0x7fe8f80b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.407+0000 7fe8fda00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f80cf9e0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.407+0000 7fe8fda00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80cfcc0 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.407+0000 7fe8fda00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80b6d80 con 0x7fe8f80b5480 2024-04-24T23:09:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8f7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8f80b50a0 0x7fe8f80d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44690/0 (socket says 172.21.15.146:44690) 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8f7e00640 1 -- 172.21.15.146:0/1230555457 learned_addr learned my addr 172.21.15.146:0/1230555457 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8fd000640 1 --2- 172.21.15.146:0/1230555457 >> v2:172.21.15.146:3300/0 conn(0x7fe8f80d0eb0 0x7fe8f80b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8f7400640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 0x7fe8f80c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8fd000640 1 -- 172.21.15.146:0/1230555457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 msgr2=0x7fe8f80c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8fd000640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 0x7fe8f80c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8fd000640 1 -- 172.21.15.146:0/1230555457 >> v1:172.21.15.146:6789/0 conn(0x7fe8f80b50a0 legacy=0x7fe8f80d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8fd000640 1 -- 172.21.15.146:0/1230555457 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80b7060 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8f6a00640 1 -- 172.21.15.146:0/1230555457 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005100026 0 0) 0x7fe8f80cf9e0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.408+0000 7fe8f7400640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 0x7fe8f80c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.409+0000 7fe8fd000640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80d0eb0 0x7fe8f80b7580 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d716b3f74aab1929 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.409+0000 7fe8f6a00640 1 -- 172.21.15.146:0/1230555457 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0037070 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.409+0000 7fe8f6a00640 1 -- 172.21.15.146:0/1230555457 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f0032440 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8f6a00640 1 -- 172.21.15.146:0/1230555457 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0032810 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 -- 172.21.15.146:0/1230555457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80d0eb0 msgr2=0x7fe8f80b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80d0eb0 0x7fe8f80b7580 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002a180 comp rx=0 tx=0).stop 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 -- 172.21.15.146:0/1230555457 shutdown_connections 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80d0eb0 0x7fe8f80b7580 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 --2- 172.21.15.146:0/1230555457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80b5480 0x7fe8f80c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 -- 172.21.15.146:0/1230555457 >> 172.21.15.146:0/1230555457 conn(0x7fe8f80d3d90 msgr2=0x7fe8f80d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 -- 172.21.15.146:0/1230555457 shutdown_connections 2024-04-24T23:09:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.410+0000 7fe8fda00640 1 -- 172.21.15.146:0/1230555457 wait complete. 2024-04-24T23:09:06.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.412+0000 7fe8fda00640 1 Processor -- start 2024-04-24T23:09:06.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.412+0000 7fe8fda00640 1 -- start start 2024-04-24T23:09:06.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8f80b5480 0x7fe8f80a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 0x7fe8f80b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80cf5c0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80cf440 con 0x7fe8f80b5480 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.413+0000 7fe8fda00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80cf740 con 0x7fe8f80d0eb0 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50354/0 (socket says 172.21.15.146:50354) 2024-04-24T23:09:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 -- 172.21.15.146:0/3624342111 learned_addr learned my addr 172.21.15.146:0/3624342111 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8fd000640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 0x7fe8f80b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7400640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8f80b5480 0x7fe8f80a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 -- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 msgr2=0x7fe8f80b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 0x7fe8f80b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 -- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8f80b5480 msgr2=0x7fe8f80a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8f80b5480 0x7fe8f80a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 -- 172.21.15.146:0/3624342111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80a1400 con 0x7fe8f80b50a0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8fd000640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 0x7fe8f80b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.414+0000 7fe8f7e00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c890 tx=0x7fe8e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.415+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8018070 con 0x7fe8f80b50a0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.415+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e800a640 con 0x7fe8f80b50a0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.415+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800aa30 con 0x7fe8f80b50a0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.415+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f80a16e0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.415+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f80cc2c0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.416+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f804f500 con 0x7fe8f80b50a0 2024-04-24T23:09:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.417+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8e800abd0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.418+0000 7fe8efe00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 0x7fe8d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.418+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fe8e808a8c0 con 0x7fe8f80b50a0 2024-04-24T23:09:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.419+0000 7fe8f7400640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 0x7fe8d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.420+0000 7fe8f7400640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 0x7fe8d406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8161d20 tx=0x7fe8e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.422+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe8e8058e70 con 0x7fe8f80b50a0 2024-04-24T23:09:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.636+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8f80b7e30 con 0x7fe8f80b50a0 2024-04-24T23:09:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.637+0000 7fe8efe00640 1 -- 172.21.15.146:0/3624342111 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v73) ==== 80+0+368 (secure 0 0 0) 0x7fe8e8058770 con 0x7fe8f80b50a0 2024-04-24T23:09:06.638 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6834/381160219 2024-04-25T23:08:53.528060+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6832/381160219 2024-04-25T23:08:53.528060+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.203:6835/4094476555 2024-04-25T23:08:54.973021+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6834/896278918 2024-04-25T23:07:41.602501+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.203:6837/4094476555 2024-04-25T23:08:54.973021+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6832/896278918 2024-04-25T23:07:41.602501+0000 2024-04-24T23:09:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:listed 6 entries 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 msgr2=0x7fe8d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 0x7fe8d406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8161d20 tx=0x7fe8e0008040 comp rx=0 tx=0).stop 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 msgr2=0x7fe8f8159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c890 tx=0x7fe8e800cd50 comp rx=0 tx=0).stop 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 shutdown_connections 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe8d406be30 0x7fe8d406e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8f80d0eb0 0x7fe8f80b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8f80b5480 0x7fe8f80a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 --2- 172.21.15.146:0/3624342111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f80b50a0 0x7fe8f8159210 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 >> 172.21.15.146:0/3624342111 conn(0x7fe8f80d3d90 msgr2=0x7fe8f80b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 shutdown_connections 2024-04-24T23:09:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:06.640+0000 7fe8fda00640 1 -- 172.21.15.146:0/3624342111 wait complete. 2024-04-24T23:09:06.660 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:09:06.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:06.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:06.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:09:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:06.788 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:09:06.840 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:06.840 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:06.840 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:06.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:06.898 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:06.898 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:06.898 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:06.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:06.956 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:06.956 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:06.956 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:07.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:07.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:07.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.215+0000 7f68e4600640 1 Processor -- start 2024-04-24T23:09:07.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.215+0000 7f68e4600640 1 -- start start 2024-04-24T23:09:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.217+0000 7f68e4600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 0x7f68dc0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.217+0000 7f68e4600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f68dc0d03a0 0x7f68dc071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.217+0000 7f68e4600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68dc1662b0 con 0x7f68dc14be80 2024-04-24T23:09:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.217+0000 7f68e4600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f68dc14bc30 con 0x7f68dc0d03a0 2024-04-24T23:09:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.217+0000 7f68e4600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc166590 con 0x7f68dc14b850 2024-04-24T23:09:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.218+0000 7f68e1c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 0x7f68dc0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.218+0000 7f68e2600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f68dc0d03a0 0x7f68dc071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.218+0000 7f68e1200640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f68dc14be80 0x7f68dc0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:45792/0 (socket says 172.21.15.146:45792) 2024-04-24T23:09:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.218+0000 7f68e1200640 1 -- 172.21.15.146:0/921873594 learned_addr learned my addr 172.21.15.146:0/921873594 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.219+0000 7f68e2600640 1 -- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 msgr2=0x7f68dc0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.219+0000 7f68e2600640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 0x7f68dc0b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.219+0000 7f68e2600640 1 -- 172.21.15.146:0/921873594 >> v1:172.21.15.203:6789/0 conn(0x7f68dc14be80 legacy=0x7f68dc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.219+0000 7f68e2600640 1 -- 172.21.15.146:0/921873594 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc166870 con 0x7f68dc0d03a0 2024-04-24T23:09:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.219+0000 7f68e1c00640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 0x7f68dc0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:09:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.220+0000 7f68e2600640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc0d03a0 0x7f68dc071150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009d90 tx=0x7f68d402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adb686b09dc53b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68dbe00640 1 -- 172.21.15.146:0/921873594 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4031600 con 0x7f68dc0d03a0 2024-04-24T23:09:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68dbe00640 1 -- 172.21.15.146:0/921873594 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d40317a0 con 0x7f68dc0d03a0 2024-04-24T23:09:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68dbe00640 1 -- 172.21.15.146:0/921873594 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4031b70 con 0x7f68dc0d03a0 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 -- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc0d03a0 msgr2=0x7f68dc071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc0d03a0 0x7f68dc071150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009d90 tx=0x7f68d402a5d0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 -- 172.21.15.146:0/921873594 shutdown_connections 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc0d03a0 0x7f68dc071150 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 --2- 172.21.15.146:0/921873594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14b850 0x7f68dc0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.221+0000 7f68e4600640 1 -- 172.21.15.146:0/921873594 >> 172.21.15.146:0/921873594 conn(0x7f68dc06b320 msgr2=0x7f68dc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.222+0000 7f68e4600640 1 -- 172.21.15.146:0/921873594 shutdown_connections 2024-04-24T23:09:07.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.222+0000 7f68e4600640 1 -- 172.21.15.146:0/921873594 wait complete. 2024-04-24T23:09:07.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.223+0000 7f68e4600640 1 Processor -- start 2024-04-24T23:09:07.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.223+0000 7f68e4600640 1 -- start start 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 0x7f68dc1ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14be80 0x7f68dc0aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc166070 con 0x7f68dc0d03a0 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc165ef0 con 0x7f68dc14b850 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.224+0000 7f68e4600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc071690 con 0x7f68dc14be80 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50370/0 (socket says 172.21.15.146:50370) 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 -- 172.21.15.146:0/3234652842 learned_addr learned my addr 172.21.15.146:0/3234652842 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1200640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 0x7f68dc1ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e2600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14be80 0x7f68dc0aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 -- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14be80 msgr2=0x7f68dc0aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14be80 0x7f68dc0aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 -- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 msgr2=0x7f68dc1ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 0x7f68dc1ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1c00640 1 -- 172.21.15.146:0/3234652842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc1ec650 con 0x7f68dc0d03a0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.225+0000 7f68e1200640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 0x7f68dc1ebb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68e1c00640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f68d000ebe0 tx=0x7f68d000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0017070 con 0x7f68dc0d03a0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d000cc30 con 0x7f68dc0d03a0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0013470 con 0x7f68dc0d03a0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc1ec930 con 0x7f68dc0d03a0 2024-04-24T23:09:07.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.226+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc1f9a40 con 0x7f68dc0d03a0 2024-04-24T23:09:07.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.227+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc068b80 con 0x7f68dc0d03a0 2024-04-24T23:09:07.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.228+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68d001a070 con 0x7f68dc0d03a0 2024-04-24T23:09:07.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.229+0000 7f68d9600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 0x7f68bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.229+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f68d008b560 con 0x7f68dc0d03a0 2024-04-24T23:09:07.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.230+0000 7f68e1200640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 0x7f68bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.231+0000 7f68e1200640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 0x7f68bc06e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f68dc147580 tx=0x7f68c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.234+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f68dc068b80 con 0x7f68dc0d03a0 2024-04-24T23:09:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.470+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68dc0b1280 con 0x7f68dc0d03a0 2024-04-24T23:09:07.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.471+0000 7f68d9600640 1 -- 172.21.15.146:0/3234652842 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5192 (secure 0 0 0) 0x7f68dc0b1280 con 0x7f68dc0d03a0 2024-04-24T23:09:07.472 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:07.472 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:09:00.566872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6993,"qdb_cluster":[6993]},"id":4}]} 2024-04-24T23:09:07.473 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 65 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.473+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 msgr2=0x7f68bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.473+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 0x7f68bc06e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f68dc147580 tx=0x7f68c8009040 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.473+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 msgr2=0x7f68dc149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.473+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f68d000ebe0 tx=0x7f68d000c520 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 shutdown_connections 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f68bc06be60 0x7f68bc06e320 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68dc14be80 0x7f68dc0aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68dc14b850 0x7f68dc1ebb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 --2- 172.21.15.146:0/3234652842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68dc0d03a0 0x7f68dc149980 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 >> 172.21.15.146:0/3234652842 conn(0x7f68dc06b320 msgr2=0x7f68dc1464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:07.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 shutdown_connections 2024-04-24T23:09:07.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.474+0000 7f68e4600640 1 -- 172.21.15.146:0/3234652842 wait complete. 2024-04-24T23:09:07.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:07.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.686+0000 7f363a000640 1 Processor -- start 2024-04-24T23:09:07.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.686+0000 7f363a000640 1 -- start start 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f363a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f36340d03a0 0x7f36340b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f363a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3634071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f363a000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36341662b0 con 0x7f363414b850 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f363a000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f363414bc30 con 0x7f36340d03a0 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f363a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3634166590 con 0x7f363414be80 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f3633400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f363414b850 0x7f36340cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44704/0 (socket says 172.21.15.146:44704) 2024-04-24T23:09:07.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.688+0000 7f3633400640 1 -- 172.21.15.146:0/2905168238 learned_addr learned my addr 172.21.15.146:0/2905168238 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:07.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026714218 0 0) 0x7f36341662b0 con 0x7f363414b850 2024-04-24T23:09:07.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632a00640 1 --2- 172.21.15.146:0/2905168238 >> v2:172.21.15.203:3300/0 conn(0x7f36340d03a0 0x7f36340b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3618003520 con 0x7f363414b850 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3633e00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3634071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73142595 0 0) 0x7f3618003520 con 0x7f363414b850 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 msgr2=0x7f3634071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3634071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 >> v2:172.21.15.203:3300/0 conn(0x7f36340d03a0 msgr2=0x7f36340b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 --2- 172.21.15.146:0/2905168238 >> v2:172.21.15.203:3300/0 conn(0x7f36340d03a0 0x7f36340b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3634166870 con 0x7f363414b850 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f3624001670 con 0x7f363414b850 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632a00640 1 --2- 172.21.15.146:0/2905168238 >> v2:172.21.15.203:3300/0 conn(0x7f36340d03a0 0x7f36340b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 >> v1:172.21.15.146:6789/0 conn(0x7f363414b850 legacy=0x7f36340cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36180039b0 0x7f3618003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3618004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3618004d40 0x7f36180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f363414bc30 con 0x7f3618004d40 2024-04-24T23:09:07.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3634166590 con 0x7f36180039b0 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f361800bb20 con 0x7f363414be80 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.689+0000 7f3633e00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3618004d40 0x7f36180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633400640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36180039b0 0x7f3618003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3632a00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3618004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633e00640 1 -- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 msgr2=0x7f3618004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633e00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f363414be80 0x7f3618004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633e00640 1 -- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36180039b0 msgr2=0x7f3618003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633e00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36180039b0 0x7f3618003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.690+0000 7f3633e00640 1 -- 172.21.15.146:0/2905168238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3618003520 con 0x7f3618004d40 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.691+0000 7f3633e00640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3618004d40 0x7f36180051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f362c007360 tx=0x7f3618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce606a61fe524a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.691+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c009be0 con 0x7f3618004d40 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.691+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c036600 con 0x7f3618004d40 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.691+0000 7f3632000640 1 -- 172.21.15.146:0/2905168238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0369d0 con 0x7f3618004d40 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 -- 172.21.15.146:0/2905168238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3618004d40 msgr2=0x7f36180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 --2- 172.21.15.146:0/2905168238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3618004d40 0x7f36180051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f362c007360 tx=0x7f3618005830 comp rx=0 tx=0).stop 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f3633e00640 1 -- 172.21.15.146:0/2905168238 reap_dead start 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 -- 172.21.15.146:0/2905168238 shutdown_connections 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 -- 172.21.15.146:0/2905168238 >> 172.21.15.146:0/2905168238 conn(0x7f363406b320 msgr2=0x7f363406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 -- 172.21.15.146:0/2905168238 shutdown_connections 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.692+0000 7f363a000640 1 -- 172.21.15.146:0/2905168238 wait complete. 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.694+0000 7f363a000640 1 Processor -- start 2024-04-24T23:09:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.694+0000 7f363a000640 1 -- start start 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3618004d40 0x7f3634164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36341f7c30 0x7f3634148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3634166070 con 0x7f3634149310 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3634165ef0 con 0x7f3618004d40 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f363a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3634071150 con 0x7f36341f7c30 2024-04-24T23:09:07.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f3633e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f3633e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50392/0 (socket says 172.21.15.146:50392) 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.695+0000 7f3633e00640 1 -- 172.21.15.146:0/4136681570 learned_addr learned my addr 172.21.15.146:0/4136681570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3632a00640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36341f7c30 0x7f3634148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633400640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3618004d40 0x7f3634164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 -- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36341f7c30 msgr2=0x7f3634148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36341f7c30 0x7f3634148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 -- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3618004d40 msgr2=0x7f3634164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3618004d40 0x7f3634164d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 -- 172.21.15.146:0/4136681570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3634147d30 con 0x7f3634149310 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f3633e00640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f362c02e620 tx=0x7f362c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c045070 con 0x7f3634149310 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c003990 con 0x7f3634149310 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3634148010 con 0x7f3634149310 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.696+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c036e60 con 0x7f3634149310 2024-04-24T23:09:07.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.697+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36341485d0 con 0x7f3634149310 2024-04-24T23:09:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.698+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3634068190 con 0x7f3634149310 2024-04-24T23:09:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.699+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f362c02e890 con 0x7f3634149310 2024-04-24T23:09:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.700+0000 7f362b400640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 0x7f361006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.700+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f362c0ab930 con 0x7f3634149310 2024-04-24T23:09:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.700+0000 7f3633400640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 0x7f361006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:07.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.701+0000 7f3633400640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 0x7f361006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3624001050 tx=0x7f3624009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:07.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.704+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f362c03d070 con 0x7f3634149310 2024-04-24T23:09:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.902+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f363406e770 con 0x7f3634149310 2024-04-24T23:09:07.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.905+0000 7f362b400640 1 -- 172.21.15.146:0/4136681570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+17684 (secure 0 0 0) 0x7f362c032030 con 0x7f3634149310 2024-04-24T23:09:07.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:07.907 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":73,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:08:54.973054+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.34","mappings":[{"from":2,"to":7}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.203:6835/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.203:6837/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 msgr2=0x7f361006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 0x7f361006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3624001050 tx=0x7f3624009040 comp rx=0 tx=0).stop 2024-04-24T23:09:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 msgr2=0x7f3634155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f362c02e620 tx=0x7f362c004ab0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 shutdown_connections 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3634149310 0x7f3634155550 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f361006be30 0x7f361006e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36341f7c30 0x7f3634148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 --2- 172.21.15.146:0/4136681570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3618004d40 0x7f3634164d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 >> 172.21.15.146:0/4136681570 conn(0x7f363406b320 msgr2=0x7f3634146be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 shutdown_connections 2024-04-24T23:09:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:07.908+0000 7f363a000640 1 -- 172.21.15.146:0/4136681570 wait complete. 2024-04-24T23:09:07.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:07:06.558364+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:07:07.805671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:07.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.125+0000 7f282bc00640 1 Processor -- start 2024-04-24T23:09:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.125+0000 7f282bc00640 1 -- start start 2024-04-24T23:09:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 0x7f28240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28240ce5a0 0x7f282415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f28241423d0 con 0x7f28240ce5a0 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2824070f80 con 0x7f2824141ab0 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f282bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28240ced40 con 0x7f282413ef30 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28240ce5a0 0x7f282415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28240ce5a0 0x7f282415fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40376/0 (socket says 172.21.15.146:40376) 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 -- 172.21.15.146:0/2664551174 learned_addr learned my addr 172.21.15.146:0/2664551174 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f281be00640 1 --2- 172.21.15.146:0/2664551174 >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 0x7f28240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829200640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 -- 172.21.15.146:0/2664551174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 msgr2=0x7f2824141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 -- 172.21.15.146:0/2664551174 >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 msgr2=0x7f28240ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 --2- 172.21.15.146:0/2664551174 >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 0x7f28240ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.127+0000 7f2829c00640 1 -- 172.21.15.146:0/2664551174 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28240cf020 con 0x7f28240ce5a0 2024-04-24T23:09:08.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.128+0000 7f281be00640 1 --2- 172.21.15.146:0/2664551174 >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 0x7f28240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.128+0000 7f2829c00640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f282415fa00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f282406c3a0 tx=0x7f281c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ad796a4748ae61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f2823e00640 1 -- 172.21.15.146:0/2664551174 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c036070 con 0x7f28240ce5a0 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f2823e00640 1 -- 172.21.15.146:0/2664551174 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c031600 con 0x7f28240ce5a0 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f2823e00640 1 -- 172.21.15.146:0/2664551174 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c0319d0 con 0x7f28240ce5a0 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 -- 172.21.15.146:0/2664551174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 msgr2=0x7f282415fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f282415fa00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f282406c3a0 tx=0x7f281c02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 -- 172.21.15.146:0/2664551174 shutdown_connections 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f282415fa00 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 --2- 172.21.15.146:0/2664551174 >> v2:172.21.15.203:3300/0 conn(0x7f2824141ab0 0x7f28240ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 --2- 172.21.15.146:0/2664551174 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.129+0000 7f282bc00640 1 -- 172.21.15.146:0/2664551174 >> 172.21.15.146:0/2664551174 conn(0x7f28240b17b0 msgr2=0x7f28240b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:08.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.130+0000 7f282bc00640 1 -- 172.21.15.146:0/2664551174 shutdown_connections 2024-04-24T23:09:08.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.130+0000 7f282bc00640 1 -- 172.21.15.146:0/2664551174 wait complete. 2024-04-24T23:09:08.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.131+0000 7f282bc00640 1 Processor -- start 2024-04-24T23:09:08.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.131+0000 7f282bc00640 1 -- start start 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2824141ab0 0x7f282406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28240cea30 con 0x7f28240ce5a0 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2824070c10 con 0x7f2824141ab0 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f282bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f282415ff40 con 0x7f282413ef30 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f2829200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f2829200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40390/0 (socket says 172.21.15.146:40390) 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.132+0000 7f2829200640 1 -- 172.21.15.146:0/2265364638 learned_addr learned my addr 172.21.15.146:0/2265364638 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 -- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 msgr2=0x7f2824130220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 -- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2824141ab0 msgr2=0x7f282406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2824141ab0 0x7f282406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 -- 172.21.15.146:0/2265364638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282413a580 con 0x7f28240ce5a0 2024-04-24T23:09:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2829200640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c7f0 tx=0x7f280c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c015070 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c004240 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282413c8b0 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c007620 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.133+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282413baf0 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.134+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282404f5a0 con 0x7f28240ce5a0 2024-04-24T23:09:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.135+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f280c0077c0 con 0x7f28240ce5a0 2024-04-24T23:09:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.136+0000 7f2821600640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 0x7f280006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.136+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f280c08b470 con 0x7f28240ce5a0 2024-04-24T23:09:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.137+0000 7f281be00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 0x7f280006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.138+0000 7f281be00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 0x7f280006e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2814006b10 tx=0x7f2814008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.141+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f282413a580 con 0x7f28240ce5a0 2024-04-24T23:09:08.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.322+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2824072d30 con 0x7f28240ce5a0 2024-04-24T23:09:08.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.323+0000 7f2821600640 1 -- 172.21.15.146:0/2265364638 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f280c059a20 con 0x7f28240ce5a0 2024-04-24T23:09:08.324 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 msgr2=0x7f280006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 0x7f280006e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2814006b10 tx=0x7f2814008040 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 msgr2=0x7f28240a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c7f0 tx=0x7f280c00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 shutdown_connections 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2824141ab0 0x7f282406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f280006be30 0x7f280006e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f282413ef30 0x7f2824130220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 --2- 172.21.15.146:0/2265364638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28240ce5a0 0x7f28240a9ec0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.325+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 >> 172.21.15.146:0/2265364638 conn(0x7f28240b17b0 msgr2=0x7f2824140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.326+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 shutdown_connections 2024-04-24T23:09:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.326+0000 7f282bc00640 1 -- 172.21.15.146:0/2265364638 wait complete. 2024-04-24T23:09:08.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:09:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.539+0000 7fe817200640 1 Processor -- start 2024-04-24T23:09:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.539+0000 7fe817200640 1 -- start start 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe81015e010 0x7fe81006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe810071520 0x7fe8100719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe81006e620 0x7fe81006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe81015e3f0 con 0x7fe810071520 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe81006cd20 con 0x7fe81006e620 2024-04-24T23:09:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe817200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe81015f440 con 0x7fe81015e010 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe80f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe810071520 0x7fe8100719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe80f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe810071520 0x7fe8100719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40394/0 (socket says 172.21.15.146:40394) 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.541+0000 7fe80f400640 1 -- 172.21.15.146:0/3030468509 learned_addr learned my addr 172.21.15.146:0/3030468509 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80fe00640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe81015e010 0x7fe81006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe815200640 1 --2- 172.21.15.146:0/3030468509 >> v2:172.21.15.203:3300/0 conn(0x7fe81006e620 0x7fe81006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80f400640 1 -- 172.21.15.146:0/3030468509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe81015e010 msgr2=0x7fe81006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80f400640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe81015e010 0x7fe81006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80f400640 1 -- 172.21.15.146:0/3030468509 >> v2:172.21.15.203:3300/0 conn(0x7fe81006e620 msgr2=0x7fe81006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80f400640 1 --2- 172.21.15.146:0/3030468509 >> v2:172.21.15.203:3300/0 conn(0x7fe81006e620 0x7fe81006eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.542+0000 7fe80f400640 1 -- 172.21.15.146:0/3030468509 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810071fe0 con 0x7fe810071520 2024-04-24T23:09:08.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.543+0000 7fe80f400640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe810071520 0x7fe8100719a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe810071ee0 tx=0x7fe7fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e725c4bf261595 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.543+0000 7fe80ea00640 1 -- 172.21.15.146:0/3030468509 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc037070 con 0x7fe810071520 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.543+0000 7fe80ea00640 1 -- 172.21.15.146:0/3030468509 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc032440 con 0x7fe810071520 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.543+0000 7fe80ea00640 1 -- 172.21.15.146:0/3030468509 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc032810 con 0x7fe810071520 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 -- 172.21.15.146:0/3030468509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe810071520 msgr2=0x7fe8100719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe810071520 0x7fe8100719a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe810071ee0 tx=0x7fe7fc02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 -- 172.21.15.146:0/3030468509 shutdown_connections 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe810071520 0x7fe8100719a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 --2- 172.21.15.146:0/3030468509 >> v2:172.21.15.203:3300/0 conn(0x7fe81006e620 0x7fe81006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 --2- 172.21.15.146:0/3030468509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe81015e010 0x7fe81006dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 -- 172.21.15.146:0/3030468509 >> 172.21.15.146:0/3030468509 conn(0x7fe8100b17b0 msgr2=0x7fe8100b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 -- 172.21.15.146:0/3030468509 shutdown_connections 2024-04-24T23:09:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.544+0000 7fe817200640 1 -- 172.21.15.146:0/3030468509 wait complete. 2024-04-24T23:09:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.546+0000 7fe817200640 1 Processor -- start 2024-04-24T23:09:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.546+0000 7fe817200640 1 -- start start 2024-04-24T23:09:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe81006e620 0x7fe8100b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 0x7fe810147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe81006d580 con 0x7fe81015e010 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe81006d2a0 con 0x7fe81006e620 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe817200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe81006d860 con 0x7fe810071520 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe815200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe815200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40396/0 (socket says 172.21.15.146:40396) 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe815200640 1 -- 172.21.15.146:0/13322488 learned_addr learned my addr 172.21.15.146:0/13322488 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.547+0000 7fe80fe00640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe81006e620 0x7fe8100b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe80f400640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 0x7fe810147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 -- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 msgr2=0x7fe810147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 0x7fe810147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 -- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe81006e620 msgr2=0x7fe8100b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe81006e620 0x7fe8100b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 -- 172.21.15.146:0/13322488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810148980 con 0x7fe81015e010 2024-04-24T23:09:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe80f400640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 0x7fe810147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe815200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe808007d20 tx=0x7fe80800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808014420 con 0x7fe81015e010 2024-04-24T23:09:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808019070 con 0x7fe81015e010 2024-04-24T23:09:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8101f7d10 con 0x7fe81015e010 2024-04-24T23:09:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.548+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808014820 con 0x7fe81015e010 2024-04-24T23:09:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.549+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101f3fb0 con 0x7fe81015e010 2024-04-24T23:09:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.550+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81004f5a0 con 0x7fe81015e010 2024-04-24T23:09:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.551+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8080149c0 con 0x7fe81015e010 2024-04-24T23:09:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.551+0000 7fe807e00640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 0x7fe7f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.552+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fe80808b9f0 con 0x7fe81015e010 2024-04-24T23:09:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.552+0000 7fe80fe00640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 0x7fe7f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.553+0000 7fe80fe00640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 0x7fe7f006e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.556+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe80805a030 con 0x7fe81015e010 2024-04-24T23:09:08.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.783+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe810073eb0 con 0x7fe81015e010 2024-04-24T23:09:08.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.783+0000 7fe807e00640 1 -- 172.21.15.146:0/13322488 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) ==== 104+0+11 (secure 0 0 0) 0x7fe808059930 con 0x7fe81015e010 2024-04-24T23:09:08.785 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:09:08.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 msgr2=0x7fe7f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 0x7fe7f006e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 msgr2=0x7fe810148440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe808007d20 tx=0x7fe80800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 shutdown_connections 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81015e010 0x7fe810148440 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe7f006be30 0x7fe7f006e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe810071520 0x7fe810147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 --2- 172.21.15.146:0/13322488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe81006e620 0x7fe8100b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 >> 172.21.15.146:0/13322488 conn(0x7fe8100b17b0 msgr2=0x7fe8100b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.786+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 shutdown_connections 2024-04-24T23:09:08.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:08.787+0000 7fe817200640 1 -- 172.21.15.146:0/13322488 wait complete. 2024-04-24T23:09:08.807 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:09:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.014+0000 7f6222200640 1 Processor -- start 2024-04-24T23:09:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.014+0000 7f6222200640 1 -- start start 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.015+0000 7f6222200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f621c155460 0x7f621c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.015+0000 7f6222200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c06ea40 0x7f621c0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.015+0000 7f6222200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f621c0b3250 con 0x7f621c0b2ab0 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.015+0000 7f6222200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f621c0b3530 con 0x7f621c155460 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.015+0000 7f6222200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f621c0b3810 con 0x7f621c06ea40 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f621c155460 0x7f621c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f621c155460 0x7f621c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40406/0 (socket says 172.21.15.146:40406) 2024-04-24T23:09:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 -- 172.21.15.146:0/4263623801 learned_addr learned my addr 172.21.15.146:0/4263623801 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621be00640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c06ea40 0x7f621c0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 -- 172.21.15.146:0/4263623801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c06ea40 msgr2=0x7f621c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c06ea40 0x7f621c0713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 -- 172.21.15.146:0/4263623801 >> v1:172.21.15.203:6789/0 conn(0x7f621c0b2ab0 legacy=0x7f621c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.016+0000 7f621b400640 1 -- 172.21.15.146:0/4263623801 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c070ec0 con 0x7f621c155460 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.017+0000 7f621b400640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c155460 0x7f621c15be40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f620c009e50 tx=0x7f620c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1270e9171ff5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.017+0000 7f621a000640 1 -- 172.21.15.146:0/4263623801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c036070 con 0x7f621c155460 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.017+0000 7f621a000640 1 -- 172.21.15.146:0/4263623801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c031600 con 0x7f621c155460 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.017+0000 7f621a000640 1 -- 172.21.15.146:0/4263623801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0319d0 con 0x7f621c155460 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 -- 172.21.15.146:0/4263623801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c155460 msgr2=0x7f621c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c155460 0x7f621c15be40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f620c009e50 tx=0x7f620c02a6c0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 -- 172.21.15.146:0/4263623801 shutdown_connections 2024-04-24T23:09:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c06ea40 0x7f621c0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 --2- 172.21.15.146:0/4263623801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c155460 0x7f621c15be40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 -- 172.21.15.146:0/4263623801 >> 172.21.15.146:0/4263623801 conn(0x7f621c0b17b0 msgr2=0x7f621c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 -- 172.21.15.146:0/4263623801 shutdown_connections 2024-04-24T23:09:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.018+0000 7f6222200640 1 -- 172.21.15.146:0/4263623801 wait complete. 2024-04-24T23:09:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.020+0000 7f6222200640 1 Processor -- start 2024-04-24T23:09:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.020+0000 7f6222200640 1 -- start start 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c0b2ab0 0x7f621c0af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621c155460 0x7f621c0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f621c15c480 con 0x7f621c06ea40 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b3af0 con 0x7f621c155460 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f6222200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f621c15c600 con 0x7f621c0b2ab0 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f621b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f621b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40412/0 (socket says 172.21.15.146:40412) 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.021+0000 7f621b400640 1 -- 172.21.15.146:0/3974124528 learned_addr learned my addr 172.21.15.146:0/3974124528 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 -- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c0b2ab0 msgr2=0x7f621c0af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c0b2ab0 0x7f621c0af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 -- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621c155460 msgr2=0x7f621c0afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621c155460 0x7f621c0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 -- 172.21.15.146:0/3974124528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c0cfc90 con 0x7f621c06ea40 2024-04-24T23:09:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f621b400640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f620c009e50 tx=0x7f620c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c036050 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c042070 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c009510 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.022+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c0cff70 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.023+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c0d0530 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.024+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c04f5a0 con 0x7f621c06ea40 2024-04-24T23:09:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.025+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f620c007c70 con 0x7f621c06ea40 2024-04-24T23:09:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.026+0000 7f6213400640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 0x7f61f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.026+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f620c0ac250 con 0x7f621c06ea40 2024-04-24T23:09:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.027+0000 7f621aa00640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 0x7f61f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.028+0000 7f621aa00640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 0x7f61f806e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f621c0cd090 tx=0x7f62040079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.031+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f620c045360 con 0x7f621c06ea40 2024-04-24T23:09:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.229+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f621c06ce50 con 0x7f621c06ea40 2024-04-24T23:09:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.230+0000 7f6213400640 1 -- 172.21.15.146:0/3974124528 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) ==== 100+0+11 (secure 0 0 0) 0x7f620c07a800 con 0x7f621c06ea40 2024-04-24T23:09:09.232 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:09:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 msgr2=0x7f61f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 0x7f61f806e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f621c0cd090 tx=0x7f62040079d0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 msgr2=0x7f621c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f620c009e50 tx=0x7f620c004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 shutdown_connections 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621c155460 0x7f621c0afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f61f806be30 0x7f61f806e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f621c0b2ab0 0x7f621c0af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 --2- 172.21.15.146:0/3974124528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f621c06ea40 0x7f621c0cd660 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 >> 172.21.15.146:0/3974124528 conn(0x7f621c0b17b0 msgr2=0x7f621c0ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 shutdown_connections 2024-04-24T23:09:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.233+0000 7f6222200640 1 -- 172.21.15.146:0/3974124528 wait complete. 2024-04-24T23:09:09.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.454+0000 7fe17fe00640 1 Processor -- start 2024-04-24T23:09:09.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.454+0000 7fe17fe00640 1 -- start start 2024-04-24T23:09:09.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.456+0000 7fe17fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.456+0000 7fe17fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe1800b2dc0 0x7fe1800b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.456+0000 7fe17fe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800d4bc0 con 0x7fe1800d06e0 2024-04-24T23:09:09.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.456+0000 7fe17fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe1800cf5b0 con 0x7fe1800b2dc0 2024-04-24T23:09:09.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.456+0000 7fe17fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe1800d48e0 con 0x7fe18015e5b0 2024-04-24T23:09:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.457+0000 7fe17f400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe1800b2dc0 0x7fe1800b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.457+0000 7fe176000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.457+0000 7fe17ea00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fe1800d06e0 0x7fe18015dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:45256/0 (socket says 172.21.15.146:45256) 2024-04-24T23:09:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.457+0000 7fe17ea00640 1 -- 172.21.15.146:0/3408006007 learned_addr learned my addr 172.21.15.146:0/3408006007 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:09.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.458+0000 7fe17f400640 1 -- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 msgr2=0x7fe1800b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.458+0000 7fe17f400640 1 --2- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.458+0000 7fe17f400640 1 -- 172.21.15.146:0/3408006007 >> v1:172.21.15.203:6789/0 conn(0x7fe1800d06e0 legacy=0x7fe18015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.458+0000 7fe17f400640 1 -- 172.21.15.146:0/3408006007 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1800cf850 con 0x7fe1800b2dc0 2024-04-24T23:09:09.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.459+0000 7fe17f400640 1 --2- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800b3450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf261d1de1ee29a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.460+0000 7fe17e000640 1 -- 172.21.15.146:0/3408006007 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178031600 con 0x7fe1800b2dc0 2024-04-24T23:09:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.460+0000 7fe17e000640 1 -- 172.21.15.146:0/3408006007 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1780317a0 con 0x7fe1800b2dc0 2024-04-24T23:09:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.460+0000 7fe17e000640 1 -- 172.21.15.146:0/3408006007 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178031b70 con 0x7fe1800b2dc0 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.460+0000 7fe17fe00640 1 -- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 msgr2=0x7fe1800b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.460+0000 7fe17fe00640 1 --2- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800b3450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17802a5d0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 -- 172.21.15.146:0/3408006007 shutdown_connections 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 --2- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800b3450 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 --2- 172.21.15.146:0/3408006007 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 -- 172.21.15.146:0/3408006007 >> 172.21.15.146:0/3408006007 conn(0x7fe1800d3d20 msgr2=0x7fe1800d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 -- 172.21.15.146:0/3408006007 shutdown_connections 2024-04-24T23:09:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.461+0000 7fe17fe00640 1 -- 172.21.15.146:0/3408006007 wait complete. 2024-04-24T23:09:09.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.463+0000 7fe17fe00640 1 Processor -- start 2024-04-24T23:09:09.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.463+0000 7fe17fe00640 1 -- start start 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800d2e40 con 0x7fe1800d06e0 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800d2cc0 con 0x7fe1800b2dc0 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.464+0000 7fe17fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe1800d0ac0 con 0x7fe18015e5b0 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40418/0 (socket says 172.21.15.146:40418) 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 -- 172.21.15.146:0/1348112570 learned_addr learned my addr 172.21.15.146:0/1348112570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe17ea00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe17f400640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 -- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 msgr2=0x7fe1800c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 -- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 msgr2=0x7fe1800ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 -- 172.21.15.146:0/1348112570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18015a490 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.465+0000 7fe176000640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e870 tx=0x7fe16800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.466+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168017070 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.466+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16800c940 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.466+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16800cd30 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.466+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18015a770 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.466+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18015ad30 con 0x7fe1800d06e0 2024-04-24T23:09:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.467+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1800c7d90 con 0x7fe1800d06e0 2024-04-24T23:09:09.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.468+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe16801a070 con 0x7fe1800d06e0 2024-04-24T23:09:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.469+0000 7fe177400640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 0x7fe15c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.469+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fe16808b3f0 con 0x7fe1800d06e0 2024-04-24T23:09:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.470+0000 7fe17ea00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 0x7fe15c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.471+0000 7fe17ea00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 0x7fe15c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe170000f60 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.473+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe168059a30 con 0x7fe1800d06e0 2024-04-24T23:09:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.712+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe18004f500 con 0x7fe1800d06e0 2024-04-24T23:09:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.713+0000 7fe177400640 1 -- 172.21.15.146:0/1348112570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5192 (secure 0 0 0) 0x7fe168059330 con 0x7fe1800d06e0 2024-04-24T23:09:09.714 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:09.715 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:09:00.566872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6993,"qdb_cluster":[6993]},"id":4}]} 2024-04-24T23:09:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 65 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 msgr2=0x7fe15c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 0x7fe15c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe170000f60 tx=0x7fe170009040 comp rx=0 tx=0).stop 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 msgr2=0x7fe1801521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e870 tx=0x7fe16800ed30 comp rx=0 tx=0).stop 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 shutdown_connections 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe15c06be30 0x7fe15c06e2f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe18015e5b0 0x7fe1800c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1800d06e0 0x7fe1801521a0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 --2- 172.21.15.146:0/1348112570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1800b2dc0 0x7fe1800ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 >> 172.21.15.146:0/1348112570 conn(0x7fe1800d3d20 msgr2=0x7fe1800b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 shutdown_connections 2024-04-24T23:09:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.716+0000 7fe17fe00640 1 -- 172.21.15.146:0/1348112570 wait complete. 2024-04-24T23:09:09.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.937+0000 7f39ae000640 1 Processor -- start 2024-04-24T23:09:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.937+0000 7f39ae000640 1 -- start start 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.938+0000 7f39ae000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f39a8166b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.938+0000 7f39ae000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a80cdf70 con 0x7f39a80b2a20 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.938+0000 7f39ae000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a8145a20 con 0x7f39a8145640 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.938+0000 7f39ae000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39a806d140 con 0x7f39a80d03a0 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.939+0000 7f399ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f39a80b2a20 0x7f39a80cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48416/0 (socket says 172.21.15.146:48416) 2024-04-24T23:09:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.939+0000 7f399ea00640 1 -- 172.21.15.146:0/4262677905 learned_addr learned my addr 172.21.15.146:0/4262677905 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.939+0000 7f39a7e00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f39a8166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.939+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933235870 0 0) 0x7f39a80cdf70 con 0x7f39a80b2a20 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.939+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f398c003520 con 0x7f39a80b2a20 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430999603 0 0) 0x7f398c003520 con 0x7f39a80b2a20 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 msgr2=0x7f39a8166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f39a8166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 >> v1:172.21.15.203:6789/0 conn(0x7f39a8145640 legacy=0x7f39a815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a806d420 con 0x7f39a80b2a20 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f39900019f0 con 0x7f39a80b2a20 2024-04-24T23:09:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 >> v1:172.21.15.146:6789/0 conn(0x7f39a80b2a20 legacy=0x7f39a80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f398c0039e0 0x7f398c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f398c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c004d40 0x7f398c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39a806d140 con 0x7f398c004d40 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f398c00bbd0 con 0x7f398c0039e0 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f398c00bdd0 con 0x7f39a80d03a0 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a7e00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c004d40 0x7f398c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f399ea00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f398c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.940+0000 7f39a7400640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f398c0039e0 0x7f398c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7e00640 1 -- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 msgr2=0x7f398c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7e00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39a80d03a0 0x7f398c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7e00640 1 -- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f398c0039e0 msgr2=0x7f398c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7e00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f398c0039e0 0x7f398c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7e00640 1 -- 172.21.15.146:0/4262677905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c003520 con 0x7f398c004d40 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.941+0000 7f39a7400640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f398c0039e0 0x7f398c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39a7e00640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c004d40 0x7f398c0051c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f39a000ba00 tx=0x7f398c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df22514a8f88560d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0030070 con 0x7f398c004d40 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a002adb0 con 0x7f398c004d40 2024-04-24T23:09:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39a6a00640 1 -- 172.21.15.146:0/4262677905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a000b600 con 0x7f398c004d40 2024-04-24T23:09:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39ae000640 1 -- 172.21.15.146:0/4262677905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c004d40 msgr2=0x7f398c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39ae000640 1 --2- 172.21.15.146:0/4262677905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c004d40 0x7f398c0051c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f39a000ba00 tx=0x7f398c005830 comp rx=0 tx=0).stop 2024-04-24T23:09:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.942+0000 7f39a7e00640 1 -- 172.21.15.146:0/4262677905 reap_dead start 2024-04-24T23:09:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.943+0000 7f39ae000640 1 -- 172.21.15.146:0/4262677905 shutdown_connections 2024-04-24T23:09:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.943+0000 7f39ae000640 1 -- 172.21.15.146:0/4262677905 >> 172.21.15.146:0/4262677905 conn(0x7f39a806b320 msgr2=0x7f39a806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.943+0000 7f39ae000640 1 -- 172.21.15.146:0/4262677905 shutdown_connections 2024-04-24T23:09:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.943+0000 7f39ae000640 1 -- 172.21.15.146:0/4262677905 wait complete. 2024-04-24T23:09:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.944+0000 7f39ae000640 1 Processor -- start 2024-04-24T23:09:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.945+0000 7f39ae000640 1 -- start start 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.945+0000 7f39ae000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f398c004d40 0x7f39a813f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.945+0000 7f39ae000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.945+0000 7f39ae000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a8071e70 0x7f39a8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f39ae000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39a806cbc0 con 0x7f39a8071a10 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f39ae000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39a806d9e0 con 0x7f39a8071e70 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f39ae000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39a806cd40 con 0x7f398c004d40 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40446/0 (socket says 172.21.15.146:40446) 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 -- 172.21.15.146:0/3814643200 learned_addr learned my addr 172.21.15.146:0/3814643200 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f39a7400640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f398c004d40 0x7f39a813f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f39a7e00640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a8071e70 0x7f39a8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 -- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f398c004d40 msgr2=0x7f39a813f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f398c004d40 0x7f39a813f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 -- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a8071e70 msgr2=0x7f39a8158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a8071e70 0x7f39a8158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.946+0000 7f399ea00640 1 -- 172.21.15.146:0/3814643200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a813fab0 con 0x7f39a8071a10 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f399ea00640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3990007a60 tx=0x7f399000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399000edf0 con 0x7f39a8071a10 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3990018070 con 0x7f39a8071a10 2024-04-24T23:09:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990013660 con 0x7f39a8071a10 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a8157e00 con 0x7f39a8071a10 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.947+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a8158380 con 0x7f39a8071a10 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.948+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a8068190 con 0x7f39a8071a10 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.949+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3990013800 con 0x7f39a8071a10 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.950+0000 7f399fe00640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 0x7f398406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.950+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f399008b940 con 0x7f39a8071a10 2024-04-24T23:09:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.951+0000 7f39a7400640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 0x7f398406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.952+0000 7f39a7400640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 0x7f398406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3998000c00 tx=0x7f3998009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:09.954+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f39a813fab0 con 0x7f39a8071a10 2024-04-24T23:09:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.142+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39a815db60 con 0x7f39a8071a10 2024-04-24T23:09:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.144+0000 7f399fe00640 1 -- 172.21.15.146:0/3814643200 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+17684 (secure 0 0 0) 0x7f3990059ef0 con 0x7f39a8071a10 2024-04-24T23:09:10.145 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:10.146 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":73,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:08:54.973054+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.34","mappings":[{"from":2,"to":7}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.203:6835/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.203:6837/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 msgr2=0x7f398406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 0x7f398406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3998000c00 tx=0x7f3998009040 comp rx=0 tx=0).stop 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 msgr2=0x7f39a81588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3990007a60 tx=0x7f399000e530 comp rx=0 tx=0).stop 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 shutdown_connections 2024-04-24T23:09:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39a8071e70 0x7f39a8158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a8071a10 0x7f39a81588e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f398406be30 0x7f398406e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 --2- 172.21.15.146:0/3814643200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f398c004d40 0x7f39a813f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 >> 172.21.15.146:0/3814643200 conn(0x7f39a806b320 msgr2=0x7f39a806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 shutdown_connections 2024-04-24T23:09:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.147+0000 7f39ae000640 1 -- 172.21.15.146:0/3814643200 wait complete. 2024-04-24T23:09:10.166 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:09:10.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.363+0000 7f4ddb000640 1 Processor -- start 2024-04-24T23:09:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.363+0000 7f4ddb000640 1 -- start start 2024-04-24T23:09:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4ddb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 0x7f4dd4166b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4ddb000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd40cdf70 con 0x7f4dd4145640 2024-04-24T23:09:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4ddb000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd4145a20 con 0x7f4dd40b2a20 2024-04-24T23:09:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4ddb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd406d140 con 0x7f4dd40d03a0 2024-04-24T23:09:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4dd3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4dd4145640 0x7f4dd415ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48424/0 (socket says 172.21.15.146:48424) 2024-04-24T23:09:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.365+0000 7f4dd3e00640 1 -- 172.21.15.146:0/2982779463 learned_addr learned my addr 172.21.15.146:0/2982779463 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd9000640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 0x7f4dd4166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5102937 0 0) 0x7f4dd40cdf70 con 0x7f4dd4145640 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4db8003520 con 0x7f4dd4145640 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3603794320 0 0) 0x7f4db8003520 con 0x7f4dd4145640 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 msgr2=0x7f4dd4166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 0x7f4dd4166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 >> v1:172.21.15.203:6789/0 conn(0x7f4dd40b2a20 legacy=0x7f4dd40cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd406d420 con 0x7f4dd4145640 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f4dc4001670 con 0x7f4dd4145640 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 >> v1:172.21.15.146:6789/0 conn(0x7f4dd4145640 legacy=0x7f4dd415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4db8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 0x7f4db8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.366+0000 7f4dd3400640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4db8004d40 0x7f4db80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd406d140 con 0x7f4db80039e0 2024-04-24T23:09:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4db800baa0 con 0x7f4db8004d40 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4db800bca0 con 0x7f4dd40d03a0 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4db8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 -- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 msgr2=0x7f4db8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd40d03a0 0x7f4db8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 -- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4db8004d40 msgr2=0x7f4db80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd9000640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4db8004d40 0x7f4db80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4db8004d40 0x7f4db80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.367+0000 7f4dd3e00640 1 -- 172.21.15.146:0/2982779463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db8003520 con 0x7f4db80039e0 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.368+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4db8003e00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c210 tx=0x7f4db8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61bff7df7d81c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.368+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4007cf0 con 0x7f4db80039e0 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4005af0 con 0x7f4db80039e0 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4dd3400640 1 -- 172.21.15.146:0/2982779463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4007070 con 0x7f4db80039e0 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 -- 172.21.15.146:0/2982779463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 msgr2=0x7f4db8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 --2- 172.21.15.146:0/2982779463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4db8003e00 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c210 tx=0x7f4db8005830 comp rx=0 tx=0).stop 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4dd9000640 1 -- 172.21.15.146:0/2982779463 reap_dead start 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 -- 172.21.15.146:0/2982779463 shutdown_connections 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 -- 172.21.15.146:0/2982779463 >> 172.21.15.146:0/2982779463 conn(0x7f4dd406b320 msgr2=0x7f4dd406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 -- 172.21.15.146:0/2982779463 shutdown_connections 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.369+0000 7f4ddb000640 1 -- 172.21.15.146:0/2982779463 wait complete. 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.371+0000 7f4ddb000640 1 Processor -- start 2024-04-24T23:09:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.371+0000 7f4ddb000640 1 -- start start 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd4141c40 0x7f4dd4142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 0x7f4dd4144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd406cbc0 con 0x7f4db80039e0 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd406d9e0 con 0x7f4dd41f2a60 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4ddb000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd406cd40 con 0x7f4dd4141c40 2024-04-24T23:09:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4dd3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4dd3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40476/0 (socket says 172.21.15.146:40476) 2024-04-24T23:09:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.372+0000 7f4dd3e00640 1 -- 172.21.15.146:0/3576918657 learned_addr learned my addr 172.21.15.146:0/3576918657 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd9000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 0x7f4dd4144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 -- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd4141c40 msgr2=0x7f4dd4142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dcb400640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd4141c40 0x7f4dd4142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd4141c40 0x7f4dd4142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 -- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 msgr2=0x7f4dd4144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 0x7f4dd4144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 -- 172.21.15.146:0/3576918657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd4143750 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd9000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 0x7f4dd4144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd3e00640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4000f60 tx=0x7f4dd406d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4001430 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4042070 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4007070 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd4157210 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.373+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd41f2f10 con 0x7f4db80039e0 2024-04-24T23:09:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.374+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd4068190 con 0x7f4db80039e0 2024-04-24T23:09:10.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.375+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4dc4007210 con 0x7f4db80039e0 2024-04-24T23:09:10.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.376+0000 7f4dd0c00640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.376+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7f4dc40ab280 con 0x7f4db80039e0 2024-04-24T23:09:10.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.377+0000 7f4dcb400640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.378+0000 7f4dcb400640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 0x7f4db006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4dd415f110 tx=0x7f4dbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.381+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4dc40799e0 con 0x7f4db80039e0 2024-04-24T23:09:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.604+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dd4156770 con 0x7f4db80039e0 2024-04-24T23:09:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.605+0000 7f4dd0c00640 1 -- 172.21.15.146:0/3576918657 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5192 (secure 0 0 0) 0x7f4dc40792e0 con 0x7f4db80039e0 2024-04-24T23:09:10.607 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:10.607 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:09:00.566872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6993,"qdb_cluster":[6993]},"id":4}]} 2024-04-24T23:09:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 65 2024-04-24T23:09:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 msgr2=0x7f4db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 0x7f4db006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4dd415f110 tx=0x7f4dbc009040 comp rx=0 tx=0).stop 2024-04-24T23:09:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 msgr2=0x7f4dd41efc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4000f60 tx=0x7f4dd406d5f0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 shutdown_connections 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd41f2a60 0x7f4dd4144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4db006be30 0x7f4db006e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4dd4141c40 0x7f4dd4142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 --2- 172.21.15.146:0/3576918657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db80039e0 0x7f4dd41efc50 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 >> 172.21.15.146:0/3576918657 conn(0x7f4dd406b320 msgr2=0x7f4dd413ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 shutdown_connections 2024-04-24T23:09:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.608+0000 7f4ddb000640 1 -- 172.21.15.146:0/3576918657 wait complete. 2024-04-24T23:09:10.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.822+0000 7efdaa400640 1 Processor -- start 2024-04-24T23:09:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.822+0000 7efdaa400640 1 -- start start 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efdaa400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efda415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efdaa400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda40af300 con 0x7efda415a410 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efdaa400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda406e120 con 0x7efda415e330 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efdaa400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efda406e400 con 0x7efda406dc50 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efda9000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efda415a410 0x7efda40aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48426/0 (socket says 172.21.15.146:48426) 2024-04-24T23:09:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.823+0000 7efda9000640 1 -- 172.21.15.146:0/2415016383 learned_addr learned my addr 172.21.15.146:0/2415016383 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139505495 0 0) 0x7efda40af300 con 0x7efda415a410 2024-04-24T23:09:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c003440 con 0x7efda415a410 2024-04-24T23:09:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3e00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efda415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1516390257 0 0) 0x7efd8c003440 con 0x7efda415a410 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 msgr2=0x7efda415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efda415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 >> v1:172.21.15.203:6789/0 conn(0x7efda415e330 legacy=0x7efda40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda406e6e0 con 0x7efda415a410 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7efd98001670 con 0x7efda415a410 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 >> v1:172.21.15.146:6789/0 conn(0x7efda415a410 legacy=0x7efda40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd8c003ad0 0x7efd8c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efd8c00a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efd8c00d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efda406e400 con 0x7efd8c00b090 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c00dd00 con 0x7efd8c003ad0 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.824+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c00df00 con 0x7efda406dc50 2024-04-24T23:09:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efd8c00d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9000640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd8c003ad0 0x7efd8c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda3e00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efd8c00a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 -- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 msgr2=0x7efd8c00a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda406dc50 0x7efd8c00a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 -- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd8c003ad0 msgr2=0x7efd8c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd8c003ad0 0x7efd8c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.825+0000 7efda9a00640 1 -- 172.21.15.146:0/2415016383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c003440 con 0x7efd8c00b090 2024-04-24T23:09:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.826+0000 7efda9a00640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efd8c00d520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7efd9c001e50 tx=0x7efd8c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d0c726f04390c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c001a70 con 0x7efd8c00b090 2024-04-24T23:09:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9c003970 con 0x7efd8c00b090 2024-04-24T23:09:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efda3400640 1 -- 172.21.15.146:0/2415016383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c003d60 con 0x7efd8c00b090 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 -- 172.21.15.146:0/2415016383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 msgr2=0x7efd8c00d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 --2- 172.21.15.146:0/2415016383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efd8c00d520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7efd9c001e50 tx=0x7efd8c003730 comp rx=0 tx=0).stop 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efda9a00640 1 -- 172.21.15.146:0/2415016383 reap_dead start 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 -- 172.21.15.146:0/2415016383 shutdown_connections 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 -- 172.21.15.146:0/2415016383 >> 172.21.15.146:0/2415016383 conn(0x7efda406b320 msgr2=0x7efda406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 -- 172.21.15.146:0/2415016383 shutdown_connections 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.827+0000 7efdaa400640 1 -- 172.21.15.146:0/2415016383 wait complete. 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.829+0000 7efdaa400640 1 Processor -- start 2024-04-24T23:09:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.829+0000 7efdaa400640 1 -- start start 2024-04-24T23:09:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efda40c4e30 0x7efda41e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda41f3b40 0x7efda41f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efda40cfb30 con 0x7efd8c00b090 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efda415e080 con 0x7efda40c4e30 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efdaa400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efda40cfcb0 con 0x7efda41f3b40 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efda9000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efda9000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40494/0 (socket says 172.21.15.146:40494) 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.830+0000 7efda9000640 1 -- 172.21.15.146:0/2314423622 learned_addr learned my addr 172.21.15.146:0/2314423622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9a00640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda41f3b40 0x7efda41f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 -- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda41f3b40 msgr2=0x7efda41f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda41f3b40 0x7efda41f3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda3e00640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efda40c4e30 0x7efda41e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 -- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efda40c4e30 msgr2=0x7efda41e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efda40c4e30 0x7efda41e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 -- 172.21.15.146:0/2314423622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41f4500 con 0x7efd8c00b090 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.831+0000 7efda9000640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7efd9800e840 tx=0x7efd9800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.832+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9800c870 con 0x7efd8c00b090 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.832+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98018070 con 0x7efd8c00b090 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.832+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda41e5de0 con 0x7efd8c00b090 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.832+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9800cc70 con 0x7efd8c00b090 2024-04-24T23:09:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.832+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda4147820 con 0x7efd8c00b090 2024-04-24T23:09:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.833+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda404f500 con 0x7efd8c00b090 2024-04-24T23:09:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.834+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd9801d460 con 0x7efd8c00b090 2024-04-24T23:09:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.835+0000 7efda0c00640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 0x7efd8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.835+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7efd9808b1b0 con 0x7efd8c00b090 2024-04-24T23:09:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.835+0000 7efda3e00640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 0x7efd8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.836+0000 7efda3e00640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 0x7efd8406e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efda41e6840 tx=0x7efd90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:10.839+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efda41f4500 con 0x7efd8c00b090 2024-04-24T23:09:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.081+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efda4070b00 con 0x7efd8c00b090 2024-04-24T23:09:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.082+0000 7efda0c00640 1 -- 172.21.15.146:0/2314423622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5192 (secure 0 0 0) 0x7efd98059110 con 0x7efd8c00b090 2024-04-24T23:09:11.083 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:11.083 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:08:56.981468+0000","modified":"2024-04-24T23:09:00.566872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6993},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_6993":{"gid":6993,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1781418579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1781418579},{"type":"v1","addr":"172.21.15.146:6834","nonce":1781418579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6993,"qdb_cluster":[6993]},"id":4}]} 2024-04-24T23:09:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 65 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 msgr2=0x7efd8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 0x7efd8406e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efda41e6840 tx=0x7efd90008040 comp rx=0 tx=0).stop 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 msgr2=0x7efda4146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7efd9800e840 tx=0x7efd9800ed00 comp rx=0 tx=0).stop 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 shutdown_connections 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd8406be30 0x7efd8406e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efda41f3b40 0x7efda41f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efda40c4e30 0x7efda41e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 --2- 172.21.15.146:0/2314423622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c00b090 0x7efda4146f40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 >> 172.21.15.146:0/2314423622 conn(0x7efda406b320 msgr2=0x7efda40b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 shutdown_connections 2024-04-24T23:09:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.085+0000 7efdaa400640 1 -- 172.21.15.146:0/2314423622 wait complete. 2024-04-24T23:09:11.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.297+0000 7fbc07400640 1 Processor -- start 2024-04-24T23:09:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.297+0000 7fbc07400640 1 -- start start 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.298+0000 7fbc07400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbc000b2a20 0x7fbc000cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbc07400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc000cdf70 con 0x7fbc0006cbc0 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbc07400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00145a20 con 0x7fbc00145640 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbc07400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0006d140 con 0x7fbc000b2a20 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbc05400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc0006cbc0 0x7fbc000ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48436/0 (socket says 172.21.15.146:48436) 2024-04-24T23:09:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbc05400640 1 -- 172.21.15.146:0/408994240 learned_addr learned my addr 172.21.15.146:0/408994240 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbbffe00640 1 --2- 172.21.15.146:0/408994240 >> v2:172.21.15.203:3300/0 conn(0x7fbc000b2a20 0x7fbc000cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450603529 0 0) 0x7fbc000cdf70 con 0x7fbc0006cbc0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.299+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe0003520 con 0x7fbc0006cbc0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1191391728 0 0) 0x7fbbe0003520 con 0x7fbc0006cbc0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 >> v2:172.21.15.203:3300/0 conn(0x7fbc000b2a20 msgr2=0x7fbc000cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 --2- 172.21.15.146:0/408994240 >> v2:172.21.15.203:3300/0 conn(0x7fbc000b2a20 0x7fbc000cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 >> v1:172.21.15.203:6789/0 conn(0x7fbc00145640 legacy=0x7fbc0015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0006d420 con 0x7fbc0006cbc0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fbbf8001690 con 0x7fbc0006cbc0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 >> v1:172.21.15.146:6789/0 conn(0x7fbc0006cbc0 legacy=0x7fbc000ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 0x7fbbe0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe0004800 0x7fbbe0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe00051c0 0x7fbbe000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0006d140 con 0x7fbbe00039b0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe000c060 con 0x7fbbe0004800 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe000c260 con 0x7fbbe00051c0 2024-04-24T23:09:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.300+0000 7fbc04a00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 0x7fbbe0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc05400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe00051c0 0x7fbbe000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc04a00640 1 -- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe00051c0 msgr2=0x7fbbe000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbbffe00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe0004800 0x7fbbe0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc04a00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe00051c0 0x7fbbe000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc04a00640 1 -- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe0004800 msgr2=0x7fbbe0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc04a00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe0004800 0x7fbbe0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc04a00640 1 -- 172.21.15.146:0/408994240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe0003520 con 0x7fbbe00039b0 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbbffe00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe0004800 0x7fbbe0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.301+0000 7fbc05400640 1 -- 172.21.15.146:0/408994240 reap_dead start 2024-04-24T23:09:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.302+0000 7fbc04a00640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 0x7fbbe0003dd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0001750 tx=0x7fbbe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c2c134bf2c095f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.302+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0001370 con 0x7fbbe00039b0 2024-04-24T23:09:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.302+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf00052d0 con 0x7fbbe00039b0 2024-04-24T23:09:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.302+0000 7fbbff400640 1 -- 172.21.15.146:0/408994240 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf002abe0 con 0x7fbbe00039b0 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 -- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 msgr2=0x7fbbe0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 0x7fbbe0003dd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0001750 tx=0x7fbbe0005830 comp rx=0 tx=0).stop 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 -- 172.21.15.146:0/408994240 shutdown_connections 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 --2- 172.21.15.146:0/408994240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe00039b0 0x7fbbe0003dd0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 -- 172.21.15.146:0/408994240 >> 172.21.15.146:0/408994240 conn(0x7fbc0006b320 msgr2=0x7fbc0006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 -- 172.21.15.146:0/408994240 shutdown_connections 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.303+0000 7fbc07400640 1 -- 172.21.15.146:0/408994240 wait complete. 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.304+0000 7fbc07400640 1 Processor -- start 2024-04-24T23:09:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.305+0000 7fbc07400640 1 -- start start 2024-04-24T23:09:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.305+0000 7fbc07400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 0x7fbc001f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.305+0000 7fbc07400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc07400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc001f5370 0x7fbc000c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc07400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0015ce20 con 0x7fbc001594e0 2024-04-24T23:09:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc07400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0006d9e0 con 0x7fbbe00039b0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc07400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0015cfa0 con 0x7fbc001f5370 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40516/0 (socket says 172.21.15.146:40516) 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 -- 172.21.15.146:0/1435042123 learned_addr learned my addr 172.21.15.146:0/1435042123 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc04a00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 0x7fbc001f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc05400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc001f5370 0x7fbc000c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 -- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc001f5370 msgr2=0x7fbc000c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc001f5370 0x7fbc000c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 -- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 msgr2=0x7fbc001f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 0x7fbc001f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbbffe00640 1 -- 172.21.15.146:0/1435042123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000c5130 con 0x7fbc001594e0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.306+0000 7fbc04a00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 0x7fbc001f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbbffe00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800f3e0 tx=0x7fbbe800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8003990 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe8003b30 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8004020 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc000c5410 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.307+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc000c59d0 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.309+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc00068190 con 0x7fbc001594e0 2024-04-24T23:09:11.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.309+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbe8005d10 con 0x7fbc001594e0 2024-04-24T23:09:11.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.310+0000 7fbbfcc00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 0x7fbbdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.310+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fbbe808ba80 con 0x7fbc001594e0 2024-04-24T23:09:11.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.311+0000 7fbc04a00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 0x7fbbdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.312+0000 7fbc04a00640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 0x7fbbdc06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0032000 tx=0x7fbbf002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.315+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbbe8024020 con 0x7fbc001594e0 2024-04-24T23:09:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.518+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc000d0180 con 0x7fbc001594e0 2024-04-24T23:09:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.521+0000 7fbbfcc00640 1 -- 172.21.15.146:0/1435042123 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+17684 (secure 0 0 0) 0x7fbbe805a160 con 0x7fbc001594e0 2024-04-24T23:09:11.522 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:11.522 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":73,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:08:54.973054+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:07:06.558364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-24T23:07:07.805671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.11","mappings":[{"from":4,"to":5}]},{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.2e","mappings":[{"from":2,"to":7}]},{"pgid":"10.34","mappings":[{"from":2,"to":7}]},{"pgid":"10.38","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.203:6835/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.203:6837/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 msgr2=0x7fbbdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 0x7fbbdc06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0032000 tx=0x7fbbf002e000 comp rx=0 tx=0).stop 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 msgr2=0x7fbc001f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800f3e0 tx=0x7fbbe800f8a0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 shutdown_connections 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbbdc06be30 0x7fbbdc06e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbc001f5370 0x7fbc000c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc001594e0 0x7fbc001f4e30 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 --2- 172.21.15.146:0/1435042123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe00039b0 0x7fbc001f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 >> 172.21.15.146:0/1435042123 conn(0x7fbc0006b320 msgr2=0x7fbc000ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 shutdown_connections 2024-04-24T23:09:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.524+0000 7fbc07400640 1 -- 172.21.15.146:0/1435042123 wait complete. 2024-04-24T23:09:11.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:09:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.748+0000 7fd31e000640 1 Processor -- start 2024-04-24T23:09:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.748+0000 7fd31e000640 1 -- start start 2024-04-24T23:09:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.750+0000 7fd31e000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd31815e010 0x7fd3180b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.750+0000 7fd31e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.750+0000 7fd31e000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd318070a80 con 0x7fd3180ade00 2024-04-24T23:09:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.750+0000 7fd31e000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd3180aeb60 con 0x7fd31815e010 2024-04-24T23:09:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.750+0000 7fd31e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd318071930 con 0x7fd318072380 2024-04-24T23:09:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.751+0000 7fd317e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.751+0000 7fd317e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:36416/0 (socket says 172.21.15.146:36416) 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.751+0000 7fd317e00640 1 -- 172.21.15.146:0/1242018752 learned_addr learned my addr 172.21.15.146:0/1242018752 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.751+0000 7fd31cc00640 1 --2- 172.21.15.146:0/1242018752 >> v2:172.21.15.203:3300/0 conn(0x7fd31815e010 0x7fd3180b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.752+0000 7fd317e00640 1 -- 172.21.15.146:0/1242018752 >> v2:172.21.15.203:3300/0 conn(0x7fd31815e010 msgr2=0x7fd3180b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.752+0000 7fd317e00640 1 --2- 172.21.15.146:0/1242018752 >> v2:172.21.15.203:3300/0 conn(0x7fd31815e010 0x7fd3180b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.752+0000 7fd317e00640 1 -- 172.21.15.146:0/1242018752 >> v1:172.21.15.203:6789/0 conn(0x7fd3180ade00 legacy=0x7fd318161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.752+0000 7fd317e00640 1 -- 172.21.15.146:0/1242018752 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd318070d20 con 0x7fd318072380 2024-04-24T23:09:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.753+0000 7fd317e00640 1 --2- 172.21.15.146:0/1242018752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd308009870 tx=0x7fd30802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31912c9f9dcd3abf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.753+0000 7fd317400640 1 -- 172.21.15.146:0/1242018752 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308037070 con 0x7fd318072380 2024-04-24T23:09:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.753+0000 7fd317400640 1 -- 172.21.15.146:0/1242018752 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30802ae50 con 0x7fd318072380 2024-04-24T23:09:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.753+0000 7fd317400640 1 -- 172.21.15.146:0/1242018752 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308032860 con 0x7fd318072380 2024-04-24T23:09:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 -- 172.21.15.146:0/1242018752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 msgr2=0x7fd3180ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 --2- 172.21.15.146:0/1242018752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd308009870 tx=0x7fd30802a300 comp rx=0 tx=0).stop 2024-04-24T23:09:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 -- 172.21.15.146:0/1242018752 shutdown_connections 2024-04-24T23:09:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 --2- 172.21.15.146:0/1242018752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd3180ad8c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 --2- 172.21.15.146:0/1242018752 >> v2:172.21.15.203:3300/0 conn(0x7fd31815e010 0x7fd3180b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 -- 172.21.15.146:0/1242018752 >> 172.21.15.146:0/1242018752 conn(0x7fd3180b1560 msgr2=0x7fd3180b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 -- 172.21.15.146:0/1242018752 shutdown_connections 2024-04-24T23:09:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.754+0000 7fd31e000640 1 -- 172.21.15.146:0/1242018752 wait complete. 2024-04-24T23:09:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.756+0000 7fd31e000640 1 Processor -- start 2024-04-24T23:09:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.756+0000 7fd31e000640 1 -- start start 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd318148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd31815e010 0x7fd31806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180715c0 con 0x7fd3180ade00 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180712e0 con 0x7fd31815e010 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd31e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd318071dc0 con 0x7fd318072380 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd317e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.757+0000 7fd317e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40532/0 (socket says 172.21.15.146:40532) 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 -- 172.21.15.146:0/3744354931 learned_addr learned my addr 172.21.15.146:0/3744354931 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd31cc00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd318148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd31d600640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd31815e010 0x7fd31806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 -- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 msgr2=0x7fd318148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd318148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 -- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd31815e010 msgr2=0x7fd31806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd31815e010 0x7fd31806d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 -- 172.21.15.146:0/3744354931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180cf4e0 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.758+0000 7fd317e00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd3080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.759+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308041020 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.759+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30803c870 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.759+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308037040 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.759+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180cf7c0 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.759+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180cfd80 con 0x7fd3180ade00 2024-04-24T23:09:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.760+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31804f500 con 0x7fd3180ade00 2024-04-24T23:09:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.761+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd308044020 con 0x7fd3180ade00 2024-04-24T23:09:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.762+0000 7fd314c00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 0x7fd2fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.762+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6562+0+0 (secure 0 0 0) 0x7fd3080abac0 con 0x7fd3180ade00 2024-04-24T23:09:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.762+0000 7fd31cc00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 0x7fd2fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.763+0000 7fd31cc00640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 0x7fd2fc06e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006fd0 tx=0x7fd30c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:11.766+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd30804b030 con 0x7fd3180ade00 2024-04-24T23:09:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.007+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd3180b2270 con 0x7fd3180ade00 2024-04-24T23:09:12.009 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:09:12.008+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:09:12.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.012+0000 7fd314c00640 1 -- 172.21.15.146:0/3744354931 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) ==== 161+0+0 (secure 0 0 0) 0x7fd30807a070 con 0x7fd3180ade00 2024-04-24T23:09:12.013 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.014+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 msgr2=0x7fd2fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.014+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 0x7fd2fc06e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006fd0 tx=0x7fd30c008040 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.014+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 msgr2=0x7fd3180cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.014+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd3080046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 shutdown_connections 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd31815e010 0x7fd31806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3180ade00 0x7fd3180cd340 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd2fc06be30 0x7fd2fc06e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 --2- 172.21.15.146:0/3744354931 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd318072380 0x7fd318148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 >> 172.21.15.146:0/3744354931 conn(0x7fd3180b1560 msgr2=0x7fd31806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:12.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 shutdown_connections 2024-04-24T23:09:12.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.015+0000 7fd31e000640 1 -- 172.21.15.146:0/3744354931 wait complete. 2024-04-24T23:09:12.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:09:12.120 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:09:12.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.225+0000 7f1e26c00640 1 Processor -- start 2024-04-24T23:09:12.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.225+0000 7f1e26c00640 1 -- start start 2024-04-24T23:09:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e26c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1e2015ba40 0x7f1e200cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e26c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e2015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e26c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2015c340 con 0x7f1e2015be20 2024-04-24T23:09:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e26c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1e200ce1c0 con 0x7f1e2015ba40 2024-04-24T23:09:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e26c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2015cf10 con 0x7f1e200d01f0 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e24e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1e2015be20 0x7f1e200cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48452/0 (socket says 172.21.15.146:48452) 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e24e00640 1 -- 172.21.15.146:0/2570163941 learned_addr learned my addr 172.21.15.146:0/2570163941 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.227+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> v2:172.21.15.203:3300/0 conn(0x7f1e2015ba40 0x7f1e200cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e26200640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e2015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661835277 0 0) 0x7f1e2015c340 con 0x7f1e2015be20 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e08003520 con 0x7f1e2015be20 2024-04-24T23:09:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3168304254 0 0) 0x7f1e08003520 con 0x7f1e2015be20 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 msgr2=0x7f1e2015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e2015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 >> v2:172.21.15.203:3300/0 conn(0x7f1e2015ba40 msgr2=0x7f1e200cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 --2- 172.21.15.146:0/2570163941 >> v2:172.21.15.203:3300/0 conn(0x7f1e2015ba40 0x7f1e200cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2015c5e0 con 0x7f1e2015be20 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1e0c001690 con 0x7f1e2015be20 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> v2:172.21.15.203:3300/0 conn(0x7f1e2015ba40 0x7f1e200cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 >> v1:172.21.15.146:6789/0 conn(0x7f1e2015be20 legacy=0x7f1e200cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e080039b0 0x7f1e08003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e08004d40 0x7f1e080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2015cf10 con 0x7f1e080039b0 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0800b9c0 con 0x7f1e08004d40 2024-04-24T23:09:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.228+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0800bbc0 con 0x7f1e200d01f0 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e080039b0 0x7f1e08003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 -- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 msgr2=0x7f1e08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e24e00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e26200640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e08004d40 0x7f1e080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e200d01f0 0x7f1e08004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 -- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e08004d40 msgr2=0x7f1e080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e08004d40 0x7f1e080051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.229+0000 7f1e25800640 1 -- 172.21.15.146:0/2570163941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08003520 con 0x7f1e080039b0 2024-04-24T23:09:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.230+0000 7f1e25800640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e080039b0 0x7f1e08003df0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c90 tx=0x7f1e08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e36f060d8f8454 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.230+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14036070 con 0x7f1e080039b0 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.230+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e14031400 con 0x7f1e080039b0 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.230+0000 7f1e1fe00640 1 -- 172.21.15.146:0/2570163941 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14009860 con 0x7f1e080039b0 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 -- 172.21.15.146:0/2570163941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e080039b0 msgr2=0x7f1e08003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 --2- 172.21.15.146:0/2570163941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e080039b0 0x7f1e08003df0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c90 tx=0x7f1e08005830 comp rx=0 tx=0).stop 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26200640 1 -- 172.21.15.146:0/2570163941 reap_dead start 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 -- 172.21.15.146:0/2570163941 shutdown_connections 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 -- 172.21.15.146:0/2570163941 >> 172.21.15.146:0/2570163941 conn(0x7f1e2006b350 msgr2=0x7f1e2006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 -- 172.21.15.146:0/2570163941 shutdown_connections 2024-04-24T23:09:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.231+0000 7f1e26c00640 1 -- 172.21.15.146:0/2570163941 wait complete. 2024-04-24T23:09:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.233+0000 7f1e26c00640 1 Processor -- start 2024-04-24T23:09:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.233+0000 7f1e26c00640 1 -- start start 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e080039b0 0x7f1e201f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e20071790 0x7f1e20071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2006e120 con 0x7f1e2013f230 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2015cba0 con 0x7f1e20071790 2024-04-24T23:09:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.234+0000 7f1e26c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2006e590 con 0x7f1e080039b0 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40578/0 (socket says 172.21.15.146:40578) 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 -- 172.21.15.146:0/3053083580 learned_addr learned my addr 172.21.15.146:0/3053083580 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e26200640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e20071790 0x7f1e20071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e25800640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e080039b0 0x7f1e201f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 -- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e080039b0 msgr2=0x7f1e201f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e080039b0 0x7f1e201f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 -- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e20071790 msgr2=0x7f1e20071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e20071790 0x7f1e20071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 -- 172.21.15.146:0/3053083580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2014e590 con 0x7f1e2013f230 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.235+0000 7f1e24e00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d7d0 tx=0x7f1e0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.236+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c019070 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.236+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c0074e0 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.236+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c004a20 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.236+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2014e870 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.236+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2014ee30 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.237+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2004f500 con 0x7f1e2013f230 2024-04-24T23:09:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.238+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e0c01c070 con 0x7f1e2013f230 2024-04-24T23:09:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.239+0000 7f1e1d600640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 0x7f1e0006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.239+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6648+0+0 (secure 0 0 0) 0x7f1e0c08abc0 con 0x7f1e2013f230 2024-04-24T23:09:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.240+0000 7f1e25800640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 0x7f1e0006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.243+0000 7f1e25800640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 0x7f1e0006e370 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e14033000 tx=0x7f1e14008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.246+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1e0c058b50 con 0x7f1e2013f230 2024-04-24T23:09:12.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:12.482+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1e2006d360 con 0x7f1e2013f230 2024-04-24T23:09:13.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.076+0000 7f1e1d600640 1 -- 172.21.15.146:0/3053083580 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7f1e0c05ce50 con 0x7f1e2013f230 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 msgr2=0x7f1e0006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 0x7f1e0006e370 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e14033000 tx=0x7f1e14008030 comp rx=0 tx=0).stop 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 msgr2=0x7f1e2014f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d7d0 tx=0x7f1e0c00dc90 comp rx=0 tx=0).stop 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 shutdown_connections 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e20071790 0x7f1e20071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2013f230 0x7f1e2014f630 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1e0006beb0 0x7f1e0006e370 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 --2- 172.21.15.146:0/3053083580 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1e080039b0 0x7f1e201f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.080+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 >> 172.21.15.146:0/3053083580 conn(0x7f1e2006b350 msgr2=0x7f1e2015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.081+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 shutdown_connections 2024-04-24T23:09:13.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.081+0000 7f1e26c00640 1 -- 172.21.15.146:0/3053083580 wait complete. 2024-04-24T23:09:13.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:09:13.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.305+0000 7f5b1a200640 1 Processor -- start 2024-04-24T23:09:13.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.305+0000 7f5b1a200640 1 -- start start 2024-04-24T23:09:13.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.307+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b140cc200 0x7f5b1406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.307+0000 7f5b1a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5b1406e230 0x7f5b1406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.307+0000 7f5b1a200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b14160420 con 0x7f5b14071f10 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.307+0000 7f5b1a200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1415d2a0 con 0x7f5b1406e230 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.307+0000 7f5b1a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1406e070 con 0x7f5b140cc200 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b18e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5b14071f10 0x7f5b1415cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48458/0 (socket says 172.21.15.146:48458) 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b18e00640 1 -- 172.21.15.146:0/811211877 learned_addr learned my addr 172.21.15.146:0/811211877 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b19800640 1 --2- 172.21.15.146:0/811211877 >> v2:172.21.15.146:3300/0 conn(0x7f5b1406e230 0x7f5b1406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b13e00640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b140cc200 0x7f5b1406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b13400640 1 -- 172.21.15.146:0/811211877 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33269659 0 0) 0x7f5b14160420 con 0x7f5b14071f10 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b13400640 1 -- 172.21.15.146:0/811211877 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5afc003520 con 0x7f5b14071f10 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b19800640 1 -- 172.21.15.146:0/811211877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b140cc200 msgr2=0x7f5b1406db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b19800640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b140cc200 0x7f5b1406db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b19800640 1 -- 172.21.15.146:0/811211877 >> v1:172.21.15.146:6789/0 conn(0x7f5b14071f10 legacy=0x7f5b1415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.308+0000 7f5b19800640 1 -- 172.21.15.146:0/811211877 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1415c390 con 0x7f5b1406e230 2024-04-24T23:09:13.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.309+0000 7f5b19800640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b1406e230 0x7f5b1406e680 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009d90 tx=0x7f5b0c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab21975fa82e5cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b13400640 1 -- 172.21.15.146:0/811211877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c007740 con 0x7f5b1406e230 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b13400640 1 -- 172.21.15.146:0/811211877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0078e0 con 0x7f5b1406e230 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b13400640 1 -- 172.21.15.146:0/811211877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c007cb0 con 0x7f5b1406e230 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 -- 172.21.15.146:0/811211877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b1406e230 msgr2=0x7f5b1406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b1406e230 0x7f5b1406e680 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009d90 tx=0x7f5b0c02a660 comp rx=0 tx=0).stop 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 -- 172.21.15.146:0/811211877 shutdown_connections 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b1406e230 0x7f5b1406e680 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 --2- 172.21.15.146:0/811211877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b140cc200 0x7f5b1406db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 -- 172.21.15.146:0/811211877 >> 172.21.15.146:0/811211877 conn(0x7f5b140b1460 msgr2=0x7f5b140b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 -- 172.21.15.146:0/811211877 shutdown_connections 2024-04-24T23:09:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.310+0000 7f5b1a200640 1 -- 172.21.15.146:0/811211877 wait complete. 2024-04-24T23:09:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.312+0000 7f5b1a200640 1 Processor -- start 2024-04-24T23:09:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.312+0000 7f5b1a200640 1 -- start start 2024-04-24T23:09:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b1406e230 0x7f5b140c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b140cc200 0x7f5b140b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b140722f0 con 0x7f5b14071f10 2024-04-24T23:09:13.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1406ebc0 con 0x7f5b140cc200 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b1a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1415c700 con 0x7f5b1406e230 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40604/0 (socket says 172.21.15.146:40604) 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.313+0000 7f5b13e00640 1 -- 172.21.15.146:0/762233935 learned_addr learned my addr 172.21.15.146:0/762233935 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 -- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b1406e230 msgr2=0x7f5b140c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b1406e230 0x7f5b140c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 -- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b140cc200 msgr2=0x7f5b140b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b140cc200 0x7f5b140b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 -- 172.21.15.146:0/762233935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b140b3040 con 0x7f5b14071f10 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b13e00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d800 tx=0x7f5b0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000b6c0 con 0x7f5b14071f10 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00019070 con 0x7f5b14071f10 2024-04-24T23:09:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b140b3320 con 0x7f5b14071f10 2024-04-24T23:09:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ba80 con 0x7f5b14071f10 2024-04-24T23:09:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.314+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b140b38e0 con 0x7f5b14071f10 2024-04-24T23:09:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.315+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1404f500 con 0x7f5b14071f10 2024-04-24T23:09:13.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.316+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b0000bc20 con 0x7f5b14071f10 2024-04-24T23:09:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.317+0000 7f5b10c00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.317+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6648+0+0 (secure 0 0 0) 0x7f5b0008b770 con 0x7f5b14071f10 2024-04-24T23:09:13.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.318+0000 7f5b18e00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.319+0000 7f5b18e00640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 0x7f5af406e320 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5b08000f60 tx=0x7f5b080078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:13.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.321+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5b0001c360 con 0x7f5b14071f10 2024-04-24T23:09:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:13.507+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b140724a0 con 0x7f5b14071f10 2024-04-24T23:09:14.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.081+0000 7f5b10c00640 1 -- 172.21.15.146:0/762233935 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) ==== 181+0+0 (secure 0 0 0) 0x7f5b00059cd0 con 0x7f5b14071f10 2024-04-24T23:09:14.082 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 msgr2=0x7f5af406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 0x7f5af406e320 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5b08000f60 tx=0x7f5b080078f0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 msgr2=0x7f5b140b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d800 tx=0x7f5b0000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 shutdown_connections 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b140cc200 0x7f5b140b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14071f10 0x7f5b140b40e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 --2- 172.21.15.146:0/762233935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b1406e230 0x7f5b140c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.087+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 >> 172.21.15.146:0/762233935 conn(0x7f5b140b1460 msgr2=0x7f5b140ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:14.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.088+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 shutdown_connections 2024-04-24T23:09:14.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.088+0000 7f5b1a200640 1 -- 172.21.15.146:0/762233935 wait complete. 2024-04-24T23:09:14.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:09:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.308+0000 7f5caf800640 1 Processor -- start 2024-04-24T23:09:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.309+0000 7f5caf800640 1 -- start start 2024-04-24T23:09:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.310+0000 7f5caf800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 0x7f5ca80728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.310+0000 7f5caf800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 0x7f5ca815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.310+0000 7f5caf800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca80cf040 con 0x7f5ca80ceaf0 2024-04-24T23:09:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.310+0000 7f5caf800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca81603a0 con 0x7f5ca815f9f0 2024-04-24T23:09:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.310+0000 7f5caf800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca80cf320 con 0x7f5ca8145510 2024-04-24T23:09:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.311+0000 7f5ca7e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f5ca80ceaf0 0x7f5ca806cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:45332/0 (socket says 172.21.15.146:45332) 2024-04-24T23:09:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.311+0000 7f5ca7e00640 1 -- 172.21.15.146:0/1849250893 learned_addr learned my addr 172.21.15.146:0/1849250893 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.311+0000 7f5cace00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 0x7f5ca80728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.311+0000 7f5cad800640 1 --2- 172.21.15.146:0/1849250893 >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 0x7f5ca815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5ca7400640 1 -- 172.21.15.146:0/1849250893 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422730612 0 0) 0x7f5ca80cf040 con 0x7f5ca80ceaf0 2024-04-24T23:09:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5ca7400640 1 -- 172.21.15.146:0/1849250893 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c90003520 con 0x7f5ca80ceaf0 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5cace00640 1 -- 172.21.15.146:0/1849250893 >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 msgr2=0x7f5ca815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5cace00640 1 --2- 172.21.15.146:0/1849250893 >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 0x7f5ca815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5cace00640 1 -- 172.21.15.146:0/1849250893 >> v1:172.21.15.203:6789/0 conn(0x7f5ca80ceaf0 legacy=0x7f5ca806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5cace00640 1 -- 172.21.15.146:0/1849250893 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca8070c70 con 0x7f5ca8145510 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.312+0000 7f5cad800640 1 --2- 172.21.15.146:0/1849250893 >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 0x7f5ca815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:09:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.314+0000 7f5cace00640 1 --2- 172.21.15.146:0/1849250893 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 0x7f5ca80728d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097a0 tx=0x7f5c9c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85de86df915c408 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.314+0000 7f5ca7400640 1 -- 172.21.15.146:0/1849250893 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c037070 con 0x7f5ca8145510 2024-04-24T23:09:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.314+0000 7f5ca7400640 1 -- 172.21.15.146:0/1849250893 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c02ae50 con 0x7f5ca8145510 2024-04-24T23:09:14.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.314+0000 7f5ca7400640 1 -- 172.21.15.146:0/1849250893 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c032660 con 0x7f5ca8145510 2024-04-24T23:09:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 -- 172.21.15.146:0/1849250893 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 msgr2=0x7f5ca80728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 --2- 172.21.15.146:0/1849250893 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 0x7f5ca80728d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097a0 tx=0x7f5c9c02a100 comp rx=0 tx=0).stop 2024-04-24T23:09:14.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 -- 172.21.15.146:0/1849250893 shutdown_connections 2024-04-24T23:09:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 --2- 172.21.15.146:0/1849250893 >> v2:172.21.15.203:3300/0 conn(0x7f5ca815f9f0 0x7f5ca815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 --2- 172.21.15.146:0/1849250893 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca8145510 0x7f5ca80728d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 -- 172.21.15.146:0/1849250893 >> 172.21.15.146:0/1849250893 conn(0x7f5ca80b16b0 msgr2=0x7f5ca80b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 -- 172.21.15.146:0/1849250893 shutdown_connections 2024-04-24T23:09:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.315+0000 7f5caf800640 1 -- 172.21.15.146:0/1849250893 wait complete. 2024-04-24T23:09:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.317+0000 7f5caf800640 1 Processor -- start 2024-04-24T23:09:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.317+0000 7f5caf800640 1 -- start start 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca80ceaf0 0x7f5ca81f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 0x7f5ca8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca806d290 con 0x7f5ca8145510 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8071230 con 0x7f5ca815f9f0 2024-04-24T23:09:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5caf800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca8072e10 con 0x7f5ca80ceaf0 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40610/0 (socket says 172.21.15.146:40610) 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.318+0000 7f5ca7e00640 1 -- 172.21.15.146:0/625102389 learned_addr learned my addr 172.21.15.146:0/625102389 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5cace00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca80ceaf0 0x7f5ca81f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5cad800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 0x7f5ca8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 -- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca80ceaf0 msgr2=0x7f5ca81f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca80ceaf0 0x7f5ca81f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 -- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 msgr2=0x7f5ca8155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 0x7f5ca8155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 -- 172.21.15.146:0/625102389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca81f4c30 con 0x7f5ca8145510 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5cad800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 0x7f5ca8155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca7e00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c430 tx=0x7f5c9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.319+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94017070 con 0x7f5ca8145510 2024-04-24T23:09:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.320+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c94005ce0 con 0x7f5ca8145510 2024-04-24T23:09:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.320+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c940072f0 con 0x7f5ca8145510 2024-04-24T23:09:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.320+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca80b2e20 con 0x7f5ca8145510 2024-04-24T23:09:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.320+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca80b33e0 con 0x7f5ca8145510 2024-04-24T23:09:14.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.321+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca8068190 con 0x7f5ca8145510 2024-04-24T23:09:14.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.322+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c9401a070 con 0x7f5ca8145510 2024-04-24T23:09:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.323+0000 7f5ca4c00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 0x7f5c8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.323+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6210+0+0 (secure 0 0 0) 0x7f5c9408a560 con 0x7f5ca8145510 2024-04-24T23:09:14.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.324+0000 7f5cace00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 0x7f5c8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.325+0000 7f5cace00640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 0x7f5c8806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c034000 tx=0x7f5c9c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.328+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5ca81f4c30 con 0x7f5ca8145510 2024-04-24T23:09:14.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:14.527+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ca806e580 con 0x7f5ca8145510 2024-04-24T23:09:15.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.100+0000 7f5ca4c00640 1 -- 172.21.15.146:0/625102389 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) ==== 169+0+0 (secure 0 0 0) 0x7f5c94058d10 con 0x7f5ca8145510 2024-04-24T23:09:15.101 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:09:15.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.106+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 msgr2=0x7f5c8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.106+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 0x7f5c8806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c034000 tx=0x7f5c9c02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.106+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 msgr2=0x7f5ca813b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.106+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c430 tx=0x7f5c9400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 shutdown_connections 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ca815f9f0 0x7f5ca8155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca8145510 0x7f5ca813b320 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f5c8806be30 0x7f5c8806e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 --2- 172.21.15.146:0/625102389 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ca80ceaf0 0x7f5ca81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 >> 172.21.15.146:0/625102389 conn(0x7f5ca80b16b0 msgr2=0x7f5ca806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:15.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 shutdown_connections 2024-04-24T23:09:15.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.107+0000 7f5caf800640 1 -- 172.21.15.146:0/625102389 wait complete. 2024-04-24T23:09:15.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:09:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.333+0000 7f8b6e000640 1 Processor -- start 2024-04-24T23:09:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.333+0000 7f8b6e000640 1 -- start start 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b68155460 0x7f8b6815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8b680b2ab0 0x7f8b6806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6806ec90 con 0x7f8b68155460 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8b680b3250 con 0x7f8b680b2ab0 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.334+0000 7f8b6e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b680b3530 con 0x7f8b6806e870 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b68155460 0x7f8b6815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b68155460 0x7f8b6815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40616/0 (socket says 172.21.15.146:40616) 2024-04-24T23:09:15.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 -- 172.21.15.146:0/3259875916 learned_addr learned my addr 172.21.15.146:0/3259875916 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 -- 172.21.15.146:0/3259875916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 msgr2=0x7f8b6815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 --2- 172.21.15.146:0/3259875916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 -- 172.21.15.146:0/3259875916 >> v2:172.21.15.203:3300/0 conn(0x7f8b680b2ab0 msgr2=0x7f8b6806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b5ea00640 1 --2- 172.21.15.146:0/3259875916 >> v2:172.21.15.203:3300/0 conn(0x7f8b680b2ab0 0x7f8b6806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 --2- 172.21.15.146:0/3259875916 >> v2:172.21.15.203:3300/0 conn(0x7f8b680b2ab0 0x7f8b6806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.335+0000 7f8b67400640 1 -- 172.21.15.146:0/3259875916 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b680b3810 con 0x7f8b68155460 2024-04-24T23:09:15.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.337+0000 7f8b67400640 1 --2- 172.21.15.146:0/3259875916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b68155460 0x7f8b6815be40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8b6806f010 tx=0x7f8b5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a468f07f3969378b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.337+0000 7f8b66a00640 1 -- 172.21.15.146:0/3259875916 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58037070 con 0x7f8b68155460 2024-04-24T23:09:15.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.337+0000 7f8b66a00640 1 -- 172.21.15.146:0/3259875916 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58032440 con 0x7f8b68155460 2024-04-24T23:09:15.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.337+0000 7f8b66a00640 1 -- 172.21.15.146:0/3259875916 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58032810 con 0x7f8b68155460 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 -- 172.21.15.146:0/3259875916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b68155460 msgr2=0x7f8b6815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3259875916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b68155460 0x7f8b6815be40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8b6806f010 tx=0x7f8b5802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 -- 172.21.15.146:0/3259875916 shutdown_connections 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3259875916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3259875916 >> v2:172.21.15.203:3300/0 conn(0x7f8b680b2ab0 0x7f8b6806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3259875916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b68155460 0x7f8b6815be40 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 -- 172.21.15.146:0/3259875916 >> 172.21.15.146:0/3259875916 conn(0x7f8b680b17b0 msgr2=0x7f8b680b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:15.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 -- 172.21.15.146:0/3259875916 shutdown_connections 2024-04-24T23:09:15.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.338+0000 7f8b6e000640 1 -- 172.21.15.146:0/3259875916 wait complete. 2024-04-24T23:09:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.340+0000 7f8b6e000640 1 Processor -- start 2024-04-24T23:09:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.340+0000 7f8b6e000640 1 -- start start 2024-04-24T23:09:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b68155460 0x7f8b680b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680b3af0 con 0x7f8b680b2ab0 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680b2f60 con 0x7f8b68155460 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b6e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6815c480 con 0x7f8b6806e870 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.341+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40618/0 (socket says 172.21.15.146:40618) 2024-04-24T23:09:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 -- 172.21.15.146:0/3298044864 learned_addr learned my addr 172.21.15.146:0/3298044864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b67400640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 -- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 msgr2=0x7f8b6813e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6813e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b67e00640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b68155460 0x7f8b680b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 -- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b68155460 msgr2=0x7f8b680b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b68155460 0x7f8b680b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 -- 172.21.15.146:0/3298044864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6814fc20 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.342+0000 7f8b5ea00640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c7f0 tx=0x7f8b5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.343+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50015070 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.343+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50004220 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.343+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50007620 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.343+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6814ff00 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.343+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b681504c0 con 0x7f8b680b2ab0 2024-04-24T23:09:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.344+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6804f5a0 con 0x7f8b680b2ab0 2024-04-24T23:09:15.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.345+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b500079d0 con 0x7f8b680b2ab0 2024-04-24T23:09:15.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.346+0000 7f8b5fe00640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 0x7f8b4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.346+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7f8b5008b280 con 0x7f8b680b2ab0 2024-04-24T23:09:15.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.347+0000 7f8b67400640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 0x7f8b4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.348+0000 7f8b67400640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 0x7f8b4406e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b58034000 tx=0x7f8b5802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.351+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b50059b70 con 0x7f8b680b2ab0 2024-04-24T23:09:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.549+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8b6815ac30 con 0x7f8b680b2ab0 2024-04-24T23:09:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.555+0000 7f8b5fe00640 1 -- 172.21.15.146:0/3298044864 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f8b50059470 con 0x7f8b680b2ab0 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 msgr2=0x7f8b4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 0x7f8b4406e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b58034000 tx=0x7f8b5802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 msgr2=0x7f8b680b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c7f0 tx=0x7f8b5000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 shutdown_connections 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b68155460 0x7f8b680b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b680b2ab0 0x7f8b680b0480 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b4406be30 0x7f8b4406e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 --2- 172.21.15.146:0/3298044864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b6806e870 0x7f8b6813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 >> 172.21.15.146:0/3298044864 conn(0x7f8b680b17b0 msgr2=0x7f8b680d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 shutdown_connections 2024-04-24T23:09:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.558+0000 7f8b6e000640 1 -- 172.21.15.146:0/3298044864 wait complete. 2024-04-24T23:09:15.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-04-24T23:09:15.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.777+0000 7f2a8ec00640 1 Processor -- start 2024-04-24T23:09:15.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.777+0000 7f2a8ec00640 1 -- start start 2024-04-24T23:09:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a8ec00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a880d03a0 0x7f2a88071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a8ec00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a88158970 con 0x7f2a880715f0 2024-04-24T23:09:15.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a8ec00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a88070c10 con 0x7f2a88158590 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a8ec00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a88070ef0 con 0x7f2a880d03a0 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a87400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a880715f0 0x7f2a880cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48462/0 (socket says 172.21.15.146:48462) 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a87400640 1 -- 172.21.15.146:0/685361344 learned_addr learned my addr 172.21.15.146:0/685361344 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.779+0000 7f2a8cc00640 1 --2- 172.21.15.146:0/685361344 >> v2:172.21.15.146:3300/0 conn(0x7f2a880d03a0 0x7f2a88071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.780+0000 7f2a8cc00640 1 -- 172.21.15.146:0/685361344 >> v1:172.21.15.203:6789/0 conn(0x7f2a88158590 legacy=0x7f2a88162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.780+0000 7f2a8cc00640 1 -- 172.21.15.146:0/685361344 >> v1:172.21.15.146:6789/0 conn(0x7f2a880715f0 legacy=0x7f2a880cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.780+0000 7f2a8cc00640 1 -- 172.21.15.146:0/685361344 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a880711d0 con 0x7f2a880d03a0 2024-04-24T23:09:15.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.780+0000 7f2a86a00640 1 -- 172.21.15.146:0/685361344 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744799561 0 0) 0x7f2a88158970 con 0x7f2a880715f0 2024-04-24T23:09:15.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.781+0000 7f2a8cc00640 1 --2- 172.21.15.146:0/685361344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880d03a0 0x7f2a88071a70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acab9e5fbba96469 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.781+0000 7f2a86a00640 1 -- 172.21.15.146:0/685361344 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80007740 con 0x7f2a880d03a0 2024-04-24T23:09:15.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.781+0000 7f2a86a00640 1 -- 172.21.15.146:0/685361344 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a800078e0 con 0x7f2a880d03a0 2024-04-24T23:09:15.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.781+0000 7f2a86a00640 1 -- 172.21.15.146:0/685361344 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80007cb0 con 0x7f2a880d03a0 2024-04-24T23:09:15.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 -- 172.21.15.146:0/685361344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880d03a0 msgr2=0x7f2a88071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/685361344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880d03a0 0x7f2a88071a70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002a730 comp rx=0 tx=0).stop 2024-04-24T23:09:15.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 -- 172.21.15.146:0/685361344 shutdown_connections 2024-04-24T23:09:15.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/685361344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880d03a0 0x7f2a88071a70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 -- 172.21.15.146:0/685361344 >> 172.21.15.146:0/685361344 conn(0x7f2a8806b320 msgr2=0x7f2a8806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:15.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 -- 172.21.15.146:0/685361344 shutdown_connections 2024-04-24T23:09:15.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.782+0000 7f2a8ec00640 1 -- 172.21.15.146:0/685361344 wait complete. 2024-04-24T23:09:15.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.784+0000 7f2a8ec00640 1 Processor -- start 2024-04-24T23:09:15.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.785+0000 7f2a8ec00640 1 -- start start 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a880d03a0 0x7f2a881f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a88158590 0x7f2a8815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8815e4e0 con 0x7f2a880715f0 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88161f30 con 0x7f2a880d03a0 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a8ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8815e660 con 0x7f2a88158590 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40636/0 (socket says 172.21.15.146:40636) 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.786+0000 7f2a87e00640 1 -- 172.21.15.146:0/3429719907 learned_addr learned my addr 172.21.15.146:0/3429719907 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 -- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a88158590 msgr2=0x7f2a8815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a88158590 0x7f2a8815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 -- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a880d03a0 msgr2=0x7f2a881f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a880d03a0 0x7f2a881f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 -- 172.21.15.146:0/3429719907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8814fc80 con 0x7f2a880715f0 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a87e00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800b420 tx=0x7f2a7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78011830 con 0x7f2a880715f0 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a78016070 con 0x7f2a880715f0 2024-04-24T23:09:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8815b6f0 con 0x7f2a880715f0 2024-04-24T23:09:15.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78011c10 con 0x7f2a880715f0 2024-04-24T23:09:15.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.787+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a881e7d00 con 0x7f2a880715f0 2024-04-24T23:09:15.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.789+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a88068190 con 0x7f2a880715f0 2024-04-24T23:09:15.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.790+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a7801b460 con 0x7f2a880715f0 2024-04-24T23:09:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.791+0000 7f2a7fe00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 0x7f2a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.791+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7f2a7808a8b0 con 0x7f2a880715f0 2024-04-24T23:09:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.791+0000 7f2a87400640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 0x7f2a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.792+0000 7f2a87400640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 0x7f2a6806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2a740011e0 tx=0x7f2a74007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:15.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:15.795+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a78020020 con 0x7f2a880715f0 2024-04-24T23:09:16.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.063+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) -- 0x7f2a8815c4c0 con 0x7f2a880715f0 2024-04-24T23:09:16.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.103+0000 7f2a7fe00640 1 -- 172.21.15.146:0/3429719907 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v406) ==== 140+0+0 (secure 0 0 0) 0x7f2a780592c0 con 0x7f2a880715f0 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.106+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 msgr2=0x7f2a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.106+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 0x7f2a6806e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2a740011e0 tx=0x7f2a74007940 comp rx=0 tx=0).stop 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.106+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 msgr2=0x7f2a880af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.106+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800b420 tx=0x7f2a7800b8e0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 shutdown_connections 2024-04-24T23:09:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a6806be30 0x7f2a6806e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a88158590 0x7f2a8815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a880d03a0 0x7f2a881f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 --2- 172.21.15.146:0/3429719907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a880715f0 0x7f2a880af690 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 >> 172.21.15.146:0/3429719907 conn(0x7f2a8806b320 msgr2=0x7f2a880cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 shutdown_connections 2024-04-24T23:09:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.107+0000 7f2a8ec00640 1 -- 172.21.15.146:0/3429719907 wait complete. 2024-04-24T23:09:16.125 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into ... ok 2024-04-24T23:09:16.125 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-04-24T23:09:16.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.320+0000 7fab00200640 1 Processor -- start 2024-04-24T23:09:16.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.320+0000 7fab00200640 1 -- start start 2024-04-24T23:09:16.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7fab00200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaf8145640 0x7faaf815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7fab00200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 0x7faaf80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7fab00200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf80cdf70 con 0x7faaf80b2a20 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7fab00200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faaf815d360 con 0x7faaf8145640 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7fab00200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faaf8145a20 con 0x7faaf80d03a0 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7faafd800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaf8145640 0x7faaf815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7faafd800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaf8145640 0x7faaf815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40646/0 (socket says 172.21.15.146:40646) 2024-04-24T23:09:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.322+0000 7faafd800640 1 -- 172.21.15.146:0/31041219 learned_addr learned my addr 172.21.15.146:0/31041219 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafe200640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 0x7faaf80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafd800640 1 -- 172.21.15.146:0/31041219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 msgr2=0x7faaf80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafd800640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 0x7faaf80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafd800640 1 -- 172.21.15.146:0/31041219 >> v1:172.21.15.203:6789/0 conn(0x7faaf80b2a20 legacy=0x7faaf80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafd800640 1 -- 172.21.15.146:0/31041219 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf806d140 con 0x7faaf8145640 2024-04-24T23:09:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.323+0000 7faafe200640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 0x7faaf80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.324+0000 7faafd800640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf8145640 0x7faaf815ce20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7faaf80cfa20 tx=0x7faaec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9916dba4f705dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.325+0000 7faaf7e00640 1 -- 172.21.15.146:0/31041219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec036070 con 0x7faaf8145640 2024-04-24T23:09:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.325+0000 7faaf7e00640 1 -- 172.21.15.146:0/31041219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec031600 con 0x7faaf8145640 2024-04-24T23:09:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.325+0000 7faaf7e00640 1 -- 172.21.15.146:0/31041219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec0319d0 con 0x7faaf8145640 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.325+0000 7fab00200640 1 -- 172.21.15.146:0/31041219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf8145640 msgr2=0x7faaf815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.325+0000 7fab00200640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf8145640 0x7faaf815ce20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7faaf80cfa20 tx=0x7faaec02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 -- 172.21.15.146:0/31041219 shutdown_connections 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf80d03a0 0x7faaf80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 --2- 172.21.15.146:0/31041219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf8145640 0x7faaf815ce20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 -- 172.21.15.146:0/31041219 >> 172.21.15.146:0/31041219 conn(0x7faaf806b320 msgr2=0x7faaf806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 -- 172.21.15.146:0/31041219 shutdown_connections 2024-04-24T23:09:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.326+0000 7fab00200640 1 -- 172.21.15.146:0/31041219 wait complete. 2024-04-24T23:09:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.328+0000 7fab00200640 1 Processor -- start 2024-04-24T23:09:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.328+0000 7fab00200640 1 -- start start 2024-04-24T23:09:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaf80b2a20 0x7faaf815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf8145640 0x7faaf8072680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faaf806d9e0 con 0x7faaf80d03a0 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faaf806d700 con 0x7faaf80b2a20 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7fab00200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faaf806cbc0 con 0x7faaf8145640 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.329+0000 7faafce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40656/0 (socket says 172.21.15.146:40656) 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 -- 172.21.15.146:0/1038037091 learned_addr learned my addr 172.21.15.146:0/1038037091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafd800640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaf80b2a20 0x7faaf815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 -- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf8145640 msgr2=0x7faaf8072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf8145640 0x7faaf8072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 -- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaf80b2a20 msgr2=0x7faaf815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaf80b2a20 0x7faaf815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 -- 172.21.15.146:0/1038037091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf815db10 con 0x7faaf80d03a0 2024-04-24T23:09:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.330+0000 7faafce00640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7faae400c430 tx=0x7faae400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.331+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4011790 con 0x7faaf80d03a0 2024-04-24T23:09:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.331+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae4017070 con 0x7faaf80d03a0 2024-04-24T23:09:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.331+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4011bb0 con 0x7faaf80d03a0 2024-04-24T23:09:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.331+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf815ddf0 con 0x7faaf80d03a0 2024-04-24T23:09:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.331+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf815e3b0 con 0x7faaf80d03a0 2024-04-24T23:09:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.332+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf8068190 con 0x7faaf80d03a0 2024-04-24T23:09:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.333+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faae401c460 con 0x7faaf80d03a0 2024-04-24T23:09:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.334+0000 7faaf5600640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.334+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7faae408ac30 con 0x7faaf80d03a0 2024-04-24T23:09:16.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.334+0000 7faafd800640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.336+0000 7faafd800640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 0x7faad806e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faaec033000 tx=0x7faaec009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.338+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faae4059650 con 0x7faaf80d03a0 2024-04-24T23:09:16.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.538+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faaf8159070 con 0x7faaf80d03a0 2024-04-24T23:09:16.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.540+0000 7faaf5600640 1 -- 172.21.15.146:0/1038037091 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+13712 (secure 0 0 0) 0x7faae4058f50 con 0x7faaf80d03a0 2024-04-24T23:09:16.542 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:16.542 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":76,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:15.096518+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/1781418579":"2024-04-25T23:09:12.008625+0000","172.21.15.146:6834/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/381160219":"2024-04-25T23:08:53.528060+0000","172.21.15.146:6832/1781418579":"2024-04-25T23:09:12.008625+0000","172.21.15.203:6835/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6834/896278918":"2024-04-25T23:07:41.602501+0000","172.21.15.203:6837/4094476555":"2024-04-25T23:08:54.973021+0000","172.21.15.146:6832/896278918":"2024-04-25T23:07:41.602501+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.543+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 msgr2=0x7faad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.543+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 0x7faad806e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faaec033000 tx=0x7faaec009000 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.543+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 msgr2=0x7faaf81557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.543+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7faae400c430 tx=0x7faae400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 shutdown_connections 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faaf8145640 0x7faaf8072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf80d03a0 0x7faaf81557d0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 --2- 172.21.15.146:0/1038037091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faaf80b2a20 0x7faaf815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 >> 172.21.15.146:0/1038037091 conn(0x7faaf806b320 msgr2=0x7faaf80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 shutdown_connections 2024-04-24T23:09:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.544+0000 7fab00200640 1 -- 172.21.15.146:0/1038037091 wait complete. 2024-04-24T23:09:16.563 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:16.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:16.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.766+0000 7ffb21a00640 1 Processor -- start 2024-04-24T23:09:16.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.766+0000 7ffb21a00640 1 -- start start 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.767+0000 7ffb21a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.767+0000 7ffb21a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c15cd60 0x7ffb1c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.767+0000 7ffb21a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0b4df0 con 0x7ffb1c0d0200 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.767+0000 7ffb21a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c15c8d0 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.767+0000 7ffb21a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0b4b10 con 0x7ffb1c15cd60 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40672/0 (socket says 172.21.15.146:40672) 2024-04-24T23:09:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 -- 172.21.15.146:0/2872219210 learned_addr learned my addr 172.21.15.146:0/2872219210 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb13400640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c15cd60 0x7ffb1c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 -- 172.21.15.146:0/2872219210 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c15cd60 msgr2=0x7ffb1c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c15cd60 0x7ffb1c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 -- 172.21.15.146:0/2872219210 >> v1:172.21.15.146:6789/0 conn(0x7ffb1c0d0200 legacy=0x7ffb1c06c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1be00640 1 -- 172.21.15.146:0/2872219210 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c15c280 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.768+0000 7ffb1b400640 1 -- 172.21.15.146:0/2872219210 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704211614 0 0) 0x7ffb1c0b4df0 con 0x7ffb1c0d0200 2024-04-24T23:09:16.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.769+0000 7ffb1be00640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009870 tx=0x7ffb0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35461129c10a2e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb1b400640 1 -- 172.21.15.146:0/2872219210 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c037070 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb1b400640 1 -- 172.21.15.146:0/2872219210 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c032440 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb1b400640 1 -- 172.21.15.146:0/2872219210 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c032810 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 -- 172.21.15.146:0/2872219210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15bcd0 msgr2=0x7ffb1c0cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009870 tx=0x7ffb0c02a270 comp rx=0 tx=0).stop 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 -- 172.21.15.146:0/2872219210 shutdown_connections 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c15cd60 0x7ffb1c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2872219210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cc230 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 -- 172.21.15.146:0/2872219210 >> 172.21.15.146:0/2872219210 conn(0x7ffb1c06b560 msgr2=0x7ffb1c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 -- 172.21.15.146:0/2872219210 shutdown_connections 2024-04-24T23:09:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.770+0000 7ffb21a00640 1 -- 172.21.15.146:0/2872219210 wait complete. 2024-04-24T23:09:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.772+0000 7ffb21a00640 1 Processor -- start 2024-04-24T23:09:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.772+0000 7ffb21a00640 1 -- start start 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c0d0200 0x7ffb1c1451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c06e590 con 0x7ffb1c15cd60 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0cc770 con 0x7ffb1c15bcd0 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0b4790 con 0x7ffb1c0d0200 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.773+0000 7ffb21000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40688/0 (socket says 172.21.15.146:40688) 2024-04-24T23:09:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 -- 172.21.15.146:0/2261690847 learned_addr learned my addr 172.21.15.146:0/2261690847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb1be00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c0d0200 0x7ffb1c1451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 -- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c0d0200 msgr2=0x7ffb1c1451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb13400640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c0d0200 0x7ffb1c1451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 -- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb1c15bcd0 msgr2=0x7ffb1c0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 -- 172.21.15.146:0/2261690847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c1e5a50 con 0x7ffb1c15cd60 2024-04-24T23:09:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21000640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c790 tx=0x7ffb1400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14003da0 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14005070 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.774+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c1e5d30 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.775+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14005460 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.775+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c1e65d0 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.776+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c1e5f00 con 0x7ffb1c15cd60 2024-04-24T23:09:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.777+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb14005600 con 0x7ffb1c15cd60 2024-04-24T23:09:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.777+0000 7ffb18c00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 0x7ffaf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.778+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7ffb1408ae10 con 0x7ffb1c15cd60 2024-04-24T23:09:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.778+0000 7ffb1be00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 0x7ffaf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.779+0000 7ffb1be00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 0x7ffaf806e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c034000 tx=0x7ffb0c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:16.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.782+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb1408e030 con 0x7ffb1c15cd60 2024-04-24T23:09:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.964+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffb1c04f500 con 0x7ffb1c15cd60 2024-04-24T23:09:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.965+0000 7ffb18c00640 1 -- 172.21.15.146:0/2261690847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7ffb14059790 con 0x7ffb1c15cd60 2024-04-24T23:09:16.966 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:16.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 msgr2=0x7ffaf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 0x7ffaf806e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c034000 tx=0x7ffb0c02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 msgr2=0x7ffb1c1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c790 tx=0x7ffb1400cc50 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 shutdown_connections 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb1c15cd60 0x7ffb1c1555f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb1c15bcd0 0x7ffb1c0cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ffaf806be30 0x7ffaf806e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 --2- 172.21.15.146:0/2261690847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb1c0d0200 0x7ffb1c1451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 >> 172.21.15.146:0/2261690847 conn(0x7ffb1c06b560 msgr2=0x7ffb1c15e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.967+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 shutdown_connections 2024-04-24T23:09:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:16.968+0000 7ffb21a00640 1 -- 172.21.15.146:0/2261690847 wait complete. 2024-04-24T23:09:16.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-04-24T23:09:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.187+0000 7fbdbe000640 1 Processor -- start 2024-04-24T23:09:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.187+0000 7fbdbe000640 1 -- start start 2024-04-24T23:09:17.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdbe000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 0x7fbdb80cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdbe000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdb8071320 0x7fbdb80d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdbe000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb81449c0 con 0x7fbdb80728c0 2024-04-24T23:09:17.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdbe000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb8072430 con 0x7fbdb8071320 2024-04-24T23:09:17.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdbe000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb80b2d70 con 0x7fbdb81445e0 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdb7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdb8071320 0x7fbdb80d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdb7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdb8071320 0x7fbdb80d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40698/0 (socket says 172.21.15.146:40698) 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.189+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4029076041 learned_addr learned my addr 172.21.15.146:0/4029076041 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4029076041 >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 0x7fbdb80cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4029076041 >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 msgr2=0x7fbdb80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7e00640 1 --2- 172.21.15.146:0/4029076041 >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 0x7fbdb80cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4029076041 >> v1:172.21.15.203:6789/0 conn(0x7fbdb80728c0 legacy=0x7fbdb8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4029076041 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8071820 con 0x7fbdb8071320 2024-04-24T23:09:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.190+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4029076041 >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 0x7fbdb80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.191+0000 7fbdb7e00640 1 --2- 172.21.15.146:0/4029076041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb8071320 0x7fbdb80d01d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80d08a0 tx=0x7fbdb002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860314ab5079cf6f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.191+0000 7fbdb6000640 1 -- 172.21.15.146:0/4029076041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0036070 con 0x7fbdb8071320 2024-04-24T23:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdb6000640 1 -- 172.21.15.146:0/4029076041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb0031600 con 0x7fbdb8071320 2024-04-24T23:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdb6000640 1 -- 172.21.15.146:0/4029076041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00319d0 con 0x7fbdb8071320 2024-04-24T23:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 -- 172.21.15.146:0/4029076041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb8071320 msgr2=0x7fbdb80d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4029076041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb8071320 0x7fbdb80d01d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80d08a0 tx=0x7fbdb002a6f0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 -- 172.21.15.146:0/4029076041 shutdown_connections 2024-04-24T23:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4029076041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb8071320 0x7fbdb80d01d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4029076041 >> v2:172.21.15.203:3300/0 conn(0x7fbdb81445e0 0x7fbdb80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 -- 172.21.15.146:0/4029076041 >> 172.21.15.146:0/4029076041 conn(0x7fbdb806b320 msgr2=0x7fbdb806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 -- 172.21.15.146:0/4029076041 shutdown_connections 2024-04-24T23:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.192+0000 7fbdbe000640 1 -- 172.21.15.146:0/4029076041 wait complete. 2024-04-24T23:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.194+0000 7fbdbe000640 1 Processor -- start 2024-04-24T23:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.194+0000 7fbdbe000640 1 -- start start 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 0x7fbdb815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 0x7fbdb813ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80720c0 con 0x7fbdb81445e0 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8071de0 con 0x7fbdb80728c0 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.195+0000 7fbdbe000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80cced0 con 0x7fbdb8071320 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40702/0 (socket says 172.21.15.146:40702) 2024-04-24T23:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4204255842 learned_addr learned my addr 172.21.15.146:0/4204255842 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 0x7fbdb815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb6a00640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 0x7fbdb813ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 msgr2=0x7fbdb815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 0x7fbdb815a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 msgr2=0x7fbdb813ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 0x7fbdb813ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 -- 172.21.15.146:0/4204255842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb813dd80 con 0x7fbdb81445e0 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 0x7fbdb815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb6a00640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 0x7fbdb813ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.196+0000 7fbdb7e00640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009f40 tx=0x7fbdb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:17.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.197+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0036050 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.197+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb0042070 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.197+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0009510 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.197+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb813e020 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.197+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb813e5e0 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.198+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb8068190 con 0x7fbdb81445e0 2024-04-24T23:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.199+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdb0007bd0 con 0x7fbdb81445e0 2024-04-24T23:09:17.203 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:17.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.200+0000 7fbdaf400640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 0x7fbd9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.200+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7fbdb00abdf0 con 0x7fbdb81445e0 2024-04-24T23:09:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.200+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 0x7fbd9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.202+0000 7fbdb7400640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 0x7fbd9806e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.204+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbdb007a810 con 0x7fbdb81445e0 2024-04-24T23:09:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:17.485+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) -- 0x7fbdb806eab0 con 0x7fbdb81445e0 2024-04-24T23:09:18.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.117+0000 7fbdaf400640 1 -- 172.21.15.146:0/4204255842 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v408) ==== 148+0+0 (secure 0 0 0) 0x7fbdb007a110 con 0x7fbdb81445e0 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.120+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 msgr2=0x7fbd9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.120+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 0x7fbd9806e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8008040 comp rx=0 tx=0).stop 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.120+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 msgr2=0x7fbdb81f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.120+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009f40 tx=0x7fbdb0004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 shutdown_connections 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdb81445e0 0x7fbdb81f1c90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdb80728c0 0x7fbdb813ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbd9806be30 0x7fbd9806e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 --2- 172.21.15.146:0/4204255842 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbdb8071320 0x7fbdb815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 >> 172.21.15.146:0/4204255842 conn(0x7fbdb806b320 msgr2=0x7fbdb80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 shutdown_connections 2024-04-24T23:09:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.121+0000 7fbdbe000640 1 -- 172.21.15.146:0/4204255842 wait complete. 2024-04-24T23:09:18.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:09:18.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.346+0000 7fd7cbe00640 1 Processor -- start 2024-04-24T23:09:18.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.347+0000 7fd7cbe00640 1 -- start start 2024-04-24T23:09:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.348+0000 7fd7cbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7c40d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.348+0000 7fd7cbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c40cc8b0 con 0x7fd7c41608c0 2024-04-24T23:09:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.348+0000 7fd7cbe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c40d06f0 con 0x7fd7c415f780 2024-04-24T23:09:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.348+0000 7fd7cbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c40ccec0 con 0x7fd7c415f3a0 2024-04-24T23:09:18.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.349+0000 7fd7c8a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd7c41608c0 0x7fd7c40b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41376/0 (socket says 172.21.15.146:41376) 2024-04-24T23:09:18.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.349+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2368784173 learned_addr learned my addr 172.21.15.146:0/2368784173 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:18.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.349+0000 7fd7c9400640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7c40d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.349+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317815933 0 0) 0x7fd7c40cc8b0 con 0x7fd7c41608c0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.349+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7a8003520 con 0x7fd7c41608c0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916173176 0 0) 0x7fd7a8003520 con 0x7fd7c41608c0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 msgr2=0x7fd7c40d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7c40d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 >> v1:172.21.15.203:6789/0 conn(0x7fd7c415f780 legacy=0x7fd7c40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c40d09d0 con 0x7fd7c41608c0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fd7b00019f0 con 0x7fd7c41608c0 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 >> v1:172.21.15.146:6789/0 conn(0x7fd7c41608c0 legacy=0x7fd7c40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a8003f60 0x7fd7a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7a8004d40 0x7fd7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40ccec0 con 0x7fd7a8003f60 2024-04-24T23:09:18.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a800bb30 con 0x7fd7a8004d40 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a800bd30 con 0x7fd7c415f3a0 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a8003f60 0x7fd7a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c9e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7a8004d40 0x7fd7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c9400640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 msgr2=0x7fd7a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.350+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7c415f3a0 0x7fd7a80039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.351+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7a8004d40 msgr2=0x7fd7a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.351+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7a8004d40 0x7fd7a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.351+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2368784173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a8003520 con 0x7fd7a8003f60 2024-04-24T23:09:18.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.351+0000 7fd7c9e00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7a8004d40 0x7fd7a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a8003f60 0x7fd7a8004800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000a850 tx=0x7fd7a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257f48de79159594 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000a4a0 con 0x7fd7a8003f60 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b002f070 con 0x7fd7a8003f60 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7c3e00640 1 -- 172.21.15.146:0/2368784173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002bd20 con 0x7fd7a8003f60 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2368784173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a8003f60 msgr2=0x7fd7a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2368784173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a8003f60 0x7fd7a8004800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000a850 tx=0x7fd7a8005830 comp rx=0 tx=0).stop 2024-04-24T23:09:18.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7c9e00640 1 -- 172.21.15.146:0/2368784173 reap_dead start 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2368784173 shutdown_connections 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.352+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2368784173 >> 172.21.15.146:0/2368784173 conn(0x7fd7c40d1da0 msgr2=0x7fd7c40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.353+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2368784173 shutdown_connections 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.353+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2368784173 wait complete. 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.354+0000 7fd7cbe00640 1 Processor -- start 2024-04-24T23:09:18.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.354+0000 7fd7cbe00640 1 -- start start 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7a8003f60 0x7fd7c415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7c4155ec0 0x7fd7c4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40d0380 con 0x7fd7c40c9850 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40b5300 con 0x7fd7c4155ec0 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.355+0000 7fd7cbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c40cda60 con 0x7fd7a8003f60 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59298/0 (socket says 172.21.15.146:59298) 2024-04-24T23:09:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2015417243 learned_addr learned my addr 172.21.15.146:0/2015417243 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c9e00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7c4155ec0 0x7fd7c4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c9400640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7a8003f60 0x7fd7c415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7a8003f60 msgr2=0x7fd7c415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7a8003f60 0x7fd7c415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7c4155ec0 msgr2=0x7fd7c4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7c4155ec0 0x7fd7c4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.356+0000 7fd7c8a00640 1 -- 172.21.15.146:0/2015417243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c40ca460 con 0x7fd7c40c9850 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7c8a00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd7b002b530 tx=0x7fd7b0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0044070 con 0x7fd7c40c9850 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b002bc90 con 0x7fd7c40c9850 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c40ca740 con 0x7fd7c40c9850 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00346b0 con 0x7fd7c40c9850 2024-04-24T23:09:18.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.357+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c40cad00 con 0x7fd7c40c9850 2024-04-24T23:09:18.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.358+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c404f570 con 0x7fd7c40c9850 2024-04-24T23:09:18.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.359+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7b0047070 con 0x7fd7c40c9850 2024-04-24T23:09:18.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.360+0000 7fd7c1600640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 0x7fd7a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:18.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.361+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7fd7b00ab0d0 con 0x7fd7c40c9850 2024-04-24T23:09:18.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.361+0000 7fd7c9400640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 0x7fd7a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:18.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.362+0000 7fd7c9400640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 0x7fd7a406e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd7c406b790 tx=0x7fd7b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:18.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.365+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd7b0079a50 con 0x7fd7c40c9850 2024-04-24T23:09:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.565+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd7c40b7d20 con 0x7fd7c40c9850 2024-04-24T23:09:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.572+0000 7fd7c1600640 1 -- 172.21.15.146:0/2015417243 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd7b0079350 con 0x7fd7c40c9850 2024-04-24T23:09:18.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 msgr2=0x7fd7a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 0x7fd7a406e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd7c406b790 tx=0x7fd7b4008040 comp rx=0 tx=0).stop 2024-04-24T23:09:18.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 msgr2=0x7fd7c40c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:18.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd7b002b530 tx=0x7fd7b0001dc0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 shutdown_connections 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7c4155ec0 0x7fd7c4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c40c9850 0x7fd7c40c9cd0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd7a406be30 0x7fd7a406e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 --2- 172.21.15.146:0/2015417243 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7a8003f60 0x7fd7c415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 >> 172.21.15.146:0/2015417243 conn(0x7fd7c40d1da0 msgr2=0x7fd7c406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 shutdown_connections 2024-04-24T23:09:18.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:18.575+0000 7fd7cbe00640 1 -- 172.21.15.146:0/2015417243 wait complete. 2024-04-24T23:09:18.595 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:09:18.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:18.683 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:18.793 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:09:18.793 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:18.793 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:18.850 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:18.850 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:18.850 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:18.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:18.908 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:18.908 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:18.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:18.964 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:18.964 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:19.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:19.021 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:09:19.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.225+0000 7f9be2600640 1 Processor -- start 2024-04-24T23:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.225+0000 7f9be2600640 1 -- start start 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9be2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc0d03a0 0x7f9bdc070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9be2600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9bdc0728c0 0x7f9bdc071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9be2600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc1449c0 con 0x7f9bdc1445e0 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9be2600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9bdc072430 con 0x7f9bdc0728c0 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9be2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc0b2d70 con 0x7f9bdc0d03a0 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9bdb400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9bdc1445e0 0x7f9bdc0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41382/0 (socket says 172.21.15.146:41382) 2024-04-24T23:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9bdb400640 1 -- 172.21.15.146:0/573042896 learned_addr learned my addr 172.21.15.146:0/573042896 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9bdbe00640 1 --2- 172.21.15.146:0/573042896 >> v2:172.21.15.146:3300/0 conn(0x7f9bdc0728c0 0x7f9bdc071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.227+0000 7f9bdaa00640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc0d03a0 0x7f9bdc070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.228+0000 7f9bdbe00640 1 -- 172.21.15.146:0/573042896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc0d03a0 msgr2=0x7f9bdc070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.228+0000 7f9bdbe00640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc0d03a0 0x7f9bdc070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.228+0000 7f9bdbe00640 1 -- 172.21.15.146:0/573042896 >> v1:172.21.15.146:6789/0 conn(0x7f9bdc1445e0 legacy=0x7f9bdc0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.228+0000 7f9bdbe00640 1 -- 172.21.15.146:0/573042896 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc071820 con 0x7f9bdc0728c0 2024-04-24T23:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.228+0000 7f9bda000640 1 -- 172.21.15.146:0/573042896 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625299238 0 0) 0x7f9bdc1449c0 con 0x7f9bdc1445e0 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.229+0000 7f9bdbe00640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc071150 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009d90 tx=0x7f9bd402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876ac8fb49b8e000 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.229+0000 7f9bda000640 1 -- 172.21.15.146:0/573042896 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4007740 con 0x7f9bdc0728c0 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.229+0000 7f9bda000640 1 -- 172.21.15.146:0/573042896 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd40078e0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.229+0000 7f9bda000640 1 -- 172.21.15.146:0/573042896 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4007cb0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 -- 172.21.15.146:0/573042896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 msgr2=0x7f9bdc071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc071150 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009d90 tx=0x7f9bd402a660 comp rx=0 tx=0).stop 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 -- 172.21.15.146:0/573042896 shutdown_connections 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc071150 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 --2- 172.21.15.146:0/573042896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc0d03a0 0x7f9bdc070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 -- 172.21.15.146:0/573042896 >> 172.21.15.146:0/573042896 conn(0x7f9bdc06b320 msgr2=0x7f9bdc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 -- 172.21.15.146:0/573042896 shutdown_connections 2024-04-24T23:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.230+0000 7f9be2600640 1 -- 172.21.15.146:0/573042896 wait complete. 2024-04-24T23:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.232+0000 7f9be2600640 1 Processor -- start 2024-04-24T23:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.232+0000 7f9be2600640 1 -- start start 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc0d03a0 0x7f9bdc1337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc1445e0 0x7f9bdc133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc0720c0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc071de0 con 0x7f9bdc0d03a0 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9be2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc06cbc0 con 0x7f9bdc1445e0 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59316/0 (socket says 172.21.15.146:59316) 2024-04-24T23:09:19.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 -- 172.21.15.146:0/1041917003 learned_addr learned my addr 172.21.15.146:0/1041917003 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:19.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdaa00640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc0d03a0 0x7f9bdc1337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 -- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc1445e0 msgr2=0x7f9bdc133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc1445e0 0x7f9bdc133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 -- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc0d03a0 msgr2=0x7f9bdc1337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc0d03a0 0x7f9bdc1337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.233+0000 7f9bdb400640 1 -- 172.21.15.146:0/1041917003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc134590 con 0x7f9bdc0728c0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9bdb400640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c430 tx=0x7f9bcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0074e0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0047e0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc004bd0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc134870 con 0x7f9bdc0728c0 2024-04-24T23:09:19.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.234+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc134240 con 0x7f9bdc0728c0 2024-04-24T23:09:19.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.235+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc068190 con 0x7f9bdc0728c0 2024-04-24T23:09:19.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.236+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bcc011070 con 0x7f9bdc0728c0 2024-04-24T23:09:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.237+0000 7f9bd3400640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 0x7f9bbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.237+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7f9bcc08aaa0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.238+0000 7f9bdaa00640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 0x7f9bbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.239+0000 7f9bdaa00640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 0x7f9bbc06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc1f77f0 tx=0x7f9bc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.241+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9bcc0594b0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.478+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bdc13aa80 con 0x7f9bdc0728c0 2024-04-24T23:09:19.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.479+0000 7f9bd3400640 1 -- 172.21.15.146:0/1041917003 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+3878 (secure 0 0 0) 0x7f9bcc058db0 con 0x7f9bdc0728c0 2024-04-24T23:09:19.480 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:19.480 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3371603973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3371603973},{"type":"v1","addr":"172.21.15.203:6836","nonce":3371603973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/210172800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":210172800},{"type":"v1","addr":"172.21.15.203:6837","nonce":210172800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1705248489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1705248489},{"type":"v1","addr":"172.21.15.146:6835","nonce":1705248489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":7293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2143293064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2143293064},{"type":"v1","addr":"172.21.15.146:6834","nonce":2143293064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[]} 2024-04-24T23:09:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 67 2024-04-24T23:09:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 msgr2=0x7f9bbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 0x7f9bbc06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc1f77f0 tx=0x7f9bc8008040 comp rx=0 tx=0).stop 2024-04-24T23:09:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 msgr2=0x7f9bdc15b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c430 tx=0x7f9bcc00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 shutdown_connections 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bbc06be30 0x7f9bbc06e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9bdc1445e0 0x7f9bdc133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc0d03a0 0x7f9bdc1337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 --2- 172.21.15.146:0/1041917003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bdc0728c0 0x7f9bdc15b350 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 >> 172.21.15.146:0/1041917003 conn(0x7f9bdc06b320 msgr2=0x7f9bdc13aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 shutdown_connections 2024-04-24T23:09:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.482+0000 7f9be2600640 1 -- 172.21.15.146:0/1041917003 wait complete. 2024-04-24T23:09:19.502 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:09:19.502 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:09:19.503 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:09:19.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:19.503 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:09:19.503 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:09:19.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:09:19.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:19.504 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:09:19.504 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:09:19.504 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:09:19.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:19.504 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:09:19.504 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:09:19.505 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:09:19.505 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:19.520 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:09:19.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:09:19.523 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:09:19.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:09:19.528 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:09:19.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:09:19.531 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:09:19.531 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:09:19.571 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:09:19.571 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:19.580 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:09:19.580 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:09:19.581 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:19.581 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:19.585 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:09:19.585 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:19.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:09:19.713 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:09:19.713 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:09:19.715 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:09:19.714+0000 7efe9d400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-24T23:09:19.733 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:09:19.741 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:09:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.756+0000 7f0f7dc00640 1 Processor -- start 2024-04-24T23:09:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.756+0000 7f0f7dc00640 1 -- start start 2024-04-24T23:09:19.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f7dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f780719d0 0x7f0f7806b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f7dc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7806c880 con 0x7f0f780b2610 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f7dc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780d0470 con 0x7f0f7815e2b0 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f7dc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780d0750 con 0x7f0f780719d0 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f77400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f780719d0 0x7f0f7806b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f6fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f780b2610 0x7f0f7806b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41388/0 (socket says 172.21.15.146:41388) 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.757+0000 7f0f6fe00640 1 -- 172.21.15.146:0/27434767 learned_addr learned my addr 172.21.15.146:0/27434767 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.758+0000 7f0f77400640 1 -- 172.21.15.146:0/27434767 >> v1:172.21.15.203:6789/0 conn(0x7f0f7815e2b0 legacy=0x7f0f780b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.758+0000 7f0f77400640 1 -- 172.21.15.146:0/27434767 >> v1:172.21.15.146:6789/0 conn(0x7f0f780b2610 legacy=0x7f0f7806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.758+0000 7f0f77400640 1 -- 172.21.15.146:0/27434767 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7806d6c0 con 0x7f0f780719d0 2024-04-24T23:09:19.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.759+0000 7f0f77400640 1 --2- 172.21.15.146:0/27434767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f7806b850 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009d90 tx=0x7f0f7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fde370fcc6e8d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.759+0000 7f0f76000640 1 -- 172.21.15.146:0/27434767 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007740 con 0x7f0f780719d0 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.759+0000 7f0f76000640 1 -- 172.21.15.146:0/27434767 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f700078e0 con 0x7f0f780719d0 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.759+0000 7f0f76000640 1 -- 172.21.15.146:0/27434767 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007cb0 con 0x7f0f780719d0 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 -- 172.21.15.146:0/27434767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 msgr2=0x7f0f7806b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/27434767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f7806b850 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009d90 tx=0x7f0f7002a660 comp rx=0 tx=0).stop 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 -- 172.21.15.146:0/27434767 shutdown_connections 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/27434767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f7806b850 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 -- 172.21.15.146:0/27434767 >> 172.21.15.146:0/27434767 conn(0x7f0f780b3e70 msgr2=0x7f0f780b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 -- 172.21.15.146:0/27434767 shutdown_connections 2024-04-24T23:09:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.760+0000 7f0f7dc00640 1 -- 172.21.15.146:0/27434767 wait complete. 2024-04-24T23:09:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.761+0000 7f0f7dc00640 1 Processor -- start 2024-04-24T23:09:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 -- start start 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 0x7f0f781f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0f7815e2b0 0x7f0f78072880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d10d0 con 0x7f0f780719d0 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d0f50 con 0x7f0f780b2610 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.762+0000 7f0f7dc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7806bd90 con 0x7f0f7815e2b0 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59378/0 (socket says 172.21.15.146:59378) 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 -- 172.21.15.146:0/209728547 learned_addr learned my addr 172.21.15.146:0/209728547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f77400640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0f7815e2b0 0x7f0f78072880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f6fe00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 0x7f0f781f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 -- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0f7815e2b0 msgr2=0x7f0f78072880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0f7815e2b0 0x7f0f78072880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 -- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 msgr2=0x7f0f781f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 0x7f0f781f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 -- 172.21.15.146:0/209728547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781f7e60 con 0x7f0f780719d0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f6fe00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 0x7f0f781f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.763+0000 7f0f76a00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c430 tx=0x7f0f6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.764+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68017070 con 0x7f0f780719d0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.764+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f680052d0 con 0x7f0f780719d0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.764+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7815b690 con 0x7f0f780719d0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.764+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68003830 con 0x7f0f780719d0 2024-04-24T23:09:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.764+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7815bc50 con 0x7f0f780719d0 2024-04-24T23:09:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.765+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7804f5a0 con 0x7f0f780719d0 2024-04-24T23:09:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.766+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f6801a070 con 0x7f0f780719d0 2024-04-24T23:09:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.767+0000 7f0f6ea00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 0x7f0f5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.767+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5593+0+0 (secure 0 0 0) 0x7f0f6808a200 con 0x7f0f780719d0 2024-04-24T23:09:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.767+0000 7f0f6fe00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 0x7f0f5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:19.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.768+0000 7f0f6fe00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 0x7f0f5406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0f781612a0 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.771+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0f781f7e60 con 0x7f0f780719d0 2024-04-24T23:09:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:19.982+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0f7815c730 con 0x7f0f780719d0 2024-04-24T23:09:20.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.144+0000 7f0f6ea00640 1 -- 172.21.15.146:0/209728547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) ==== 97+0+0 (secure 0 0 0) 0x7f0f68058b80 con 0x7f0f780719d0 2024-04-24T23:09:20.146 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.147+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 msgr2=0x7f0f5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.147+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 0x7f0f5406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0f781612a0 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.147+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 msgr2=0x7f0f781f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.147+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c430 tx=0x7f0f6800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 shutdown_connections 2024-04-24T23:09:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0f5406be30 0x7f0f5406e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0f7815e2b0 0x7f0f78072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f780b2610 0x7f0f781f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 --2- 172.21.15.146:0/209728547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f780719d0 0x7f0f781f68f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 >> 172.21.15.146:0/209728547 conn(0x7f0f780b3e70 msgr2=0x7f0f780af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 shutdown_connections 2024-04-24T23:09:20.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.148+0000 7f0f7dc00640 1 -- 172.21.15.146:0/209728547 wait complete. 2024-04-24T23:09:20.173 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:09:20.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.357+0000 7fe408a00640 1 Processor -- start 2024-04-24T23:09:20.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.357+0000 7fe408a00640 1 -- start start 2024-04-24T23:09:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe408a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4040b8070 0x7fe4040d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe408a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 0x7fe4040ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe408a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe404161a80 con 0x7fe4041616a0 2024-04-24T23:09:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe408a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe4040d1110 con 0x7fe4040b8070 2024-04-24T23:09:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe408a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe4040b6bd0 con 0x7fe4040d0cb0 2024-04-24T23:09:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe402800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe4041616a0 0x7fe4040d46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41398/0 (socket says 172.21.15.146:41398) 2024-04-24T23:09:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe402800640 1 -- 172.21.15.146:0/3313281405 learned_addr learned my addr 172.21.15.146:0/3313281405 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.359+0000 7fe401e00640 1 --2- 172.21.15.146:0/3313281405 >> v2:172.21.15.146:3300/0 conn(0x7fe4040b8070 0x7fe4040d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe403200640 1 --2- 172.21.15.146:0/3313281405 >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 0x7fe4040ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401400640 1 -- 172.21.15.146:0/3313281405 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219670537 0 0) 0x7fe404161a80 con 0x7fe4041616a0 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401400640 1 -- 172.21.15.146:0/3313281405 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e4003520 con 0x7fe4041616a0 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401e00640 1 -- 172.21.15.146:0/3313281405 >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 msgr2=0x7fe4040ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401e00640 1 --2- 172.21.15.146:0/3313281405 >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 0x7fe4040ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401e00640 1 -- 172.21.15.146:0/3313281405 >> v1:172.21.15.146:6789/0 conn(0x7fe4041616a0 legacy=0x7fe4040d46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe401e00640 1 -- 172.21.15.146:0/3313281405 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4040d2360 con 0x7fe4040b8070 2024-04-24T23:09:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.360+0000 7fe403200640 1 --2- 172.21.15.146:0/3313281405 >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 0x7fe4040ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.361+0000 7fe401e00640 1 --2- 172.21.15.146:0/3313281405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040d0770 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe40409d700 tx=0x7fe3ec02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed973fb893579aad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.361+0000 7fe401400640 1 -- 172.21.15.146:0/3313281405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec037070 con 0x7fe4040b8070 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.361+0000 7fe401400640 1 -- 172.21.15.146:0/3313281405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3ec02add0 con 0x7fe4040b8070 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.361+0000 7fe401400640 1 -- 172.21.15.146:0/3313281405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec032660 con 0x7fe4040b8070 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 -- 172.21.15.146:0/3313281405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 msgr2=0x7fe4040d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 --2- 172.21.15.146:0/3313281405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040d0770 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe40409d700 tx=0x7fe3ec02a080 comp rx=0 tx=0).stop 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 -- 172.21.15.146:0/3313281405 shutdown_connections 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 --2- 172.21.15.146:0/3313281405 >> v2:172.21.15.203:3300/0 conn(0x7fe4040d0cb0 0x7fe4040ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 --2- 172.21.15.146:0/3313281405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040d0770 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 -- 172.21.15.146:0/3313281405 >> 172.21.15.146:0/3313281405 conn(0x7fe40409d000 msgr2=0x7fe4040d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 -- 172.21.15.146:0/3313281405 shutdown_connections 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.362+0000 7fe408a00640 1 -- 172.21.15.146:0/3313281405 wait complete. 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.364+0000 7fe408a00640 1 Processor -- start 2024-04-24T23:09:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.364+0000 7fe408a00640 1 -- start start 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4040d0cb0 0x7fe40414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4041616a0 0x7fe4040b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4040d2c00 con 0x7fe4040b8070 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4040d2920 con 0x7fe4040d0cb0 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe408a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4040ceed0 con 0x7fe4041616a0 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59398/0 (socket says 172.21.15.146:59398) 2024-04-24T23:09:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 -- 172.21.15.146:0/1615626051 learned_addr learned my addr 172.21.15.146:0/1615626051 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe401e00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4040d0cb0 0x7fe40414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 -- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4041616a0 msgr2=0x7fe4040b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4041616a0 0x7fe4040b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 -- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4040d0cb0 msgr2=0x7fe40414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4040d0cb0 0x7fe40414ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.365+0000 7fe402800640 1 -- 172.21.15.146:0/1615626051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4040cc090 con 0x7fe4040b8070 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe402800640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c390 tx=0x7fe3f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4017070 con 0x7fe4040b8070 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f4005ce0 con 0x7fe4040b8070 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40072f0 con 0x7fe4040b8070 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4040cc370 con 0x7fe4040b8070 2024-04-24T23:09:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.366+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4040cc930 con 0x7fe4040b8070 2024-04-24T23:09:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.367+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40404f500 con 0x7fe4040b8070 2024-04-24T23:09:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.368+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3f401a070 con 0x7fe4040b8070 2024-04-24T23:09:20.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.369+0000 7fe3faa00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.369+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5249+0+0 (secure 0 0 0) 0x7fe3f408a0f0 con 0x7fe4040b8070 2024-04-24T23:09:20.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.370+0000 7fe401e00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.371+0000 7fe401e00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 0x7fe3e006e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec034000 tx=0x7fe3ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.374+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3f4058c50 con 0x7fe4040b8070 2024-04-24T23:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.627+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4040ca8b0 con 0x7fe4040b8070 2024-04-24T23:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.628+0000 7fe3faa00640 1 -- 172.21.15.146:0/1615626051 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fe3f4058550 con 0x7fe4040b8070 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ==", 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.629 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ==", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.630 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg==", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg==", 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.631 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA==", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.632 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ==", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA==", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.633 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg==", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ==", 2024-04-24T23:09:20.634 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q==", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.635 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ==", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA==", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:20.636 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw==", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-04-24T23:09:20.637 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g==", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw==", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:20.638 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg==", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.639 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmFG6LAxAA7YUamq4/Vvt8ibyWUFiI+w==", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA==", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:09:20.640 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg==", 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:20.641 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 msgr2=0x7fe3e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 0x7fe3e006e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec034000 tx=0x7fe3ec02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 msgr2=0x7fe4040cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c390 tx=0x7fe3f400c850 comp rx=0 tx=0).stop 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 shutdown_connections 2024-04-24T23:09:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe4041616a0 0x7fe4040b6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4040d0cb0 0x7fe40414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 --2- 172.21.15.146:0/1615626051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4040b8070 0x7fe4040cb830 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 >> 172.21.15.146:0/1615626051 conn(0x7fe40409d000 msgr2=0x7fe4041602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 shutdown_connections 2024-04-24T23:09:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.630+0000 7fe408a00640 1 -- 172.21.15.146:0/1615626051 wait complete. 2024-04-24T23:09:20.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.831+0000 7fe3cbe00640 1 Processor -- start 2024-04-24T23:09:20.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.832+0000 7fe3cbe00640 1 -- start start 2024-04-24T23:09:20.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3cc0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3cbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3cc0d4bc0 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3cbe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3cc0cf5b0 con 0x7fe3cc0d06e0 2024-04-24T23:09:20.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3cc0d48e0 con 0x7fe3cc0b2dc0 2024-04-24T23:09:20.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3c2000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe3cc15e5b0 0x7fe3cc0b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41404/0 (socket says 172.21.15.146:41404) 2024-04-24T23:09:20.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.833+0000 7fe3c2000640 1 -- 172.21.15.146:0/1077591642 learned_addr learned my addr 172.21.15.146:0/1077591642 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3cb400640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3cc0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130999434 0 0) 0x7fe3cc0d4bc0 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b0003520 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3525124304 0 0) 0x7fe3b0003520 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 msgr2=0x7fe3cc0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3cc0b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 >> v1:172.21.15.203:6789/0 conn(0x7fe3cc0d06e0 legacy=0x7fe3cc15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc0cf850 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe3b4001670 con 0x7fe3cc15e5b0 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 >> v1:172.21.15.146:6789/0 conn(0x7fe3cc15e5b0 legacy=0x7fe3cc0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00039e0 0x7fe3b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b0004800 0x7fe3b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc0d48e0 con 0x7fe3b00039e0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b000bad0 con 0x7fe3b0004800 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.834+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b000bcd0 con 0x7fe3cc0b2dc0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00039e0 0x7fe3b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3cb400640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 -- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 msgr2=0x7fe3b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3c2000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b0004800 0x7fe3b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 -- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b0004800 msgr2=0x7fe3b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b0004800 0x7fe3b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3caa00640 1 -- 172.21.15.146:0/1077591642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b0003520 con 0x7fe3b00039e0 2024-04-24T23:09:20.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3c2000640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b0004800 0x7fe3b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:20.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.835+0000 7fe3cb400640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b2dc0 0x7fe3b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.836+0000 7fe3caa00640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00039e0 0x7fe3b0003e00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc001720 tx=0x7fe3b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c4cc9a7597f42e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.836+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc001370 con 0x7fe3b00039e0 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.836+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0052d0 con 0x7fe3b00039e0 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.836+0000 7fe3ca000640 1 -- 172.21.15.146:0/1077591642 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc02aba0 con 0x7fe3b00039e0 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 -- 172.21.15.146:0/1077591642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00039e0 msgr2=0x7fe3b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/1077591642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00039e0 0x7fe3b0003e00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc001720 tx=0x7fe3b0005830 comp rx=0 tx=0).stop 2024-04-24T23:09:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cb400640 1 -- 172.21.15.146:0/1077591642 reap_dead start 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 -- 172.21.15.146:0/1077591642 shutdown_connections 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 -- 172.21.15.146:0/1077591642 >> 172.21.15.146:0/1077591642 conn(0x7fe3cc0d3d20 msgr2=0x7fe3cc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 -- 172.21.15.146:0/1077591642 shutdown_connections 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.837+0000 7fe3cbe00640 1 -- 172.21.15.146:0/1077591642 wait complete. 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.839+0000 7fe3cbe00640 1 Processor -- start 2024-04-24T23:09:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.839+0000 7fe3cbe00640 1 -- start start 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b00039e0 0x7fe3cc09eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b5ce0 0x7fe3cc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc0d2e40 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc0d2cc0 con 0x7fe3b00039e0 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3cc0d0ac0 con 0x7fe3cc0b5ce0 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3c2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3c2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59430/0 (socket says 172.21.15.146:59430) 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.840+0000 7fe3c2000640 1 -- 172.21.15.146:0/2726467558 learned_addr learned my addr 172.21.15.146:0/2726467558 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3caa00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b00039e0 0x7fe3cc09eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 -- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b5ce0 msgr2=0x7fe3cc0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b5ce0 0x7fe3cc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 -- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b00039e0 msgr2=0x7fe3cc09eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b00039e0 0x7fe3cc09eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 -- 172.21.15.146:0/2726467558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc152610 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c2000640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4001eb0 tx=0x7fe3b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.841+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4019070 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.842+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b400de50 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.842+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40047e0 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.842+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3cc1528f0 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.842+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3cc09eff0 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.843+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3cc04f500 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.844+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3b4004980 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.845+0000 7fe3c3e00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 0x7fe3a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.845+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5249+0+0 (secure 0 0 0) 0x7fe3b408a630 con 0x7fe3cc0b6bf0 2024-04-24T23:09:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.845+0000 7fe3caa00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 0x7fe3a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.847+0000 7fe3caa00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 0x7fe3a806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc032000 tx=0x7fe3bc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:20.849+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe3b4059100 con 0x7fe3cc0b6bf0 2024-04-24T23:09:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.050+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3cc0d0190 con 0x7fe3cc0b6bf0 2024-04-24T23:09:21.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.053+0000 7fe3c3e00640 1 -- 172.21.15.146:0/2726467558 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+13189 (secure 0 0 0) 0x7fe3b4058a00 con 0x7fe3cc0b6bf0 2024-04-24T23:09:21.054 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:21.054 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":80,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:20.159005+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 msgr2=0x7fe3a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 0x7fe3a806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc032000 tx=0x7fe3bc02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 msgr2=0x7fe3cc0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4001eb0 tx=0x7fe3b400dc00 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 shutdown_connections 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe3a806be60 0x7fe3a806e320 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3cc0b5ce0 0x7fe3cc0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3cc0b6bf0 0x7fe3cc0b7070 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 --2- 172.21.15.146:0/2726467558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3b00039e0 0x7fe3cc09eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.055+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 >> 172.21.15.146:0/2726467558 conn(0x7fe3cc0d3d20 msgr2=0x7fe3cc0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.056+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 shutdown_connections 2024-04-24T23:09:21.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.056+0000 7fe3cbe00640 1 -- 172.21.15.146:0/2726467558 wait complete. 2024-04-24T23:09:21.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:21.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.275+0000 7f7a3a600640 1 Processor -- start 2024-04-24T23:09:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.275+0000 7f7a3a600640 1 -- start start 2024-04-24T23:09:21.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.276+0000 7f7a3a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a340b3ac0 0x7f7a34072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.276+0000 7f7a3a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a3406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.276+0000 7f7a3a600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3406bf20 con 0x7f7a340b3ea0 2024-04-24T23:09:21.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.276+0000 7f7a3a600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7a34071cb0 con 0x7f7a340b3ac0 2024-04-24T23:09:21.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.276+0000 7f7a3a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a34071f90 con 0x7f7a3406b8c0 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a340b3ac0 0x7f7a34072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a32a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7a340b3ea0 0x7f7a3406b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41408/0 (socket says 172.21.15.146:41408) 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a32a00640 1 -- 172.21.15.146:0/3696569438 learned_addr learned my addr 172.21.15.146:0/3696569438 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33e00640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a3406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33400640 1 -- 172.21.15.146:0/3696569438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 msgr2=0x7f7a3406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33400640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a3406dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33400640 1 -- 172.21.15.146:0/3696569438 >> v1:172.21.15.146:6789/0 conn(0x7f7a340b3ea0 legacy=0x7f7a3406b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a32000640 1 -- 172.21.15.146:0/3696569438 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137731479 0 0) 0x7f7a3406bf20 con 0x7f7a340b3ea0 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33400640 1 -- 172.21.15.146:0/3696569438 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34072270 con 0x7f7a340b3ac0 2024-04-24T23:09:21.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.277+0000 7f7a33e00640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a3406dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:21.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.278+0000 7f7a33400640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ac0 0x7f7a34072a70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097a0 tx=0x7f7a2402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26775d23332a7fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.278+0000 7f7a32000640 1 -- 172.21.15.146:0/3696569438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24037070 con 0x7f7a340b3ac0 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a32000640 1 -- 172.21.15.146:0/3696569438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24032440 con 0x7f7a340b3ac0 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a32000640 1 -- 172.21.15.146:0/3696569438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24032810 con 0x7f7a340b3ac0 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 -- 172.21.15.146:0/3696569438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ac0 msgr2=0x7f7a34072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ac0 0x7f7a34072a70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097a0 tx=0x7f7a2402a210 comp rx=0 tx=0).stop 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 -- 172.21.15.146:0/3696569438 shutdown_connections 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a3406dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 --2- 172.21.15.146:0/3696569438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ac0 0x7f7a34072a70 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 -- 172.21.15.146:0/3696569438 >> 172.21.15.146:0/3696569438 conn(0x7f7a3406c250 msgr2=0x7f7a3406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 -- 172.21.15.146:0/3696569438 shutdown_connections 2024-04-24T23:09:21.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.279+0000 7f7a3a600640 1 -- 172.21.15.146:0/3696569438 wait complete. 2024-04-24T23:09:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.281+0000 7f7a3a600640 1 Processor -- start 2024-04-24T23:09:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.281+0000 7f7a3a600640 1 -- start start 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a341560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a340b3ac0 0x7f7a341f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340b42f0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34147aa0 con 0x7f7a340b3ac0 2024-04-24T23:09:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a3a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a340b4470 con 0x7f7a3406b8c0 2024-04-24T23:09:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59450/0 (socket says 172.21.15.146:59450) 2024-04-24T23:09:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.282+0000 7f7a33e00640 1 -- 172.21.15.146:0/1894559630 learned_addr learned my addr 172.21.15.146:0/1894559630 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 -- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 msgr2=0x7f7a341560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a341560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 -- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a340b3ac0 msgr2=0x7f7a341f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a32a00640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a340b3ac0 0x7f7a341f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a340b3ac0 0x7f7a341f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 -- 172.21.15.146:0/1894559630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34158500 con 0x7f7a340b3ea0 2024-04-24T23:09:21.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a33e00640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00cd50 tx=0x7f7a2c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00f680 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00f840 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34157460 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00fc30 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.283+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a34157a20 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.285+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a340cfcf0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.286+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a2c0213f0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.286+0000 7f7a2b400640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 0x7f7a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.286+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5249+0+0 (secure 0 0 0) 0x7f7a2c08ba60 con 0x7f7a340b3ea0 2024-04-24T23:09:21.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.287+0000 7f7a33400640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 0x7f7a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.288+0000 7f7a33400640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 0x7f7a1406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7a24034000 tx=0x7f7a2402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.291+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7a340cfcf0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.485+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a341589f0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.486+0000 7f7a2b400640 1 -- 172.21.15.146:0/1894559630 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f7a341589f0 con 0x7f7a340b3ea0 2024-04-24T23:09:21.488 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 msgr2=0x7f7a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 0x7f7a1406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7a24034000 tx=0x7f7a2402c000 comp rx=0 tx=0).stop 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 msgr2=0x7f7a3415d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00cd50 tx=0x7f7a2c00a650 comp rx=0 tx=0).stop 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 shutdown_connections 2024-04-24T23:09:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a340b3ea0 0x7f7a3415d780 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a340b3ac0 0x7f7a341f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7a1406be30 0x7f7a1406e2f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 --2- 172.21.15.146:0/1894559630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a3406b8c0 0x7f7a341560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 >> 172.21.15.146:0/1894559630 conn(0x7f7a3406c250 msgr2=0x7f7a3415f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 shutdown_connections 2024-04-24T23:09:21.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.489+0000 7f7a3a600640 1 -- 172.21.15.146:0/1894559630 wait complete. 2024-04-24T23:09:21.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:09:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.708+0000 7fd011000640 1 Processor -- start 2024-04-24T23:09:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.708+0000 7fd011000640 1 -- start start 2024-04-24T23:09:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.710+0000 7fd011000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd00c0d0240 0x7fd00c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.710+0000 7fd011000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00c070f90 con 0x7fd00c1561c0 2024-04-24T23:09:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.710+0000 7fd011000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00c071270 con 0x7fd00c0709d0 2024-04-24T23:09:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.710+0000 7fd011000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd00c0b4310 con 0x7fd00c0d0240 2024-04-24T23:09:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd00c1561c0 0x7fd00c0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41424/0 (socket says 172.21.15.146:41424) 2024-04-24T23:09:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00b400640 1 -- 172.21.15.146:0/271729687 learned_addr learned my addr 172.21.15.146:0/271729687 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd003e00640 1 --2- 172.21.15.146:0/271729687 >> v2:172.21.15.203:3300/0 conn(0x7fd00c0d0240 0x7fd00c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639952087 0 0) 0x7fd00c070f90 con 0x7fd00c1561c0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff0003520 con 0x7fd00c1561c0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 369648910 0 0) 0x7fcff0003520 con 0x7fd00c1561c0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 >> v2:172.21.15.203:3300/0 conn(0x7fd00c0d0240 msgr2=0x7fd00c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.711+0000 7fd00aa00640 1 --2- 172.21.15.146:0/271729687 >> v2:172.21.15.203:3300/0 conn(0x7fd00c0d0240 0x7fd00c0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 >> v1:172.21.15.203:6789/0 conn(0x7fd00c0709d0 legacy=0x7fd00c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c071550 con 0x7fd00c1561c0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fcffc001670 con 0x7fd00c1561c0 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 >> v1:172.21.15.146:6789/0 conn(0x7fd00c1561c0 legacy=0x7fd00c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcff00039b0 0x7fcff0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcff0004800 0x7fcff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fcff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c0b4310 con 0x7fcff00052e0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcff000c1b0 con 0x7fcff00039b0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcff000c3b0 con 0x7fcff0004800 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fcff000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00b400640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcff00039b0 0x7fcff0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd003e00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcff0004800 0x7fcff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 -- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcff0004800 msgr2=0x7fcff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcff0004800 0x7fcff0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 -- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcff00039b0 msgr2=0x7fcff0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcff00039b0 0x7fcff0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.712+0000 7fd00be00640 1 -- 172.21.15.146:0/271729687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0003520 con 0x7fcff00052e0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.713+0000 7fd00be00640 1 -- 172.21.15.146:0/271729687 reap_dead start 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd00be00640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fcff000b9c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd004001e20 tx=0x7fcff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f613566e06d51458 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004001a70 con 0x7fcff00052e0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00402ae40 con 0x7fcff00052e0 2024-04-24T23:09:21.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd00aa00640 1 -- 172.21.15.146:0/271729687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004003bb0 con 0x7fcff00052e0 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd011000640 1 -- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 msgr2=0x7fcff000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd011000640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fcff000b9c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd004001e20 tx=0x7fcff0005830 comp rx=0 tx=0).stop 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd011000640 1 -- 172.21.15.146:0/271729687 shutdown_connections 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd011000640 1 --2- 172.21.15.146:0/271729687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fcff000b9c0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.714+0000 7fd011000640 1 -- 172.21.15.146:0/271729687 >> 172.21.15.146:0/271729687 conn(0x7fd00c06b320 msgr2=0x7fd00c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.715+0000 7fd011000640 1 -- 172.21.15.146:0/271729687 shutdown_connections 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.715+0000 7fd011000640 1 -- 172.21.15.146:0/271729687 wait complete. 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.716+0000 7fd011000640 1 Processor -- start 2024-04-24T23:09:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.716+0000 7fd011000640 1 -- start start 2024-04-24T23:09:21.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 0x7fd00c15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd00c15aa50 0x7fd00c15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c0cdbf0 con 0x7fcff00052e0 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c0cdd70 con 0x7fd00c15cb80 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.717+0000 7fd011000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd00c0cdef0 con 0x7fd00c15aa50 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59476/0 (socket says 172.21.15.146:59476) 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 -- 172.21.15.146:0/2495287104 learned_addr learned my addr 172.21.15.146:0/2495287104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd003e00640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 0x7fd00c15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00be00640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd00c15aa50 0x7fd00c15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 -- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd00c15aa50 msgr2=0x7fd00c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd00c15aa50 0x7fd00c15aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 -- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 msgr2=0x7fd00c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 0x7fd00c15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 -- 172.21.15.146:0/2495287104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c15d120 con 0x7fcff00052e0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd003e00640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 0x7fd00c15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.718+0000 7fd00b400640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e760 tx=0x7fcffc00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.719+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00c660 con 0x7fcff00052e0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.719+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc018070 con 0x7fcff00052e0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.719+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00ca40 con 0x7fcff00052e0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.719+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c15d400 con 0x7fcff00052e0 2024-04-24T23:09:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.719+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c15d9c0 con 0x7fcff00052e0 2024-04-24T23:09:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.720+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c15b410 con 0x7fcff00052e0 2024-04-24T23:09:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.721+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcffc00cbe0 con 0x7fcff00052e0 2024-04-24T23:09:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.722+0000 7fd003400640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 0x7fcfe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.722+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5249+0+0 (secure 0 0 0) 0x7fcffc08a910 con 0x7fcff00052e0 2024-04-24T23:09:21.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.722+0000 7fd003e00640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 0x7fcfe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:21.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.724+0000 7fd003e00640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 0x7fcfe806e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd00c1597c0 tx=0x7fcff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.727+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcffc059470 con 0x7fcff00052e0 2024-04-24T23:09:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.932+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd00c04f500 con 0x7fcff00052e0 2024-04-24T23:09:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.933+0000 7fd003400640 1 -- 172.21.15.146:0/2495287104 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) ==== 84+0+65 (secure 0 0 0) 0x7fcffc058d70 con 0x7fcff00052e0 2024-04-24T23:09:21.935 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:21.936 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T23:09:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 msgr2=0x7fcfe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 0x7fcfe806e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd00c1597c0 tx=0x7fcff4008040 comp rx=0 tx=0).stop 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 msgr2=0x7fd00c147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e760 tx=0x7fcffc00ec20 comp rx=0 tx=0).stop 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 shutdown_connections 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcfe806be30 0x7fcfe806e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd00c15aa50 0x7fd00c15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd00c15cb80 0x7fd00c15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 --2- 172.21.15.146:0/2495287104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff00052e0 0x7fd00c147490 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:21.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 >> 172.21.15.146:0/2495287104 conn(0x7fd00c06b320 msgr2=0x7fd00c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:21.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.936+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 shutdown_connections 2024-04-24T23:09:21.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:21.937+0000 7fd011000640 1 -- 172.21.15.146:0/2495287104 wait complete. 2024-04-24T23:09:21.958 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:09:21.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:09:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.163+0000 7f6a9c200640 1 Processor -- start 2024-04-24T23:09:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.163+0000 7f6a9c200640 1 -- start start 2024-04-24T23:09:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.164+0000 7f6a9c200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a940ca320 0x7f6a940d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.164+0000 7f6a9c200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a940d0ed0 0x7f6a940cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9c200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a940b4fa0 con 0x7f6a940d4ab0 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9c200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6a940d1c00 con 0x7f6a940d0ed0 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9c200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a940d1ee0 con 0x7f6a940ca320 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a940d0ed0 0x7f6a940cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a98e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a940d4ab0 0x7f6a940c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41440/0 (socket says 172.21.15.146:41440) 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a940d0ed0 0x7f6a940cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59492/0 (socket says 172.21.15.146:59492) 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 -- 172.21.15.146:0/534273734 learned_addr learned my addr 172.21.15.146:0/534273734 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a99800640 1 --2- 172.21.15.146:0/534273734 >> v2:172.21.15.203:3300/0 conn(0x7f6a940ca320 0x7f6a940d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 -- 172.21.15.146:0/534273734 >> v2:172.21.15.203:3300/0 conn(0x7f6a940ca320 msgr2=0x7f6a940d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 --2- 172.21.15.146:0/534273734 >> v2:172.21.15.203:3300/0 conn(0x7f6a940ca320 0x7f6a940d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a9a200640 1 -- 172.21.15.146:0/534273734 >> v1:172.21.15.146:6789/0 conn(0x7f6a940d4ab0 legacy=0x7f6a940c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.166+0000 7f6a9a200640 1 -- 172.21.15.146:0/534273734 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940b4b00 con 0x7f6a940d0ed0 2024-04-24T23:09:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.165+0000 7f6a93e00640 1 -- 172.21.15.146:0/534273734 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462538876 0 0) 0x7f6a940b4fa0 con 0x7f6a940d4ab0 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.167+0000 7f6a9a200640 1 --2- 172.21.15.146:0/534273734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d0ed0 0x7f6a940cfa40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f6a9408c7b0 tx=0x7f6a8c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb38bfb608aa80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.167+0000 7f6a93e00640 1 -- 172.21.15.146:0/534273734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c036070 con 0x7f6a940d0ed0 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.167+0000 7f6a93e00640 1 -- 172.21.15.146:0/534273734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c031600 con 0x7f6a940d0ed0 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.167+0000 7f6a93e00640 1 -- 172.21.15.146:0/534273734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0319d0 con 0x7f6a940d0ed0 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 -- 172.21.15.146:0/534273734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d0ed0 msgr2=0x7f6a940cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 --2- 172.21.15.146:0/534273734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d0ed0 0x7f6a940cfa40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f6a9408c7b0 tx=0x7f6a8c02a730 comp rx=0 tx=0).stop 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 -- 172.21.15.146:0/534273734 shutdown_connections 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 --2- 172.21.15.146:0/534273734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d0ed0 0x7f6a940cfa40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 --2- 172.21.15.146:0/534273734 >> v2:172.21.15.203:3300/0 conn(0x7f6a940ca320 0x7f6a940d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 -- 172.21.15.146:0/534273734 >> 172.21.15.146:0/534273734 conn(0x7f6a940d3e20 msgr2=0x7f6a940d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 -- 172.21.15.146:0/534273734 shutdown_connections 2024-04-24T23:09:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.168+0000 7f6a9c200640 1 -- 172.21.15.146:0/534273734 wait complete. 2024-04-24T23:09:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.170+0000 7f6a9c200640 1 Processor -- start 2024-04-24T23:09:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.170+0000 7f6a9c200640 1 -- start start 2024-04-24T23:09:22.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940ca320 0x7f6a941523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 0x7f6a940cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940d2940 con 0x7f6a940d4ab0 2024-04-24T23:09:22.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940b5510 con 0x7f6a940ca320 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9c200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940d2ac0 con 0x7f6a940d0ed0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59508/0 (socket says 172.21.15.146:59508) 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 -- 172.21.15.146:0/1052608473 learned_addr learned my addr 172.21.15.146:0/1052608473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a99800640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940ca320 0x7f6a941523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a98e00640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 0x7f6a940cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 -- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 msgr2=0x7f6a940cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 0x7f6a940cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 -- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940ca320 msgr2=0x7f6a941523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940ca320 0x7f6a941523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.171+0000 7f6a9a200640 1 -- 172.21.15.146:0/1052608473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9409e190 con 0x7f6a940d4ab0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a98e00640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 0x7f6a940cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a9a200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c02ad20 tx=0x7f6a8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c03f020 con 0x7f6a940d4ab0 2024-04-24T23:09:22.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c037040 con 0x7f6a940d4ab0 2024-04-24T23:09:22.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c036070 con 0x7f6a940d4ab0 2024-04-24T23:09:22.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9409e470 con 0x7f6a940d4ab0 2024-04-24T23:09:22.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.172+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9409ea30 con 0x7f6a940d4ab0 2024-04-24T23:09:22.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.174+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a94068190 con 0x7f6a940d4ab0 2024-04-24T23:09:22.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.175+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a8c042020 con 0x7f6a940d4ab0 2024-04-24T23:09:22.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.176+0000 7f6a91600640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:22.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.176+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5249+0+0 (secure 0 0 0) 0x7f6a8c0ab4b0 con 0x7f6a940d4ab0 2024-04-24T23:09:22.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.176+0000 7f6a99800640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:22.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.177+0000 7f6a99800640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:22.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.180+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a8c049020 con 0x7f6a940d4ab0 2024-04-24T23:09:22.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:22.380+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6a940d38a0 con 0x7f6a940d4ab0 2024-04-24T23:09:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.173+0000 7f6a91600640 1 -- 172.21.15.146:0/1052608473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) ==== 138+0+0 (secure 0 0 0) 0x7f6a8c079f80 con 0x7f6a940d4ab0 2024-04-24T23:09:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T23:09:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 msgr2=0x7f6a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88008040 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 msgr2=0x7f6a9409f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c02ad20 tx=0x7f6a8c004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 shutdown_connections 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a940d4ab0 0x7f6a9409f230 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a940d0ed0 0x7f6a940cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 --2- 172.21.15.146:0/1052608473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940ca320 0x7f6a941523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.179+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 >> 172.21.15.146:0/1052608473 conn(0x7f6a940d3e20 msgr2=0x7f6a940c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.180+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 shutdown_connections 2024-04-24T23:09:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.180+0000 7f6a9c200640 1 -- 172.21.15.146:0/1052608473 wait complete. 2024-04-24T23:09:23.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:09:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.401+0000 7fcb46800640 1 Processor -- start 2024-04-24T23:09:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.401+0000 7fcb46800640 1 -- start start 2024-04-24T23:09:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb46800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb4006dd80 0x7fcb4006e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb46800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb400b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb46800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4015e3f0 con 0x7fcb4015e010 2024-04-24T23:09:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb46800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4006efd0 con 0x7fcb4006dd80 2024-04-24T23:09:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb46800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4006e230 con 0x7fcb4006eb60 2024-04-24T23:09:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.403+0000 7fcb37e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb4006dd80 0x7fcb4006e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb4006dd80 0x7fcb4006e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59520/0 (socket says 172.21.15.146:59520) 2024-04-24T23:09:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 -- 172.21.15.146:0/1639438673 learned_addr learned my addr 172.21.15.146:0/1639438673 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb3fe00640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb400b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 -- 172.21.15.146:0/1639438673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 msgr2=0x7fcb400b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb400b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 -- 172.21.15.146:0/1639438673 >> v1:172.21.15.203:6789/0 conn(0x7fcb4015e010 legacy=0x7fcb40071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.404+0000 7fcb37e00640 1 -- 172.21.15.146:0/1639438673 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4006cd20 con 0x7fcb4006dd80 2024-04-24T23:09:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.405+0000 7fcb37e00640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4006dd80 0x7fcb4006e620 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009870 tx=0x7fcb2802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3c45a1010de227 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.405+0000 7fcb3ea00640 1 -- 172.21.15.146:0/1639438673 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28037070 con 0x7fcb4006dd80 2024-04-24T23:09:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.406+0000 7fcb3ea00640 1 -- 172.21.15.146:0/1639438673 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb28032440 con 0x7fcb4006dd80 2024-04-24T23:09:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.406+0000 7fcb3ea00640 1 -- 172.21.15.146:0/1639438673 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28032810 con 0x7fcb4006dd80 2024-04-24T23:09:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.406+0000 7fcb46800640 1 -- 172.21.15.146:0/1639438673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4006dd80 msgr2=0x7fcb4006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.406+0000 7fcb46800640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4006dd80 0x7fcb4006e620 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009870 tx=0x7fcb2802a210 comp rx=0 tx=0).stop 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 -- 172.21.15.146:0/1639438673 shutdown_connections 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb400b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 --2- 172.21.15.146:0/1639438673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4006dd80 0x7fcb4006e620 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 -- 172.21.15.146:0/1639438673 >> 172.21.15.146:0/1639438673 conn(0x7fcb400b17b0 msgr2=0x7fcb400b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 -- 172.21.15.146:0/1639438673 shutdown_connections 2024-04-24T23:09:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.407+0000 7fcb46800640 1 -- 172.21.15.146:0/1639438673 wait complete. 2024-04-24T23:09:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.408+0000 7fcb46800640 1 Processor -- start 2024-04-24T23:09:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.408+0000 7fcb46800640 1 -- start start 2024-04-24T23:09:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 0x7fcb401529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb401f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4006cfc0 con 0x7fcb4015e010 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40071fe0 con 0x7fcb4006dd80 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.409+0000 7fcb46800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4006d2a0 con 0x7fcb4006eb60 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59528/0 (socket says 172.21.15.146:59528) 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 -- 172.21.15.146:0/3971038948 learned_addr learned my addr 172.21.15.146:0/3971038948 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb37e00640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb401f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 -- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 msgr2=0x7fcb401f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb401f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3f400640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 0x7fcb401529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 -- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 msgr2=0x7fcb401529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 0x7fcb401529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3fe00640 1 -- 172.21.15.146:0/3971038948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb40156590 con 0x7fcb4015e010 2024-04-24T23:09:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.410+0000 7fcb3f400640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 0x7fcb401529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb3fe00640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fcb38007e40 tx=0x7fcb3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38014620 con 0x7fcb4015e010 2024-04-24T23:09:23.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38019070 con 0x7fcb4015e010 2024-04-24T23:09:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38014a20 con 0x7fcb4015e010 2024-04-24T23:09:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb40156870 con 0x7fcb4015e010 2024-04-24T23:09:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.411+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb40156e30 con 0x7fcb4015e010 2024-04-24T23:09:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.412+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4004f5a0 con 0x7fcb4015e010 2024-04-24T23:09:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.414+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb38014bc0 con 0x7fcb4015e010 2024-04-24T23:09:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.415+0000 7fcb37400640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.415+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5619+0+0 (secure 0 0 0) 0x7fcb3808b730 con 0x7fcb4015e010 2024-04-24T23:09:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.416+0000 7fcb3f400640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.417+0000 7fcb3f400640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000a830 tx=0x7fcb30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.421+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb3805a120 con 0x7fcb4015e010 2024-04-24T23:09:23.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:23.623+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb400b3190 con 0x7fcb4015e010 2024-04-24T23:09:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.189+0000 7fcb37400640 1 -- 172.21.15.146:0/3971038948 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) ==== 170+0+0 (secure 0 0 0) 0x7fcb38059a20 con 0x7fcb4015e010 2024-04-24T23:09:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T23:09:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.193+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 msgr2=0x7fcb1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.193+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000a830 tx=0x7fcb30008040 comp rx=0 tx=0).stop 2024-04-24T23:09:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.193+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 msgr2=0x7fcb4015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.193+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fcb38007e40 tx=0x7fcb3800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 shutdown_connections 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb4015e010 0x7fcb4015ab60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4006eb60 0x7fcb401f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 --2- 172.21.15.146:0/3971038948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb4006dd80 0x7fcb401529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 >> 172.21.15.146:0/3971038948 conn(0x7fcb400b17b0 msgr2=0x7fcb4015c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 shutdown_connections 2024-04-24T23:09:24.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.195+0000 7fcb46800640 1 -- 172.21.15.146:0/3971038948 wait complete. 2024-04-24T23:09:24.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:09:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.415+0000 7fd2a6a00640 1 Processor -- start 2024-04-24T23:09:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.415+0000 7fd2a6a00640 1 -- start start 2024-04-24T23:09:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a6a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2a015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a6a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd2a00b2ab0 0x7fd2a006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a6a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a006ec80 con 0x7fd2a006e870 2024-04-24T23:09:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a6a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a00723f0 con 0x7fd2a00b2ab0 2024-04-24T23:09:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a6a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00b3250 con 0x7fd2a0155460 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a4a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2a006e870 0x7fd2a015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41452/0 (socket says 172.21.15.146:41452) 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd2a4a00640 1 -- 172.21.15.146:0/1357909340 learned_addr learned my addr 172.21.15.146:0/1357909340 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd29f400640 1 --2- 172.21.15.146:0/1357909340 >> v2:172.21.15.203:3300/0 conn(0x7fd2a00b2ab0 0x7fd2a006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.417+0000 7fd29fe00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2a015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559114141 0 0) 0x7fd298001490 con 0x7fd2a006e870 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd284003520 con 0x7fd2a006e870 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2623558250 0 0) 0x7fd284003520 con 0x7fd2a006e870 2024-04-24T23:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 msgr2=0x7fd2a015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2a015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 >> v2:172.21.15.203:3300/0 conn(0x7fd2a00b2ab0 msgr2=0x7fd2a006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 --2- 172.21.15.146:0/1357909340 >> v2:172.21.15.203:3300/0 conn(0x7fd2a00b2ab0 0x7fd2a006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a00b3530 con 0x7fd2a006e870 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fd298001bc0 con 0x7fd2a006e870 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 >> v1:172.21.15.146:6789/0 conn(0x7fd2a006e870 legacy=0x7fd2a015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd284003f30 0x7fd284004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00b3250 con 0x7fd284004d40 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd28400dbd0 con 0x7fd284003f30 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.418+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd28400dd50 con 0x7fd2a0155460 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd29f400640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd284003f30 0x7fd284004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd29fe00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 -- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 msgr2=0x7fd2840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155460 0x7fd2840039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 -- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd284003f30 msgr2=0x7fd284004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd284003f30 0x7fd284004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.419+0000 7fd2a4a00640 1 -- 172.21.15.146:0/1357909340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd284003520 con 0x7fd284004d40 2024-04-24T23:09:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.420+0000 7fd2a4a00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2840051c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd29800aa70 tx=0x7fd284005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82592975cdff6db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.420+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29800a690 con 0x7fd284004d40 2024-04-24T23:09:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29802f070 con 0x7fd284004d40 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd29ea00640 1 -- 172.21.15.146:0/1357909340 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298034470 con 0x7fd284004d40 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 -- 172.21.15.146:0/1357909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 msgr2=0x7fd2840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/1357909340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2840051c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd29800aa70 tx=0x7fd284005830 comp rx=0 tx=0).stop 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a4a00640 1 -- 172.21.15.146:0/1357909340 reap_dead start 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 -- 172.21.15.146:0/1357909340 shutdown_connections 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 -- 172.21.15.146:0/1357909340 >> 172.21.15.146:0/1357909340 conn(0x7fd2a00b17b0 msgr2=0x7fd2a00b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 -- 172.21.15.146:0/1357909340 shutdown_connections 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.421+0000 7fd2a6a00640 1 -- 172.21.15.146:0/1357909340 wait complete. 2024-04-24T23:09:24.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.423+0000 7fd2a6a00640 1 Processor -- start 2024-04-24T23:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.423+0000 7fd2a6a00640 1 -- start start 2024-04-24T23:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155840 0x7fd2a0144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2a0151300 0x7fd2a0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a00b2f30 con 0x7fd284004d40 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a0070ec0 con 0x7fd2a0151300 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd2a6a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00b3af0 con 0x7fd2a0155840 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59544/0 (socket says 172.21.15.146:59544) 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.424+0000 7fd29fe00640 1 -- 172.21.15.146:0/205146877 learned_addr learned my addr 172.21.15.146:0/205146877 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 -- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155840 msgr2=0x7fd2a0144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd2a4a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2a0151300 0x7fd2a0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155840 0x7fd2a0144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 -- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2a0151300 msgr2=0x7fd2a0151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2a0151300 0x7fd2a0151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 -- 172.21.15.146:0/205146877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a0156070 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd29fe00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd290010890 tx=0x7fd290010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.425+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29000f040 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.426+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29000eb00 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.426+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29001c400 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.426+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a0156350 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.426+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a0156910 con 0x7fd284004d40 2024-04-24T23:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.427+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a004f5a0 con 0x7fd284004d40 2024-04-24T23:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.428+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd29001c5a0 con 0x7fd284004d40 2024-04-24T23:09:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.429+0000 7fd297e00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 0x7fd28006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.429+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6001+0+0 (secure 0 0 0) 0x7fd29008b5e0 con 0x7fd284004d40 2024-04-24T23:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.430+0000 7fd29f400640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 0x7fd28006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.431+0000 7fd29f400640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 0x7fd28006e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd2a01544b0 tx=0x7fd28c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.435+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd290018030 con 0x7fd284004d40 2024-04-24T23:09:24.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:24.673+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd2a00b4a60 con 0x7fd284004d40 2024-04-24T23:09:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.193+0000 7fd297e00640 1 -- 172.21.15.146:0/205146877 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v70) ==== 174+0+0 (secure 0 0 0) 0x7fd290059dd0 con 0x7fd284004d40 2024-04-24T23:09:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 11 and data pool 12 2024-04-24T23:09:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 msgr2=0x7fd28006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 0x7fd28006e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd2a01544b0 tx=0x7fd28c008040 comp rx=0 tx=0).stop 2024-04-24T23:09:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 msgr2=0x7fd2a0152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd290010890 tx=0x7fd290010d50 comp rx=0 tx=0).stop 2024-04-24T23:09:25.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 shutdown_connections 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2a0151300 0x7fd2a0151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd28006be30 0x7fd28006e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd2a0155840 0x7fd2a0144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 --2- 172.21.15.146:0/205146877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd284004d40 0x7fd2a0152110 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.197+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 >> 172.21.15.146:0/205146877 conn(0x7fd2a00b17b0 msgr2=0x7fd2a01500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.198+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 shutdown_connections 2024-04-24T23:09:25.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.198+0000 7fd2a6a00640 1 -- 172.21.15.146:0/205146877 wait complete. 2024-04-24T23:09:25.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:25.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.407+0000 7f9161000640 1 Processor -- start 2024-04-24T23:09:25.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.407+0000 7f9161000640 1 -- start start 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.408+0000 7f9161000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f915c158590 0x7f915c162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.408+0000 7f9161000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.408+0000 7f9161000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f915c162990 con 0x7f915c0cfc90 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.408+0000 7f9161000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f915c158970 con 0x7f915c158590 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.408+0000 7f9161000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f915c070c10 con 0x7f915c0715f0 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f915a800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f915c0cfc90 0x7f915c15e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41468/0 (socket says 172.21.15.146:41468) 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f915c158590 0x7f915c162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f915a800640 1 -- 172.21.15.146:0/2179481279 learned_addr learned my addr 172.21.15.146:0/2179481279 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159400640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159e00640 1 -- 172.21.15.146:0/2179481279 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 msgr2=0x7f915c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159e00640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159e00640 1 -- 172.21.15.146:0/2179481279 >> v1:172.21.15.146:6789/0 conn(0x7f915c0cfc90 legacy=0x7f915c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159e00640 1 -- 172.21.15.146:0/2179481279 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c070ef0 con 0x7f915c158590 2024-04-24T23:09:25.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9158a00640 1 -- 172.21.15.146:0/2179481279 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890503940 0 0) 0x7f9154001490 con 0x7f915c0cfc90 2024-04-24T23:09:25.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.409+0000 7f9159400640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:25.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.410+0000 7f9159e00640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c158590 0x7f915c162450 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f91480097a0 tx=0x7f914802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1e0cd54d430dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.411+0000 7f9158a00640 1 -- 172.21.15.146:0/2179481279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148037070 con 0x7f915c158590 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.411+0000 7f9158a00640 1 -- 172.21.15.146:0/2179481279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9148032440 con 0x7f915c158590 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.411+0000 7f9158a00640 1 -- 172.21.15.146:0/2179481279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148032810 con 0x7f915c158590 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.411+0000 7f9161000640 1 -- 172.21.15.146:0/2179481279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c158590 msgr2=0x7f915c162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.411+0000 7f9161000640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c158590 0x7f915c162450 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f91480097a0 tx=0x7f914802a210 comp rx=0 tx=0).stop 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 -- 172.21.15.146:0/2179481279 shutdown_connections 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 --2- 172.21.15.146:0/2179481279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c158590 0x7f915c162450 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 -- 172.21.15.146:0/2179481279 >> 172.21.15.146:0/2179481279 conn(0x7f915c06b320 msgr2=0x7f915c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 -- 172.21.15.146:0/2179481279 shutdown_connections 2024-04-24T23:09:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.412+0000 7f9161000640 1 -- 172.21.15.146:0/2179481279 wait complete. 2024-04-24T23:09:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.413+0000 7f9161000640 1 Processor -- start 2024-04-24T23:09:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.413+0000 7f9161000640 1 -- start start 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915c158590 0x7f915c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f915c161f30 con 0x7f915c0cfc90 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f915c161c50 con 0x7f915c158590 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.414+0000 7f9161000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f915c0d0120 con 0x7f915c0715f0 2024-04-24T23:09:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59560/0 (socket says 172.21.15.146:59560) 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 -- 172.21.15.146:0/3752944249 learned_addr learned my addr 172.21.15.146:0/3752944249 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 -- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 msgr2=0x7f915c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 -- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915c158590 msgr2=0x7f915c15e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915c158590 0x7f915c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 -- 172.21.15.146:0/3752944249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c159bf0 con 0x7f915c0cfc90 2024-04-24T23:09:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9159400640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c7f0 tx=0x7f914c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.415+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c015070 con 0x7f915c0cfc90 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.416+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c007a30 con 0x7f915c0cfc90 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.416+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c159ed0 con 0x7f915c0cfc90 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.416+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c007e00 con 0x7f915c0cfc90 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.416+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c15a490 con 0x7f915c0cfc90 2024-04-24T23:09:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.417+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915c068190 con 0x7f915c0cfc90 2024-04-24T23:09:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.418+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f914c018070 con 0x7f915c0cfc90 2024-04-24T23:09:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.418+0000 7f9152000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 0x7f913c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.419+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f914c08b080 con 0x7f915c0cfc90 2024-04-24T23:09:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.419+0000 7f9159e00640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 0x7f913c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.420+0000 7f9159e00640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 0x7f913c06e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9148034000 tx=0x7f914802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.423+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f914c059800 con 0x7f915c0cfc90 2024-04-24T23:09:25.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.617+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f915c071a70 con 0x7f915c0cfc90 2024-04-24T23:09:25.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.620+0000 7f9152000640 1 -- 172.21.15.146:0/3752944249 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16922 (secure 0 0 0) 0x7f914c059100 con 0x7f915c0cfc90 2024-04-24T23:09:25.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:25.622 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:24.676139+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.622+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 msgr2=0x7f913c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.622+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 0x7f913c06e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9148034000 tx=0x7f914802c000 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.622+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 msgr2=0x7f915c15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.622+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c7f0 tx=0x7f914c00cbf0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 shutdown_connections 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f915c158590 0x7f915c15e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f915c0cfc90 0x7f915c15b2b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f913c06be30 0x7f913c06e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 --2- 172.21.15.146:0/3752944249 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f915c0715f0 0x7f915c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 >> 172.21.15.146:0/3752944249 conn(0x7f915c06b320 msgr2=0x7f915c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 shutdown_connections 2024-04-24T23:09:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.623+0000 7f9161000640 1 -- 172.21.15.146:0/3752944249 wait complete. 2024-04-24T23:09:25.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:25.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.837+0000 7fedaee00640 1 Processor -- start 2024-04-24T23:09:25.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.838+0000 7fedaee00640 1 -- start start 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.839+0000 7fedaee00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7feda80d0240 0x7feda80cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.839+0000 7fedaee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7feda815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.839+0000 7fedaee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda8070f90 con 0x7feda81561c0 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.839+0000 7fedaee00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7feda80b4310 con 0x7feda80d0240 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.839+0000 7fedaee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feda81565a0 con 0x7feda80709d0 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7fedada00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feda81561c0 0x7feda80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41478/0 (socket says 172.21.15.146:41478) 2024-04-24T23:09:25.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7fedada00640 1 -- 172.21.15.146:0/1258569996 learned_addr learned my addr 172.21.15.146:0/1258569996 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7fedad000640 1 --2- 172.21.15.146:0/1258569996 >> v2:172.21.15.203:3300/0 conn(0x7feda80d0240 0x7feda80cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208840109 0 0) 0x7feda8070f90 con 0x7feda81561c0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7fedae400640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7feda815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed90003520 con 0x7feda81561c0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1038106412 0 0) 0x7fed90003520 con 0x7feda81561c0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 msgr2=0x7feda815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7feda815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 >> v2:172.21.15.203:3300/0 conn(0x7feda80d0240 msgr2=0x7feda80cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 --2- 172.21.15.146:0/1258569996 >> v2:172.21.15.203:3300/0 conn(0x7feda80d0240 0x7feda80cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.840+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8071270 con 0x7feda81561c0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fed9c0019f0 con 0x7feda81561c0 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 >> v1:172.21.15.146:6789/0 conn(0x7feda81561c0 legacy=0x7feda80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7fed90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed90004d40 0x7fed900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feda80b4310 con 0x7fed900039b0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed9000ba40 con 0x7fed90004d40 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed9000bc40 con 0x7feda80709d0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedad000640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7fed90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedae400640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed90004d40 0x7fed900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 -- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 msgr2=0x7fed90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feda80709d0 0x7fed90004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 -- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed90004d40 msgr2=0x7fed900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed90004d40 0x7fed900051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.841+0000 7fedada00640 1 -- 172.21.15.146:0/1258569996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90003520 con 0x7fed900039b0 2024-04-24T23:09:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.842+0000 7fedada00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00a7b0 tx=0x7fed90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c619f7b08d444636 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00a3d0 con 0x7fed900039b0 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c02f070 con 0x7fed900039b0 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7feda7e00640 1 -- 172.21.15.146:0/1258569996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c02bc20 con 0x7fed900039b0 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 -- 172.21.15.146:0/1258569996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed900039b0 msgr2=0x7fed90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 --2- 172.21.15.146:0/1258569996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00a7b0 tx=0x7fed90005830 comp rx=0 tx=0).stop 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedae400640 1 -- 172.21.15.146:0/1258569996 reap_dead start 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 -- 172.21.15.146:0/1258569996 shutdown_connections 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 -- 172.21.15.146:0/1258569996 >> 172.21.15.146:0/1258569996 conn(0x7feda806b320 msgr2=0x7feda806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 -- 172.21.15.146:0/1258569996 shutdown_connections 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.843+0000 7fedaee00640 1 -- 172.21.15.146:0/1258569996 wait complete. 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.845+0000 7fedaee00640 1 Processor -- start 2024-04-24T23:09:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.845+0000 7fedaee00640 1 -- start start 2024-04-24T23:09:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.846+0000 7fedaee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed900039b0 0x7feda8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.846+0000 7fedaee00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda81519d0 0x7feda8151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.846+0000 7fedaee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedaee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feda815cb80 con 0x7feda8152350 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedaee00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feda8071830 con 0x7feda81519d0 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedaee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feda815cd00 con 0x7fed900039b0 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59582/0 (socket says 172.21.15.146:59582) 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 -- 172.21.15.146:0/3863215177 learned_addr learned my addr 172.21.15.146:0/3863215177 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedada00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed900039b0 0x7feda8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedad000640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda81519d0 0x7feda8151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 -- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed900039b0 msgr2=0x7feda8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed900039b0 0x7feda8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 -- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda81519d0 msgr2=0x7feda8151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:25.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda81519d0 0x7feda8151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.847+0000 7fedae400640 1 -- 172.21.15.146:0/3863215177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda81576a0 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7fedae400640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feda80d09f0 tx=0x7feda0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda000f040 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda001c070 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda000eb00 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda80ae000 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.848+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda815b500 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.849+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda804f500 con 0x7feda8152350 2024-04-24T23:09:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.851+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feda000eca0 con 0x7feda8152350 2024-04-24T23:09:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.852+0000 7feda5600640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.852+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7feda008ab90 con 0x7feda8152350 2024-04-24T23:09:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.853+0000 7fedada00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.854+0000 7fedada00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 0x7fed8806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fed9c033000 tx=0x7fed9c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:25.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:25.857+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7feda0026020 con 0x7feda8152350 2024-04-24T23:09:26.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.054+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feda8154af0 con 0x7feda8152350 2024-04-24T23:09:26.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.057+0000 7feda5600640 1 -- 172.21.15.146:0/3863215177 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16922 (secure 0 0 0) 0x7feda0058d60 con 0x7feda8152350 2024-04-24T23:09:26.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:26.060 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:24.676139+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 msgr2=0x7fed8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 0x7fed8806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fed9c033000 tx=0x7fed9c007000 comp rx=0 tx=0).stop 2024-04-24T23:09:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 msgr2=0x7feda81527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feda80d09f0 tx=0x7feda0010c20 comp rx=0 tx=0).stop 2024-04-24T23:09:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 shutdown_connections 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda8152350 0x7feda81527d0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feda81519d0 0x7feda8151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fed8806be30 0x7fed8806e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 --2- 172.21.15.146:0/3863215177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed900039b0 0x7feda8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 >> 172.21.15.146:0/3863215177 conn(0x7feda806b320 msgr2=0x7feda8155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 shutdown_connections 2024-04-24T23:09:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.060+0000 7fedaee00640 1 -- 172.21.15.146:0/3863215177 wait complete. 2024-04-24T23:09:26.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:09:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.283+0000 7fd737e00640 1 Processor -- start 2024-04-24T23:09:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.283+0000 7fd737e00640 1 -- start start 2024-04-24T23:09:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.284+0000 7fd737e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd73815bcd0 0x7fd7380cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.284+0000 7fd737e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd7380d03d0 0x7fd73815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.284+0000 7fd737e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7380b4df0 con 0x7fd73815cd60 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.284+0000 7fd737e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd73815c8d0 con 0x7fd73815bcd0 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.284+0000 7fd737e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd7380b4b10 con 0x7fd7380d03d0 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd736a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd73815bcd0 0x7fd7380cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd72fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd73815cd60 0x7fd7380cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41482/0 (socket says 172.21.15.146:41482) 2024-04-24T23:09:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd72fe00640 1 -- 172.21.15.146:0/257998614 learned_addr learned my addr 172.21.15.146:0/257998614 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd737400640 1 --2- 172.21.15.146:0/257998614 >> v2:172.21.15.203:3300/0 conn(0x7fd7380d03d0 0x7fd73815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd736a00640 1 -- 172.21.15.146:0/257998614 >> v2:172.21.15.203:3300/0 conn(0x7fd7380d03d0 msgr2=0x7fd73815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd736a00640 1 --2- 172.21.15.146:0/257998614 >> v2:172.21.15.203:3300/0 conn(0x7fd7380d03d0 0x7fd73815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd736a00640 1 -- 172.21.15.146:0/257998614 >> v1:172.21.15.146:6789/0 conn(0x7fd73815cd60 legacy=0x7fd7380cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.285+0000 7fd736a00640 1 -- 172.21.15.146:0/257998614 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73815c280 con 0x7fd73815bcd0 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.286+0000 7fd736a00640 1 --2- 172.21.15.146:0/257998614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cc230 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd7280097a0 tx=0x7fd72802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eae8aab2f71eab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd736000640 1 -- 172.21.15.146:0/257998614 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728037070 con 0x7fd73815bcd0 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd736000640 1 -- 172.21.15.146:0/257998614 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728032440 con 0x7fd73815bcd0 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd736000640 1 -- 172.21.15.146:0/257998614 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728032810 con 0x7fd73815bcd0 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd737e00640 1 -- 172.21.15.146:0/257998614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 msgr2=0x7fd7380cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd737e00640 1 --2- 172.21.15.146:0/257998614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cc230 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd7280097a0 tx=0x7fd72802a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd737e00640 1 -- 172.21.15.146:0/257998614 shutdown_connections 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.287+0000 7fd737e00640 1 --2- 172.21.15.146:0/257998614 >> v2:172.21.15.203:3300/0 conn(0x7fd7380d03d0 0x7fd73815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.288+0000 7fd737e00640 1 --2- 172.21.15.146:0/257998614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cc230 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.288+0000 7fd737e00640 1 -- 172.21.15.146:0/257998614 >> 172.21.15.146:0/257998614 conn(0x7fd73806b560 msgr2=0x7fd73806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.288+0000 7fd737e00640 1 -- 172.21.15.146:0/257998614 shutdown_connections 2024-04-24T23:09:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.288+0000 7fd737e00640 1 -- 172.21.15.146:0/257998614 wait complete. 2024-04-24T23:09:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.289+0000 7fd737e00640 1 Processor -- start 2024-04-24T23:09:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.289+0000 7fd737e00640 1 -- start start 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7380d03d0 0x7fd7381f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd73815cd60 0x7fd73806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd73806e590 con 0x7fd73815bcd0 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380cc770 con 0x7fd7380d03d0 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.290+0000 7fd737e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd7380b4790 con 0x7fd73815cd60 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59596/0 (socket says 172.21.15.146:59596) 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 -- 172.21.15.146:0/647012759 learned_addr learned my addr 172.21.15.146:0/647012759 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd737400640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd73815cd60 0x7fd73806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd736a00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7380d03d0 0x7fd7381f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 -- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd73815cd60 msgr2=0x7fd73806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd73815cd60 0x7fd73806c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 -- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7380d03d0 msgr2=0x7fd7381f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7380d03d0 0x7fd7381f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.291+0000 7fd72fe00640 1 -- 172.21.15.146:0/647012759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7380cb7f0 con 0x7fd73815bcd0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd72fe00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c3c0 tx=0x7fd72000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720017070 con 0x7fd73815bcd0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd720005ce0 con 0x7fd73815bcd0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720007310 con 0x7fd73815bcd0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd738153c70 con 0x7fd73815bcd0 2024-04-24T23:09:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.292+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd738072550 con 0x7fd73815bcd0 2024-04-24T23:09:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.293+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73804f500 con 0x7fd73815bcd0 2024-04-24T23:09:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.294+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd72001a070 con 0x7fd73815bcd0 2024-04-24T23:09:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.295+0000 7fd72ea00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 0x7fd71406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.295+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7fd72008a3f0 con 0x7fd73815bcd0 2024-04-24T23:09:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.295+0000 7fd736a00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 0x7fd71406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:26.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.297+0000 7fd736a00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 0x7fd71406e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd728034000 tx=0x7fd72802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.299+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd720058b70 con 0x7fd73815bcd0 2024-04-24T23:09:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:26.536+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd73806e140 con 0x7fd73815bcd0 2024-04-24T23:09:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.229+0000 7fd72ea00640 1 -- 172.21.15.146:0/647012759 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) ==== 118+0+0 (secure 0 0 0) 0x7fd720058470 con 0x7fd73815bcd0 2024-04-24T23:09:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 msgr2=0x7fd71406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 0x7fd71406e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd728034000 tx=0x7fd72802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 msgr2=0x7fd7380cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c3c0 tx=0x7fd72000c880 comp rx=0 tx=0).stop 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 shutdown_connections 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd71406be30 0x7fd71406e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd73815cd60 0x7fd73806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd73815bcd0 0x7fd7380cb2b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 --2- 172.21.15.146:0/647012759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7380d03d0 0x7fd7381f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 >> 172.21.15.146:0/647012759 conn(0x7fd73806b560 msgr2=0x7fd7381589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.233+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 shutdown_connections 2024-04-24T23:09:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.234+0000 7fd737e00640 1 -- 172.21.15.146:0/647012759 wait complete. 2024-04-24T23:09:27.257 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:09:27.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:09:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.460+0000 7f3836e00640 1 Processor -- start 2024-04-24T23:09:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.460+0000 7f3836e00640 1 -- start start 2024-04-24T23:09:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f3836e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f383006ea00 0x7f3830162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f3836e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f383006c990 0x7f383006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f3836e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3830072360 con 0x7f383014be80 2024-04-24T23:09:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f3836e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3830072640 con 0x7f383006c990 2024-04-24T23:09:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f3836e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f383014c260 con 0x7f383006ea00 2024-04-24T23:09:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f382fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f383014be80 0x7f3830071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41498/0 (socket says 172.21.15.146:41498) 2024-04-24T23:09:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.462+0000 7f382fe00640 1 -- 172.21.15.146:0/2211439220 learned_addr learned my addr 172.21.15.146:0/2211439220 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f3834e00640 1 --2- 172.21.15.146:0/2211439220 >> v2:172.21.15.146:3300/0 conn(0x7f383006c990 0x7f383006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f382f400640 1 --2- 172.21.15.146:0/2211439220 >> v2:172.21.15.203:3300/0 conn(0x7f383006ea00 0x7f3830162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f3834e00640 1 -- 172.21.15.146:0/2211439220 >> v2:172.21.15.203:3300/0 conn(0x7f383006ea00 msgr2=0x7f3830162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f3834e00640 1 --2- 172.21.15.146:0/2211439220 >> v2:172.21.15.203:3300/0 conn(0x7f383006ea00 0x7f3830162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f3834e00640 1 -- 172.21.15.146:0/2211439220 >> v1:172.21.15.146:6789/0 conn(0x7f383014be80 legacy=0x7f3830071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f3834e00640 1 -- 172.21.15.146:0/2211439220 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38300b2c50 con 0x7f383006c990 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.463+0000 7f382ea00640 1 -- 172.21.15.146:0/2211439220 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391961117 0 0) 0x7f3830072360 con 0x7f383014be80 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.464+0000 7f3834e00640 1 --2- 172.21.15.146:0/2211439220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006c990 0x7f383006cdc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3830072a00 tx=0x7f382802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea31f65343812dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.464+0000 7f382ea00640 1 -- 172.21.15.146:0/2211439220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828037070 con 0x7f383006c990 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.464+0000 7f382ea00640 1 -- 172.21.15.146:0/2211439220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828032440 con 0x7f383006c990 2024-04-24T23:09:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.464+0000 7f382ea00640 1 -- 172.21.15.146:0/2211439220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828032810 con 0x7f383006c990 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 -- 172.21.15.146:0/2211439220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006c990 msgr2=0x7f383006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 --2- 172.21.15.146:0/2211439220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006c990 0x7f383006cdc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3830072a00 tx=0x7f382802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 -- 172.21.15.146:0/2211439220 shutdown_connections 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 --2- 172.21.15.146:0/2211439220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006c990 0x7f383006cdc0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 --2- 172.21.15.146:0/2211439220 >> v2:172.21.15.203:3300/0 conn(0x7f383006ea00 0x7f3830162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 -- 172.21.15.146:0/2211439220 >> 172.21.15.146:0/2211439220 conn(0x7f38300b17b0 msgr2=0x7f38300b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 -- 172.21.15.146:0/2211439220 shutdown_connections 2024-04-24T23:09:27.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.465+0000 7f3836e00640 1 -- 172.21.15.146:0/2211439220 wait complete. 2024-04-24T23:09:27.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.467+0000 7f3836e00640 1 Processor -- start 2024-04-24T23:09:27.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.467+0000 7f3836e00640 1 -- start start 2024-04-24T23:09:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 0x7f38301423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f383014be80 0x7f3830160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f383006d300 con 0x7f383006ea00 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f38300b32a0 con 0x7f383006c990 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f3836e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38300b3730 con 0x7f383014be80 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f382f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f382f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59618/0 (socket says 172.21.15.146:59618) 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.468+0000 7f382f400640 1 -- 172.21.15.146:0/2046151979 learned_addr learned my addr 172.21.15.146:0/2046151979 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382fe00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 0x7f38301423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f3834e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f383014be80 0x7f3830160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 -- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f383014be80 msgr2=0x7f3830160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f383014be80 0x7f3830160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 -- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 msgr2=0x7f38301423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 0x7f38301423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 -- 172.21.15.146:0/2046151979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3830143460 con 0x7f383006ea00 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382fe00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 0x7f38301423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f382f400640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3818007ef0 tx=0x7f381800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818014620 con 0x7f383006ea00 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3818019070 con 0x7f383006ea00 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818014a00 con 0x7f383006ea00 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.469+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3830143740 con 0x7f383006ea00 2024-04-24T23:09:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.470+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3830143d00 con 0x7f383006ea00 2024-04-24T23:09:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.471+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383004f5a0 con 0x7f383006ea00 2024-04-24T23:09:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.472+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3818014ba0 con 0x7f383006ea00 2024-04-24T23:09:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.473+0000 7f3827e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.473+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f381808b930 con 0x7f383006ea00 2024-04-24T23:09:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.473+0000 7f382fe00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:27.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.474+0000 7f382fe00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 0x7f380c06e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3820000f60 tx=0x7f3820009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:27.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.477+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f381805a140 con 0x7f383006ea00 2024-04-24T23:09:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:27.713+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f38301625d0 con 0x7f383006ea00 2024-04-24T23:09:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.250+0000 7f3827e00640 1 -- 172.21.15.146:0/2046151979 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7f3818059a40 con 0x7f383006ea00 2024-04-24T23:09:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 msgr2=0x7f380c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 0x7f380c06e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3820000f60 tx=0x7f3820009040 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 msgr2=0x7f38300b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3818007ef0 tx=0x7f381800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 shutdown_connections 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f383014be80 0x7f3830160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f383006ea00 0x7f38300b4280 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 --2- 172.21.15.146:0/2046151979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f383006c990 0x7f38301423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.253+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 >> 172.21.15.146:0/2046151979 conn(0x7f38300b17b0 msgr2=0x7f3830164f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.254+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 shutdown_connections 2024-04-24T23:09:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.254+0000 7f3836e00640 1 -- 172.21.15.146:0/2046151979 wait complete. 2024-04-24T23:09:28.276 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:09:28.276 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.471+0000 7efd41000640 1 Processor -- start 2024-04-24T23:09:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.471+0000 7efd41000640 1 -- start start 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.472+0000 7efd41000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efd3c15a410 0x7efd3c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd41000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd3c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd41000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd3c06e120 con 0x7efd3c15e330 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd41000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efd3c06e400 con 0x7efd3c15a410 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd41000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd3c06e6e0 con 0x7efd3c06dc50 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd3be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efd3c15e330 0x7efd3c0709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42946/0 (socket says 172.21.15.146:42946) 2024-04-24T23:09:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd3be00640 1 -- 172.21.15.146:0/206977173 learned_addr learned my addr 172.21.15.146:0/206977173 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd3aa00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd3c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd3b400640 1 --2- 172.21.15.146:0/206977173 >> v2:172.21.15.203:3300/0 conn(0x7efd3c15a410 0x7efd3c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.473+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786295140 0 0) 0x7efd3c06e120 con 0x7efd3c15e330 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd20003520 con 0x7efd3c15e330 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2523079849 0 0) 0x7efd20003520 con 0x7efd3c15e330 2024-04-24T23:09:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 msgr2=0x7efd3c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd3c15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 >> v2:172.21.15.203:3300/0 conn(0x7efd3c15a410 msgr2=0x7efd3c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 --2- 172.21.15.146:0/206977173 >> v2:172.21.15.203:3300/0 conn(0x7efd3c15a410 0x7efd3c0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c0af130 con 0x7efd3c15e330 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7efd340019f0 con 0x7efd3c15e330 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 >> v1:172.21.15.146:6789/0 conn(0x7efd3c15e330 legacy=0x7efd3c0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd20003f80 0x7efd20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c06e400 con 0x7efd20004d40 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c06e6e0 con 0x7efd20003f80 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd2000dbd0 con 0x7efd3c06dc50 2024-04-24T23:09:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.474+0000 7efd3be00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3b400640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3be00640 1 -- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 msgr2=0x7efd200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3be00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c06dc50 0x7efd200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3be00640 1 -- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd20003f80 msgr2=0x7efd20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3aa00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd20003f80 0x7efd20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3be00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd20003f80 0x7efd20004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.475+0000 7efd3be00640 1 -- 172.21.15.146:0/206977173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd20003520 con 0x7efd20004d40 2024-04-24T23:09:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.476+0000 7efd3be00640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd200051c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd3400a800 tx=0x7efd20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93f767705f9ee9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.476+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3400a3f0 con 0x7efd20004d40 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.476+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3402f070 con 0x7efd20004d40 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.476+0000 7efd3a000640 1 -- 172.21.15.146:0/206977173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3402bc70 con 0x7efd20004d40 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 -- 172.21.15.146:0/206977173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 msgr2=0x7efd200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 --2- 172.21.15.146:0/206977173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd200051c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd3400a800 tx=0x7efd20005830 comp rx=0 tx=0).stop 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd3be00640 1 -- 172.21.15.146:0/206977173 reap_dead start 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 -- 172.21.15.146:0/206977173 shutdown_connections 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 -- 172.21.15.146:0/206977173 >> 172.21.15.146:0/206977173 conn(0x7efd3c06b320 msgr2=0x7efd3c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 -- 172.21.15.146:0/206977173 shutdown_connections 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.477+0000 7efd41000640 1 -- 172.21.15.146:0/206977173 wait complete. 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.478+0000 7efd41000640 1 Processor -- start 2024-04-24T23:09:28.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.479+0000 7efd41000640 1 -- start start 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.479+0000 7efd41000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd41000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd3c0c65b0 0x7efd3c0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd41000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c0c6a30 0x7efd3c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd41000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c0af320 con 0x7efd20004d40 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd41000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c0b4140 con 0x7efd3c0c65b0 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd41000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd3c15ddf0 con 0x7efd3c0c6a30 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40496/0 (socket says 172.21.15.146:40496) 2024-04-24T23:09:28.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 -- 172.21.15.146:0/1436264869 learned_addr learned my addr 172.21.15.146:0/1436264869 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 -- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c0c6a30 msgr2=0x7efd3c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c0c6a30 0x7efd3c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 -- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd3c0c65b0 msgr2=0x7efd3c0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd3c0c65b0 0x7efd3c0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.480+0000 7efd3b400640 1 -- 172.21.15.146:0/1436264869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c0c5510 con 0x7efd20004d40 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd3b400640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efd2c010770 tx=0x7efd2c010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c019070 con 0x7efd20004d40 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2c00ebe0 con 0x7efd20004d40 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00b040 con 0x7efd20004d40 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3c0c57f0 con 0x7efd20004d40 2024-04-24T23:09:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.481+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3c0c5db0 con 0x7efd20004d40 2024-04-24T23:09:28.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.482+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3c04f500 con 0x7efd20004d40 2024-04-24T23:09:28.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.483+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd2c01c070 con 0x7efd20004d40 2024-04-24T23:09:28.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.484+0000 7efd33400640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 0x7efd1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.484+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7efd2c08afa0 con 0x7efd20004d40 2024-04-24T23:09:28.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.484+0000 7efd3aa00640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 0x7efd1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.485+0000 7efd3aa00640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 0x7efd1c06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd3c14eba0 tx=0x7efd28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.488+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efd2c059720 con 0x7efd20004d40 2024-04-24T23:09:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.705+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd3c06cb00 con 0x7efd20004d40 2024-04-24T23:09:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.707+0000 7efd33400640 1 -- 172.21.15.146:0/1436264869 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7efd2c059020 con 0x7efd20004d40 2024-04-24T23:09:28.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:28.709 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 msgr2=0x7efd1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 0x7efd1c06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd3c14eba0 tx=0x7efd28008040 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 msgr2=0x7efd3c14e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efd2c010770 tx=0x7efd2c010c30 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 shutdown_connections 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7efd1c06be30 0x7efd1c06e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd3c0c6a30 0x7efd3c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd3c0c65b0 0x7efd3c0c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 --2- 172.21.15.146:0/1436264869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd20004d40 0x7efd3c14e0d0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 >> 172.21.15.146:0/1436264869 conn(0x7efd3c06b320 msgr2=0x7efd3c159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.709+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 shutdown_connections 2024-04-24T23:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.710+0000 7efd41000640 1 -- 172.21.15.146:0/1436264869 wait complete. 2024-04-24T23:09:28.730 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.916+0000 7f2fdcc00640 1 Processor -- start 2024-04-24T23:09:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.916+0000 7f2fdcc00640 1 -- start start 2024-04-24T23:09:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fdcc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fd815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fdcc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2fd80d03a0 0x7f2fd80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fdcc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd80cdf70 con 0x7f2fd80b2a20 2024-04-24T23:09:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fdcc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd815d360 con 0x7f2fd80d03a0 2024-04-24T23:09:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fdcc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd8145a20 con 0x7f2fd8145640 2024-04-24T23:09:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fd5400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2fd80b2a20 0x7f2fd80cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42960/0 (socket says 172.21.15.146:42960) 2024-04-24T23:09:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fd5400640 1 -- 172.21.15.146:0/799532539 learned_addr learned my addr 172.21.15.146:0/799532539 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fd5e00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fd815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.918+0000 7f2fd6800640 1 --2- 172.21.15.146:0/799532539 >> v2:172.21.15.203:3300/0 conn(0x7f2fd80d03a0 0x7f2fd80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059257 0 0) 0x7f2fd80cdf70 con 0x7f2fd80b2a20 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fbc003520 con 0x7f2fd80b2a20 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1659076870 0 0) 0x7f2fbc003520 con 0x7f2fd80b2a20 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 msgr2=0x7f2fd815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fd815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 >> v2:172.21.15.203:3300/0 conn(0x7f2fd80d03a0 msgr2=0x7f2fd80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 --2- 172.21.15.146:0/799532539 >> v2:172.21.15.203:3300/0 conn(0x7f2fd80d03a0 0x7f2fd80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd806d140 con 0x7f2fd80b2a20 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f2fc4001670 con 0x7f2fd80b2a20 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 >> v1:172.21.15.146:6789/0 conn(0x7f2fd80b2a20 legacy=0x7f2fd80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fbc0039b0 0x7f2fbc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd815d360 con 0x7f2fbc004d40 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd8145a20 con 0x7f2fbc0039b0 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.919+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc00b9c0 con 0x7f2fd8145640 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd5e00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fbc0039b0 0x7f2fbc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd5400640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 -- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 msgr2=0x7f2fbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd8145640 0x7f2fbc004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 -- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fbc0039b0 msgr2=0x7f2fbc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fbc0039b0 0x7f2fbc003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.920+0000 7f2fd6800640 1 -- 172.21.15.146:0/799532539 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc003520 con 0x7f2fbc004d40 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.921+0000 7f2fd6800640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fbc0051c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009f90 tx=0x7f2fbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ef61d376443909 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.921+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0009c10 con 0x7f2fbc004d40 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.921+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0036070 con 0x7f2fbc004d40 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.921+0000 7f2fd4a00640 1 -- 172.21.15.146:0/799532539 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0031880 con 0x7f2fbc004d40 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 -- 172.21.15.146:0/799532539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 msgr2=0x7f2fbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/799532539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fbc0051c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009f90 tx=0x7f2fbc005830 comp rx=0 tx=0).stop 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fd6800640 1 -- 172.21.15.146:0/799532539 reap_dead start 2024-04-24T23:09:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 -- 172.21.15.146:0/799532539 shutdown_connections 2024-04-24T23:09:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 -- 172.21.15.146:0/799532539 >> 172.21.15.146:0/799532539 conn(0x7f2fd806b320 msgr2=0x7f2fd806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 -- 172.21.15.146:0/799532539 shutdown_connections 2024-04-24T23:09:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.922+0000 7f2fdcc00640 1 -- 172.21.15.146:0/799532539 wait complete. 2024-04-24T23:09:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.924+0000 7f2fdcc00640 1 Processor -- start 2024-04-24T23:09:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.924+0000 7f2fdcc00640 1 -- start start 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 0x7f2fd813c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fd813ecd0 0x7f2fd813c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd806d9e0 con 0x7f2fbc004d40 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd806d700 con 0x7f2fd813ecd0 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fdcc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd806cbc0 con 0x7f2fd813e850 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40518/0 (socket says 172.21.15.146:40518) 2024-04-24T23:09:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 -- 172.21.15.146:0/3011691501 learned_addr learned my addr 172.21.15.146:0/3011691501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5400640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 0x7f2fd813c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 -- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 msgr2=0x7f2fd813c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 0x7f2fd813c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 -- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fd813ecd0 msgr2=0x7f2fd813c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fd813ecd0 0x7f2fd813c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.925+0000 7f2fd5e00640 1 -- 172.21.15.146:0/3011691501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd81f8760 con 0x7f2fbc004d40 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fd5400640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 0x7f2fd813c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fd5e00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8010860 tx=0x7f2fc8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800f040 con 0x7f2fbc004d40 2024-04-24T23:09:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc800eae0 con 0x7f2fbc004d40 2024-04-24T23:09:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc801c400 con 0x7f2fbc004d40 2024-04-24T23:09:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd815dd30 con 0x7f2fbc004d40 2024-04-24T23:09:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.926+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd815e2f0 con 0x7f2fbc004d40 2024-04-24T23:09:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.927+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd8068190 con 0x7f2fbc004d40 2024-04-24T23:09:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.928+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fc801c5a0 con 0x7f2fbc004d40 2024-04-24T23:09:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.929+0000 7f2fce000640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 0x7f2fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.929+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f2fc808b620 con 0x7f2fbc004d40 2024-04-24T23:09:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.930+0000 7f2fd5400640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 0x7f2fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.931+0000 7f2fd5400640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 0x7f2fb806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40017e0 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:28.933+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2fd81f8760 con 0x7f2fbc004d40 2024-04-24T23:09:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.131+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fd80b3e10 con 0x7f2fbc004d40 2024-04-24T23:09:29.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.134+0000 7f2fce000640 1 -- 172.21.15.146:0/3011691501 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16909 (secure 0 0 0) 0x7f2fc8018030 con 0x7f2fbc004d40 2024-04-24T23:09:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:29.136 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":84,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:26.215171+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 msgr2=0x7f2fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 0x7f2fb806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40017e0 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 msgr2=0x7f2fd81f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8010860 tx=0x7f2fc8010d20 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 shutdown_connections 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fd813ecd0 0x7f2fd813c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2fb806be30 0x7f2fb806e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fd813e850 0x7f2fd813c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 --2- 172.21.15.146:0/3011691501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc004d40 0x7f2fd81f8220 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 >> 172.21.15.146:0/3011691501 conn(0x7f2fd806b320 msgr2=0x7f2fd80ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 shutdown_connections 2024-04-24T23:09:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.136+0000 7f2fdcc00640 1 -- 172.21.15.146:0/3011691501 wait complete. 2024-04-24T23:09:29.157 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:09:29.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:09:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.356+0000 7f1352c00640 1 Processor -- start 2024-04-24T23:09:29.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.356+0000 7f1352c00640 1 -- start start 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1352c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f134c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1352c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f134c0728c0 0x7f134c0d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1352c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134c1449c0 con 0x7f134c070c10 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1352c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f134c072430 con 0x7f134c0728c0 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1352c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f134c0b2d70 con 0x7f134c1445e0 2024-04-24T23:09:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1350c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f134c070c10 0x7f134c15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42968/0 (socket says 172.21.15.146:42968) 2024-04-24T23:09:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1350c00640 1 -- 172.21.15.146:0/3425627658 learned_addr learned my addr 172.21.15.146:0/3425627658 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.358+0000 7f1343400640 1 --2- 172.21.15.146:0/3425627658 >> v2:172.21.15.203:3300/0 conn(0x7f134c0728c0 0x7f134c0d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134be00640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f134c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693671161 0 0) 0x7f134c1449c0 con 0x7f134c070c10 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1330003520 con 0x7f134c070c10 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2175694746 0 0) 0x7f1330003520 con 0x7f134c070c10 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 msgr2=0x7f134c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f134c0cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 >> v2:172.21.15.203:3300/0 conn(0x7f134c0728c0 msgr2=0x7f134c0d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 --2- 172.21.15.146:0/3425627658 >> v2:172.21.15.203:3300/0 conn(0x7f134c0728c0 0x7f134c0d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c071820 con 0x7f134c070c10 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f13440019f0 con 0x7f134c070c10 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 >> v1:172.21.15.146:6789/0 conn(0x7f134c070c10 legacy=0x7f134c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f13300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f1330004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f134c072430 con 0x7f1330003f30 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0b2d70 con 0x7f1330004d40 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f133000ba10 con 0x7f134c1445e0 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.359+0000 7f1343400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f1330004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f134be00640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f13300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1350c00640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1343400640 1 -- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 msgr2=0x7f13300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1343400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c1445e0 0x7f13300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1343400640 1 -- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1330004d40 msgr2=0x7f13300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1343400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1343400640 1 -- 172.21.15.146:0/3425627658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1330003520 con 0x7f1330003f30 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.360+0000 7f1350c00640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1330004d40 0x7f13300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.361+0000 7f1343400640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f1330004800 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1334009650 tx=0x7f1330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addda8d02f77fba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.361+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334038070 con 0x7f1330003f30 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.361+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1334033400 con 0x7f1330003f30 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.361+0000 7f134b400640 1 -- 172.21.15.146:0/3425627658 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334009690 con 0x7f1330003f30 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 -- 172.21.15.146:0/3425627658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 msgr2=0x7f1330004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 --2- 172.21.15.146:0/3425627658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f1330004800 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1334009650 tx=0x7f1330005830 comp rx=0 tx=0).stop 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1350c00640 1 -- 172.21.15.146:0/3425627658 reap_dead start 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 -- 172.21.15.146:0/3425627658 shutdown_connections 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 -- 172.21.15.146:0/3425627658 >> 172.21.15.146:0/3425627658 conn(0x7f134c06b320 msgr2=0x7f134c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 -- 172.21.15.146:0/3425627658 shutdown_connections 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.362+0000 7f1352c00640 1 -- 172.21.15.146:0/3425627658 wait complete. 2024-04-24T23:09:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.364+0000 7f1352c00640 1 Processor -- start 2024-04-24T23:09:29.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.364+0000 7f1352c00640 1 -- start start 2024-04-24T23:09:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f134c0cf2d0 0x7f134c13fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c140290 0x7f134c138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0720c0 con 0x7f1330003f30 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f134c071de0 con 0x7f134c0cf2d0 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1352c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f134c0cfc90 con 0x7f134c140290 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40536/0 (socket says 172.21.15.146:40536) 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 -- 172.21.15.146:0/426199308 learned_addr learned my addr 172.21.15.146:0/426199308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f1343400640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f134c0cf2d0 0x7f134c13fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 -- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c140290 msgr2=0x7f134c138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c140290 0x7f134c138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 -- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f134c0cf2d0 msgr2=0x7f134c13fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f134c0cf2d0 0x7f134c13fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.365+0000 7f134be00640 1 -- 172.21.15.146:0/426199308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c0cd7e0 con 0x7f1330003f30 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f134be00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f133c00f580 tx=0x7f133c00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c019020 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c014870 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c014c60 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c0cdac0 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.366+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c0ce080 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.367+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134c1406b0 con 0x7f1330003f30 2024-04-24T23:09:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.368+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f133c01c020 con 0x7f1330003f30 2024-04-24T23:09:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.370+0000 7f1348c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 0x7f132806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.370+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f133c08b840 con 0x7f1330003f30 2024-04-24T23:09:29.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.370+0000 7f1343400640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 0x7f132806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.372+0000 7f1343400640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 0x7f132806e320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1334035000 tx=0x7f1334008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.374+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f133c023020 con 0x7f1330003f30 2024-04-24T23:09:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.570+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f134c068190 con 0x7f132806be60 2024-04-24T23:09:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.590+0000 7f1348c00640 1 -- 172.21.15.146:0/426199308 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252098 (secure 0 0 0) 0x7f134c068190 con 0x7f132806be60 2024-04-24T23:09:29.596 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:29.598 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 msgr2=0x7f132806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 0x7f132806e320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1334035000 tx=0x7f1334008030 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 msgr2=0x7f134c13e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f133c00f580 tx=0x7f133c00fa40 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 shutdown_connections 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f132806be60 0x7f132806e320 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f134c140290 0x7f134c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f134c0cf2d0 0x7f134c13fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 --2- 172.21.15.146:0/426199308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330003f30 0x7f134c13e060 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 >> 172.21.15.146:0/426199308 conn(0x7f134c06b320 msgr2=0x7f134c0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 shutdown_connections 2024-04-24T23:09:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.596+0000 7f1352c00640 1 -- 172.21.15.146:0/426199308 wait complete. 2024-04-24T23:09:29.617 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-04-24T23:09:27.804593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258664,"kb_used_data":9180,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716056,"statfs":{"total":773094113280,"available":772829241344,"internally_reserved":0,"allocated":9400320,"data_stored":4935288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.627115"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231670+0000","last_change":"2024-04-24T23:09:25.223296+0000","last_active":"2024-04-24T23:09:26.231670+0000","last_peered":"2024-04-24T23:09:26.231670+0000","last_clean":"2024-04-24T23:09:26.231670+0000","last_became_active":"2024-04-24T23:09:25.222993+0000","last_became_peered":"2024-04-24T23:09:25.222993+0000","last_unstale":"2024-04-24T23:09:26.231670+0000","last_undegraded":"2024-04-24T23:09:26.231670+0000","last_fullsized":"2024-04-24T23:09:26.231670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:52.382958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248360+0000","last_change":"2024-04-24T23:09:25.236829+0000","last_active":"2024-04-24T23:09:26.248360+0000","last_peered":"2024-04-24T23:09:26.248360+0000","last_clean":"2024-04-24T23:09:26.248360+0000","last_became_active":"2024-04-24T23:09:25.236528+0000","last_became_peered":"2024-04-24T23:09:25.236528+0000","last_unstale":"2024-04-24T23:09:26.248360+0000","last_undegraded":"2024-04-24T23:09:26.248360+0000","last_fullsized":"2024-04-24T23:09:26.248360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248481+0000","last_change":"2024-04-24T23:09:25.248655+0000","last_active":"2024-04-24T23:09:26.248481+0000","last_peered":"2024-04-24T23:09:26.248481+0000","last_clean":"2024-04-24T23:09:26.248481+0000","last_became_active":"2024-04-24T23:09:25.245702+0000","last_became_peered":"2024-04-24T23:09:25.245702+0000","last_unstale":"2024-04-24T23:09:26.248481+0000","last_undegraded":"2024-04-24T23:09:26.248481+0000","last_fullsized":"2024-04-24T23:09:26.248481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:59.534431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757575+0000","last_change":"2024-04-24T23:09:25.218749+0000","last_active":"2024-04-24T23:09:26.757575+0000","last_peered":"2024-04-24T23:09:26.757575+0000","last_clean":"2024-04-24T23:09:26.757575+0000","last_became_active":"2024-04-24T23:09:25.218446+0000","last_became_peered":"2024-04-24T23:09:25.218446+0000","last_unstale":"2024-04-24T23:09:26.757575+0000","last_undegraded":"2024-04-24T23:09:26.757575+0000","last_fullsized":"2024-04-24T23:09:26.757575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:15.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236831+0000","last_change":"2024-04-24T23:09:25.236340+0000","last_active":"2024-04-24T23:09:26.236831+0000","last_peered":"2024-04-24T23:09:26.236831+0000","last_clean":"2024-04-24T23:09:26.236831+0000","last_became_active":"2024-04-24T23:09:25.233245+0000","last_became_peered":"2024-04-24T23:09:25.233245+0000","last_unstale":"2024-04-24T23:09:26.236831+0000","last_undegraded":"2024-04-24T23:09:26.236831+0000","last_fullsized":"2024-04-24T23:09:26.236831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.613073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395371+0000","last_change":"2024-04-24T23:09:25.249206+0000","last_active":"2024-04-24T23:09:26.395371+0000","last_peered":"2024-04-24T23:09:26.395371+0000","last_clean":"2024-04-24T23:09:26.395371+0000","last_became_active":"2024-04-24T23:09:25.248628+0000","last_became_peered":"2024-04-24T23:09:25.248628+0000","last_unstale":"2024-04-24T23:09:26.395371+0000","last_undegraded":"2024-04-24T23:09:26.395371+0000","last_fullsized":"2024-04-24T23:09:26.395371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:46.046071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760556+0000","last_change":"2024-04-24T23:09:25.232429+0000","last_active":"2024-04-24T23:09:26.760556+0000","last_peered":"2024-04-24T23:09:26.760556+0000","last_clean":"2024-04-24T23:09:26.760556+0000","last_became_active":"2024-04-24T23:09:25.232159+0000","last_became_peered":"2024-04-24T23:09:25.232159+0000","last_unstale":"2024-04-24T23:09:26.760556+0000","last_undegraded":"2024-04-24T23:09:26.760556+0000","last_fullsized":"2024-04-24T23:09:26.760556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235680+0000","last_change":"2024-04-24T23:09:25.235938+0000","last_active":"2024-04-24T23:09:26.235680+0000","last_peered":"2024-04-24T23:09:26.235680+0000","last_clean":"2024-04-24T23:09:26.235680+0000","last_became_active":"2024-04-24T23:09:25.235665+0000","last_became_peered":"2024-04-24T23:09:25.235665+0000","last_unstale":"2024-04-24T23:09:26.235680+0000","last_undegraded":"2024-04-24T23:09:26.235680+0000","last_fullsized":"2024-04-24T23:09:26.235680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.322132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758496+0000","last_change":"2024-04-24T23:09:25.231288+0000","last_active":"2024-04-24T23:09:26.758496+0000","last_peered":"2024-04-24T23:09:26.758496+0000","last_clean":"2024-04-24T23:09:26.758496+0000","last_became_active":"2024-04-24T23:09:25.230864+0000","last_became_peered":"2024-04-24T23:09:25.230864+0000","last_unstale":"2024-04-24T23:09:26.758496+0000","last_undegraded":"2024-04-24T23:09:26.758496+0000","last_fullsized":"2024-04-24T23:09:26.758496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:53.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231084+0000","last_change":"2024-04-24T23:09:25.215705+0000","last_active":"2024-04-24T23:09:26.231084+0000","last_peered":"2024-04-24T23:09:26.231084+0000","last_clean":"2024-04-24T23:09:26.231084+0000","last_became_active":"2024-04-24T23:09:25.215327+0000","last_became_peered":"2024-04-24T23:09:25.215327+0000","last_unstale":"2024-04-24T23:09:26.231084+0000","last_undegraded":"2024-04-24T23:09:26.231084+0000","last_fullsized":"2024-04-24T23:09:26.231084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:42:44.498611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.249084+0000","last_change":"2024-04-24T23:09:25.252869+0000","last_active":"2024-04-24T23:09:26.249084+0000","last_peered":"2024-04-24T23:09:26.249084+0000","last_clean":"2024-04-24T23:09:26.249084+0000","last_became_active":"2024-04-24T23:09:25.251623+0000","last_became_peered":"2024-04-24T23:09:25.251623+0000","last_unstale":"2024-04-24T23:09:26.249084+0000","last_undegraded":"2024-04-24T23:09:26.249084+0000","last_fullsized":"2024-04-24T23:09:26.249084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:52.840852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761004+0000","last_change":"2024-04-24T23:09:25.229953+0000","last_active":"2024-04-24T23:09:26.761004+0000","last_peered":"2024-04-24T23:09:26.761004+0000","last_clean":"2024-04-24T23:09:26.761004+0000","last_became_active":"2024-04-24T23:09:25.228118+0000","last_became_peered":"2024-04-24T23:09:25.228118+0000","last_unstale":"2024-04-24T23:09:26.761004+0000","last_undegraded":"2024-04-24T23:09:26.761004+0000","last_fullsized":"2024-04-24T23:09:26.761004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:24.237057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248273+0000","last_change":"2024-04-24T23:09:25.250019+0000","last_active":"2024-04-24T23:09:26.248273+0000","last_peered":"2024-04-24T23:09:26.248273+0000","last_clean":"2024-04-24T23:09:26.248273+0000","last_became_active":"2024-04-24T23:09:25.249057+0000","last_became_peered":"2024-04-24T23:09:25.249057+0000","last_unstale":"2024-04-24T23:09:26.248273+0000","last_undegraded":"2024-04-24T23:09:26.248273+0000","last_fullsized":"2024-04-24T23:09:26.248273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237975+0000","last_change":"2024-04-24T23:09:25.246055+0000","last_active":"2024-04-24T23:09:26.237975+0000","last_peered":"2024-04-24T23:09:26.237975+0000","last_clean":"2024-04-24T23:09:26.237975+0000","last_became_active":"2024-04-24T23:09:25.245740+0000","last_became_peered":"2024-04-24T23:09:25.245740+0000","last_unstale":"2024-04-24T23:09:26.237975+0000","last_undegraded":"2024-04-24T23:09:26.237975+0000","last_fullsized":"2024-04-24T23:09:26.237975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:58.372442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235702+0000","last_change":"2024-04-24T23:09:25.242722+0000","last_active":"2024-04-24T23:09:26.235702+0000","last_peered":"2024-04-24T23:09:26.235702+0000","last_clean":"2024-04-24T23:09:26.235702+0000","last_became_active":"2024-04-24T23:09:25.242443+0000","last_became_peered":"2024-04-24T23:09:25.242443+0000","last_unstale":"2024-04-24T23:09:26.235702+0000","last_undegraded":"2024-04-24T23:09:26.235702+0000","last_fullsized":"2024-04-24T23:09:26.235702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:58.903489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757599+0000","last_change":"2024-04-24T23:09:25.228520+0000","last_active":"2024-04-24T23:09:26.757599+0000","last_peered":"2024-04-24T23:09:26.757599+0000","last_clean":"2024-04-24T23:09:26.757599+0000","last_became_active":"2024-04-24T23:09:25.228245+0000","last_became_peered":"2024-04-24T23:09:25.228245+0000","last_unstale":"2024-04-24T23:09:26.757599+0000","last_undegraded":"2024-04-24T23:09:26.757599+0000","last_fullsized":"2024-04-24T23:09:26.757599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:21.670603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.238939+0000","last_change":"2024-04-24T23:09:25.247763+0000","last_active":"2024-04-24T23:09:26.238939+0000","last_peered":"2024-04-24T23:09:26.238939+0000","last_clean":"2024-04-24T23:09:26.238939+0000","last_became_active":"2024-04-24T23:09:25.235969+0000","last_became_peered":"2024-04-24T23:09:25.235969+0000","last_unstale":"2024-04-24T23:09:26.238939+0000","last_undegraded":"2024-04-24T23:09:26.238939+0000","last_fullsized":"2024-04-24T23:09:26.238939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:48.153602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248756+0000","last_change":"2024-04-24T23:09:25.250706+0000","last_active":"2024-04-24T23:09:26.248756+0000","last_peered":"2024-04-24T23:09:26.248756+0000","last_clean":"2024-04-24T23:09:26.248756+0000","last_became_active":"2024-04-24T23:09:25.250373+0000","last_became_peered":"2024-04-24T23:09:25.250373+0000","last_unstale":"2024-04-24T23:09:26.248756+0000","last_undegraded":"2024-04-24T23:09:26.248756+0000","last_fullsized":"2024-04-24T23:09:26.248756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:10.954962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239177+0000","last_change":"2024-04-24T23:09:25.247375+0000","last_active":"2024-04-24T23:09:26.239177+0000","last_peered":"2024-04-24T23:09:26.239177+0000","last_clean":"2024-04-24T23:09:26.239177+0000","last_became_active":"2024-04-24T23:09:25.244481+0000","last_became_peered":"2024-04-24T23:09:25.244481+0000","last_unstale":"2024-04-24T23:09:26.239177+0000","last_undegraded":"2024-04-24T23:09:26.239177+0000","last_fullsized":"2024-04-24T23:09:26.239177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:01.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395649+0000","last_change":"2024-04-24T23:09:25.229947+0000","last_active":"2024-04-24T23:09:26.395649+0000","last_peered":"2024-04-24T23:09:26.395649+0000","last_clean":"2024-04-24T23:09:26.395649+0000","last_became_active":"2024-04-24T23:09:25.229625+0000","last_became_peered":"2024-04-24T23:09:25.229625+0000","last_unstale":"2024-04-24T23:09:26.395649+0000","last_undegraded":"2024-04-24T23:09:26.395649+0000","last_fullsized":"2024-04-24T23:09:26.395649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:13.591194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758210+0000","last_change":"2024-04-24T23:09:25.232821+0000","last_active":"2024-04-24T23:09:26.758210+0000","last_peered":"2024-04-24T23:09:26.758210+0000","last_clean":"2024-04-24T23:09:26.758210+0000","last_became_active":"2024-04-24T23:09:25.232122+0000","last_became_peered":"2024-04-24T23:09:25.232122+0000","last_unstale":"2024-04-24T23:09:26.758210+0000","last_undegraded":"2024-04-24T23:09:26.758210+0000","last_fullsized":"2024-04-24T23:09:26.758210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248075+0000","last_change":"2024-04-24T23:09:25.250173+0000","last_active":"2024-04-24T23:09:26.248075+0000","last_peered":"2024-04-24T23:09:26.248075+0000","last_clean":"2024-04-24T23:09:26.248075+0000","last_became_active":"2024-04-24T23:09:25.249794+0000","last_became_peered":"2024-04-24T23:09:25.249794+0000","last_unstale":"2024-04-24T23:09:26.248075+0000","last_undegraded":"2024-04-24T23:09:26.248075+0000","last_fullsized":"2024-04-24T23:09:26.248075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:53.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230843+0000","last_change":"2024-04-24T23:09:25.213905+0000","last_active":"2024-04-24T23:09:26.230843+0000","last_peered":"2024-04-24T23:09:26.230843+0000","last_clean":"2024-04-24T23:09:26.230843+0000","last_became_active":"2024-04-24T23:09:25.213701+0000","last_became_peered":"2024-04-24T23:09:25.213701+0000","last_unstale":"2024-04-24T23:09:26.230843+0000","last_undegraded":"2024-04-24T23:09:26.230843+0000","last_fullsized":"2024-04-24T23:09:26.230843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:55.203361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247492+0000","last_change":"2024-04-24T23:09:25.239512+0000","last_active":"2024-04-24T23:09:26.247492+0000","last_peered":"2024-04-24T23:09:26.247492+0000","last_clean":"2024-04-24T23:09:26.247492+0000","last_became_active":"2024-04-24T23:09:25.239168+0000","last_became_peered":"2024-04-24T23:09:25.239168+0000","last_unstale":"2024-04-24T23:09:26.247492+0000","last_undegraded":"2024-04-24T23:09:26.247492+0000","last_fullsized":"2024-04-24T23:09:26.247492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.496485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.396108+0000","last_change":"2024-04-24T23:09:25.244305+0000","last_active":"2024-04-24T23:09:26.396108+0000","last_peered":"2024-04-24T23:09:26.396108+0000","last_clean":"2024-04-24T23:09:26.396108+0000","last_became_active":"2024-04-24T23:09:25.242339+0000","last_became_peered":"2024-04-24T23:09:25.242339+0000","last_unstale":"2024-04-24T23:09:26.396108+0000","last_undegraded":"2024-04-24T23:09:26.396108+0000","last_fullsized":"2024-04-24T23:09:26.396108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:40:03.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759742+0000","last_change":"2024-04-24T23:09:25.233359+0000","last_active":"2024-04-24T23:09:26.759742+0000","last_peered":"2024-04-24T23:09:26.759742+0000","last_clean":"2024-04-24T23:09:26.759742+0000","last_became_active":"2024-04-24T23:09:25.233025+0000","last_became_peered":"2024-04-24T23:09:25.233025+0000","last_unstale":"2024-04-24T23:09:26.759742+0000","last_undegraded":"2024-04-24T23:09:26.759742+0000","last_fullsized":"2024-04-24T23:09:26.759742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757796+0000","last_change":"2024-04-24T23:09:25.231047+0000","last_active":"2024-04-24T23:09:26.757796+0000","last_peered":"2024-04-24T23:09:26.757796+0000","last_clean":"2024-04-24T23:09:26.757796+0000","last_became_active":"2024-04-24T23:09:25.229072+0000","last_became_peered":"2024-04-24T23:09:25.229072+0000","last_unstale":"2024-04-24T23:09:26.757796+0000","last_undegraded":"2024-04-24T23:09:26.757796+0000","last_fullsized":"2024-04-24T23:09:26.757796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.496485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236886+0000","last_change":"2024-04-24T23:09:25.236250+0000","last_active":"2024-04-24T23:09:26.236886+0000","last_peered":"2024-04-24T23:09:26.236886+0000","last_clean":"2024-04-24T23:09:26.236886+0000","last_became_active":"2024-04-24T23:09:25.235571+0000","last_became_peered":"2024-04-24T23:09:25.235571+0000","last_unstale":"2024-04-24T23:09:26.236886+0000","last_undegraded":"2024-04-24T23:09:26.236886+0000","last_fullsized":"2024-04-24T23:09:26.236886+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:33.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395288+0000","last_change":"2024-04-24T23:09:25.234167+0000","last_active":"2024-04-24T23:09:26.395288+0000","last_peered":"2024-04-24T23:09:26.395288+0000","last_clean":"2024-04-24T23:09:26.395288+0000","last_became_active":"2024-04-24T23:09:25.229906+0000","last_became_peered":"2024-04-24T23:09:25.229906+0000","last_unstale":"2024-04-24T23:09:26.395288+0000","last_undegraded":"2024-04-24T23:09:26.395288+0000","last_fullsized":"2024-04-24T23:09:26.395288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:28.847769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230772+0000","last_change":"2024-04-24T23:09:25.241402+0000","last_active":"2024-04-24T23:09:26.230772+0000","last_peered":"2024-04-24T23:09:26.230772+0000","last_clean":"2024-04-24T23:09:26.230772+0000","last_became_active":"2024-04-24T23:09:25.241081+0000","last_became_peered":"2024-04-24T23:09:25.241081+0000","last_unstale":"2024-04-24T23:09:26.230772+0000","last_undegraded":"2024-04-24T23:09:26.230772+0000","last_fullsized":"2024-04-24T23:09:26.230772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:29.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248052+0000","last_change":"2024-04-24T23:09:25.238308+0000","last_active":"2024-04-24T23:09:26.248052+0000","last_peered":"2024-04-24T23:09:26.248052+0000","last_clean":"2024-04-24T23:09:26.248052+0000","last_became_active":"2024-04-24T23:09:25.237949+0000","last_became_peered":"2024-04-24T23:09:25.237949+0000","last_unstale":"2024-04-24T23:09:26.248052+0000","last_undegraded":"2024-04-24T23:09:26.248052+0000","last_fullsized":"2024-04-24T23:09:26.248052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:34.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758072+0000","last_change":"2024-04-24T23:09:25.233652+0000","last_active":"2024-04-24T23:09:26.758072+0000","last_peered":"2024-04-24T23:09:26.758072+0000","last_clean":"2024-04-24T23:09:26.758072+0000","last_became_active":"2024-04-24T23:09:25.232978+0000","last_became_peered":"2024-04-24T23:09:25.232978+0000","last_unstale":"2024-04-24T23:09:26.758072+0000","last_undegraded":"2024-04-24T23:09:26.758072+0000","last_fullsized":"2024-04-24T23:09:26.758072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:34.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235326+0000","last_change":"2024-04-24T23:09:25.234162+0000","last_active":"2024-04-24T23:09:26.235326+0000","last_peered":"2024-04-24T23:09:26.235326+0000","last_clean":"2024-04-24T23:09:26.235326+0000","last_became_active":"2024-04-24T23:09:25.233803+0000","last_became_peered":"2024-04-24T23:09:25.233803+0000","last_unstale":"2024-04-24T23:09:26.235326+0000","last_undegraded":"2024-04-24T23:09:26.235326+0000","last_fullsized":"2024-04-24T23:09:26.235326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:37:30.159467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237835+0000","last_change":"2024-04-24T23:09:24.229720+0000","last_active":"2024-04-24T23:09:26.237835+0000","last_peered":"2024-04-24T23:09:26.237835+0000","last_clean":"2024-04-24T23:09:26.237835+0000","last_became_active":"2024-04-24T23:09:24.229380+0000","last_became_peered":"2024-04-24T23:09:24.229380+0000","last_unstale":"2024-04-24T23:09:26.237835+0000","last_undegraded":"2024-04-24T23:09:26.237835+0000","last_fullsized":"2024-04-24T23:09:26.237835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:02.991973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235948+0000","last_change":"2024-04-24T23:09:25.225513+0000","last_active":"2024-04-24T23:09:26.235948+0000","last_peered":"2024-04-24T23:09:26.235948+0000","last_clean":"2024-04-24T23:09:26.235948+0000","last_became_active":"2024-04-24T23:09:25.224623+0000","last_became_peered":"2024-04-24T23:09:25.224623+0000","last_unstale":"2024-04-24T23:09:26.235948+0000","last_undegraded":"2024-04-24T23:09:26.235948+0000","last_fullsized":"2024-04-24T23:09:26.235948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:02.576367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761179+0000","last_change":"2024-04-24T23:09:24.226138+0000","last_active":"2024-04-24T23:09:26.761179+0000","last_peered":"2024-04-24T23:09:26.761179+0000","last_clean":"2024-04-24T23:09:26.761179+0000","last_became_active":"2024-04-24T23:09:24.225798+0000","last_became_peered":"2024-04-24T23:09:24.225798+0000","last_unstale":"2024-04-24T23:09:26.761179+0000","last_undegraded":"2024-04-24T23:09:26.761179+0000","last_fullsized":"2024-04-24T23:09:26.761179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:36.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759931+0000","last_change":"2024-04-24T23:09:25.229328+0000","last_active":"2024-04-24T23:09:26.759931+0000","last_peered":"2024-04-24T23:09:26.759931+0000","last_clean":"2024-04-24T23:09:26.759931+0000","last_became_active":"2024-04-24T23:09:25.229009+0000","last_became_peered":"2024-04-24T23:09:25.229009+0000","last_unstale":"2024-04-24T23:09:26.759931+0000","last_undegraded":"2024-04-24T23:09:26.759931+0000","last_fullsized":"2024-04-24T23:09:26.759931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:10.954962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231822+0000","last_change":"2024-04-24T23:09:24.227335+0000","last_active":"2024-04-24T23:09:26.231822+0000","last_peered":"2024-04-24T23:09:26.231822+0000","last_clean":"2024-04-24T23:09:26.231822+0000","last_became_active":"2024-04-24T23:09:24.227045+0000","last_became_peered":"2024-04-24T23:09:24.227045+0000","last_unstale":"2024-04-24T23:09:26.231822+0000","last_undegraded":"2024-04-24T23:09:26.231822+0000","last_fullsized":"2024-04-24T23:09:26.231822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:37.525440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757677+0000","last_change":"2024-04-24T23:09:25.219436+0000","last_active":"2024-04-24T23:09:26.757677+0000","last_peered":"2024-04-24T23:09:26.757677+0000","last_clean":"2024-04-24T23:09:26.757677+0000","last_became_active":"2024-04-24T23:09:25.219174+0000","last_became_peered":"2024-04-24T23:09:25.219174+0000","last_unstale":"2024-04-24T23:09:26.757677+0000","last_undegraded":"2024-04-24T23:09:26.757677+0000","last_fullsized":"2024-04-24T23:09:26.757677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:56.223927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761576+0000","last_change":"2024-04-24T23:09:24.220851+0000","last_active":"2024-04-24T23:09:26.761576+0000","last_peered":"2024-04-24T23:09:26.761576+0000","last_clean":"2024-04-24T23:09:26.761576+0000","last_became_active":"2024-04-24T23:09:24.220586+0000","last_became_peered":"2024-04-24T23:09:24.220586+0000","last_unstale":"2024-04-24T23:09:26.761576+0000","last_undegraded":"2024-04-24T23:09:26.761576+0000","last_fullsized":"2024-04-24T23:09:26.761576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:51.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395943+0000","last_change":"2024-04-24T23:09:25.231778+0000","last_active":"2024-04-24T23:09:26.395943+0000","last_peered":"2024-04-24T23:09:26.395943+0000","last_clean":"2024-04-24T23:09:26.395943+0000","last_became_active":"2024-04-24T23:09:25.231449+0000","last_became_peered":"2024-04-24T23:09:25.231449+0000","last_unstale":"2024-04-24T23:09:26.395943+0000","last_undegraded":"2024-04-24T23:09:26.395943+0000","last_fullsized":"2024-04-24T23:09:26.395943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:33.466853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758746+0000","last_change":"2024-04-24T23:09:24.218033+0000","last_active":"2024-04-24T23:09:26.758746+0000","last_peered":"2024-04-24T23:09:26.758746+0000","last_clean":"2024-04-24T23:09:26.758746+0000","last_became_active":"2024-04-24T23:09:24.217759+0000","last_became_peered":"2024-04-24T23:09:24.217759+0000","last_unstale":"2024-04-24T23:09:26.758746+0000","last_undegraded":"2024-04-24T23:09:26.758746+0000","last_fullsized":"2024-04-24T23:09:26.758746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:47.991580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248938+0000","last_change":"2024-04-24T23:09:25.252549+0000","last_active":"2024-04-24T23:09:26.248938+0000","last_peered":"2024-04-24T23:09:26.248938+0000","last_clean":"2024-04-24T23:09:26.248938+0000","last_became_active":"2024-04-24T23:09:25.250785+0000","last_became_peered":"2024-04-24T23:09:25.250785+0000","last_unstale":"2024-04-24T23:09:26.248938+0000","last_undegraded":"2024-04-24T23:09:26.248938+0000","last_fullsized":"2024-04-24T23:09:26.248938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:28.584484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759505+0000","last_change":"2024-04-24T23:09:24.228965+0000","last_active":"2024-04-24T23:09:26.759505+0000","last_peered":"2024-04-24T23:09:26.759505+0000","last_clean":"2024-04-24T23:09:26.759505+0000","last_became_active":"2024-04-24T23:09:24.228686+0000","last_became_peered":"2024-04-24T23:09:24.228686+0000","last_unstale":"2024-04-24T23:09:26.759505+0000","last_undegraded":"2024-04-24T23:09:26.759505+0000","last_fullsized":"2024-04-24T23:09:26.759505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:00.609301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761682+0000","last_change":"2024-04-24T23:09:25.236323+0000","last_active":"2024-04-24T23:09:26.761682+0000","last_peered":"2024-04-24T23:09:26.761682+0000","last_clean":"2024-04-24T23:09:26.761682+0000","last_became_active":"2024-04-24T23:09:25.236042+0000","last_became_peered":"2024-04-24T23:09:25.236042+0000","last_unstale":"2024-04-24T23:09:26.761682+0000","last_undegraded":"2024-04-24T23:09:26.761682+0000","last_fullsized":"2024-04-24T23:09:26.761682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:52.840852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236795+0000","last_change":"2024-04-24T23:09:24.228705+0000","last_active":"2024-04-24T23:09:26.236795+0000","last_peered":"2024-04-24T23:09:26.236795+0000","last_clean":"2024-04-24T23:09:26.236795+0000","last_became_active":"2024-04-24T23:09:24.227729+0000","last_became_peered":"2024-04-24T23:09:24.227729+0000","last_unstale":"2024-04-24T23:09:26.236795+0000","last_undegraded":"2024-04-24T23:09:26.236795+0000","last_fullsized":"2024-04-24T23:09:26.236795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:48:57.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760486+0000","last_change":"2024-04-24T23:09:25.242972+0000","last_active":"2024-04-24T23:09:26.760486+0000","last_peered":"2024-04-24T23:09:26.760486+0000","last_clean":"2024-04-24T23:09:26.760486+0000","last_became_active":"2024-04-24T23:09:25.242569+0000","last_became_peered":"2024-04-24T23:09:25.242569+0000","last_unstale":"2024-04-24T23:09:26.760486+0000","last_undegraded":"2024-04-24T23:09:26.760486+0000","last_fullsized":"2024-04-24T23:09:26.760486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:55.925038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247788+0000","last_change":"2024-04-24T23:09:24.223223+0000","last_active":"2024-04-24T23:09:26.247788+0000","last_peered":"2024-04-24T23:09:26.247788+0000","last_clean":"2024-04-24T23:09:26.247788+0000","last_became_active":"2024-04-24T23:09:24.222957+0000","last_became_peered":"2024-04-24T23:09:24.222957+0000","last_unstale":"2024-04-24T23:09:26.247788+0000","last_undegraded":"2024-04-24T23:09:26.247788+0000","last_fullsized":"2024-04-24T23:09:26.247788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:01.560471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247804+0000","last_change":"2024-04-24T23:09:25.242147+0000","last_active":"2024-04-24T23:09:26.247804+0000","last_peered":"2024-04-24T23:09:26.247804+0000","last_clean":"2024-04-24T23:09:26.247804+0000","last_became_active":"2024-04-24T23:09:25.241858+0000","last_became_peered":"2024-04-24T23:09:25.241858+0000","last_unstale":"2024-04-24T23:09:26.247804+0000","last_undegraded":"2024-04-24T23:09:26.247804+0000","last_fullsized":"2024-04-24T23:09:26.247804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:15.157553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758757+0000","last_change":"2024-04-24T23:09:24.223854+0000","last_active":"2024-04-24T23:09:26.758757+0000","last_peered":"2024-04-24T23:09:26.758757+0000","last_clean":"2024-04-24T23:09:26.758757+0000","last_became_active":"2024-04-24T23:09:24.223537+0000","last_became_peered":"2024-04-24T23:09:24.223537+0000","last_unstale":"2024-04-24T23:09:26.758757+0000","last_undegraded":"2024-04-24T23:09:26.758757+0000","last_fullsized":"2024-04-24T23:09:26.758757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:29.031769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757077+0000","last_change":"2024-04-24T23:09:25.231907+0000","last_active":"2024-04-24T23:09:26.757077+0000","last_peered":"2024-04-24T23:09:26.757077+0000","last_clean":"2024-04-24T23:09:26.757077+0000","last_became_active":"2024-04-24T23:09:25.227045+0000","last_became_peered":"2024-04-24T23:09:25.227045+0000","last_unstale":"2024-04-24T23:09:26.757077+0000","last_undegraded":"2024-04-24T23:09:26.757077+0000","last_fullsized":"2024-04-24T23:09:26.757077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231031+0000","last_change":"2024-04-24T23:09:24.221737+0000","last_active":"2024-04-24T23:09:26.231031+0000","last_peered":"2024-04-24T23:09:26.231031+0000","last_clean":"2024-04-24T23:09:26.231031+0000","last_became_active":"2024-04-24T23:09:24.221467+0000","last_became_peered":"2024-04-24T23:09:24.221467+0000","last_unstale":"2024-04-24T23:09:26.231031+0000","last_undegraded":"2024-04-24T23:09:26.231031+0000","last_fullsized":"2024-04-24T23:09:26.231031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:13.776588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239143+0000","last_change":"2024-04-24T23:09:25.232538+0000","last_active":"2024-04-24T23:09:26.239143+0000","last_peered":"2024-04-24T23:09:26.239143+0000","last_clean":"2024-04-24T23:09:26.239143+0000","last_became_active":"2024-04-24T23:09:25.231629+0000","last_became_peered":"2024-04-24T23:09:25.231629+0000","last_unstale":"2024-04-24T23:09:26.239143+0000","last_undegraded":"2024-04-24T23:09:26.239143+0000","last_fullsized":"2024-04-24T23:09:26.239143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:33:49.737399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395963+0000","last_change":"2024-04-24T23:09:24.225726+0000","last_active":"2024-04-24T23:09:26.395963+0000","last_peered":"2024-04-24T23:09:26.395963+0000","last_clean":"2024-04-24T23:09:26.395963+0000","last_became_active":"2024-04-24T23:09:24.225396+0000","last_became_peered":"2024-04-24T23:09:24.225396+0000","last_unstale":"2024-04-24T23:09:26.395963+0000","last_undegraded":"2024-04-24T23:09:26.395963+0000","last_fullsized":"2024-04-24T23:09:26.395963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:02.640509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395412+0000","last_change":"2024-04-24T23:09:25.238544+0000","last_active":"2024-04-24T23:09:26.395412+0000","last_peered":"2024-04-24T23:09:26.395412+0000","last_clean":"2024-04-24T23:09:26.395412+0000","last_became_active":"2024-04-24T23:09:25.238239+0000","last_became_peered":"2024-04-24T23:09:25.238239+0000","last_unstale":"2024-04-24T23:09:26.395412+0000","last_undegraded":"2024-04-24T23:09:26.395412+0000","last_fullsized":"2024-04-24T23:09:26.395412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:12.723565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761050+0000","last_change":"2024-04-24T23:09:24.226948+0000","last_active":"2024-04-24T23:09:26.761050+0000","last_peered":"2024-04-24T23:09:26.761050+0000","last_clean":"2024-04-24T23:09:26.761050+0000","last_became_active":"2024-04-24T23:09:24.226681+0000","last_became_peered":"2024-04-24T23:09:24.226681+0000","last_unstale":"2024-04-24T23:09:26.761050+0000","last_undegraded":"2024-04-24T23:09:26.761050+0000","last_fullsized":"2024-04-24T23:09:26.761050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:19.918344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757660+0000","last_change":"2024-04-24T23:09:25.231574+0000","last_active":"2024-04-24T23:09:26.757660+0000","last_peered":"2024-04-24T23:09:26.757660+0000","last_clean":"2024-04-24T23:09:26.757660+0000","last_became_active":"2024-04-24T23:09:25.231309+0000","last_became_peered":"2024-04-24T23:09:25.231309+0000","last_unstale":"2024-04-24T23:09:26.757660+0000","last_undegraded":"2024-04-24T23:09:26.757660+0000","last_fullsized":"2024-04-24T23:09:26.757660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:55.372827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231310+0000","last_change":"2024-04-24T23:09:24.218890+0000","last_active":"2024-04-24T23:09:26.231310+0000","last_peered":"2024-04-24T23:09:26.231310+0000","last_clean":"2024-04-24T23:09:26.231310+0000","last_became_active":"2024-04-24T23:09:24.218596+0000","last_became_peered":"2024-04-24T23:09:24.218596+0000","last_unstale":"2024-04-24T23:09:26.231310+0000","last_undegraded":"2024-04-24T23:09:26.231310+0000","last_fullsized":"2024-04-24T23:09:26.231310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:33.780905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230852+0000","last_change":"2024-04-24T23:09:25.246469+0000","last_active":"2024-04-24T23:09:26.230852+0000","last_peered":"2024-04-24T23:09:26.230852+0000","last_clean":"2024-04-24T23:09:26.230852+0000","last_became_active":"2024-04-24T23:09:25.246049+0000","last_became_peered":"2024-04-24T23:09:25.246049+0000","last_unstale":"2024-04-24T23:09:26.230852+0000","last_undegraded":"2024-04-24T23:09:26.230852+0000","last_fullsized":"2024-04-24T23:09:26.230852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:28.410885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759543+0000","last_change":"2024-04-24T23:09:24.227341+0000","last_active":"2024-04-24T23:09:26.759543+0000","last_peered":"2024-04-24T23:09:26.759543+0000","last_clean":"2024-04-24T23:09:26.759543+0000","last_became_active":"2024-04-24T23:09:24.226986+0000","last_became_peered":"2024-04-24T23:09:24.226986+0000","last_unstale":"2024-04-24T23:09:26.759543+0000","last_undegraded":"2024-04-24T23:09:26.759543+0000","last_fullsized":"2024-04-24T23:09:26.759543+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:25.191613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761755+0000","last_change":"2024-04-24T23:09:25.221049+0000","last_active":"2024-04-24T23:09:26.761755+0000","last_peered":"2024-04-24T23:09:26.761755+0000","last_clean":"2024-04-24T23:09:26.761755+0000","last_became_active":"2024-04-24T23:09:25.220561+0000","last_became_peered":"2024-04-24T23:09:25.220561+0000","last_unstale":"2024-04-24T23:09:26.761755+0000","last_undegraded":"2024-04-24T23:09:26.761755+0000","last_fullsized":"2024-04-24T23:09:26.761755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:30.220539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236055+0000","last_change":"2024-04-24T23:09:24.230941+0000","last_active":"2024-04-24T23:09:26.236055+0000","last_peered":"2024-04-24T23:09:26.236055+0000","last_clean":"2024-04-24T23:09:26.236055+0000","last_became_active":"2024-04-24T23:09:24.229475+0000","last_became_peered":"2024-04-24T23:09:24.229475+0000","last_unstale":"2024-04-24T23:09:26.236055+0000","last_undegraded":"2024-04-24T23:09:26.236055+0000","last_fullsized":"2024-04-24T23:09:26.236055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:30.376541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231421+0000","last_change":"2024-04-24T23:09:25.231043+0000","last_active":"2024-04-24T23:09:26.231421+0000","last_peered":"2024-04-24T23:09:26.231421+0000","last_clean":"2024-04-24T23:09:26.231421+0000","last_became_active":"2024-04-24T23:09:25.230807+0000","last_became_peered":"2024-04-24T23:09:25.230807+0000","last_unstale":"2024-04-24T23:09:26.231421+0000","last_undegraded":"2024-04-24T23:09:26.231421+0000","last_fullsized":"2024-04-24T23:09:26.231421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:09:34.984557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.394969+0000","last_change":"2024-04-24T23:09:24.222823+0000","last_active":"2024-04-24T23:09:26.394969+0000","last_peered":"2024-04-24T23:09:26.394969+0000","last_clean":"2024-04-24T23:09:26.394969+0000","last_became_active":"2024-04-24T23:09:24.222541+0000","last_became_peered":"2024-04-24T23:09:24.222541+0000","last_unstale":"2024-04-24T23:09:26.394969+0000","last_undegraded":"2024-04-24T23:09:26.394969+0000","last_fullsized":"2024-04-24T23:09:26.394969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:36:43.389786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235731+0000","last_change":"2024-04-24T23:09:25.241748+0000","last_active":"2024-04-24T23:09:26.235731+0000","last_peered":"2024-04-24T23:09:26.235731+0000","last_clean":"2024-04-24T23:09:26.235731+0000","last_became_active":"2024-04-24T23:09:25.241369+0000","last_became_peered":"2024-04-24T23:09:25.241369+0000","last_unstale":"2024-04-24T23:09:26.235731+0000","last_undegraded":"2024-04-24T23:09:26.235731+0000","last_fullsized":"2024-04-24T23:09:26.235731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:30.047665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759005+0000","last_change":"2024-04-24T23:09:24.226965+0000","last_active":"2024-04-24T23:09:26.759005+0000","last_peered":"2024-04-24T23:09:26.759005+0000","last_clean":"2024-04-24T23:09:26.759005+0000","last_became_active":"2024-04-24T23:09:24.226663+0000","last_became_peered":"2024-04-24T23:09:24.226663+0000","last_unstale":"2024-04-24T23:09:26.759005+0000","last_undegraded":"2024-04-24T23:09:26.759005+0000","last_fullsized":"2024-04-24T23:09:26.759005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:01.560471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248192+0000","last_change":"2024-04-24T23:09:25.242611+0000","last_active":"2024-04-24T23:09:26.248192+0000","last_peered":"2024-04-24T23:09:26.248192+0000","last_clean":"2024-04-24T23:09:26.248192+0000","last_became_active":"2024-04-24T23:09:25.241478+0000","last_became_peered":"2024-04-24T23:09:25.241478+0000","last_unstale":"2024-04-24T23:09:26.248192+0000","last_undegraded":"2024-04-24T23:09:26.248192+0000","last_fullsized":"2024-04-24T23:09:26.248192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:08.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760009+0000","last_change":"2024-04-24T23:09:24.220727+0000","last_active":"2024-04-24T23:09:26.760009+0000","last_peered":"2024-04-24T23:09:26.760009+0000","last_clean":"2024-04-24T23:09:26.760009+0000","last_became_active":"2024-04-24T23:09:24.220441+0000","last_became_peered":"2024-04-24T23:09:24.220441+0000","last_unstale":"2024-04-24T23:09:26.760009+0000","last_undegraded":"2024-04-24T23:09:26.760009+0000","last_fullsized":"2024-04-24T23:09:26.760009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:57.887593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.238290+0000","last_change":"2024-04-24T23:09:25.251221+0000","last_active":"2024-04-24T23:09:26.238290+0000","last_peered":"2024-04-24T23:09:26.238290+0000","last_clean":"2024-04-24T23:09:26.238290+0000","last_became_active":"2024-04-24T23:09:25.247828+0000","last_became_peered":"2024-04-24T23:09:25.247828+0000","last_unstale":"2024-04-24T23:09:26.238290+0000","last_undegraded":"2024-04-24T23:09:26.238290+0000","last_fullsized":"2024-04-24T23:09:26.238290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:04.130559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237981+0000","last_change":"2024-04-24T23:09:24.229978+0000","last_active":"2024-04-24T23:09:26.237981+0000","last_peered":"2024-04-24T23:09:26.237981+0000","last_clean":"2024-04-24T23:09:26.237981+0000","last_became_active":"2024-04-24T23:09:24.229680+0000","last_became_peered":"2024-04-24T23:09:24.229680+0000","last_unstale":"2024-04-24T23:09:26.237981+0000","last_undegraded":"2024-04-24T23:09:26.237981+0000","last_fullsized":"2024-04-24T23:09:26.237981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:42.093715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237220+0000","last_change":"2024-04-24T23:09:25.237345+0000","last_active":"2024-04-24T23:09:26.237220+0000","last_peered":"2024-04-24T23:09:26.237220+0000","last_clean":"2024-04-24T23:09:26.237220+0000","last_became_active":"2024-04-24T23:09:25.237029+0000","last_became_peered":"2024-04-24T23:09:25.237029+0000","last_unstale":"2024-04-24T23:09:26.237220+0000","last_undegraded":"2024-04-24T23:09:26.237220+0000","last_fullsized":"2024-04-24T23:09:26.237220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:29.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237652+0000","last_change":"2024-04-24T23:09:24.231828+0000","last_active":"2024-04-24T23:09:26.237652+0000","last_peered":"2024-04-24T23:09:26.237652+0000","last_clean":"2024-04-24T23:09:26.237652+0000","last_became_active":"2024-04-24T23:09:24.231478+0000","last_became_peered":"2024-04-24T23:09:24.231478+0000","last_unstale":"2024-04-24T23:09:26.237652+0000","last_undegraded":"2024-04-24T23:09:26.237652+0000","last_fullsized":"2024-04-24T23:09:26.237652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:01.985992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237330+0000","last_change":"2024-04-24T23:09:25.236290+0000","last_active":"2024-04-24T23:09:26.237330+0000","last_peered":"2024-04-24T23:09:26.237330+0000","last_clean":"2024-04-24T23:09:26.237330+0000","last_became_active":"2024-04-24T23:09:25.235954+0000","last_became_peered":"2024-04-24T23:09:25.235954+0000","last_unstale":"2024-04-24T23:09:26.237330+0000","last_undegraded":"2024-04-24T23:09:26.237330+0000","last_fullsized":"2024-04-24T23:09:26.237330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:55.203361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248531+0000","last_change":"2024-04-24T23:09:24.222354+0000","last_active":"2024-04-24T23:09:26.248531+0000","last_peered":"2024-04-24T23:09:26.248531+0000","last_clean":"2024-04-24T23:09:26.248531+0000","last_became_active":"2024-04-24T23:09:24.221901+0000","last_became_peered":"2024-04-24T23:09:24.221901+0000","last_unstale":"2024-04-24T23:09:26.248531+0000","last_undegraded":"2024-04-24T23:09:26.248531+0000","last_fullsized":"2024-04-24T23:09:26.248531+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:29.031769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237774+0000","last_change":"2024-04-24T23:09:25.237776+0000","last_active":"2024-04-24T23:09:26.237774+0000","last_peered":"2024-04-24T23:09:26.237774+0000","last_clean":"2024-04-24T23:09:26.237774+0000","last_became_active":"2024-04-24T23:09:25.237483+0000","last_became_peered":"2024-04-24T23:09:25.237483+0000","last_unstale":"2024-04-24T23:09:26.237774+0000","last_undegraded":"2024-04-24T23:09:26.237774+0000","last_fullsized":"2024-04-24T23:09:26.237774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:40.777740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237025+0000","last_change":"2024-04-24T23:09:24.227859+0000","last_active":"2024-04-24T23:09:26.237025+0000","last_peered":"2024-04-24T23:09:26.237025+0000","last_clean":"2024-04-24T23:09:26.237025+0000","last_became_active":"2024-04-24T23:09:24.226007+0000","last_became_peered":"2024-04-24T23:09:24.226007+0000","last_unstale":"2024-04-24T23:09:26.237025+0000","last_undegraded":"2024-04-24T23:09:26.237025+0000","last_fullsized":"2024-04-24T23:09:26.237025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:07.605024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760926+0000","last_change":"2024-04-24T23:09:25.221217+0000","last_active":"2024-04-24T23:09:26.760926+0000","last_peered":"2024-04-24T23:09:26.760926+0000","last_clean":"2024-04-24T23:09:26.760926+0000","last_became_active":"2024-04-24T23:09:25.220878+0000","last_became_peered":"2024-04-24T23:09:25.220878+0000","last_unstale":"2024-04-24T23:09:26.760926+0000","last_undegraded":"2024-04-24T23:09:26.760926+0000","last_fullsized":"2024-04-24T23:09:26.760926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:48.067615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248532+0000","last_change":"2024-04-24T23:09:24.229471+0000","last_active":"2024-04-24T23:09:26.248532+0000","last_peered":"2024-04-24T23:09:26.248532+0000","last_clean":"2024-04-24T23:09:26.248532+0000","last_became_active":"2024-04-24T23:09:24.228937+0000","last_became_peered":"2024-04-24T23:09:24.228937+0000","last_unstale":"2024-04-24T23:09:26.248532+0000","last_undegraded":"2024-04-24T23:09:26.248532+0000","last_fullsized":"2024-04-24T23:09:26.248532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:30.597178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758506+0000","last_change":"2024-04-24T23:09:25.228173+0000","last_active":"2024-04-24T23:09:26.758506+0000","last_peered":"2024-04-24T23:09:26.758506+0000","last_clean":"2024-04-24T23:09:26.758506+0000","last_became_active":"2024-04-24T23:09:25.227863+0000","last_became_peered":"2024-04-24T23:09:25.227863+0000","last_unstale":"2024-04-24T23:09:26.758506+0000","last_undegraded":"2024-04-24T23:09:26.758506+0000","last_fullsized":"2024-04-24T23:09:26.758506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:08.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231668+0000","last_change":"2024-04-24T23:09:24.226541+0000","last_active":"2024-04-24T23:09:26.231668+0000","last_peered":"2024-04-24T23:09:26.231668+0000","last_clean":"2024-04-24T23:09:26.231668+0000","last_became_active":"2024-04-24T23:09:24.226084+0000","last_became_peered":"2024-04-24T23:09:24.226084+0000","last_unstale":"2024-04-24T23:09:26.231668+0000","last_undegraded":"2024-04-24T23:09:26.231668+0000","last_fullsized":"2024-04-24T23:09:26.231668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:52.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231000+0000","last_change":"2024-04-24T23:09:25.244166+0000","last_active":"2024-04-24T23:09:26.231000+0000","last_peered":"2024-04-24T23:09:26.231000+0000","last_clean":"2024-04-24T23:09:26.231000+0000","last_became_active":"2024-04-24T23:09:25.243897+0000","last_became_peered":"2024-04-24T23:09:25.243897+0000","last_unstale":"2024-04-24T23:09:26.231000+0000","last_undegraded":"2024-04-24T23:09:26.231000+0000","last_fullsized":"2024-04-24T23:09:26.231000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:40.777740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395853+0000","last_change":"2024-04-24T23:09:24.227127+0000","last_active":"2024-04-24T23:09:26.395853+0000","last_peered":"2024-04-24T23:09:26.395853+0000","last_clean":"2024-04-24T23:09:26.395853+0000","last_became_active":"2024-04-24T23:09:24.226858+0000","last_became_peered":"2024-04-24T23:09:24.226858+0000","last_unstale":"2024-04-24T23:09:26.395853+0000","last_undegraded":"2024-04-24T23:09:26.395853+0000","last_fullsized":"2024-04-24T23:09:26.395853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:14.089554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759250+0000","last_change":"2024-04-24T23:09:25.241451+0000","last_active":"2024-04-24T23:09:26.759250+0000","last_peered":"2024-04-24T23:09:26.759250+0000","last_clean":"2024-04-24T23:09:26.759250+0000","last_became_active":"2024-04-24T23:09:25.240983+0000","last_became_peered":"2024-04-24T23:09:25.240983+0000","last_unstale":"2024-04-24T23:09:26.759250+0000","last_undegraded":"2024-04-24T23:09:26.759250+0000","last_fullsized":"2024-04-24T23:09:26.759250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:59.534431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231139+0000","last_change":"2024-04-24T23:09:24.222194+0000","last_active":"2024-04-24T23:09:26.231139+0000","last_peered":"2024-04-24T23:09:26.231139+0000","last_clean":"2024-04-24T23:09:26.231139+0000","last_became_active":"2024-04-24T23:09:24.221900+0000","last_became_peered":"2024-04-24T23:09:24.221900+0000","last_unstale":"2024-04-24T23:09:26.231139+0000","last_undegraded":"2024-04-24T23:09:26.231139+0000","last_fullsized":"2024-04-24T23:09:26.231139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:42.849804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239502+0000","last_change":"2024-04-24T23:09:25.231594+0000","last_active":"2024-04-24T23:09:26.239502+0000","last_peered":"2024-04-24T23:09:26.239502+0000","last_clean":"2024-04-24T23:09:26.239502+0000","last_became_active":"2024-04-24T23:09:25.231228+0000","last_became_peered":"2024-04-24T23:09:25.231228+0000","last_unstale":"2024-04-24T23:09:26.239502+0000","last_undegraded":"2024-04-24T23:09:26.239502+0000","last_fullsized":"2024-04-24T23:09:26.239502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:20.201544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757866+0000","last_change":"2024-04-24T23:09:24.207270+0000","last_active":"2024-04-24T23:09:26.757866+0000","last_peered":"2024-04-24T23:09:26.757866+0000","last_clean":"2024-04-24T23:09:26.757866+0000","last_became_active":"2024-04-24T23:09:24.207055+0000","last_became_peered":"2024-04-24T23:09:24.207055+0000","last_unstale":"2024-04-24T23:09:26.757866+0000","last_undegraded":"2024-04-24T23:09:26.757866+0000","last_fullsized":"2024-04-24T23:09:26.757866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:37:29.143571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761263+0000","last_change":"2024-04-24T23:09:25.235865+0000","last_active":"2024-04-24T23:09:26.761263+0000","last_peered":"2024-04-24T23:09:26.761263+0000","last_clean":"2024-04-24T23:09:26.761263+0000","last_became_active":"2024-04-24T23:09:25.235558+0000","last_became_peered":"2024-04-24T23:09:25.235558+0000","last_unstale":"2024-04-24T23:09:26.761263+0000","last_undegraded":"2024-04-24T23:09:26.761263+0000","last_fullsized":"2024-04-24T23:09:26.761263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:28.584484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760141+0000","last_change":"2024-04-24T23:09:24.218209+0000","last_active":"2024-04-24T23:09:26.760141+0000","last_peered":"2024-04-24T23:09:26.760141+0000","last_clean":"2024-04-24T23:09:26.760141+0000","last_became_active":"2024-04-24T23:09:24.217923+0000","last_became_peered":"2024-04-24T23:09:24.217923+0000","last_unstale":"2024-04-24T23:09:26.760141+0000","last_undegraded":"2024-04-24T23:09:26.760141+0000","last_fullsized":"2024-04-24T23:09:26.760141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:19.185648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757992+0000","last_change":"2024-04-24T23:09:25.247544+0000","last_active":"2024-04-24T23:09:26.757992+0000","last_peered":"2024-04-24T23:09:26.757992+0000","last_clean":"2024-04-24T23:09:26.757992+0000","last_became_active":"2024-04-24T23:09:25.247235+0000","last_became_peered":"2024-04-24T23:09:25.247235+0000","last_unstale":"2024-04-24T23:09:26.757992+0000","last_undegraded":"2024-04-24T23:09:26.757992+0000","last_fullsized":"2024-04-24T23:09:26.757992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:15.157553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395981+0000","last_change":"2024-04-24T23:09:24.226794+0000","last_active":"2024-04-24T23:09:26.395981+0000","last_peered":"2024-04-24T23:09:26.395981+0000","last_clean":"2024-04-24T23:09:26.395981+0000","last_became_active":"2024-04-24T23:09:24.226530+0000","last_became_peered":"2024-04-24T23:09:24.226530+0000","last_unstale":"2024-04-24T23:09:26.395981+0000","last_undegraded":"2024-04-24T23:09:26.395981+0000","last_fullsized":"2024-04-24T23:09:26.395981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:54:35.891333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248777+0000","last_change":"2024-04-24T23:09:25.237026+0000","last_active":"2024-04-24T23:09:26.248777+0000","last_peered":"2024-04-24T23:09:26.248777+0000","last_clean":"2024-04-24T23:09:26.248777+0000","last_became_active":"2024-04-24T23:09:25.236674+0000","last_became_peered":"2024-04-24T23:09:25.236674+0000","last_unstale":"2024-04-24T23:09:26.248777+0000","last_undegraded":"2024-04-24T23:09:26.248777+0000","last_fullsized":"2024-04-24T23:09:26.248777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:24.237057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760215+0000","last_change":"2024-04-24T23:09:24.224850+0000","last_active":"2024-04-24T23:09:26.760215+0000","last_peered":"2024-04-24T23:09:26.760215+0000","last_clean":"2024-04-24T23:09:26.760215+0000","last_became_active":"2024-04-24T23:09:24.223602+0000","last_became_peered":"2024-04-24T23:09:24.223602+0000","last_unstale":"2024-04-24T23:09:26.760215+0000","last_undegraded":"2024-04-24T23:09:26.760215+0000","last_fullsized":"2024-04-24T23:09:26.760215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:07:05.045999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237570+0000","last_change":"2024-04-24T23:09:25.237051+0000","last_active":"2024-04-24T23:09:26.237570+0000","last_peered":"2024-04-24T23:09:26.237570+0000","last_clean":"2024-04-24T23:09:26.237570+0000","last_became_active":"2024-04-24T23:09:25.236719+0000","last_became_peered":"2024-04-24T23:09:25.236719+0000","last_unstale":"2024-04-24T23:09:26.237570+0000","last_undegraded":"2024-04-24T23:09:26.237570+0000","last_fullsized":"2024-04-24T23:09:26.237570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:28.410885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248110+0000","last_change":"2024-04-24T23:09:24.222439+0000","last_active":"2024-04-24T23:09:26.248110+0000","last_peered":"2024-04-24T23:09:26.248110+0000","last_clean":"2024-04-24T23:09:26.248110+0000","last_became_active":"2024-04-24T23:09:24.222134+0000","last_became_peered":"2024-04-24T23:09:24.222134+0000","last_unstale":"2024-04-24T23:09:26.248110+0000","last_undegraded":"2024-04-24T23:09:26.248110+0000","last_fullsized":"2024-04-24T23:09:26.248110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:32.726218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760743+0000","last_change":"2024-04-24T23:09:25.237081+0000","last_active":"2024-04-24T23:09:26.760743+0000","last_peered":"2024-04-24T23:09:26.760743+0000","last_clean":"2024-04-24T23:09:26.760743+0000","last_became_active":"2024-04-24T23:09:25.236716+0000","last_became_peered":"2024-04-24T23:09:25.236716+0000","last_unstale":"2024-04-24T23:09:26.760743+0000","last_undegraded":"2024-04-24T23:09:26.760743+0000","last_fullsized":"2024-04-24T23:09:26.760743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:03.747822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395697+0000","last_change":"2024-04-24T23:09:24.219796+0000","last_active":"2024-04-24T23:09:26.395697+0000","last_peered":"2024-04-24T23:09:26.395697+0000","last_clean":"2024-04-24T23:09:26.395697+0000","last_became_active":"2024-04-24T23:09:24.219165+0000","last_became_peered":"2024-04-24T23:09:24.219165+0000","last_unstale":"2024-04-24T23:09:26.395697+0000","last_undegraded":"2024-04-24T23:09:26.395697+0000","last_fullsized":"2024-04-24T23:09:26.395697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:59.413603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230594+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:26.230594+0000","last_peered":"2024-04-24T23:09:26.230594+0000","last_clean":"2024-04-24T23:09:26.230594+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:26.230594+0000","last_undegraded":"2024-04-24T23:09:26.230594+0000","last_fullsized":"2024-04-24T23:09:26.230594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":470205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":470225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509559,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":469575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509560,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1040384,"data_stored":471269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":469553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1630208,"data_stored":1061567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":469575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542264,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":1053319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:09:29.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:09:29.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.860+0000 7f9dc5c00640 1 Processor -- start 2024-04-24T23:09:29.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.860+0000 7f9dc5c00640 1 -- start start 2024-04-24T23:09:29.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.861+0000 7f9dc5c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 0x7f9dc00cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.861+0000 7f9dc5c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dc00d0240 0x7f9dc015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc0070f90 con 0x7f9dc00709d0 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc00b4310 con 0x7f9dc00d0240 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc01565a0 con 0x7f9dc01561c0 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dc00d0240 0x7f9dc015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dc00d0240 0x7f9dc015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40552/0 (socket says 172.21.15.146:40552) 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 -- 172.21.15.146:0/2065704938 learned_addr learned my addr 172.21.15.146:0/2065704938 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dbfe00640 1 --2- 172.21.15.146:0/2065704938 >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 0x7f9dc00cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 -- 172.21.15.146:0/2065704938 >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 msgr2=0x7f9dc00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 --2- 172.21.15.146:0/2065704938 >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 0x7f9dc00cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 -- 172.21.15.146:0/2065704938 >> v1:172.21.15.203:6789/0 conn(0x7f9dc00709d0 legacy=0x7f9dc00cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:29.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dc5200640 1 -- 172.21.15.146:0/2065704938 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc0071270 con 0x7f9dc00d0240 2024-04-24T23:09:29.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.862+0000 7f9dbfe00640 1 --2- 172.21.15.146:0/2065704938 >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 0x7f9dc00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dc5200640 1 --2- 172.21.15.146:0/2065704938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00d0240 0x7f9dc015cb80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00706c0 tx=0x7f9db802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7500aaf629af0d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dbea00640 1 -- 172.21.15.146:0/2065704938 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8036070 con 0x7f9dc00d0240 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dbea00640 1 -- 172.21.15.146:0/2065704938 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db8031600 con 0x7f9dc00d0240 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dbea00640 1 -- 172.21.15.146:0/2065704938 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80319d0 con 0x7f9dc00d0240 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dc5c00640 1 -- 172.21.15.146:0/2065704938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00d0240 msgr2=0x7f9dc015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.864+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/2065704938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00d0240 0x7f9dc015cb80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00706c0 tx=0x7f9db802a5d0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 -- 172.21.15.146:0/2065704938 shutdown_connections 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/2065704938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00d0240 0x7f9dc015cb80 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/2065704938 >> v2:172.21.15.203:3300/0 conn(0x7f9dc01561c0 0x7f9dc00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 -- 172.21.15.146:0/2065704938 >> 172.21.15.146:0/2065704938 conn(0x7f9dc006b320 msgr2=0x7f9dc006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:29.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 -- 172.21.15.146:0/2065704938 shutdown_connections 2024-04-24T23:09:29.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.865+0000 7f9dc5c00640 1 -- 172.21.15.146:0/2065704938 wait complete. 2024-04-24T23:09:29.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.866+0000 7f9dc5c00640 1 Processor -- start 2024-04-24T23:09:29.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.867+0000 7f9dc5c00640 1 -- start start 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.867+0000 7f9dc5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.867+0000 7f9dc5c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 0x7f9dc015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dc5c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 0x7f9dc0158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dc5c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00b2c20 con 0x7f9dc00709d0 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dc5c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0071830 con 0x7f9dc00d0240 2024-04-24T23:09:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dc5c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc00b2da0 con 0x7f9dc01561c0 2024-04-24T23:09:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dbfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dbfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40554/0 (socket says 172.21.15.146:40554) 2024-04-24T23:09:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dbfe00640 1 -- 172.21.15.146:0/4087265490 learned_addr learned my addr 172.21.15.146:0/4087265490 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dc5200640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 0x7f9dc0158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.868+0000 7f9dbf400640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 0x7f9dc015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 -- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 msgr2=0x7f9dc0158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 0x7f9dc0158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 -- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 msgr2=0x7f9dc015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 0x7f9dc015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 -- 172.21.15.146:0/4087265490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc006dd80 con 0x7f9dc00709d0 2024-04-24T23:09:29.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbf400640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 0x7f9dc015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dc5200640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 0x7f9dc0158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dbfe00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c820 tx=0x7f9db000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0015070 con 0x7f9dc00709d0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db0007a30 con 0x7f9dc00709d0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc0156bc0 con 0x7f9dc00709d0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0007de0 con 0x7f9dc00709d0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.869+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc0157180 con 0x7f9dc00709d0 2024-04-24T23:09:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.871+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc00cfd30 con 0x7f9dc00709d0 2024-04-24T23:09:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.872+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9db0018070 con 0x7f9dc00709d0 2024-04-24T23:09:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.873+0000 7f9db7e00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 0x7f9d9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.873+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f9db008afb0 con 0x7f9dc00709d0 2024-04-24T23:09:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.873+0000 7f9dbf400640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 0x7f9d9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.875+0000 7f9dbf400640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 0x7f9d9c06e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00cef70 tx=0x7f9da8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:29.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:29.880+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9dc00cfd30 con 0x7f9dc00709d0 2024-04-24T23:09:30.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.075+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dc0068c40 con 0x7f9d9c06be30 2024-04-24T23:09:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.094+0000 7f9db7e00640 1 -- 172.21.15.146:0/4087265490 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252098 (secure 0 0 0) 0x7f9da80568e0 con 0x7f9d9c06be30 2024-04-24T23:09:30.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 msgr2=0x7f9d9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 0x7f9d9c06e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00cef70 tx=0x7f9da8009040 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 msgr2=0x7f9dc01494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c820 tx=0x7f9db000cce0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 shutdown_connections 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9d9c06be30 0x7f9d9c06e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9dc01561c0 0x7f9dc0158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dc00d0240 0x7f9dc015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 --2- 172.21.15.146:0/4087265490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dc00709d0 0x7f9dc01494b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.100+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 >> 172.21.15.146:0/4087265490 conn(0x7f9dc006b320 msgr2=0x7f9dc00cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.101+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 shutdown_connections 2024-04-24T23:09:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.101+0000 7f9dc5c00640 1 -- 172.21.15.146:0/4087265490 wait complete. 2024-04-24T23:09:30.121 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-24T23:09:29.805411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258664,"kb_used_data":9180,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716056,"statfs":{"total":773094113280,"available":772829241344,"internally_reserved":0,"allocated":9400320,"data_stored":4935288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002061"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231670+0000","last_change":"2024-04-24T23:09:25.223296+0000","last_active":"2024-04-24T23:09:26.231670+0000","last_peered":"2024-04-24T23:09:26.231670+0000","last_clean":"2024-04-24T23:09:26.231670+0000","last_became_active":"2024-04-24T23:09:25.222993+0000","last_became_peered":"2024-04-24T23:09:25.222993+0000","last_unstale":"2024-04-24T23:09:26.231670+0000","last_undegraded":"2024-04-24T23:09:26.231670+0000","last_fullsized":"2024-04-24T23:09:26.231670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:52.382958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248360+0000","last_change":"2024-04-24T23:09:25.236829+0000","last_active":"2024-04-24T23:09:26.248360+0000","last_peered":"2024-04-24T23:09:26.248360+0000","last_clean":"2024-04-24T23:09:26.248360+0000","last_became_active":"2024-04-24T23:09:25.236528+0000","last_became_peered":"2024-04-24T23:09:25.236528+0000","last_unstale":"2024-04-24T23:09:26.248360+0000","last_undegraded":"2024-04-24T23:09:26.248360+0000","last_fullsized":"2024-04-24T23:09:26.248360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248481+0000","last_change":"2024-04-24T23:09:25.248655+0000","last_active":"2024-04-24T23:09:26.248481+0000","last_peered":"2024-04-24T23:09:26.248481+0000","last_clean":"2024-04-24T23:09:26.248481+0000","last_became_active":"2024-04-24T23:09:25.245702+0000","last_became_peered":"2024-04-24T23:09:25.245702+0000","last_unstale":"2024-04-24T23:09:26.248481+0000","last_undegraded":"2024-04-24T23:09:26.248481+0000","last_fullsized":"2024-04-24T23:09:26.248481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:59.534431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757575+0000","last_change":"2024-04-24T23:09:25.218749+0000","last_active":"2024-04-24T23:09:26.757575+0000","last_peered":"2024-04-24T23:09:26.757575+0000","last_clean":"2024-04-24T23:09:26.757575+0000","last_became_active":"2024-04-24T23:09:25.218446+0000","last_became_peered":"2024-04-24T23:09:25.218446+0000","last_unstale":"2024-04-24T23:09:26.757575+0000","last_undegraded":"2024-04-24T23:09:26.757575+0000","last_fullsized":"2024-04-24T23:09:26.757575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:15.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236831+0000","last_change":"2024-04-24T23:09:25.236340+0000","last_active":"2024-04-24T23:09:26.236831+0000","last_peered":"2024-04-24T23:09:26.236831+0000","last_clean":"2024-04-24T23:09:26.236831+0000","last_became_active":"2024-04-24T23:09:25.233245+0000","last_became_peered":"2024-04-24T23:09:25.233245+0000","last_unstale":"2024-04-24T23:09:26.236831+0000","last_undegraded":"2024-04-24T23:09:26.236831+0000","last_fullsized":"2024-04-24T23:09:26.236831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.613073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395371+0000","last_change":"2024-04-24T23:09:25.249206+0000","last_active":"2024-04-24T23:09:26.395371+0000","last_peered":"2024-04-24T23:09:26.395371+0000","last_clean":"2024-04-24T23:09:26.395371+0000","last_became_active":"2024-04-24T23:09:25.248628+0000","last_became_peered":"2024-04-24T23:09:25.248628+0000","last_unstale":"2024-04-24T23:09:26.395371+0000","last_undegraded":"2024-04-24T23:09:26.395371+0000","last_fullsized":"2024-04-24T23:09:26.395371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:46.046071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760556+0000","last_change":"2024-04-24T23:09:25.232429+0000","last_active":"2024-04-24T23:09:26.760556+0000","last_peered":"2024-04-24T23:09:26.760556+0000","last_clean":"2024-04-24T23:09:26.760556+0000","last_became_active":"2024-04-24T23:09:25.232159+0000","last_became_peered":"2024-04-24T23:09:25.232159+0000","last_unstale":"2024-04-24T23:09:26.760556+0000","last_undegraded":"2024-04-24T23:09:26.760556+0000","last_fullsized":"2024-04-24T23:09:26.760556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235680+0000","last_change":"2024-04-24T23:09:25.235938+0000","last_active":"2024-04-24T23:09:26.235680+0000","last_peered":"2024-04-24T23:09:26.235680+0000","last_clean":"2024-04-24T23:09:26.235680+0000","last_became_active":"2024-04-24T23:09:25.235665+0000","last_became_peered":"2024-04-24T23:09:25.235665+0000","last_unstale":"2024-04-24T23:09:26.235680+0000","last_undegraded":"2024-04-24T23:09:26.235680+0000","last_fullsized":"2024-04-24T23:09:26.235680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:23.322132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758496+0000","last_change":"2024-04-24T23:09:25.231288+0000","last_active":"2024-04-24T23:09:26.758496+0000","last_peered":"2024-04-24T23:09:26.758496+0000","last_clean":"2024-04-24T23:09:26.758496+0000","last_became_active":"2024-04-24T23:09:25.230864+0000","last_became_peered":"2024-04-24T23:09:25.230864+0000","last_unstale":"2024-04-24T23:09:26.758496+0000","last_undegraded":"2024-04-24T23:09:26.758496+0000","last_fullsized":"2024-04-24T23:09:26.758496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:53.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231084+0000","last_change":"2024-04-24T23:09:25.215705+0000","last_active":"2024-04-24T23:09:26.231084+0000","last_peered":"2024-04-24T23:09:26.231084+0000","last_clean":"2024-04-24T23:09:26.231084+0000","last_became_active":"2024-04-24T23:09:25.215327+0000","last_became_peered":"2024-04-24T23:09:25.215327+0000","last_unstale":"2024-04-24T23:09:26.231084+0000","last_undegraded":"2024-04-24T23:09:26.231084+0000","last_fullsized":"2024-04-24T23:09:26.231084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:42:44.498611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.249084+0000","last_change":"2024-04-24T23:09:25.252869+0000","last_active":"2024-04-24T23:09:26.249084+0000","last_peered":"2024-04-24T23:09:26.249084+0000","last_clean":"2024-04-24T23:09:26.249084+0000","last_became_active":"2024-04-24T23:09:25.251623+0000","last_became_peered":"2024-04-24T23:09:25.251623+0000","last_unstale":"2024-04-24T23:09:26.249084+0000","last_undegraded":"2024-04-24T23:09:26.249084+0000","last_fullsized":"2024-04-24T23:09:26.249084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:52.840852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761004+0000","last_change":"2024-04-24T23:09:25.229953+0000","last_active":"2024-04-24T23:09:26.761004+0000","last_peered":"2024-04-24T23:09:26.761004+0000","last_clean":"2024-04-24T23:09:26.761004+0000","last_became_active":"2024-04-24T23:09:25.228118+0000","last_became_peered":"2024-04-24T23:09:25.228118+0000","last_unstale":"2024-04-24T23:09:26.761004+0000","last_undegraded":"2024-04-24T23:09:26.761004+0000","last_fullsized":"2024-04-24T23:09:26.761004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:24.237057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248273+0000","last_change":"2024-04-24T23:09:25.250019+0000","last_active":"2024-04-24T23:09:26.248273+0000","last_peered":"2024-04-24T23:09:26.248273+0000","last_clean":"2024-04-24T23:09:26.248273+0000","last_became_active":"2024-04-24T23:09:25.249057+0000","last_became_peered":"2024-04-24T23:09:25.249057+0000","last_unstale":"2024-04-24T23:09:26.248273+0000","last_undegraded":"2024-04-24T23:09:26.248273+0000","last_fullsized":"2024-04-24T23:09:26.248273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237975+0000","last_change":"2024-04-24T23:09:25.246055+0000","last_active":"2024-04-24T23:09:26.237975+0000","last_peered":"2024-04-24T23:09:26.237975+0000","last_clean":"2024-04-24T23:09:26.237975+0000","last_became_active":"2024-04-24T23:09:25.245740+0000","last_became_peered":"2024-04-24T23:09:25.245740+0000","last_unstale":"2024-04-24T23:09:26.237975+0000","last_undegraded":"2024-04-24T23:09:26.237975+0000","last_fullsized":"2024-04-24T23:09:26.237975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:58.372442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235702+0000","last_change":"2024-04-24T23:09:25.242722+0000","last_active":"2024-04-24T23:09:26.235702+0000","last_peered":"2024-04-24T23:09:26.235702+0000","last_clean":"2024-04-24T23:09:26.235702+0000","last_became_active":"2024-04-24T23:09:25.242443+0000","last_became_peered":"2024-04-24T23:09:25.242443+0000","last_unstale":"2024-04-24T23:09:26.235702+0000","last_undegraded":"2024-04-24T23:09:26.235702+0000","last_fullsized":"2024-04-24T23:09:26.235702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:58.903489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757599+0000","last_change":"2024-04-24T23:09:25.228520+0000","last_active":"2024-04-24T23:09:26.757599+0000","last_peered":"2024-04-24T23:09:26.757599+0000","last_clean":"2024-04-24T23:09:26.757599+0000","last_became_active":"2024-04-24T23:09:25.228245+0000","last_became_peered":"2024-04-24T23:09:25.228245+0000","last_unstale":"2024-04-24T23:09:26.757599+0000","last_undegraded":"2024-04-24T23:09:26.757599+0000","last_fullsized":"2024-04-24T23:09:26.757599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:21.670603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.238939+0000","last_change":"2024-04-24T23:09:25.247763+0000","last_active":"2024-04-24T23:09:26.238939+0000","last_peered":"2024-04-24T23:09:26.238939+0000","last_clean":"2024-04-24T23:09:26.238939+0000","last_became_active":"2024-04-24T23:09:25.235969+0000","last_became_peered":"2024-04-24T23:09:25.235969+0000","last_unstale":"2024-04-24T23:09:26.238939+0000","last_undegraded":"2024-04-24T23:09:26.238939+0000","last_fullsized":"2024-04-24T23:09:26.238939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:48.153602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248756+0000","last_change":"2024-04-24T23:09:25.250706+0000","last_active":"2024-04-24T23:09:26.248756+0000","last_peered":"2024-04-24T23:09:26.248756+0000","last_clean":"2024-04-24T23:09:26.248756+0000","last_became_active":"2024-04-24T23:09:25.250373+0000","last_became_peered":"2024-04-24T23:09:25.250373+0000","last_unstale":"2024-04-24T23:09:26.248756+0000","last_undegraded":"2024-04-24T23:09:26.248756+0000","last_fullsized":"2024-04-24T23:09:26.248756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:10.954962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239177+0000","last_change":"2024-04-24T23:09:25.247375+0000","last_active":"2024-04-24T23:09:26.239177+0000","last_peered":"2024-04-24T23:09:26.239177+0000","last_clean":"2024-04-24T23:09:26.239177+0000","last_became_active":"2024-04-24T23:09:25.244481+0000","last_became_peered":"2024-04-24T23:09:25.244481+0000","last_unstale":"2024-04-24T23:09:26.239177+0000","last_undegraded":"2024-04-24T23:09:26.239177+0000","last_fullsized":"2024-04-24T23:09:26.239177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:01.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395649+0000","last_change":"2024-04-24T23:09:25.229947+0000","last_active":"2024-04-24T23:09:26.395649+0000","last_peered":"2024-04-24T23:09:26.395649+0000","last_clean":"2024-04-24T23:09:26.395649+0000","last_became_active":"2024-04-24T23:09:25.229625+0000","last_became_peered":"2024-04-24T23:09:25.229625+0000","last_unstale":"2024-04-24T23:09:26.395649+0000","last_undegraded":"2024-04-24T23:09:26.395649+0000","last_fullsized":"2024-04-24T23:09:26.395649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:13.591194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758210+0000","last_change":"2024-04-24T23:09:25.232821+0000","last_active":"2024-04-24T23:09:26.758210+0000","last_peered":"2024-04-24T23:09:26.758210+0000","last_clean":"2024-04-24T23:09:26.758210+0000","last_became_active":"2024-04-24T23:09:25.232122+0000","last_became_peered":"2024-04-24T23:09:25.232122+0000","last_unstale":"2024-04-24T23:09:26.758210+0000","last_undegraded":"2024-04-24T23:09:26.758210+0000","last_fullsized":"2024-04-24T23:09:26.758210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:04.547362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248075+0000","last_change":"2024-04-24T23:09:25.250173+0000","last_active":"2024-04-24T23:09:26.248075+0000","last_peered":"2024-04-24T23:09:26.248075+0000","last_clean":"2024-04-24T23:09:26.248075+0000","last_became_active":"2024-04-24T23:09:25.249794+0000","last_became_peered":"2024-04-24T23:09:25.249794+0000","last_unstale":"2024-04-24T23:09:26.248075+0000","last_undegraded":"2024-04-24T23:09:26.248075+0000","last_fullsized":"2024-04-24T23:09:26.248075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:53.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230843+0000","last_change":"2024-04-24T23:09:25.213905+0000","last_active":"2024-04-24T23:09:26.230843+0000","last_peered":"2024-04-24T23:09:26.230843+0000","last_clean":"2024-04-24T23:09:26.230843+0000","last_became_active":"2024-04-24T23:09:25.213701+0000","last_became_peered":"2024-04-24T23:09:25.213701+0000","last_unstale":"2024-04-24T23:09:26.230843+0000","last_undegraded":"2024-04-24T23:09:26.230843+0000","last_fullsized":"2024-04-24T23:09:26.230843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:55.203361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247492+0000","last_change":"2024-04-24T23:09:25.239512+0000","last_active":"2024-04-24T23:09:26.247492+0000","last_peered":"2024-04-24T23:09:26.247492+0000","last_clean":"2024-04-24T23:09:26.247492+0000","last_became_active":"2024-04-24T23:09:25.239168+0000","last_became_peered":"2024-04-24T23:09:25.239168+0000","last_unstale":"2024-04-24T23:09:26.247492+0000","last_undegraded":"2024-04-24T23:09:26.247492+0000","last_fullsized":"2024-04-24T23:09:26.247492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.496485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.396108+0000","last_change":"2024-04-24T23:09:25.244305+0000","last_active":"2024-04-24T23:09:26.396108+0000","last_peered":"2024-04-24T23:09:26.396108+0000","last_clean":"2024-04-24T23:09:26.396108+0000","last_became_active":"2024-04-24T23:09:25.242339+0000","last_became_peered":"2024-04-24T23:09:25.242339+0000","last_unstale":"2024-04-24T23:09:26.396108+0000","last_undegraded":"2024-04-24T23:09:26.396108+0000","last_fullsized":"2024-04-24T23:09:26.396108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:40:03.762521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759742+0000","last_change":"2024-04-24T23:09:25.233359+0000","last_active":"2024-04-24T23:09:26.759742+0000","last_peered":"2024-04-24T23:09:26.759742+0000","last_clean":"2024-04-24T23:09:26.759742+0000","last_became_active":"2024-04-24T23:09:25.233025+0000","last_became_peered":"2024-04-24T23:09:25.233025+0000","last_unstale":"2024-04-24T23:09:26.759742+0000","last_undegraded":"2024-04-24T23:09:26.759742+0000","last_fullsized":"2024-04-24T23:09:26.759742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757796+0000","last_change":"2024-04-24T23:09:25.231047+0000","last_active":"2024-04-24T23:09:26.757796+0000","last_peered":"2024-04-24T23:09:26.757796+0000","last_clean":"2024-04-24T23:09:26.757796+0000","last_became_active":"2024-04-24T23:09:25.229072+0000","last_became_peered":"2024-04-24T23:09:25.229072+0000","last_unstale":"2024-04-24T23:09:26.757796+0000","last_undegraded":"2024-04-24T23:09:26.757796+0000","last_fullsized":"2024-04-24T23:09:26.757796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.496485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236886+0000","last_change":"2024-04-24T23:09:25.236250+0000","last_active":"2024-04-24T23:09:26.236886+0000","last_peered":"2024-04-24T23:09:26.236886+0000","last_clean":"2024-04-24T23:09:26.236886+0000","last_became_active":"2024-04-24T23:09:25.235571+0000","last_became_peered":"2024-04-24T23:09:25.235571+0000","last_unstale":"2024-04-24T23:09:26.236886+0000","last_undegraded":"2024-04-24T23:09:26.236886+0000","last_fullsized":"2024-04-24T23:09:26.236886+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:33.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395288+0000","last_change":"2024-04-24T23:09:25.234167+0000","last_active":"2024-04-24T23:09:26.395288+0000","last_peered":"2024-04-24T23:09:26.395288+0000","last_clean":"2024-04-24T23:09:26.395288+0000","last_became_active":"2024-04-24T23:09:25.229906+0000","last_became_peered":"2024-04-24T23:09:25.229906+0000","last_unstale":"2024-04-24T23:09:26.395288+0000","last_undegraded":"2024-04-24T23:09:26.395288+0000","last_fullsized":"2024-04-24T23:09:26.395288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:28.847769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230772+0000","last_change":"2024-04-24T23:09:25.241402+0000","last_active":"2024-04-24T23:09:26.230772+0000","last_peered":"2024-04-24T23:09:26.230772+0000","last_clean":"2024-04-24T23:09:26.230772+0000","last_became_active":"2024-04-24T23:09:25.241081+0000","last_became_peered":"2024-04-24T23:09:25.241081+0000","last_unstale":"2024-04-24T23:09:26.230772+0000","last_undegraded":"2024-04-24T23:09:26.230772+0000","last_fullsized":"2024-04-24T23:09:26.230772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:29.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248052+0000","last_change":"2024-04-24T23:09:25.238308+0000","last_active":"2024-04-24T23:09:26.248052+0000","last_peered":"2024-04-24T23:09:26.248052+0000","last_clean":"2024-04-24T23:09:26.248052+0000","last_became_active":"2024-04-24T23:09:25.237949+0000","last_became_peered":"2024-04-24T23:09:25.237949+0000","last_unstale":"2024-04-24T23:09:26.248052+0000","last_undegraded":"2024-04-24T23:09:26.248052+0000","last_fullsized":"2024-04-24T23:09:26.248052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:34.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758072+0000","last_change":"2024-04-24T23:09:25.233652+0000","last_active":"2024-04-24T23:09:26.758072+0000","last_peered":"2024-04-24T23:09:26.758072+0000","last_clean":"2024-04-24T23:09:26.758072+0000","last_became_active":"2024-04-24T23:09:25.232978+0000","last_became_peered":"2024-04-24T23:09:25.232978+0000","last_unstale":"2024-04-24T23:09:26.758072+0000","last_undegraded":"2024-04-24T23:09:26.758072+0000","last_fullsized":"2024-04-24T23:09:26.758072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:34.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235326+0000","last_change":"2024-04-24T23:09:25.234162+0000","last_active":"2024-04-24T23:09:26.235326+0000","last_peered":"2024-04-24T23:09:26.235326+0000","last_clean":"2024-04-24T23:09:26.235326+0000","last_became_active":"2024-04-24T23:09:25.233803+0000","last_became_peered":"2024-04-24T23:09:25.233803+0000","last_unstale":"2024-04-24T23:09:26.235326+0000","last_undegraded":"2024-04-24T23:09:26.235326+0000","last_fullsized":"2024-04-24T23:09:26.235326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:37:30.159467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237835+0000","last_change":"2024-04-24T23:09:24.229720+0000","last_active":"2024-04-24T23:09:26.237835+0000","last_peered":"2024-04-24T23:09:26.237835+0000","last_clean":"2024-04-24T23:09:26.237835+0000","last_became_active":"2024-04-24T23:09:24.229380+0000","last_became_peered":"2024-04-24T23:09:24.229380+0000","last_unstale":"2024-04-24T23:09:26.237835+0000","last_undegraded":"2024-04-24T23:09:26.237835+0000","last_fullsized":"2024-04-24T23:09:26.237835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:02.991973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235948+0000","last_change":"2024-04-24T23:09:25.225513+0000","last_active":"2024-04-24T23:09:26.235948+0000","last_peered":"2024-04-24T23:09:26.235948+0000","last_clean":"2024-04-24T23:09:26.235948+0000","last_became_active":"2024-04-24T23:09:25.224623+0000","last_became_peered":"2024-04-24T23:09:25.224623+0000","last_unstale":"2024-04-24T23:09:26.235948+0000","last_undegraded":"2024-04-24T23:09:26.235948+0000","last_fullsized":"2024-04-24T23:09:26.235948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:02.576367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761179+0000","last_change":"2024-04-24T23:09:24.226138+0000","last_active":"2024-04-24T23:09:26.761179+0000","last_peered":"2024-04-24T23:09:26.761179+0000","last_clean":"2024-04-24T23:09:26.761179+0000","last_became_active":"2024-04-24T23:09:24.225798+0000","last_became_peered":"2024-04-24T23:09:24.225798+0000","last_unstale":"2024-04-24T23:09:26.761179+0000","last_undegraded":"2024-04-24T23:09:26.761179+0000","last_fullsized":"2024-04-24T23:09:26.761179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:36.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759931+0000","last_change":"2024-04-24T23:09:25.229328+0000","last_active":"2024-04-24T23:09:26.759931+0000","last_peered":"2024-04-24T23:09:26.759931+0000","last_clean":"2024-04-24T23:09:26.759931+0000","last_became_active":"2024-04-24T23:09:25.229009+0000","last_became_peered":"2024-04-24T23:09:25.229009+0000","last_unstale":"2024-04-24T23:09:26.759931+0000","last_undegraded":"2024-04-24T23:09:26.759931+0000","last_fullsized":"2024-04-24T23:09:26.759931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:10.954962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231822+0000","last_change":"2024-04-24T23:09:24.227335+0000","last_active":"2024-04-24T23:09:26.231822+0000","last_peered":"2024-04-24T23:09:26.231822+0000","last_clean":"2024-04-24T23:09:26.231822+0000","last_became_active":"2024-04-24T23:09:24.227045+0000","last_became_peered":"2024-04-24T23:09:24.227045+0000","last_unstale":"2024-04-24T23:09:26.231822+0000","last_undegraded":"2024-04-24T23:09:26.231822+0000","last_fullsized":"2024-04-24T23:09:26.231822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:37.525440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757677+0000","last_change":"2024-04-24T23:09:25.219436+0000","last_active":"2024-04-24T23:09:26.757677+0000","last_peered":"2024-04-24T23:09:26.757677+0000","last_clean":"2024-04-24T23:09:26.757677+0000","last_became_active":"2024-04-24T23:09:25.219174+0000","last_became_peered":"2024-04-24T23:09:25.219174+0000","last_unstale":"2024-04-24T23:09:26.757677+0000","last_undegraded":"2024-04-24T23:09:26.757677+0000","last_fullsized":"2024-04-24T23:09:26.757677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:56.223927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761576+0000","last_change":"2024-04-24T23:09:24.220851+0000","last_active":"2024-04-24T23:09:26.761576+0000","last_peered":"2024-04-24T23:09:26.761576+0000","last_clean":"2024-04-24T23:09:26.761576+0000","last_became_active":"2024-04-24T23:09:24.220586+0000","last_became_peered":"2024-04-24T23:09:24.220586+0000","last_unstale":"2024-04-24T23:09:26.761576+0000","last_undegraded":"2024-04-24T23:09:26.761576+0000","last_fullsized":"2024-04-24T23:09:26.761576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:51.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395943+0000","last_change":"2024-04-24T23:09:25.231778+0000","last_active":"2024-04-24T23:09:26.395943+0000","last_peered":"2024-04-24T23:09:26.395943+0000","last_clean":"2024-04-24T23:09:26.395943+0000","last_became_active":"2024-04-24T23:09:25.231449+0000","last_became_peered":"2024-04-24T23:09:25.231449+0000","last_unstale":"2024-04-24T23:09:26.395943+0000","last_undegraded":"2024-04-24T23:09:26.395943+0000","last_fullsized":"2024-04-24T23:09:26.395943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:33.466853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758746+0000","last_change":"2024-04-24T23:09:24.218033+0000","last_active":"2024-04-24T23:09:26.758746+0000","last_peered":"2024-04-24T23:09:26.758746+0000","last_clean":"2024-04-24T23:09:26.758746+0000","last_became_active":"2024-04-24T23:09:24.217759+0000","last_became_peered":"2024-04-24T23:09:24.217759+0000","last_unstale":"2024-04-24T23:09:26.758746+0000","last_undegraded":"2024-04-24T23:09:26.758746+0000","last_fullsized":"2024-04-24T23:09:26.758746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:47.991580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248938+0000","last_change":"2024-04-24T23:09:25.252549+0000","last_active":"2024-04-24T23:09:26.248938+0000","last_peered":"2024-04-24T23:09:26.248938+0000","last_clean":"2024-04-24T23:09:26.248938+0000","last_became_active":"2024-04-24T23:09:25.250785+0000","last_became_peered":"2024-04-24T23:09:25.250785+0000","last_unstale":"2024-04-24T23:09:26.248938+0000","last_undegraded":"2024-04-24T23:09:26.248938+0000","last_fullsized":"2024-04-24T23:09:26.248938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:28.584484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759505+0000","last_change":"2024-04-24T23:09:24.228965+0000","last_active":"2024-04-24T23:09:26.759505+0000","last_peered":"2024-04-24T23:09:26.759505+0000","last_clean":"2024-04-24T23:09:26.759505+0000","last_became_active":"2024-04-24T23:09:24.228686+0000","last_became_peered":"2024-04-24T23:09:24.228686+0000","last_unstale":"2024-04-24T23:09:26.759505+0000","last_undegraded":"2024-04-24T23:09:26.759505+0000","last_fullsized":"2024-04-24T23:09:26.759505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:00.609301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761682+0000","last_change":"2024-04-24T23:09:25.236323+0000","last_active":"2024-04-24T23:09:26.761682+0000","last_peered":"2024-04-24T23:09:26.761682+0000","last_clean":"2024-04-24T23:09:26.761682+0000","last_became_active":"2024-04-24T23:09:25.236042+0000","last_became_peered":"2024-04-24T23:09:25.236042+0000","last_unstale":"2024-04-24T23:09:26.761682+0000","last_undegraded":"2024-04-24T23:09:26.761682+0000","last_fullsized":"2024-04-24T23:09:26.761682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:52.840852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236795+0000","last_change":"2024-04-24T23:09:24.228705+0000","last_active":"2024-04-24T23:09:26.236795+0000","last_peered":"2024-04-24T23:09:26.236795+0000","last_clean":"2024-04-24T23:09:26.236795+0000","last_became_active":"2024-04-24T23:09:24.227729+0000","last_became_peered":"2024-04-24T23:09:24.227729+0000","last_unstale":"2024-04-24T23:09:26.236795+0000","last_undegraded":"2024-04-24T23:09:26.236795+0000","last_fullsized":"2024-04-24T23:09:26.236795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:48:57.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760486+0000","last_change":"2024-04-24T23:09:25.242972+0000","last_active":"2024-04-24T23:09:26.760486+0000","last_peered":"2024-04-24T23:09:26.760486+0000","last_clean":"2024-04-24T23:09:26.760486+0000","last_became_active":"2024-04-24T23:09:25.242569+0000","last_became_peered":"2024-04-24T23:09:25.242569+0000","last_unstale":"2024-04-24T23:09:26.760486+0000","last_undegraded":"2024-04-24T23:09:26.760486+0000","last_fullsized":"2024-04-24T23:09:26.760486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:31:55.925038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247788+0000","last_change":"2024-04-24T23:09:24.223223+0000","last_active":"2024-04-24T23:09:26.247788+0000","last_peered":"2024-04-24T23:09:26.247788+0000","last_clean":"2024-04-24T23:09:26.247788+0000","last_became_active":"2024-04-24T23:09:24.222957+0000","last_became_peered":"2024-04-24T23:09:24.222957+0000","last_unstale":"2024-04-24T23:09:26.247788+0000","last_undegraded":"2024-04-24T23:09:26.247788+0000","last_fullsized":"2024-04-24T23:09:26.247788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:01.560471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.247804+0000","last_change":"2024-04-24T23:09:25.242147+0000","last_active":"2024-04-24T23:09:26.247804+0000","last_peered":"2024-04-24T23:09:26.247804+0000","last_clean":"2024-04-24T23:09:26.247804+0000","last_became_active":"2024-04-24T23:09:25.241858+0000","last_became_peered":"2024-04-24T23:09:25.241858+0000","last_unstale":"2024-04-24T23:09:26.247804+0000","last_undegraded":"2024-04-24T23:09:26.247804+0000","last_fullsized":"2024-04-24T23:09:26.247804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:15.157553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758757+0000","last_change":"2024-04-24T23:09:24.223854+0000","last_active":"2024-04-24T23:09:26.758757+0000","last_peered":"2024-04-24T23:09:26.758757+0000","last_clean":"2024-04-24T23:09:26.758757+0000","last_became_active":"2024-04-24T23:09:24.223537+0000","last_became_peered":"2024-04-24T23:09:24.223537+0000","last_unstale":"2024-04-24T23:09:26.758757+0000","last_undegraded":"2024-04-24T23:09:26.758757+0000","last_fullsized":"2024-04-24T23:09:26.758757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:29.031769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757077+0000","last_change":"2024-04-24T23:09:25.231907+0000","last_active":"2024-04-24T23:09:26.757077+0000","last_peered":"2024-04-24T23:09:26.757077+0000","last_clean":"2024-04-24T23:09:26.757077+0000","last_became_active":"2024-04-24T23:09:25.227045+0000","last_became_peered":"2024-04-24T23:09:25.227045+0000","last_unstale":"2024-04-24T23:09:26.757077+0000","last_undegraded":"2024-04-24T23:09:26.757077+0000","last_fullsized":"2024-04-24T23:09:26.757077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:25:56.589612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231031+0000","last_change":"2024-04-24T23:09:24.221737+0000","last_active":"2024-04-24T23:09:26.231031+0000","last_peered":"2024-04-24T23:09:26.231031+0000","last_clean":"2024-04-24T23:09:26.231031+0000","last_became_active":"2024-04-24T23:09:24.221467+0000","last_became_peered":"2024-04-24T23:09:24.221467+0000","last_unstale":"2024-04-24T23:09:26.231031+0000","last_undegraded":"2024-04-24T23:09:26.231031+0000","last_fullsized":"2024-04-24T23:09:26.231031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:13.776588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239143+0000","last_change":"2024-04-24T23:09:25.232538+0000","last_active":"2024-04-24T23:09:26.239143+0000","last_peered":"2024-04-24T23:09:26.239143+0000","last_clean":"2024-04-24T23:09:26.239143+0000","last_became_active":"2024-04-24T23:09:25.231629+0000","last_became_peered":"2024-04-24T23:09:25.231629+0000","last_unstale":"2024-04-24T23:09:26.239143+0000","last_undegraded":"2024-04-24T23:09:26.239143+0000","last_fullsized":"2024-04-24T23:09:26.239143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:33:49.737399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395963+0000","last_change":"2024-04-24T23:09:24.225726+0000","last_active":"2024-04-24T23:09:26.395963+0000","last_peered":"2024-04-24T23:09:26.395963+0000","last_clean":"2024-04-24T23:09:26.395963+0000","last_became_active":"2024-04-24T23:09:24.225396+0000","last_became_peered":"2024-04-24T23:09:24.225396+0000","last_unstale":"2024-04-24T23:09:26.395963+0000","last_undegraded":"2024-04-24T23:09:26.395963+0000","last_fullsized":"2024-04-24T23:09:26.395963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:02.640509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395412+0000","last_change":"2024-04-24T23:09:25.238544+0000","last_active":"2024-04-24T23:09:26.395412+0000","last_peered":"2024-04-24T23:09:26.395412+0000","last_clean":"2024-04-24T23:09:26.395412+0000","last_became_active":"2024-04-24T23:09:25.238239+0000","last_became_peered":"2024-04-24T23:09:25.238239+0000","last_unstale":"2024-04-24T23:09:26.395412+0000","last_undegraded":"2024-04-24T23:09:26.395412+0000","last_fullsized":"2024-04-24T23:09:26.395412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:12.723565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761050+0000","last_change":"2024-04-24T23:09:24.226948+0000","last_active":"2024-04-24T23:09:26.761050+0000","last_peered":"2024-04-24T23:09:26.761050+0000","last_clean":"2024-04-24T23:09:26.761050+0000","last_became_active":"2024-04-24T23:09:24.226681+0000","last_became_peered":"2024-04-24T23:09:24.226681+0000","last_unstale":"2024-04-24T23:09:26.761050+0000","last_undegraded":"2024-04-24T23:09:26.761050+0000","last_fullsized":"2024-04-24T23:09:26.761050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:19.918344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757660+0000","last_change":"2024-04-24T23:09:25.231574+0000","last_active":"2024-04-24T23:09:26.757660+0000","last_peered":"2024-04-24T23:09:26.757660+0000","last_clean":"2024-04-24T23:09:26.757660+0000","last_became_active":"2024-04-24T23:09:25.231309+0000","last_became_peered":"2024-04-24T23:09:25.231309+0000","last_unstale":"2024-04-24T23:09:26.757660+0000","last_undegraded":"2024-04-24T23:09:26.757660+0000","last_fullsized":"2024-04-24T23:09:26.757660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:55.372827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231310+0000","last_change":"2024-04-24T23:09:24.218890+0000","last_active":"2024-04-24T23:09:26.231310+0000","last_peered":"2024-04-24T23:09:26.231310+0000","last_clean":"2024-04-24T23:09:26.231310+0000","last_became_active":"2024-04-24T23:09:24.218596+0000","last_became_peered":"2024-04-24T23:09:24.218596+0000","last_unstale":"2024-04-24T23:09:26.231310+0000","last_undegraded":"2024-04-24T23:09:26.231310+0000","last_fullsized":"2024-04-24T23:09:26.231310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:33.780905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230852+0000","last_change":"2024-04-24T23:09:25.246469+0000","last_active":"2024-04-24T23:09:26.230852+0000","last_peered":"2024-04-24T23:09:26.230852+0000","last_clean":"2024-04-24T23:09:26.230852+0000","last_became_active":"2024-04-24T23:09:25.246049+0000","last_became_peered":"2024-04-24T23:09:25.246049+0000","last_unstale":"2024-04-24T23:09:26.230852+0000","last_undegraded":"2024-04-24T23:09:26.230852+0000","last_fullsized":"2024-04-24T23:09:26.230852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:28.410885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759543+0000","last_change":"2024-04-24T23:09:24.227341+0000","last_active":"2024-04-24T23:09:26.759543+0000","last_peered":"2024-04-24T23:09:26.759543+0000","last_clean":"2024-04-24T23:09:26.759543+0000","last_became_active":"2024-04-24T23:09:24.226986+0000","last_became_peered":"2024-04-24T23:09:24.226986+0000","last_unstale":"2024-04-24T23:09:26.759543+0000","last_undegraded":"2024-04-24T23:09:26.759543+0000","last_fullsized":"2024-04-24T23:09:26.759543+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:25.191613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761755+0000","last_change":"2024-04-24T23:09:25.221049+0000","last_active":"2024-04-24T23:09:26.761755+0000","last_peered":"2024-04-24T23:09:26.761755+0000","last_clean":"2024-04-24T23:09:26.761755+0000","last_became_active":"2024-04-24T23:09:25.220561+0000","last_became_peered":"2024-04-24T23:09:25.220561+0000","last_unstale":"2024-04-24T23:09:26.761755+0000","last_undegraded":"2024-04-24T23:09:26.761755+0000","last_fullsized":"2024-04-24T23:09:26.761755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:30.220539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.236055+0000","last_change":"2024-04-24T23:09:24.230941+0000","last_active":"2024-04-24T23:09:26.236055+0000","last_peered":"2024-04-24T23:09:26.236055+0000","last_clean":"2024-04-24T23:09:26.236055+0000","last_became_active":"2024-04-24T23:09:24.229475+0000","last_became_peered":"2024-04-24T23:09:24.229475+0000","last_unstale":"2024-04-24T23:09:26.236055+0000","last_undegraded":"2024-04-24T23:09:26.236055+0000","last_fullsized":"2024-04-24T23:09:26.236055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:30.376541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231421+0000","last_change":"2024-04-24T23:09:25.231043+0000","last_active":"2024-04-24T23:09:26.231421+0000","last_peered":"2024-04-24T23:09:26.231421+0000","last_clean":"2024-04-24T23:09:26.231421+0000","last_became_active":"2024-04-24T23:09:25.230807+0000","last_became_peered":"2024-04-24T23:09:25.230807+0000","last_unstale":"2024-04-24T23:09:26.231421+0000","last_undegraded":"2024-04-24T23:09:26.231421+0000","last_fullsized":"2024-04-24T23:09:26.231421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:09:34.984557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.394969+0000","last_change":"2024-04-24T23:09:24.222823+0000","last_active":"2024-04-24T23:09:26.394969+0000","last_peered":"2024-04-24T23:09:26.394969+0000","last_clean":"2024-04-24T23:09:26.394969+0000","last_became_active":"2024-04-24T23:09:24.222541+0000","last_became_peered":"2024-04-24T23:09:24.222541+0000","last_unstale":"2024-04-24T23:09:26.394969+0000","last_undegraded":"2024-04-24T23:09:26.394969+0000","last_fullsized":"2024-04-24T23:09:26.394969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:36:43.389786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.235731+0000","last_change":"2024-04-24T23:09:25.241748+0000","last_active":"2024-04-24T23:09:26.235731+0000","last_peered":"2024-04-24T23:09:26.235731+0000","last_clean":"2024-04-24T23:09:26.235731+0000","last_became_active":"2024-04-24T23:09:25.241369+0000","last_became_peered":"2024-04-24T23:09:25.241369+0000","last_unstale":"2024-04-24T23:09:26.235731+0000","last_undegraded":"2024-04-24T23:09:26.235731+0000","last_fullsized":"2024-04-24T23:09:26.235731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:30.047665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759005+0000","last_change":"2024-04-24T23:09:24.226965+0000","last_active":"2024-04-24T23:09:26.759005+0000","last_peered":"2024-04-24T23:09:26.759005+0000","last_clean":"2024-04-24T23:09:26.759005+0000","last_became_active":"2024-04-24T23:09:24.226663+0000","last_became_peered":"2024-04-24T23:09:24.226663+0000","last_unstale":"2024-04-24T23:09:26.759005+0000","last_undegraded":"2024-04-24T23:09:26.759005+0000","last_fullsized":"2024-04-24T23:09:26.759005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:01.560471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248192+0000","last_change":"2024-04-24T23:09:25.242611+0000","last_active":"2024-04-24T23:09:26.248192+0000","last_peered":"2024-04-24T23:09:26.248192+0000","last_clean":"2024-04-24T23:09:26.248192+0000","last_became_active":"2024-04-24T23:09:25.241478+0000","last_became_peered":"2024-04-24T23:09:25.241478+0000","last_unstale":"2024-04-24T23:09:26.248192+0000","last_undegraded":"2024-04-24T23:09:26.248192+0000","last_fullsized":"2024-04-24T23:09:26.248192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:08.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760009+0000","last_change":"2024-04-24T23:09:24.220727+0000","last_active":"2024-04-24T23:09:26.760009+0000","last_peered":"2024-04-24T23:09:26.760009+0000","last_clean":"2024-04-24T23:09:26.760009+0000","last_became_active":"2024-04-24T23:09:24.220441+0000","last_became_peered":"2024-04-24T23:09:24.220441+0000","last_unstale":"2024-04-24T23:09:26.760009+0000","last_undegraded":"2024-04-24T23:09:26.760009+0000","last_fullsized":"2024-04-24T23:09:26.760009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:57.887593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.238290+0000","last_change":"2024-04-24T23:09:25.251221+0000","last_active":"2024-04-24T23:09:26.238290+0000","last_peered":"2024-04-24T23:09:26.238290+0000","last_clean":"2024-04-24T23:09:26.238290+0000","last_became_active":"2024-04-24T23:09:25.247828+0000","last_became_peered":"2024-04-24T23:09:25.247828+0000","last_unstale":"2024-04-24T23:09:26.238290+0000","last_undegraded":"2024-04-24T23:09:26.238290+0000","last_fullsized":"2024-04-24T23:09:26.238290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:04.130559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237981+0000","last_change":"2024-04-24T23:09:24.229978+0000","last_active":"2024-04-24T23:09:26.237981+0000","last_peered":"2024-04-24T23:09:26.237981+0000","last_clean":"2024-04-24T23:09:26.237981+0000","last_became_active":"2024-04-24T23:09:24.229680+0000","last_became_peered":"2024-04-24T23:09:24.229680+0000","last_unstale":"2024-04-24T23:09:26.237981+0000","last_undegraded":"2024-04-24T23:09:26.237981+0000","last_fullsized":"2024-04-24T23:09:26.237981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:05:42.093715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237220+0000","last_change":"2024-04-24T23:09:25.237345+0000","last_active":"2024-04-24T23:09:26.237220+0000","last_peered":"2024-04-24T23:09:26.237220+0000","last_clean":"2024-04-24T23:09:26.237220+0000","last_became_active":"2024-04-24T23:09:25.237029+0000","last_became_peered":"2024-04-24T23:09:25.237029+0000","last_unstale":"2024-04-24T23:09:26.237220+0000","last_undegraded":"2024-04-24T23:09:26.237220+0000","last_fullsized":"2024-04-24T23:09:26.237220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:29.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237652+0000","last_change":"2024-04-24T23:09:24.231828+0000","last_active":"2024-04-24T23:09:26.237652+0000","last_peered":"2024-04-24T23:09:26.237652+0000","last_clean":"2024-04-24T23:09:26.237652+0000","last_became_active":"2024-04-24T23:09:24.231478+0000","last_became_peered":"2024-04-24T23:09:24.231478+0000","last_unstale":"2024-04-24T23:09:26.237652+0000","last_undegraded":"2024-04-24T23:09:26.237652+0000","last_fullsized":"2024-04-24T23:09:26.237652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:01.985992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237330+0000","last_change":"2024-04-24T23:09:25.236290+0000","last_active":"2024-04-24T23:09:26.237330+0000","last_peered":"2024-04-24T23:09:26.237330+0000","last_clean":"2024-04-24T23:09:26.237330+0000","last_became_active":"2024-04-24T23:09:25.235954+0000","last_became_peered":"2024-04-24T23:09:25.235954+0000","last_unstale":"2024-04-24T23:09:26.237330+0000","last_undegraded":"2024-04-24T23:09:26.237330+0000","last_fullsized":"2024-04-24T23:09:26.237330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:55.203361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248531+0000","last_change":"2024-04-24T23:09:24.222354+0000","last_active":"2024-04-24T23:09:26.248531+0000","last_peered":"2024-04-24T23:09:26.248531+0000","last_clean":"2024-04-24T23:09:26.248531+0000","last_became_active":"2024-04-24T23:09:24.221901+0000","last_became_peered":"2024-04-24T23:09:24.221901+0000","last_unstale":"2024-04-24T23:09:26.248531+0000","last_undegraded":"2024-04-24T23:09:26.248531+0000","last_fullsized":"2024-04-24T23:09:26.248531+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:29.031769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237774+0000","last_change":"2024-04-24T23:09:25.237776+0000","last_active":"2024-04-24T23:09:26.237774+0000","last_peered":"2024-04-24T23:09:26.237774+0000","last_clean":"2024-04-24T23:09:26.237774+0000","last_became_active":"2024-04-24T23:09:25.237483+0000","last_became_peered":"2024-04-24T23:09:25.237483+0000","last_unstale":"2024-04-24T23:09:26.237774+0000","last_undegraded":"2024-04-24T23:09:26.237774+0000","last_fullsized":"2024-04-24T23:09:26.237774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:40.777740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237025+0000","last_change":"2024-04-24T23:09:24.227859+0000","last_active":"2024-04-24T23:09:26.237025+0000","last_peered":"2024-04-24T23:09:26.237025+0000","last_clean":"2024-04-24T23:09:26.237025+0000","last_became_active":"2024-04-24T23:09:24.226007+0000","last_became_peered":"2024-04-24T23:09:24.226007+0000","last_unstale":"2024-04-24T23:09:26.237025+0000","last_undegraded":"2024-04-24T23:09:26.237025+0000","last_fullsized":"2024-04-24T23:09:26.237025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:07.605024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760926+0000","last_change":"2024-04-24T23:09:25.221217+0000","last_active":"2024-04-24T23:09:26.760926+0000","last_peered":"2024-04-24T23:09:26.760926+0000","last_clean":"2024-04-24T23:09:26.760926+0000","last_became_active":"2024-04-24T23:09:25.220878+0000","last_became_peered":"2024-04-24T23:09:25.220878+0000","last_unstale":"2024-04-24T23:09:26.760926+0000","last_undegraded":"2024-04-24T23:09:26.760926+0000","last_fullsized":"2024-04-24T23:09:26.760926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:48.067615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248532+0000","last_change":"2024-04-24T23:09:24.229471+0000","last_active":"2024-04-24T23:09:26.248532+0000","last_peered":"2024-04-24T23:09:26.248532+0000","last_clean":"2024-04-24T23:09:26.248532+0000","last_became_active":"2024-04-24T23:09:24.228937+0000","last_became_peered":"2024-04-24T23:09:24.228937+0000","last_unstale":"2024-04-24T23:09:26.248532+0000","last_undegraded":"2024-04-24T23:09:26.248532+0000","last_fullsized":"2024-04-24T23:09:26.248532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:30.597178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.758506+0000","last_change":"2024-04-24T23:09:25.228173+0000","last_active":"2024-04-24T23:09:26.758506+0000","last_peered":"2024-04-24T23:09:26.758506+0000","last_clean":"2024-04-24T23:09:26.758506+0000","last_became_active":"2024-04-24T23:09:25.227863+0000","last_became_peered":"2024-04-24T23:09:25.227863+0000","last_unstale":"2024-04-24T23:09:26.758506+0000","last_undegraded":"2024-04-24T23:09:26.758506+0000","last_fullsized":"2024-04-24T23:09:26.758506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:08.917912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231668+0000","last_change":"2024-04-24T23:09:24.226541+0000","last_active":"2024-04-24T23:09:26.231668+0000","last_peered":"2024-04-24T23:09:26.231668+0000","last_clean":"2024-04-24T23:09:26.231668+0000","last_became_active":"2024-04-24T23:09:24.226084+0000","last_became_peered":"2024-04-24T23:09:24.226084+0000","last_unstale":"2024-04-24T23:09:26.231668+0000","last_undegraded":"2024-04-24T23:09:26.231668+0000","last_fullsized":"2024-04-24T23:09:26.231668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:52.210142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231000+0000","last_change":"2024-04-24T23:09:25.244166+0000","last_active":"2024-04-24T23:09:26.231000+0000","last_peered":"2024-04-24T23:09:26.231000+0000","last_clean":"2024-04-24T23:09:26.231000+0000","last_became_active":"2024-04-24T23:09:25.243897+0000","last_became_peered":"2024-04-24T23:09:25.243897+0000","last_unstale":"2024-04-24T23:09:26.231000+0000","last_undegraded":"2024-04-24T23:09:26.231000+0000","last_fullsized":"2024-04-24T23:09:26.231000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:40.777740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395853+0000","last_change":"2024-04-24T23:09:24.227127+0000","last_active":"2024-04-24T23:09:26.395853+0000","last_peered":"2024-04-24T23:09:26.395853+0000","last_clean":"2024-04-24T23:09:26.395853+0000","last_became_active":"2024-04-24T23:09:24.226858+0000","last_became_peered":"2024-04-24T23:09:24.226858+0000","last_unstale":"2024-04-24T23:09:26.395853+0000","last_undegraded":"2024-04-24T23:09:26.395853+0000","last_fullsized":"2024-04-24T23:09:26.395853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:14.089554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.759250+0000","last_change":"2024-04-24T23:09:25.241451+0000","last_active":"2024-04-24T23:09:26.759250+0000","last_peered":"2024-04-24T23:09:26.759250+0000","last_clean":"2024-04-24T23:09:26.759250+0000","last_became_active":"2024-04-24T23:09:25.240983+0000","last_became_peered":"2024-04-24T23:09:25.240983+0000","last_unstale":"2024-04-24T23:09:26.759250+0000","last_undegraded":"2024-04-24T23:09:26.759250+0000","last_fullsized":"2024-04-24T23:09:26.759250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:59.534431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.231139+0000","last_change":"2024-04-24T23:09:24.222194+0000","last_active":"2024-04-24T23:09:26.231139+0000","last_peered":"2024-04-24T23:09:26.231139+0000","last_clean":"2024-04-24T23:09:26.231139+0000","last_became_active":"2024-04-24T23:09:24.221900+0000","last_became_peered":"2024-04-24T23:09:24.221900+0000","last_unstale":"2024-04-24T23:09:26.231139+0000","last_undegraded":"2024-04-24T23:09:26.231139+0000","last_fullsized":"2024-04-24T23:09:26.231139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:42.849804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.239502+0000","last_change":"2024-04-24T23:09:25.231594+0000","last_active":"2024-04-24T23:09:26.239502+0000","last_peered":"2024-04-24T23:09:26.239502+0000","last_clean":"2024-04-24T23:09:26.239502+0000","last_became_active":"2024-04-24T23:09:25.231228+0000","last_became_peered":"2024-04-24T23:09:25.231228+0000","last_unstale":"2024-04-24T23:09:26.239502+0000","last_undegraded":"2024-04-24T23:09:26.239502+0000","last_fullsized":"2024-04-24T23:09:26.239502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:20.201544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757866+0000","last_change":"2024-04-24T23:09:24.207270+0000","last_active":"2024-04-24T23:09:26.757866+0000","last_peered":"2024-04-24T23:09:26.757866+0000","last_clean":"2024-04-24T23:09:26.757866+0000","last_became_active":"2024-04-24T23:09:24.207055+0000","last_became_peered":"2024-04-24T23:09:24.207055+0000","last_unstale":"2024-04-24T23:09:26.757866+0000","last_undegraded":"2024-04-24T23:09:26.757866+0000","last_fullsized":"2024-04-24T23:09:26.757866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:37:29.143571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.761263+0000","last_change":"2024-04-24T23:09:25.235865+0000","last_active":"2024-04-24T23:09:26.761263+0000","last_peered":"2024-04-24T23:09:26.761263+0000","last_clean":"2024-04-24T23:09:26.761263+0000","last_became_active":"2024-04-24T23:09:25.235558+0000","last_became_peered":"2024-04-24T23:09:25.235558+0000","last_unstale":"2024-04-24T23:09:26.761263+0000","last_undegraded":"2024-04-24T23:09:26.761263+0000","last_fullsized":"2024-04-24T23:09:26.761263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:28.584484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760141+0000","last_change":"2024-04-24T23:09:24.218209+0000","last_active":"2024-04-24T23:09:26.760141+0000","last_peered":"2024-04-24T23:09:26.760141+0000","last_clean":"2024-04-24T23:09:26.760141+0000","last_became_active":"2024-04-24T23:09:24.217923+0000","last_became_peered":"2024-04-24T23:09:24.217923+0000","last_unstale":"2024-04-24T23:09:26.760141+0000","last_undegraded":"2024-04-24T23:09:26.760141+0000","last_fullsized":"2024-04-24T23:09:26.760141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:19.185648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.757992+0000","last_change":"2024-04-24T23:09:25.247544+0000","last_active":"2024-04-24T23:09:26.757992+0000","last_peered":"2024-04-24T23:09:26.757992+0000","last_clean":"2024-04-24T23:09:26.757992+0000","last_became_active":"2024-04-24T23:09:25.247235+0000","last_became_peered":"2024-04-24T23:09:25.247235+0000","last_unstale":"2024-04-24T23:09:26.757992+0000","last_undegraded":"2024-04-24T23:09:26.757992+0000","last_fullsized":"2024-04-24T23:09:26.757992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:15.157553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395981+0000","last_change":"2024-04-24T23:09:24.226794+0000","last_active":"2024-04-24T23:09:26.395981+0000","last_peered":"2024-04-24T23:09:26.395981+0000","last_clean":"2024-04-24T23:09:26.395981+0000","last_became_active":"2024-04-24T23:09:24.226530+0000","last_became_peered":"2024-04-24T23:09:24.226530+0000","last_unstale":"2024-04-24T23:09:26.395981+0000","last_undegraded":"2024-04-24T23:09:26.395981+0000","last_fullsized":"2024-04-24T23:09:26.395981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:54:35.891333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248777+0000","last_change":"2024-04-24T23:09:25.237026+0000","last_active":"2024-04-24T23:09:26.248777+0000","last_peered":"2024-04-24T23:09:26.248777+0000","last_clean":"2024-04-24T23:09:26.248777+0000","last_became_active":"2024-04-24T23:09:25.236674+0000","last_became_peered":"2024-04-24T23:09:25.236674+0000","last_unstale":"2024-04-24T23:09:26.248777+0000","last_undegraded":"2024-04-24T23:09:26.248777+0000","last_fullsized":"2024-04-24T23:09:26.248777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:24.237057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760215+0000","last_change":"2024-04-24T23:09:24.224850+0000","last_active":"2024-04-24T23:09:26.760215+0000","last_peered":"2024-04-24T23:09:26.760215+0000","last_clean":"2024-04-24T23:09:26.760215+0000","last_became_active":"2024-04-24T23:09:24.223602+0000","last_became_peered":"2024-04-24T23:09:24.223602+0000","last_unstale":"2024-04-24T23:09:26.760215+0000","last_undegraded":"2024-04-24T23:09:26.760215+0000","last_fullsized":"2024-04-24T23:09:26.760215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:07:05.045999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.237570+0000","last_change":"2024-04-24T23:09:25.237051+0000","last_active":"2024-04-24T23:09:26.237570+0000","last_peered":"2024-04-24T23:09:26.237570+0000","last_clean":"2024-04-24T23:09:26.237570+0000","last_became_active":"2024-04-24T23:09:25.236719+0000","last_became_peered":"2024-04-24T23:09:25.236719+0000","last_unstale":"2024-04-24T23:09:26.237570+0000","last_undegraded":"2024-04-24T23:09:26.237570+0000","last_fullsized":"2024-04-24T23:09:26.237570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:28.410885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.248110+0000","last_change":"2024-04-24T23:09:24.222439+0000","last_active":"2024-04-24T23:09:26.248110+0000","last_peered":"2024-04-24T23:09:26.248110+0000","last_clean":"2024-04-24T23:09:26.248110+0000","last_became_active":"2024-04-24T23:09:24.222134+0000","last_became_peered":"2024-04-24T23:09:24.222134+0000","last_unstale":"2024-04-24T23:09:26.248110+0000","last_undegraded":"2024-04-24T23:09:26.248110+0000","last_fullsized":"2024-04-24T23:09:26.248110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:32.726218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.760743+0000","last_change":"2024-04-24T23:09:25.237081+0000","last_active":"2024-04-24T23:09:26.760743+0000","last_peered":"2024-04-24T23:09:26.760743+0000","last_clean":"2024-04-24T23:09:26.760743+0000","last_became_active":"2024-04-24T23:09:25.236716+0000","last_became_peered":"2024-04-24T23:09:25.236716+0000","last_unstale":"2024-04-24T23:09:26.760743+0000","last_undegraded":"2024-04-24T23:09:26.760743+0000","last_fullsized":"2024-04-24T23:09:26.760743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:24.175985+0000","last_clean_scrub_stamp":"2024-04-24T23:09:24.175985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:03.747822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.395697+0000","last_change":"2024-04-24T23:09:24.219796+0000","last_active":"2024-04-24T23:09:26.395697+0000","last_peered":"2024-04-24T23:09:26.395697+0000","last_clean":"2024-04-24T23:09:26.395697+0000","last_became_active":"2024-04-24T23:09:24.219165+0000","last_became_peered":"2024-04-24T23:09:24.219165+0000","last_unstale":"2024-04-24T23:09:26.395697+0000","last_undegraded":"2024-04-24T23:09:26.395697+0000","last_fullsized":"2024-04-24T23:09:26.395697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:23.160089+0000","last_clean_scrub_stamp":"2024-04-24T23:09:23.160089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:59.413603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-24T23:09:26.230594+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:26.230594+0000","last_peered":"2024-04-24T23:09:26.230594+0000","last_clean":"2024-04-24T23:09:26.230594+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:26.230594+0000","last_undegraded":"2024-04-24T23:09:26.230594+0000","last_fullsized":"2024-04-24T23:09:26.230594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":470205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":470225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509559,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":469575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509560,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1040384,"data_stored":471269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":469553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1630208,"data_stored":1061567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":469575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542264,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":1053319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:09:30.125 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:09:30.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:09:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.374+0000 7fa1bbe00640 1 Processor -- start 2024-04-24T23:09:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.375+0000 7fa1bbe00640 1 -- start start 2024-04-24T23:09:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.376+0000 7fa1bbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1bc0b2bc0 0x7fa1bc0b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.376+0000 7fa1bbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1bc161bb0 con 0x7fa1bc0d2a00 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.376+0000 7fa1bbe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1bc0d4830 con 0x7fa1bc1617d0 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.376+0000 7fa1bbe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa1bc0b0880 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1ba000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa1bc0d2a00 0x7fa1bc0b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42974/0 (socket says 172.21.15.146:42974) 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1ba000640 1 -- 172.21.15.146:0/3693496812 learned_addr learned my addr 172.21.15.146:0/3693496812 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1bb400640 1 --2- 172.21.15.146:0/3693496812 >> v2:172.21.15.146:3300/0 conn(0x7fa1bc0b2bc0 0x7fa1bc0b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1b9600640 1 -- 172.21.15.146:0/3693496812 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306788527 0 0) 0x7fa1a4001490 con 0x7fa1bc0d2a00 2024-04-24T23:09:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1b9600640 1 -- 172.21.15.146:0/3693496812 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa19c003520 con 0x7fa1bc0d2a00 2024-04-24T23:09:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1bb400640 1 -- 172.21.15.146:0/3693496812 >> v1:172.21.15.203:6789/0 conn(0x7fa1bc1617d0 legacy=0x7fa1bc0d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1bb400640 1 -- 172.21.15.146:0/3693496812 >> v1:172.21.15.146:6789/0 conn(0x7fa1bc0d2a00 legacy=0x7fa1bc0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.377+0000 7fa1bb400640 1 -- 172.21.15.146:0/3693496812 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0d4af0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.378+0000 7fa1bb400640 1 --2- 172.21.15.146:0/3693496812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b19e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40097a0 tx=0x7fa1b402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5145e8f44498aea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.379+0000 7fa1b9600640 1 -- 172.21.15.146:0/3693496812 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4037070 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.379+0000 7fa1b9600640 1 -- 172.21.15.146:0/3693496812 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b4032640 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.379+0000 7fa1b9600640 1 -- 172.21.15.146:0/3693496812 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4032a10 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.379+0000 7fa1bbe00640 1 -- 172.21.15.146:0/3693496812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 msgr2=0x7fa1bc0b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.379+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/3693496812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b19e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40097a0 tx=0x7fa1b402a2c0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.380+0000 7fa1bbe00640 1 -- 172.21.15.146:0/3693496812 shutdown_connections 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.380+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/3693496812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b19e0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.380+0000 7fa1bbe00640 1 -- 172.21.15.146:0/3693496812 >> 172.21.15.146:0/3693496812 conn(0x7fa1bc0d3d10 msgr2=0x7fa1bc0d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.380+0000 7fa1bbe00640 1 -- 172.21.15.146:0/3693496812 shutdown_connections 2024-04-24T23:09:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.380+0000 7fa1bbe00640 1 -- 172.21.15.146:0/3693496812 wait complete. 2024-04-24T23:09:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.381+0000 7fa1bbe00640 1 Processor -- start 2024-04-24T23:09:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.381+0000 7fa1bbe00640 1 -- start start 2024-04-24T23:09:30.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1bc0d2a00 0x7fa1bc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 0x7fa1bc0b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0d0fe0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0b0db0 con 0x7fa1bc0d2a00 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.382+0000 7fa1bbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc0d1af0 con 0x7fa1bc1617d0 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40568/0 (socket says 172.21.15.146:40568) 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 -- 172.21.15.146:0/839176701 learned_addr learned my addr 172.21.15.146:0/839176701 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1ba000640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1bc0d2a00 0x7fa1bc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1bb400640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 0x7fa1bc0b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 -- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 msgr2=0x7fa1bc0b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 0x7fa1bc0b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 -- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1bc0d2a00 msgr2=0x7fa1bc159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1bc0d2a00 0x7fa1bc159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1baa00640 1 -- 172.21.15.146:0/839176701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0b95f0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.383+0000 7fa1bb400640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 0x7fa1bc0b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1baa00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c400 tx=0x7fa1ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac017070 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac0052d0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac003830 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc0b6da0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.384+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc0b7360 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.385+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc04f500 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.386+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1ac01a070 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.387+0000 7fa1b2a00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.387+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7fa1ac08a3c0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.388+0000 7fa1ba000640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.389+0000 7fa1ba000640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 0x7fa19806e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc1f7790 tx=0x7fa1a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.392+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa1ac058b40 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.664+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa1bc0d20d0 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.669+0000 7fa1b2a00640 1 -- 172.21.15.146:0/839176701 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fa1ac058440 con 0x7fa1bc0b2bc0 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:09:30.672 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 msgr2=0x7fa19806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 0x7fa19806e320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc1f7790 tx=0x7fa1a4009040 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 msgr2=0x7fa1bc0b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c400 tx=0x7fa1ac00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 shutdown_connections 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1bc1617d0 0x7fa1bc0b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1bc0d2a00 0x7fa1bc159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 --2- 172.21.15.146:0/839176701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc0b2bc0 0x7fa1bc0b7b60 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 >> 172.21.15.146:0/839176701 conn(0x7fa1bc0d3d10 msgr2=0x7fa1bc0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.672+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 shutdown_connections 2024-04-24T23:09:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.673+0000 7fa1bbe00640 1 -- 172.21.15.146:0/839176701 wait complete. 2024-04-24T23:09:30.695 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.880+0000 7f3b43e00640 1 Processor -- start 2024-04-24T23:09:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.880+0000 7f3b43e00640 1 -- start start 2024-04-24T23:09:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3b4415ddd0 0x7f3b44070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b44072920 0x7f3b440cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4415e1b0 con 0x7f3b440d0070 2024-04-24T23:09:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3b440d04d0 con 0x7f3b44072920 2024-04-24T23:09:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3b440713b0 con 0x7f3b4415ddd0 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3b440d0070 0x7f3b440ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42976/0 (socket says 172.21.15.146:42976) 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b43400640 1 -- 172.21.15.146:0/1341261281 learned_addr learned my addr 172.21.15.146:0/1341261281 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.882+0000 7f3b3a000640 1 --2- 172.21.15.146:0/1341261281 >> v2:172.21.15.146:3300/0 conn(0x7f3b44072920 0x7f3b440cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b42a00640 1 --2- 172.21.15.146:0/1341261281 >> v2:172.21.15.203:3300/0 conn(0x7f3b4415ddd0 0x7f3b44070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b3a000640 1 -- 172.21.15.146:0/1341261281 >> v2:172.21.15.203:3300/0 conn(0x7f3b4415ddd0 msgr2=0x7f3b44070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b3a000640 1 --2- 172.21.15.146:0/1341261281 >> v2:172.21.15.203:3300/0 conn(0x7f3b4415ddd0 0x7f3b44070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b42000640 1 -- 172.21.15.146:0/1341261281 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832327548 0 0) 0x7f3b4415e1b0 con 0x7f3b440d0070 2024-04-24T23:09:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b3a000640 1 -- 172.21.15.146:0/1341261281 >> v1:172.21.15.146:6789/0 conn(0x7f3b440d0070 legacy=0x7f3b440ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.883+0000 7f3b3a000640 1 -- 172.21.15.146:0/1341261281 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b44071690 con 0x7f3b44072920 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.884+0000 7f3b3a000640 1 --2- 172.21.15.146:0/1341261281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b44072920 0x7f3b440cfb30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3b440d06d0 tx=0x7f3b2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2621954bb51b74bc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.884+0000 7f3b42000640 1 -- 172.21.15.146:0/1341261281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c037070 con 0x7f3b44072920 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.884+0000 7f3b42000640 1 -- 172.21.15.146:0/1341261281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c032440 con 0x7f3b44072920 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.884+0000 7f3b42000640 1 -- 172.21.15.146:0/1341261281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032810 con 0x7f3b44072920 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 -- 172.21.15.146:0/1341261281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b44072920 msgr2=0x7f3b440cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 --2- 172.21.15.146:0/1341261281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b44072920 0x7f3b440cfb30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3b440d06d0 tx=0x7f3b2c02a1a0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 -- 172.21.15.146:0/1341261281 shutdown_connections 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 --2- 172.21.15.146:0/1341261281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b44072920 0x7f3b440cfb30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 --2- 172.21.15.146:0/1341261281 >> v2:172.21.15.203:3300/0 conn(0x7f3b4415ddd0 0x7f3b44070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 -- 172.21.15.146:0/1341261281 >> 172.21.15.146:0/1341261281 conn(0x7f3b4406b320 msgr2=0x7f3b4406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 -- 172.21.15.146:0/1341261281 shutdown_connections 2024-04-24T23:09:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.885+0000 7f3b43e00640 1 -- 172.21.15.146:0/1341261281 wait complete. 2024-04-24T23:09:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.887+0000 7f3b43e00640 1 Processor -- start 2024-04-24T23:09:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.887+0000 7f3b43e00640 1 -- start start 2024-04-24T23:09:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b44072920 0x7f3b4414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 0x7f3b441547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440710a0 con 0x7f3b4415ddd0 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44071c50 con 0x7f3b44072920 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b440b3c10 con 0x7f3b440d0070 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40592/0 (socket says 172.21.15.146:40592) 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b43400640 1 -- 172.21.15.146:0/4008315504 learned_addr learned my addr 172.21.15.146:0/4008315504 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b42a00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b44072920 0x7f3b4414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.888+0000 7f3b3a000640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 0x7f3b441547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 -- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 msgr2=0x7f3b441547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 0x7f3b441547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 -- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b44072920 msgr2=0x7f3b4414a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b44072920 0x7f3b4414a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 -- 172.21.15.146:0/4008315504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4415f980 con 0x7f3b4415ddd0 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b3a000640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 0x7f3b441547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43400640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c7e0 tx=0x7f3b3c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c018070 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c00a640 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00aa30 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4415fc60 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.889+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b44160220 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.891+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4404f500 con 0x7f3b4415ddd0 2024-04-24T23:09:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.892+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b3c00abd0 con 0x7f3b4415ddd0 2024-04-24T23:09:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.892+0000 7f3b3be00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 0x7f3b2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.893+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f3b3c08a6c0 con 0x7f3b4415ddd0 2024-04-24T23:09:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.893+0000 7f3b42a00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 0x7f3b2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.894+0000 7f3b42a00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 0x7f3b2006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3b34006fd0 tx=0x7f3b34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:30.897+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b3c058e40 con 0x7f3b4415ddd0 2024-04-24T23:09:31.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.136+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b4415c470 con 0x7f3b4415ddd0 2024-04-24T23:09:31.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.137+0000 7f3b3be00640 1 -- 172.21.15.146:0/4008315504 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7f3b3c058740 con 0x7f3b4415ddd0 2024-04-24T23:09:31.139 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:31.140 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 msgr2=0x7f3b2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 0x7f3b2006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3b34006fd0 tx=0x7f3b34008040 comp rx=0 tx=0).stop 2024-04-24T23:09:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 msgr2=0x7f3b44154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c7e0 tx=0x7f3b3c00cca0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 shutdown_connections 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b4415ddd0 0x7f3b44154d30 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3b2006be30 0x7f3b2006e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b440d0070 0x7f3b441547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 --2- 172.21.15.146:0/4008315504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b44072920 0x7f3b4414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 >> 172.21.15.146:0/4008315504 conn(0x7f3b4406b320 msgr2=0x7f3b440b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 shutdown_connections 2024-04-24T23:09:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.140+0000 7f3b43e00640 1 -- 172.21.15.146:0/4008315504 wait complete. 2024-04-24T23:09:31.159 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-04-24T23:09:31.158+0000 7efe95c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:09:31.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:09:24.676969+0000', 'modified': '2024-04-24T23:09:27.715137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7374': {'gid': 7374, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3967134794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3967134794}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3967134794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7374, 'qdb_cluster': [7374]} 2024-04-24T23:09:31.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:09:31.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-24T23:09:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.772+0000 7f41fb200640 1 Processor -- start 2024-04-24T23:09:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.772+0000 7f41fb200640 1 -- start start 2024-04-24T23:09:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41fb200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41f406e370 0x7f41f40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41fb200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41fb200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40af0a0 con 0x7f41f415ae50 2024-04-24T23:09:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41fb200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f41f40b2860 con 0x7f41f406e370 2024-04-24T23:09:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41fb200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41f406cbe0 con 0x7f41f40b3020 2024-04-24T23:09:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.774+0000 7f41f9400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41f406e370 0x7f41f40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41f406e370 0x7f41f40710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40600/0 (socket says 172.21.15.146:40600) 2024-04-24T23:09:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 -- 172.21.15.146:0/260318031 learned_addr learned my addr 172.21.15.146:0/260318031 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41fa800640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 -- 172.21.15.146:0/260318031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 msgr2=0x7f41f40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f40b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 -- 172.21.15.146:0/260318031 >> v1:172.21.15.203:6789/0 conn(0x7f41f415ae50 legacy=0x7f41f40709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41f9400640 1 -- 172.21.15.146:0/260318031 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f406cec0 con 0x7f41f406e370 2024-04-24T23:09:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.775+0000 7f41fa800640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.776+0000 7f41f9400640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f406e370 0x7f41f40710e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009870 tx=0x7f41e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b5bb39435a0a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.776+0000 7f41f8a00640 1 -- 172.21.15.146:0/260318031 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4037070 con 0x7f41f406e370 2024-04-24T23:09:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.776+0000 7f41f8a00640 1 -- 172.21.15.146:0/260318031 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e4032440 con 0x7f41f406e370 2024-04-24T23:09:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.776+0000 7f41f8a00640 1 -- 172.21.15.146:0/260318031 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4032810 con 0x7f41f406e370 2024-04-24T23:09:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 -- 172.21.15.146:0/260318031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f406e370 msgr2=0x7f41f40710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f406e370 0x7f41f40710e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009870 tx=0x7f41e402a210 comp rx=0 tx=0).stop 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 -- 172.21.15.146:0/260318031 shutdown_connections 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 --2- 172.21.15.146:0/260318031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f406e370 0x7f41f40710e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 -- 172.21.15.146:0/260318031 >> 172.21.15.146:0/260318031 conn(0x7f41f40b1560 msgr2=0x7f41f40b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 -- 172.21.15.146:0/260318031 shutdown_connections 2024-04-24T23:09:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.777+0000 7f41fb200640 1 -- 172.21.15.146:0/260318031 wait complete. 2024-04-24T23:09:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.779+0000 7f41fb200640 1 Processor -- start 2024-04-24T23:09:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.779+0000 7f41fb200640 1 -- start start 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41f406e370 0x7f41f415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f4146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40b3b70 con 0x7f41f415ae50 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40b39f0 con 0x7f41f406e370 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fb200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41f40b3cf0 con 0x7f41f40b3020 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40612/0 (socket says 172.21.15.146:40612) 2024-04-24T23:09:31.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fa800640 1 -- 172.21.15.146:0/2524841642 learned_addr learned my addr 172.21.15.146:0/2524841642 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41fa800640 1 -- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 msgr2=0x7f41f4146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.780+0000 7f41f9400640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f4146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fa800640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f4146dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41f9e00640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41f406e370 0x7f41f415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fa800640 1 -- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41f406e370 msgr2=0x7f41f415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fa800640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41f406e370 0x7f41f415cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fa800640 1 -- 172.21.15.146:0/2524841642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f415d610 con 0x7f41f415ae50 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fa800640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f41f000cf20 tx=0x7f41f000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41ee000640 1 -- 172.21.15.146:0/2524841642 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f001a070 con 0x7f41f415ae50 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41ee000640 1 -- 172.21.15.146:0/2524841642 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f000d840 con 0x7f41f415ae50 2024-04-24T23:09:31.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41ee000640 1 -- 172.21.15.146:0/2524841642 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f000dc30 con 0x7f41f415ae50 2024-04-24T23:09:31.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f415d8f0 con 0x7f41f415ae50 2024-04-24T23:09:31.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.781+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f414cd60 con 0x7f41f415ae50 2024-04-24T23:09:31.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.784+0000 7f41ee000640 1 -- 172.21.15.146:0/2524841642 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41f001d070 con 0x7f41f415ae50 2024-04-24T23:09:31.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.784+0000 7f41ee000640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.784+0000 7f41ee000640 1 -- 172.21.15.146:0/2524841642 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f41f008b810 con 0x7f41f415ae50 2024-04-24T23:09:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.785+0000 7f41f9e00640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.785+0000 7f41ff601740 1 Processor -- start 2024-04-24T23:09:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.785+0000 7f41ff601740 1 -- start start 2024-04-24T23:09:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41f9e00640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 0x7f41d806e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f41e800a750 tx=0x7f41e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 0x558f6a5d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558f6a48bed0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f6a4eedf0 con 0x558f6a58c400 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.786+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x558f6a4978d0 con 0x558f6a5b6720 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40620/0 (socket says 172.21.15.146:40620) 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 -- 172.21.15.146:0/1318250767 learned_addr learned my addr 172.21.15.146:0/1318250767 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9e00640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41fa800640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 0x558f6a5d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 -- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 msgr2=0x558f6a5b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 -- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 msgr2=0x558f6a5d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 0x558f6a5d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 -- 172.21.15.146:0/1318250767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f6a2032d0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41fa800640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 0x558f6a5d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:31.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.787+0000 7f41f9400640 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000c00 tx=0x7f41e402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd8b90e3358aa61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41e2600640 1 -- 172.21.15.146:0/1318250767 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4041070 con 0x558f6a5d3fc0 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41e2600640 1 -- 172.21.15.146:0/1318250767 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40326c0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41e2600640 1 -- 172.21.15.146:0/1318250767 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4037040 con 0x558f6a5d3fc0 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 -- 172.21.15.146:0/1318250767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 msgr2=0x558f6a5d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000c00 tx=0x7f41e402c000 comp rx=0 tx=0).stop 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 -- 172.21.15.146:0/1318250767 shutdown_connections 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a58c400 0x558f6a5d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d4510 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 --2- 172.21.15.146:0/1318250767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.788+0000 7f41ff601740 1 -- 172.21.15.146:0/1318250767 >> 172.21.15.146:0/1318250767 conn(0x558f6a588d30 msgr2=0x558f6a5d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.789+0000 7f41ff601740 1 -- 172.21.15.146:0/1318250767 shutdown_connections 2024-04-24T23:09:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.789+0000 7f41ff601740 1 -- 172.21.15.146:0/1318250767 wait complete. 2024-04-24T23:09:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.789+0000 7f41ff601740 1 -- start start 2024-04-24T23:09:31.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.789+0000 7f41ff601740 1 Processor -- start 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5c80a0 0x558f6a5b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558f6a4aad20 con 0x558f6a5b6720 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f6a4eadb0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x558f6a58d1a0 con 0x558f6a5c80a0 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.790+0000 7f41ff601740 10 client.0 _ll_register_callbacks cb 0x558f6a4e5f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40624/0 (socket says 172.21.15.146:40624) 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 -- 172.21.15.146:0/1757277136 learned_addr learned my addr 172.21.15.146:0/1757277136 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 -- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5c80a0 msgr2=0x558f6a5b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41fa800640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5c80a0 0x558f6a5b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5c80a0 0x558f6a5b98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 -- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 msgr2=0x558f6a5ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9400640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 -- 172.21.15.146:0/1757277136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f6a2cd6b0 con 0x558f6a5b6720 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.791+0000 7f41f9e00640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ce70 tx=0x7f41e8004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c75c980e02b9de9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8023020 con 0x558f6a5b6720 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f41e801f670 con 0x558f6a5b6720 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e40326c0 con 0x558f6a5b6720 2024-04-24T23:09:31.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f41e802d050 con 0x558f6a5b6720 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41ff601740 10 client.7536 fetch_fsmap learned FSMap version 74 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558f6a5b1f30 con 0x558f6a5b6720 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40326c0 con 0x558f6a5b6720 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f41e8030020 con 0x558f6a5b6720 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41ff601740 10 client.7536 fetch_fsmap finished waiting for FSMap version 74 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.792+0000 7f41ff601740 10 client.7536 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41ff601740 20 client.7536 populate_metadata read hostname 'smithi146' 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a5b7840 0x558f6a5b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41ff601740 4 client.7536 mds_command: new command op to 7374 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 --> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f6a4fc330 con 0x558f6a5b7840 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41f9400640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a5b7840 0x558f6a5b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41f9400640 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a5b7840 0x558f6a5b7c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e583393e7e612bf server_cookie=25ae84deb270edc4 in_seq=0 out_seq=0 2024-04-24T23:09:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.793+0000 7f41d6a00640 10 client.7536 ms_handle_connect on v2:172.21.15.146:6833/3967134794 2024-04-24T23:09:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.794+0000 7f41d6a00640 1 -- 172.21.15.146:0/1757277136 <== mds.0 v2:172.21.15.146:6833/3967134794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558f6a4fc330 con 0x558f6a5b7840 2024-04-24T23:09:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.794+0000 7f41d6a00640 10 client.7536 handle_command_reply: tid=0 2024-04-24T23:09:31.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.794+0000 7f41ff601740 1 client.7536 shutdown 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 msgr2=0x558f6a5c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ce70 tx=0x7f41e8004680 comp rx=0 tx=0).stop 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 shutdown_connections 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a5b7840 0x558f6a5b7c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5c80a0 0x558f6a5b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 --2- 172.21.15.146:0/1757277136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5b6720 0x558f6a5c9dc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 >> 172.21.15.146:0/1757277136 conn(0x558f6a58c400 msgr2=0x558f6a58b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41d6a00640 0 client.7536 ms_handle_reset on v2:172.21.15.146:6833/3967134794 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 shutdown_connections 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 1 -- 172.21.15.146:0/1757277136 wait complete. 2024-04-24T23:09:31.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.795+0000 7f41ff601740 20 client.7536 trim_cache size 0 max 16384 2024-04-24T23:09:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.815+0000 7f41ff601740 1 Processor -- start 2024-04-24T23:09:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.815+0000 7f41ff601740 1 -- start start 2024-04-24T23:09:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.815+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.815+0000 7f41ff601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.815+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41ff601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4167390 con 0x558f6a5c80a0 2024-04-24T23:09:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41f414b9c0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41f4166d40 con 0x558f6a5b6720 2024-04-24T23:09:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40634/0 (socket says 172.21.15.146:40634) 2024-04-24T23:09:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9400640 1 -- 172.21.15.146:0/2194802547 learned_addr learned my addr 172.21.15.146:0/2194802547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9e00640 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41fa800640 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9400640 1 -- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 msgr2=0x558f6a5b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.816+0000 7f41f9400640 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41f9400640 1 -- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 msgr2=0x558f6a5c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41f9400640 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41f9400640 1 -- 172.21.15.146:0/2194802547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f6a4f9950 con 0x558f6a5c80a0 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41f9400640 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f41e402a800 tx=0x7f41e4034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac579c9f267b60ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41e1c00640 1 -- 172.21.15.146:0/2194802547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4037040 con 0x558f6a5c80a0 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41e1c00640 1 -- 172.21.15.146:0/2194802547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40043c0 con 0x558f6a5c80a0 2024-04-24T23:09:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.817+0000 7f41e1c00640 1 -- 172.21.15.146:0/2194802547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4041040 con 0x558f6a5c80a0 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 -- 172.21.15.146:0/2194802547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 msgr2=0x558f6a5b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f41e402a800 tx=0x7f41e4034040 comp rx=0 tx=0).stop 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 -- 172.21.15.146:0/2194802547 shutdown_connections 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5d3fc0 0x558f6a5c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5c80a0 0x558f6a5b8fe0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 --2- 172.21.15.146:0/2194802547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 -- 172.21.15.146:0/2194802547 >> 172.21.15.146:0/2194802547 conn(0x558f6a58c400 msgr2=0x558f6a5d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 -- 172.21.15.146:0/2194802547 shutdown_connections 2024-04-24T23:09:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.818+0000 7f41ff601740 1 -- 172.21.15.146:0/2194802547 wait complete. 2024-04-24T23:09:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.819+0000 7f41ff601740 1 -- start start 2024-04-24T23:09:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.819+0000 7f41ff601740 1 Processor -- start 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5c80a0 0x558f6a5d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558f6a5b2590 con 0x558f6a5d3fc0 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f6a5b2860 con 0x558f6a5c80a0 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x558f6a5e9780 con 0x558f6a5b6720 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41ff601740 10 client.0 _ll_register_callbacks cb 0x7f41e800c520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40642/0 (socket says 172.21.15.146:40642) 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 -- 172.21.15.146:0/3035679860 learned_addr learned my addr 172.21.15.146:0/3035679860 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 -- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 msgr2=0x558f6a5b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 -- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5c80a0 msgr2=0x558f6a5d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5c80a0 0x558f6a5d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.820+0000 7f41fa800640 1 -- 172.21.15.146:0/3035679860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f6a5b93e0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41fa800640 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f41f0089c40 tx=0x7f41f005dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2cf9ae88e61c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f00602b0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f41f0062110 con 0x558f6a5d3fc0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e40043c0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f41f0062310 con 0x558f6a5d3fc0 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 10 client.7542 fetch_fsmap learned FSMap version 74 2024-04-24T23:09:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558f6a5d12b0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40043c0 con 0x558f6a5d3fc0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f41f0058e10 con 0x558f6a5d3fc0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 10 client.7542 fetch_fsmap finished waiting for FSMap version 74 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 10 client.7542 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 20 client.7542 populate_metadata read hostname 'smithi146' 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.821+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a64e670 0x558f6a64ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.822+0000 7f41ff601740 4 client.7542 mds_command: new command op to 7374 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.822+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 --> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] -- command(tid 0: {"prefix": "status"}) -- 0x558f6a5cb970 con 0x558f6a64e670 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.822+0000 7f41f9e00640 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a64e670 0x558f6a64ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.822+0000 7f41d6a00640 10 client.7542 ms_handle_connect on v2:172.21.15.146:6833/3967134794 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.822+0000 7f41f9e00640 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a64e670 0x558f6a64ea50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6d4930700b2d3ef server_cookie=5a72417c9c8b4882 in_seq=0 out_seq=0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41d6a00640 1 -- 172.21.15.146:0/3035679860 <== mds.0 v2:172.21.15.146:6833/3967134794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558f6a5cb970 con 0x558f6a64e670 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41d6a00640 10 client.7542 handle_command_reply: tid=0 2024-04-24T23:09:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 client.7542 shutdown 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 msgr2=0x558f6a5d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f41f0089c40 tx=0x7f41f005dd70 comp rx=0 tx=0).stop 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 shutdown_connections 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:6833/3967134794,v1:172.21.15.146:6835/3967134794] conn(0x558f6a64e670 0x558f6a64ea50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558f6a5d3fc0 0x558f6a5d0d70 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f6a5c80a0 0x558f6a5d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 --2- 172.21.15.146:0/3035679860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x558f6a5b6720 0x558f6a5b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41d6a00640 0 client.7542 ms_handle_reset on v2:172.21.15.146:6833/3967134794 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 >> 172.21.15.146:0/3035679860 conn(0x558f6a58c400 msgr2=0x558f6a581d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 shutdown_connections 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 1 -- 172.21.15.146:0/3035679860 wait complete. 2024-04-24T23:09:31.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.823+0000 7f41ff601740 20 client.7542 trim_cache size 0 max 16384 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7374, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 6.6267958010000001, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 74, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 84, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 84, 2024-04-24T23:09:31.829 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 12.106794729000001 2024-04-24T23:09:31.830 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:31.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 msgr2=0x7f41d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 0x7f41d806e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f41e800a750 tx=0x7f41e8008040 comp rx=0 tx=0).stop 2024-04-24T23:09:31.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 msgr2=0x7f41f41527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f41f000cf20 tx=0x7f41f000a7d0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 shutdown_connections 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f415ae50 0x7f41f41527e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f41d806be30 0x7f41d806e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41f40b3020 0x7f41f4146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 --2- 172.21.15.146:0/2524841642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41f406e370 0x7f41f415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 >> 172.21.15.146:0/2524841642 conn(0x7f41f40b1560 msgr2=0x7f41f40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 shutdown_connections 2024-04-24T23:09:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:31.824+0000 7f41fb200640 1 -- 172.21.15.146:0/2524841642 wait complete. 2024-04-24T23:09:31.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:09:32.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.023+0000 7f48bb200640 1 Processor -- start 2024-04-24T23:09:32.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.023+0000 7f48bb200640 1 -- start start 2024-04-24T23:09:32.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.025+0000 7f48bb200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f48bc1561c0 0x7f48bc0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.025+0000 7f48bb200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc070f90 con 0x7f48bc0d0240 2024-04-24T23:09:32.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.025+0000 7f48bb200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc071270 con 0x7f48bc0709d0 2024-04-24T23:09:32.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.025+0000 7f48bb200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f48bc0b4310 con 0x7f48bc1561c0 2024-04-24T23:09:32.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.025+0000 7f48ba800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48bc0d0240 0x7f48bc0b2c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42984/0 (socket says 172.21.15.146:42984) 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48ba800640 1 -- 172.21.15.146:0/1100112276 learned_addr learned my addr 172.21.15.146:0/1100112276 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197225668 0 0) 0x7f48bc070f90 con 0x7f48bc0d0240 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a0003520 con 0x7f48bc0d0240 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9e00640 1 --2- 172.21.15.146:0/1100112276 >> v2:172.21.15.203:3300/0 conn(0x7f48bc1561c0 0x7f48bc0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2375024333 0 0) 0x7f48a0003520 con 0x7f48bc0d0240 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 >> v2:172.21.15.203:3300/0 conn(0x7f48bc1561c0 msgr2=0x7f48bc0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 --2- 172.21.15.146:0/1100112276 >> v2:172.21.15.203:3300/0 conn(0x7f48bc1561c0 0x7f48bc0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 >> v1:172.21.15.203:6789/0 conn(0x7f48bc0709d0 legacy=0x7f48bc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc071550 con 0x7f48bc0d0240 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f48b40019f0 con 0x7f48bc0d0240 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.026+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 >> v1:172.21.15.146:6789/0 conn(0x7f48bc0d0240 legacy=0x7f48bc0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 0x7f48a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48a0004800 0x7f48a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a00053c0 0x7f48a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0b4310 con 0x7f48a0003a00 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48a000c2a0 con 0x7f48a00053c0 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f48a000c4a0 con 0x7f48a0004800 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 0x7f48a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b1400640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48a0004800 0x7f48a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 -- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48a0004800 msgr2=0x7f48a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48a0004800 0x7f48a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 -- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a00053c0 msgr2=0x7f48a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48ba800640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a00053c0 0x7f48a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a00053c0 0x7f48a000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b9e00640 1 -- 172.21.15.146:0/1100112276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a0003520 con 0x7f48a0003a00 2024-04-24T23:09:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48ba800640 1 -- 172.21.15.146:0/1100112276 reap_dead start 2024-04-24T23:09:32.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.027+0000 7f48b1400640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48a0004800 0x7f48a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:32.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.028+0000 7f48b9e00640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 0x7f48a0003e20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00ba10 tx=0x7f48a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fd150ccaf0d18f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac030070 con 0x7f48a0003a00 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac02add0 con 0x7f48a0003a00 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48b9400640 1 -- 172.21.15.146:0/1100112276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00b5e0 con 0x7f48a0003a00 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 -- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 msgr2=0x7f48a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 0x7f48a0003e20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00ba10 tx=0x7f48a0005830 comp rx=0 tx=0).stop 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 -- 172.21.15.146:0/1100112276 shutdown_connections 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 --2- 172.21.15.146:0/1100112276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0003a00 0x7f48a0003e20 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 -- 172.21.15.146:0/1100112276 >> 172.21.15.146:0/1100112276 conn(0x7f48bc06b320 msgr2=0x7f48bc06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 -- 172.21.15.146:0/1100112276 shutdown_connections 2024-04-24T23:09:32.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.029+0000 7f48bb200640 1 -- 172.21.15.146:0/1100112276 wait complete. 2024-04-24T23:09:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.031+0000 7f48bb200640 1 Processor -- start 2024-04-24T23:09:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.031+0000 7f48bb200640 1 -- start start 2024-04-24T23:09:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a0003a00 0x7f48bc0a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 0x7f48bc149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0cdbf0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0cdd70 con 0x7f48a0003a00 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48bb200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc0cdef0 con 0x7f48bc157c30 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.032+0000 7f48ba800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40658/0 (socket says 172.21.15.146:40658) 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 -- 172.21.15.146:0/529313226 learned_addr learned my addr 172.21.15.146:0/529313226 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b1400640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 0x7f48bc149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 -- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 msgr2=0x7f48bc149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b9e00640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a0003a00 0x7f48bc0a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 0x7f48bc149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 -- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a0003a00 msgr2=0x7f48bc0a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a0003a00 0x7f48bc0a9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 -- 172.21.15.146:0/529313226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1580b0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b1400640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 0x7f48bc149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48ba800640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0cf8a0 tx=0x7f48b400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bb00 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b400bcc0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4007350 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.033+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc158330 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.034+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1588f0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.035+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48bc04f500 con 0x7f48bc0abbd0 2024-04-24T23:09:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.036+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48b401b020 con 0x7f48bc0abbd0 2024-04-24T23:09:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.036+0000 7f48b2a00640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 0x7f489806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.037+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f48b408b150 con 0x7f48bc0abbd0 2024-04-24T23:09:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.037+0000 7f48b9e00640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 0x7f489806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.038+0000 7f48b9e00640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 0x7f489806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b9e0 tx=0x7f48ac030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.041+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f48bc1580b0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.283+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f48bc0683a0 con 0x7f48bc0abbd0 2024-04-24T23:09:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.284+0000 7f48b2a00640 1 -- 172.21.15.146:0/529313226 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7f48b4059a00 con 0x7f48bc0abbd0 2024-04-24T23:09:32.286 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:09:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 msgr2=0x7f489806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 0x7f489806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b9e0 tx=0x7f48ac030000 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 msgr2=0x7f48bc0ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0cf8a0 tx=0x7f48b400b0d0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 shutdown_connections 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48bc0abbd0 0x7f48bc0ac030 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f489806be30 0x7f489806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f48bc157c30 0x7f48bc149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 --2- 172.21.15.146:0/529313226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48a0003a00 0x7f48bc0a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 >> 172.21.15.146:0/529313226 conn(0x7f48bc06b320 msgr2=0x7f48bc0af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.286+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 shutdown_connections 2024-04-24T23:09:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32.287+0000 7f48bb200640 1 -- 172.21.15.146:0/529313226 wait complete. 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:09:32.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:09:32.309 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:32.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.309 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:09:32.354 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:32.355 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42063sec preferred_lft 42063sec 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:09:32.356 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:09:32.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:09:32.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.358 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:09:32.474 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:09:32.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.479 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:09:32.530 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:09:32.530 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:09:32.530 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:09:32.530 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:09:32.530 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:09:32.531 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:09:32.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:09:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:09:32.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.742 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:09:32.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:09:32.788 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:09:32.789 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:32.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:09:32.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:09:32.864 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:32.914 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:09:32.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:09:32.915 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:32.967 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:09:32.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:32.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:33.096 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:33.096 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:09:33.127 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:09:33.127 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:09:33.127 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:09:33.128 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:09:33.128 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:09:33.129 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:09:33.129 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:09:33.129 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:09:33.129 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:09:33.129 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:09:33.133 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:09:33.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:33.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:33.204 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:09:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:09:33.322 INFO:teuthology.orchestra.run.smithi146.stdout:client5390 2024-04-24T23:09:33.322 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:33.322 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:33.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:33.370 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch foo) 2024-04-24T23:09:33.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:33.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.675+0000 7fa1db000640 1 Processor -- start 2024-04-24T23:09:33.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.675+0000 7fa1db000640 1 -- start start 2024-04-24T23:09:33.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.676+0000 7fa1db000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa1d4072920 0x7fa1d40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.676+0000 7fa1db000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d40d0070 0x7fa1d40b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1db000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d415e1b0 con 0x7fa1d415ddd0 2024-04-24T23:09:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1db000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d40d04d0 con 0x7fa1d40d0070 2024-04-24T23:09:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1db000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d40713b0 con 0x7fa1d4072920 2024-04-24T23:09:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1d9c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa1d415ddd0 0x7fa1d4070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42996/0 (socket says 172.21.15.146:42996) 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1d9c00640 1 -- 172.21.15.146:0/1505496363 learned_addr learned my addr 172.21.15.146:0/1505496363 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1da600640 1 --2- 172.21.15.146:0/1505496363 >> v2:172.21.15.146:3300/0 conn(0x7fa1d40d0070 0x7fa1d40b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1d9200640 1 --2- 172.21.15.146:0/1505496363 >> v2:172.21.15.203:3300/0 conn(0x7fa1d4072920 0x7fa1d40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1da600640 1 -- 172.21.15.146:0/1505496363 >> v2:172.21.15.203:3300/0 conn(0x7fa1d4072920 msgr2=0x7fa1d40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1da600640 1 --2- 172.21.15.146:0/1505496363 >> v2:172.21.15.203:3300/0 conn(0x7fa1d4072920 0x7fa1d40cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1da600640 1 -- 172.21.15.146:0/1505496363 >> v1:172.21.15.146:6789/0 conn(0x7fa1d415ddd0 legacy=0x7fa1d4070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.677+0000 7fa1da600640 1 -- 172.21.15.146:0/1505496363 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d4071690 con 0x7fa1d40d0070 2024-04-24T23:09:33.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.678+0000 7fa1da600640 1 --2- 172.21.15.146:0/1505496363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d40b2c00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4074fb0 tx=0x7fa1cc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb9dfd9ab48049b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:33.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1d3e00640 1 -- 172.21.15.146:0/1505496363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc007740 con 0x7fa1d40d0070 2024-04-24T23:09:33.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1d3e00640 1 -- 172.21.15.146:0/1505496363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0078e0 con 0x7fa1d40d0070 2024-04-24T23:09:33.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1d3e00640 1 -- 172.21.15.146:0/1505496363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc007cb0 con 0x7fa1d40d0070 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 -- 172.21.15.146:0/1505496363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 msgr2=0x7fa1d40b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 --2- 172.21.15.146:0/1505496363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d40b2c00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4074fb0 tx=0x7fa1cc02a680 comp rx=0 tx=0).stop 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 -- 172.21.15.146:0/1505496363 shutdown_connections 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 --2- 172.21.15.146:0/1505496363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d40b2c00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 --2- 172.21.15.146:0/1505496363 >> v2:172.21.15.203:3300/0 conn(0x7fa1d4072920 0x7fa1d40cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.679+0000 7fa1db000640 1 -- 172.21.15.146:0/1505496363 >> 172.21.15.146:0/1505496363 conn(0x7fa1d406b320 msgr2=0x7fa1d406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.680+0000 7fa1db000640 1 -- 172.21.15.146:0/1505496363 shutdown_connections 2024-04-24T23:09:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.680+0000 7fa1db000640 1 -- 172.21.15.146:0/1505496363 wait complete. 2024-04-24T23:09:33.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.681+0000 7fa1db000640 1 Processor -- start 2024-04-24T23:09:33.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.682+0000 7fa1db000640 1 -- start start 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 0x7fa1d41f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1d415ddd0 0x7fa1d415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d40b3140 con 0x7fa1d40d0070 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4071c50 con 0x7fa1d4072920 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1db000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d40b32c0 con 0x7fa1d415ddd0 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40686/0 (socket says 172.21.15.146:40686) 2024-04-24T23:09:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 -- 172.21.15.146:0/1872632547 learned_addr learned my addr 172.21.15.146:0/1872632547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9c00640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 0x7fa1d41f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1da600640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1d415ddd0 0x7fa1d415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 -- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1d415ddd0 msgr2=0x7fa1d415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1d415ddd0 0x7fa1d415abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 -- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 msgr2=0x7fa1d41f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 0x7fa1d41f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9200640 1 -- 172.21.15.146:0/1872632547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d41f72f0 con 0x7fa1d40d0070 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.683+0000 7fa1d9c00640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 0x7fa1d41f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1d9200640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000d800 tx=0x7fa1c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000b6c0 con 0x7fa1d40d0070 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c0019070 con 0x7fa1d40d0070 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d41f75d0 con 0x7fa1d40d0070 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000ba80 con 0x7fa1d40d0070 2024-04-24T23:09:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.684+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d41f7b90 con 0x7fa1d40d0070 2024-04-24T23:09:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.685+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d404f500 con 0x7fa1d40d0070 2024-04-24T23:09:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.686+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1c000bc20 con 0x7fa1d40d0070 2024-04-24T23:09:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.687+0000 7fa1d1600640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 0x7fa1b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.687+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7fa1c008b4c0 con 0x7fa1d40d0070 2024-04-24T23:09:33.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.688+0000 7fa1d9c00640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 0x7fa1b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:33.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.689+0000 7fa1d9c00640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 0x7fa1b406e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:33.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.691+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa1c0059ce0 con 0x7fa1d40d0070 2024-04-24T23:09:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.929+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d4159390 con 0x7fa1d40d0070 2024-04-24T23:09:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.931+0000 7fa1d1600640 1 -- 172.21.15.146:0/1872632547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7fa1c00595e0 con 0x7fa1d40d0070 2024-04-24T23:09:33.933 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:33.933 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.933+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 msgr2=0x7fa1b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.933+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 0x7fa1b406e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c8009040 comp rx=0 tx=0).stop 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.933+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 msgr2=0x7fa1d4158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.933+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000d800 tx=0x7fa1c000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 shutdown_connections 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fa1b406be30 0x7fa1b406e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa1d415ddd0 0x7fa1d415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d40d0070 0x7fa1d4158e50 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 --2- 172.21.15.146:0/1872632547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1d4072920 0x7fa1d41f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 >> 172.21.15.146:0/1872632547 conn(0x7fa1d406b320 msgr2=0x7fa1d40ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 shutdown_connections 2024-04-24T23:09:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:33.934+0000 7fa1db000640 1 -- 172.21.15.146:0/1872632547 wait complete. 2024-04-24T23:09:33.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-24T23:09:34.191 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-04-24T23:09:34.192 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-24T23:09:34.192 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-04-24T23:09:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.281+0000 7f5012223280 1 -- start start 2024-04-24T23:09:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.281+0000 7f5012223280 1 Processor -- start 2024-04-24T23:09:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448dc04c00 0x56448dc70580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448dc05800 0x56448dc70b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56448e9da180 con 0x56448dc05c00 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56448e9da300 con 0x56448dc05800 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.282+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56448e9da480 con 0x56448dc04c00 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40708/0 (socket says 172.21.15.146:40708) 2024-04-24T23:09:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 -- 172.21.15.146:0/2258858316 learned_addr learned my addr 172.21.15.146:0/2258858316 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010200640 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448dc04c00 0x56448dc70580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f500f800640 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448dc05800 0x56448dc70b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 -- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448dc04c00 msgr2=0x56448dc70580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448dc04c00 0x56448dc70580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 -- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448dc05800 msgr2=0x56448dc70b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448dc05800 0x56448dc70b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 -- 172.21.15.146:0/2258858316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56448dc38780 con 0x56448dc05c00 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.283+0000 7f5010c00640 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x56448ea25140 tx=0x56448e9969c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9131d76979a5a179 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f500d000640 1 -- 172.21.15.146:0/2258858316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a9c0 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f500d000640 1 -- 172.21.15.146:0/2258858316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56448dc30700 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56448dc394a0 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56448dc38000 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 4 waiting for MDS map... 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f500d000640 1 -- 172.21.15.146:0/2258858316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a680 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f500d000640 1 -- 172.21.15.146:0/2258858316 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x56448ead4200 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f500d000640 1 -- 172.21.15.146:0/2258858316 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x56448dc5f180 con 0x56448dc05c00 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 4 Got MDS map 74 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 10 main: main 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.284+0000 7f5012223280 4 main: connecting to RADOS... 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.285+0000 7f5012223280 1 Processor -- start 2024-04-24T23:09:34.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.285+0000 7f5012223280 1 -- start start 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22000 0x56448dc71600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22400 0x56448dc71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56448e9da600 con 0x56448eb22800 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56448e9da780 con 0x56448eb22400 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56448e9da900 con 0x56448eb22000 2024-04-24T23:09:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f500f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f500f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40716/0 (socket says 172.21.15.146:40716) 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.286+0000 7f500f800640 1 -- 172.21.15.146:0/2358059362 learned_addr learned my addr 172.21.15.146:0/2358059362 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 -- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22000 msgr2=0x56448dc71600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22000 0x56448dc71600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 -- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22400 msgr2=0x56448dc71b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22400 0x56448dc71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 -- 172.21.15.146:0/2358059362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56448dc383c0 con 0x56448eb22800 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500f800640 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x56448ea254d0 tx=0x56448eadac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7637e8bcc87b64e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500a800640 1 -- 172.21.15.146:0/2358059362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a9c0 con 0x56448eb22800 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500a800640 1 -- 172.21.15.146:0/2358059362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56448dc30fc0 con 0x56448eb22800 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.287+0000 7f500a800640 1 -- 172.21.15.146:0/2358059362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a680 con 0x56448eb22800 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 -- 172.21.15.146:0/2358059362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 msgr2=0x56448dc72100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x56448ea254d0 tx=0x56448eadac00 comp rx=0 tx=0).stop 2024-04-24T23:09:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 -- 172.21.15.146:0/2358059362 shutdown_connections 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72100 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22400 0x56448dc71b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 --2- 172.21.15.146:0/2358059362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22000 0x56448dc71600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 -- 172.21.15.146:0/2358059362 >> 172.21.15.146:0/2358059362 conn(0x56448e9e7c00 msgr2=0x56448e983000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 -- 172.21.15.146:0/2358059362 shutdown_connections 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 -- 172.21.15.146:0/2358059362 wait complete. 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.288+0000 7f5012223280 1 Processor -- start 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 -- start start 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22000 0x56448dc73180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22400 0x56448dc72c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56448e9db980 con 0x56448eb22800 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56448e9da300 con 0x56448eb22000 2024-04-24T23:09:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.289+0000 7f5012223280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56448e9dac00 con 0x56448eb22400 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40726/0 (socket says 172.21.15.146:40726) 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 -- 172.21.15.146:0/3676939810 learned_addr learned my addr 172.21.15.146:0/3676939810 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 -- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22400 msgr2=0x56448dc72c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448eb22400 0x56448dc72c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 -- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22000 msgr2=0x56448dc73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448eb22000 0x56448dc73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 -- 172.21.15.146:0/3676939810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56448dc38960 con 0x56448eb22800 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.290+0000 7f500f800640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72680 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x56448ead9350 tx=0x56448e996720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5008a00640 1 -- 172.21.15.146:0/3676939810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a4e0 con 0x56448eb22800 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5008a00640 1 -- 172.21.15.146:0/3676939810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56448dc30e00 con 0x56448eb22800 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56448dc39680 con 0x56448eb22800 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5008a00640 1 -- 172.21.15.146:0/3676939810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56448dc2a9c0 con 0x56448eb22800 2024-04-24T23:09:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56448dc39860 con 0x56448eb22800 2024-04-24T23:09:34.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.291+0000 7f5012223280 4 main: resolving pool 11 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.292+0000 7f5008a00640 1 -- 172.21.15.146:0/3676939810 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56448eb3ac00 con 0x56448eb22800 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.293+0000 7f5008a00640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56448df64000 0x56448dc73700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.293+0000 7f5008a00640 1 -- 172.21.15.146:0/3676939810 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x56448eb38a00 con 0x56448eb22800 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.293+0000 7f5012223280 4 main: creating IoCtx.. 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.293+0000 7f5012223280 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56448eb22c00 0x56448dc72100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.293+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x56448eb23000 con 0x56448eb22c00 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.294+0000 7f500f800640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56448eb22c00 0x56448dc72100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.294+0000 7f5010200640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56448df64000 0x56448dc73700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.294+0000 7f500f800640 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56448eb22c00 0x56448dc72100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.294+0000 7f500f800640 1 -- 172.21.15.146:0/3676939810 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x56448e986000 con 0x56448eb22c00 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 2, 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511628777, 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511626775 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.299 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511628777, 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511626775 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.300 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.301 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56448eb22c00 msgr2=0x56448dc72100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56448eb22c00 0x56448dc72100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56448df64000 msgr2=0x56448dc73700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56448df64000 0x56448dc73700 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x56448e98e690 tx=0x56448def8e40 comp rx=0 tx=0).stop 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 msgr2=0x56448dc72680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/3676939810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448eb22800 0x56448dc72680 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x56448ead9350 tx=0x56448e996720 comp rx=0 tx=0).stop 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5010200640 1 -- 172.21.15.146:0/3676939810 reap_dead start 2024-04-24T23:09:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 shutdown_connections 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 >> 172.21.15.146:0/3676939810 conn(0x56448e9e7c00 msgr2=0x56448e983000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 shutdown_connections 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/3676939810 wait complete. 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 msgr2=0x56448dc71080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x56448ea25140 tx=0x56448e9969c0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 shutdown_connections 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56448dc05c00 0x56448dc71080 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56448dc05800 0x56448dc70b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 --2- 172.21.15.146:0/2258858316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56448dc04c00 0x56448dc70580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.295+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 >> 172.21.15.146:0/2258858316 conn(0x56448dc05000 msgr2=0x56448e982800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.296+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 shutdown_connections 2024-04-24T23:09:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.296+0000 7f5012223280 1 -- 172.21.15.146:0/2258858316 wait complete. 2024-04-24T23:09:34.305 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.112752, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-04-24T23:09:34.305 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-04-24T23:09:34.305 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-04-24T23:09:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.381+0000 7f63c5a0e280 1 -- start start 2024-04-24T23:09:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.381+0000 7f63c5a0e280 1 Processor -- start 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a55fa8c00 0x564a56014580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a55fa9c00 0x564a56015080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564a56e5a180 con 0x564a55fa9800 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a56e5a300 con 0x564a55fa8c00 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564a56e5a480 con 0x564a55fa9c00 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40754/0 (socket says 172.21.15.146:40754) 2024-04-24T23:09:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 -- 172.21.15.146:0/777638413 learned_addr learned my addr 172.21.15.146:0/777638413 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 -- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a55fa9c00 msgr2=0x564a56015080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c3800640 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a55fa9c00 0x564a56015080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2e00640 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a55fa8c00 0x564a56014580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a55fa9c00 0x564a56015080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 -- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a55fa8c00 msgr2=0x564a56014580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a55fa8c00 0x564a56014580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.382+0000 7f63c2400640 1 -- 172.21.15.146:0/777638413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a55fdc780 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63c2400640 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x564a56dc5200 tx=0x564a56d3c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f16edd5f8570c77 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63bfc00640 1 -- 172.21.15.146:0/777638413 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fce680 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63bfc00640 1 -- 172.21.15.146:0/777638413 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564a55fd4a80 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63bfc00640 1 -- 172.21.15.146:0/777638413 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fceb60 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a55fdd4a0 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564a55fdc000 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63c5a0e280 4 waiting for MDS map... 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.383+0000 7f63bfc00640 1 -- 172.21.15.146:0/777638413 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x564a56e6c600 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.384+0000 7f63bfc00640 1 -- 172.21.15.146:0/777638413 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x564a56003180 con 0x564a55fa9800 2024-04-24T23:09:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.384+0000 7f63c5a0e280 4 Got MDS map 74 2024-04-24T23:09:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.384+0000 7f63c5a0e280 10 main: main 2024-04-24T23:09:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.384+0000 7f63c5a0e280 4 main: connecting to RADOS... 2024-04-24T23:09:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.384+0000 7f63c5a0e280 1 Processor -- start 2024-04-24T23:09:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 -- start start 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f800 0x564a56015b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564a56e5a600 con 0x564a56e6f400 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a56e5a780 con 0x564a56e6fc00 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.385+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564a56e5a900 con 0x564a56e6f800 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40760/0 (socket says 172.21.15.146:40760) 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 -- 172.21.15.146:0/203771879 learned_addr learned my addr 172.21.15.146:0/203771879 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 -- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f800 msgr2=0x564a56015b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c2e00640 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f800 0x564a56015b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f800 0x564a56015b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 -- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 msgr2=0x564a56016100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 -- 172.21.15.146:0/203771879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a55fdc3c0 con 0x564a56e6f400 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63c3800640 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x564a56edc030 tx=0x564a56d3a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52922790a8828ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63bd400640 1 -- 172.21.15.146:0/203771879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fce9c0 con 0x564a56e6f400 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63bd400640 1 -- 172.21.15.146:0/203771879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564a55fd4fc0 con 0x564a56e6f400 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.386+0000 7f63bd400640 1 -- 172.21.15.146:0/203771879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fce680 con 0x564a56e6f400 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 -- 172.21.15.146:0/203771879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 msgr2=0x564a56015600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x564a56edc030 tx=0x564a56d3a780 comp rx=0 tx=0).stop 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 -- 172.21.15.146:0/203771879 shutdown_connections 2024-04-24T23:09:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f800 0x564a56015b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/203771879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f400 0x564a56015600 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 -- 172.21.15.146:0/203771879 >> 172.21.15.146:0/203771879 conn(0x564a56e6f000 msgr2=0x564a56d27000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 -- 172.21.15.146:0/203771879 shutdown_connections 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.387+0000 7f63c5a0e280 1 -- 172.21.15.146:0/203771879 wait complete. 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.388+0000 7f63c5a0e280 1 Processor -- start 2024-04-24T23:09:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.388+0000 7f63c5a0e280 1 -- start start 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f400 0x564a56017180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 0x564a56016c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564a5600a180 con 0x564a56e6f800 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a56e5be00 con 0x564a56e6fc00 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c5a0e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564a56e5ad80 con 0x564a56e6f400 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 0x564a56016c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 0x564a56016c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40768/0 (socket says 172.21.15.146:40768) 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 -- 172.21.15.146:0/3671004000 learned_addr learned my addr 172.21.15.146:0/3671004000 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c3800640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f400 0x564a56017180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2400640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 -- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f400 msgr2=0x564a56017180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f400 0x564a56017180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 -- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 msgr2=0x564a56016680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a56e6fc00 0x564a56016680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c2e00640 1 -- 172.21.15.146:0/3671004000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a55fdc780 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.389+0000 7f63c3800640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a56e6f400 0x564a56017180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63c2e00640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 0x564a56016c00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x564a56edd440 tx=0x564a56e8b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63bb600640 1 -- 172.21.15.146:0/3671004000 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fce9c0 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63bb600640 1 -- 172.21.15.146:0/3671004000 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564a55fd4c40 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63bb600640 1 -- 172.21.15.146:0/3671004000 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a55fce680 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a55fdd4a0 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a55fdc960 con 0x564a56e6f800 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.390+0000 7f63c5a0e280 4 main: resolving pool 11 2024-04-24T23:09:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63bb600640 1 -- 172.21.15.146:0/3671004000 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564a56edec00 con 0x564a56e6f800 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63bb600640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564a56eeac00 0x564a56017700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63bb600640 1 -- 172.21.15.146:0/3671004000 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x564a56eec800 con 0x564a56e6f800 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63c5a0e280 4 main: creating IoCtx.. 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564a56eeb000 0x564a56016100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.392+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x564a56eeb400 con 0x564a56eeb000 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.393+0000 7f63c3800640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564a56eeac00 0x564a56017700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.393+0000 7f63c2400640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564a56eeb000 0x564a56016100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.394+0000 7f63c2400640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564a56eeb000 0x564a56016100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.395+0000 7f63c3800640 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564a56eeac00 0x564a56017700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x564a56edc030 tx=0x564a56d3c1e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.395+0000 7f63c2400640 1 -- 172.21.15.146:0/3671004000 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x564a56d2a000 con 0x564a56eeb000 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "snapserver": { 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "last_snap": 1, 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "last_created": 1, 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "last_destroyed": 1, 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_noop": [], 2024-04-24T23:09:34.398 INFO:teuthology.orchestra.run.smithi146.stdout: "snaps": [], 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "need_to_purge": {}, 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_update": [], 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_destroy": [] 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.399 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564a56eeb000 msgr2=0x564a56016100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564a56eeb000 0x564a56016100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564a56eeac00 msgr2=0x564a56017700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564a56eeac00 0x564a56017700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x564a56edc030 tx=0x564a56d3c1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 msgr2=0x564a56016c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/3671004000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a56e6f800 0x564a56016c00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x564a56edd440 tx=0x564a56e8b800 comp rx=0 tx=0).stop 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c2e00640 1 -- 172.21.15.146:0/3671004000 reap_dead start 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 shutdown_connections 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 >> 172.21.15.146:0/3671004000 conn(0x564a56e6f000 msgr2=0x564a56d27000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 shutdown_connections 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/3671004000 wait complete. 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 msgr2=0x564a56014b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x564a56dc5200 tx=0x564a56d3c180 comp rx=0 tx=0).stop 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 shutdown_connections 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564a55fa9c00 0x564a56015080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564a55fa9800 0x564a56014b00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 --2- 172.21.15.146:0/777638413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a55fa8c00 0x564a56014580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.396+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 >> 172.21.15.146:0/777638413 conn(0x564a55fa9000 msgr2=0x564a56d26800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.397+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 shutdown_connections 2024-04-24T23:09:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.397+0000 7f63c5a0e280 1 -- 172.21.15.146:0/777638413 wait complete. 2024-04-24T23:09:34.404 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.098984, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:34.404 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:34.404 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-04-24T23:09:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.487+0000 7f1c2367a280 1 -- start start 2024-04-24T23:09:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.487+0000 7f1c2367a280 1 Processor -- start 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.488+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e96ce400 0x5570e8971600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.488+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 0x5570e8971b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c2367a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c0000 con 0x5570e96cfc00 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c0180 con 0x5570e9704000 2024-04-24T23:09:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5570e97c0300 con 0x5570e96ce400 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40792/0 (socket says 172.21.15.146:40792) 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 -- 172.21.15.146:0/269688151 learned_addr learned my addr 172.21.15.146:0/269688151 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c21800640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e96ce400 0x5570e8971600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c22200640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 0x5570e8971b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 -- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e96ce400 msgr2=0x5570e8971600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e96ce400 0x5570e8971600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 -- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 msgr2=0x5570e8971b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 0x5570e8971b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c20e00640 1 -- 172.21.15.146:0/269688151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e8938780 con 0x5570e96cfc00 2024-04-24T23:09:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.489+0000 7f1c22200640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 0x5570e8971b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c20e00640 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x5570e9735260 tx=0x5570e96968a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb432590fda5e2c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c1e600640 1 -- 172.21.15.146:0/269688151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a9c0 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c1e600640 1 -- 172.21.15.146:0/269688151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5570e8930e00 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e89394a0 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5570e8938960 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c2367a280 4 waiting for MDS map... 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c1e600640 1 -- 172.21.15.146:0/269688151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a680 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c1e600640 1 -- 172.21.15.146:0/269688151 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x5570e97ce200 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c1e600640 1 -- 172.21.15.146:0/269688151 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x5570e895f180 con 0x5570e96cfc00 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.490+0000 7f1c2367a280 4 Got MDS map 74 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.491+0000 7f1c2367a280 10 main: main 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.491+0000 7f1c2367a280 4 main: connecting to RADOS... 2024-04-24T23:09:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.491+0000 7f1c2367a280 1 Processor -- start 2024-04-24T23:09:34.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.491+0000 7f1c2367a280 1 -- start start 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9704c00 0x5570e8972100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9705000 0x5570e8972680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c0480 con 0x5570e9704800 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c0600 con 0x5570e9705000 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5570e97c0780 con 0x5570e9704c00 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c22200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c22200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40798/0 (socket says 172.21.15.146:40798) 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.492+0000 7f1c22200640 1 -- 172.21.15.146:0/1015614704 learned_addr learned my addr 172.21.15.146:0/1015614704 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 -- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9704c00 msgr2=0x5570e8972100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9704c00 0x5570e8972100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 -- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9705000 msgr2=0x5570e8972680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9705000 0x5570e8972680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 -- 172.21.15.146:0/1015614704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e89383c0 con 0x5570e9704800 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c22200640 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5570e97ee390 tx=0x5570e97f0cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd581c68720512d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c1be00640 1 -- 172.21.15.146:0/1015614704 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a9c0 con 0x5570e9704800 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c1be00640 1 -- 172.21.15.146:0/1015614704 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5570e8930700 con 0x5570e9704800 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.493+0000 7f1c1be00640 1 -- 172.21.15.146:0/1015614704 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a680 con 0x5570e9704800 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 -- 172.21.15.146:0/1015614704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 msgr2=0x5570e8970580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5570e97ee390 tx=0x5570e97f0cc0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 -- 172.21.15.146:0/1015614704 shutdown_connections 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9705000 0x5570e8972680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9704c00 0x5570e8972100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 --2- 172.21.15.146:0/1015614704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704800 0x5570e8970580 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 -- 172.21.15.146:0/1015614704 >> 172.21.15.146:0/1015614704 conn(0x5570e9704400 msgr2=0x5570e9683000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 -- 172.21.15.146:0/1015614704 shutdown_connections 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.494+0000 7f1c2367a280 1 -- 172.21.15.146:0/1015614704 wait complete. 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 Processor -- start 2024-04-24T23:09:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 -- start start 2024-04-24T23:09:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704800 0x5570e8973700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 0x5570e8973180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9705000 0x5570e8972c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c1b00 con 0x5570e9704c00 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5570e97c1980 con 0x5570e9704800 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.495+0000 7f1c2367a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5570e97c0c00 con 0x5570e9705000 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 0x5570e8973180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 0x5570e8973180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40804/0 (socket says 172.21.15.146:40804) 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 -- 172.21.15.146:0/4050858502 learned_addr learned my addr 172.21.15.146:0/4050858502 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c20e00640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9705000 0x5570e8972c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 -- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9705000 msgr2=0x5570e8972c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e9705000 0x5570e8972c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c22200640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704800 0x5570e8973700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 -- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704800 msgr2=0x5570e8973700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704800 0x5570e8973700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.496+0000 7f1c21800640 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570e8938780 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c21800640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 0x5570e8973180 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x5570e97ef470 tx=0x5570e97f0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c1a000640 1 -- 172.21.15.146:0/4050858502 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a9c0 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c1a000640 1 -- 172.21.15.146:0/4050858502 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5570e8930c40 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c1a000640 1 -- 172.21.15.146:0/4050858502 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5570e892a680 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570e8938000 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570e8939680 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.497+0000 7f1c2367a280 4 main: resolving pool 11 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.499+0000 7f1c1a000640 1 -- 172.21.15.146:0/4050858502 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5570e9844c00 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.499+0000 7f1c1a000640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5570e8c6e000 0x5570e8c74000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.499+0000 7f1c1a000640 1 -- 172.21.15.146:0/4050858502 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x5570e983f800 con 0x5570e9704c00 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.499+0000 7f1c2367a280 4 main: creating IoCtx.. 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.499+0000 7f1c2367a280 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5570e8c6e400 0x5570e8972680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.500+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x5570e8c6e800 con 0x5570e8c6e400 2024-04-24T23:09:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.500+0000 7f1c22200640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5570e8c6e000 0x5570e8c74000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.500+0000 7f1c20e00640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5570e8c6e400 0x5570e8972680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.501+0000 7f1c22200640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5570e8c6e000 0x5570e8c74000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5570e97ee390 tx=0x5570e97f0c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.501+0000 7f1c20e00640 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5570e8c6e400 0x5570e8972680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.502+0000 7f1c20e00640 1 -- 172.21.15.146:0/4050858502 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x5570e89ea000 con 0x5570e8c6e400 2024-04-24T23:09:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.502+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:2 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x5570e8c6ec00 con 0x5570e8c6e400 2024-04-24T23:09:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.503+0000 7f1c20e00640 1 -- 172.21.15.146:0/4050858502 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=288b] v0'0 uv3 ondisk = 0) ==== 159+0+288 (crc 0 0 0) 0x5570e89ea000 con 0x5570e8c6e400 2024-04-24T23:09:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.503+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:3 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x5570e8c6f000 con 0x5570e8c6e400 2024-04-24T23:09:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.504+0000 7f1c20e00640 1 -- 172.21.15.146:0/4050858502 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x5570e89ea000 con 0x5570e8c6e400 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions": [ 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5390, 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": { 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5390 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.507 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "any", 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4084164855 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "open", 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "num_leases": 0, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "num_caps": 0, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "request_load_avg": 0, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 0.00099998399999999999, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "requests_in_flight": 0, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "num_completed_requests": 2, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "num_completed_flushes": 0, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "reconnecting": false, 2024-04-24T23:09:34.508 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps": { 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 60 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "release_caps": { 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 60 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps_throttle": { 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 1.5 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps_throttle2o": { 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.509 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 0.5 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "session_cache_liveness": { 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 300 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition": { 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 30 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "last_trim_completed_requests_tid": 0, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "last_trim_completed_flushes_tid": 0, 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "delegated_inos": [], 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": "client.5390 172.21.15.146:0/4084164855", 2024-04-24T23:09:34.510 INFO:teuthology.orchestra.run.smithi146.stdout: "completed_requests": [ 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 2, 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "created_ino": "0x0" 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 31, 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "created_ino": "0x10000000000" 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "prealloc_inos": [ 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "start": "0x10000000001", 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: "length": 1000 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.511 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_metadata": { 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "client_features": { 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "feature_bits": "0x000000000037fbff" 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "metric_spec": { 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "metric_flags": { 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "feature_bits": "0x000000000080ffff" 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "kernel_version": "6.9.0-rc3-g806ec36b2112", 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2024-04-24T23:09:34.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.513 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5570e8c6e400 msgr2=0x5570e8972680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x5570e8c6e400 0x5570e8972680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5570e8c6e000 msgr2=0x5570e8c74000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5570e8c6e000 0x5570e8c74000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5570e97ee390 tx=0x5570e97f0c00 comp rx=0 tx=0).stop 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 msgr2=0x5570e8973180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/4050858502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e9704c00 0x5570e8973180 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x5570e97ef470 tx=0x5570e97f0de0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c21800640 1 -- 172.21.15.146:0/4050858502 reap_dead start 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 shutdown_connections 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 >> 172.21.15.146:0/4050858502 conn(0x5570e9704400 msgr2=0x5570e9683000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 shutdown_connections 2024-04-24T23:09:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/4050858502 wait complete. 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 msgr2=0x5570e8970b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x5570e9735260 tx=0x5570e96968a0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 shutdown_connections 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5570e9704000 0x5570e8971b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570e96cfc00 0x5570e8970b00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.505+0000 7f1c2367a280 1 --2- 172.21.15.146:0/269688151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5570e96ce400 0x5570e8971600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.506+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 >> 172.21.15.146:0/269688151 conn(0x5570e8905000 msgr2=0x5570e9682000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.506+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 shutdown_connections 2024-04-24T23:09:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.506+0000 7f1c2367a280 1 -- 172.21.15.146:0/269688151 wait complete. 2024-04-24T23:09:34.516 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.112416, result: { "0": { "data": { "sessions": [ { "id": 5390, "entity": { "name": { "type": "client", "num": 5390 }, "addr": { "type": "any", "addr": "172.21.15.146:0", "nonce": 4084164855 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.00099998399999999999, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.5390 172.21.15.146:0/4084164855", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 31, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi146", "kernel_version": "6.9.0-rc3-g806ec36b2112", "root": "/" } } ] }, "result": 0 } } 2024-04-24T23:09:34.516 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [ { "id": 5390, "entity": { "name": { "type": "client", "num": 5390 }, "addr": { "type": "any", "addr": "172.21.15.146:0", "nonce": 4084164855 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0.00099998399999999999, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.5390 172.21.15.146:0/4084164855", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 31, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi146", "kernel_version": "6.9.0-rc3-g806ec36b2112", "root": "/" } } ] }, "result": 0 } } 2024-04-24T23:09:34.517 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-04-24T23:09:34.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.606+0000 7f0497819280 1 -- start start 2024-04-24T23:09:34.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.606+0000 7f0497819280 1 Processor -- start 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.606+0000 7f0497819280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 0x55b11d2ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 0x55b11d2cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0497819280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05e000 con 0x55b11e03c400 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05e180 con 0x55b11e03c800 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b11e05e300 con 0x55b11e03dc00 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40814/0 (socket says 172.21.15.146:40814) 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 -- 172.21.15.146:0/2323199750 learned_addr learned my addr 172.21.15.146:0/2323199750 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0495600640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 0x55b11d2cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494200640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 0x55b11d2ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 -- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 msgr2=0x55b11d2cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 0x55b11d2cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 -- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 msgr2=0x55b11d2ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 0x55b11d2ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494c00640 1 -- 172.21.15.146:0/2323199750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11d294780 con 0x55b11e03c400 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0495600640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 0x55b11d2cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.607+0000 7f0494200640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 0x55b11d2ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0494c00640 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x55b11e083410 tx=0x55b11dff4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6f80c9e7234945 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0491a00640 1 -- 172.21.15.146:0/2323199750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286d00 con 0x55b11e03c400 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0491a00640 1 -- 172.21.15.146:0/2323199750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b11d28ca80 con 0x55b11e03c400 2024-04-24T23:09:34.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0491a00640 1 -- 172.21.15.146:0/2323199750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286680 con 0x55b11e03c400 2024-04-24T23:09:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11d294000 con 0x55b11e03c400 2024-04-24T23:09:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b11d295a40 con 0x55b11e03c400 2024-04-24T23:09:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0497819280 4 waiting for MDS map... 2024-04-24T23:09:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0491a00640 1 -- 172.21.15.146:0/2323199750 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55b11e066400 con 0x55b11e03c400 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0491a00640 1 -- 172.21.15.146:0/2323199750 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55b11d2bb180 con 0x55b11e03c400 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.608+0000 7f0497819280 4 Got MDS map 74 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.609+0000 7f0497819280 10 main: main 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.609+0000 7f0497819280 4 main: connecting to RADOS... 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.609+0000 7f0497819280 1 Processor -- start 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.609+0000 7f0497819280 1 -- start start 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e123000 0x55b11d2cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05e480 con 0x55b11e03d800 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05e600 con 0x55b11e123400 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b11e05e780 con 0x55b11e123000 2024-04-24T23:09:34.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.610+0000 7f0495600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40816/0 (socket says 172.21.15.146:40816) 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 -- 172.21.15.146:0/238047141 learned_addr learned my addr 172.21.15.146:0/238047141 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0494c00640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e123000 0x55b11d2cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0494200640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 -- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e123000 msgr2=0x55b11d2cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e123000 0x55b11d2cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 -- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 msgr2=0x55b11d2ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 -- 172.21.15.146:0/238047141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11d295860 con 0x55b11e03d800 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0494200640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.611+0000 7f0495600640 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x55b11d2f1d10 tx=0x55b11dff28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c081ca82107af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f048f200640 1 -- 172.21.15.146:0/238047141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286b60 con 0x55b11e03d800 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f048f200640 1 -- 172.21.15.146:0/238047141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b11d28cc40 con 0x55b11e03d800 2024-04-24T23:09:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f048f200640 1 -- 172.21.15.146:0/238047141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286d00 con 0x55b11e03d800 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 -- 172.21.15.146:0/238047141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 msgr2=0x55b11d2cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x55b11d2f1d10 tx=0x55b11dff28a0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 -- 172.21.15.146:0/238047141 shutdown_connections 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e123000 0x55b11d2cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 --2- 172.21.15.146:0/238047141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03d800 0x55b11d2cd080 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 -- 172.21.15.146:0/238047141 >> 172.21.15.146:0/238047141 conn(0x55b11e03d400 msgr2=0x55b11dfdf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 -- 172.21.15.146:0/238047141 shutdown_connections 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.612+0000 7f0497819280 1 -- 172.21.15.146:0/238047141 wait complete. 2024-04-24T23:09:34.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.613+0000 7f0497819280 1 Processor -- start 2024-04-24T23:09:34.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.613+0000 7f0497819280 1 -- start start 2024-04-24T23:09:34.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03d800 0x55b11d2cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 0x55b11d2cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05fe00 con 0x55b11e123000 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b11e05ed80 con 0x55b11e123400 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0497819280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55b11e05ef00 con 0x55b11e03d800 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 0x55b11d2cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 0x55b11d2cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40830/0 (socket says 172.21.15.146:40830) 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 -- 172.21.15.146:0/4069234333 learned_addr learned my addr 172.21.15.146:0/4069234333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0495600640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03d800 0x55b11d2cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 -- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03d800 msgr2=0x55b11d2cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03d800 0x55b11d2cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494200640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 -- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 msgr2=0x55b11d2ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e123400 0x55b11d2ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.614+0000 7f0494c00640 1 -- 172.21.15.146:0/4069234333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11d2954a0 con 0x55b11e123000 2024-04-24T23:09:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f0494c00640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 0x55b11d2cec00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x55b11e13b5f0 tx=0x55b11dff29c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f048d400640 1 -- 172.21.15.146:0/4069234333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286b60 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f048d400640 1 -- 172.21.15.146:0/4069234333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b11d28ce00 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b11d294960 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f048d400640 1 -- 172.21.15.146:0/4069234333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b11d286d00 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11d294780 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.615+0000 7f0497819280 4 main: resolving pool 11 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.617+0000 7f048d400640 1 -- 172.21.15.146:0/4069234333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55b11e196c00 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.617+0000 7f048d400640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b11e19d000 0x55b11d2cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.617+0000 7f048d400640 1 -- 172.21.15.146:0/4069234333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55b11dfe2600 con 0x55b11e123000 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.617+0000 7f0497819280 4 main: creating IoCtx.. 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.617+0000 7f0497819280 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55b11e123800 0x55b11d2ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.618+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55b11e123c00 con 0x55b11e123800 2024-04-24T23:09:34.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.618+0000 7f0494200640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55b11e123800 0x55b11d2ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.618+0000 7f0495600640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b11e19d000 0x55b11d2cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.618+0000 7f0494200640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55b11e123800 0x55b11d2ce100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0494200640 1 -- 172.21.15.146:0/4069234333 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55b11d346000 con 0x55b11e123800 2024-04-24T23:09:34.623 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 2, 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511628777, 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511626775 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.624 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511628777, 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511626775 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.625 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55b11e123800 msgr2=0x55b11d2ce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55b11e123800 0x55b11d2ce100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0495600640 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b11e19d000 0x55b11d2cf700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55b11d2f1d10 tx=0x55b11dff41e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b11e19d000 msgr2=0x55b11d2cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55b11e19d000 0x55b11d2cf700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55b11d2f1d10 tx=0x55b11dff41e0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 msgr2=0x55b11d2cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 --2- 172.21.15.146:0/4069234333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e123000 0x55b11d2cec00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x55b11e13b5f0 tx=0x55b11dff29c0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0494200640 1 -- 172.21.15.146:0/4069234333 reap_dead start 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 shutdown_connections 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 >> 172.21.15.146:0/4069234333 conn(0x55b11e03d400 msgr2=0x55b11dfdf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 shutdown_connections 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.619+0000 7f0497819280 1 -- 172.21.15.146:0/4069234333 wait complete. 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 msgr2=0x55b11d2cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x55b11e083410 tx=0x55b11dff4240 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 shutdown_connections 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55b11e03dc00 0x55b11d2cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b11e03c800 0x55b11d2ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 --2- 172.21.15.146:0/2323199750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b11e03c400 0x55b11d2cd600 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 >> 172.21.15.146:0/2323199750 conn(0x55b11d261000 msgr2=0x55b11dfde000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 shutdown_connections 2024-04-24T23:09:34.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.620+0000 7f0497819280 1 -- 172.21.15.146:0/2323199750 wait complete. 2024-04-24T23:09:34.629 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.112210, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-04-24T23:09:34.629 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.722+0000 7fa37e8b2280 1 -- start start 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.722+0000 7fa37e8b2280 1 Processor -- start 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754d97e000 0x55754cc13080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754cba7c00 0x55754cc12b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55754da60000 con 0x55754d97e800 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55754da60180 con 0x55754d97e000 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55754da60300 con 0x55754cba7c00 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40850/0 (socket says 172.21.15.146:40850) 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37d400640 1 -- 172.21.15.146:0/3308450478 learned_addr learned my addr 172.21.15.146:0/3308450478 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.723+0000 7fa37ca00640 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754d97e000 0x55754cc13080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37c000640 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754cba7c00 0x55754cc12b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 -- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754cba7c00 msgr2=0x55754cc12b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754cba7c00 0x55754cc12b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 -- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754d97e000 msgr2=0x55754cc13080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754d97e000 0x55754cc13080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 -- 172.21.15.146:0/3308450478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754cbda780 con 0x55754d97e800 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37d400640 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x55754d9c1230 tx=0x55754d93a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616acea3509ed049 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa379800640 1 -- 172.21.15.146:0/3308450478 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbccd00 con 0x55754d97e800 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa379800640 1 -- 172.21.15.146:0/3308450478 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55754cbd2e00 con 0x55754d97e800 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa379800640 1 -- 172.21.15.146:0/3308450478 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbcc680 con 0x55754d97e800 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754cbdb860 con 0x55754d97e800 2024-04-24T23:09:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55754cbdb680 con 0x55754d97e800 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.724+0000 7fa37e8b2280 4 waiting for MDS map... 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.725+0000 7fa379800640 1 -- 172.21.15.146:0/3308450478 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55754da72400 con 0x55754d97e800 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.725+0000 7fa379800640 1 -- 172.21.15.146:0/3308450478 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55754cc01180 con 0x55754d97e800 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.725+0000 7fa37e8b2280 4 Got MDS map 74 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.725+0000 7fa37e8b2280 10 main: main 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.725+0000 7fa37e8b2280 4 main: connecting to RADOS... 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 Processor -- start 2024-04-24T23:09:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 -- start start 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc13600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55754da60480 con 0x55754da75000 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55754da60600 con 0x55754da74c00 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.726+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55754da60780 con 0x55754da75400 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40860/0 (socket says 172.21.15.146:40860) 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 -- 172.21.15.146:0/2279386090 learned_addr learned my addr 172.21.15.146:0/2279386090 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37c000640 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 -- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 msgr2=0x55754cc14100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37c000640 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc13600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 -- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 msgr2=0x55754cc13600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc13600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 -- 172.21.15.146:0/2279386090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754cbdb4a0 con 0x55754da75000 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.727+0000 7fa37ca00640 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x55754dade0c0 tx=0x55754da8d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee411d94344bac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa377000640 1 -- 172.21.15.146:0/2279386090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbccd00 con 0x55754da75000 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa377000640 1 -- 172.21.15.146:0/2279386090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55754cbd2c40 con 0x55754da75000 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa377000640 1 -- 172.21.15.146:0/2279386090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbcc680 con 0x55754da75000 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 -- 172.21.15.146:0/2279386090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 msgr2=0x55754cc12580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x55754dade0c0 tx=0x55754da8d800 comp rx=0 tx=0).stop 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 -- 172.21.15.146:0/2279386090 shutdown_connections 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc12580 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/2279386090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc13600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 -- 172.21.15.146:0/2279386090 >> 172.21.15.146:0/2279386090 conn(0x55754d97e400 msgr2=0x55754d923000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 -- 172.21.15.146:0/2279386090 shutdown_connections 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.728+0000 7fa37e8b2280 1 -- 172.21.15.146:0/2279386090 wait complete. 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.729+0000 7fa37e8b2280 1 Processor -- start 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.729+0000 7fa37e8b2280 1 -- start start 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc15180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc14c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55754da60d80 con 0x55754da75000 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55754da60f00 con 0x55754da74c00 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37e8b2280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55754da61080 con 0x55754da75400 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc14c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40870/0 (socket says 172.21.15.146:40870) 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.730+0000 7fa37ca00640 1 -- 172.21.15.146:0/827369159 learned_addr learned my addr 172.21.15.146:0/827369159 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 -- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 msgr2=0x55754cc14680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754da75400 0x55754cc14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 -- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 msgr2=0x55754cc15180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754da74c00 0x55754cc15180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754cbda000 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37ca00640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc14c00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x55754dadf380 tx=0x55754d93a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa375200640 1 -- 172.21.15.146:0/827369159 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbcc820 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa375200640 1 -- 172.21.15.146:0/827369159 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55754cbd21c0 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa375200640 1 -- 172.21.15.146:0/827369159 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55754cbccd00 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55754cbda960 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754cbda780 con 0x55754da75000 2024-04-24T23:09:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.731+0000 7fa37e8b2280 4 main: resolving pool 11 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.733+0000 7fa375200640 1 -- 172.21.15.146:0/827369159 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55754d9a2c00 con 0x55754da75000 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa375200640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55754dae8c00 0x55754cc15700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa375200640 1 -- 172.21.15.146:0/827369159 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55754d99ca00 con 0x55754da75000 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa37e8b2280 4 main: creating IoCtx.. 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55754da75800 0x55754cc14100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55754da75c00 con 0x55754da75800 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.734+0000 7fa37c000640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55754dae8c00 0x55754cc15700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.735+0000 7fa37c000640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55754da75800 0x55754cc14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.736+0000 7fa37c000640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55754dae8c00 0x55754cc15700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55754d9c0d50 tx=0x55754d938660 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.736+0000 7fa37c000640 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55754da75800 0x55754cc14100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.737+0000 7fa37c000640 1 -- 172.21.15.146:0/827369159 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55754d928000 con 0x55754da75800 2024-04-24T23:09:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.737+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:2 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55754dae9000 con 0x55754da75800 2024-04-24T23:09:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.738+0000 7fa37c000640 1 -- 172.21.15.146:0/827369159 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=288b] v0'0 uv3 ondisk = 0) ==== 159+0+288 (crc 0 0 0) 0x55754d928000 con 0x55754da75800 2024-04-24T23:09:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.738+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:3 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55754dae9400 con 0x55754da75800 2024-04-24T23:09:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.738+0000 7fa37c000640 1 -- 172.21.15.146:0/827369159 <== osd.6 v2:172.21.15.203:6807/3736386787 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55754d928000 con 0x55754da75800 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions": [ 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5390, 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": { 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5390 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.741 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "any", 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4084164855 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "open", 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "num_leases": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "num_caps": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "request_load_avg": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "requests_in_flight": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "num_completed_requests": 2, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "num_completed_flushes": 0, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "reconnecting": false, 2024-04-24T23:09:34.742 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps": { 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 60 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "release_caps": { 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 60 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps_throttle": { 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 1.5 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "recall_caps_throttle2o": { 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.743 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 0.5 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "session_cache_liveness": { 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 300 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition": { 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "value": 0, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "halflife": 30 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "last_trim_completed_requests_tid": 0, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "last_trim_completed_flushes_tid": 0, 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "delegated_inos": [], 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": "client.5390 172.21.15.146:0/4084164855", 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: "completed_requests": [ 2024-04-24T23:09:34.744 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 2, 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "created_ino": "0x0" 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "tid": 31, 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "created_ino": "0x10000000000" 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "prealloc_inos": [ 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "start": "0x10000000001", 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "length": 1000 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "client_metadata": { 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "client_features": { 2024-04-24T23:09:34.745 INFO:teuthology.orchestra.run.smithi146.stdout: "feature_bits": "0x000000000037fbff" 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "metric_spec": { 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "metric_flags": { 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "feature_bits": "0x000000000080ffff" 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "kernel_version": "6.9.0-rc3-g806ec36b2112", 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:34.747 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.747 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.747 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.747 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.747 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.738+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55754da75800 msgr2=0x55754cc14100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.738+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55754da75800 0x55754cc14100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55754dae8c00 msgr2=0x55754cc15700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55754dae8c00 0x55754cc15700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55754d9c0d50 tx=0x55754d938660 comp rx=0 tx=0).stop 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 msgr2=0x55754cc14c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/827369159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754da75000 0x55754cc14c00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x55754dadf380 tx=0x55754d93a120 comp rx=0 tx=0).stop 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37ca00640 1 -- 172.21.15.146:0/827369159 reap_dead start 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 shutdown_connections 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 >> 172.21.15.146:0/827369159 conn(0x55754d97e400 msgr2=0x55754d923000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 shutdown_connections 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/827369159 wait complete. 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 msgr2=0x55754cc13b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x55754d9c1230 tx=0x55754d93a000 comp rx=0 tx=0).stop 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 shutdown_connections 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55754d97e800 0x55754cc13b80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55754cba7c00 0x55754cc12b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 --2- 172.21.15.146:0/3308450478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754d97e000 0x55754cc13080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 >> 172.21.15.146:0/3308450478 conn(0x55754cba7000 msgr2=0x55754d924000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.739+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 shutdown_connections 2024-04-24T23:09:34.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.740+0000 7fa37e8b2280 1 -- 172.21.15.146:0/3308450478 wait complete. 2024-04-24T23:09:34.750 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.120968, result: { "0": { "data": { "sessions": [ { "id": 5390, "entity": { "name": { "type": "client", "num": 5390 }, "addr": { "type": "any", "addr": "172.21.15.146:0", "nonce": 4084164855 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.5390 172.21.15.146:0/4084164855", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 31, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi146", "kernel_version": "6.9.0-rc3-g806ec36b2112", "root": "/" } } ] }, "result": 0 } } 2024-04-24T23:09:34.750 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-04-24T23:09:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.832+0000 7f3700953280 1 -- start start 2024-04-24T23:09:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.832+0000 7f3700953280 1 Processor -- start 2024-04-24T23:09:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.832+0000 7f3700953280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 0x564c6590cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 0x564c6590db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f3700953280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564c666a0000 con 0x564c6667e400 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564c666a0180 con 0x564c6667fc00 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564c666a0300 con 0x564c6667e800 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40884/0 (socket says 172.21.15.146:40884) 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 -- 172.21.15.146:0/3507910272 learned_addr learned my addr 172.21.15.146:0/3507910272 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36ff400640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 0x564c6590db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fe000640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 0x564c6590cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 -- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 msgr2=0x564c6590cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 0x564c6590cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 -- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 msgr2=0x564c6590db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 0x564c6590db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fea00640 1 -- 172.21.15.146:0/3507910272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c658d4780 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36ff400640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 0x564c6590db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.833+0000 7f36fe000640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 0x564c6590cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fea00640 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x564c666c35c0 tx=0x564c666341e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d729c80896369a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fb800640 1 -- 172.21.15.146:0/3507910272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6d00 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fb800640 1 -- 172.21.15.146:0/3507910272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564c658ccc40 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fb800640 1 -- 172.21.15.146:0/3507910272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6680 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c658d4000 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564c658d5680 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f3700953280 4 waiting for MDS map... 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fb800640 1 -- 172.21.15.146:0/3507910272 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x564c6676c600 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f36fb800640 1 -- 172.21.15.146:0/3507910272 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x564c658fb180 con 0x564c6667e400 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f3700953280 4 Got MDS map 74 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.834+0000 7f3700953280 10 main: main 2024-04-24T23:09:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.835+0000 7f3700953280 4 main: connecting to RADOS... 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.835+0000 7f3700953280 1 Processor -- start 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.835+0000 7f3700953280 1 -- start start 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6676f400 0x564c6590e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564c666a0480 con 0x564c6667f800 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564c666a0600 con 0x564c6676f000 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564c666a0780 con 0x564c6676f400 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f36ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f36ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40896/0 (socket says 172.21.15.146:40896) 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.836+0000 7f36ff400640 1 -- 172.21.15.146:0/3757609826 learned_addr learned my addr 172.21.15.146:0/3757609826 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 -- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6676f400 msgr2=0x564c6590e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6676f400 0x564c6590e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 -- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 msgr2=0x564c6590c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 -- 172.21.15.146:0/3757609826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c658d5860 con 0x564c6667f800 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36ff400640 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x564c666c31d0 tx=0x564c666328a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cbd763882589d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36f9000640 1 -- 172.21.15.146:0/3757609826 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6d00 con 0x564c6667f800 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36f9000640 1 -- 172.21.15.146:0/3757609826 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564c658cce00 con 0x564c6667f800 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.837+0000 7f36f9000640 1 -- 172.21.15.146:0/3757609826 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6680 con 0x564c6667f800 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 -- 172.21.15.146:0/3757609826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 msgr2=0x564c6590d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x564c666c31d0 tx=0x564c666328a0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 -- 172.21.15.146:0/3757609826 shutdown_connections 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6676f400 0x564c6590e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 --2- 172.21.15.146:0/3757609826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667f800 0x564c6590d080 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 -- 172.21.15.146:0/3757609826 >> 172.21.15.146:0/3757609826 conn(0x564c6667f400 msgr2=0x564c6661f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 -- 172.21.15.146:0/3757609826 shutdown_connections 2024-04-24T23:09:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.838+0000 7f3700953280 1 -- 172.21.15.146:0/3757609826 wait complete. 2024-04-24T23:09:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 Processor -- start 2024-04-24T23:09:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 -- start start 2024-04-24T23:09:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667f800 0x564c6590f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 0x564c6590e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564c666a1e00 con 0x564c6676f400 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564c666a0d80 con 0x564c6676f000 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.839+0000 7f3700953280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564c666a0f00 con 0x564c6667f800 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 0x564c6590e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 0x564c6590e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40906/0 (socket says 172.21.15.146:40906) 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 -- 172.21.15.146:0/3606652045 learned_addr learned my addr 172.21.15.146:0/3606652045 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36ff400640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667f800 0x564c6590f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 -- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667f800 msgr2=0x564c6590f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667f800 0x564c6590f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fea00640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 -- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 msgr2=0x564c6590ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6676f000 0x564c6590ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 -- 172.21.15.146:0/3606652045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c658d54a0 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.840+0000 7f36fe000640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 0x564c6590e680 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x564c66789230 tx=0x564c6678b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f36f7200640 1 -- 172.21.15.146:0/3606652045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6d00 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f36f7200640 1 -- 172.21.15.146:0/3606652045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564c658cc700 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c658d4960 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f36f7200640 1 -- 172.21.15.146:0/3606652045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c658c6680 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c658d43c0 con 0x564c6676f400 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.841+0000 7f3700953280 4 main: resolving pool 11 2024-04-24T23:09:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f36f7200640 1 -- 172.21.15.146:0/3606652045 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x564c66698c00 con 0x564c6676f400 2024-04-24T23:09:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f36f7200640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564c667e0c00 0x564c6590f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f36f7200640 1 -- 172.21.15.146:0/3606652045 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x564c66696e00 con 0x564c6676f400 2024-04-24T23:09:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f3700953280 4 main: creating IoCtx.. 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f3700953280 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564c6676f800 0x564c6590e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.843+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x564c6676fc00 con 0x564c6676f800 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.844+0000 7f36ff400640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564c667e0c00 0x564c6590f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.844+0000 7f36fea00640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564c6676f800 0x564c6590e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.845+0000 7f36ff400640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564c667e0c00 0x564c6590f700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x564c666c31d0 tx=0x564c66634780 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.845+0000 7f36fea00640 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564c6676f800 0x564c6590e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f36fea00640 1 -- 172.21.15.146:0/3606652045 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x564c65986000 con 0x564c6676f800 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "snapserver": { 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "last_snap": 1, 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "last_created": 1, 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "last_destroyed": 1, 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_noop": [], 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "snaps": [], 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "need_to_purge": {}, 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_update": [], 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_destroy": [] 2024-04-24T23:09:34.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:34.850 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.850 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564c6676f800 msgr2=0x564c6590e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x564c6676f800 0x564c6590e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564c667e0c00 msgr2=0x564c6590f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x564c667e0c00 0x564c6590f700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x564c666c31d0 tx=0x564c66634780 comp rx=0 tx=0).stop 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 msgr2=0x564c6590e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 --2- 172.21.15.146:0/3606652045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6676f400 0x564c6590e680 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x564c66789230 tx=0x564c6678b8c0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f36fe000640 1 -- 172.21.15.146:0/3606652045 reap_dead start 2024-04-24T23:09:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 shutdown_connections 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 >> 172.21.15.146:0/3606652045 conn(0x564c6667f400 msgr2=0x564c6661f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 shutdown_connections 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.846+0000 7f3700953280 1 -- 172.21.15.146:0/3606652045 wait complete. 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 msgr2=0x564c6590d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x564c666c35c0 tx=0x564c666341e0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 shutdown_connections 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564c6667fc00 0x564c6590db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564c6667e800 0x564c6590cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 --2- 172.21.15.146:0/3507910272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c6667e400 0x564c6590d600 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 >> 172.21.15.146:0/3507910272 conn(0x564c658a1000 msgr2=0x564c6661e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 shutdown_connections 2024-04-24T23:09:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.847+0000 7f3700953280 1 -- 172.21.15.146:0/3507910272 wait complete. 2024-04-24T23:09:34.854 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.104252, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:34.855 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset session 2024-04-24T23:09:34.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.940+0000 7f01ea8f7280 1 -- start start 2024-04-24T23:09:34.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 Processor -- start 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 0x55d3c71be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c7153c00 0x55d3c71bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d3c7f32180 con 0x55d3c7153800 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3c7f32300 con 0x55d3c7152c00 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.941+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d3c7f32480 con 0x55d3c7153c00 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40920/0 (socket says 172.21.15.146:40920) 2024-04-24T23:09:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 -- 172.21.15.146:0/3766274168 learned_addr learned my addr 172.21.15.146:0/3766274168 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8a00640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 0x55d3c71be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e9400640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c7153c00 0x55d3c71bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 -- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c7153c00 msgr2=0x55d3c71bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c7153c00 0x55d3c71bf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 -- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 msgr2=0x55d3c71be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 0x55d3c71be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 -- 172.21.15.146:0/3766274168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c7186780 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8a00640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 0x55d3c71be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.942+0000 7f01e8000640 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f74f30 tx=0x55d3c7ee6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba98da5927edb6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01e5800640 1 -- 172.21.15.146:0/3766274168 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c7178680 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01e5800640 1 -- 172.21.15.146:0/3766274168 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d3c717e700 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c71874a0 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d3c7186000 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 4 waiting for MDS map... 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01e5800640 1 -- 172.21.15.146:0/3766274168 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c7178b60 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01e5800640 1 -- 172.21.15.146:0/3766274168 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55d3c801e600 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01e5800640 1 -- 172.21.15.146:0/3766274168 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55d3c71ad180 con 0x55d3c7153800 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 4 Got MDS map 74 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 10 main: main 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.943+0000 7f01ea8f7280 4 main: connecting to RADOS... 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.944+0000 7f01ea8f7280 1 Processor -- start 2024-04-24T23:09:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.944+0000 7f01ea8f7280 1 -- start start 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021800 0x55d3c71bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d3c7f32600 con 0x55d3c8021400 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3c7f32780 con 0x55d3c8021800 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d3c7f32900 con 0x55d3c8021c00 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01e9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01e9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40922/0 (socket says 172.21.15.146:40922) 2024-04-24T23:09:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.945+0000 7f01e9400640 1 -- 172.21.15.146:0/2355329035 learned_addr learned my addr 172.21.15.146:0/2355329035 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 -- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 msgr2=0x55d3c71c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 -- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021800 msgr2=0x55d3c71bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e8a00640 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021800 0x55d3c71bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021800 0x55d3c71bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 -- 172.21.15.146:0/2355329035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c71863c0 con 0x55d3c8021400 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e9400640 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f749c0 tx=0x55d3c7ee6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92d60dd9fb319d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e3000640 1 -- 172.21.15.146:0/2355329035 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c71789c0 con 0x55d3c8021400 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e3000640 1 -- 172.21.15.146:0/2355329035 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d3c717efc0 con 0x55d3c8021400 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.946+0000 7f01e3000640 1 -- 172.21.15.146:0/2355329035 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c7178680 con 0x55d3c8021400 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 -- 172.21.15.146:0/2355329035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 msgr2=0x55d3c71bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f749c0 tx=0x55d3c7ee6d80 comp rx=0 tx=0).stop 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 -- 172.21.15.146:0/2355329035 shutdown_connections 2024-04-24T23:09:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021800 0x55d3c71bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/2355329035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021400 0x55d3c71bf600 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 -- 172.21.15.146:0/2355329035 >> 172.21.15.146:0/2355329035 conn(0x55d3c8021000 msgr2=0x55d3c7245800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 -- 172.21.15.146:0/2355329035 shutdown_connections 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.947+0000 7f01ea8f7280 1 -- 172.21.15.146:0/2355329035 wait complete. 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.948+0000 7f01ea8f7280 1 Processor -- start 2024-04-24T23:09:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.948+0000 7f01ea8f7280 1 -- start start 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021400 0x55d3c71c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 0x55d3c71c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d3c71b4180 con 0x55d3c8021800 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d3c7f33e00 con 0x55d3c8021400 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01ea8f7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d3c7f32d80 con 0x55d3c8021c00 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 0x55d3c71c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 0x55d3c71c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40926/0 (socket says 172.21.15.146:40926) 2024-04-24T23:09:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01e8a00640 1 -- 172.21.15.146:0/3887887016 learned_addr learned my addr 172.21.15.146:0/3887887016 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01e9400640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021400 0x55d3c71c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.949+0000 7f01e8000640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 -- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 msgr2=0x55d3c71c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c8021c00 0x55d3c71c0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 -- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021400 msgr2=0x55d3c71c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c8021400 0x55d3c71c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 -- 172.21.15.146:0/3887887016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c7186780 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e8a00640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 0x55d3c71c0c00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x55d3c807d470 tx=0x55d3c803b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e1200640 1 -- 172.21.15.146:0/3887887016 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c71789c0 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e1200640 1 -- 172.21.15.146:0/3887887016 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d3c717ee00 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01e1200640 1 -- 172.21.15.146:0/3887887016 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3c7178680 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c71874a0 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c7186960 con 0x55d3c8021800 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.950+0000 7f01ea8f7280 4 main: resolving pool 11 2024-04-24T23:09:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.952+0000 7f01e1200640 1 -- 172.21.15.146:0/3887887016 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d3c7f4ac00 con 0x55d3c8021800 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01e1200640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d3c8094c00 0x55d3c71c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01e1200640 1 -- 172.21.15.146:0/3887887016 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55d3c8096a00 con 0x55d3c8021800 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01ea8f7280 4 main: creating IoCtx.. 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55d3c8095000 0x55d3c71c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84) -- 0x55d3c8095400 con 0x55d3c8095000 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01e9400640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d3c8094c00 0x55d3c71c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.953+0000 7f01e8000640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55d3c8095000 0x55d3c71c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.954+0000 7f01e9400640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d3c8094c00 0x55d3c71c1700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f749c0 tx=0x55d3c7ee6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.955+0000 7f01e8000640 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55d3c8095000 0x55d3c71c0100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01e8000640 1 -- 172.21.15.146:0/3887887016 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v84'4 uv4 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x55d3c7ed4000 con 0x55d3c8095000 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout: "data": {}, 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:34.961 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55d3c8095000 msgr2=0x55d3c71c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55d3c8095000 0x55d3c71c0100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d3c8094c00 msgr2=0x55d3c71c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d3c8094c00 0x55d3c71c1700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f749c0 tx=0x55d3c7ee6000 comp rx=0 tx=0).stop 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 msgr2=0x55d3c71c0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3887887016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c8021800 0x55d3c71c0c00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x55d3c807d470 tx=0x55d3c803b8c0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01e8a00640 1 -- 172.21.15.146:0/3887887016 reap_dead start 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 shutdown_connections 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 >> 172.21.15.146:0/3887887016 conn(0x55d3c8021000 msgr2=0x55d3c7245800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 shutdown_connections 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.959+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3887887016 wait complete. 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 msgr2=0x55d3c71beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x55d3c7f74f30 tx=0x55d3c7ee6f60 comp rx=0 tx=0).stop 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 shutdown_connections 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d3c7153c00 0x55d3c71bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3c7153800 0x55d3c71beb00 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 --2- 172.21.15.146:0/3766274168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d3c7152c00 0x55d3c71be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 >> 172.21.15.146:0/3766274168 conn(0x55d3c7153000 msgr2=0x55d3c7245000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 shutdown_connections 2024-04-24T23:09:34.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:34.960+0000 7f01ea8f7280 1 -- 172.21.15.146:0/3766274168 wait complete. 2024-04-24T23:09:34.967 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'session'] in time 0:00:00.112281, result: { "0": { "data": {}, "result": 0 } } 2024-04-24T23:09:34.967 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset inode 2024-04-24T23:09:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.064+0000 7f1c0d421280 1 -- start start 2024-04-24T23:09:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.064+0000 7f1c0d421280 1 Processor -- start 2024-04-24T23:09:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 0x562783754b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 0x562783755080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5627845a2180 con 0x5627836e8c00 2024-04-24T23:09:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627845a2300 con 0x5627836e9800 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.065+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627845a2480 con 0x5627836e9c00 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40940/0 (socket says 172.21.15.146:40940) 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 -- 172.21.15.146:0/3496918137 learned_addr learned my addr 172.21.15.146:0/3496918137 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 0x562783754b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0be00640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 0x562783755080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 -- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 msgr2=0x562783755080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 0x562783755080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 -- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 msgr2=0x562783754b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 0x562783754b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0b400640 1 -- 172.21.15.146:0/3496918137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278371c780 con 0x5627836e8c00 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0be00640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 0x562783755080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.066+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 0x562783754b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x5627845051a0 tx=0x56278447bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc31645aecb04e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c08200640 1 -- 172.21.15.146:0/3496918137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370e9c0 con 0x5627836e8c00 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c08200640 1 -- 172.21.15.146:0/3496918137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562783714fc0 con 0x5627836e8c00 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c08200640 1 -- 172.21.15.146:0/3496918137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370e680 con 0x5627836e8c00 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278371d4a0 con 0x5627836e8c00 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56278371c000 con 0x5627836e8c00 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 4 waiting for MDS map... 2024-04-24T23:09:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c08200640 1 -- 172.21.15.146:0/3496918137 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x5627845b0200 con 0x5627836e8c00 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c08200640 1 -- 172.21.15.146:0/3496918137 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x562783743180 con 0x5627836e8c00 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 4 Got MDS map 74 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 10 main: main 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.067+0000 7f1c0d421280 4 main: connecting to RADOS... 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.068+0000 7f1c0d421280 1 Processor -- start 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.068+0000 7f1c0d421280 1 -- start start 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610000 0x562783755600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610400 0x562783755b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5627845a2600 con 0x562784610800 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627845a2780 con 0x562784610400 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627845a2900 con 0x562784610000 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40948/0 (socket says 172.21.15.146:40948) 2024-04-24T23:09:35.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.069+0000 7f1c0aa00640 1 -- 172.21.15.146:0/2761410142 learned_addr learned my addr 172.21.15.146:0/2761410142 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 -- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610000 msgr2=0x562783755600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0b400640 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610400 0x562783755b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610000 0x562783755600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 -- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610400 msgr2=0x562783755b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610400 0x562783755b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 -- 172.21.15.146:0/2761410142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278371c3c0 con 0x562784610800 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x5627845c2270 tx=0x5627845c8cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aa60b67ac0b79a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c05a00640 1 -- 172.21.15.146:0/2761410142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370e9c0 con 0x562784610800 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c05a00640 1 -- 172.21.15.146:0/2761410142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562783714a80 con 0x562784610800 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.070+0000 7f1c05a00640 1 -- 172.21.15.146:0/2761410142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370e680 con 0x562784610800 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 -- 172.21.15.146:0/2761410142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 msgr2=0x562783756100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x5627845c2270 tx=0x5627845c8cc0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 -- 172.21.15.146:0/2761410142 shutdown_connections 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610800 0x562783756100 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610400 0x562783755b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 --2- 172.21.15.146:0/2761410142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610000 0x562783755600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 -- 172.21.15.146:0/2761410142 >> 172.21.15.146:0/2761410142 conn(0x5627844c5c00 msgr2=0x562784467000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 -- 172.21.15.146:0/2761410142 shutdown_connections 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.071+0000 7f1c0d421280 1 -- 172.21.15.146:0/2761410142 wait complete. 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 Processor -- start 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 -- start start 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610000 0x562783757180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 0x562783756c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610800 0x562783756680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5627845a3980 con 0x562784610400 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627845a2300 con 0x562784610000 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.072+0000 7f1c0d421280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627845a2c00 con 0x562784610800 2024-04-24T23:09:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 0x562783756c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 0x562783756c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40960/0 (socket says 172.21.15.146:40960) 2024-04-24T23:09:35.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 -- 172.21.15.146:0/3274720416 learned_addr learned my addr 172.21.15.146:0/3274720416 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610800 0x562783756680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 -- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610800 msgr2=0x562783756680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x562784610800 0x562783756680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 -- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610000 msgr2=0x562783757180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562784610000 0x562783757180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 -- 172.21.15.146:0/3274720416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278371c960 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.073+0000 7f1c0b400640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 0x562783756c00 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x5627845055f0 tx=0x562783764de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c03c00640 1 -- 172.21.15.146:0/3274720416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370eb60 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c03c00640 1 -- 172.21.15.146:0/3274720416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562783714e00 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278371d680 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c03c00640 1 -- 172.21.15.146:0/3274720416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56278370e820 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278371d860 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.074+0000 7f1c0d421280 4 main: resolving pool 11 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c03c00640 1 -- 172.21.15.146:0/3274720416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x562784620c00 con 0x562784610400 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c03c00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562784629000 0x562783757700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c03c00640 1 -- 172.21.15.146:0/3274720416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x562784617200 con 0x562784610400 2024-04-24T23:09:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c0d421280 4 main: creating IoCtx.. 2024-04-24T23:09:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562784610c00 0x562783756100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.076+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84) -- 0x562784611000 con 0x562784610c00 2024-04-24T23:09:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.077+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562784610c00 0x562783756100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.077+0000 7f1c0be00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562784629000 0x562783757700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.077+0000 7f1c0aa00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562784610c00 0x562783756100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.078+0000 7f1c0be00640 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562784629000 0x562783757700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5627844726f0 tx=0x562783a52000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0aa00640 1 -- 172.21.15.146:0/3274720416 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v84'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x56278446a000 con 0x562784610c00 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout: "data": {}, 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.081 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562784610c00 msgr2=0x562783756100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x562784610c00 0x562783756100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562784629000 msgr2=0x562783757700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x562784629000 0x562783757700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5627844726f0 tx=0x562783a52000 comp rx=0 tx=0).stop 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 msgr2=0x562783756c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3274720416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562784610400 0x562783756c00 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x5627845055f0 tx=0x562783764de0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0aa00640 1 -- 172.21.15.146:0/3274720416 reap_dead start 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 shutdown_connections 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 >> 172.21.15.146:0/3274720416 conn(0x5627844c5c00 msgr2=0x562784467000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 shutdown_connections 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.079+0000 7f1c0d421280 1 -- 172.21.15.146:0/3274720416 wait complete. 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 msgr2=0x562783754580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x5627845051a0 tx=0x56278447bf80 comp rx=0 tx=0).stop 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 shutdown_connections 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627836e9c00 0x562783755080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627836e9800 0x562783754b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 --2- 172.21.15.146:0/3496918137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627836e8c00 0x562783754580 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 >> 172.21.15.146:0/3496918137 conn(0x5627836e9000 msgr2=0x562784466800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 shutdown_connections 2024-04-24T23:09:35.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.080+0000 7f1c0d421280 1 -- 172.21.15.146:0/3496918137 wait complete. 2024-04-24T23:09:35.087 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'inode'] in time 0:00:00.120334, result: { "0": { "data": {}, "result": 0 } } 2024-04-24T23:09:35.088 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset snap 2024-04-24T23:09:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.166+0000 7fbc6efda280 1 -- start start 2024-04-24T23:09:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.166+0000 7fbc6efda280 1 Processor -- start 2024-04-24T23:09:35.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 0x56553a283b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553a217800 0x56553a283600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56553a2fe180 con 0x56553a217c00 2024-04-24T23:09:35.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56553a278900 con 0x56553a216c00 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56553a278480 con 0x56553a217800 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40968/0 (socket says 172.21.15.146:40968) 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6da00640 1 -- 172.21.15.146:0/419033518 learned_addr learned my addr 172.21.15.146:0/419033518 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.167+0000 7fbc6d000640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 0x56553a283b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6c600640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553a217800 0x56553a283600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 -- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553a217800 msgr2=0x56553a283600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553a217800 0x56553a283600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 -- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 msgr2=0x56553a283b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 0x56553a283b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 -- 172.21.15.146:0/419033518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553a24a780 con 0x56553a217c00 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6d000640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 0x56553a283b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6da00640 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x56553b040a80 tx=0x56553afaaea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a04529e3b886040 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc69e00640 1 -- 172.21.15.146:0/419033518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c9c0 con 0x56553a217c00 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc69e00640 1 -- 172.21.15.146:0/419033518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56553a242700 con 0x56553a217c00 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc69e00640 1 -- 172.21.15.146:0/419033518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c680 con 0x56553a217c00 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553a24b4a0 con 0x56553a217c00 2024-04-24T23:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56553a24a000 con 0x56553a217c00 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.168+0000 7fbc6efda280 4 waiting for MDS map... 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.169+0000 7fbc69e00640 1 -- 172.21.15.146:0/419033518 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x56553b0dc000 con 0x56553a217c00 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.169+0000 7fbc69e00640 1 -- 172.21.15.146:0/419033518 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x56553a271180 con 0x56553a217c00 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.169+0000 7fbc6efda280 4 Got MDS map 74 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.169+0000 7fbc6efda280 10 main: main 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.169+0000 7fbc6efda280 4 main: connecting to RADOS... 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.170+0000 7fbc6efda280 1 Processor -- start 2024-04-24T23:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.170+0000 7fbc6efda280 1 -- start start 2024-04-24T23:09:35.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140800 0x56553a284100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56553a278180 con 0x56553b140000 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56553a2ff500 con 0x56553b140400 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56553a2ff380 con 0x56553b140800 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40976/0 (socket says 172.21.15.146:40976) 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 -- 172.21.15.146:0/1508452674 learned_addr learned my addr 172.21.15.146:0/1508452674 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6d000640 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 -- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140800 msgr2=0x56553a284100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140800 0x56553a284100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 -- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140400 msgr2=0x56553a282580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.171+0000 7fbc6c600640 1 -- 172.21.15.146:0/1508452674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553a24a3c0 con 0x56553b140000 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6c600640 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x56553b0ee6f0 tx=0x56553b0f0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7583f4a9fe5977ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc67600640 1 -- 172.21.15.146:0/1508452674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c9c0 con 0x56553b140000 2024-04-24T23:09:35.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc67600640 1 -- 172.21.15.146:0/1508452674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56553a242e00 con 0x56553b140000 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc67600640 1 -- 172.21.15.146:0/1508452674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c680 con 0x56553b140000 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 -- 172.21.15.146:0/1508452674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 msgr2=0x56553a282b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x56553b0ee6f0 tx=0x56553b0f0c00 comp rx=0 tx=0).stop 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 -- 172.21.15.146:0/1508452674 shutdown_connections 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140800 0x56553a284100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 --2- 172.21.15.146:0/1508452674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.172+0000 7fbc6efda280 1 -- 172.21.15.146:0/1508452674 >> 172.21.15.146:0/1508452674 conn(0x56553afedc00 msgr2=0x56553a30b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.173+0000 7fbc6efda280 1 -- 172.21.15.146:0/1508452674 shutdown_connections 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.173+0000 7fbc6efda280 1 -- 172.21.15.146:0/1508452674 wait complete. 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.173+0000 7fbc6efda280 1 Processor -- start 2024-04-24T23:09:35.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.173+0000 7fbc6efda280 1 -- start start 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140800 0x56553a284100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56553a2ff680 con 0x56553b140000 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56553a2fe900 con 0x56553b140800 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6efda280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56553a278480 con 0x56553b140400 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40992/0 (socket says 172.21.15.146:40992) 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.174+0000 7fbc6c600640 1 -- 172.21.15.146:0/424506419 learned_addr learned my addr 172.21.15.146:0/424506419 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 -- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140400 msgr2=0x56553a282580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553b140400 0x56553a282580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 -- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140800 msgr2=0x56553a284100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553b140800 0x56553a284100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 -- 172.21.15.146:0/424506419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553a24a960 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6c600640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x56553b0ef3b0 tx=0x56553afaa0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc65800640 1 -- 172.21.15.146:0/424506419 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c4e0 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc65800640 1 -- 172.21.15.146:0/424506419 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56553a242a80 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc65800640 1 -- 172.21.15.146:0/424506419 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56553a23c9c0 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56553a24b680 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553a24b860 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.175+0000 7fbc6efda280 4 main: resolving pool 11 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.177+0000 7fbc65800640 1 -- 172.21.15.146:0/424506419 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56553b14cc00 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.177+0000 7fbc65800640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56553a57e000 0x56553a580000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc65800640 1 -- 172.21.15.146:0/424506419 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x56553b14aa00 con 0x56553b140000 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc6efda280 4 main: creating IoCtx.. 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc6efda280 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56553b140c00 0x56553a284680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84) -- 0x56553b141000 con 0x56553b140c00 2024-04-24T23:09:35.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc6d000640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56553a57e000 0x56553a580000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.178+0000 7fbc6c600640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56553b140c00 0x56553a284680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.180+0000 7fbc6c600640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56553b140c00 0x56553a284680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.180+0000 7fbc6d000640 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56553a57e000 0x56553a580000 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x56553a2f8630 tx=0x56553a512e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6c600640 1 -- 172.21.15.146:0/424506419 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v84'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x56553af98000 con 0x56553b140c00 2024-04-24T23:09:35.185 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.185 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.185 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.185 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56553b140c00 msgr2=0x56553a284680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56553b140c00 0x56553a284680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56553a57e000 msgr2=0x56553a580000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56553a57e000 0x56553a580000 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x56553a2f8630 tx=0x56553a512e40 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 msgr2=0x56553a282b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 --2- 172.21.15.146:0/424506419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553b140000 0x56553a282b00 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x56553b0ef3b0 tx=0x56553afaa0c0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6d000640 1 -- 172.21.15.146:0/424506419 reap_dead start 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 shutdown_connections 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 >> 172.21.15.146:0/424506419 conn(0x56553afedc00 msgr2=0x56553a30b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 shutdown_connections 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/424506419 wait complete. 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 msgr2=0x56553a283080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.183+0000 7fbc6efda280 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x56553b040a80 tx=0x56553afaaea0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 shutdown_connections 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56553a217c00 0x56553a283080 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56553a217800 0x56553a283600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 --2- 172.21.15.146:0/419033518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56553a216c00 0x56553a283b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 >> 172.21.15.146:0/419033518 conn(0x56553a217000 msgr2=0x56553a30a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 shutdown_connections 2024-04-24T23:09:35.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.184+0000 7fbc6efda280 1 -- 172.21.15.146:0/419033518 wait complete. 2024-04-24T23:09:35.191 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'snap'] in time 0:00:00.103292, result: { "result": 0 } 2024-04-24T23:09:35.191 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-04-24T23:09:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.271+0000 7f9f6fef1280 1 -- start start 2024-04-24T23:09:35.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.271+0000 7f9f6fef1280 1 Processor -- start 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 0x55644b258580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644b1edc00 0x55644b259080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ac180 con 0x55644b1ed800 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ac300 con 0x55644b1edc00 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55644c0ac480 con 0x55644b1ecc00 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41006/0 (socket says 172.21.15.146:41006) 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.272+0000 7f9f6d600640 1 -- 172.21.15.146:0/1855258615 learned_addr learned my addr 172.21.15.146:0/1855258615 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6e000640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 0x55644b258580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 -- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 msgr2=0x55644b258580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 0x55644b258580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6ea00640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644b1edc00 0x55644b259080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 -- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644b1edc00 msgr2=0x55644b259080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644b1edc00 0x55644b259080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 -- 172.21.15.146:0/1855258615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644b220780 con 0x55644b1ed800 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6e000640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 0x55644b258580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6d600640 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x55644c00ea50 tx=0x55644bf80d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaf209e5452f387 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6ae00640 1 -- 172.21.15.146:0/1855258615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b2129c0 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6ae00640 1 -- 172.21.15.146:0/1855258615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55644b218fc0 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6ae00640 1 -- 172.21.15.146:0/1855258615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b212680 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55644b2214a0 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55644b220000 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.273+0000 7f9f6fef1280 4 waiting for MDS map... 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.274+0000 7f9f6ae00640 1 -- 172.21.15.146:0/1855258615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55644c0b8200 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.274+0000 7f9f6ae00640 1 -- 172.21.15.146:0/1855258615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55644b247180 con 0x55644b1ed800 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.274+0000 7f9f6fef1280 4 Got MDS map 74 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.274+0000 7f9f6fef1280 10 main: main 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.274+0000 7f9f6fef1280 4 main: connecting to RADOS... 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.275+0000 7f9f6fef1280 1 Processor -- start 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.275+0000 7f9f6fef1280 1 -- start start 2024-04-24T23:09:35.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122000 0x55644b259600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122800 0x55644b25a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ac600 con 0x55644c122400 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ac780 con 0x55644c122000 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55644c0ac900 con 0x55644c122800 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41018/0 (socket says 172.21.15.146:41018) 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 -- 172.21.15.146:0/2214002945 learned_addr learned my addr 172.21.15.146:0/2214002945 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 -- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122800 msgr2=0x55644b25a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122800 0x55644b25a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 -- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122000 msgr2=0x55644b259600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122000 0x55644b259600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.276+0000 7f9f6e000640 1 -- 172.21.15.146:0/2214002945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644b2203c0 con 0x55644c122400 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6e000640 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x55644c12a510 tx=0x55644c0d2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e657e2848e550636 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f68600640 1 -- 172.21.15.146:0/2214002945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b2129c0 con 0x55644c122400 2024-04-24T23:09:35.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f68600640 1 -- 172.21.15.146:0/2214002945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55644b218c40 con 0x55644c122400 2024-04-24T23:09:35.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f68600640 1 -- 172.21.15.146:0/2214002945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b212680 con 0x55644c122400 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 -- 172.21.15.146:0/2214002945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 msgr2=0x55644b259b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x55644c12a510 tx=0x55644c0d2c00 comp rx=0 tx=0).stop 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 -- 172.21.15.146:0/2214002945 shutdown_connections 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122800 0x55644b25a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b259b80 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/2214002945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122000 0x55644b259600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 -- 172.21.15.146:0/2214002945 >> 172.21.15.146:0/2214002945 conn(0x55644bf4dc00 msgr2=0x55644b2df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 -- 172.21.15.146:0/2214002945 shutdown_connections 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.277+0000 7f9f6fef1280 1 -- 172.21.15.146:0/2214002945 wait complete. 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.278+0000 7f9f6fef1280 1 Processor -- start 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.278+0000 7f9f6fef1280 1 -- start start 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122000 0x55644b25b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b25ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122800 0x55644b25a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ad980 con 0x55644c122400 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55644c0ac300 con 0x55644c122800 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6fef1280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55644c0acc00 con 0x55644c122000 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b25ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b25ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41022/0 (socket says 172.21.15.146:41022) 2024-04-24T23:09:35.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.279+0000 7f9f6e000640 1 -- 172.21.15.146:0/710090093 learned_addr learned my addr 172.21.15.146:0/710090093 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 -- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122000 msgr2=0x55644b25b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644c122000 0x55644b25b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 -- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122800 msgr2=0x55644b25a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644c122800 0x55644b25a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 -- 172.21.15.146:0/710090093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644b220960 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f6e000640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b25ac00 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x55644c12b7d0 tx=0x55644bf800c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f66800640 1 -- 172.21.15.146:0/710090093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b2124e0 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.280+0000 7f9f66800640 1 -- 172.21.15.146:0/710090093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55644b2181c0 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.281+0000 7f9f66800640 1 -- 172.21.15.146:0/710090093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55644b2129c0 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.281+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55644b221680 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.281+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55644b221860 con 0x55644c122400 2024-04-24T23:09:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.281+0000 7f9f6fef1280 4 main: resolving pool 11 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.282+0000 7f9f66800640 1 -- 172.21.15.146:0/710090093 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55644c12cc00 con 0x55644c122400 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f66800640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55644b564000 0x55644b25b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f66800640 1 -- 172.21.15.146:0/710090093 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55644c129400 con 0x55644c122400 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f6fef1280 4 main: creating IoCtx.. 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55644c122c00 0x55644b25a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55644c123000 con 0x55644c122c00 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.283+0000 7f9f6d600640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55644c122c00 0x55644b25a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.284+0000 7f9f6ea00640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55644b564000 0x55644b25b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.284+0000 7f9f6d600640 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55644c122c00 0x55644b25a100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.284+0000 7f9f6d600640 1 -- 172.21.15.146:0/710090093 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55644bf6e000 con 0x55644c122c00 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.288 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.289 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55644c122c00 msgr2=0x55644b25a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55644c122c00 0x55644b25a100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55644b564000 msgr2=0x55644b25b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55644b564000 0x55644b25b700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x55644b2ce750 tx=0x55644b56c0c0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 msgr2=0x55644b25ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/710090093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644c122400 0x55644b25ac00 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x55644c12b7d0 tx=0x55644bf800c0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6e000640 1 -- 172.21.15.146:0/710090093 reap_dead start 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 shutdown_connections 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 >> 172.21.15.146:0/710090093 conn(0x55644bf4dc00 msgr2=0x55644b2df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 shutdown_connections 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/710090093 wait complete. 2024-04-24T23:09:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 msgr2=0x55644b258b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x55644c00ea50 tx=0x55644bf80d80 comp rx=0 tx=0).stop 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 shutdown_connections 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55644b1edc00 0x55644b259080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55644b1ed800 0x55644b258b00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 --2- 172.21.15.146:0/1855258615 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55644b1ecc00 0x55644b258580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.285+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 >> 172.21.15.146:0/1855258615 conn(0x55644b1ed000 msgr2=0x55644b2df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.286+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 shutdown_connections 2024-04-24T23:09:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.286+0000 7f9f6fef1280 1 -- 172.21.15.146:0/1855258615 wait complete. 2024-04-24T23:09:35.293 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.101960, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-04-24T23:09:35.293 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-04-24T23:09:35.293 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-04-24T23:09:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.374+0000 7fd07da11280 1 -- start start 2024-04-24T23:09:35.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 Processor -- start 2024-04-24T23:09:35.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069396f800 0x5606939dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069396fc00 0x5606939db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560694744180 con 0x56069396ec00 2024-04-24T23:09:35.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560694744300 con 0x56069396fc00 2024-04-24T23:09:35.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.375+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560694744480 con 0x56069396f800 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41032/0 (socket says 172.21.15.146:41032) 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 -- 172.21.15.146:0/4025724557 learned_addr learned my addr 172.21.15.146:0/4025724557 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 -- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069396f800 msgr2=0x5606939dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069396f800 0x5606939dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07c400640 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069396fc00 0x5606939db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 -- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069396fc00 msgr2=0x5606939db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069396fc00 0x5606939db080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 -- 172.21.15.146:0/4025724557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606939a2780 con 0x56069396ec00 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.376+0000 7fd07ba00640 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x56069478b140 tx=0x5606947009c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dd2cd401e0bc77 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd078800640 1 -- 172.21.15.146:0/4025724557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606939949c0 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd078800640 1 -- 172.21.15.146:0/4025724557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56069399a700 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd078800640 1 -- 172.21.15.146:0/4025724557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560693994680 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606939a34a0 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5606939a2000 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd07da11280 4 waiting for MDS map... 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd078800640 1 -- 172.21.15.146:0/4025724557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x560694836200 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd078800640 1 -- 172.21.15.146:0/4025724557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x5606939c9180 con 0x56069396ec00 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd07da11280 4 Got MDS map 74 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.377+0000 7fd07da11280 10 main: main 2024-04-24T23:09:35.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.378+0000 7fd07da11280 4 main: connecting to RADOS... 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.378+0000 7fd07da11280 1 Processor -- start 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.378+0000 7fd07da11280 1 -- start start 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c400 0x5606939dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c800 0x5606939dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560694744600 con 0x56069488c000 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560694744780 con 0x56069488c400 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560694744900 con 0x56069488c800 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41038/0 (socket says 172.21.15.146:41038) 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.379+0000 7fd07c400640 1 -- 172.21.15.146:0/1393252739 learned_addr learned my addr 172.21.15.146:0/1393252739 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 -- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c800 msgr2=0x5606939dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c800 0x5606939dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 -- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c400 msgr2=0x5606939dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c400 0x5606939dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 -- 172.21.15.146:0/1393252739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606939a23c0 con 0x56069488c000 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd07c400640 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x56069478b500 tx=0x56069482ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f3253fc458dcab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd076000640 1 -- 172.21.15.146:0/1393252739 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606939949c0 con 0x56069488c000 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd076000640 1 -- 172.21.15.146:0/1393252739 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56069399afc0 con 0x56069488c000 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.380+0000 7fd076000640 1 -- 172.21.15.146:0/1393252739 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560693994680 con 0x56069488c000 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 -- 172.21.15.146:0/1393252739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 msgr2=0x5606939db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x56069478b500 tx=0x56069482ccc0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 -- 172.21.15.146:0/1393252739 shutdown_connections 2024-04-24T23:09:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c800 0x5606939dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c400 0x5606939dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 --2- 172.21.15.146:0/1393252739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c000 0x5606939db600 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 -- 172.21.15.146:0/1393252739 >> 172.21.15.146:0/1393252739 conn(0x56069474bc00 msgr2=0x5606946ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 -- 172.21.15.146:0/1393252739 shutdown_connections 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 -- 172.21.15.146:0/1393252739 wait complete. 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.381+0000 7fd07da11280 1 Processor -- start 2024-04-24T23:09:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 -- start start 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c000 0x5606939dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c400 0x5606939dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 0x5606939dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560694745980 con 0x56069488c800 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560694744300 con 0x56069488c000 2024-04-24T23:09:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.382+0000 7fd07da11280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560694744c00 con 0x56069488c400 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 0x5606939dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 0x5606939dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41046/0 (socket says 172.21.15.146:41046) 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 -- 172.21.15.146:0/2089890133 learned_addr learned my addr 172.21.15.146:0/2089890133 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07ba00640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c400 0x5606939dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 -- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c400 msgr2=0x5606939dcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069488c400 0x5606939dcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 -- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c000 msgr2=0x5606939dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069488c000 0x5606939dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 -- 172.21.15.146:0/2089890133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606939a2960 con 0x56069488c800 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd07b000640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 0x5606939dc680 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x56069482b350 tx=0x56069482cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.383+0000 7fd074200640 1 -- 172.21.15.146:0/2089890133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606939949c0 con 0x56069488c800 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.384+0000 7fd074200640 1 -- 172.21.15.146:0/2089890133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56069399ae00 con 0x56069488c800 2024-04-24T23:09:35.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.384+0000 7fd074200640 1 -- 172.21.15.146:0/2089890133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560693994680 con 0x56069488c800 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.384+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606939a3680 con 0x56069488c800 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.384+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606939a3860 con 0x56069488c800 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.384+0000 7fd07da11280 4 main: resolving pool 11 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.385+0000 7fd074200640 1 -- 172.21.15.146:0/2089890133 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5606948a0c00 con 0x56069488c800 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.386+0000 7fd074200640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5606948acc00 0x5606939dd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.386+0000 7fd074200640 1 -- 172.21.15.146:0/2089890133 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x560694893800 con 0x56069488c800 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.386+0000 7fd07da11280 4 main: creating IoCtx.. 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.386+0000 7fd07da11280 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56069488cc00 0x5606939dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.386+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x56069488d000 con 0x56069488cc00 2024-04-24T23:09:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.387+0000 7fd07c400640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5606948acc00 0x5606939dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.387+0000 7fd07ba00640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56069488cc00 0x5606939dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.388+0000 7fd07ba00640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56069488cc00 0x5606939dc100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.388+0000 7fd07c400640 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5606948acc00 0x5606939dd700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56069478b500 tx=0x56069482cc00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07ba00640 1 -- 172.21.15.146:0/2089890133 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x5606946f0000 con 0x56069488cc00 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "snapserver": { 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "last_snap": 1, 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "last_created": 1, 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "last_destroyed": 1, 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_noop": [], 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "snaps": [], 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "need_to_purge": {}, 2024-04-24T23:09:35.392 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_update": [], 2024-04-24T23:09:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_destroy": [] 2024-04-24T23:09:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.393 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.393 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56069488cc00 msgr2=0x5606939dc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x56069488cc00 0x5606939dc100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5606948acc00 msgr2=0x5606939dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x5606948acc00 0x5606939dd700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56069478b500 tx=0x56069482cc00 comp rx=0 tx=0).stop 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 msgr2=0x5606939dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 --2- 172.21.15.146:0/2089890133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069488c800 0x5606939dc680 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x56069482b350 tx=0x56069482cea0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07b000640 1 -- 172.21.15.146:0/2089890133 reap_dead start 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 shutdown_connections 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 >> 172.21.15.146:0/2089890133 conn(0x56069474bc00 msgr2=0x5606946ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 shutdown_connections 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.389+0000 7fd07da11280 1 -- 172.21.15.146:0/2089890133 wait complete. 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 msgr2=0x5606939da580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x56069478b140 tx=0x5606947009c0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 shutdown_connections 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56069396fc00 0x5606939db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56069396f800 0x5606939dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 --2- 172.21.15.146:0/4025724557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56069396ec00 0x5606939da580 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 >> 172.21.15.146:0/4025724557 conn(0x56069396f000 msgr2=0x5606946ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 shutdown_connections 2024-04-24T23:09:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.390+0000 7fd07da11280 1 -- 172.21.15.146:0/4025724557 wait complete. 2024-04-24T23:09:35.397 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.104143, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:35.397 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:35.398 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-04-24T23:09:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.479+0000 7fdf1fe7a280 1 -- start start 2024-04-24T23:09:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.479+0000 7fdf1fe7a280 1 Processor -- start 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8800 0x55e7e166db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d9c00 0x55e7e166d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8000 con 0x55e7e1601c00 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8180 con 0x55e7e23d8800 2024-04-24T23:09:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e7e23c8300 con 0x55e7e23d9c00 2024-04-24T23:09:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41072/0 (socket says 172.21.15.146:41072) 2024-04-24T23:09:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.480+0000 7fdf1d600640 1 -- 172.21.15.146:0/833693223 learned_addr learned my addr 172.21.15.146:0/833693223 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 -- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d9c00 msgr2=0x55e7e166d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d9c00 0x55e7e166d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 -- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8800 msgr2=0x55e7e166db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8800 0x55e7e166db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 -- 172.21.15.146:0/833693223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e1634780 con 0x55e7e1601c00 2024-04-24T23:09:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1d600640 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x55e7e2431170 tx=0x55e7e2392360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdc48faaf064e5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1ae00640 1 -- 172.21.15.146:0/833693223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e1626d00 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1ae00640 1 -- 172.21.15.146:0/833693223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e7e162cc40 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1ae00640 1 -- 172.21.15.146:0/833693223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e16269c0 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e1634000 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e7e1635680 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1fe7a280 4 waiting for MDS map... 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.481+0000 7fdf1ae00640 1 -- 172.21.15.146:0/833693223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55e7e24d2600 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.482+0000 7fdf1ae00640 1 -- 172.21.15.146:0/833693223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55e7e165b180 con 0x55e7e1601c00 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.482+0000 7fdf1fe7a280 4 Got MDS map 74 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.482+0000 7fdf1fe7a280 10 main: main 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.482+0000 7fdf1fe7a280 4 main: connecting to RADOS... 2024-04-24T23:09:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.482+0000 7fdf1fe7a280 1 Processor -- start 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 -- start start 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8000 0x55e7e166d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e24d5800 0x55e7e166e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8480 con 0x55e7e24d5c00 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8600 con 0x55e7e23d8000 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.483+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e7e23c8780 con 0x55e7e24d5800 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41086/0 (socket says 172.21.15.146:41086) 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 -- 172.21.15.146:0/1013724815 learned_addr learned my addr 172.21.15.146:0/1013724815 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 -- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e24d5800 msgr2=0x55e7e166e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e24d5800 0x55e7e166e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 -- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8000 msgr2=0x55e7e166d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8000 0x55e7e166d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 -- 172.21.15.146:0/1013724815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e1635860 con 0x55e7e24d5c00 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf1d600640 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x55e7e2534030 tx=0x55e7e2392a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce23384b1c000a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf18600640 1 -- 172.21.15.146:0/1013724815 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e16264e0 con 0x55e7e24d5c00 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf18600640 1 -- 172.21.15.146:0/1013724815 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e7e162c1c0 con 0x55e7e24d5c00 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.484+0000 7fdf18600640 1 -- 172.21.15.146:0/1013724815 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e1626d00 con 0x55e7e24d5c00 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/1013724815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 msgr2=0x55e7e166e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x55e7e2534030 tx=0x55e7e2392a20 comp rx=0 tx=0).stop 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/1013724815 shutdown_connections 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166e680 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e24d5800 0x55e7e166e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/1013724815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8000 0x55e7e166d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/1013724815 >> 172.21.15.146:0/1013724815 conn(0x55e7e23d8400 msgr2=0x55e7e16f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/1013724815 shutdown_connections 2024-04-24T23:09:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.485+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/1013724815 wait complete. 2024-04-24T23:09:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.486+0000 7fdf1fe7a280 1 Processor -- start 2024-04-24T23:09:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.486+0000 7fdf1fe7a280 1 -- start start 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d8000 0x55e7e166f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e24d5800 0x55e7e166f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8a80 con 0x55e7e24d5c00 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e7e23c8900 con 0x55e7e24d5800 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1fe7a280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55e7e23c9c80 con 0x55e7e23d8000 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41102/0 (socket says 172.21.15.146:41102) 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 -- 172.21.15.146:0/3601649713 learned_addr learned my addr 172.21.15.146:0/3601649713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1ea00640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d8000 0x55e7e166f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 -- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d8000 msgr2=0x55e7e166f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d8000 0x55e7e166f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 -- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e24d5800 msgr2=0x55e7e166f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e24d5800 0x55e7e166f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.487+0000 7fdf1d600640 1 -- 172.21.15.146:0/3601649713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e1634780 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf1d600640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166ec00 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x55e7e25342a0 tx=0x55e7e24f2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf16800640 1 -- 172.21.15.146:0/3601649713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e16269c0 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf16800640 1 -- 172.21.15.146:0/3601649713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e7e162c8c0 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf16800640 1 -- 172.21.15.146:0/3601649713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7e16261a0 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7e1634000 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e1635a40 con 0x55e7e24d5c00 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.488+0000 7fdf1fe7a280 4 main: resolving pool 11 2024-04-24T23:09:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.490+0000 7fdf16800640 1 -- 172.21.15.146:0/3601649713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55e7e2536c00 con 0x55e7e24d5c00 2024-04-24T23:09:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.490+0000 7fdf16800640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e7e253d000 0x55e7e196a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.490+0000 7fdf16800640 1 -- 172.21.15.146:0/3601649713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55e7e253a600 con 0x55e7e24d5c00 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.491+0000 7fdf1fe7a280 4 main: creating IoCtx.. 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.491+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e7e253d400 0x55e7e166e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.491+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55e7e253d800 con 0x55e7e253d400 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.491+0000 7fdf1ea00640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e7e253d000 0x55e7e196a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.491+0000 7fdf1e000640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e7e253d400 0x55e7e166e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.492+0000 7fdf1ea00640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e7e253d000 0x55e7e196a000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55e7e16e2990 tx=0x55e7e24f2f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.492+0000 7fdf1e000640 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e7e253d400 0x55e7e166e680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.493+0000 7fdf1e000640 1 -- 172.21.15.146:0/3601649713 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55e7e2382000 con 0x55e7e253d400 2024-04-24T23:09:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.493+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:2 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55e7e253dc00 con 0x55e7e253d400 2024-04-24T23:09:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1e000640 1 -- 172.21.15.146:0/3601649713 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55e7e2382000 con 0x55e7e253d400 2024-04-24T23:09:35.496 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions": [] 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.497 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e7e253d400 msgr2=0x55e7e166e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55e7e253d400 0x55e7e166e680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e7e253d000 msgr2=0x55e7e196a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55e7e253d000 0x55e7e196a000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55e7e16e2990 tx=0x55e7e24f2f60 comp rx=0 tx=0).stop 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 msgr2=0x55e7e166ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/3601649713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e24d5c00 0x55e7e166ec00 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x55e7e25342a0 tx=0x55e7e24f2c00 comp rx=0 tx=0).stop 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.494+0000 7fdf1e000640 1 -- 172.21.15.146:0/3601649713 reap_dead start 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 shutdown_connections 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 >> 172.21.15.146:0/3601649713 conn(0x55e7e23d8400 msgr2=0x55e7e16f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 shutdown_connections 2024-04-24T23:09:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/3601649713 wait complete. 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 msgr2=0x55e7e166cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x55e7e2431170 tx=0x55e7e2392360 comp rx=0 tx=0).stop 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 shutdown_connections 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55e7e23d9c00 0x55e7e166d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7e1601c00 0x55e7e166cb00 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 --2- 172.21.15.146:0/833693223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e7e23d8800 0x55e7e166db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 >> 172.21.15.146:0/833693223 conn(0x55e7e1601000 msgr2=0x55e7e16f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 shutdown_connections 2024-04-24T23:09:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.495+0000 7fdf1fe7a280 1 -- 172.21.15.146:0/833693223 wait complete. 2024-04-24T23:09:35.502 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.104770, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-04-24T23:09:35.502 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [] }, "result": 0 } } 2024-04-24T23:09:35.503 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-04-24T23:09:35.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.589+0000 7fb4e15d7280 1 -- start start 2024-04-24T23:09:35.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.589+0000 7fb4e15d7280 1 Processor -- start 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 0x55f30b0e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30b07dc00 0x55f30b0e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f30be52180 con 0x55f30b07d800 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f30be52300 con 0x55f30b07dc00 2024-04-24T23:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.590+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f30be52480 con 0x55f30b07cc00 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41118/0 (socket says 172.21.15.146:41118) 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 -- 172.21.15.146:0/3052952352 learned_addr learned my addr 172.21.15.146:0/3052952352 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4e0000640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30b07dc00 0x55f30b0e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4df600640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 0x55f30b0e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 -- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 msgr2=0x55f30b0e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 0x55f30b0e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 -- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30b07dc00 msgr2=0x55f30b0e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30b07dc00 0x55f30b0e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4dec00640 1 -- 172.21.15.146:0/3052952352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30b0b0780 con 0x55f30b07d800 2024-04-24T23:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.591+0000 7fb4df600640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 0x55f30b0e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dec00640 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x55f30bea31d0 tx=0x55f30be10180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58abe0a515a4c03f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dc400640 1 -- 172.21.15.146:0/3052952352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a2680 con 0x55f30b07d800 2024-04-24T23:09:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dc400640 1 -- 172.21.15.146:0/3052952352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f30b0a8700 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dc400640 1 -- 172.21.15.146:0/3052952352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a29c0 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30b0b1680 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f30b0b0000 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4e15d7280 4 waiting for MDS map... 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dc400640 1 -- 172.21.15.146:0/3052952352 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55f30bf44600 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4dc400640 1 -- 172.21.15.146:0/3052952352 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55f30b0d7180 con 0x55f30b07d800 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.592+0000 7fb4e15d7280 4 Got MDS map 74 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.593+0000 7fb4e15d7280 10 main: main 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.593+0000 7fb4e15d7280 4 main: connecting to RADOS... 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.593+0000 7fb4e15d7280 1 Processor -- start 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.593+0000 7fb4e15d7280 1 -- start start 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41400 0x55f30b0e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41800 0x55f30b0e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f30be52600 con 0x55f30bf41c00 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f30be52780 con 0x55f30bf41400 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f30be52900 con 0x55f30bf41800 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.594+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41124/0 (socket says 172.21.15.146:41124) 2024-04-24T23:09:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 -- 172.21.15.146:0/97522732 learned_addr learned my addr 172.21.15.146:0/97522732 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 -- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41800 msgr2=0x55f30b0e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41800 0x55f30b0e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 -- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41400 msgr2=0x55f30b0e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41400 0x55f30b0e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 -- 172.21.15.146:0/97522732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30b0b03c0 con 0x55f30bf41c00 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4dec00640 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x55f30bfb4000 tx=0x55f30b0f9020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea1132f679e95b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4d9c00640 1 -- 172.21.15.146:0/97522732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a2680 con 0x55f30bf41c00 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4d9c00640 1 -- 172.21.15.146:0/97522732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f30b0a8fc0 con 0x55f30bf41c00 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.595+0000 7fb4d9c00640 1 -- 172.21.15.146:0/97522732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a29c0 con 0x55f30bf41c00 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 -- 172.21.15.146:0/97522732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 msgr2=0x55f30b0ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x55f30bfb4000 tx=0x55f30b0f9020 comp rx=0 tx=0).stop 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 -- 172.21.15.146:0/97522732 shutdown_connections 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea100 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41800 0x55f30b0e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/97522732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41400 0x55f30b0e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 -- 172.21.15.146:0/97522732 >> 172.21.15.146:0/97522732 conn(0x55f30bf41000 msgr2=0x55f30bdfb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 -- 172.21.15.146:0/97522732 shutdown_connections 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.596+0000 7fb4e15d7280 1 -- 172.21.15.146:0/97522732 wait complete. 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.597+0000 7fb4e15d7280 1 Processor -- start 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.597+0000 7fb4e15d7280 1 -- start start 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41400 0x55f30b0eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41800 0x55f30b0eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f30be53c80 con 0x55f30bf41c00 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f30be52a80 con 0x55f30bf41800 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e15d7280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55f30be53b00 con 0x55f30bf41400 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41130/0 (socket says 172.21.15.146:41130) 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 -- 172.21.15.146:0/2104018828 learned_addr learned my addr 172.21.15.146:0/2104018828 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4df600640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41800 0x55f30b0eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4e0000640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41400 0x55f30b0eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 -- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41400 msgr2=0x55f30b0eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30bf41400 0x55f30b0eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 -- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41800 msgr2=0x55f30b0eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30bf41800 0x55f30b0eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.598+0000 7fb4dec00640 1 -- 172.21.15.146:0/2104018828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30b0b14a0 con 0x55f30bf41c00 2024-04-24T23:09:35.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4dec00640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55f30bfb4270 tx=0x55f30bf5f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4d7e00640 1 -- 172.21.15.146:0/2104018828 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a2b60 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4d7e00640 1 -- 172.21.15.146:0/2104018828 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f30b0a8e00 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4d7e00640 1 -- 172.21.15.146:0/2104018828 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f30b0a2680 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f30b0b0780 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30b0b1680 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.599+0000 7fb4e15d7280 4 main: resolving pool 11 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.601+0000 7fb4d7e00640 1 -- 172.21.15.146:0/2104018828 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55f30bfbac00 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.601+0000 7fb4d7e00640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f30bfb7000 0x55f30b0eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.601+0000 7fb4d7e00640 1 -- 172.21.15.146:0/2104018828 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55f30bfb8c00 con 0x55f30bf41c00 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.602+0000 7fb4e15d7280 4 main: creating IoCtx.. 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.602+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f30bfb7400 0x55f30b0ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.602+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55f30bfb7800 con 0x55f30bfb7400 2024-04-24T23:09:35.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.602+0000 7fb4e0000640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f30bfb7000 0x55f30b0eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.602+0000 7fb4df600640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f30bfb7400 0x55f30b0ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.604+0000 7fb4df600640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f30bfb7400 0x55f30b0ea100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.604+0000 7fb4e0000640 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f30bfb7000 0x55f30b0eb700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55f30be067e0 tx=0x55f30b384ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.604+0000 7fb4df600640 1 -- 172.21.15.146:0/2104018828 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55f30bdfe000 con 0x55f30bfb7400 2024-04-24T23:09:35.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.604+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- osd_op(unknown.0.0:2 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55f30bfb7c00 con 0x55f30bfb7400 2024-04-24T23:09:35.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4df600640 1 -- 172.21.15.146:0/2104018828 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55f30bdfe000 con 0x55f30bfb7400 2024-04-24T23:09:35.607 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.607 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:35.607 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions": [] 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.608 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f30bfb7400 msgr2=0x55f30b0ea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x55f30bfb7400 0x55f30b0ea100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f30bfb7000 msgr2=0x55f30b0eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55f30bfb7000 0x55f30b0eb700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55f30be067e0 tx=0x55f30b384ae0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 msgr2=0x55f30b0ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/2104018828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30bf41c00 0x55f30b0ea680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55f30bfb4270 tx=0x55f30bf5f800 comp rx=0 tx=0).stop 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.605+0000 7fb4df600640 1 -- 172.21.15.146:0/2104018828 reap_dead start 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 shutdown_connections 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 >> 172.21.15.146:0/2104018828 conn(0x55f30bf41000 msgr2=0x55f30bdfb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 shutdown_connections 2024-04-24T23:09:35.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/2104018828 wait complete. 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 msgr2=0x55f30b0e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x55f30bea31d0 tx=0x55f30be10180 comp rx=0 tx=0).stop 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 shutdown_connections 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f30b07dc00 0x55f30b0e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f30b07d800 0x55f30b0e8b00 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 --2- 172.21.15.146:0/3052952352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55f30b07cc00 0x55f30b0e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 >> 172.21.15.146:0/3052952352 conn(0x55f30b07d000 msgr2=0x55f30bdfa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 shutdown_connections 2024-04-24T23:09:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.606+0000 7fb4e15d7280 1 -- 172.21.15.146:0/3052952352 wait complete. 2024-04-24T23:09:35.613 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.110709, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-04-24T23:09:35.613 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-04-24T23:09:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.698+0000 7f47b9288280 1 -- start start 2024-04-24T23:09:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.698+0000 7f47b9288280 1 Processor -- start 2024-04-24T23:09:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 0x55a86ad4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 0x55a86ad4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98180 con 0x55a86acdfc00 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98300 con 0x55a86acdec00 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.699+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a86bb98480 con 0x55a86acdf800 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41136/0 (socket says 172.21.15.146:41136) 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 -- 172.21.15.146:0/3747076964 learned_addr learned my addr 172.21.15.146:0/3747076964 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7400640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 0x55a86ad4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 0x55a86ad4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 -- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 msgr2=0x55a86ad4ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 0x55a86ad4ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 -- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 msgr2=0x55a86ad4a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 0x55a86ad4a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7e00640 1 -- 172.21.15.146:0/3747076964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86ad12780 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b7400640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 0x55a86ad4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.700+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 0x55a86ad4ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b7e00640 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x55a86bb011d0 tx=0x55a86ba72180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1970a16cfd29cc41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b4200640 1 -- 172.21.15.146:0/3747076964 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad04680 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b4200640 1 -- 172.21.15.146:0/3747076964 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a86ad0aa80 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b4200640 1 -- 172.21.15.146:0/3747076964 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad04b60 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86ad123c0 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a86ad13680 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b9288280 4 waiting for MDS map... 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b4200640 1 -- 172.21.15.146:0/3747076964 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55a86bbaa600 con 0x55a86acdfc00 2024-04-24T23:09:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.701+0000 7f47b4200640 1 -- 172.21.15.146:0/3747076964 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55a86ad39180 con 0x55a86acdfc00 2024-04-24T23:09:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.702+0000 7f47b9288280 4 Got MDS map 74 2024-04-24T23:09:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.702+0000 7f47b9288280 10 main: main 2024-04-24T23:09:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.702+0000 7f47b9288280 4 main: connecting to RADOS... 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.702+0000 7f47b9288280 1 Processor -- start 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 -- start start 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad400 0x55a86ad4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbad800 0x55a86ad4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98600 con 0x55a86bbadc00 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98780 con 0x55a86bbad400 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a86bb98900 con 0x55a86bbad800 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.703+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41150/0 (socket says 172.21.15.146:41150) 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 -- 172.21.15.146:0/2923043883 learned_addr learned my addr 172.21.15.146:0/2923043883 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad400 0x55a86ad4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b7400640 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbad800 0x55a86ad4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 -- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbad800 msgr2=0x55a86ad4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbad800 0x55a86ad4bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 -- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad400 msgr2=0x55a86ad4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad400 0x55a86ad4b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 -- 172.21.15.146:0/2923043883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86ad134a0 con 0x55a86bbadc00 2024-04-24T23:09:35.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b6a00640 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55a86bc160c0 tx=0x55a86bbc9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966c3ea4df87d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b1a00640 1 -- 172.21.15.146:0/2923043883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad04680 con 0x55a86bbadc00 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b1a00640 1 -- 172.21.15.146:0/2923043883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a86ad0afc0 con 0x55a86bbadc00 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.704+0000 7f47b1a00640 1 -- 172.21.15.146:0/2923043883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad04b60 con 0x55a86bbadc00 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 -- 172.21.15.146:0/2923043883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 msgr2=0x55a86ad4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55a86bc160c0 tx=0x55a86bbc9800 comp rx=0 tx=0).stop 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 -- 172.21.15.146:0/2923043883 shutdown_connections 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbadc00 0x55a86ad4c100 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbad800 0x55a86ad4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 --2- 172.21.15.146:0/2923043883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad400 0x55a86ad4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 -- 172.21.15.146:0/2923043883 >> 172.21.15.146:0/2923043883 conn(0x55a86bbad000 msgr2=0x55a86ba5d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 -- 172.21.15.146:0/2923043883 shutdown_connections 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.705+0000 7f47b9288280 1 -- 172.21.15.146:0/2923043883 wait complete. 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.706+0000 7f47b9288280 1 Processor -- start 2024-04-24T23:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.706+0000 7f47b9288280 1 -- start start 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 0x55a86ad4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad800 0x55a86ad4cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbadc00 0x55a86ad4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98900 con 0x55a86bbad400 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a86bb98a80 con 0x55a86bbad800 2024-04-24T23:09:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b9288280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55a86bb98780 con 0x55a86bbadc00 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 0x55a86ad4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 0x55a86ad4d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41160/0 (socket says 172.21.15.146:41160) 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 -- 172.21.15.146:0/3731510627 learned_addr learned my addr 172.21.15.146:0/3731510627 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 -- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbadc00 msgr2=0x55a86ad4c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86bbadc00 0x55a86ad4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 -- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad800 msgr2=0x55a86ad4cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86bbad800 0x55a86ad4cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.707+0000 7f47b6a00640 1 -- 172.21.15.146:0/3731510627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86ad12780 con 0x55a86bbad400 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 0x55a86ad4d180 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55a86bc17380 tx=0x55a86ba708a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47afc00640 1 -- 172.21.15.146:0/3731510627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad044e0 con 0x55a86bbad400 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47afc00640 1 -- 172.21.15.146:0/3731510627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a86ad0ae00 con 0x55a86bbad400 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86ad123c0 con 0x55a86bbad400 2024-04-24T23:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47afc00640 1 -- 172.21.15.146:0/3731510627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a86ad04680 con 0x55a86bbad400 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86ad13680 con 0x55a86bbad400 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.708+0000 7f47b9288280 4 main: resolving pool 11 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47afc00640 1 -- 172.21.15.146:0/3731510627 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55a86bc1ac00 con 0x55a86bbad400 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47afc00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55a86bc20c00 0x55a86ad4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47afc00640 1 -- 172.21.15.146:0/3731510627 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55a86bc18a00 con 0x55a86bbad400 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47b9288280 4 main: creating IoCtx.. 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47b9288280 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55a86bc21000 0x55a86ad4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.710+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55a86bc21400 con 0x55a86bc21000 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.711+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55a86bc21000 0x55a86ad4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.711+0000 7f47b7400640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55a86bc20c00 0x55a86ad4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.711+0000 7f47b6a00640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55a86bc21000 0x55a86ad4c100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b6a00640 1 -- 172.21.15.146:0/3731510627 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55a86ba60000 con 0x55a86bc21000 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b7400640 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55a86bc20c00 0x55a86ad4d700 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55a86ad6fb00 tx=0x55a86ba70780 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55a86bc21000 msgr2=0x55a86ad4c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x55a86bc21000 0x55a86ad4c100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55a86bc20c00 msgr2=0x55a86ad4d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55a86bc20c00 0x55a86ad4d700 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55a86ad6fb00 tx=0x55a86ba70780 comp rx=0 tx=0).stop 2024-04-24T23:09:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 msgr2=0x55a86ad4d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 --2- 172.21.15.146:0/3731510627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86bbad400 0x55a86ad4d180 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55a86bc17380 tx=0x55a86ba708a0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b7400640 1 -- 172.21.15.146:0/3731510627 reap_dead start 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 shutdown_connections 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 >> 172.21.15.146:0/3731510627 conn(0x55a86bbad000 msgr2=0x55a86ba5d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 shutdown_connections 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.712+0000 7f47b9288280 1 -- 172.21.15.146:0/3731510627 wait complete. 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 msgr2=0x55a86ad4b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x55a86bb011d0 tx=0x55a86ba72180 comp rx=0 tx=0).stop 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 shutdown_connections 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a86acdfc00 0x55a86ad4b080 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55a86acdf800 0x55a86ad4ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 --2- 172.21.15.146:0/3747076964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a86acdec00 0x55a86ad4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 >> 172.21.15.146:0/3747076964 conn(0x55a86acdf000 msgr2=0x55a86ba5c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 shutdown_connections 2024-04-24T23:09:35.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.713+0000 7f47b9288280 1 -- 172.21.15.146:0/3747076964 wait complete. 2024-04-24T23:09:35.721 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.107935, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-04-24T23:09:35.722 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-04-24T23:09:35.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.814+0000 7fd02080e280 1 -- start start 2024-04-24T23:09:35.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.814+0000 7fd02080e280 1 Processor -- start 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d1287b6c00 0x55d128822580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d1287b7c00 0x55d128823080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d129546600 con 0x55d1287b7800 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d129546480 con 0x55d1287b7c00 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d129546300 con 0x55d1287b6c00 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd01d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd01d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41172/0 (socket says 172.21.15.146:41172) 2024-04-24T23:09:35.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd01d200640 1 -- 172.21.15.146:0/1211341900 learned_addr learned my addr 172.21.15.146:0/1211341900 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd01dc00640 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d1287b6c00 0x55d128822580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.815+0000 7fd01e600640 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d1287b7c00 0x55d128823080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 -- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d1287b6c00 msgr2=0x55d128822580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d1287b6c00 0x55d128822580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 -- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d1287b7c00 msgr2=0x55d128823080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d1287b7c00 0x55d128823080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 -- 172.21.15.146:0/1211341900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1287ea780 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01d200640 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x55d1295cf290 tx=0x55d12954a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf03623ef2437455 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01aa00640 1 -- 172.21.15.146:0/1211341900 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dc680 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01aa00640 1 -- 172.21.15.146:0/1211341900 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d1287e2e00 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd01aa00640 1 -- 172.21.15.146:0/1211341900 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dcb60 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1287eb4a0 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d1287ea000 con 0x55d1287b7800 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.816+0000 7fd02080e280 4 waiting for MDS map... 2024-04-24T23:09:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.817+0000 7fd01aa00640 1 -- 172.21.15.146:0/1211341900 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55d12968c600 con 0x55d1287b7800 2024-04-24T23:09:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.817+0000 7fd01aa00640 1 -- 172.21.15.146:0/1211341900 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x55d128811180 con 0x55d1287b7800 2024-04-24T23:09:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.817+0000 7fd02080e280 4 Got MDS map 74 2024-04-24T23:09:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.817+0000 7fd02080e280 10 main: main 2024-04-24T23:09:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.817+0000 7fd02080e280 4 main: connecting to RADOS... 2024-04-24T23:09:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.818+0000 7fd02080e280 1 Processor -- start 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.818+0000 7fd02080e280 1 -- start start 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679400 0x55d128823600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679c00 0x55d128824100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d129546180 con 0x55d129679800 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d128818480 con 0x55d129679400 2024-04-24T23:09:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d128818900 con 0x55d129679c00 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41180/0 (socket says 172.21.15.146:41180) 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 -- 172.21.15.146:0/700477341 learned_addr learned my addr 172.21.15.146:0/700477341 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 -- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679c00 msgr2=0x55d128824100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679c00 0x55d128824100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 -- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679400 msgr2=0x55d128823600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679400 0x55d128823600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.819+0000 7fd01dc00640 1 -- 172.21.15.146:0/700477341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1287ea3c0 con 0x55d129679800 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd01dc00640 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x55d1296f80f0 tx=0x55d1296a7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4534c8b405e7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd018200640 1 -- 172.21.15.146:0/700477341 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dc680 con 0x55d129679800 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd018200640 1 -- 172.21.15.146:0/700477341 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d1287e2a80 con 0x55d129679800 2024-04-24T23:09:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd018200640 1 -- 172.21.15.146:0/700477341 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dcb60 con 0x55d129679800 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd02080e280 1 -- 172.21.15.146:0/700477341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 msgr2=0x55d128823b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.820+0000 7fd02080e280 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x55d1296f80f0 tx=0x55d1296a7800 comp rx=0 tx=0).stop 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 -- 172.21.15.146:0/700477341 shutdown_connections 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679c00 0x55d128824100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128823b80 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 --2- 172.21.15.146:0/700477341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679400 0x55d128823600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 -- 172.21.15.146:0/700477341 >> 172.21.15.146:0/700477341 conn(0x55d129679000 msgr2=0x55d1288a8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 -- 172.21.15.146:0/700477341 shutdown_connections 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 -- 172.21.15.146:0/700477341 wait complete. 2024-04-24T23:09:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.821+0000 7fd02080e280 1 Processor -- start 2024-04-24T23:09:35.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 -- start start 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679400 0x55d128825180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128824c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679c00 0x55d128824680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d129547800 con 0x55d129679800 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d129546180 con 0x55d129679c00 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.822+0000 7fd02080e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d129546d80 con 0x55d129679400 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128824c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128824c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41194/0 (socket says 172.21.15.146:41194) 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 -- 172.21.15.146:0/2964755669 learned_addr learned my addr 172.21.15.146:0/2964755669 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01e600640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679400 0x55d128825180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01d200640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679c00 0x55d128824680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 -- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679400 msgr2=0x55d128825180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d129679400 0x55d128825180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 -- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679c00 msgr2=0x55d128824680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d129679c00 0x55d128824680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 -- 172.21.15.146:0/2964755669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1287ea780 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd01dc00640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128824c00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x55d1296f93b0 tx=0x55d129548540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd016400640 1 -- 172.21.15.146:0/2964755669 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dc4e0 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.823+0000 7fd016400640 1 -- 172.21.15.146:0/2964755669 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d1287e2a80 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.824+0000 7fd016400640 1 -- 172.21.15.146:0/2964755669 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d1287dc680 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.824+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1287eb4a0 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.824+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1287ea960 con 0x55d129679800 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.824+0000 7fd02080e280 4 main: resolving pool 11 2024-04-24T23:09:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.825+0000 7fd016400640 1 -- 172.21.15.146:0/2964755669 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x55d129706c00 con 0x55d129679800 2024-04-24T23:09:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.826+0000 7fd016400640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d1296fec00 0x55d128825700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.826+0000 7fd016400640 1 -- 172.21.15.146:0/2964755669 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x55d129700a00 con 0x55d129679800 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.826+0000 7fd02080e280 4 main: creating IoCtx.. 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.826+0000 7fd02080e280 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d1296ff000 0x55d128824100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.826+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84) -- 0x55d1296ff400 con 0x55d1296ff000 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.827+0000 7fd01e600640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d1296fec00 0x55d128825700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.827+0000 7fd01d200640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d1296ff000 0x55d128824100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.828+0000 7fd01e600640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d1296fec00 0x55d128825700 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55d1288479e0 tx=0x55d129548ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.828+0000 7fd01d200640 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d1296ff000 0x55d128824100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd01d200640 1 -- 172.21.15.146:0/2964755669 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55d129538000 con 0x55d1296ff000 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "snapserver": { 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "last_snap": 1, 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "last_created": 1, 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "last_destroyed": 1, 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_noop": [], 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "snaps": [], 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "need_to_purge": {}, 2024-04-24T23:09:35.832 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_update": [], 2024-04-24T23:09:35.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pending_destroy": [] 2024-04-24T23:09:35.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:35.833 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:09:35.833 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:35.833 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d1296ff000 msgr2=0x55d128824100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x55d1296ff000 0x55d128824100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d1296fec00 msgr2=0x55d128825700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x55d1296fec00 0x55d128825700 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55d1288479e0 tx=0x55d129548ae0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 msgr2=0x55d128824c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 --2- 172.21.15.146:0/2964755669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d129679800 0x55d128824c00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x55d1296f93b0 tx=0x55d129548540 comp rx=0 tx=0).stop 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd01dc00640 1 -- 172.21.15.146:0/2964755669 reap_dead start 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 shutdown_connections 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.829+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 >> 172.21.15.146:0/2964755669 conn(0x55d129679000 msgr2=0x55d1288a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 shutdown_connections 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/2964755669 wait complete. 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 msgr2=0x55d128822b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x55d1295cf290 tx=0x55d12954a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 shutdown_connections 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d1287b7c00 0x55d128823080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1287b7800 0x55d128822b00 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 --2- 172.21.15.146:0/1211341900 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d1287b6c00 0x55d128822580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:35.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 >> 172.21.15.146:0/1211341900 conn(0x55d1287b7000 msgr2=0x55d1288a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:35.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 shutdown_connections 2024-04-24T23:09:35.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:35.830+0000 7fd02080e280 1 -- 172.21.15.146:0/1211341900 wait complete. 2024-04-24T23:09:35.838 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.116120, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-04-24T23:09:35.838 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:09:35.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:35.933 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:36.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:09:36.043 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:36.043 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:36.044 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:36.100 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:36.100 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:36.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:36.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.351+0000 7fc25ca00640 1 Processor -- start 2024-04-24T23:09:36.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.351+0000 7fc25ca00640 1 -- start start 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc25ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc2580d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc25ca00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2580b36c0 con 0x7fc258161910 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc25ca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2580cf7d0 con 0x7fc2580d0910 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc25ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580cfab0 con 0x7fc258161530 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc24ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc258161910 0x7fc2580d0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43114/0 (socket says 172.21.15.146:43114) 2024-04-24T23:09:36.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.353+0000 7fc24ea00640 1 -- 172.21.15.146:0/1128530785 learned_addr learned my addr 172.21.15.146:0/1128530785 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:36.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc257400640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc2580d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886716792 0 0) 0x7fc2580b36c0 con 0x7fc258161910 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc23c003520 con 0x7fc258161910 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3575374400 0 0) 0x7fc23c003520 con 0x7fc258161910 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 msgr2=0x7fc2580d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc2580d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 >> v1:172.21.15.203:6789/0 conn(0x7fc2580d0910 legacy=0x7fc2580b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2580b3960 con 0x7fc258161910 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fc240001690 con 0x7fc258161910 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 >> v1:172.21.15.146:6789/0 conn(0x7fc258161910 legacy=0x7fc2580d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc23c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c003f60 0x7fc23c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23c004d40 0x7fc23c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580cfab0 con 0x7fc23c004d40 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c00bb30 con 0x7fc23c003f60 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.354+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc23c00bd30 con 0x7fc258161530 2024-04-24T23:09:36.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23c004d40 0x7fc23c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257400640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc23c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc24ea00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c003f60 0x7fc23c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 -- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 msgr2=0x7fc23c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc258161530 0x7fc23c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 -- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c003f60 msgr2=0x7fc23c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c003f60 0x7fc23c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.355+0000 7fc257e00640 1 -- 172.21.15.146:0/1128530785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c003520 con 0x7fc23c004d40 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.356+0000 7fc257e00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23c004d40 0x7fc23c0051c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc250001750 tx=0x7fc23c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33adee0df118b25b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.356+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250001370 con 0x7fc23c004d40 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.356+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2500052d0 con 0x7fc23c004d40 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.356+0000 7fc256a00640 1 -- 172.21.15.146:0/1128530785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25002abe0 con 0x7fc23c004d40 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 -- 172.21.15.146:0/1128530785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23c004d40 msgr2=0x7fc23c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 --2- 172.21.15.146:0/1128530785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23c004d40 0x7fc23c0051c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc250001750 tx=0x7fc23c005830 comp rx=0 tx=0).stop 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc257e00640 1 -- 172.21.15.146:0/1128530785 reap_dead start 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 -- 172.21.15.146:0/1128530785 shutdown_connections 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 -- 172.21.15.146:0/1128530785 >> 172.21.15.146:0/1128530785 conn(0x7fc2580d3cc0 msgr2=0x7fc2580d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 -- 172.21.15.146:0/1128530785 shutdown_connections 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.357+0000 7fc25ca00640 1 -- 172.21.15.146:0/1128530785 wait complete. 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.359+0000 7fc25ca00640 1 Processor -- start 2024-04-24T23:09:36.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.359+0000 7fc25ca00640 1 -- start start 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c004d40 0x7fc258158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2581593f0 0x7fc258159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d10b0 con 0x7fc25815e180 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d0f30 con 0x7fc23c004d40 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc25ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580cf3a0 con 0x7fc2581593f0 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc24ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc24ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41206/0 (socket says 172.21.15.146:41206) 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.360+0000 7fc24ea00640 1 -- 172.21.15.146:0/4022895816 learned_addr learned my addr 172.21.15.146:0/4022895816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc257400640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c004d40 0x7fc258158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc257e00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2581593f0 0x7fc258159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 -- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2581593f0 msgr2=0x7fc258159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2581593f0 0x7fc258159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 -- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c004d40 msgr2=0x7fc258158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c004d40 0x7fc258158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 -- 172.21.15.146:0/4022895816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25815a000 con 0x7fc25815e180 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24ea00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc24000e7d0 tx=0x7fc24000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000c870 con 0x7fc25815e180 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc240018070 con 0x7fc25815e180 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000cc30 con 0x7fc25815e180 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.361+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25815a2e0 con 0x7fc25815e180 2024-04-24T23:09:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.362+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25815a8a0 con 0x7fc25815e180 2024-04-24T23:09:36.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.363+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25804f500 con 0x7fc25815e180 2024-04-24T23:09:36.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.364+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc24001d460 con 0x7fc25815e180 2024-04-24T23:09:36.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.365+0000 7fc24fe00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 0x7fc23406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.365+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7fc24008af90 con 0x7fc25815e180 2024-04-24T23:09:36.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.366+0000 7fc257400640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 0x7fc23406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.367+0000 7fc257400640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 0x7fc23406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc248007520 tx=0x7fc24800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.369+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc240059680 con 0x7fc25815e180 2024-04-24T23:09:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.572+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc258160b30 con 0x7fc25815e180 2024-04-24T23:09:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.574+0000 7fc24fe00640 1 -- 172.21.15.146:0/4022895816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16909 (secure 0 0 0) 0x7fc240058f80 con 0x7fc25815e180 2024-04-24T23:09:36.576 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:36.576 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":84,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:26.215171+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.576+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 msgr2=0x7fc23406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.576+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 0x7fc23406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc248007520 tx=0x7fc24800b040 comp rx=0 tx=0).stop 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.576+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 msgr2=0x7fc25815e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.576+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc24000e7d0 tx=0x7fc24000ec90 comp rx=0 tx=0).stop 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 shutdown_connections 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fc23406be30 0x7fc23406e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2581593f0 0x7fc258159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc25815e180 0x7fc25815e600 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 --2- 172.21.15.146:0/4022895816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc23c004d40 0x7fc258158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 >> 172.21.15.146:0/4022895816 conn(0x7fc2580d3cc0 msgr2=0x7fc25806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:36.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 shutdown_connections 2024-04-24T23:09:36.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.577+0000 7fc25ca00640 1 -- 172.21.15.146:0/4022895816 wait complete. 2024-04-24T23:09:36.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:09:22.432204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:09:23.676356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:36.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:36.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.799+0000 7f6a95200640 1 Processor -- start 2024-04-24T23:09:36.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.799+0000 7f6a95200640 1 -- start start 2024-04-24T23:09:36.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a95200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a900ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a95200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a900ce5a0 0x7f6a90071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a95200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a900ced40 con 0x7f6a9013ef30 2024-04-24T23:09:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a95200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a901423d0 con 0x7f6a900ce5a0 2024-04-24T23:09:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a95200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a90070f80 con 0x7f6a90141c80 2024-04-24T23:09:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a8de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a9013ef30 0x7f6a90141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43126/0 (socket says 172.21.15.146:43126) 2024-04-24T23:09:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.801+0000 7f6a8de00640 1 -- 172.21.15.146:0/3667557058 learned_addr learned my addr 172.21.15.146:0/3667557058 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8d400640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a900ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8e800640 1 --2- 172.21.15.146:0/3667557058 >> v2:172.21.15.203:3300/0 conn(0x7f6a900ce5a0 0x7f6a90071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310582035 0 0) 0x7f6a900ced40 con 0x7f6a9013ef30 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a74003520 con 0x7f6a9013ef30 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116330913 0 0) 0x7f6a74003520 con 0x7f6a9013ef30 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 msgr2=0x7f6a900ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a900ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 >> v2:172.21.15.203:3300/0 conn(0x7f6a900ce5a0 msgr2=0x7f6a90071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 --2- 172.21.15.146:0/3667557058 >> v2:172.21.15.203:3300/0 conn(0x7f6a900ce5a0 0x7f6a90071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a900cf020 con 0x7f6a9013ef30 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.802+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6a80001670 con 0x7f6a9013ef30 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 >> v1:172.21.15.146:6789/0 conn(0x7f6a9013ef30 legacy=0x7f6a90141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a74003f30 0x7f6a74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a74004d40 0x7f6a740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90070f80 con 0x7f6a74003f30 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7400b9c0 con 0x7f6a74004d40 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7400bb40 con 0x7f6a90141c80 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a74003f30 0x7f6a74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8de00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8e800640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a74004d40 0x7f6a740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 -- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 msgr2=0x7f6a740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 -- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a74004d40 msgr2=0x7f6a740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a74004d40 0x7f6a740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8d400640 1 -- 172.21.15.146:0/3667557058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74003520 con 0x7f6a74003f30 2024-04-24T23:09:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8e800640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a74004d40 0x7f6a740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.803+0000 7f6a8de00640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a90141c80 0x7f6a740039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.804+0000 7f6a8d400640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a74003f30 0x7f6a74004800 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009ac0 tx=0x7f6a74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3053c6e0d70068c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78036070 con 0x7f6a74003f30 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a78031400 con 0x7f6a74003f30 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a8ca00640 1 -- 172.21.15.146:0/3667557058 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78009690 con 0x7f6a74003f30 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 -- 172.21.15.146:0/3667557058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a74003f30 msgr2=0x7f6a74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 --2- 172.21.15.146:0/3667557058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a74003f30 0x7f6a74004800 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009ac0 tx=0x7f6a74005830 comp rx=0 tx=0).stop 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a8e800640 1 -- 172.21.15.146:0/3667557058 reap_dead start 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 -- 172.21.15.146:0/3667557058 shutdown_connections 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 -- 172.21.15.146:0/3667557058 >> 172.21.15.146:0/3667557058 conn(0x7f6a900b17b0 msgr2=0x7f6a900b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 -- 172.21.15.146:0/3667557058 shutdown_connections 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.805+0000 7f6a95200640 1 -- 172.21.15.146:0/3667557058 wait complete. 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.807+0000 7f6a95200640 1 Processor -- start 2024-04-24T23:09:36.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.807+0000 7f6a95200640 1 -- start start 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a74003f30 0x7f6a901543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 0x7f6a900b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900cea50 con 0x7f6a90143420 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90070c10 con 0x7f6a900b34c0 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.808+0000 7f6a95200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a900ce060 con 0x7f6a74003f30 2024-04-24T23:09:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41226/0 (socket says 172.21.15.146:41226) 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 -- 172.21.15.146:0/2671171524 learned_addr learned my addr 172.21.15.146:0/2671171524 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8de00640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a74003f30 0x7f6a901543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8d400640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 0x7f6a900b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 -- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a74003f30 msgr2=0x7f6a901543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a74003f30 0x7f6a901543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 -- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 msgr2=0x7f6a900b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 0x7f6a900b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 -- 172.21.15.146:0/2671171524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a90144150 con 0x7f6a90143420 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8d400640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 0x7f6a900b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.809+0000 7f6a8e800640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6a90145b70 tx=0x7f6a8800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.810+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8801c070 con 0x7f6a90143420 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.810+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a88017400 con 0x7f6a90143420 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.810+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880177d0 con 0x7f6a90143420 2024-04-24T23:09:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.810+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a90144430 con 0x7f6a90143420 2024-04-24T23:09:36.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.810+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901449f0 con 0x7f6a90143420 2024-04-24T23:09:36.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.811+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9004f5a0 con 0x7f6a90143420 2024-04-24T23:09:36.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.812+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a8801f070 con 0x7f6a90143420 2024-04-24T23:09:36.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.813+0000 7f6a86000640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 0x7f6a6c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:36.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.813+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f6a8808b150 con 0x7f6a90143420 2024-04-24T23:09:36.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.814+0000 7f6a8de00640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 0x7f6a6c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:36.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.815+0000 7f6a8de00640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 0x7f6a6c06e370 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000f60 tx=0x7f6a80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:36.817+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a88012070 con 0x7f6a90143420 2024-04-24T23:09:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.015+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a9013ab70 con 0x7f6a90143420 2024-04-24T23:09:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.016+0000 7f6a86000640 1 -- 172.21.15.146:0/2671171524 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f6a88059950 con 0x7f6a90143420 2024-04-24T23:09:37.018 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:37.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.018+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 msgr2=0x7f6a6c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.018+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 0x7f6a6c06e370 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000f60 tx=0x7f6a80009040 comp rx=0 tx=0).stop 2024-04-24T23:09:37.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.018+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 msgr2=0x7f6a901438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.018+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f6a90145b70 tx=0x7f6a8800f4a0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 shutdown_connections 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90143420 0x7f6a901438a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a900b34c0 0x7f6a900b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a6c06beb0 0x7f6a6c06e370 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 --2- 172.21.15.146:0/2671171524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a74003f30 0x7f6a901543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 >> 172.21.15.146:0/2671171524 conn(0x7f6a900b17b0 msgr2=0x7f6a9006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 shutdown_connections 2024-04-24T23:09:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.019+0000 7f6a95200640 1 -- 172.21.15.146:0/2671171524 wait complete. 2024-04-24T23:09:37.040 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:09:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.245+0000 7f0245a00640 1 Processor -- start 2024-04-24T23:09:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.245+0000 7f0245a00640 1 -- start start 2024-04-24T23:09:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.246+0000 7f0245a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f024013ef30 0x7f0240141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f0245a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 0x7f02400ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f0245a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02400ce5a0 0x7f024015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f0245a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f02401423d0 con 0x7f02400ce5a0 2024-04-24T23:09:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f0245a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0240070f80 con 0x7f024013ef30 2024-04-24T23:09:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f0245a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02400ced40 con 0x7f0240141ab0 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f023f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02400ce5a0 0x7f024015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f023f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02400ce5a0 0x7f024015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41240/0 (socket says 172.21.15.146:41240) 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f023f400640 1 -- 172.21.15.146:0/2782418093 learned_addr learned my addr 172.21.15.146:0/2782418093 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f023ea00640 1 --2- 172.21.15.146:0/2782418093 >> v2:172.21.15.203:3300/0 conn(0x7f024013ef30 0x7f0240141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.247+0000 7f023e000640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 0x7f02400ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023f400640 1 -- 172.21.15.146:0/2782418093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 msgr2=0x7f02400ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023f400640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 0x7f02400ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023f400640 1 -- 172.21.15.146:0/2782418093 >> v2:172.21.15.203:3300/0 conn(0x7f024013ef30 msgr2=0x7f0240141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:37.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023f400640 1 --2- 172.21.15.146:0/2782418093 >> v2:172.21.15.203:3300/0 conn(0x7f024013ef30 0x7f0240141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023f400640 1 -- 172.21.15.146:0/2782418093 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02400cf020 con 0x7f02400ce5a0 2024-04-24T23:09:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.248+0000 7f023e000640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 0x7f02400ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f023f400640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024015fa00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f02400707a0 tx=0x7f023802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b44d2a399b13a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f023d600640 1 -- 172.21.15.146:0/2782418093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238036070 con 0x7f02400ce5a0 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f023d600640 1 -- 172.21.15.146:0/2782418093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0238031600 con 0x7f02400ce5a0 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f023d600640 1 -- 172.21.15.146:0/2782418093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380319d0 con 0x7f02400ce5a0 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f0245a00640 1 -- 172.21.15.146:0/2782418093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 msgr2=0x7f024015fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.249+0000 7f0245a00640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024015fa00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f02400707a0 tx=0x7f023802a6a0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 -- 172.21.15.146:0/2782418093 shutdown_connections 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024015fa00 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 --2- 172.21.15.146:0/2782418093 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0240141ab0 0x7f02400ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 --2- 172.21.15.146:0/2782418093 >> v2:172.21.15.203:3300/0 conn(0x7f024013ef30 0x7f0240141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 -- 172.21.15.146:0/2782418093 >> 172.21.15.146:0/2782418093 conn(0x7f02400b17b0 msgr2=0x7f02400b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 -- 172.21.15.146:0/2782418093 shutdown_connections 2024-04-24T23:09:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.250+0000 7f0245a00640 1 -- 172.21.15.146:0/2782418093 wait complete. 2024-04-24T23:09:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.251+0000 7f0245a00640 1 Processor -- start 2024-04-24T23:09:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.252+0000 7f0245a00640 1 -- start start 2024-04-24T23:09:37.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.252+0000 7f0245a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.252+0000 7f0245a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f024013ef30 0x7f024013cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f0245a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 0x7f024013d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f0245a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02400cea30 con 0x7f02400ce5a0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f0245a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0240070c10 con 0x7f0240141ab0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f0245a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f024015ff40 con 0x7f024013ef30 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41256/0 (socket says 172.21.15.146:41256) 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 -- 172.21.15.146:0/662445228 learned_addr learned my addr 172.21.15.146:0/662445228 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023f400640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 0x7f024013d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 -- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f024013ef30 msgr2=0x7f024013cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023e000640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f024013ef30 0x7f024013cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f024013ef30 0x7f024013cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 -- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 msgr2=0x7f024013d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 0x7f024013d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023ea00640 1 -- 172.21.15.146:0/662445228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024013a860 con 0x7f02400ce5a0 2024-04-24T23:09:37.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.253+0000 7f023f400640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 0x7f024013d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f023ea00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f023000d800 tx=0x7f023000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023000b6c0 con 0x7f02400ce5a0 2024-04-24T23:09:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0230019070 con 0x7f02400ce5a0 2024-04-24T23:09:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023000ba80 con 0x7f02400ce5a0 2024-04-24T23:09:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02400b2fe0 con 0x7f02400ce5a0 2024-04-24T23:09:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.254+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02400b35a0 con 0x7f02400ce5a0 2024-04-24T23:09:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.255+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024004f5a0 con 0x7f02400ce5a0 2024-04-24T23:09:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.256+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f023000bc20 con 0x7f02400ce5a0 2024-04-24T23:09:37.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.257+0000 7f0236a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 0x7f022006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.257+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f023008b4d0 con 0x7f02400ce5a0 2024-04-24T23:09:37.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.258+0000 7f023e000640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 0x7f022006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.259+0000 7f023e000640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 0x7f022006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f02400b2f10 tx=0x7f022c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.261+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f024013a860 con 0x7f02400ce5a0 2024-04-24T23:09:37.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.460+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02400cd4b0 con 0x7f02400ce5a0 2024-04-24T23:09:37.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.461+0000 7f0236a00640 1 -- 172.21.15.146:0/662445228 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f023001c360 con 0x7f02400ce5a0 2024-04-24T23:09:37.463 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:09:37.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 msgr2=0x7f022006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 0x7f022006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f02400b2f10 tx=0x7f022c008040 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 msgr2=0x7f024013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f023000d800 tx=0x7f023000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 shutdown_connections 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0240141ab0 0x7f024013d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f022006be30 0x7f022006e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f024013ef30 0x7f024013cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 --2- 172.21.15.146:0/662445228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02400ce5a0 0x7f024013b380 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 >> 172.21.15.146:0/662445228 conn(0x7f02400b17b0 msgr2=0x7f02400aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 shutdown_connections 2024-04-24T23:09:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.464+0000 7f0245a00640 1 -- 172.21.15.146:0/662445228 wait complete. 2024-04-24T23:09:37.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:09:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.686+0000 7f41c3000640 1 Processor -- start 2024-04-24T23:09:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.686+0000 7f41c3000640 1 -- start start 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc0d03d0 0x7f41bc15e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c3000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41bc162580 0x7f41bc15e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c3000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41bc15f070 con 0x7f41bc158300 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c3000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f41bc0b2ae0 con 0x7f41bc162580 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41bc161aa0 con 0x7f41bc0d03d0 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c2600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41bc162580 0x7f41bc15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c2600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41bc162580 0x7f41bc15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41268/0 (socket says 172.21.15.146:41268) 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.688+0000 7f41c2600640 1 -- 172.21.15.146:0/681282804 learned_addr learned my addr 172.21.15.146:0/681282804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.689+0000 7f41c1200640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc0d03d0 0x7f41bc15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.689+0000 7f41c2600640 1 -- 172.21.15.146:0/681282804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc0d03d0 msgr2=0x7f41bc15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.689+0000 7f41c2600640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc0d03d0 0x7f41bc15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.689+0000 7f41c2600640 1 -- 172.21.15.146:0/681282804 >> v1:172.21.15.203:6789/0 conn(0x7f41bc158300 legacy=0x7f41bc0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.689+0000 7f41c2600640 1 -- 172.21.15.146:0/681282804 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc161d80 con 0x7f41bc162580 2024-04-24T23:09:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.690+0000 7f41c2600640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc15e850 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009e50 tx=0x7f41b402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f93280eee0aa9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.690+0000 7f41bbe00640 1 -- 172.21.15.146:0/681282804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4036070 con 0x7f41bc162580 2024-04-24T23:09:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.690+0000 7f41bbe00640 1 -- 172.21.15.146:0/681282804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4031600 con 0x7f41bc162580 2024-04-24T23:09:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.690+0000 7f41bbe00640 1 -- 172.21.15.146:0/681282804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b40319d0 con 0x7f41bc162580 2024-04-24T23:09:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 -- 172.21.15.146:0/681282804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 msgr2=0x7f41bc15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc15e850 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009e50 tx=0x7f41b402a750 comp rx=0 tx=0).stop 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 -- 172.21.15.146:0/681282804 shutdown_connections 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc15e850 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 --2- 172.21.15.146:0/681282804 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc0d03d0 0x7f41bc15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 -- 172.21.15.146:0/681282804 >> 172.21.15.146:0/681282804 conn(0x7f41bc06b560 msgr2=0x7f41bc06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 -- 172.21.15.146:0/681282804 shutdown_connections 2024-04-24T23:09:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.691+0000 7f41c3000640 1 -- 172.21.15.146:0/681282804 wait complete. 2024-04-24T23:09:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.693+0000 7f41c3000640 1 Processor -- start 2024-04-24T23:09:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.693+0000 7f41c3000640 1 -- start start 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41bc0d03d0 0x7f41bc148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc158300 0x7f41bc1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1586e0 con 0x7f41bc162580 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc15ed90 con 0x7f41bc0d03d0 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41bc06cab0 con 0x7f41bc158300 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c2600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c2600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41280/0 (socket says 172.21.15.146:41280) 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.694+0000 7f41c2600640 1 -- 172.21.15.146:0/142383433 learned_addr learned my addr 172.21.15.146:0/142383433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 -- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc158300 msgr2=0x7f41bc1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc158300 0x7f41bc1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 -- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41bc0d03d0 msgr2=0x7f41bc148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41bc0d03d0 0x7f41bc148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 -- 172.21.15.146:0/142383433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc14e860 con 0x7f41bc162580 2024-04-24T23:09:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c2600640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009e50 tx=0x7f41b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4036050 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4042070 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4009510 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc152150 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.695+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc152710 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.697+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41bc04f500 con 0x7f41bc162580 2024-04-24T23:09:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.698+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41b4007bb0 con 0x7f41bc162580 2024-04-24T23:09:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.698+0000 7f41b9600640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 0x7f419c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.699+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f41b40abe70 con 0x7f41bc162580 2024-04-24T23:09:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.699+0000 7f41c1c00640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 0x7f419c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.700+0000 7f41c1c00640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 0x7f419c06e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f41ac003cc0 tx=0x7f41ac0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:37.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.703+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41b4045360 con 0x7f41bc162580 2024-04-24T23:09:37.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.901+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f41bc1612d0 con 0x7f41bc162580 2024-04-24T23:09:37.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.902+0000 7f41b9600640 1 -- 172.21.15.146:0/142383433 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f41b407a720 con 0x7f41bc162580 2024-04-24T23:09:37.905 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:09:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 msgr2=0x7f419c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 0x7f419c06e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f41ac003cc0 tx=0x7f41ac0079b0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 msgr2=0x7f41bc156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009e50 tx=0x7f41b4004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 shutdown_connections 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41bc162580 0x7f41bc156ee0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f419c06be30 0x7f419c06e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41bc158300 0x7f41bc1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 --2- 172.21.15.146:0/142383433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41bc0d03d0 0x7f41bc148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 >> 172.21.15.146:0/142383433 conn(0x7f41bc06b560 msgr2=0x7f41bc0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 shutdown_connections 2024-04-24T23:09:37.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:37.905+0000 7f41c3000640 1 -- 172.21.15.146:0/142383433 wait complete. 2024-04-24T23:09:37.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:09:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.131+0000 7f7e74a00640 1 Processor -- start 2024-04-24T23:09:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.131+0000 7f7e74a00640 1 -- start start 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e74a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e7015ae50 0x7f7e7006e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e74a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e700af0a0 con 0x7f7e70071370 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e74a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7e70071800 con 0x7f7e7015ae50 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e74a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700b2860 con 0x7f7e700709d0 2024-04-24T23:09:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e6f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e7015ae50 0x7f7e7006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e6fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7e70071370 0x7f7e7015e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58754/0 (socket says 172.21.15.146:58754) 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.133+0000 7f7e6fe00640 1 -- 172.21.15.146:0/2142782889 learned_addr learned my addr 172.21.15.146:0/2142782889 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.134+0000 7f7e6f400640 1 -- 172.21.15.146:0/2142782889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 msgr2=0x7f7e70070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.134+0000 7f7e6f400640 1 --2- 172.21.15.146:0/2142782889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.134+0000 7f7e6f400640 1 -- 172.21.15.146:0/2142782889 >> v1:172.21.15.146:6789/0 conn(0x7f7e70071370 legacy=0x7f7e7015e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.134+0000 7f7e6f400640 1 -- 172.21.15.146:0/2142782889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7006cbe0 con 0x7f7e7015ae50 2024-04-24T23:09:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.135+0000 7f7e6f400640 1 --2- 172.21.15.146:0/2142782889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e7006e370 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7e600097a0 tx=0x7f7e6002c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df41e3fac0b8cd0d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.135+0000 7f7e6ea00640 1 -- 172.21.15.146:0/2142782889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60039070 con 0x7f7e7015ae50 2024-04-24T23:09:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.135+0000 7f7e6ea00640 1 -- 172.21.15.146:0/2142782889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e60034640 con 0x7f7e7015ae50 2024-04-24T23:09:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.135+0000 7f7e6ea00640 1 -- 172.21.15.146:0/2142782889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60034a10 con 0x7f7e7015ae50 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 -- 172.21.15.146:0/2142782889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 msgr2=0x7f7e7006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 --2- 172.21.15.146:0/2142782889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e7006e370 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7e600097a0 tx=0x7f7e6002c390 comp rx=0 tx=0).stop 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 -- 172.21.15.146:0/2142782889 shutdown_connections 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 --2- 172.21.15.146:0/2142782889 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 --2- 172.21.15.146:0/2142782889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e7006e370 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 -- 172.21.15.146:0/2142782889 >> 172.21.15.146:0/2142782889 conn(0x7f7e700b1560 msgr2=0x7f7e700b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 -- 172.21.15.146:0/2142782889 shutdown_connections 2024-04-24T23:09:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.136+0000 7f7e74a00640 1 -- 172.21.15.146:0/2142782889 wait complete. 2024-04-24T23:09:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.138+0000 7f7e74a00640 1 Processor -- start 2024-04-24T23:09:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.138+0000 7f7e74a00640 1 -- start start 2024-04-24T23:09:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 0x7f7e700aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700b41b0 con 0x7f7e7015ae50 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700b4030 con 0x7f7e70071370 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e74a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700b4330 con 0x7f7e700709d0 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34018/0 (socket says 172.21.15.146:34018) 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.139+0000 7f7e6fe00640 1 -- 172.21.15.146:0/4086165940 learned_addr learned my addr 172.21.15.146:0/4086165940 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6f400640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e67e00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 0x7f7e700aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 -- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 msgr2=0x7f7e70149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 -- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 msgr2=0x7f7e700aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 0x7f7e700aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 -- 172.21.15.146:0/4086165940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e701f7fe0 con 0x7f7e7015ae50 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e67e00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 0x7f7e700aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e6fe00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800cbc0 tx=0x7f7e6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68017070 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6800ad40 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012600 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e701f82c0 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.140+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e70149e70 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.142+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7004f500 con 0x7f7e7015ae50 2024-04-24T23:09:38.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.142+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e6801a070 con 0x7f7e7015ae50 2024-04-24T23:09:38.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.143+0000 7f7e67400640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 0x7f7e4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.144+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f7e6808ac90 con 0x7f7e7015ae50 2024-04-24T23:09:38.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.144+0000 7f7e6f400640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 0x7f7e4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.145+0000 7f7e6f400640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 0x7f7e4c06e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e60036000 tx=0x7f7e60030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.148+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7e700af0a0 con 0x7f7e7015ae50 2024-04-24T23:09:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.364+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e700aeb30 con 0x7f7e7015ae50 2024-04-24T23:09:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.365+0000 7f7e67400640 1 -- 172.21.15.146:0/4086165940 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) ==== 80+0+0 (secure 0 0 0) 0x7f7e68058e50 con 0x7f7e7015ae50 2024-04-24T23:09:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.367+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 msgr2=0x7f7e4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.367+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 0x7f7e4c06e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e60036000 tx=0x7f7e60030000 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.367+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 msgr2=0x7f7e701f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.367+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800cbc0 tx=0x7f7e6800a430 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 shutdown_connections 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e7015ae50 0x7f7e701f7670 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e70071370 0x7f7e700aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7e4c06be30 0x7f7e4c06e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 --2- 172.21.15.146:0/4086165940 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e700709d0 0x7f7e70149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 >> 172.21.15.146:0/4086165940 conn(0x7f7e700b1560 msgr2=0x7f7e7006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:38.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 shutdown_connections 2024-04-24T23:09:38.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.368+0000 7f7e74a00640 1 -- 172.21.15.146:0/4086165940 wait complete. 2024-04-24T23:09:38.390 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:09:38.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:38.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:09:38.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:09:38.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:09:38.485 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:09:38.535 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:38.535 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:38.535 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:38.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:38.594 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:38.594 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:38.594 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:38.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:38.651 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:09:38.651 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:38.651 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:38.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:38.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.915+0000 7f44d2e00640 1 Processor -- start 2024-04-24T23:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.915+0000 7f44d2e00640 1 -- start start 2024-04-24T23:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f44cc158590 0x7f44cc162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0715f0 0x7f44cc071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44cc0cfc90 0x7f44cc0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc162990 con 0x7f44cc0cfc90 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc158970 con 0x7f44cc158590 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.916+0000 7f44d2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc070c10 con 0x7f44cc0715f0 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44cc0cfc90 0x7f44cc0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44cc0cfc90 0x7f44cc0d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34022/0 (socket says 172.21.15.146:34022) 2024-04-24T23:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 -- 172.21.15.146:0/94410162 learned_addr learned my addr 172.21.15.146:0/94410162 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44cbe00640 1 --2- 172.21.15.146:0/94410162 >> v2:172.21.15.203:3300/0 conn(0x7f44cc158590 0x7f44cc162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44c3400640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0715f0 0x7f44cc071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 -- 172.21.15.146:0/94410162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0715f0 msgr2=0x7f44cc071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0715f0 0x7f44cc071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 -- 172.21.15.146:0/94410162 >> v2:172.21.15.203:3300/0 conn(0x7f44cc158590 msgr2=0x7f44cc162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 --2- 172.21.15.146:0/94410162 >> v2:172.21.15.203:3300/0 conn(0x7f44cc158590 0x7f44cc162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.917+0000 7f44d0e00640 1 -- 172.21.15.146:0/94410162 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc070ef0 con 0x7f44cc0cfc90 2024-04-24T23:09:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.918+0000 7f44d0e00640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0cfc90 0x7f44cc0d0120 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0aed80 tx=0x7f44c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e556c445b19b040 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44cb400640 1 -- 172.21.15.146:0/94410162 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4036070 con 0x7f44cc0cfc90 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44cb400640 1 -- 172.21.15.146:0/94410162 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4031600 con 0x7f44cc0cfc90 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44cb400640 1 -- 172.21.15.146:0/94410162 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40319d0 con 0x7f44cc0cfc90 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 -- 172.21.15.146:0/94410162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0cfc90 msgr2=0x7f44cc0d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0cfc90 0x7f44cc0d0120 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0aed80 tx=0x7f44c402a730 comp rx=0 tx=0).stop 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 -- 172.21.15.146:0/94410162 shutdown_connections 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0cfc90 0x7f44cc0d0120 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 --2- 172.21.15.146:0/94410162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0715f0 0x7f44cc071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 --2- 172.21.15.146:0/94410162 >> v2:172.21.15.203:3300/0 conn(0x7f44cc158590 0x7f44cc162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 -- 172.21.15.146:0/94410162 >> 172.21.15.146:0/94410162 conn(0x7f44cc06b320 msgr2=0x7f44cc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 -- 172.21.15.146:0/94410162 shutdown_connections 2024-04-24T23:09:38.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.919+0000 7f44d2e00640 1 -- 172.21.15.146:0/94410162 wait complete. 2024-04-24T23:09:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.921+0000 7f44d2e00640 1 Processor -- start 2024-04-24T23:09:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.921+0000 7f44d2e00640 1 -- start start 2024-04-24T23:09:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0cfc90 0x7f44cc159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 0x7f44cc159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc161f30 con 0x7f44cc0715f0 2024-04-24T23:09:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc161c50 con 0x7f44cc158590 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.922+0000 7f44d2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc15e4e0 con 0x7f44cc0cfc90 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34038/0 (socket says 172.21.15.146:34038) 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 -- 172.21.15.146:0/2407092874 learned_addr learned my addr 172.21.15.146:0/2407092874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44d0e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 0x7f44cc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 -- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0cfc90 msgr2=0x7f44cc159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44c3400640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0cfc90 0x7f44cc159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0cfc90 0x7f44cc159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 -- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 msgr2=0x7f44cc159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 0x7f44cc159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 -- 172.21.15.146:0/2407092874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc15b9a0 con 0x7f44cc0715f0 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44d0e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 0x7f44cc159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.923+0000 7f44cbe00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00d5f0 tx=0x7f44bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.924+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0125f0 con 0x7f44cc0715f0 2024-04-24T23:09:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.924+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc019070 con 0x7f44cc0715f0 2024-04-24T23:09:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.924+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0129d0 con 0x7f44cc0715f0 2024-04-24T23:09:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.924+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44cc15b3e0 con 0x7f44cc0715f0 2024-04-24T23:09:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.924+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44cc153110 con 0x7f44cc0715f0 2024-04-24T23:09:38.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.925+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44cc068190 con 0x7f44cc0715f0 2024-04-24T23:09:38.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.926+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44bc012b70 con 0x7f44cc0715f0 2024-04-24T23:09:38.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.927+0000 7f44c8c00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 0x7f44a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:38.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.927+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f44bc08b360 con 0x7f44cc0715f0 2024-04-24T23:09:38.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.927+0000 7f44c3400640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 0x7f44a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:38.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.928+0000 7f44c3400640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 0x7f44a806e320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f44b4006fd0 tx=0x7f44b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:38.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:38.931+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f44bc059b70 con 0x7f44cc0715f0 2024-04-24T23:09:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.170+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44cc15be00 con 0x7f44cc0715f0 2024-04-24T23:09:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.171+0000 7f44c8c00640 1 -- 172.21.15.146:0/2407092874 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7f44bc059470 con 0x7f44cc0715f0 2024-04-24T23:09:39.174 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:39.174 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:39.174 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:39.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 msgr2=0x7f44a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 0x7f44a806e320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f44b4006fd0 tx=0x7f44b4008040 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 msgr2=0x7f44cc148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00d5f0 tx=0x7f44bc00dab0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 shutdown_connections 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44cc158590 0x7f44cc159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f44a806be60 0x7f44a806e320 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44cc0cfc90 0x7f44cc159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 --2- 172.21.15.146:0/2407092874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44cc0715f0 0x7f44cc148550 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 >> 172.21.15.146:0/2407092874 conn(0x7f44cc06b320 msgr2=0x7f44cc0b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 shutdown_connections 2024-04-24T23:09:39.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.174+0000 7f44d2e00640 1 -- 172.21.15.146:0/2407092874 wait complete. 2024-04-24T23:09:39.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:39.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.392+0000 7f0ec3600640 1 Processor -- start 2024-04-24T23:09:39.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.392+0000 7f0ec3600640 1 -- start start 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec3600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0ebc145640 0x7f0ebc15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec3600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ebc0b2a20 0x7f0ebc0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec3600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ebc0cdf70 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec3600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0ebc15d360 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec3600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0ebc145a20 con 0x7f0ebc145640 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec1600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0ebc06cbc0 0x7f0ebc15f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58766/0 (socket says 172.21.15.146:58766) 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec1600640 1 -- 172.21.15.146:0/1799576803 learned_addr learned my addr 172.21.15.146:0/1799576803 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1799576803 >> v2:172.21.15.146:3300/0 conn(0x7f0ebc0b2a20 0x7f0ebc0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.394+0000 7f0ec0c00640 1 --2- 172.21.15.146:0/1799576803 >> v2:172.21.15.203:3300/0 conn(0x7f0ebc145640 0x7f0ebc15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebb400640 1 -- 172.21.15.146:0/1799576803 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579938348 0 0) 0x7f0ebc0cdf70 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebb400640 1 -- 172.21.15.146:0/1799576803 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea4003520 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebbe00640 1 -- 172.21.15.146:0/1799576803 >> v2:172.21.15.203:3300/0 conn(0x7f0ebc145640 msgr2=0x7f0ebc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:39.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1799576803 >> v2:172.21.15.203:3300/0 conn(0x7f0ebc145640 0x7f0ebc15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebbe00640 1 -- 172.21.15.146:0/1799576803 >> v1:172.21.15.146:6789/0 conn(0x7f0ebc06cbc0 legacy=0x7f0ebc15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.395+0000 7f0ebbe00640 1 -- 172.21.15.146:0/1799576803 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc06d140 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.396+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1799576803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc0cfc90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0cfa20 tx=0x7f0ea802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21f26d1ede1729a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.397+0000 7f0ebb400640 1 -- 172.21.15.146:0/1799576803 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8037070 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.397+0000 7f0ebb400640 1 -- 172.21.15.146:0/1799576803 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea8032440 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.397+0000 7f0ebb400640 1 -- 172.21.15.146:0/1799576803 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea802ae60 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.397+0000 7f0ec3600640 1 -- 172.21.15.146:0/1799576803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc0b2a20 msgr2=0x7f0ebc0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.397+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1799576803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc0cfc90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0cfa20 tx=0x7f0ea802a110 comp rx=0 tx=0).stop 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 -- 172.21.15.146:0/1799576803 shutdown_connections 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1799576803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc0cfc90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1799576803 >> v2:172.21.15.203:3300/0 conn(0x7f0ebc145640 0x7f0ebc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 -- 172.21.15.146:0/1799576803 >> 172.21.15.146:0/1799576803 conn(0x7f0ebc06b320 msgr2=0x7f0ebc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 -- 172.21.15.146:0/1799576803 shutdown_connections 2024-04-24T23:09:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.398+0000 7f0ec3600640 1 -- 172.21.15.146:0/1799576803 wait complete. 2024-04-24T23:09:39.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.399+0000 7f0ec3600640 1 Processor -- start 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 -- start start 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ebc145640 0x7f0ebc137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc06d9e0 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc06d700 con 0x7f0ebc0b2a20 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.400+0000 7f0ec3600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc0d01d0 con 0x7f0ebc145640 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34060/0 (socket says 172.21.15.146:34060) 2024-04-24T23:09:39.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 -- 172.21.15.146:0/1099277361 learned_addr learned my addr 172.21.15.146:0/1099277361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec1600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ebc145640 0x7f0ebc137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 -- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ebc145640 msgr2=0x7f0ebc137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ebc145640 0x7f0ebc137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 -- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ebc0b2a20 msgr2=0x7f0ebc15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc15c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.401+0000 7f0ec0c00640 1 -- 172.21.15.146:0/1099277361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc15d050 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0ec0c00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000d5f0 tx=0x7f0eb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00125f0 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb0019070 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00129d0 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc071d80 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.402+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc072340 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.403+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ebc068190 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.404+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0eb0012b70 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.405+0000 7f0eb8c00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 0x7f0e9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.405+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f0eb008b4a0 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.406+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 0x7f0e9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.407+0000 7f0ebbe00640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 0x7f0e9c06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8034000 tx=0x7f0ea802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.409+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0eb0059c20 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.608+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ebc0b3a10 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.611+0000 7f0eb8c00640 1 -- 172.21.15.146:0/1099277361 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16909 (secure 0 0 0) 0x7f0eb0059520 con 0x7f0ebc06cbc0 2024-04-24T23:09:39.613 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:39.613 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":84,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:26.215171+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.613+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 msgr2=0x7f0e9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.613+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 0x7f0e9c06e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8034000 tx=0x7f0ea802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.613+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 msgr2=0x7f0ebc15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.613+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000d5f0 tx=0x7f0eb000dab0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 shutdown_connections 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e9c06be30 0x7f0e9c06e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ebc145640 0x7f0ebc137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ebc0b2a20 0x7f0ebc15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 --2- 172.21.15.146:0/1099277361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ebc06cbc0 0x7f0ebc15e830 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 >> 172.21.15.146:0/1099277361 conn(0x7f0ebc06b320 msgr2=0x7f0ebc141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 shutdown_connections 2024-04-24T23:09:39.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.614+0000 7f0ec3600640 1 -- 172.21.15.146:0/1099277361 wait complete. 2024-04-24T23:09:39.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:09:22.432204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:09:23.676356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:39.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.837+0000 7fd11fe00640 1 Processor -- start 2024-04-24T23:09:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.837+0000 7fd11fe00640 1 -- start start 2024-04-24T23:09:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.839+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.839+0000 7fd11fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd1200cfcc0 0x7fd1200d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.839+0000 7fd11fe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd120071ab0 con 0x7fd12006d860 2024-04-24T23:09:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.839+0000 7fd11fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd1200d0660 con 0x7fd1200cfcc0 2024-04-24T23:09:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.839+0000 7fd11fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd120155500 con 0x7fd120155120 2024-04-24T23:09:39.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.840+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.840+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:32870/0 (socket says 172.21.15.146:32870) 2024-04-24T23:09:39.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.840+0000 7fd11ea00640 1 -- 172.21.15.146:0/1019127333 learned_addr learned my addr 172.21.15.146:0/1019127333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:39.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.840+0000 7fd11e000640 1 --2- 172.21.15.146:0/1019127333 >> v2:172.21.15.203:3300/0 conn(0x7fd1200cfcc0 0x7fd1200d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.841+0000 7fd11ea00640 1 -- 172.21.15.146:0/1019127333 >> v2:172.21.15.203:3300/0 conn(0x7fd1200cfcc0 msgr2=0x7fd1200d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:39.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.841+0000 7fd11ea00640 1 --2- 172.21.15.146:0/1019127333 >> v2:172.21.15.203:3300/0 conn(0x7fd1200cfcc0 0x7fd1200d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.841+0000 7fd11ea00640 1 -- 172.21.15.146:0/1019127333 >> v1:172.21.15.203:6789/0 conn(0x7fd12006d860 legacy=0x7fd12006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.841+0000 7fd11ea00640 1 -- 172.21.15.146:0/1019127333 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120071d90 con 0x7fd120155120 2024-04-24T23:09:39.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.841+0000 7fd11d600640 1 -- 172.21.15.146:0/1019127333 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077716851 0 0) 0x7fd120071ab0 con 0x7fd12006d860 2024-04-24T23:09:39.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.842+0000 7fd11ea00640 1 --2- 172.21.15.146:0/1019127333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd110009870 tx=0x7fd11002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574dff77a647a0d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11d600640 1 -- 172.21.15.146:0/1019127333 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110037070 con 0x7fd120155120 2024-04-24T23:09:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11d600640 1 -- 172.21.15.146:0/1019127333 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd110032440 con 0x7fd120155120 2024-04-24T23:09:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11d600640 1 -- 172.21.15.146:0/1019127333 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110032810 con 0x7fd120155120 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 -- 172.21.15.146:0/1019127333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 msgr2=0x7fd1200b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 --2- 172.21.15.146:0/1019127333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd110009870 tx=0x7fd11002a270 comp rx=0 tx=0).stop 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 -- 172.21.15.146:0/1019127333 shutdown_connections 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 --2- 172.21.15.146:0/1019127333 >> v2:172.21.15.203:3300/0 conn(0x7fd1200cfcc0 0x7fd1200d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 --2- 172.21.15.146:0/1019127333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd120155120 0x7fd1200b3d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.843+0000 7fd11fe00640 1 -- 172.21.15.146:0/1019127333 >> 172.21.15.146:0/1019127333 conn(0x7fd12006b560 msgr2=0x7fd12006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.844+0000 7fd11fe00640 1 -- 172.21.15.146:0/1019127333 shutdown_connections 2024-04-24T23:09:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.844+0000 7fd11fe00640 1 -- 172.21.15.146:0/1019127333 wait complete. 2024-04-24T23:09:39.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.845+0000 7fd11fe00640 1 Processor -- start 2024-04-24T23:09:39.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.845+0000 7fd11fe00640 1 -- start start 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1200cfcc0 0x7fd12014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 0x7fd12014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd120072350 con 0x7fd12006d860 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd12015d1b0 con 0x7fd120155120 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.846+0000 7fd11fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd120072630 con 0x7fd1200cfcc0 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34068/0 (socket says 172.21.15.146:34068) 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 -- 172.21.15.146:0/591842181 learned_addr learned my addr 172.21.15.146:0/591842181 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11f400640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 0x7fd12014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 -- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1200cfcc0 msgr2=0x7fd12014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1200cfcc0 0x7fd12014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 -- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 msgr2=0x7fd12014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 0x7fd12014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 -- 172.21.15.146:0/591842181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12014dcc0 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11f400640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 0x7fd12014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.847+0000 7fd11ea00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd110000c00 tx=0x7fd1100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.848+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110037040 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.848+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd110042070 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.848+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110030880 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.848+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12014dfa0 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.848+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1201f5620 con 0x7fd12006d860 2024-04-24T23:09:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.849+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12014e170 con 0x7fd12006d860 2024-04-24T23:09:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.850+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd110030a20 con 0x7fd12006d860 2024-04-24T23:09:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.851+0000 7fd117400640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.852+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7fd1100ab910 con 0x7fd12006d860 2024-04-24T23:09:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.852+0000 7fd11e000640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:39.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.853+0000 7fd11e000640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 0x7fd10006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd10c006a90 tx=0x7fd10c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:39.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:39.856+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd11007a130 con 0x7fd12006d860 2024-04-24T23:09:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.055+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd12004f500 con 0x7fd12006d860 2024-04-24T23:09:40.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.056+0000 7fd117400640 1 -- 172.21.15.146:0/591842181 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fd110079a30 con 0x7fd12006d860 2024-04-24T23:09:40.058 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 msgr2=0x7fd10006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 0x7fd10006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd10c006a90 tx=0x7fd10c006a20 comp rx=0 tx=0).stop 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 msgr2=0x7fd120149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd110000c00 tx=0x7fd1100046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 shutdown_connections 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd120155120 0x7fd12014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd10006be30 0x7fd10006e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd1200cfcc0 0x7fd12014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 --2- 172.21.15.146:0/591842181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12006d860 0x7fd120149f90 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.059+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 >> 172.21.15.146:0/591842181 conn(0x7fd12006b560 msgr2=0x7fd12015dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.060+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 shutdown_connections 2024-04-24T23:09:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.060+0000 7fd11fe00640 1 -- 172.21.15.146:0/591842181 wait complete. 2024-04-24T23:09:40.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:09:40.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.284+0000 7f3e3fe00640 1 Processor -- start 2024-04-24T23:09:40.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.284+0000 7f3e3fe00640 1 -- start start 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.285+0000 7f3e3fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 0x7f3e400cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e40162580 0x7f3e400d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e4015e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3e400b2ae0 con 0x7f3e40162580 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4015f070 con 0x7f3e40158300 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e40161aa0 con 0x7f3e4015e310 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e36000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e40162580 0x7f3e400d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e36000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e40162580 0x7f3e400d0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34074/0 (socket says 172.21.15.146:34074) 2024-04-24T23:09:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e36000640 1 -- 172.21.15.146:0/1655864273 learned_addr learned my addr 172.21.15.146:0/1655864273 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3ea00640 1 --2- 172.21.15.146:0/1655864273 >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 0x7f3e400cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e36000640 1 -- 172.21.15.146:0/1655864273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 msgr2=0x7f3e4015e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.286+0000 7f3e3f400640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e4015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.287+0000 7f3e36000640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e4015e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.287+0000 7f3e36000640 1 -- 172.21.15.146:0/1655864273 >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 msgr2=0x7f3e400cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:40.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.287+0000 7f3e36000640 1 --2- 172.21.15.146:0/1655864273 >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 0x7f3e400cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.287+0000 7f3e36000640 1 -- 172.21.15.146:0/1655864273 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e40161d80 con 0x7f3e40162580 2024-04-24T23:09:40.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.287+0000 7f3e3ea00640 1 --2- 172.21.15.146:0/1655864273 >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 0x7f3e400cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.288+0000 7f3e36000640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e400d0200 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3e4006ec20 tx=0x7f3e2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2439124d2cdd59b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.288+0000 7f3e3e000640 1 -- 172.21.15.146:0/1655864273 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28037070 con 0x7f3e40162580 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.288+0000 7f3e3e000640 1 -- 172.21.15.146:0/1655864273 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e28032440 con 0x7f3e40162580 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.288+0000 7f3e3e000640 1 -- 172.21.15.146:0/1655864273 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28032810 con 0x7f3e40162580 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 -- 172.21.15.146:0/1655864273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 msgr2=0x7f3e400d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e400d0200 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3e4006ec20 tx=0x7f3e2802a270 comp rx=0 tx=0).stop 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 -- 172.21.15.146:0/1655864273 shutdown_connections 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e400d0200 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/1655864273 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e4015e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/1655864273 >> v2:172.21.15.203:3300/0 conn(0x7f3e40158300 0x7f3e400cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 -- 172.21.15.146:0/1655864273 >> 172.21.15.146:0/1655864273 conn(0x7f3e4006b560 msgr2=0x7f3e4006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:40.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 -- 172.21.15.146:0/1655864273 shutdown_connections 2024-04-24T23:09:40.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.289+0000 7f3e3fe00640 1 -- 172.21.15.146:0/1655864273 wait complete. 2024-04-24T23:09:40.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.291+0000 7f3e3fe00640 1 Processor -- start 2024-04-24T23:09:40.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.291+0000 7f3e3fe00640 1 -- start start 2024-04-24T23:09:40.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e40158300 0x7f3e401576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e40151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4015eca0 con 0x7f3e40162580 2024-04-24T23:09:40.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401586e0 con 0x7f3e40158300 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4015ee20 con 0x7f3e4015e310 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34090/0 (socket says 172.21.15.146:34090) 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3f400640 1 -- 172.21.15.146:0/4199095558 learned_addr learned my addr 172.21.15.146:0/4199095558 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3ea00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e40158300 0x7f3e401576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e36000640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e40151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3f400640 1 -- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 msgr2=0x7f3e40151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.292+0000 7f3e3f400640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e40151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3f400640 1 -- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e40158300 msgr2=0x7f3e401576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3f400640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e40158300 0x7f3e401576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3f400640 1 -- 172.21.15.146:0/4199095558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e40152830 con 0x7f3e40162580 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3f400640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800cd70 tx=0x7f3e3800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38003b90 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e38003d30 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e40152b10 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38004240 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.293+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e401530d0 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.294+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4004f500 con 0x7f3e40162580 2024-04-24T23:09:40.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.295+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e380043e0 con 0x7f3e40162580 2024-04-24T23:09:40.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.296+0000 7f3e37400640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 0x7f3e1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.296+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f3e3808bb80 con 0x7f3e40162580 2024-04-24T23:09:40.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.297+0000 7f3e3ea00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 0x7f3e1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.298+0000 7f3e3ea00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 0x7f3e1c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000a950 tx=0x7f3e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.301+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e3805a300 con 0x7f3e40162580 2024-04-24T23:09:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.497+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e401612d0 con 0x7f3e40162580 2024-04-24T23:09:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.498+0000 7f3e37400640 1 -- 172.21.15.146:0/4199095558 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f3e38059c00 con 0x7f3e40162580 2024-04-24T23:09:40.500 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:09:40.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 msgr2=0x7f3e1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 0x7f3e1c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000a950 tx=0x7f3e30008040 comp rx=0 tx=0).stop 2024-04-24T23:09:40.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 msgr2=0x7f3e4015c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800cd70 tx=0x7f3e3800a660 comp rx=0 tx=0).stop 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 shutdown_connections 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e40162580 0x7f3e4015c700 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1c06be30 0x7f3e1c06e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e4015e310 0x7f3e40151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 --2- 172.21.15.146:0/4199095558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e40158300 0x7f3e401576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.500+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 >> 172.21.15.146:0/4199095558 conn(0x7f3e4006b560 msgr2=0x7f3e4006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.501+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 shutdown_connections 2024-04-24T23:09:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.501+0000 7f3e3fe00640 1 -- 172.21.15.146:0/4199095558 wait complete. 2024-04-24T23:09:40.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:09:40.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.717+0000 7f56f2800640 1 Processor -- start 2024-04-24T23:09:40.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.717+0000 7f56f2800640 1 -- start start 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f56ec15bcd0 0x7f56ec0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ec0d0200 0x7f56ec06c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec15c8d0 con 0x7f56ec0d0200 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec0b4df0 con 0x7f56ec15bcd0 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0b4b10 con 0x7f56ec15cd60 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ec0d0200 0x7f56ec06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56ec0d0200 0x7f56ec06c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34094/0 (socket says 172.21.15.146:34094) 2024-04-24T23:09:40.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f1e00640 1 -- 172.21.15.146:0/35222453 learned_addr learned my addr 172.21.15.146:0/35222453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:40.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.719+0000 7f56f1400640 1 --2- 172.21.15.146:0/35222453 >> v2:172.21.15.203:3300/0 conn(0x7f56ec15bcd0 0x7f56ec0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f0a00640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f1e00640 1 -- 172.21.15.146:0/35222453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 msgr2=0x7f56ec0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f1e00640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f1e00640 1 -- 172.21.15.146:0/35222453 >> v2:172.21.15.203:3300/0 conn(0x7f56ec15bcd0 msgr2=0x7f56ec0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f1e00640 1 --2- 172.21.15.146:0/35222453 >> v2:172.21.15.203:3300/0 conn(0x7f56ec15bcd0 0x7f56ec0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f1e00640 1 -- 172.21.15.146:0/35222453 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec15c280 con 0x7f56ec0d0200 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.720+0000 7f56f0a00640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:40.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.721+0000 7f56f1e00640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec06c750 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f56ec06da10 tx=0x7f56e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544e3f79691ae2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.721+0000 7f56ebe00640 1 -- 172.21.15.146:0/35222453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4037070 con 0x7f56ec0d0200 2024-04-24T23:09:40.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.721+0000 7f56ebe00640 1 -- 172.21.15.146:0/35222453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4032440 con 0x7f56ec0d0200 2024-04-24T23:09:40.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.721+0000 7f56ebe00640 1 -- 172.21.15.146:0/35222453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4032810 con 0x7f56ec0d0200 2024-04-24T23:09:40.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 -- 172.21.15.146:0/35222453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 msgr2=0x7f56ec06c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec06c750 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f56ec06da10 tx=0x7f56e402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 -- 172.21.15.146:0/35222453 shutdown_connections 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec06c750 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 --2- 172.21.15.146:0/35222453 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 --2- 172.21.15.146:0/35222453 >> v2:172.21.15.203:3300/0 conn(0x7f56ec15bcd0 0x7f56ec0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 -- 172.21.15.146:0/35222453 >> 172.21.15.146:0/35222453 conn(0x7f56ec06b560 msgr2=0x7f56ec06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 -- 172.21.15.146:0/35222453 shutdown_connections 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.722+0000 7f56f2800640 1 -- 172.21.15.146:0/35222453 wait complete. 2024-04-24T23:09:40.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.724+0000 7f56f2800640 1 Processor -- start 2024-04-24T23:09:40.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.724+0000 7f56f2800640 1 -- start start 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56ec15bcd0 0x7f56ec153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec06e590 con 0x7f56ec0d0200 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0cc770 con 0x7f56ec15bcd0 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0b4790 con 0x7f56ec15cd60 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34096/0 (socket says 172.21.15.146:34096) 2024-04-24T23:09:40.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 -- 172.21.15.146:0/3084546244 learned_addr learned my addr 172.21.15.146:0/3084546244 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 -- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 msgr2=0x7f56ec14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 -- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56ec15bcd0 msgr2=0x7f56ec153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56ec15bcd0 0x7f56ec153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.725+0000 7f56f1400640 1 -- 172.21.15.146:0/3084546244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec14eec0 con 0x7f56ec0d0200 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56f1400640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f56e0007ef0 tx=0x7f56e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0014620 con 0x7f56ec0d0200 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0019070 con 0x7f56ec0d0200 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0014a00 con 0x7f56ec0d0200 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec14f1a0 con 0x7f56ec0d0200 2024-04-24T23:09:40.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.726+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec14f760 con 0x7f56ec0d0200 2024-04-24T23:09:40.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.727+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec156570 con 0x7f56ec0d0200 2024-04-24T23:09:40.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.728+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56e0014ba0 con 0x7f56ec0d0200 2024-04-24T23:09:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.729+0000 7f56e9600640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 0x7f56cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.729+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f56e008b9c0 con 0x7f56ec0d0200 2024-04-24T23:09:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.730+0000 7f56f0a00640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 0x7f56cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:40.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.731+0000 7f56f0a00640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 0x7f56cc06e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006b10 tx=0x7f56d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:40.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.734+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56ec156570 con 0x7f56ec0d0200 2024-04-24T23:09:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.930+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56ec04f500 con 0x7f56ec0d0200 2024-04-24T23:09:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.931+0000 7f56e9600640 1 -- 172.21.15.146:0/3084546244 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f56e005a140 con 0x7f56ec0d0200 2024-04-24T23:09:40.933 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 msgr2=0x7f56cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 0x7f56cc06e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006b10 tx=0x7f56d8008040 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 msgr2=0x7f56ec14e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f56e0007ef0 tx=0x7f56e000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 shutdown_connections 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f56cc06be30 0x7f56cc06e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56ec15cd60 0x7f56ec14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56ec15bcd0 0x7f56ec153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 --2- 172.21.15.146:0/3084546244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56ec0d0200 0x7f56ec14e8e0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 >> 172.21.15.146:0/3084546244 conn(0x7f56ec06b560 msgr2=0x7f56ec1567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 shutdown_connections 2024-04-24T23:09:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:40.933+0000 7f56f2800640 1 -- 172.21.15.146:0/3084546244 wait complete. 2024-04-24T23:09:40.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.154+0000 7f2a63800640 1 Processor -- start 2024-04-24T23:09:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.154+0000 7f2a63800640 1 -- start start 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.155+0000 7f2a63800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a5c1445e0 0x7f2a5c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.155+0000 7f2a63800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c1449c0 con 0x7f2a5c071320 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.155+0000 7f2a63800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c071820 con 0x7f2a5c0728c0 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.155+0000 7f2a63800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c072430 con 0x7f2a5c1445e0 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a60e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a5c1445e0 0x7f2a5c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a61800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a5c071320 0x7f2a5c0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58778/0 (socket says 172.21.15.146:58778) 2024-04-24T23:09:41.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a61800640 1 -- 172.21.15.146:0/2983876180 learned_addr learned my addr 172.21.15.146:0/2983876180 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:41.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a60e00640 1 -- 172.21.15.146:0/2983876180 >> v1:172.21.15.203:6789/0 conn(0x7f2a5c0728c0 legacy=0x7f2a5c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a60e00640 1 -- 172.21.15.146:0/2983876180 >> v1:172.21.15.146:6789/0 conn(0x7f2a5c071320 legacy=0x7f2a5c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a60e00640 1 -- 172.21.15.146:0/2983876180 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c071b00 con 0x7f2a5c1445e0 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.156+0000 7f2a5be00640 1 -- 172.21.15.146:0/2983876180 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842890943 0 0) 0x7f2a5c1449c0 con 0x7f2a5c071320 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.157+0000 7f2a60e00640 1 --2- 172.21.15.146:0/2983876180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c0cfc90 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0097a0 tx=0x7f2a4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c6c5e7c0bd0342 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a5be00640 1 -- 172.21.15.146:0/2983876180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c037070 con 0x7f2a5c1445e0 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a5be00640 1 -- 172.21.15.146:0/2983876180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c032440 con 0x7f2a5c1445e0 2024-04-24T23:09:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a5be00640 1 -- 172.21.15.146:0/2983876180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c032810 con 0x7f2a5c1445e0 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a63800640 1 -- 172.21.15.146:0/2983876180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c1445e0 msgr2=0x7f2a5c0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a63800640 1 --2- 172.21.15.146:0/2983876180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c0cfc90 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0097a0 tx=0x7f2a4c02a1e0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.158+0000 7f2a63800640 1 -- 172.21.15.146:0/2983876180 shutdown_connections 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.159+0000 7f2a63800640 1 --2- 172.21.15.146:0/2983876180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c0cfc90 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.159+0000 7f2a63800640 1 -- 172.21.15.146:0/2983876180 >> 172.21.15.146:0/2983876180 conn(0x7f2a5c06b320 msgr2=0x7f2a5c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.159+0000 7f2a63800640 1 -- 172.21.15.146:0/2983876180 shutdown_connections 2024-04-24T23:09:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.159+0000 7f2a63800640 1 -- 172.21.15.146:0/2983876180 wait complete. 2024-04-24T23:09:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.160+0000 7f2a63800640 1 Processor -- start 2024-04-24T23:09:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.160+0000 7f2a63800640 1 -- start start 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.161+0000 7f2a63800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.161+0000 7f2a63800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a5c0728c0 0x7f2a5c13fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.161+0000 7f2a63800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c1e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a63800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0720c0 con 0x7f2a5c071320 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a63800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0b2d70 con 0x7f2a5c1445e0 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a63800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d01d0 con 0x7f2a5c0728c0 2024-04-24T23:09:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34114/0 (socket says 172.21.15.146:34114) 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 -- 172.21.15.146:0/3736267763 learned_addr learned my addr 172.21.15.146:0/3736267763 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 -- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a5c0728c0 msgr2=0x7f2a5c13fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a5c0728c0 0x7f2a5c13fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 -- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a5c1445e0 msgr2=0x7f2a5c1e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c1e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.162+0000 7f2a60e00640 1 -- 172.21.15.146:0/3736267763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c14d490 con 0x7f2a5c071320 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a60e00640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098c0 tx=0x7f2a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c041070 con 0x7f2a5c071320 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c03c870 con 0x7f2a5c071320 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c037040 con 0x7f2a5c071320 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c14d770 con 0x7f2a5c071320 2024-04-24T23:09:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.163+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c14dd30 con 0x7f2a5c071320 2024-04-24T23:09:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.164+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c067af0 con 0x7f2a5c071320 2024-04-24T23:09:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.165+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a4c044070 con 0x7f2a5c071320 2024-04-24T23:09:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.166+0000 7f2a59600640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 0x7f2a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.166+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f2a4c0abe30 con 0x7f2a5c071320 2024-04-24T23:09:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.167+0000 7f2a53e00640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 0x7f2a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.168+0000 7f2a53e00640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 0x7f2a3806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c150620 tx=0x7f2a440079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.171+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a5c067af0 con 0x7f2a5c071320 2024-04-24T23:09:41.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.418+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a5c06eab0 con 0x7f2a5c071320 2024-04-24T23:09:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.419+0000 7f2a59600640 1 -- 172.21.15.146:0/3736267763 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7f2a4c07a6d0 con 0x7f2a5c071320 2024-04-24T23:09:41.421 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:41.422 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 msgr2=0x7f2a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 0x7f2a3806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c150620 tx=0x7f2a440079b0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 msgr2=0x7f2a5c13be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098c0 tx=0x7f2a4c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 shutdown_connections 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a5c1445e0 0x7f2a5c1e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a3806be30 0x7f2a3806e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a5c0728c0 0x7f2a5c13fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 --2- 172.21.15.146:0/3736267763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a5c071320 0x7f2a5c13be60 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 >> 172.21.15.146:0/3736267763 conn(0x7f2a5c06b320 msgr2=0x7f2a5c0af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 shutdown_connections 2024-04-24T23:09:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.422+0000 7f2a63800640 1 -- 172.21.15.146:0/3736267763 wait complete. 2024-04-24T23:09:41.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.635+0000 7f4ae2800640 1 Processor -- start 2024-04-24T23:09:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.636+0000 7f4ae2800640 1 -- start start 2024-04-24T23:09:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.637+0000 7f4ae2800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4adc0d06e0 0x7f4adc0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.637+0000 7f4ae2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0b2dc0 0x7f4adc15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.637+0000 7f4ae2800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc0d4bc0 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.637+0000 7f4ae2800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4adc0cf5b0 con 0x7f4adc0d06e0 2024-04-24T23:09:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.637+0000 7f4ae2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4adc0d48e0 con 0x7f4adc0b2dc0 2024-04-24T23:09:41.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.638+0000 7f4ae1400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4adc0d06e0 0x7f4adc0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.638+0000 7f4ae0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0b2dc0 0x7f4adc15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.638+0000 7f4ae1e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f4adc0d0ac0 0x7f4adc0d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:39990/0 (socket says 172.21.15.146:39990) 2024-04-24T23:09:41.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.638+0000 7f4ae1e00640 1 -- 172.21.15.146:0/688042315 learned_addr learned my addr 172.21.15.146:0/688042315 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:41.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.639+0000 7f4ae1400640 1 -- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0b2dc0 msgr2=0x7f4adc15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:41.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.639+0000 7f4ae1400640 1 --2- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0b2dc0 0x7f4adc15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.639+0000 7f4ae1400640 1 -- 172.21.15.146:0/688042315 >> v1:172.21.15.203:6789/0 conn(0x7f4adc0d0ac0 legacy=0x7f4adc0d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.639+0000 7f4ae1400640 1 -- 172.21.15.146:0/688042315 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc0cf850 con 0x7f4adc0d06e0 2024-04-24T23:09:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.640+0000 7f4ae1400640 1 --2- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0d06e0 0x7f4adc0b52d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c3bb6b157f569c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.641+0000 7f4adbe00640 1 -- 172.21.15.146:0/688042315 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0037070 con 0x7f4adc0d06e0 2024-04-24T23:09:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.641+0000 7f4adbe00640 1 -- 172.21.15.146:0/688042315 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad002adb0 con 0x7f4adc0d06e0 2024-04-24T23:09:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.641+0000 7f4adbe00640 1 -- 172.21.15.146:0/688042315 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0032660 con 0x7f4adc0d06e0 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 -- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0d06e0 msgr2=0x7f4adc0b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 --2- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0d06e0 0x7f4adc0b52d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002a060 comp rx=0 tx=0).stop 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 -- 172.21.15.146:0/688042315 shutdown_connections 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 --2- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0b2dc0 0x7f4adc15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 --2- 172.21.15.146:0/688042315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0d06e0 0x7f4adc0b52d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 -- 172.21.15.146:0/688042315 >> 172.21.15.146:0/688042315 conn(0x7f4adc0d3d20 msgr2=0x7f4adc0d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 -- 172.21.15.146:0/688042315 shutdown_connections 2024-04-24T23:09:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.642+0000 7f4ae2800640 1 -- 172.21.15.146:0/688042315 wait complete. 2024-04-24T23:09:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.644+0000 7f4ae2800640 1 Processor -- start 2024-04-24T23:09:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.644+0000 7f4ae2800640 1 -- start start 2024-04-24T23:09:41.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 0x7f4adc0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0d06e0 0x7f4adc15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc0d2e40 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc0d2cc0 con 0x7f4adc0b2dc0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4adc0b4460 con 0x7f4adc0d06e0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34124/0 (socket says 172.21.15.146:34124) 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae1e00640 1 -- 172.21.15.146:0/1188285005 learned_addr learned my addr 172.21.15.146:0/1188285005 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae1400640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 0x7f4adc0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.645+0000 7f4ae0a00640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0d06e0 0x7f4adc15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 -- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0d06e0 msgr2=0x7f4adc15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0d06e0 0x7f4adc15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 -- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 msgr2=0x7f4adc0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 0x7f4adc0ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 -- 172.21.15.146:0/1188285005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc1f8000 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1400640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 0x7f4adc0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae1e00640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400ca80 tx=0x7f4ad400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4017070 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad400ac30 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4012600 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc0c9aa0 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.646+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc0ca060 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.648+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc04f500 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.649+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ad401a070 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.650+0000 7f4ad9600640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 0x7f4abc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:41.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.650+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f4ad408ab60 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.650+0000 7f4ae1400640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 0x7f4abc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:41.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.652+0000 7f4ae1400640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 0x7f4abc06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0034000 tx=0x7f4ad002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.654+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4ad400ae20 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.856+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4adc1e2f00 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.859+0000 7f4ad9600640 1 -- 172.21.15.146:0/1188285005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16909 (secure 0 0 0) 0x7f4ad4058dc0 con 0x7f4adc0d0ac0 2024-04-24T23:09:41.861 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:41.861 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":84,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:26.215171+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.861+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 msgr2=0x7f4abc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.861+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 0x7f4abc06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0034000 tx=0x7f4ad002e000 comp rx=0 tx=0).stop 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.861+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 msgr2=0x7f4adc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.861+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400ca80 tx=0x7f4ad400cf40 comp rx=0 tx=0).stop 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 shutdown_connections 2024-04-24T23:09:41.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc0d0ac0 0x7f4adc0b0950 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4abc06be60 0x7f4abc06e320 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4adc0d06e0 0x7f4adc15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 --2- 172.21.15.146:0/1188285005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4adc0b2dc0 0x7f4adc0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 >> 172.21.15.146:0/1188285005 conn(0x7f4adc0d3d20 msgr2=0x7f4adc0b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 shutdown_connections 2024-04-24T23:09:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:41.862+0000 7f4ae2800640 1 -- 172.21.15.146:0/1188285005 wait complete. 2024-04-24T23:09:41.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:09:41.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:42.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.085+0000 7f69ff200640 1 Processor -- start 2024-04-24T23:09:42.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.085+0000 7f69ff200640 1 -- start start 2024-04-24T23:09:42.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.087+0000 7f69ff200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.087+0000 7f69ff200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 0x7f69f80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.087+0000 7f69ff200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f80ccb10 con 0x7f69f8071dd0 2024-04-24T23:09:42.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.087+0000 7f69ff200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f69f8072230 con 0x7f69f80d0240 2024-04-24T23:09:42.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.087+0000 7f69ff200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80aede0 con 0x7f69f815a980 2024-04-24T23:09:42.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:32972/0 (socket says 172.21.15.146:32972) 2024-04-24T23:09:42.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fde00640 1 -- 172.21.15.146:0/3410151021 learned_addr learned my addr 172.21.15.146:0/3410151021 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:42.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fe800640 1 --2- 172.21.15.146:0/3410151021 >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 0x7f69f80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fde00640 1 -- 172.21.15.146:0/3410151021 >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 msgr2=0x7f69f80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.088+0000 7f69fde00640 1 --2- 172.21.15.146:0/3410151021 >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 0x7f69f80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.089+0000 7f69fde00640 1 -- 172.21.15.146:0/3410151021 >> v1:172.21.15.203:6789/0 conn(0x7f69f8071dd0 legacy=0x7f69f80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.089+0000 7f69fde00640 1 -- 172.21.15.146:0/3410151021 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f806ddc0 con 0x7f69f815a980 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.089+0000 7f69fe800640 1 --2- 172.21.15.146:0/3410151021 >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 0x7f69f80ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:09:42.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.090+0000 7f69fde00640 1 --2- 172.21.15.146:0/3410151021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bb10 tx=0x7f69ec02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aa1055a784b3567 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.090+0000 7f69fca00640 1 -- 172.21.15.146:0/3410151021 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec032790 con 0x7f69f815a980 2024-04-24T23:09:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.090+0000 7f69fca00640 1 -- 172.21.15.146:0/3410151021 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec038070 con 0x7f69f815a980 2024-04-24T23:09:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.090+0000 7f69fca00640 1 -- 172.21.15.146:0/3410151021 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec032b50 con 0x7f69f815a980 2024-04-24T23:09:42.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 -- 172.21.15.146:0/3410151021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 msgr2=0x7f69f806d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 --2- 172.21.15.146:0/3410151021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bb10 tx=0x7f69ec02c890 comp rx=0 tx=0).stop 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 -- 172.21.15.146:0/3410151021 shutdown_connections 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 --2- 172.21.15.146:0/3410151021 >> v2:172.21.15.203:3300/0 conn(0x7f69f80d0240 0x7f69f80ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 --2- 172.21.15.146:0/3410151021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f815a980 0x7f69f806d770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 -- 172.21.15.146:0/3410151021 >> 172.21.15.146:0/3410151021 conn(0x7f69f806b320 msgr2=0x7f69f806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 -- 172.21.15.146:0/3410151021 shutdown_connections 2024-04-24T23:09:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.091+0000 7f69ff200640 1 -- 172.21.15.146:0/3410151021 wait complete. 2024-04-24T23:09:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.093+0000 7f69ff200640 1 Processor -- start 2024-04-24T23:09:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.093+0000 7f69ff200640 1 -- start start 2024-04-24T23:09:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f8071dd0 0x7f69f815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f80d0240 0x7f69f81f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69f806e660 con 0x7f69f815a980 2024-04-24T23:09:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f69f806e380 con 0x7f69f8071dd0 2024-04-24T23:09:42.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69ff200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f69f815ad60 con 0x7f69f80d0240 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69fe800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69fe800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34134/0 (socket says 172.21.15.146:34134) 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.094+0000 7f69fe800640 1 -- 172.21.15.146:0/4105095269 learned_addr learned my addr 172.21.15.146:0/4105095269 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fde00640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f8071dd0 0x7f69f815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fd400640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f80d0240 0x7f69f81f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 -- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f80d0240 msgr2=0x7f69f81f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f80d0240 0x7f69f81f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 -- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f8071dd0 msgr2=0x7f69f815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f8071dd0 0x7f69f815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 -- 172.21.15.146:0/4105095269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f8148ee0 con 0x7f69f815a980 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69fe800640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f69f400efb0 tx=0x7f69f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4018020 con 0x7f69f815a980 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f4014480 con 0x7f69f815a980 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4014850 con 0x7f69f815a980 2024-04-24T23:09:42.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.095+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f815d860 con 0x7f69f815a980 2024-04-24T23:09:42.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.096+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f8149150 con 0x7f69f815a980 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.097+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f804f500 con 0x7f69f815a980 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.098+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69f4005d10 con 0x7f69f815a980 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.098+0000 7f69f2000640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 0x7f69dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.098+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f69f408be20 con 0x7f69f815a980 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.099+0000 7f69fde00640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 0x7f69dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.100+0000 7f69fde00640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 0x7f69dc06e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f69ec037000 tx=0x7f69ec032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.104+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f69f4022030 con 0x7f69f815a980 2024-04-24T23:09:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.339+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f8149320 con 0x7f69f815a980 2024-04-24T23:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.340+0000 7f69f2000640 1 -- 172.21.15.146:0/4105095269 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7f69f4010040 con 0x7f69f815a980 2024-04-24T23:09:42.343 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:42.343 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 msgr2=0x7f69dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 0x7f69dc06e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f69ec037000 tx=0x7f69ec032000 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 msgr2=0x7f69f8149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f69f400efb0 tx=0x7f69f400c490 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 shutdown_connections 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f815a980 0x7f69f8149670 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69dc06be60 0x7f69dc06e320 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f69f80d0240 0x7f69f81f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 --2- 172.21.15.146:0/4105095269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f8071dd0 0x7f69f815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.343+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 >> 172.21.15.146:0/4105095269 conn(0x7f69f806b320 msgr2=0x7f69f81588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.344+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 shutdown_connections 2024-04-24T23:09:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.344+0000 7f69ff200640 1 -- 172.21.15.146:0/4105095269 wait complete. 2024-04-24T23:09:42.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:42.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.566+0000 7f0ef3000640 1 Processor -- start 2024-04-24T23:09:42.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.566+0000 7f0ef3000640 1 -- start start 2024-04-24T23:09:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ef3000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0eec0b2a20 0x7f0eec0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ef3000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eec0cdf70 con 0x7f0eec06cbc0 2024-04-24T23:09:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ef3000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eec145a20 con 0x7f0eec145640 2024-04-24T23:09:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ef3000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0eec06d140 con 0x7f0eec0b2a20 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0eec0b2a20 0x7f0eec0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0eec0b2a20 0x7f0eec0cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34136/0 (socket says 172.21.15.146:34136) 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 -- 172.21.15.146:0/17465154 learned_addr learned my addr 172.21.15.146:0/17465154 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 -- 172.21.15.146:0/17465154 >> v1:172.21.15.203:6789/0 conn(0x7f0eec145640 legacy=0x7f0eec15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 -- 172.21.15.146:0/17465154 >> v1:172.21.15.146:6789/0 conn(0x7f0eec06cbc0 legacy=0x7f0eec0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.568+0000 7f0ee3e00640 1 -- 172.21.15.146:0/17465154 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec06d420 con 0x7f0eec0b2a20 2024-04-24T23:09:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.569+0000 7f0ee3e00640 1 --2- 172.21.15.146:0/17465154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec0cfc90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1abbec07e450cb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.570+0000 7f0eeb400640 1 -- 172.21.15.146:0/17465154 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4037070 con 0x7f0eec0b2a20 2024-04-24T23:09:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.570+0000 7f0eeb400640 1 -- 172.21.15.146:0/17465154 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4032440 con 0x7f0eec0b2a20 2024-04-24T23:09:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.570+0000 7f0eeb400640 1 -- 172.21.15.146:0/17465154 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4032810 con 0x7f0eec0b2a20 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.570+0000 7f0ef3000640 1 -- 172.21.15.146:0/17465154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 msgr2=0x7f0eec0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.570+0000 7f0ef3000640 1 --2- 172.21.15.146:0/17465154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec0cfc90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed402a2a0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.571+0000 7f0ef3000640 1 -- 172.21.15.146:0/17465154 shutdown_connections 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.571+0000 7f0ef3000640 1 --2- 172.21.15.146:0/17465154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec0cfc90 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.571+0000 7f0ef3000640 1 -- 172.21.15.146:0/17465154 >> 172.21.15.146:0/17465154 conn(0x7f0eec06b320 msgr2=0x7f0eec06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.571+0000 7f0ef3000640 1 -- 172.21.15.146:0/17465154 shutdown_connections 2024-04-24T23:09:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.571+0000 7f0ef3000640 1 -- 172.21.15.146:0/17465154 wait complete. 2024-04-24T23:09:42.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.572+0000 7f0ef3000640 1 Processor -- start 2024-04-24T23:09:42.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 -- start start 2024-04-24T23:09:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 0x7f0eec13d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 0x7f0eec1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec0d01d0 con 0x7f0eec0b2a20 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec06d9e0 con 0x7f0eec145640 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.573+0000 7f0ef3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0eec0d0350 con 0x7f0eec06cbc0 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34138/0 (socket says 172.21.15.146:34138) 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 -- 172.21.15.146:0/1057607103 learned_addr learned my addr 172.21.15.146:0/1057607103 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ef1000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 0x7f0eec1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0eebe00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 0x7f0eec13d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 -- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 msgr2=0x7f0eec13d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 0x7f0eec13d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 -- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 msgr2=0x7f0eec1f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 0x7f0eec1f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ee3e00640 1 -- 172.21.15.146:0/1057607103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec139c20 con 0x7f0eec0b2a20 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0ef1000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 0x7f0eec1f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.574+0000 7f0eebe00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 0x7f0eec13d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:42.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ee3e00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4041020 con 0x7f0eec0b2a20 2024-04-24T23:09:42.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4030970 con 0x7f0eec0b2a20 2024-04-24T23:09:42.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec13c6f0 con 0x7f0eec0b2a20 2024-04-24T23:09:42.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4037040 con 0x7f0eec0b2a20 2024-04-24T23:09:42.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.575+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec13ccb0 con 0x7f0eec0b2a20 2024-04-24T23:09:42.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.576+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec068190 con 0x7f0eec0b2a20 2024-04-24T23:09:42.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.577+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ed4044020 con 0x7f0eec0b2a20 2024-04-24T23:09:42.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.578+0000 7f0ee8c00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 0x7f0ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:42.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.578+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f0ed40aba50 con 0x7f0eec0b2a20 2024-04-24T23:09:42.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.578+0000 7f0eebe00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 0x7f0ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:42.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.580+0000 7f0eebe00640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 0x7f0ec806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00a830 tx=0x7f0edc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.582+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0ed404b030 con 0x7f0eec0b2a20 2024-04-24T23:09:42.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.812+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0eec0ce840 con 0x7f0eec0b2a20 2024-04-24T23:09:42.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.813+0000 7f0ee8c00640 1 -- 172.21.15.146:0/1057607103 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5186 (secure 0 0 0) 0x7f0ed407a1d0 con 0x7f0eec0b2a20 2024-04-24T23:09:42.816 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:24.676969+0000","modified":"2024-04-24T23:09:27.715137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7374":{"gid":7374,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3967134794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3967134794},{"type":"v1","addr":"172.21.15.146:6835","nonce":3967134794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7374,"qdb_cluster":[7374]},"id":5}]} 2024-04-24T23:09:42.816 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 74 2024-04-24T23:09:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 msgr2=0x7f0ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 0x7f0ec806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00a830 tx=0x7f0edc008040 comp rx=0 tx=0).stop 2024-04-24T23:09:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 msgr2=0x7f0eec1396e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed40046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 shutdown_connections 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0eec145640 0x7f0eec1f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0eec0b2a20 0x7f0eec1396e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0ec806be30 0x7f0ec806e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 --2- 172.21.15.146:0/1057607103 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0eec06cbc0 0x7f0eec13d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 >> 172.21.15.146:0/1057607103 conn(0x7f0eec06b320 msgr2=0x7f0eec06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 shutdown_connections 2024-04-24T23:09:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:42.816+0000 7f0ef3000640 1 -- 172.21.15.146:0/1057607103 wait complete. 2024-04-24T23:09:42.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.031+0000 7f893bc00640 1 Processor -- start 2024-04-24T23:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.031+0000 7f893bc00640 1 -- start start 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f893bc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f893414b850 0x7f89340b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f893bc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f893414be80 0x7f89340cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f893bc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89340d05e0 con 0x7f89340d01d0 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f893bc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f893414bc30 con 0x7f893414be80 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f893bc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f89341662b0 con 0x7f893414b850 2024-04-24T23:09:43.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f8933e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f893414be80 0x7f89340cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f8939c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89340d01d0 0x7f893406cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58786/0 (socket says 172.21.15.146:58786) 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f8939c00640 1 -- 172.21.15.146:0/4013876228 learned_addr learned my addr 172.21.15.146:0/4013876228 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.033+0000 7f8939200640 1 --2- 172.21.15.146:0/4013876228 >> v2:172.21.15.203:3300/0 conn(0x7f893414b850 0x7f89340b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.034+0000 7f8933e00640 1 -- 172.21.15.146:0/4013876228 >> v2:172.21.15.203:3300/0 conn(0x7f893414b850 msgr2=0x7f89340b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.034+0000 7f8933e00640 1 --2- 172.21.15.146:0/4013876228 >> v2:172.21.15.203:3300/0 conn(0x7f893414b850 0x7f89340b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.034+0000 7f8933e00640 1 -- 172.21.15.146:0/4013876228 >> v1:172.21.15.146:6789/0 conn(0x7f89340d01d0 legacy=0x7f893406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.034+0000 7f8933e00640 1 -- 172.21.15.146:0/4013876228 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8934166590 con 0x7f893414be80 2024-04-24T23:09:43.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.034+0000 7f8933400640 1 -- 172.21.15.146:0/4013876228 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823465430 0 0) 0x7f892c001490 con 0x7f89340d01d0 2024-04-24T23:09:43.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f8933e00640 1 --2- 172.21.15.146:0/4013876228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414be80 0x7f89340cfc90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f893406dcc0 tx=0x7f892002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b47797a15f69e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f8933400640 1 -- 172.21.15.146:0/4013876228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920037070 con 0x7f893414be80 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f8933400640 1 -- 172.21.15.146:0/4013876228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920032440 con 0x7f893414be80 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f8933400640 1 -- 172.21.15.146:0/4013876228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892002ae60 con 0x7f893414be80 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f893bc00640 1 -- 172.21.15.146:0/4013876228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414be80 msgr2=0x7f89340cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.035+0000 7f893bc00640 1 --2- 172.21.15.146:0/4013876228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414be80 0x7f89340cfc90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f893406dcc0 tx=0x7f892002a110 comp rx=0 tx=0).stop 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 -- 172.21.15.146:0/4013876228 shutdown_connections 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 --2- 172.21.15.146:0/4013876228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414be80 0x7f89340cfc90 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 --2- 172.21.15.146:0/4013876228 >> v2:172.21.15.203:3300/0 conn(0x7f893414b850 0x7f89340b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 -- 172.21.15.146:0/4013876228 >> 172.21.15.146:0/4013876228 conn(0x7f893406b320 msgr2=0x7f893406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 -- 172.21.15.146:0/4013876228 shutdown_connections 2024-04-24T23:09:43.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.036+0000 7f893bc00640 1 -- 172.21.15.146:0/4013876228 wait complete. 2024-04-24T23:09:43.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.037+0000 7f893bc00640 1 Processor -- start 2024-04-24T23:09:43.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 -- start start 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f89340d01d0 0x7f8934144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893414be80 0x7f8934144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8934165ef0 con 0x7f893414b850 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8934166b50 con 0x7f893414be80 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.038+0000 7f893bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8934166070 con 0x7f89340d01d0 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34158/0 (socket says 172.21.15.146:34158) 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 -- 172.21.15.146:0/948459318 learned_addr learned my addr 172.21.15.146:0/948459318 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 -- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f89340d01d0 msgr2=0x7f8934144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f89340d01d0 0x7f8934144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 -- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893414be80 msgr2=0x7f8934144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893414be80 0x7f8934144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 -- 172.21.15.146:0/948459318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8934140ba0 con 0x7f893414b850 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.039+0000 7f8933e00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8920009890 tx=0x7f89200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.040+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920037040 con 0x7f893414b850 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.040+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920042070 con 0x7f893414b850 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.040+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8934140e40 con 0x7f893414b850 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.040+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920030bd0 con 0x7f893414b850 2024-04-24T23:09:43.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.040+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341438b0 con 0x7f893414b850 2024-04-24T23:09:43.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.041+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8934068190 con 0x7f893414b850 2024-04-24T23:09:43.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.042+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8920047460 con 0x7f893414b850 2024-04-24T23:09:43.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.043+0000 7f8930c00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 0x7f891406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.043+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f89200abca0 con 0x7f893414b850 2024-04-24T23:09:43.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.044+0000 7f8939200640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 0x7f891406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.045+0000 7f8939200640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 0x7f891406e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89280098f0 tx=0x7f8928008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.047+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8920032e20 con 0x7f893414b850 2024-04-24T23:09:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.244+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89340b4d90 con 0x7f893414b850 2024-04-24T23:09:43.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.246+0000 7f8930c00640 1 -- 172.21.15.146:0/948459318 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16909 (secure 0 0 0) 0x7f892007a390 con 0x7f893414b850 2024-04-24T23:09:43.249 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:43.249 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":84,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:26.215171+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:22.432204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:23.676356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 msgr2=0x7f891406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 0x7f891406e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89280098f0 tx=0x7f8928008040 comp rx=0 tx=0).stop 2024-04-24T23:09:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 msgr2=0x7f89341edab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8920009890 tx=0x7f89200046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 shutdown_connections 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f893414be80 0x7f8934144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f893414b850 0x7f89341edab0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f891406be30 0x7f891406e2f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 --2- 172.21.15.146:0/948459318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f89340d01d0 0x7f8934144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 >> 172.21.15.146:0/948459318 conn(0x7f893406b320 msgr2=0x7f89340b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 shutdown_connections 2024-04-24T23:09:43.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.249+0000 7f893bc00640 1 -- 172.21.15.146:0/948459318 wait complete. 2024-04-24T23:09:43.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:09:43.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.469+0000 7f43f8400640 1 Processor -- start 2024-04-24T23:09:43.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.469+0000 7f43f8400640 1 -- start start 2024-04-24T23:09:43.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f8400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0142570 0x7f43f006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f8400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43f00720d0 0x7f43f015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f8400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f0142950 con 0x7f43f0070ba0 2024-04-24T23:09:43.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f8400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f43f0071c40 con 0x7f43f00720d0 2024-04-24T23:09:43.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f8400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43f0071030 con 0x7f43f0142570 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f6400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43f00720d0 0x7f43f015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f6400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43f00720d0 0x7f43f015fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34170/0 (socket says 172.21.15.146:34170) 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.471+0000 7f43f6400640 1 -- 172.21.15.146:0/2982741237 learned_addr learned my addr 172.21.15.146:0/2982741237 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.472+0000 7f43f6400640 1 -- 172.21.15.146:0/2982741237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0142570 msgr2=0x7f43f006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.472+0000 7f43f6400640 1 --2- 172.21.15.146:0/2982741237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0142570 0x7f43f006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.472+0000 7f43f6400640 1 -- 172.21.15.146:0/2982741237 >> v1:172.21.15.203:6789/0 conn(0x7f43f0070ba0 legacy=0x7f43f006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.472+0000 7f43f6400640 1 -- 172.21.15.146:0/2982741237 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f0071310 con 0x7f43f00720d0 2024-04-24T23:09:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.473+0000 7f43f6400640 1 --2- 172.21.15.146:0/2982741237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015fc00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e50 tx=0x7f43e802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2cffe515f6e605 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.473+0000 7f43efe00640 1 -- 172.21.15.146:0/2982741237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8036070 con 0x7f43f00720d0 2024-04-24T23:09:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.473+0000 7f43efe00640 1 -- 172.21.15.146:0/2982741237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e8031600 con 0x7f43f00720d0 2024-04-24T23:09:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.473+0000 7f43efe00640 1 -- 172.21.15.146:0/2982741237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80319d0 con 0x7f43f00720d0 2024-04-24T23:09:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 -- 172.21.15.146:0/2982741237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 msgr2=0x7f43f015fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 --2- 172.21.15.146:0/2982741237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015fc00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e50 tx=0x7f43e802a6c0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 -- 172.21.15.146:0/2982741237 shutdown_connections 2024-04-24T23:09:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 --2- 172.21.15.146:0/2982741237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015fc00 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 --2- 172.21.15.146:0/2982741237 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0142570 0x7f43f006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 -- 172.21.15.146:0/2982741237 >> 172.21.15.146:0/2982741237 conn(0x7f43f006b140 msgr2=0x7f43f006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 -- 172.21.15.146:0/2982741237 shutdown_connections 2024-04-24T23:09:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.474+0000 7f43f8400640 1 -- 172.21.15.146:0/2982741237 wait complete. 2024-04-24T23:09:43.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.476+0000 7f43f8400640 1 Processor -- start 2024-04-24T23:09:43.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.476+0000 7f43f8400640 1 -- start start 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43f0142570 0x7f43f0130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0131020 0x7f43f00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0072c60 con 0x7f43f00720d0 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00718d0 con 0x7f43f0142570 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f8400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43f0072de0 con 0x7f43f0131020 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34176/0 (socket says 172.21.15.146:34176) 2024-04-24T23:09:43.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.477+0000 7f43f5a00640 1 -- 172.21.15.146:0/2353939333 learned_addr learned my addr 172.21.15.146:0/2353939333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5000640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43f0142570 0x7f43f0130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f6400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0131020 0x7f43f00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 -- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0131020 msgr2=0x7f43f00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0131020 0x7f43f00c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 -- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43f0142570 msgr2=0x7f43f0130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43f0142570 0x7f43f0130ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 -- 172.21.15.146:0/2353939333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f00c9a20 con 0x7f43f00720d0 2024-04-24T23:09:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f5a00640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b410 tx=0x7f43e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4015020 con 0x7f43f00720d0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4011850 con 0x7f43f00720d0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4011c40 con 0x7f43f00720d0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.478+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f00c9d00 con 0x7f43f00720d0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.479+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f00ca2c0 con 0x7f43f00720d0 2024-04-24T23:09:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.480+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f0131430 con 0x7f43f00720d0 2024-04-24T23:09:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.481+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e4018020 con 0x7f43f00720d0 2024-04-24T23:09:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.481+0000 7f43ed600640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 0x7f43d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.482+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6101+0+0 (secure 0 0 0) 0x7f43e408af90 con 0x7f43f00720d0 2024-04-24T23:09:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.482+0000 7f43f5000640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 0x7f43d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.483+0000 7f43f5000640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 0x7f43d006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43f015f780 tx=0x7f43dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.486+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43f0131430 con 0x7f43f00720d0 2024-04-24T23:09:43.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.728+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f43f006e9a0 con 0x7f43f00720d0 2024-04-24T23:09:43.731 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:09:43.729+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:09:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.733+0000 7f43ed600640 1 -- 172.21.15.146:0/2353939333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f43e401f020 con 0x7f43f00720d0 2024-04-24T23:09:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.736+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 msgr2=0x7f43d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.736+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 0x7f43d006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43f015f780 tx=0x7f43dc009040 comp rx=0 tx=0).stop 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.736+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 msgr2=0x7f43f015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.736+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b410 tx=0x7f43e400b8d0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 shutdown_connections 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43d006be30 0x7f43d006e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43f0131020 0x7f43f00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43f0142570 0x7f43f0130ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 --2- 172.21.15.146:0/2353939333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43f00720d0 0x7f43f015bc50 secure :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b410 tx=0x7f43e400b8d0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 >> 172.21.15.146:0/2353939333 conn(0x7f43f006b140 msgr2=0x7f43f00ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 shutdown_connections 2024-04-24T23:09:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.737+0000 7f43f8400640 1 -- 172.21.15.146:0/2353939333 wait complete. 2024-04-24T23:09:43.745 INFO:tasks.ceph.mds.c.smithi146.stderr: -4159> 2024-04-24T23:09:19.714+0000 7efe9d400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-24T23:09:43.749 INFO:tasks.ceph.mds.c.smithi146.stderr: -2850> 2024-04-24T23:09:31.158+0000 7efe95c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:09:43.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:09:43.818 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:09:43.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.935+0000 7f455e400640 1 Processor -- start 2024-04-24T23:09:43.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.935+0000 7f455e400640 1 -- start start 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.936+0000 7f455e400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f455813ef30 0x7f4558141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.936+0000 7f455e400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580ced40 con 0x7f45580ce770 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.936+0000 7f455e400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580cf020 con 0x7f4558141ab0 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.936+0000 7f455e400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f45581423d0 con 0x7f455813ef30 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.937+0000 7f4557e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f45580ce770 0x7f4558071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58792/0 (socket says 172.21.15.146:58792) 2024-04-24T23:09:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.937+0000 7f4557e00640 1 -- 172.21.15.146:0/2096615901 learned_addr learned my addr 172.21.15.146:0/2096615901 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.937+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 446666232 0 0) 0x7f45580ced40 con 0x7f45580ce770 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.937+0000 7f4557400640 1 --2- 172.21.15.146:0/2096615901 >> v2:172.21.15.203:3300/0 conn(0x7f455813ef30 0x7f4558141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.937+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4538003520 con 0x7f45580ce770 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861301561 0 0) 0x7f4538003520 con 0x7f45580ce770 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 >> v2:172.21.15.203:3300/0 conn(0x7f455813ef30 msgr2=0x7f4558141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 --2- 172.21.15.146:0/2096615901 >> v2:172.21.15.203:3300/0 conn(0x7f455813ef30 0x7f4558141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 >> v1:172.21.15.203:6789/0 conn(0x7f4558141ab0 legacy=0x7f45580ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580cf300 con 0x7f45580ce770 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f45500019f0 con 0x7f45580ce770 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 >> v1:172.21.15.146:6789/0 conn(0x7f45580ce770 legacy=0x7f4558071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45380039b0 0x7f4538003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4538004800 0x7f4538004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 0x7f453800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f453800c030 con 0x7f45380051c0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f453800c1e0 con 0x7f45380039b0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f453800c3e0 con 0x7f4538004800 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4557e00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 0x7f453800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f4557400640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45380039b0 0x7f4538003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.938+0000 7f454ea00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4538004800 0x7f4538004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 -- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4538004800 msgr2=0x7f4538004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4538004800 0x7f4538004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 -- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45380039b0 msgr2=0x7f4538003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45380039b0 0x7f4538003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 -- 172.21.15.146:0/2096615901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4538003520 con 0x7f45380051c0 2024-04-24T23:09:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f454ea00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4538004800 0x7f4538004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.939+0000 7f4557e00640 1 -- 172.21.15.146:0/2096615901 reap_dead start 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f4557e00640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 0x7f453800b9c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f455000a850 tx=0x7f4538005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbbbbd5df653a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000a4a0 con 0x7f45380051c0 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455002f070 con 0x7f45380051c0 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f4556a00640 1 -- 172.21.15.146:0/2096615901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455002bce0 con 0x7f45380051c0 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f455e400640 1 -- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 msgr2=0x7f453800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.940+0000 7f455e400640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 0x7f453800b9c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f455000a850 tx=0x7f4538005830 comp rx=0 tx=0).stop 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.941+0000 7f455e400640 1 -- 172.21.15.146:0/2096615901 shutdown_connections 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.941+0000 7f455e400640 1 --2- 172.21.15.146:0/2096615901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45380051c0 0x7f453800b9c0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.941+0000 7f455e400640 1 -- 172.21.15.146:0/2096615901 >> 172.21.15.146:0/2096615901 conn(0x7f45580b17b0 msgr2=0x7f45580b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.941+0000 7f455e400640 1 -- 172.21.15.146:0/2096615901 shutdown_connections 2024-04-24T23:09:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.941+0000 7f455e400640 1 -- 172.21.15.146:0/2096615901 wait complete. 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.942+0000 7f455e400640 1 Processor -- start 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 -- start start 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 0x7f45581f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455815a6d0 0x7f455806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4558141570 con 0x7f455806de20 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4558070f80 con 0x7f455815a6d0 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.943+0000 7f455e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f45581416f0 con 0x7f45380051c0 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34212/0 (socket says 172.21.15.146:34212) 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 -- 172.21.15.146:0/177546100 learned_addr learned my addr 172.21.15.146:0/177546100 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 0x7f45581f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f454ea00640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455815a6d0 0x7f455806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 -- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 msgr2=0x7f45581f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 0x7f45581f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 -- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455815a6d0 msgr2=0x7f455806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455815a6d0 0x7f455806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 -- 172.21.15.146:0/177546100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455815ab50 con 0x7f455806de20 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 0x7f45581f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.944+0000 7f4557e00640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f455002b530 tx=0x7f455002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.945+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455002b880 con 0x7f455806de20 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.945+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455002ba20 con 0x7f455806de20 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.945+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455002bdf0 con 0x7f455806de20 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.945+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45580ae6f0 con 0x7f455806de20 2024-04-24T23:09:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.945+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45580b2c50 con 0x7f455806de20 2024-04-24T23:09:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.946+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455804f5a0 con 0x7f455806de20 2024-04-24T23:09:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.947+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4550034470 con 0x7f455806de20 2024-04-24T23:09:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.948+0000 7f454fe00640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 0x7f453406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.948+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6187+0+0 (secure 0 0 0) 0x7f45500aaec0 con 0x7f455806de20 2024-04-24T23:09:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.949+0000 7f4557400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 0x7f453406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.950+0000 7f4557400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 0x7f453406e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4548009980 tx=0x7f4548008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:43.952+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4550047020 con 0x7f455806de20 2024-04-24T23:09:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.175+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4558072d30 con 0x7f455806de20 2024-04-24T23:09:44.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.744+0000 7f454fe00640 1 -- 172.21.15.146:0/177546100 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7f4550079720 con 0x7f455806de20 2024-04-24T23:09:44.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 msgr2=0x7f453406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 0x7f453406e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4548009980 tx=0x7f4548008040 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 msgr2=0x7f45580ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f455002b530 tx=0x7f455002d070 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 shutdown_connections 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455806de20 0x7f45580ad9a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455815a6d0 0x7f455806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453406be30 0x7f453406e2f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 --2- 172.21.15.146:0/177546100 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45380051c0 0x7f45581f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 >> 172.21.15.146:0/177546100 conn(0x7f45580b17b0 msgr2=0x7f455813f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 shutdown_connections 2024-04-24T23:09:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.748+0000 7f455e400640 1 -- 172.21.15.146:0/177546100 wait complete. 2024-04-24T23:09:44.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:09:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.972+0000 7fdb57e00640 1 Processor -- start 2024-04-24T23:09:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.973+0000 7fdb57e00640 1 -- start start 2024-04-24T23:09:44.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.974+0000 7fdb57e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 0x7fdb58071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.974+0000 7fdb57e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb5806cdd0 0x7fdb5806d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.974+0000 7fdb57e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5815f420 con 0x7fdb58158490 2024-04-24T23:09:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.974+0000 7fdb57e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5815e400 con 0x7fdb5806cdd0 2024-04-24T23:09:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.974+0000 7fdb57e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdb58070c40 con 0x7fdb58071370 2024-04-24T23:09:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb56a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdb58158490 0x7fdb580ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58802/0 (socket says 172.21.15.146:58802) 2024-04-24T23:09:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb56a00640 1 -- 172.21.15.146:0/855749042 learned_addr learned my addr 172.21.15.146:0/855749042 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb57400640 1 --2- 172.21.15.146:0/855749042 >> v2:172.21.15.146:3300/0 conn(0x7fdb5806cdd0 0x7fdb5806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb4e000640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 0x7fdb58071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb56000640 1 -- 172.21.15.146:0/855749042 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140341348 0 0) 0x7fdb5815f420 con 0x7fdb58158490 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb56000640 1 -- 172.21.15.146:0/855749042 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb3c003520 con 0x7fdb58158490 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb57400640 1 -- 172.21.15.146:0/855749042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 msgr2=0x7fdb58071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb57400640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 0x7fdb58071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb57400640 1 -- 172.21.15.146:0/855749042 >> v1:172.21.15.146:6789/0 conn(0x7fdb58158490 legacy=0x7fdb580ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb57400640 1 -- 172.21.15.146:0/855749042 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5815e660 con 0x7fdb5806cdd0 2024-04-24T23:09:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.975+0000 7fdb4e000640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 0x7fdb58071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:09:44.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.976+0000 7fdb57400640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5806d220 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e216fb5b9d4834ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb56000640 1 -- 172.21.15.146:0/855749042 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007740 con 0x7fdb5806cdd0 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb56000640 1 -- 172.21.15.146:0/855749042 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb500078e0 con 0x7fdb5806cdd0 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb56000640 1 -- 172.21.15.146:0/855749042 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007cb0 con 0x7fdb5806cdd0 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 -- 172.21.15.146:0/855749042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 msgr2=0x7fdb5806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5806d220 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5002a530 comp rx=0 tx=0).stop 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 -- 172.21.15.146:0/855749042 shutdown_connections 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5806d220 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 --2- 172.21.15.146:0/855749042 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58071370 0x7fdb58071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 -- 172.21.15.146:0/855749042 >> 172.21.15.146:0/855749042 conn(0x7fdb580b1460 msgr2=0x7fdb580b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 -- 172.21.15.146:0/855749042 shutdown_connections 2024-04-24T23:09:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.977+0000 7fdb57e00640 1 -- 172.21.15.146:0/855749042 wait complete. 2024-04-24T23:09:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.979+0000 7fdb57e00640 1 Processor -- start 2024-04-24T23:09:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.979+0000 7fdb57e00640 1 -- start start 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58071370 0x7fdb5814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58158490 0x7fdb581589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58158870 con 0x7fdb5806cdd0 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5815ec20 con 0x7fdb58071370 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb57e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdb580adfd0 con 0x7fdb58158490 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb56a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb56a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34240/0 (socket says 172.21.15.146:34240) 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.980+0000 7fdb56a00640 1 -- 172.21.15.146:0/43006606 learned_addr learned my addr 172.21.15.146:0/43006606 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 -- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58158490 msgr2=0x7fdb581589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58158490 0x7fdb581589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 -- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58071370 msgr2=0x7fdb5814fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb4e000640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58071370 0x7fdb5814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58071370 0x7fdb5814fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 -- 172.21.15.146:0/43006606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5815d060 con 0x7fdb5806cdd0 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb56a00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c430 tx=0x7fdb4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.981+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48017070 con 0x7fdb5806cdd0 2024-04-24T23:09:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.982+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48005ce0 con 0x7fdb5806cdd0 2024-04-24T23:09:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.982+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480072f0 con 0x7fdb5806cdd0 2024-04-24T23:09:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.982+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5815d340 con 0x7fdb5806cdd0 2024-04-24T23:09:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.982+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb58153d20 con 0x7fdb5806cdd0 2024-04-24T23:09:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.983+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5815d860 con 0x7fdb5806cdd0 2024-04-24T23:09:44.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.984+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb4801a070 con 0x7fdb5806cdd0 2024-04-24T23:09:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.985+0000 7fdb4f400640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 0x7fdb3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.985+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6187+0+0 (secure 0 0 0) 0x7fdb4808a5b0 con 0x7fdb5806cdd0 2024-04-24T23:09:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.985+0000 7fdb4e000640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 0x7fdb3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:44.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.987+0000 7fdb4e000640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 0x7fdb3406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb58068660 tx=0x7fdb40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:44.989+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb5815d860 con 0x7fdb5806cdd0 2024-04-24T23:09:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.192+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb5804f500 con 0x7fdb5806cdd0 2024-04-24T23:09:45.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.748+0000 7fdb4f400640 1 -- 172.21.15.146:0/43006606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7fdb48058ce0 con 0x7fdb5806cdd0 2024-04-24T23:09:45.751 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:09:45.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 msgr2=0x7fdb3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:45.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 0x7fdb3406e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb58068660 tx=0x7fdb40008040 comp rx=0 tx=0).stop 2024-04-24T23:09:45.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 msgr2=0x7fdb5815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:45.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c430 tx=0x7fdb4800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 shutdown_connections 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdb3406be30 0x7fdb3406e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdb58158490 0x7fdb581589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58071370 0x7fdb5814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 --2- 172.21.15.146:0/43006606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5806cdd0 0x7fdb5815c830 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.752+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 >> 172.21.15.146:0/43006606 conn(0x7fdb580b1460 msgr2=0x7fdb580d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.753+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 shutdown_connections 2024-04-24T23:09:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.753+0000 7fdb57e00640 1 -- 172.21.15.146:0/43006606 wait complete. 2024-04-24T23:09:45.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:09:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.979+0000 7f4f1f200640 1 Processor -- start 2024-04-24T23:09:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.979+0000 7f4f1f200640 1 -- start start 2024-04-24T23:09:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.981+0000 7f4f1f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f18145510 0x7f4f180728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.981+0000 7f4f1f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f1815f9f0 0x7f4f1815fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.981+0000 7f4f1f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f180cf040 con 0x7f4f180ceaf0 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.981+0000 7f4f1f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4f180cf320 con 0x7f4f18145510 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.981+0000 7f4f1f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4f18070c70 con 0x7f4f1815f9f0 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f18145510 0x7f4f180728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f18145510 0x7f4f180728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34252/0 (socket says 172.21.15.146:34252) 2024-04-24T23:09:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 -- 172.21.15.146:0/1999675188 learned_addr learned my addr 172.21.15.146:0/1999675188 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 -- 172.21.15.146:0/1999675188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f1815f9f0 msgr2=0x7f4f1815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 --2- 172.21.15.146:0/1999675188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f1815f9f0 0x7f4f1815fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 -- 172.21.15.146:0/1999675188 >> v1:172.21.15.203:6789/0 conn(0x7f4f180ceaf0 legacy=0x7f4f1806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.982+0000 7f4f17e00640 1 -- 172.21.15.146:0/1999675188 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18070f50 con 0x7f4f18145510 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.983+0000 7f4f17e00640 1 --2- 172.21.15.146:0/1999675188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f18145510 0x7f4f180728d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9c96d91078091f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:45.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f17400640 1 -- 172.21.15.146:0/1999675188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08037070 con 0x7f4f18145510 2024-04-24T23:09:45.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f17400640 1 -- 172.21.15.146:0/1999675188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f08032440 con 0x7f4f18145510 2024-04-24T23:09:45.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f17400640 1 -- 172.21.15.146:0/1999675188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08032810 con 0x7f4f18145510 2024-04-24T23:09:45.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 -- 172.21.15.146:0/1999675188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f18145510 msgr2=0x7f4f180728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 --2- 172.21.15.146:0/1999675188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f18145510 0x7f4f180728d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0802a180 comp rx=0 tx=0).stop 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 -- 172.21.15.146:0/1999675188 shutdown_connections 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 --2- 172.21.15.146:0/1999675188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f1815f9f0 0x7f4f1815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 --2- 172.21.15.146:0/1999675188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f18145510 0x7f4f180728d0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 -- 172.21.15.146:0/1999675188 >> 172.21.15.146:0/1999675188 conn(0x7f4f180b16b0 msgr2=0x7f4f180b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 -- 172.21.15.146:0/1999675188 shutdown_connections 2024-04-24T23:09:45.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.984+0000 7f4f1f200640 1 -- 172.21.15.146:0/1999675188 wait complete. 2024-04-24T23:09:45.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.986+0000 7f4f1f200640 1 Processor -- start 2024-04-24T23:09:45.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.986+0000 7f4f1f200640 1 -- start start 2024-04-24T23:09:45.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 0x7f4f1815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 0x7f4f1815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18072e10 con 0x7f4f180ceaf0 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1806d290 con 0x7f4f1815f9f0 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f1f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4f181458f0 con 0x7f4f18145510 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34262/0 (socket says 172.21.15.146:34262) 2024-04-24T23:09:45.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.987+0000 7f4f17e00640 1 -- 172.21.15.146:0/3059984647 learned_addr learned my addr 172.21.15.146:0/3059984647 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f0f400640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 0x7f4f1815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f1d200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 0x7f4f1815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 -- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 msgr2=0x7f4f1815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 0x7f4f1815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 -- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 msgr2=0x7f4f1815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 0x7f4f1815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 -- 172.21.15.146:0/3059984647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18131360 con 0x7f4f180ceaf0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f0f400640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 0x7f4f1815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f1d200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 0x7f4f1815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.988+0000 7f4f17e00640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.989+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08041070 con 0x7f4f180ceaf0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.989+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0803c870 con 0x7f4f180ceaf0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.989+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08037040 con 0x7f4f180ceaf0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.989+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f181315d0 con 0x7f4f180ceaf0 2024-04-24T23:09:45.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.989+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f18131b90 con 0x7f4f180ceaf0 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.990+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f18068190 con 0x7f4f180ceaf0 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.991+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f08044070 con 0x7f4f180ceaf0 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.992+0000 7f4f14c00640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 0x7f4ef406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.992+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5749+0+0 (secure 0 0 0) 0x7f4f080abaa0 con 0x7f4f180ceaf0 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.992+0000 7f4f0f400640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 0x7f4ef406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.994+0000 7f4f0f400640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 0x7f4ef406e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4f181f5630 tx=0x7f4f00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:45.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:45.996+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4f0807a2f0 con 0x7f4f180ceaf0 2024-04-24T23:09:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.195+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f1806e9d0 con 0x7f4f180ceaf0 2024-04-24T23:09:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.759+0000 7f4f14c00640 1 -- 172.21.15.146:0/3059984647 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f4f08079bf0 con 0x7f4f180ceaf0 2024-04-24T23:09:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 msgr2=0x7f4ef406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 0x7f4ef406e320 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4f181f5630 tx=0x7f4f00008040 comp rx=0 tx=0).stop 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 msgr2=0x7f4f180aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f080046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 shutdown_connections 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f1815f9f0 0x7f4f1815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4ef406be60 0x7f4ef406e320 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f18145510 0x7f4f1815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 --2- 172.21.15.146:0/3059984647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f180ceaf0 0x7f4f180aecd0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.765+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 >> 172.21.15.146:0/3059984647 conn(0x7f4f180b16b0 msgr2=0x7f4f180b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.766+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 shutdown_connections 2024-04-24T23:09:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.766+0000 7f4f1f200640 1 -- 172.21.15.146:0/3059984647 wait complete. 2024-04-24T23:09:46.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:09:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.977+0000 7f98ac800640 1 Processor -- start 2024-04-24T23:09:46.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.978+0000 7f98ac800640 1 -- start start 2024-04-24T23:09:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98ac800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98a415e010 0x7f98a406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98ac800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f98a406ed30 0x7f98a40719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98ac800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a415e3f0 con 0x7f98a4071520 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98ac800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f98a406cd20 con 0x7f98a415e010 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98ac800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f98a415f440 con 0x7f98a406ed30 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.979+0000 7f98a9400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f98a4071520 0x7f98a406e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58816/0 (socket says 172.21.15.146:58816) 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9400640 1 -- 172.21.15.146:0/1284751772 learned_addr learned my addr 172.21.15.146:0/1284751772 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9e00640 1 --2- 172.21.15.146:0/1284751772 >> v2:172.21.15.146:3300/0 conn(0x7f98a415e010 0x7f98a406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98aa800640 1 --2- 172.21.15.146:0/1284751772 >> v2:172.21.15.203:3300/0 conn(0x7f98a406ed30 0x7f98a40719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a8a00640 1 -- 172.21.15.146:0/1284751772 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387596498 0 0) 0x7f98a415e3f0 con 0x7f98a4071520 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a8a00640 1 -- 172.21.15.146:0/1284751772 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f988c003520 con 0x7f98a4071520 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9e00640 1 -- 172.21.15.146:0/1284751772 >> v2:172.21.15.203:3300/0 conn(0x7f98a406ed30 msgr2=0x7f98a40719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9e00640 1 --2- 172.21.15.146:0/1284751772 >> v2:172.21.15.203:3300/0 conn(0x7f98a406ed30 0x7f98a40719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9e00640 1 -- 172.21.15.146:0/1284751772 >> v1:172.21.15.146:6789/0 conn(0x7f98a4071520 legacy=0x7f98a406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.980+0000 7f98a9e00640 1 -- 172.21.15.146:0/1284751772 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a4071fe0 con 0x7f98a415e010 2024-04-24T23:09:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.981+0000 7f98a9e00640 1 --2- 172.21.15.146:0/1284751772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a406dd80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f98a4070ba0 tx=0x7f989802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11d355024bc1bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.981+0000 7f98a8a00640 1 -- 172.21.15.146:0/1284751772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898037070 con 0x7f98a415e010 2024-04-24T23:09:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.981+0000 7f98a8a00640 1 -- 172.21.15.146:0/1284751772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9898032440 con 0x7f98a415e010 2024-04-24T23:09:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98a8a00640 1 -- 172.21.15.146:0/1284751772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898032810 con 0x7f98a415e010 2024-04-24T23:09:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 -- 172.21.15.146:0/1284751772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 msgr2=0x7f98a406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 --2- 172.21.15.146:0/1284751772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a406dd80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f98a4070ba0 tx=0x7f989802a1a0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 -- 172.21.15.146:0/1284751772 shutdown_connections 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 --2- 172.21.15.146:0/1284751772 >> v2:172.21.15.203:3300/0 conn(0x7f98a406ed30 0x7f98a40719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 --2- 172.21.15.146:0/1284751772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a406dd80 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 -- 172.21.15.146:0/1284751772 >> 172.21.15.146:0/1284751772 conn(0x7f98a40b17b0 msgr2=0x7f98a40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 -- 172.21.15.146:0/1284751772 shutdown_connections 2024-04-24T23:09:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.982+0000 7f98ac800640 1 -- 172.21.15.146:0/1284751772 wait complete. 2024-04-24T23:09:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.984+0000 7f98ac800640 1 Processor -- start 2024-04-24T23:09:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.984+0000 7f98ac800640 1 -- start start 2024-04-24T23:09:46.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98a406ed30 0x7f98a415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98a4071520 0x7f98a41609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98a406d580 con 0x7f98a415e010 2024-04-24T23:09:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98a406d2a0 con 0x7f98a406ed30 2024-04-24T23:09:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98ac800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f98a406d860 con 0x7f98a4071520 2024-04-24T23:09:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98aa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98aa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34270/0 (socket says 172.21.15.146:34270) 2024-04-24T23:09:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.985+0000 7f98aa800640 1 -- 172.21.15.146:0/239421298 learned_addr learned my addr 172.21.15.146:0/239421298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98a9e00640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98a406ed30 0x7f98a415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 -- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98a4071520 msgr2=0x7f98a41609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98a4071520 0x7f98a41609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 -- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98a406ed30 msgr2=0x7f98a415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98a406ed30 0x7f98a415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 -- 172.21.15.146:0/239421298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a41575d0 con 0x7f98a415e010 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98aa800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0014420 con 0x7f98a415e010 2024-04-24T23:09:46.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0019070 con 0x7f98a415e010 2024-04-24T23:09:46.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0014800 con 0x7f98a415e010 2024-04-24T23:09:46.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.986+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a4153900 con 0x7f98a415e010 2024-04-24T23:09:46.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.987+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a4156ca0 con 0x7f98a415e010 2024-04-24T23:09:46.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.988+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a404f5a0 con 0x7f98a415e010 2024-04-24T23:09:46.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.989+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98a00149a0 con 0x7f98a415e010 2024-04-24T23:09:46.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.989+0000 7f989e000640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 0x7f988406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:46.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.990+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f98a008b4c0 con 0x7f98a415e010 2024-04-24T23:09:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.990+0000 7f98a9e00640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 0x7f988406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.991+0000 7f98a9e00640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 0x7f988406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9898034000 tx=0x7f989802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:46.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:46.994+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f98a005a070 con 0x7f98a415e010 2024-04-24T23:09:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.190+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f98a40b3190 con 0x7f98a415e010 2024-04-24T23:09:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.196+0000 7f989e000640 1 -- 172.21.15.146:0/239421298 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f98a0059970 con 0x7f98a415e010 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 msgr2=0x7f988406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 0x7f988406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9898034000 tx=0x7f989802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 msgr2=0x7f98a41f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 shutdown_connections 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98a415e010 0x7f98a41f7560 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f988406be30 0x7f988406e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f98a4071520 0x7f98a41609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 --2- 172.21.15.146:0/239421298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98a406ed30 0x7f98a415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 >> 172.21.15.146:0/239421298 conn(0x7f98a40b17b0 msgr2=0x7f98a40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 shutdown_connections 2024-04-24T23:09:47.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.199+0000 7f98ac800640 1 -- 172.21.15.146:0/239421298 wait complete. 2024-04-24T23:09:47.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-04-24T23:09:47.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:47.326 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.411+0000 7f276bc00640 1 Processor -- start 2024-04-24T23:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.412+0000 7f276bc00640 1 -- start start 2024-04-24T23:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.413+0000 7f276bc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f27640715f0 0x7f2764071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.413+0000 7f276bc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2764158970 con 0x7f2764158590 2024-04-24T23:09:47.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.413+0000 7f276bc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2764070c10 con 0x7f27640cfc90 2024-04-24T23:09:47.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.413+0000 7f276bc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2764070ef0 con 0x7f27640715f0 2024-04-24T23:09:47.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2769200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2764158590 0x7f2764162450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58832/0 (socket says 172.21.15.146:58832) 2024-04-24T23:09:47.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2769200640 1 -- 172.21.15.146:0/411455317 learned_addr learned my addr 172.21.15.146:0/411455317 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2763e00640 1 --2- 172.21.15.146:0/411455317 >> v2:172.21.15.203:3300/0 conn(0x7f27640715f0 0x7f2764071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889089635 0 0) 0x7f2764158970 con 0x7f2764158590 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f274c003520 con 0x7f2764158590 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.414+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502212917 0 0) 0x7f2764070c10 con 0x7f27640cfc90 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.415+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2764158970 con 0x7f27640cfc90 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.415+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1587509525 0 0) 0x7f274c003520 con 0x7f2764158590 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.415+0000 7f2763e00640 1 -- 172.21.15.146:0/411455317 >> v1:172.21.15.203:6789/0 conn(0x7f27640cfc90 legacy=0x7f276415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.415+0000 7f2763e00640 1 -- 172.21.15.146:0/411455317 >> v1:172.21.15.146:6789/0 conn(0x7f2764158590 legacy=0x7f2764162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.415+0000 7f2763e00640 1 -- 172.21.15.146:0/411455317 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27640711d0 con 0x7f27640715f0 2024-04-24T23:09:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.416+0000 7f2763e00640 1 --2- 172.21.15.146:0/411455317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640715f0 0x7f2764071a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27540097a0 tx=0x7f275402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b051c044cd07a4ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754037070 con 0x7f27640715f0 2024-04-24T23:09:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275402ace0 con 0x7f27640715f0 2024-04-24T23:09:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f2763400640 1 -- 172.21.15.146:0/411455317 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758001670 con 0x7f27640715f0 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 -- 172.21.15.146:0/411455317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640715f0 msgr2=0x7f2764071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 --2- 172.21.15.146:0/411455317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640715f0 0x7f2764071a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27540097a0 tx=0x7f275402a250 comp rx=0 tx=0).stop 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 -- 172.21.15.146:0/411455317 shutdown_connections 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 --2- 172.21.15.146:0/411455317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640715f0 0x7f2764071a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 -- 172.21.15.146:0/411455317 >> 172.21.15.146:0/411455317 conn(0x7f276406b320 msgr2=0x7f276406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 -- 172.21.15.146:0/411455317 shutdown_connections 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.417+0000 7f276bc00640 1 -- 172.21.15.146:0/411455317 wait complete. 2024-04-24T23:09:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.419+0000 7f276bc00640 1 Processor -- start 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.419+0000 7f276bc00640 1 -- start start 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27640715f0 0x7f276415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640cfc90 0x7f2764144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27640d0100 con 0x7f2764158590 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2764161f30 con 0x7f27640cfc90 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f276bc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27640d0280 con 0x7f27640715f0 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f2769c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f2769c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34276/0 (socket says 172.21.15.146:34276) 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.420+0000 7f2769c00640 1 -- 172.21.15.146:0/1054637548 learned_addr learned my addr 172.21.15.146:0/1054637548 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2763e00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640cfc90 0x7f2764144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769200640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27640715f0 0x7f276415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 -- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27640715f0 msgr2=0x7f276415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27640715f0 0x7f276415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 -- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640cfc90 msgr2=0x7f2764144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640cfc90 0x7f2764144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 -- 172.21.15.146:0/1054637548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2764145610 con 0x7f2764158590 2024-04-24T23:09:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.421+0000 7f2769c00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c790 tx=0x7f275c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.422+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c003b70 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.422+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c003d10 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.422+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c00aa50 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.422+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27641458f0 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.422+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2764145eb0 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.423+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764068190 con 0x7f2764158590 2024-04-24T23:09:47.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.424+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f275c00abf0 con 0x7f2764158590 2024-04-24T23:09:47.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.425+0000 7f2760c00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 0x7f274806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:47.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.425+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f275c08ae60 con 0x7f2764158590 2024-04-24T23:09:47.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.425+0000 7f2769200640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 0x7f274806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:47.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.426+0000 7f2769200640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 0x7f274806e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f27580011e0 tx=0x7f2758009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:47.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.429+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f275c059850 con 0x7f2764158590 2024-04-24T23:09:47.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.698+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) -- 0x7f27640b2510 con 0x7f2764158590 2024-04-24T23:09:47.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.771+0000 7f2760c00640 1 -- 172.21.15.146:0/1054637548 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v434) ==== 145+0+0 (secure 0 0 0) 0x7f275c059150 con 0x7f2764158590 2024-04-24T23:09:47.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.775+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 msgr2=0x7f274806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.775+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 0x7f274806e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f27580011e0 tx=0x7f2758009040 comp rx=0 tx=0).stop 2024-04-24T23:09:47.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.775+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 msgr2=0x7f2764158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:47.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.775+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c790 tx=0x7f275c00cc50 comp rx=0 tx=0).stop 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 shutdown_connections 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2764158590 0x7f2764158d70 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27640cfc90 0x7f2764144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f274806be30 0x7f274806e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 --2- 172.21.15.146:0/1054637548 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27640715f0 0x7f276415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 >> 172.21.15.146:0/1054637548 conn(0x7f276406b320 msgr2=0x7f276406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 shutdown_connections 2024-04-24T23:09:47.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:47.776+0000 7f276bc00640 1 -- 172.21.15.146:0/1054637548 wait complete. 2024-04-24T23:09:47.798 INFO:tasks.cephfs_test_runner:test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-04-24T23:09:47.798 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-04-24T23:09:47.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:48.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.028+0000 7f7c09400640 1 Processor -- start 2024-04-24T23:09:48.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.028+0000 7f7c09400640 1 -- start start 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7c09400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7c04145640 0x7f7c0415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7c09400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c040cdf70 con 0x7f7c040b2a20 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7c09400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0415d360 con 0x7f7c040d03a0 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7c09400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7c04145a20 con 0x7f7c04145640 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7bf9e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c040b2a20 0x7f7c040cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45710/0 (socket says 172.21.15.146:45710) 2024-04-24T23:09:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.030+0000 7f7bf9e00640 1 -- 172.21.15.146:0/1624487903 learned_addr learned my addr 172.21.15.146:0/1624487903 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093468958 0 0) 0x7f7c040cdf70 con 0x7f7c040b2a20 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be8003520 con 0x7f7c040b2a20 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c02800640 1 --2- 172.21.15.146:0/1624487903 >> v2:172.21.15.203:3300/0 conn(0x7f7c04145640 0x7f7c0415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2681730664 0 0) 0x7f7be8003520 con 0x7f7c040b2a20 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 >> v2:172.21.15.203:3300/0 conn(0x7f7c04145640 msgr2=0x7f7c0415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 --2- 172.21.15.146:0/1624487903 >> v2:172.21.15.203:3300/0 conn(0x7f7c04145640 0x7f7c0415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 >> v1:172.21.15.203:6789/0 conn(0x7f7c040d03a0 legacy=0x7f7c040ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0406d140 con 0x7f7c040b2a20 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7bec001690 con 0x7f7c040b2a20 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 >> v1:172.21.15.146:6789/0 conn(0x7f7c040b2a20 legacy=0x7f7c040cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7be8003a00 0x7f7be8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8004800 0x7f7be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7be800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c04145a20 con 0x7f7be8005210 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be800c160 con 0x7f7be8004800 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.031+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7be800c360 con 0x7f7be8003a00 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7be800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c02800640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7be8003a00 0x7f7be8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7bf9e00640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8004800 0x7f7be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 -- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7be8003a00 msgr2=0x7f7be8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7be8003a00 0x7f7be8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 -- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8004800 msgr2=0x7f7be8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be8004800 0x7f7be8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c03200640 1 -- 172.21.15.146:0/1624487903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be8003520 con 0x7f7be8005210 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.032+0000 7f7c02800640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7be8003a00 0x7f7be8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.033+0000 7f7c03200640 1 -- 172.21.15.146:0/1624487903 reap_dead start 2024-04-24T23:09:48.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.033+0000 7f7c03200640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7be800b9c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc001e50 tx=0x7f7be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d190232b584a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.033+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc001a70 con 0x7f7be8005210 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.033+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc003970 con 0x7f7be8005210 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.033+0000 7f7c01e00640 1 -- 172.21.15.146:0/1624487903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc003d60 con 0x7f7be8005210 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 -- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 msgr2=0x7f7be800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7be800b9c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc001e50 tx=0x7f7be8005830 comp rx=0 tx=0).stop 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 -- 172.21.15.146:0/1624487903 shutdown_connections 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 --2- 172.21.15.146:0/1624487903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7be800b9c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 -- 172.21.15.146:0/1624487903 >> 172.21.15.146:0/1624487903 conn(0x7f7c0406b320 msgr2=0x7f7c0406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 -- 172.21.15.146:0/1624487903 shutdown_connections 2024-04-24T23:09:48.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.034+0000 7f7c09400640 1 -- 172.21.15.146:0/1624487903 wait complete. 2024-04-24T23:09:48.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.036+0000 7f7c09400640 1 Processor -- start 2024-04-24T23:09:48.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.036+0000 7f7c09400640 1 -- start start 2024-04-24T23:09:48.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04143790 0x7f7c04136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c04143c10 0x7f7c04136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0406d9e0 con 0x7f7be8005210 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0406d700 con 0x7f7c04143c10 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c09400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0406cbc0 con 0x7f7c04143790 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c02800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c02800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35178/0 (socket says 172.21.15.146:35178) 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7c02800640 1 -- 172.21.15.146:0/3800561533 learned_addr learned my addr 172.21.15.146:0/3800561533 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.037+0000 7f7bf9e00640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04143790 0x7f7c04136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 -- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04143790 msgr2=0x7f7c04136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04143790 0x7f7c04136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 -- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c04143c10 msgr2=0x7f7c04136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c04143c10 0x7f7c04136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 -- 172.21.15.146:0/3800561533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0415c3d0 con 0x7f7be8005210 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c02800640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e810 tx=0x7f7bf400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4017070 con 0x7f7be8005210 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf400c6d0 con 0x7f7be8005210 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400f040 con 0x7f7be8005210 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c04141540 con 0x7f7be8005210 2024-04-24T23:09:48.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.038+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0415e230 con 0x7f7be8005210 2024-04-24T23:09:48.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.040+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c04068190 con 0x7f7be8005210 2024-04-24T23:09:48.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.041+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bf401a070 con 0x7f7be8005210 2024-04-24T23:09:48.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.042+0000 7f7bfb400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.042+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f7bf408a900 con 0x7f7be8005210 2024-04-24T23:09:48.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.042+0000 7f7bf9e00640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.043+0000 7f7bf9e00640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 0x7f7be006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c040ccd50 tx=0x7f7bec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.046+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7bf4059410 con 0x7f7be8005210 2024-04-24T23:09:48.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.244+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c040af880 con 0x7f7be8005210 2024-04-24T23:09:48.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.246+0000 7f7bfb400640 1 -- 172.21.15.146:0/3800561533 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+13320 (secure 0 0 0) 0x7f7bf4058d10 con 0x7f7be8005210 2024-04-24T23:09:48.248 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:48.248 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:46.750085+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/3967134794":"2024-04-25T23:09:43.730309+0000","172.21.15.146:6833/3967134794":"2024-04-25T23:09:43.730309+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 msgr2=0x7f7be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 0x7f7be006e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c040ccd50 tx=0x7f7bec009040 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 msgr2=0x7f7c0415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e810 tx=0x7f7bf400ecd0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 shutdown_connections 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.248+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c04143c10 0x7f7c04136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7be006be30 0x7f7be006e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7c04143790 0x7f7c04136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 --2- 172.21.15.146:0/3800561533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be8005210 0x7f7c0415dcf0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 >> 172.21.15.146:0/3800561533 conn(0x7f7c0406b320 msgr2=0x7f7c04138d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 shutdown_connections 2024-04-24T23:09:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.249+0000 7f7c09400640 1 -- 172.21.15.146:0/3800561533 wait complete. 2024-04-24T23:09:48.272 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:48.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.466+0000 7f09a2400640 1 Processor -- start 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.466+0000 7f09a2400640 1 -- start start 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f09a2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c141c80 0x7f099c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f09a2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f099c0ce5a0 0x7f099c071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f09a2400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c0ced40 con 0x7f099c13ef30 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f09a2400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f099c1423d0 con 0x7f099c0ce5a0 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f09a2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f099c070f80 con 0x7f099c141c80 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f099c13ef30 0x7f099c141570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45720/0 (socket says 172.21.15.146:45720) 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099b400640 1 -- 172.21.15.146:0/3285238703 learned_addr learned my addr 172.21.15.146:0/3285238703 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099be00640 1 --2- 172.21.15.146:0/3285238703 >> v2:172.21.15.146:3300/0 conn(0x7f099c0ce5a0 0x7f099c071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099aa00640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c141c80 0x7f099c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099a000640 1 -- 172.21.15.146:0/3285238703 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795594158 0 0) 0x7f099c0ced40 con 0x7f099c13ef30 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.468+0000 7f099a000640 1 -- 172.21.15.146:0/3285238703 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0980003520 con 0x7f099c13ef30 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.469+0000 7f099be00640 1 -- 172.21.15.146:0/3285238703 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c141c80 msgr2=0x7f099c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.469+0000 7f099be00640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c141c80 0x7f099c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.469+0000 7f099be00640 1 -- 172.21.15.146:0/3285238703 >> v1:172.21.15.146:6789/0 conn(0x7f099c13ef30 legacy=0x7f099c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.469+0000 7f099be00640 1 -- 172.21.15.146:0/3285238703 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0cf020 con 0x7f099c0ce5a0 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.470+0000 7f099be00640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c0ce5a0 0x7f099c071410 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f0994009d90 tx=0x7f099402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ec5069bb78f4df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.470+0000 7f099a000640 1 -- 172.21.15.146:0/3285238703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994007740 con 0x7f099c0ce5a0 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.470+0000 7f099a000640 1 -- 172.21.15.146:0/3285238703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09940078e0 con 0x7f099c0ce5a0 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.470+0000 7f099a000640 1 -- 172.21.15.146:0/3285238703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994007c90 con 0x7f099c0ce5a0 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 -- 172.21.15.146:0/3285238703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c0ce5a0 msgr2=0x7f099c071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c0ce5a0 0x7f099c071410 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f0994009d90 tx=0x7f099402a660 comp rx=0 tx=0).stop 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 -- 172.21.15.146:0/3285238703 shutdown_connections 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c0ce5a0 0x7f099c071410 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 --2- 172.21.15.146:0/3285238703 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c141c80 0x7f099c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 -- 172.21.15.146:0/3285238703 >> 172.21.15.146:0/3285238703 conn(0x7f099c0b17b0 msgr2=0x7f099c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 -- 172.21.15.146:0/3285238703 shutdown_connections 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.471+0000 7f09a2400640 1 -- 172.21.15.146:0/3285238703 wait complete. 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.473+0000 7f09a2400640 1 Processor -- start 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.473+0000 7f09a2400640 1 -- start start 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 0x7f099c13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c13ef30 0x7f099c1f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0cea50 con 0x7f099c141c80 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f099c070c10 con 0x7f099c0ce5a0 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f09a2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f099c071950 con 0x7f099c13ef30 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35188/0 (socket says 172.21.15.146:35188) 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 -- 172.21.15.146:0/2339540774 learned_addr learned my addr 172.21.15.146:0/2339540774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099aa00640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c13ef30 0x7f099c1f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099b400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 0x7f099c13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 -- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c13ef30 msgr2=0x7f099c1f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c13ef30 0x7f099c1f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 -- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 msgr2=0x7f099c13dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 0x7f099c13dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099be00640 1 -- 172.21.15.146:0/2339540774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c1560e0 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.474+0000 7f099b400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 0x7f099c13dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f099be00640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f0994009eb0 tx=0x7f0994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994040070 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994031c60 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994009450 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1563c0 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.475+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c156980 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.476+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c04f5a0 con 0x7f099c141c80 2024-04-24T23:09:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.477+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0994039040 con 0x7f099c141c80 2024-04-24T23:09:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.478+0000 7f0993400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 0x7f097c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.478+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f09940ac250 con 0x7f099c141c80 2024-04-24T23:09:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.479+0000 7f099b400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 0x7f097c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.480+0000 7f099b400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 0x7f097c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f098c005880 tx=0x7f098c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.483+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f099407ad60 con 0x7f099c141c80 2024-04-24T23:09:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.685+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f099c13e010 con 0x7f099c141c80 2024-04-24T23:09:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.686+0000 7f0993400640 1 -- 172.21.15.146:0/2339540774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f099407a660 con 0x7f099c141c80 2024-04-24T23:09:48.688 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.688+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 msgr2=0x7f097c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.688+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 0x7f097c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f098c005880 tx=0x7f098c009040 comp rx=0 tx=0).stop 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.688+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 msgr2=0x7f099c15a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.688+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f0994009eb0 tx=0x7f0994004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 shutdown_connections 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f099c141c80 0x7f099c15a950 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f097c06be30 0x7f097c06e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f099c13ef30 0x7f099c1f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 --2- 172.21.15.146:0/2339540774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f099c0ce5a0 0x7f099c13dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 >> 172.21.15.146:0/2339540774 conn(0x7f099c0b17b0 msgr2=0x7f099c1408d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 shutdown_connections 2024-04-24T23:09:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.689+0000 7f09a2400640 1 -- 172.21.15.146:0/2339540774 wait complete. 2024-04-24T23:09:48.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-04-24T23:09:48.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.909+0000 7f385ce00640 1 Processor -- start 2024-04-24T23:09:48.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.909+0000 7f385ce00640 1 -- start start 2024-04-24T23:09:48.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.911+0000 7f385ce00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f385814b850 0x7f38580b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.911+0000 7f385ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.911+0000 7f385ce00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38581662b0 con 0x7f385814be80 2024-04-24T23:09:48.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.911+0000 7f385ce00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f385814bc30 con 0x7f385814b850 2024-04-24T23:09:48.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.911+0000 7f385ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3858166590 con 0x7f38580d03a0 2024-04-24T23:09:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:33894/0 (socket says 172.21.15.146:33894) 2024-04-24T23:09:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 -- 172.21.15.146:0/3027971975 learned_addr learned my addr 172.21.15.146:0/3027971975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3855e00640 1 --2- 172.21.15.146:0/3027971975 >> v2:172.21.15.203:3300/0 conn(0x7f385814b850 0x7f38580b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 -- 172.21.15.146:0/3027971975 >> v2:172.21.15.203:3300/0 conn(0x7f385814b850 msgr2=0x7f38580b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 --2- 172.21.15.146:0/3027971975 >> v2:172.21.15.203:3300/0 conn(0x7f385814b850 0x7f38580b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 -- 172.21.15.146:0/3027971975 >> v1:172.21.15.203:6789/0 conn(0x7f385814be80 legacy=0x7f38580cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.912+0000 7f3856800640 1 -- 172.21.15.146:0/3027971975 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3858166870 con 0x7f38580d03a0 2024-04-24T23:09:48.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.914+0000 7f3856800640 1 --2- 172.21.15.146:0/3027971975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3850009870 tx=0x7f385002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b847e4d410b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f3854a00640 1 -- 172.21.15.146:0/3027971975 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037070 con 0x7f38580d03a0 2024-04-24T23:09:48.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f3854a00640 1 -- 172.21.15.146:0/3027971975 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850032440 con 0x7f38580d03a0 2024-04-24T23:09:48.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f3854a00640 1 -- 172.21.15.146:0/3027971975 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850032810 con 0x7f38580d03a0 2024-04-24T23:09:48.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 -- 172.21.15.146:0/3027971975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 msgr2=0x7f3858071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 --2- 172.21.15.146:0/3027971975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3850009870 tx=0x7f385002a1c0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 -- 172.21.15.146:0/3027971975 shutdown_connections 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 --2- 172.21.15.146:0/3027971975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38580d03a0 0x7f3858071150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 --2- 172.21.15.146:0/3027971975 >> v2:172.21.15.203:3300/0 conn(0x7f385814b850 0x7f38580b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.915+0000 7f385ce00640 1 -- 172.21.15.146:0/3027971975 >> 172.21.15.146:0/3027971975 conn(0x7f385806b320 msgr2=0x7f385806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.916+0000 7f385ce00640 1 -- 172.21.15.146:0/3027971975 shutdown_connections 2024-04-24T23:09:48.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.916+0000 7f385ce00640 1 -- 172.21.15.146:0/3027971975 wait complete. 2024-04-24T23:09:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.917+0000 7f385ce00640 1 Processor -- start 2024-04-24T23:09:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.918+0000 7f385ce00640 1 -- start start 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f385814b850 0x7f3858149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f385814be80 0x7f38580aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3858166070 con 0x7f38580d03a0 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3858165ef0 con 0x7f385814b850 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f385ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3858071690 con 0x7f385814be80 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35196/0 (socket says 172.21.15.146:35196) 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855e00640 1 -- 172.21.15.146:0/2183315387 learned_addr learned my addr 172.21.15.146:0/2183315387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3856800640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f385814be80 0x7f38580aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855400640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f385814b850 0x7f3858149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855e00640 1 -- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f385814be80 msgr2=0x7f38580aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.919+0000 7f3855e00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f385814be80 0x7f38580aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f3855e00640 1 -- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f385814b850 msgr2=0x7f3858149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f3855e00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f385814b850 0x7f3858149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f3855e00640 1 -- 172.21.15.146:0/2183315387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385814a280 con 0x7f38580d03a0 2024-04-24T23:09:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f3855e00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9b0 tx=0x7f384800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848017070 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384800c9a0 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385814a530 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384800cd90 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.920+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385814aaf0 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.921+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858068190 con 0x7f38580d03a0 2024-04-24T23:09:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.922+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f384801a070 con 0x7f38580d03a0 2024-04-24T23:09:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.923+0000 7f384e000640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 0x7f383406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.923+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f384808ad30 con 0x7f38580d03a0 2024-04-24T23:09:48.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.924+0000 7f3855400640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 0x7f383406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.925+0000 7f3855400640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 0x7f383406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3840007fd0 tx=0x7f3840009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:48.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:48.928+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3848059850 con 0x7f38580d03a0 2024-04-24T23:09:49.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.212+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) -- 0x7f385806e770 con 0x7f38580d03a0 2024-04-24T23:09:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.785+0000 7f384e000640 1 -- 172.21.15.146:0/2183315387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v436) ==== 158+0+0 (secure 0 0 0) 0x7f3848059150 con 0x7f38580d03a0 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 msgr2=0x7f383406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 0x7f383406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3840007fd0 tx=0x7f3840009040 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 msgr2=0x7f3858161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9b0 tx=0x7f384800ee70 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 shutdown_connections 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f383406be30 0x7f383406e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f385814be80 0x7f38580aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f385814b850 0x7f3858149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 --2- 172.21.15.146:0/2183315387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38580d03a0 0x7f3858161170 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 >> 172.21.15.146:0/2183315387 conn(0x7f385806b320 msgr2=0x7f3858164980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.789+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 shutdown_connections 2024-04-24T23:09:49.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:49.790+0000 7f385ce00640 1 -- 172.21.15.146:0/2183315387 wait complete. 2024-04-24T23:09:49.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-24T23:09:50.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.011+0000 7f114ec00640 1 Processor -- start 2024-04-24T23:09:50.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.011+0000 7f114ec00640 1 -- start start 2024-04-24T23:09:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f114806e670 0x7f114806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114ec00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11480cdcc0 con 0x7f114806df60 2024-04-24T23:09:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f114815c0e0 con 0x7f114806e670 2024-04-24T23:09:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1148160730 con 0x7f114815bd00 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.013+0000 7f114d800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:33920/0 (socket says 172.21.15.146:33920) 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 -- 172.21.15.146:0/83434806 learned_addr learned my addr 172.21.15.146:0/83434806 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114ce00640 1 --2- 172.21.15.146:0/83434806 >> v2:172.21.15.203:3300/0 conn(0x7f114806e670 0x7f114806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 -- 172.21.15.146:0/83434806 >> v2:172.21.15.203:3300/0 conn(0x7f114806e670 msgr2=0x7f114806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 --2- 172.21.15.146:0/83434806 >> v2:172.21.15.203:3300/0 conn(0x7f114806e670 0x7f114806da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 -- 172.21.15.146:0/83434806 >> v1:172.21.15.203:6789/0 conn(0x7f114806df60 legacy=0x7f114806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.014+0000 7f114d800640 1 -- 172.21.15.146:0/83434806 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148071970 con 0x7f114815bd00 2024-04-24T23:09:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.016+0000 7f114d800640 1 --2- 172.21.15.146:0/83434806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126425050fe496f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.016+0000 7f1147e00640 1 -- 172.21.15.146:0/83434806 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c037070 con 0x7f114815bd00 2024-04-24T23:09:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.016+0000 7f1147e00640 1 -- 172.21.15.146:0/83434806 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113c032440 con 0x7f114815bd00 2024-04-24T23:09:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.016+0000 7f1147e00640 1 -- 172.21.15.146:0/83434806 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c032810 con 0x7f114815bd00 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 -- 172.21.15.146:0/83434806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 msgr2=0x7f11481601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 --2- 172.21.15.146:0/83434806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c02a250 comp rx=0 tx=0).stop 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 -- 172.21.15.146:0/83434806 shutdown_connections 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 --2- 172.21.15.146:0/83434806 >> v2:172.21.15.203:3300/0 conn(0x7f114806e670 0x7f114806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 --2- 172.21.15.146:0/83434806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114815bd00 0x7f11481601f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 -- 172.21.15.146:0/83434806 >> 172.21.15.146:0/83434806 conn(0x7f11480b1560 msgr2=0x7f11480b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 -- 172.21.15.146:0/83434806 shutdown_connections 2024-04-24T23:09:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.017+0000 7f114ec00640 1 -- 172.21.15.146:0/83434806 wait complete. 2024-04-24T23:09:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.019+0000 7f114ec00640 1 Processor -- start 2024-04-24T23:09:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.019+0000 7f114ec00640 1 -- start start 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114806df60 0x7f11481530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 0x7f11481430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11480ce500 con 0x7f114806e670 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11480ce220 con 0x7f114815bd00 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11480ce7e0 con 0x7f114806df60 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35200/0 (socket says 172.21.15.146:35200) 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114ce00640 1 -- 172.21.15.146:0/3585142768 learned_addr learned my addr 172.21.15.146:0/3585142768 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114d800640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114806df60 0x7f11481530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.020+0000 7f114e200640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 0x7f11481430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 -- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114806df60 msgr2=0x7f11481530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114806df60 0x7f11481530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 -- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 msgr2=0x7f11481430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 0x7f11481430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 -- 172.21.15.146:0/3585142768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148156280 con 0x7f114806e670 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114e200640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 0x7f11481430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ce00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f113400e9e0 tx=0x7f113400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134017070 con 0x7f114806e670 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113400c9d0 con 0x7f114806e670 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114815d150 con 0x7f114806e670 2024-04-24T23:09:50.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113400cdc0 con 0x7f114806e670 2024-04-24T23:09:50.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.021+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114815d710 con 0x7f114806e670 2024-04-24T23:09:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.023+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114804f500 con 0x7f114806e670 2024-04-24T23:09:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.023+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f113401a070 con 0x7f114806e670 2024-04-24T23:09:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.024+0000 7f1145600640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 0x7f112806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.024+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f113408b170 con 0x7f114806e670 2024-04-24T23:09:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.025+0000 7f114d800640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 0x7f112806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.026+0000 7f114d800640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 0x7f112806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f113c034000 tx=0x7f113c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.029+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1134059c00 con 0x7f114806e670 2024-04-24T23:09:50.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.229+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f11480af440 con 0x7f114806e670 2024-04-24T23:09:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.237+0000 7f1145600640 1 -- 172.21.15.146:0/3585142768 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f1134059500 con 0x7f114806e670 2024-04-24T23:09:50.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 msgr2=0x7f112806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 0x7f112806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f113c034000 tx=0x7f113c02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:50.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 msgr2=0x7f11481521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f113400e9e0 tx=0x7f113400eea0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 shutdown_connections 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f114815bd00 0x7f11481430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f114806e670 0x7f11481521b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f112806be30 0x7f112806e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 --2- 172.21.15.146:0/3585142768 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f114806df60 0x7f11481530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 >> 172.21.15.146:0/3585142768 conn(0x7f11480b1560 msgr2=0x7f1148071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 shutdown_connections 2024-04-24T23:09:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.240+0000 7f114ec00640 1 -- 172.21.15.146:0/3585142768 wait complete. 2024-04-24T23:09:50.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:09:50.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:50.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:09:50.476 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:09:50.476 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:50.476 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:50.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:50.535 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:50.536 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:50.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:50.594 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:09:50.594 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:50.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:09:50.652 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:09:50.652 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:09:50.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:09:50.709 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-24T23:09:50.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:09:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.917+0000 7f4e13400640 1 Processor -- start 2024-04-24T23:09:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.918+0000 7f4e13400640 1 -- start start 2024-04-24T23:09:50.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.919+0000 7f4e13400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e0c0b2a20 0x7f4e0c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.919+0000 7f4e13400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0c0cdf70 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.919+0000 7f4e13400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0c145a20 con 0x7f4e0c145640 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.919+0000 7f4e13400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0c06d140 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e11400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4e0c06cbc0 0x7f4e0c0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45736/0 (socket says 172.21.15.146:45736) 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e11400640 1 -- 172.21.15.146:0/946979191 learned_addr learned my addr 172.21.15.146:0/946979191 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:50.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e0be00640 1 --2- 172.21.15.146:0/946979191 >> v2:172.21.15.146:3300/0 conn(0x7f4e0c0b2a20 0x7f4e0c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e0be00640 1 -- 172.21.15.146:0/946979191 >> v1:172.21.15.203:6789/0 conn(0x7f4e0c145640 legacy=0x7f4e0c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e0be00640 1 -- 172.21.15.146:0/946979191 >> v1:172.21.15.146:6789/0 conn(0x7f4e0c06cbc0 legacy=0x7f4e0c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.920+0000 7f4e0be00640 1 -- 172.21.15.146:0/946979191 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c06d420 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.921+0000 7f4e0be00640 1 --2- 172.21.15.146:0/946979191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0cfc90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097a0 tx=0x7f4df802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a912f47b929898d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e0b400640 1 -- 172.21.15.146:0/946979191 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8037070 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e0b400640 1 -- 172.21.15.146:0/946979191 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df8032440 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e0b400640 1 -- 172.21.15.146:0/946979191 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8032810 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e13400640 1 -- 172.21.15.146:0/946979191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c0b2a20 msgr2=0x7f4e0c0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e13400640 1 --2- 172.21.15.146:0/946979191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0cfc90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097a0 tx=0x7f4df802a230 comp rx=0 tx=0).stop 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e13400640 1 -- 172.21.15.146:0/946979191 shutdown_connections 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e13400640 1 --2- 172.21.15.146:0/946979191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0cfc90 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.922+0000 7f4e13400640 1 -- 172.21.15.146:0/946979191 >> 172.21.15.146:0/946979191 conn(0x7f4e0c06b320 msgr2=0x7f4e0c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.923+0000 7f4e13400640 1 -- 172.21.15.146:0/946979191 shutdown_connections 2024-04-24T23:09:50.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.923+0000 7f4e13400640 1 -- 172.21.15.146:0/946979191 wait complete. 2024-04-24T23:09:50.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.924+0000 7f4e13400640 1 Processor -- start 2024-04-24T23:09:50.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.924+0000 7f4e13400640 1 -- start start 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e0c145640 0x7f4e0c1f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c0d01d0 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c06d9e0 con 0x7f4e0c0b2a20 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.925+0000 7f4e13400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0d0350 con 0x7f4e0c145640 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35226/0 (socket says 172.21.15.146:35226) 2024-04-24T23:09:50.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 -- 172.21.15.146:0/3028695990 learned_addr learned my addr 172.21.15.146:0/3028695990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e0be00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e11400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e0c145640 0x7f4e0c1f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 -- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e0c145640 msgr2=0x7f4e0c1f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e0c145640 0x7f4e0c1f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 -- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e0c0b2a20 msgr2=0x7f4e0c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:50.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 -- 172.21.15.146:0/3028695990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c13b690 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.926+0000 7f4e10a00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c400 tx=0x7f4e0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.927+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00017070 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.927+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e000052d0 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.927+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00003830 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.927+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c13b970 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.927+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c0ae5b0 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.928+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c068190 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.929+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e0001a070 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.930+0000 7f4e08c00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 0x7f4dec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.930+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f4e0008a0e0 con 0x7f4e0c06cbc0 2024-04-24T23:09:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.931+0000 7f4e0be00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 0x7f4dec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.932+0000 7f4e0be00640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 0x7f4dec06e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4df8034000 tx=0x7f4df802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:50.935+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4e00058b60 con 0x7f4e0c06cbc0 2024-04-24T23:09:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.170+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e0c0b4900 con 0x7f4e0c06cbc0 2024-04-24T23:09:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.171+0000 7f4e08c00640 1 -- 172.21.15.146:0/3028695990 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+3872 (secure 0 0 0) 0x7f4e00058460 con 0x7f4e0c06cbc0 2024-04-24T23:09:51.174 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/23728628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":23728628},{"type":"v1","addr":"172.21.15.203:6837","nonce":23728628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1032012570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1032012570},{"type":"v1","addr":"172.21.15.203:6835","nonce":1032012570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/599913415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":599913415},{"type":"v1","addr":"172.21.15.146:6834","nonce":599913415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":7860,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1380746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1380746019},{"type":"v1","addr":"172.21.15.146:6835","nonce":1380746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-04-24T23:09:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 76 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 msgr2=0x7f4dec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 0x7f4dec06e320 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4df8034000 tx=0x7f4df802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 msgr2=0x7f4e0c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c400 tx=0x7f4e0000c8c0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 shutdown_connections 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4dec06be60 0x7f4dec06e320 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e0c145640 0x7f4e0c1f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e0c0b2a20 0x7f4e0c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 --2- 172.21.15.146:0/3028695990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e0c06cbc0 0x7f4e0c158b50 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.174+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 >> 172.21.15.146:0/3028695990 conn(0x7f4e0c06b320 msgr2=0x7f4e0c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.175+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 shutdown_connections 2024-04-24T23:09:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.175+0000 7f4e13400640 1 -- 172.21.15.146:0/3028695990 wait complete. 2024-04-24T23:09:51.198 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:09:51.198 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-24T23:09:51.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:09:51.198 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:51.198 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:09:51.198 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-24T23:09:51.199 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:09:51.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:51.199 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:09:51.199 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-24T23:09:51.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:09:51.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:51.200 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-24T23:09:51.200 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-24T23:09:51.200 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:09:51.200 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:09:51.214 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:09:51.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:09:51.219 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:09:51.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:09:51.234 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:09:51.234 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-24T23:09:51.235 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:09:51.235 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:09:51.264 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:09:51.264 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:51.270 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:09:51.271 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:51.283 INFO:tasks.ceph.mds.d:Started 2024-04-24T23:09:51.283 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:51.289 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:09:51.289 DEBUG:teuthology.parallel:result is None 2024-04-24T23:09:51.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-24T23:09:51.414 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-04-24T23:09:51.415 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-04-24T23:09:51.435 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-24T23:09:51.435 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:09:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.466+0000 7f214dc00640 1 Processor -- start 2024-04-24T23:09:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.466+0000 7f214dc00640 1 -- start start 2024-04-24T23:09:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f214dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f214dc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21480cf7a0 con 0x7f21480d2c60 2024-04-24T23:09:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f214dc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21480cfa40 con 0x7f21480b5590 2024-04-24T23:09:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f214dc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21480b6dc0 con 0x7f21481619c0 2024-04-24T23:09:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f2147400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f21480d2c60 0x7f21480b7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45762/0 (socket says 172.21.15.146:45762) 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.467+0000 7f2147400640 1 -- 172.21.15.146:0/356903502 learned_addr learned my addr 172.21.15.146:0/356903502 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146a00640 1 --2- 172.21.15.146:0/356903502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695359436 0 0) 0x7f21480cf7a0 con 0x7f21480d2c60 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f212c003520 con 0x7f21480d2c60 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929848128 0 0) 0x7f21480cfa40 con 0x7f21480b5590 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21480cf7a0 con 0x7f21480b5590 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146a00640 1 -- 172.21.15.146:0/356903502 >> v1:172.21.15.203:6789/0 conn(0x7f21480b5590 legacy=0x7f21480d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146a00640 1 -- 172.21.15.146:0/356903502 >> v1:172.21.15.146:6789/0 conn(0x7f21480d2c60 legacy=0x7f21480b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.468+0000 7f2146a00640 1 -- 172.21.15.146:0/356903502 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21480cfd20 con 0x7f21481619c0 2024-04-24T23:09:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.469+0000 7f2146a00640 1 --2- 172.21.15.146:0/356903502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b5050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21300097d0 tx=0x7f213002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc0b4bfea3333c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130037070 con 0x7f21481619c0 2024-04-24T23:09:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213002ae50 con 0x7f21481619c0 2024-04-24T23:09:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f2146000640 1 -- 172.21.15.146:0/356903502 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130032660 con 0x7f21481619c0 2024-04-24T23:09:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 -- 172.21.15.146:0/356903502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 msgr2=0x7f21480b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 --2- 172.21.15.146:0/356903502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b5050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21300097d0 tx=0x7f213002a100 comp rx=0 tx=0).stop 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 -- 172.21.15.146:0/356903502 shutdown_connections 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 --2- 172.21.15.146:0/356903502 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b5050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 -- 172.21.15.146:0/356903502 >> 172.21.15.146:0/356903502 conn(0x7f21480d3f70 msgr2=0x7f21480d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.470+0000 7f214dc00640 1 -- 172.21.15.146:0/356903502 shutdown_connections 2024-04-24T23:09:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.471+0000 7f214dc00640 1 -- 172.21.15.146:0/356903502 wait complete. 2024-04-24T23:09:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.472+0000 7f214dc00640 1 Processor -- start 2024-04-24T23:09:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.472+0000 7f214dc00640 1 -- start start 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 0x7f2148153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2148161da0 con 0x7f21480d2c60 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21480d1f70 con 0x7f21480b5590 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.473+0000 7f214dc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2148161f20 con 0x7f21481619c0 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35254/0 (socket says 172.21.15.146:35254) 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 -- 172.21.15.146:0/2908615685 learned_addr learned my addr 172.21.15.146:0/2908615685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 -- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 msgr2=0x7f21480b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 -- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 msgr2=0x7f2148153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f2146a00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 0x7f2148153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 0x7f2148153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 -- 172.21.15.146:0/2908615685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21481569d0 con 0x7f21480d2c60 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f2146a00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 0x7f2148153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.474+0000 7f213e000640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f213800c500 tx=0x7f213800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.475+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380052d0 con 0x7f21480d2c60 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.475+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2138005490 con 0x7f21480d2c60 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.475+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138012870 con 0x7f21480d2c60 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.475+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2148156130 con 0x7f21480d2c60 2024-04-24T23:09:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.475+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21481566f0 con 0x7f21480d2c60 2024-04-24T23:09:51.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.476+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214804f5a0 con 0x7f21480d2c60 2024-04-24T23:09:51.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.477+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2138012a10 con 0x7f21480d2c60 2024-04-24T23:09:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.478+0000 7f213f400640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 0x7f212406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.478+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5335+0+0 (secure 0 0 0) 0x7f213808aad0 con 0x7f21480d2c60 2024-04-24T23:09:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.478+0000 7f2146a00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 0x7f212406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.479+0000 7f2146a00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 0x7f212406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2130034000 tx=0x7f213002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.483+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2138059560 con 0x7f21480d2c60 2024-04-24T23:09:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.697+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f21480d2330 con 0x7f21480d2c60 2024-04-24T23:09:51.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.818+0000 7f213f400640 1 -- 172.21.15.146:0/2908615685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) ==== 97+0+0 (secure 0 0 0) 0x7f2138058e60 con 0x7f21480d2c60 2024-04-24T23:09:51.820 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-04-24T23:09:51.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 msgr2=0x7f212406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 0x7f212406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2130034000 tx=0x7f213002e000 comp rx=0 tx=0).stop 2024-04-24T23:09:51.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 msgr2=0x7f2148155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:51.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f213800c500 tx=0x7f213800c9c0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 shutdown_connections 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.821+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f212406be30 0x7f212406e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21481619c0 0x7f21480b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480d2c60 0x7f2148155870 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 --2- 172.21.15.146:0/2908615685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21480b5590 0x7f2148153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 >> 172.21.15.146:0/2908615685 conn(0x7f21480d3f70 msgr2=0x7f214815f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 shutdown_connections 2024-04-24T23:09:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:51.822+0000 7f214dc00640 1 -- 172.21.15.146:0/2908615685 wait complete. 2024-04-24T23:09:51.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-24T23:09:52.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.041+0000 7ff761a00640 1 Processor -- start 2024-04-24T23:09:52.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.041+0000 7ff761a00640 1 -- start start 2024-04-24T23:09:52.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.043+0000 7ff761a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 0x7ff75c0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.043+0000 7ff761a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 0x7ff75c071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.043+0000 7ff761a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75c1662b0 con 0x7ff75c14b850 2024-04-24T23:09:52.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.043+0000 7ff761a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff75c14bc30 con 0x7ff75c0d03a0 2024-04-24T23:09:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.043+0000 7ff761a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff75c166590 con 0x7ff75c14be80 2024-04-24T23:09:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.044+0000 7ff75a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 0x7ff75c0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.044+0000 7ff75b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 0x7ff75c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.044+0000 7ff75aa00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7ff75c14b850 0x7ff75c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:51480/0 (socket says 172.21.15.146:51480) 2024-04-24T23:09:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.044+0000 7ff75aa00640 1 -- 172.21.15.146:0/1968837102 learned_addr learned my addr 172.21.15.146:0/1968837102 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.044+0000 7ff75a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 0x7ff75c0b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:41642/0 (socket says 172.21.15.146:41642) 2024-04-24T23:09:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.045+0000 7ff75b400640 1 -- 172.21.15.146:0/1968837102 >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 msgr2=0x7ff75c0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.045+0000 7ff75b400640 1 --2- 172.21.15.146:0/1968837102 >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 0x7ff75c0b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.045+0000 7ff75b400640 1 -- 172.21.15.146:0/1968837102 >> v1:172.21.15.203:6789/0 conn(0x7ff75c14b850 legacy=0x7ff75c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.045+0000 7ff75b400640 1 -- 172.21.15.146:0/1968837102 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c166870 con 0x7ff75c14be80 2024-04-24T23:09:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.046+0000 7ff75b400640 1 --2- 172.21.15.146:0/1968837102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 0x7ff75c071150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7540097a0 tx=0x7ff75402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33827d8629f492de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.047+0000 7ff759600640 1 -- 172.21.15.146:0/1968837102 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754037070 con 0x7ff75c14be80 2024-04-24T23:09:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.047+0000 7ff759600640 1 -- 172.21.15.146:0/1968837102 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75402ae50 con 0x7ff75c14be80 2024-04-24T23:09:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.047+0000 7ff759600640 1 -- 172.21.15.146:0/1968837102 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754032660 con 0x7ff75c14be80 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 -- 172.21.15.146:0/1968837102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 msgr2=0x7ff75c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 --2- 172.21.15.146:0/1968837102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 0x7ff75c071150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7540097a0 tx=0x7ff75402a100 comp rx=0 tx=0).stop 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 -- 172.21.15.146:0/1968837102 shutdown_connections 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 --2- 172.21.15.146:0/1968837102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14be80 0x7ff75c071150 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 --2- 172.21.15.146:0/1968837102 >> v2:172.21.15.203:3300/0 conn(0x7ff75c0d03a0 0x7ff75c0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 -- 172.21.15.146:0/1968837102 >> 172.21.15.146:0/1968837102 conn(0x7ff75c06b320 msgr2=0x7ff75c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 -- 172.21.15.146:0/1968837102 shutdown_connections 2024-04-24T23:09:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.048+0000 7ff761a00640 1 -- 172.21.15.146:0/1968837102 wait complete. 2024-04-24T23:09:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.050+0000 7ff761a00640 1 Processor -- start 2024-04-24T23:09:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.050+0000 7ff761a00640 1 -- start start 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c0d03a0 0x7ff75c145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14b850 0x7ff75c146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c166070 con 0x7ff75c14be80 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c165ef0 con 0x7ff75c0d03a0 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff761a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff75c071690 con 0x7ff75c14b850 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff75b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff75b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35258/0 (socket says 172.21.15.146:35258) 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff75b400640 1 -- 172.21.15.146:0/537283827 learned_addr learned my addr 172.21.15.146:0/537283827 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff75aa00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c0d03a0 0x7ff75c145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.051+0000 7ff75a000640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14b850 0x7ff75c146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 -- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14b850 msgr2=0x7ff75c146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14b850 0x7ff75c146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 -- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c0d03a0 msgr2=0x7ff75c145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c0d03a0 0x7ff75c145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 -- 172.21.15.146:0/537283827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c1ee020 con 0x7ff75c14be80 2024-04-24T23:09:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff75b400640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff7540098c0 tx=0x7ff7540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754041020 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75403c670 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754037040 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c15e0f0 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.052+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c15e6b0 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.053+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75c1597f0 con 0x7ff75c14be80 2024-04-24T23:09:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.054+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff754044020 con 0x7ff75c14be80 2024-04-24T23:09:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.056+0000 7ff752a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 0x7ff73806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.056+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5249+0+0 (secure 0 0 0) 0x7ff7540ab3d0 con 0x7ff75c14be80 2024-04-24T23:09:52.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.057+0000 7ff75aa00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 0x7ff73806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.058+0000 7ff75aa00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 0x7ff73806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff74c005880 tx=0x7ff74c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.061+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff75404b030 con 0x7ff75c14be80 2024-04-24T23:09:52.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.309+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff75c068190 con 0x7ff75c14be80 2024-04-24T23:09:52.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.310+0000 7ff752a00640 1 -- 172.21.15.146:0/537283827 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7ff75c1ee020 con 0x7ff75c14be80 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtemoAhAAY9EZwHw+OARNqIvpM8EjhQ==", 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmXAtqGxAAQJbCl6iDNzDxnaBvXqxjHQ==", 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.314 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmhJRKDhAAKoFXKIKoow9zrZmu1Kuiwg==", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmfos5KhAAbtRAbCzX+w43WUEoaIOBCg==", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:52.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCqjilmCuuBIRAAk4b/yrOpyYmKTSDlUpFmbA==", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-04-24T23:09:52.316 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCtjilmzPXYLBAAX9tZexJdbeElWvSLXuf4LQ==", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCwjilm/naTOBAAyuDQP3INhouluN7xsrEBAA==", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.317 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC0jilmH+LyCBAAe5EkupNVwdrLrpIch0p2xg==", 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-04-24T23:09:52.318 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC6jilmkiiuKBAAz9xA3cYOojPSlLJOZ3rzRQ==", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQC9jilmYYxzNhAAmlMcxbiN33/iDawSUZfn9Q==", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.319 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDBjilmIr+TFRAA2RvaRLhLha7tNvdVEZFFBQ==", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDEjilmuJUlLhAAMbOuhvjbfX101up0hUeAqA==", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-04-24T23:09:52.320 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw==", 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.321 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm+jgiDRAAiMzdYyDLbyvZJsGZ3ZLq/g==", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm7m5MBBAA+5taQZJKe4oO1c/T2mUhdw==", 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCnjilm5MuAFhAArfoMIzMzQs4PJKjlMhFlpg==", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-04-24T23:09:52.323 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmFG6LAxAA7YUamq4/Vvt8ibyWUFiI+w==", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-04-24T23:09:52.324 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmHpb5NRAApZntayICgFGxTTRk3l4TqA==", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQCljilmdYwQLBAAMU9anti7PWWJZZOyVSWwKg==", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.325 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:09:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:09:52.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 msgr2=0x7ff73806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 0x7ff73806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff74c005880 tx=0x7ff74c009040 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 msgr2=0x7ff75c146e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff7540098c0 tx=0x7ff7540046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 shutdown_connections 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff75c14be80 0x7ff75c146e40 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff73806be30 0x7ff73806e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff75c14b850 0x7ff75c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 --2- 172.21.15.146:0/537283827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c0d03a0 0x7ff75c145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 >> 172.21.15.146:0/537283827 conn(0x7ff75c06b320 msgr2=0x7ff75c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 shutdown_connections 2024-04-24T23:09:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.313+0000 7ff761a00640 1 -- 172.21.15.146:0/537283827 wait complete. 2024-04-24T23:09:52.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.519+0000 7f2a51400640 1 Processor -- start 2024-04-24T23:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.519+0000 7f2a51400640 1 -- start start 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.521+0000 7f2a51400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 0x7f2a4c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.521+0000 7f2a51400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a4c0709d0 0x7f2a4c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.521+0000 7f2a51400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4c070f90 con 0x7f2a4c1561c0 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.521+0000 7f2a51400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4c0b4310 con 0x7f2a4c0709d0 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.521+0000 7f2a51400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c1565a0 con 0x7f2a4c0d0240 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a4be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a4c1561c0 0x7f2a4c0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45768/0 (socket says 172.21.15.146:45768) 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a4be00640 1 -- 172.21.15.146:0/3102561304 learned_addr learned my addr 172.21.15.146:0/3102561304 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a50a00640 1 --2- 172.21.15.146:0/3102561304 >> v2:172.21.15.146:3300/0 conn(0x7f2a4c0709d0 0x7f2a4c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a4b400640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 0x7f2a4c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a50a00640 1 -- 172.21.15.146:0/3102561304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 msgr2=0x7f2a4c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a50a00640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 0x7f2a4c0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a50a00640 1 -- 172.21.15.146:0/3102561304 >> v1:172.21.15.146:6789/0 conn(0x7f2a4c1561c0 legacy=0x7f2a4c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a50a00640 1 -- 172.21.15.146:0/3102561304 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c071270 con 0x7f2a4c0709d0 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a4aa00640 1 -- 172.21.15.146:0/3102561304 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142112093 0 0) 0x7f2a4c070f90 con 0x7f2a4c1561c0 2024-04-24T23:09:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.522+0000 7f2a4b400640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 0x7f2a4c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.523+0000 7f2a50a00640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c0709d0 0x7f2a4c15cb80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097a0 tx=0x7f2a4402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e383a0d51f5d3814 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.523+0000 7f2a4aa00640 1 -- 172.21.15.146:0/3102561304 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44037070 con 0x7f2a4c0709d0 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.523+0000 7f2a4aa00640 1 -- 172.21.15.146:0/3102561304 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4402adb0 con 0x7f2a4c0709d0 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.523+0000 7f2a4aa00640 1 -- 172.21.15.146:0/3102561304 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44032660 con 0x7f2a4c0709d0 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 -- 172.21.15.146:0/3102561304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c0709d0 msgr2=0x7f2a4c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c0709d0 0x7f2a4c15cb80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097a0 tx=0x7f2a4402a060 comp rx=0 tx=0).stop 2024-04-24T23:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 -- 172.21.15.146:0/3102561304 shutdown_connections 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c0709d0 0x7f2a4c15cb80 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 --2- 172.21.15.146:0/3102561304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0d0240 0x7f2a4c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 -- 172.21.15.146:0/3102561304 >> 172.21.15.146:0/3102561304 conn(0x7f2a4c06b320 msgr2=0x7f2a4c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 -- 172.21.15.146:0/3102561304 shutdown_connections 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.524+0000 7f2a51400640 1 -- 172.21.15.146:0/3102561304 wait complete. 2024-04-24T23:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.526+0000 7f2a51400640 1 Processor -- start 2024-04-24T23:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.526+0000 7f2a51400640 1 -- start start 2024-04-24T23:09:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0709d0 0x7f2a4c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0d0240 0x7f2a4c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c0b2c20 con 0x7f2a4c1561c0 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c071830 con 0x7f2a4c0d0240 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a51400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c0b2da0 con 0x7f2a4c0709d0 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35270/0 (socket says 172.21.15.146:35270) 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 -- 172.21.15.146:0/2916603759 learned_addr learned my addr 172.21.15.146:0/2916603759 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 -- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0709d0 msgr2=0x7f2a4c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0709d0 0x7f2a4c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 -- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0d0240 msgr2=0x7f2a4c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0d0240 0x7f2a4c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.527+0000 7f2a50a00640 1 -- 172.21.15.146:0/2916603759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c06d260 con 0x7f2a4c1561c0 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a50a00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2a44035040 tx=0x7f2a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44041070 con 0x7f2a4c1561c0 2024-04-24T23:09:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4403c670 con 0x7f2a4c1561c0 2024-04-24T23:09:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44037040 con 0x7f2a4c1561c0 2024-04-24T23:09:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c06d540 con 0x7f2a4c1561c0 2024-04-24T23:09:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.528+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c06db00 con 0x7f2a4c1561c0 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.529+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c157c00 con 0x7f2a4c1561c0 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.530+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a44044070 con 0x7f2a4c1561c0 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.531+0000 7f2a43e00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.531+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5249+0+0 (secure 0 0 0) 0x7f2a440ab500 con 0x7f2a4c1561c0 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.532+0000 7f2a4be00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.533+0000 7f2a4be00640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007fd0 tx=0x7f2a34007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.536+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a4407a060 con 0x7f2a4c1561c0 2024-04-24T23:09:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.734+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a4c04f500 con 0x7f2a4c1561c0 2024-04-24T23:09:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.736+0000 7f2a43e00640 1 -- 172.21.15.146:0/2916603759 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+13189 (secure 0 0 0) 0x7f2a44079960 con 0x7f2a4c1561c0 2024-04-24T23:09:52.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:52.738 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":91,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:51.831884+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 msgr2=0x7f2a2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2a34007fd0 tx=0x7f2a34007960 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 msgr2=0x7f2a4c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2a44035040 tx=0x7f2a440046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 shutdown_connections 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c1561c0 0x7f2a4c06ca30 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0d0240 0x7f2a4c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 --2- 172.21.15.146:0/2916603759 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c0709d0 0x7f2a4c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 >> 172.21.15.146:0/2916603759 conn(0x7f2a4c06b320 msgr2=0x7f2a4c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 shutdown_connections 2024-04-24T23:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.739+0000 7f2a51400640 1 -- 172.21.15.146:0/2916603759 wait complete. 2024-04-24T23:09:52.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:09:52.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:09:52.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.965+0000 7f6fd2a00640 1 Processor -- start 2024-04-24T23:09:52.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.965+0000 7f6fd2a00640 1 -- start start 2024-04-24T23:09:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.967+0000 7f6fd2a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6fcc141c80 0x7f6fcc0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.967+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 0x7f6fcc071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.967+0000 7f6fd2a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fcc0ced40 con 0x7f6fcc13ef30 2024-04-24T23:09:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.967+0000 7f6fd2a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6fcc1423d0 con 0x7f6fcc141c80 2024-04-24T23:09:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.967+0000 7f6fd2a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc070f80 con 0x7f6fcc0ce5a0 2024-04-24T23:09:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.968+0000 7f6fd0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 0x7f6fcc071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.968+0000 7f6fcb400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6fcc141c80 0x7f6fcc0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.968+0000 7f6fd0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 0x7f6fcc071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:34024/0 (socket says 172.21.15.146:34024) 2024-04-24T23:09:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.968+0000 7f6fd0a00640 1 -- 172.21.15.146:0/449112041 learned_addr learned my addr 172.21.15.146:0/449112041 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:52.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.969+0000 7f6fcb400640 1 -- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 msgr2=0x7f6fcc071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:52.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.969+0000 7f6fcb400640 1 --2- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 0x7f6fcc071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.969+0000 7f6fcb400640 1 -- 172.21.15.146:0/449112041 >> v1:172.21.15.203:6789/0 conn(0x7f6fcc13ef30 legacy=0x7f6fcc141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.969+0000 7f6fcb400640 1 -- 172.21.15.146:0/449112041 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc0cf020 con 0x7f6fcc141c80 2024-04-24T23:09:52.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.970+0000 7f6fcb400640 1 --2- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc141c80 0x7f6fcc0ce060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76dfd1eae51fb11c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fcaa00640 1 -- 172.21.15.146:0/449112041 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc037070 con 0x7f6fcc141c80 2024-04-24T23:09:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fcaa00640 1 -- 172.21.15.146:0/449112041 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc032440 con 0x7f6fcc141c80 2024-04-24T23:09:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fcaa00640 1 -- 172.21.15.146:0/449112041 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc032810 con 0x7f6fcc141c80 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 -- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc141c80 msgr2=0x7f6fcc0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc141c80 0x7f6fcc0ce060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a180 comp rx=0 tx=0).stop 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 -- 172.21.15.146:0/449112041 shutdown_connections 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc0ce5a0 0x7f6fcc071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/449112041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc141c80 0x7f6fcc0ce060 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.971+0000 7f6fd2a00640 1 -- 172.21.15.146:0/449112041 >> 172.21.15.146:0/449112041 conn(0x7f6fcc0b17b0 msgr2=0x7f6fcc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.972+0000 7f6fd2a00640 1 -- 172.21.15.146:0/449112041 shutdown_connections 2024-04-24T23:09:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.972+0000 7f6fd2a00640 1 -- 172.21.15.146:0/449112041 wait complete. 2024-04-24T23:09:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.973+0000 7f6fd2a00640 1 Processor -- start 2024-04-24T23:09:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.973+0000 7f6fd2a00640 1 -- start start 2024-04-24T23:09:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 0x7f6fcc155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc141c80 0x7f6fcc151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc0cea50 con 0x7f6fcc13ef30 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc070c10 con 0x7f6fcc0ce5a0 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.974+0000 7f6fd2a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc071950 con 0x7f6fcc141c80 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35284/0 (socket says 172.21.15.146:35284) 2024-04-24T23:09:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 -- 172.21.15.146:0/4000760895 learned_addr learned my addr 172.21.15.146:0/4000760895 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fd0a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc141c80 0x7f6fcc151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcbe00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 0x7f6fcc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 -- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc141c80 msgr2=0x7f6fcc151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc141c80 0x7f6fcc151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 -- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 msgr2=0x7f6fcc155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 0x7f6fcc155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcb400640 1 -- 172.21.15.146:0/4000760895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc153920 con 0x7f6fcc13ef30 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.975+0000 7f6fcbe00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 0x7f6fcc155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fcb400640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc037040 con 0x7f6fcc13ef30 2024-04-24T23:09:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc042070 con 0x7f6fcc13ef30 2024-04-24T23:09:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fcc13bb50 con 0x7f6fcc13ef30 2024-04-24T23:09:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc030920 con 0x7f6fcc13ef30 2024-04-24T23:09:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.976+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fcc13b870 con 0x7f6fcc13ef30 2024-04-24T23:09:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.977+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fcc04f5a0 con 0x7f6fcc13ef30 2024-04-24T23:09:52.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.978+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fbc030ac0 con 0x7f6fcc13ef30 2024-04-24T23:09:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.979+0000 7f6fc3e00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.979+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5249+0+0 (secure 0 0 0) 0x7f6fbc0ab720 con 0x7f6fcc13ef30 2024-04-24T23:09:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.980+0000 7f6fcbe00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.981+0000 7f6fcbe00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4001d70 tx=0x7f6fc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:52.984+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6fbc079ba0 con 0x7f6fcc13ef30 2024-04-24T23:09:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.178+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6fcc0af720 con 0x7f6fcc13ef30 2024-04-24T23:09:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.179+0000 7f6fc3e00640 1 -- 172.21.15.146:0/4000760895 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f6fbc07dea0 con 0x7f6fcc13ef30 2024-04-24T23:09:53.181 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.181+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 msgr2=0x7f6fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.181+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4001d70 tx=0x7f6fc4009040 comp rx=0 tx=0).stop 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.181+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 msgr2=0x7f6fcc155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 shutdown_connections 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6fcc141c80 0x7f6fcc151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc13ef30 0x7f6fcc155b40 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 --2- 172.21.15.146:0/4000760895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fcc0ce5a0 0x7f6fcc155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 >> 172.21.15.146:0/4000760895 conn(0x7f6fcc0b17b0 msgr2=0x7f6fcc0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 shutdown_connections 2024-04-24T23:09:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.182+0000 7f6fd2a00640 1 -- 172.21.15.146:0/4000760895 wait complete. 2024-04-24T23:09:53.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:09:53.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.389+0000 7fddbf200640 1 Processor -- start 2024-04-24T23:09:53.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.389+0000 7fddbf200640 1 -- start start 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.390+0000 7fddbf200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fddc015a410 0x7fddc00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbf200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fddc015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbf200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc006e120 con 0x7fddc015e330 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbf200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fddc006e400 con 0x7fddc015a410 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbf200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fddc006e6e0 con 0x7fddc006dc50 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbe800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fddc015e330 0x7fddc00709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45784/0 (socket says 172.21.15.146:45784) 2024-04-24T23:09:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbe800640 1 -- 172.21.15.146:0/699351597 learned_addr learned my addr 172.21.15.146:0/699351597 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbde00640 1 --2- 172.21.15.146:0/699351597 >> v2:172.21.15.203:3300/0 conn(0x7fddc015a410 0x7fddc00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddb5400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fddc015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152126697 0 0) 0x7fddc006e120 con 0x7fddc015e330 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.391+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda4003520 con 0x7fddc015e330 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 645668917 0 0) 0x7fdda4003520 con 0x7fddc015e330 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 msgr2=0x7fddc015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fddc015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 >> v2:172.21.15.203:3300/0 conn(0x7fddc015a410 msgr2=0x7fddc00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:53.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 --2- 172.21.15.146:0/699351597 >> v2:172.21.15.203:3300/0 conn(0x7fddc015a410 0x7fddc00aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc00af130 con 0x7fddc015e330 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fddb8001670 con 0x7fddc015e330 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 >> v1:172.21.15.146:6789/0 conn(0x7fddc015e330 legacy=0x7fddc00709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fdda40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdda4003f30 0x7fdda4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fdda40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006e400 con 0x7fdda4004d40 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006e6e0 con 0x7fdda4003f30 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdda400b9c0 con 0x7fddc006dc50 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.392+0000 7fddbe800640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fdda40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddb5400640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdda4003f30 0x7fdda4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbde00640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fdda40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbe800640 1 -- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 msgr2=0x7fdda40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbe800640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc006dc50 0x7fdda40039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbe800640 1 -- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdda4003f30 msgr2=0x7fdda4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbe800640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdda4003f30 0x7fdda4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.393+0000 7fddbe800640 1 -- 172.21.15.146:0/699351597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4003520 con 0x7fdda4004d40 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbe800640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fdda40051c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fddb8001050 tx=0x7fdda4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fdccd0f12f9261 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8007d70 con 0x7fdda4004d40 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb8005af0 con 0x7fdda4004d40 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbd400640 1 -- 172.21.15.146:0/699351597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8007070 con 0x7fdda4004d40 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbf200640 1 -- 172.21.15.146:0/699351597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 msgr2=0x7fdda40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.394+0000 7fddbf200640 1 --2- 172.21.15.146:0/699351597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fdda40051c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fddb8001050 tx=0x7fdda4005830 comp rx=0 tx=0).stop 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.395+0000 7fddbe800640 1 -- 172.21.15.146:0/699351597 reap_dead start 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.395+0000 7fddbf200640 1 -- 172.21.15.146:0/699351597 shutdown_connections 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.395+0000 7fddbf200640 1 -- 172.21.15.146:0/699351597 >> 172.21.15.146:0/699351597 conn(0x7fddc006b320 msgr2=0x7fddc006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.395+0000 7fddbf200640 1 -- 172.21.15.146:0/699351597 shutdown_connections 2024-04-24T23:09:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.395+0000 7fddbf200640 1 -- 172.21.15.146:0/699351597 wait complete. 2024-04-24T23:09:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.396+0000 7fddbf200640 1 Processor -- start 2024-04-24T23:09:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.397+0000 7fddbf200640 1 -- start start 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.397+0000 7fddbf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.397+0000 7fddbf200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddc0159420 0x7fddc00aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbf200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc00acfa0 0x7fddc00aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbf200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddc00af320 con 0x7fdda4004d40 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbf200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fddc00b4140 con 0x7fddc0159420 2024-04-24T23:09:53.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbf200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fddc015ddf0 con 0x7fddc00acfa0 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35308/0 (socket says 172.21.15.146:35308) 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 -- 172.21.15.146:0/478336550 learned_addr learned my addr 172.21.15.146:0/478336550 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 -- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc00acfa0 msgr2=0x7fddc00aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc00acfa0 0x7fddc00aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 -- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddc0159420 msgr2=0x7fddc00aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddb5400640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddc0159420 0x7fddc00aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddc0159420 0x7fddc00aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.398+0000 7fddbde00640 1 -- 172.21.15.146:0/478336550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc00a94b0 con 0x7fdda4004d40 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddbde00640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fddb000f400 tx=0x7fddb000f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0016620 con 0x7fdda4004d40 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb001b070 con 0x7fdda4004d40 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc01f21a0 con 0x7fdda4004d40 2024-04-24T23:09:53.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0016a20 con 0x7fdda4004d40 2024-04-24T23:09:53.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.399+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc01f2760 con 0x7fdda4004d40 2024-04-24T23:09:53.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.400+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc004f500 con 0x7fdda4004d40 2024-04-24T23:09:53.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.401+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddb0005d10 con 0x7fdda4004d40 2024-04-24T23:09:53.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.402+0000 7fddb6a00640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 0x7fdd9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.402+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5249+0+0 (secure 0 0 0) 0x7fddb008b800 con 0x7fdda4004d40 2024-04-24T23:09:53.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.403+0000 7fddb5400640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 0x7fdd9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.404+0000 7fddb5400640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 0x7fdd9c06e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fddc00cf5a0 tx=0x7fdda8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.407+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fddb005a370 con 0x7fdda4004d40 2024-04-24T23:09:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.605+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fddc006cb00 con 0x7fdda4004d40 2024-04-24T23:09:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.605+0000 7fddb6a00640 1 -- 172.21.15.146:0/478336550 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) ==== 84+0+65 (secure 0 0 0) 0x7fddb0060020 con 0x7fdda4004d40 2024-04-24T23:09:53.607 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:53.607 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-04-24T23:09:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:09:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-04-24T23:09:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-04-24T23:09:53.608 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:09:53.608 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 msgr2=0x7fdd9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 0x7fdd9c06e320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fddc00cf5a0 tx=0x7fdda8008040 comp rx=0 tx=0).stop 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 msgr2=0x7fddc01f18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fddb000f400 tx=0x7fddb000f8c0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 shutdown_connections 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdd9c06be60 0x7fdd9c06e320 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddc00acfa0 0x7fddc00aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddc0159420 0x7fddc00aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 --2- 172.21.15.146:0/478336550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdda4004d40 0x7fddc01f18e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 >> 172.21.15.146:0/478336550 conn(0x7fddc006b320 msgr2=0x7fddc00af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 shutdown_connections 2024-04-24T23:09:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.608+0000 7fddbf200640 1 -- 172.21.15.146:0/478336550 wait complete. 2024-04-24T23:09:53.630 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:09:53.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:09:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.821+0000 7f441ee00640 1 Processor -- start 2024-04-24T23:09:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.822+0000 7f441ee00640 1 -- start start 2024-04-24T23:09:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441ee00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441815e2c0 0x7f44180d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441ee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418161cd0 0x7f4418162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441ee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44180d2b80 con 0x7f4418162650 2024-04-24T23:09:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441ee00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f44180b3010 con 0x7f441815e2c0 2024-04-24T23:09:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441ee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f441815fad0 con 0x7f4418161cd0 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441815e2c0 0x7f44180d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f441815e2c0 0x7f44180d46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35320/0 (socket says 172.21.15.146:35320) 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.823+0000 7f441da00640 1 -- 172.21.15.146:0/1558367371 learned_addr learned my addr 172.21.15.146:0/1558367371 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.824+0000 7f441d000640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418161cd0 0x7f4418162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.824+0000 7f441da00640 1 -- 172.21.15.146:0/1558367371 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418161cd0 msgr2=0x7f4418162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.824+0000 7f441da00640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418161cd0 0x7f4418162110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.824+0000 7f441da00640 1 -- 172.21.15.146:0/1558367371 >> v1:172.21.15.146:6789/0 conn(0x7f4418162650 legacy=0x7f441815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.824+0000 7f441da00640 1 -- 172.21.15.146:0/1558367371 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44180d2e60 con 0x7f441815e2c0 2024-04-24T23:09:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.825+0000 7f441da00640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441815e2c0 0x7f44180d46a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f4408009870 tx=0x7f440802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40868f3a82319f32 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.826+0000 7f4417e00640 1 -- 172.21.15.146:0/1558367371 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408037070 con 0x7f441815e2c0 2024-04-24T23:09:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.826+0000 7f4417e00640 1 -- 172.21.15.146:0/1558367371 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4408032440 con 0x7f441815e2c0 2024-04-24T23:09:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.826+0000 7f4417e00640 1 -- 172.21.15.146:0/1558367371 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408032810 con 0x7f441815e2c0 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 -- 172.21.15.146:0/1558367371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441815e2c0 msgr2=0x7f44180d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441815e2c0 0x7f44180d46a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f4408009870 tx=0x7f440802a130 comp rx=0 tx=0).stop 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 -- 172.21.15.146:0/1558367371 shutdown_connections 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418161cd0 0x7f4418162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 --2- 172.21.15.146:0/1558367371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441815e2c0 0x7f44180d46a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 -- 172.21.15.146:0/1558367371 >> 172.21.15.146:0/1558367371 conn(0x7f441809cff0 msgr2=0x7f44180d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 -- 172.21.15.146:0/1558367371 shutdown_connections 2024-04-24T23:09:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.827+0000 7f441ee00640 1 -- 172.21.15.146:0/1558367371 wait complete. 2024-04-24T23:09:53.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.829+0000 7f441ee00640 1 Processor -- start 2024-04-24T23:09:53.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.829+0000 7f441ee00640 1 -- start start 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f441815e2c0 0x7f44181e7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418162650 0x7f441814be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4418161530 con 0x7f4418161cd0 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4418162ae0 con 0x7f441815e2c0 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441ee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44181616b0 con 0x7f4418162650 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35322/0 (socket says 172.21.15.146:35322) 2024-04-24T23:09:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.830+0000 7f441d000640 1 -- 172.21.15.146:0/2471803796 learned_addr learned my addr 172.21.15.146:0/2471803796 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 -- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418162650 msgr2=0x7f441814be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441da00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f441815e2c0 0x7f44181e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441e400640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418162650 0x7f441814be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418162650 0x7f441814be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 -- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f441815e2c0 msgr2=0x7f44181e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f441815e2c0 0x7f44181e7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 -- 172.21.15.146:0/2471803796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44180b5fd0 con 0x7f4418161cd0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.831+0000 7f441d000640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f440400c7f0 tx=0x7f440400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.832+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404015070 con 0x7f4418161cd0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.832+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4404004220 con 0x7f4418161cd0 2024-04-24T23:09:53.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.832+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404007620 con 0x7f4418161cd0 2024-04-24T23:09:53.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.832+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44180b4f30 con 0x7f4418161cd0 2024-04-24T23:09:53.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.832+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44180b54f0 con 0x7f4418161cd0 2024-04-24T23:09:53.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.833+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441804f500 con 0x7f4418161cd0 2024-04-24T23:09:53.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.834+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44040079d0 con 0x7f4418161cd0 2024-04-24T23:09:53.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.835+0000 7f4415600640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 0x7f43f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:53.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.835+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5249+0+0 (secure 0 0 0) 0x7f440408afd0 con 0x7f4418161cd0 2024-04-24T23:09:53.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.836+0000 7f441da00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 0x7f43f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:53.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.837+0000 7f441da00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 0x7f43f806e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4408034000 tx=0x7f440802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:53.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:53.841+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4404059b30 con 0x7f4418161cd0 2024-04-24T23:09:54.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.040+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f44180d16e0 con 0x7f4418161cd0 2024-04-24T23:09:54.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.850+0000 7f4415600640 1 -- 172.21.15.146:0/2471803796 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) ==== 138+0+0 (secure 0 0 0) 0x7f4404059430 con 0x7f4418161cd0 2024-04-24T23:09:54.853 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 msgr2=0x7f43f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 0x7f43f806e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4408034000 tx=0x7f440802e000 comp rx=0 tx=0).stop 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 msgr2=0x7f44181e88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f440400c7f0 tx=0x7f440400ccb0 comp rx=0 tx=0).stop 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 shutdown_connections 2024-04-24T23:09:54.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f43f806be30 0x7f43f806e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4418162650 0x7f441814be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4418161cd0 0x7f44181e88b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 --2- 172.21.15.146:0/2471803796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f441815e2c0 0x7f44181e7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.854+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 >> 172.21.15.146:0/2471803796 conn(0x7f441809cff0 msgr2=0x7f44180d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.855+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 shutdown_connections 2024-04-24T23:09:54.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:54.855+0000 7f441ee00640 1 -- 172.21.15.146:0/2471803796 wait complete. 2024-04-24T23:09:54.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:09:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.070+0000 7f91ae000640 1 Processor -- start 2024-04-24T23:09:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.071+0000 7f91ae000640 1 -- start start 2024-04-24T23:09:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.072+0000 7f91ae000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f91a80b2360 0x7f91a80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.072+0000 7f91ae000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91a80d0a00 0x7f91a80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.072+0000 7f91ae000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a8162c40 con 0x7f91a80b2a90 2024-04-24T23:09:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.072+0000 7f91ae000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f91a806dd00 con 0x7f91a80d0a00 2024-04-24T23:09:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.072+0000 7f91ae000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f91a80b3160 con 0x7f91a80b2360 2024-04-24T23:09:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91a80d0a00 0x7f91a80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91a80d0a00 0x7f91a80cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35338/0 (socket says 172.21.15.146:35338) 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 -- 172.21.15.146:0/3668302336 learned_addr learned my addr 172.21.15.146:0/3668302336 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7400640 1 --2- 172.21.15.146:0/3668302336 >> v2:172.21.15.203:3300/0 conn(0x7f91a80b2360 0x7f91a80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 -- 172.21.15.146:0/3668302336 >> v2:172.21.15.203:3300/0 conn(0x7f91a80b2360 msgr2=0x7f91a80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 --2- 172.21.15.146:0/3668302336 >> v2:172.21.15.203:3300/0 conn(0x7f91a80b2360 0x7f91a80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 -- 172.21.15.146:0/3668302336 >> v1:172.21.15.203:6789/0 conn(0x7f91a80b2a90 legacy=0x7f91a80cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.073+0000 7f91a7e00640 1 -- 172.21.15.146:0/3668302336 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a80b3440 con 0x7f91a80d0a00 2024-04-24T23:09:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.074+0000 7f91a7e00640 1 --2- 172.21.15.146:0/3668302336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a80cccd0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f91a80d1c00 tx=0x7f91a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38658927c289dab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.075+0000 7f91a6000640 1 -- 172.21.15.146:0/3668302336 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0036070 con 0x7f91a80d0a00 2024-04-24T23:09:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.075+0000 7f91a6000640 1 -- 172.21.15.146:0/3668302336 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0031600 con 0x7f91a80d0a00 2024-04-24T23:09:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.075+0000 7f91a6000640 1 -- 172.21.15.146:0/3668302336 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00319d0 con 0x7f91a80d0a00 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.075+0000 7f91ae000640 1 -- 172.21.15.146:0/3668302336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 msgr2=0x7f91a80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.075+0000 7f91ae000640 1 --2- 172.21.15.146:0/3668302336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a80cccd0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f91a80d1c00 tx=0x7f91a002a6a0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 -- 172.21.15.146:0/3668302336 shutdown_connections 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 --2- 172.21.15.146:0/3668302336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a80cccd0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 --2- 172.21.15.146:0/3668302336 >> v2:172.21.15.203:3300/0 conn(0x7f91a80b2360 0x7f91a80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 -- 172.21.15.146:0/3668302336 >> 172.21.15.146:0/3668302336 conn(0x7f91a80b37f0 msgr2=0x7f91a80b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 -- 172.21.15.146:0/3668302336 shutdown_connections 2024-04-24T23:09:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.076+0000 7f91ae000640 1 -- 172.21.15.146:0/3668302336 wait complete. 2024-04-24T23:09:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.077+0000 7f91ae000640 1 Processor -- start 2024-04-24T23:09:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.078+0000 7f91ae000640 1 -- start start 2024-04-24T23:09:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.078+0000 7f91ae000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91a80b2360 0x7f91a81e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91ae000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a80b2a90 0x7f91a80b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91ae000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91ae000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91a80b28c0 con 0x7f91a80d0a00 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91ae000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91a80b2740 con 0x7f91a80b2a90 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91ae000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91a8161f90 con 0x7f91a80b2360 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35352/0 (socket says 172.21.15.146:35352) 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 -- 172.21.15.146:0/505210709 learned_addr learned my addr 172.21.15.146:0/505210709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a6a00640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a80b2a90 0x7f91a80b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7400640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91a80b2360 0x7f91a81e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 -- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91a80b2360 msgr2=0x7f91a81e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91a80b2360 0x7f91a81e7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 -- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a80b2a90 msgr2=0x7f91a80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a80b2a90 0x7f91a80b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.079+0000 7f91a7e00640 1 -- 172.21.15.146:0/505210709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a80b6cf0 con 0x7f91a80d0a00 2024-04-24T23:09:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f91a7e00640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009f40 tx=0x7f91a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0036050 con 0x7f91a80d0a00 2024-04-24T23:09:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0042070 con 0x7f91a80d0a00 2024-04-24T23:09:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a80b6fd0 con 0x7f91a80d0a00 2024-04-24T23:09:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0009510 con 0x7f91a80d0a00 2024-04-24T23:09:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.080+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a80af640 con 0x7f91a80d0a00 2024-04-24T23:09:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.082+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a804f5a0 con 0x7f91a80d0a00 2024-04-24T23:09:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.083+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a0007c70 con 0x7f91a80d0a00 2024-04-24T23:09:55.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.084+0000 7f919f400640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 0x7f918406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:55.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.084+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5619+0+0 (secure 0 0 0) 0x7f91a00abc20 con 0x7f91a80d0a00 2024-04-24T23:09:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.085+0000 7f91a7400640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 0x7f918406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.086+0000 7f91a7400640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 0x7f918406e320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ad0 tx=0x7f9198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.089+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f91a007a610 con 0x7f91a80d0a00 2024-04-24T23:09:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.287+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f91a80b71d0 con 0x7f91a80d0a00 2024-04-24T23:09:55.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.859+0000 7f919f400640 1 -- 172.21.15.146:0/505210709 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) ==== 170+0+0 (secure 0 0 0) 0x7f91a0079f10 con 0x7f91a80d0a00 2024-04-24T23:09:55.861 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-04-24T23:09:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.863+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 msgr2=0x7f918406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.863+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 0x7f918406e320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ad0 tx=0x7f9198008040 comp rx=0 tx=0).stop 2024-04-24T23:09:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.863+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 msgr2=0x7f91a81e9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.863+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009f40 tx=0x7f91a0004a40 comp rx=0 tx=0).stop 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 shutdown_connections 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a80d0a00 0x7f91a81e9b80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91a80b2a90 0x7f91a80b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f918406be60 0x7f918406e320 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 --2- 172.21.15.146:0/505210709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91a80b2360 0x7f91a81e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.864+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 >> 172.21.15.146:0/505210709 conn(0x7f91a80b37f0 msgr2=0x7f91a806ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:55.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.867+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 shutdown_connections 2024-04-24T23:09:55.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:55.868+0000 7f91ae000640 1 -- 172.21.15.146:0/505210709 wait complete. 2024-04-24T23:09:55.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:09:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.079+0000 7f8240600640 1 Processor -- start 2024-04-24T23:09:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.080+0000 7f8240600640 1 -- start start 2024-04-24T23:09:56.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.081+0000 7f8240600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f823815e010 0x7f823806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.081+0000 7f8240600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823815e3f0 con 0x7f8238071520 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.081+0000 7f8240600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823806cd20 con 0x7f823806ed30 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.081+0000 7f8240600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f823815f440 con 0x7f823815e010 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f823815e010 0x7f823806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f823815e010 0x7f823806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35364/0 (socket says 172.21.15.146:35364) 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 -- 172.21.15.146:0/3980541168 learned_addr learned my addr 172.21.15.146:0/3980541168 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823d200640 1 --1- 172.21.15.146:0/3980541168 >> v1:172.21.15.146:6789/0 conn(0x7f8238071520 0x7f823806e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45802/0 (socket says 172.21.15.146:45802) 2024-04-24T23:09:56.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 -- 172.21.15.146:0/3980541168 >> v1:172.21.15.203:6789/0 conn(0x7f823806ed30 legacy=0x7f82380b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:56.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 -- 172.21.15.146:0/3980541168 >> v1:172.21.15.146:6789/0 conn(0x7f8238071520 legacy=0x7f823806e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f823dc00640 1 -- 172.21.15.146:0/3980541168 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8238071fe0 con 0x7f823815e010 2024-04-24T23:09:56.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.082+0000 7f8237e00640 1 -- 172.21.15.146:0/3980541168 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935785771 0 0) 0x7f823815e3f0 con 0x7f8238071520 2024-04-24T23:09:56.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.083+0000 7f823dc00640 1 --2- 172.21.15.146:0/3980541168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f823806dd80 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f822c009870 tx=0x7f822c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb7ab5b5dca0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:56.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8237e00640 1 -- 172.21.15.146:0/3980541168 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c037070 con 0x7f823815e010 2024-04-24T23:09:56.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8237e00640 1 -- 172.21.15.146:0/3980541168 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c032440 con 0x7f823815e010 2024-04-24T23:09:56.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8237e00640 1 -- 172.21.15.146:0/3980541168 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c032810 con 0x7f823815e010 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 -- 172.21.15.146:0/3980541168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 msgr2=0x7f823806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 --2- 172.21.15.146:0/3980541168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f823806dd80 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f822c009870 tx=0x7f822c02a2a0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 -- 172.21.15.146:0/3980541168 shutdown_connections 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 --2- 172.21.15.146:0/3980541168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f823806dd80 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 -- 172.21.15.146:0/3980541168 >> 172.21.15.146:0/3980541168 conn(0x7f82380b17b0 msgr2=0x7f82380b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 -- 172.21.15.146:0/3980541168 shutdown_connections 2024-04-24T23:09:56.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.084+0000 7f8240600640 1 -- 172.21.15.146:0/3980541168 wait complete. 2024-04-24T23:09:56.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.086+0000 7f8240600640 1 Processor -- start 2024-04-24T23:09:56.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.086+0000 7f8240600640 1 -- start start 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f823806ed30 0x7f8238159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 0x7f8238156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f823806d580 con 0x7f823815e010 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f823806d2a0 con 0x7f8238071520 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.087+0000 7f8240600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f823806d860 con 0x7f823806ed30 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35368/0 (socket says 172.21.15.146:35368) 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 -- 172.21.15.146:0/3152498765 learned_addr learned my addr 172.21.15.146:0/3152498765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823d200640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 0x7f8238156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823dc00640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f823806ed30 0x7f8238159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 -- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f823806ed30 msgr2=0x7f8238159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f823806ed30 0x7f8238159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 -- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 msgr2=0x7f8238156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 0x7f8238156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 -- 172.21.15.146:0/3152498765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82381f3920 con 0x7f823815e010 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823d200640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 0x7f8238156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.088+0000 7f823e600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f823000c780 tx=0x7f823000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.089+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230004b60 con 0x7f823815e010 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.089+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230004d00 con 0x7f823815e010 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.089+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000aa90 con 0x7f823815e010 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.089+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82381577d0 con 0x7f823815e010 2024-04-24T23:09:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.089+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8238157d90 con 0x7f823815e010 2024-04-24T23:09:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.090+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823804f5a0 con 0x7f823815e010 2024-04-24T23:09:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.091+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f823000ac30 con 0x7f823815e010 2024-04-24T23:09:56.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.092+0000 7f8235600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:56.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.093+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6001+0+0 (secure 0 0 0) 0x7f823008b2c0 con 0x7f823815e010 2024-04-24T23:09:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.093+0000 7f823dc00640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:56.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.094+0000 7f823dc00640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 0x7f821c06e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f822c034000 tx=0x7f822c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:56.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.098+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8230020070 con 0x7f823815e010 2024-04-24T23:09:56.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.329+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f82380b3170 con 0x7f823815e010 2024-04-24T23:09:56.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.917+0000 7f8235600640 1 -- 172.21.15.146:0/3152498765 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v79) ==== 174+0+0 (secure 0 0 0) 0x7f8230059aa0 con 0x7f823815e010 2024-04-24T23:09:56.920 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 13 and data pool 14 2024-04-24T23:09:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.923+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 msgr2=0x7f821c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.923+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 0x7f821c06e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f822c034000 tx=0x7f822c02e000 comp rx=0 tx=0).stop 2024-04-24T23:09:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.923+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 msgr2=0x7f82380cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.923+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f823000c780 tx=0x7f823000cc40 comp rx=0 tx=0).stop 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 shutdown_connections 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823815e010 0x7f82380cfa40 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8238071520 0x7f8238156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f821c06be30 0x7f821c06e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 --2- 172.21.15.146:0/3152498765 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f823806ed30 0x7f8238159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.925+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 >> 172.21.15.146:0/3152498765 conn(0x7f82380b17b0 msgr2=0x7f823806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.926+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 shutdown_connections 2024-04-24T23:09:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:56.926+0000 7f8240600640 1 -- 172.21.15.146:0/3152498765 wait complete. 2024-04-24T23:09:56.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.130+0000 7f6a43800640 1 Processor -- start 2024-04-24T23:09:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.130+0000 7f6a43800640 1 -- start start 2024-04-24T23:09:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.131+0000 7f6a43800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a3c145640 0x7f6a3c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.131+0000 7f6a43800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a3c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.131+0000 7f6a43800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c0cdf70 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.131+0000 7f6a43800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c15d360 con 0x7f6a3c145640 2024-04-24T23:09:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.131+0000 7f6a43800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c145a20 con 0x7f6a3c0d03a0 2024-04-24T23:09:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a33e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a3c0b2a20 0x7f6a3c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45804/0 (socket says 172.21.15.146:45804) 2024-04-24T23:09:57.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a33e00640 1 -- 172.21.15.146:0/118130562 learned_addr learned my addr 172.21.15.146:0/118130562 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a41800640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a3c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a40e00640 1 --2- 172.21.15.146:0/118130562 >> v2:172.21.15.203:3300/0 conn(0x7f6a3c145640 0x7f6a3c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016743208 0 0) 0x7f6a3c0cdf70 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.132+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a20003520 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234028897 0 0) 0x7f6a20003520 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 msgr2=0x7f6a3c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a3c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 >> v2:172.21.15.203:3300/0 conn(0x7f6a3c145640 msgr2=0x7f6a3c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 --2- 172.21.15.146:0/118130562 >> v2:172.21.15.203:3300/0 conn(0x7f6a3c145640 0x7f6a3c15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c06d140 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f6a24001690 con 0x7f6a3c0b2a20 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 >> v1:172.21.15.146:6789/0 conn(0x7f6a3c0b2a20 legacy=0x7f6a3c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a20003f80 0x7f6a20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20004d40 0x7f6a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c15d360 con 0x7f6a20003f80 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c145a20 con 0x7f6a20004d40 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2000b9c0 con 0x7f6a3c0d03a0 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a33e00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a20003f80 0x7f6a20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a41800640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20004d40 0x7f6a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a40e00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a33e00640 1 -- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 msgr2=0x7f6a200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.133+0000 7f6a33e00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0d03a0 0x7f6a200039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.134+0000 7f6a33e00640 1 -- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20004d40 msgr2=0x7f6a200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.134+0000 7f6a33e00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20004d40 0x7f6a200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.134+0000 7f6a33e00640 1 -- 172.21.15.146:0/118130562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a20003520 con 0x7f6a20003f80 2024-04-24T23:09:57.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.134+0000 7f6a41800640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20004d40 0x7f6a200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a33e00640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a20003f80 0x7f6a20004800 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007fd0 tx=0x7f6a20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05c8702d3d851f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007ca0 con 0x7f6a20003f80 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24005ad0 con 0x7f6a20003f80 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a3be00640 1 -- 172.21.15.146:0/118130562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007070 con 0x7f6a20003f80 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a43800640 1 -- 172.21.15.146:0/118130562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a20003f80 msgr2=0x7f6a20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a43800640 1 --2- 172.21.15.146:0/118130562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a20003f80 0x7f6a20004800 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007fd0 tx=0x7f6a20005830 comp rx=0 tx=0).stop 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a41800640 1 -- 172.21.15.146:0/118130562 reap_dead start 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a43800640 1 -- 172.21.15.146:0/118130562 shutdown_connections 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.135+0000 7f6a43800640 1 -- 172.21.15.146:0/118130562 >> 172.21.15.146:0/118130562 conn(0x7f6a3c06b320 msgr2=0x7f6a3c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.136+0000 7f6a43800640 1 -- 172.21.15.146:0/118130562 shutdown_connections 2024-04-24T23:09:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.136+0000 7f6a43800640 1 -- 172.21.15.146:0/118130562 wait complete. 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.137+0000 7f6a43800640 1 Processor -- start 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.137+0000 7f6a43800640 1 -- start start 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20003f80 0x7f6a3c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0a94b0 0x7f6a3c0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c06d9e0 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c06d700 con 0x7f6a20003f80 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.138+0000 7f6a43800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c06cbc0 con 0x7f6a3c0a94b0 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35390/0 (socket says 172.21.15.146:35390) 2024-04-24T23:09:57.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 -- 172.21.15.146:0/1155821146 learned_addr learned my addr 172.21.15.146:0/1155821146 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a40e00640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20003f80 0x7f6a3c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 -- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0a94b0 msgr2=0x7f6a3c0a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0a94b0 0x7f6a3c0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 -- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20003f80 msgr2=0x7f6a3c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20003f80 0x7f6a3c159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 -- 172.21.15.146:0/1155821146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c130da0 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.139+0000 7f6a41800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0af640 tx=0x7f6a340077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.140+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34007e90 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.140+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a34018500 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.140+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340188d0 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.140+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c12dec0 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.140+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c12e480 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.141+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c068190 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.142+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a34005d10 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.143+0000 7f6a39600640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 0x7f6a1806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.143+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6101+0+0 (secure 0 0 0) 0x7f6a3408f480 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.143+0000 7f6a40e00640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 0x7f6a1806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.145+0000 7f6a40e00640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 0x7f6a1806e490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009990 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.148+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a34028020 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.346+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a3c0cec80 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.348+0000 7f6a39600640 1 -- 172.21.15.146:0/1155821146 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+16970 (secure 0 0 0) 0x7f6a3405dc90 con 0x7f6a3c12ffd0 2024-04-24T23:09:57.350 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:57.351 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":94,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:56.331875+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 msgr2=0x7f6a1806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 0x7f6a1806e490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009990 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2024-04-24T23:09:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 msgr2=0x7f6a3c130450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0af640 tx=0x7f6a340077c0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 shutdown_connections 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a3c12ffd0 0x7f6a3c130450 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a1806bfd0 0x7f6a1806e490 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a3c0a94b0 0x7f6a3c0a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 --2- 172.21.15.146:0/1155821146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a20003f80 0x7f6a3c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 >> 172.21.15.146:0/1155821146 conn(0x7f6a3c06b320 msgr2=0x7f6a3c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 shutdown_connections 2024-04-24T23:09:57.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.351+0000 7f6a43800640 1 -- 172.21.15.146:0/1155821146 wait complete. 2024-04-24T23:09:57.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:09:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.546+0000 7face3200640 1 Processor -- start 2024-04-24T23:09:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.546+0000 7face3200640 1 -- start start 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7face41561c0 0x7face40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7face40d0240 0x7face415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face4070f90 con 0x7face40709d0 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7face40b4310 con 0x7face40d0240 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7face41565a0 con 0x7face41561c0 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7face40d0240 0x7face415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face2800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7face40d0240 0x7face415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35402/0 (socket says 172.21.15.146:35402) 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face2800640 1 -- 172.21.15.146:0/845882501 learned_addr learned my addr 172.21.15.146:0/845882501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.548+0000 7face1e00640 1 --2- 172.21.15.146:0/845882501 >> v2:172.21.15.203:3300/0 conn(0x7face41561c0 0x7face40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.549+0000 7face2800640 1 -- 172.21.15.146:0/845882501 >> v2:172.21.15.203:3300/0 conn(0x7face41561c0 msgr2=0x7face40cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.549+0000 7face2800640 1 --2- 172.21.15.146:0/845882501 >> v2:172.21.15.203:3300/0 conn(0x7face41561c0 0x7face40cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.549+0000 7face2800640 1 -- 172.21.15.146:0/845882501 >> v1:172.21.15.203:6789/0 conn(0x7face40709d0 legacy=0x7face40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.549+0000 7face2800640 1 -- 172.21.15.146:0/845882501 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face4071270 con 0x7face40d0240 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.550+0000 7face2800640 1 --2- 172.21.15.146:0/845882501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face415cb80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7face40706c0 tx=0x7facdc02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49f0317748fa7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.550+0000 7face0a00640 1 -- 172.21.15.146:0/845882501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc036070 con 0x7face40d0240 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.550+0000 7face0a00640 1 -- 172.21.15.146:0/845882501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facdc031600 con 0x7face40d0240 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.550+0000 7face0a00640 1 -- 172.21.15.146:0/845882501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc0319d0 con 0x7face40d0240 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 -- 172.21.15.146:0/845882501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 msgr2=0x7face415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 --2- 172.21.15.146:0/845882501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face415cb80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7face40706c0 tx=0x7facdc02a5d0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 -- 172.21.15.146:0/845882501 shutdown_connections 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 --2- 172.21.15.146:0/845882501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face415cb80 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 --2- 172.21.15.146:0/845882501 >> v2:172.21.15.203:3300/0 conn(0x7face41561c0 0x7face40cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 -- 172.21.15.146:0/845882501 >> 172.21.15.146:0/845882501 conn(0x7face406b320 msgr2=0x7face406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 -- 172.21.15.146:0/845882501 shutdown_connections 2024-04-24T23:09:57.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.551+0000 7face3200640 1 -- 172.21.15.146:0/845882501 wait complete. 2024-04-24T23:09:57.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.552+0000 7face3200640 1 Processor -- start 2024-04-24T23:09:57.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.552+0000 7face3200640 1 -- start start 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7face40709d0 0x7face4146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7face41561c0 0x7face415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7face40b2c20 con 0x7face40d0240 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7face4071830 con 0x7face40709d0 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.553+0000 7face3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7face40b2da0 con 0x7face41561c0 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35408/0 (socket says 172.21.15.146:35408) 2024-04-24T23:09:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 -- 172.21.15.146:0/2424017290 learned_addr learned my addr 172.21.15.146:0/2424017290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 -- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7face41561c0 msgr2=0x7face415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7face41561c0 0x7face415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 -- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7face40709d0 msgr2=0x7face4146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7face40709d0 0x7face4146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 -- 172.21.15.146:0/2424017290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face41468c0 con 0x7face40d0240 2024-04-24T23:09:57.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7face1400640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7facd000c430 tx=0x7facd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.554+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0011790 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.555+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd0017070 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.555+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0011bb0 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.555+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face4156860 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.555+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41570c0 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.556+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face404f500 con 0x7face40d0240 2024-04-24T23:09:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.557+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facd001c460 con 0x7face40d0240 2024-04-24T23:09:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.558+0000 7facda000640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 0x7facc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.558+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6101+0+0 (secure 0 0 0) 0x7facd008ade0 con 0x7face40d0240 2024-04-24T23:09:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.558+0000 7face1e00640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 0x7facc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:57.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.559+0000 7face1e00640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 0x7facc406e320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7facd4006fd0 tx=0x7facd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.562+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7face41468c0 con 0x7face40d0240 2024-04-24T23:09:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.763+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7face40684e0 con 0x7face40d0240 2024-04-24T23:09:57.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.766+0000 7facda000640 1 -- 172.21.15.146:0/2424017290 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+16970 (secure 0 0 0) 0x7facd0059690 con 0x7face40d0240 2024-04-24T23:09:57.768 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:09:57.769 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":94,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:56.331875+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:09:57.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.768+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 msgr2=0x7facc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.768+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 0x7facc406e320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7facd4006fd0 tx=0x7facd4008040 comp rx=0 tx=0).stop 2024-04-24T23:09:57.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.768+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 msgr2=0x7face406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:57.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.768+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7facd000c430 tx=0x7facd000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 shutdown_connections 2024-04-24T23:09:57.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7facc406be60 0x7facc406e320 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7face41561c0 0x7face415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face40d0240 0x7face406e2f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 --2- 172.21.15.146:0/2424017290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7face40709d0 0x7face4146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 >> 172.21.15.146:0/2424017290 conn(0x7face406b320 msgr2=0x7face40b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 shutdown_connections 2024-04-24T23:09:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.769+0000 7face3200640 1 -- 172.21.15.146:0/2424017290 wait complete. 2024-04-24T23:09:57.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:09:57.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.997+0000 7fdcd9200640 1 Processor -- start 2024-04-24T23:09:57.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.997+0000 7fdcd9200640 1 -- start start 2024-04-24T23:09:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.998+0000 7fdcd9200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdcd4155120 0x7fdcd40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.998+0000 7fdcd9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd40d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.998+0000 7fdcd9200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd4071ab0 con 0x7fdcd406d860 2024-04-24T23:09:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.998+0000 7fdcd9200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd40d0660 con 0x7fdcd4155120 2024-04-24T23:09:58.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.998+0000 7fdcd9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd4155500 con 0x7fdcd40cfcc0 2024-04-24T23:09:58.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.999+0000 7fdcd3400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdcd4155120 0x7fdcd40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:58.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.999+0000 7fdcd3400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdcd4155120 0x7fdcd40b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:34852/0 (socket says 172.21.15.146:34852) 2024-04-24T23:09:58.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.999+0000 7fdcd3400640 1 -- 172.21.15.146:0/2694770871 learned_addr learned my addr 172.21.15.146:0/2694770871 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:58.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:57.999+0000 7fdccaa00640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd40d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:58.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.000+0000 7fdcd3400640 1 -- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 msgr2=0x7fdcd40d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:58.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.000+0000 7fdcd3400640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd40d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.000+0000 7fdcd3400640 1 -- 172.21.15.146:0/2694770871 >> v1:172.21.15.203:6789/0 conn(0x7fdcd406d860 legacy=0x7fdcd406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:58.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.000+0000 7fdcd3400640 1 -- 172.21.15.146:0/2694770871 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4071d90 con 0x7fdcd4155120 2024-04-24T23:09:58.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.001+0000 7fdcd3400640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd40b3d40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e9673ffd4d9e907 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:58.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.001+0000 7fdcd2a00640 1 -- 172.21.15.146:0/2694770871 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4037070 con 0x7fdcd4155120 2024-04-24T23:09:58.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.001+0000 7fdcd2a00640 1 -- 172.21.15.146:0/2694770871 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4032440 con 0x7fdcd4155120 2024-04-24T23:09:58.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.001+0000 7fdcd2a00640 1 -- 172.21.15.146:0/2694770871 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4032810 con 0x7fdcd4155120 2024-04-24T23:09:58.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 -- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 msgr2=0x7fdcd40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:58.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd40b3d40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc402a210 comp rx=0 tx=0).stop 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 -- 172.21.15.146:0/2694770871 shutdown_connections 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd40d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 --2- 172.21.15.146:0/2694770871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd40b3d40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.002+0000 7fdcd9200640 1 -- 172.21.15.146:0/2694770871 >> 172.21.15.146:0/2694770871 conn(0x7fdcd406b560 msgr2=0x7fdcd406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.003+0000 7fdcd9200640 1 -- 172.21.15.146:0/2694770871 shutdown_connections 2024-04-24T23:09:58.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.003+0000 7fdcd9200640 1 -- 172.21.15.146:0/2694770871 wait complete. 2024-04-24T23:09:58.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.004+0000 7fdcd9200640 1 Processor -- start 2024-04-24T23:09:58.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.004+0000 7fdcd9200640 1 -- start start 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd4159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4072350 con 0x7fdcd406d860 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd415d1b0 con 0x7fdcd4155120 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd4072630 con 0x7fdcd40cfcc0 2024-04-24T23:09:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.005+0000 7fdcd3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37444/0 (socket says 172.21.15.146:37444) 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 -- 172.21.15.146:0/1433857868 learned_addr learned my addr 172.21.15.146:0/1433857868 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 -- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 msgr2=0x7fdcd4159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd4159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3e00640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 -- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 msgr2=0x7fdcd413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd413fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 -- 172.21.15.146:0/1433857868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4159e10 con 0x7fdcd406d860 2024-04-24T23:09:58.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.006+0000 7fdcd3400640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000c00 tx=0x7fdcc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.007+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4037040 con 0x7fdcd406d860 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.007+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4042070 con 0x7fdcd406d860 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.007+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd415a0f0 con 0x7fdcd406d860 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.007+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4030860 con 0x7fdcd406d860 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.007+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd415a990 con 0x7fdcd406d860 2024-04-24T23:09:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.008+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd415a4e0 con 0x7fdcd406d860 2024-04-24T23:09:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.009+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcc4030a00 con 0x7fdcd406d860 2024-04-24T23:09:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.009+0000 7fdccbe00640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 0x7fdcb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.010+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fdcc40ab8f0 con 0x7fdcd406d860 2024-04-24T23:09:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.010+0000 7fdccaa00640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 0x7fdcb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.011+0000 7fdccaa00640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 0x7fdcb006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc006a90 tx=0x7fdcbc006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:58.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.014+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdcc4045360 con 0x7fdcd406d860 2024-04-24T23:09:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.255+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdcd415a2c0 con 0x7fdcd406d860 2024-04-24T23:09:58.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.929+0000 7fdccbe00640 1 -- 172.21.15.146:0/1433857868 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7fdcc407a100 con 0x7fdcd406d860 2024-04-24T23:09:58.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 msgr2=0x7fdcb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:58.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 0x7fdcb006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc006a90 tx=0x7fdcbc006a20 comp rx=0 tx=0).stop 2024-04-24T23:09:58.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 msgr2=0x7fdcd4153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:58.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000c00 tx=0x7fdcc40046c0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 shutdown_connections 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcd4155120 0x7fdcd413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fdcb006be30 0x7fdcb006e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcd40cfcc0 0x7fdcd4159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 --2- 172.21.15.146:0/1433857868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcd406d860 0x7fdcd4153970 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 >> 172.21.15.146:0/1433857868 conn(0x7fdcd406b560 msgr2=0x7fdcd406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 shutdown_connections 2024-04-24T23:09:58.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:58.934+0000 7fdcd9200640 1 -- 172.21.15.146:0/1433857868 wait complete. 2024-04-24T23:09:58.958 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-24T23:09:58.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:09:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.161+0000 7fcc8de00640 1 Processor -- start 2024-04-24T23:09:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.161+0000 7fcc8de00640 1 -- start start 2024-04-24T23:09:59.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc880d03d0 0x7fcc8815e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8de00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc88162580 0x7fcc8815e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8de00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc8815f070 con 0x7fcc88158300 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8de00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcc880b2ae0 con 0x7fcc880d03d0 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8de00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc88161aa0 con 0x7fcc88162580 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc87e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc880d03d0 0x7fcc8815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc87e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc880d03d0 0x7fcc8815e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37448/0 (socket says 172.21.15.146:37448) 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc87e00640 1 -- 172.21.15.146:0/3240818404 learned_addr learned my addr 172.21.15.146:0/3240818404 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.163+0000 7fcc8ca00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcc88158300 0x7fcc880cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41982/0 (socket says 172.21.15.146:41982) 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.164+0000 7fcc87e00640 1 -- 172.21.15.146:0/3240818404 >> v2:172.21.15.203:3300/0 conn(0x7fcc88162580 msgr2=0x7fcc8815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.164+0000 7fcc87e00640 1 --2- 172.21.15.146:0/3240818404 >> v2:172.21.15.203:3300/0 conn(0x7fcc88162580 0x7fcc8815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.164+0000 7fcc87e00640 1 -- 172.21.15.146:0/3240818404 >> v1:172.21.15.146:6789/0 conn(0x7fcc88158300 legacy=0x7fcc880cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.164+0000 7fcc87e00640 1 -- 172.21.15.146:0/3240818404 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc88161d80 con 0x7fcc880d03d0 2024-04-24T23:09:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.165+0000 7fcc87e00640 1 --2- 172.21.15.146:0/3240818404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc880d03d0 0x7fcc8815e310 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcc880725d0 tx=0x7fcc7402a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479d5b3f392eed44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.165+0000 7fcc87400640 1 -- 172.21.15.146:0/3240818404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037070 con 0x7fcc880d03d0 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.165+0000 7fcc87400640 1 -- 172.21.15.146:0/3240818404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74032640 con 0x7fcc880d03d0 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.165+0000 7fcc87400640 1 -- 172.21.15.146:0/3240818404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7402ae60 con 0x7fcc880d03d0 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 -- 172.21.15.146:0/3240818404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc880d03d0 msgr2=0x7fcc8815e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 --2- 172.21.15.146:0/3240818404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc880d03d0 0x7fcc8815e310 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcc880725d0 tx=0x7fcc7402a310 comp rx=0 tx=0).stop 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 -- 172.21.15.146:0/3240818404 shutdown_connections 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 --2- 172.21.15.146:0/3240818404 >> v2:172.21.15.203:3300/0 conn(0x7fcc88162580 0x7fcc8815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 --2- 172.21.15.146:0/3240818404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc880d03d0 0x7fcc8815e310 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 -- 172.21.15.146:0/3240818404 >> 172.21.15.146:0/3240818404 conn(0x7fcc8806b560 msgr2=0x7fcc8806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 -- 172.21.15.146:0/3240818404 shutdown_connections 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.166+0000 7fcc8de00640 1 -- 172.21.15.146:0/3240818404 wait complete. 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.168+0000 7fcc8de00640 1 Processor -- start 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.168+0000 7fcc8de00640 1 -- start start 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc880d03d0 0x7fcc88158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 0x7fcc8815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881586e0 con 0x7fcc88162580 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8815ed90 con 0x7fcc88158300 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8806cab0 con 0x7fcc880d03d0 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37452/0 (socket says 172.21.15.146:37452) 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8d400640 1 -- 172.21.15.146:0/2235049676 learned_addr learned my addr 172.21.15.146:0/2235049676 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc87e00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 0x7fcc8815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.169+0000 7fcc8ca00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc880d03d0 0x7fcc88158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 -- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc880d03d0 msgr2=0x7fcc88158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc880d03d0 0x7fcc88158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 -- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 msgr2=0x7fcc8815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 0x7fcc8815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 -- 172.21.15.146:0/2235049676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc881609f0 con 0x7fcc88162580 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc87e00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 0x7fcc8815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8d400640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000b970 tx=0x7fcc8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80019070 con 0x7fcc88162580 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8000cb60 con 0x7fcc88162580 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80014440 con 0x7fcc88162580 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc88152730 con 0x7fcc88162580 2024-04-24T23:09:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.170+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc88152cf0 con 0x7fcc88162580 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.171+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc88068c40 con 0x7fcc88162580 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.172+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc8001c070 con 0x7fcc88162580 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.173+0000 7fcc84c00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 0x7fcc6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.173+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fcc8008ae00 con 0x7fcc88162580 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.174+0000 7fcc8ca00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 0x7fcc6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:09:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.175+0000 7fcc8ca00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 0x7fcc6806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c000f60 tx=0x7fcc7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:09:59.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.177+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcc88068c40 con 0x7fcc88162580 2024-04-24T23:09:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.411+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcc88152520 con 0x7fcc88162580 2024-04-24T23:09:59.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.933+0000 7fcc84c00640 1 -- 172.21.15.146:0/2235049676 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7fcc80059580 con 0x7fcc88162580 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.936+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 msgr2=0x7fcc6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.936+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 0x7fcc6806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c000f60 tx=0x7fcc7c009040 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.936+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 msgr2=0x7fcc8815fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.936+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000b970 tx=0x7fcc8000be30 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 shutdown_connections 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc88162580 0x7fcc8815fcc0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc88158300 0x7fcc8815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcc6806be30 0x7fcc6806e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 --2- 172.21.15.146:0/2235049676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc880d03d0 0x7fcc88158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 >> 172.21.15.146:0/2235049676 conn(0x7fcc8806b560 msgr2=0x7fcc880b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 shutdown_connections 2024-04-24T23:09:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:09:59.937+0000 7fcc8de00640 1 -- 172.21.15.146:0/2235049676 wait complete. 2024-04-24T23:09:59.961 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:09:59.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:00.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.154+0000 7f968c600640 1 Processor -- start 2024-04-24T23:10:00.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.154+0000 7f968c600640 1 -- start start 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.155+0000 7f968c600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9684145640 0x7f968415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f968c600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96840b2a20 0x7f96840cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f968c600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96840cdf70 con 0x7f968406cbc0 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f968c600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f968415d360 con 0x7f96840b2a20 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f968c600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9684145a20 con 0x7f9684145640 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f9689200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96840b2a20 0x7f96840cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f9689200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96840b2a20 0x7f96840cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37462/0 (socket says 172.21.15.146:37462) 2024-04-24T23:10:00.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f9689200640 1 -- 172.21.15.146:0/1650720282 learned_addr learned my addr 172.21.15.146:0/1650720282 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:00.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.156+0000 7f9689c00640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9684145640 0x7f968415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.157+0000 7f9689200640 1 -- 172.21.15.146:0/1650720282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9684145640 msgr2=0x7f968415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:00.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.157+0000 7f9689200640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9684145640 0x7f968415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.157+0000 7f9689200640 1 -- 172.21.15.146:0/1650720282 >> v1:172.21.15.203:6789/0 conn(0x7f968406cbc0 legacy=0x7f968415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:00.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.157+0000 7f9689200640 1 -- 172.21.15.146:0/1650720282 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968406d140 con 0x7f96840b2a20 2024-04-24T23:10:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.158+0000 7f9689200640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b2a20 0x7f96840cfc90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f967002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b761264138ab5cba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.158+0000 7f9683e00640 1 -- 172.21.15.146:0/1650720282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670037070 con 0x7f96840b2a20 2024-04-24T23:10:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f9683e00640 1 -- 172.21.15.146:0/1650720282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9670032440 con 0x7f96840b2a20 2024-04-24T23:10:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f9683e00640 1 -- 172.21.15.146:0/1650720282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670032810 con 0x7f96840b2a20 2024-04-24T23:10:00.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 -- 172.21.15.146:0/1650720282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b2a20 msgr2=0x7f96840cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b2a20 0x7f96840cfc90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f967002a250 comp rx=0 tx=0).stop 2024-04-24T23:10:00.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 -- 172.21.15.146:0/1650720282 shutdown_connections 2024-04-24T23:10:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b2a20 0x7f96840cfc90 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 --2- 172.21.15.146:0/1650720282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9684145640 0x7f968415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 -- 172.21.15.146:0/1650720282 >> 172.21.15.146:0/1650720282 conn(0x7f968406b320 msgr2=0x7f968406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 -- 172.21.15.146:0/1650720282 shutdown_connections 2024-04-24T23:10:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.159+0000 7f968c600640 1 -- 172.21.15.146:0/1650720282 wait complete. 2024-04-24T23:10:00.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.161+0000 7f968c600640 1 Processor -- start 2024-04-24T23:10:00.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.161+0000 7f968c600640 1 -- start start 2024-04-24T23:10:00.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96840b2a20 0x7f9684142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9684145640 0x7f9684138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f968406d9e0 con 0x7f968406cbc0 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f968406d700 con 0x7f9684145640 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.162+0000 7f968c600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f96840d01d0 con 0x7f96840b2a20 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37478/0 (socket says 172.21.15.146:37478) 2024-04-24T23:10:00.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 -- 172.21.15.146:0/2053019282 learned_addr learned my addr 172.21.15.146:0/2053019282 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 -- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96840b2a20 msgr2=0x7f9684142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96840b2a20 0x7f9684142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 -- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9684145640 msgr2=0x7f9684138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f968a600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9684145640 0x7f9684138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9684145640 0x7f9684138060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 -- 172.21.15.146:0/2053019282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96841436b0 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.163+0000 7f9689c00640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f967800d5f0 tx=0x7f967800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.164+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780125f0 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.164+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678019070 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.164+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9684143990 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.164+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780129d0 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.164+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9684143f50 con 0x7f968406cbc0 2024-04-24T23:10:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.165+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96840cf2e0 con 0x7f968406cbc0 2024-04-24T23:10:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.166+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9678012b70 con 0x7f968406cbc0 2024-04-24T23:10:00.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.167+0000 7f9681600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 0x7f966406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.167+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f967808b540 con 0x7f968406cbc0 2024-04-24T23:10:00.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.168+0000 7f9689200640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 0x7f966406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.169+0000 7f9689200640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 0x7f966406e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9670034000 tx=0x7f967002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.171+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f96840cf2e0 con 0x7f968406cbc0 2024-04-24T23:10:00.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.402+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9684068190 con 0x7f968406cbc0 2024-04-24T23:10:00.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.403+0000 7f9681600640 1 -- 172.21.15.146:0/2053019282 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7f9678059c30 con 0x7f968406cbc0 2024-04-24T23:10:00.405 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:00.406 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:00.406 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 msgr2=0x7f966406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 0x7f966406e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9670034000 tx=0x7f967002c000 comp rx=0 tx=0).stop 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 msgr2=0x7f968415e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f967800d5f0 tx=0x7f967800dab0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 shutdown_connections 2024-04-24T23:10:00.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9684145640 0x7f9684138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f966406be30 0x7f966406e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96840b2a20 0x7f9684142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 --2- 172.21.15.146:0/2053019282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968406cbc0 0x7f968415e830 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.406+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 >> 172.21.15.146:0/2053019282 conn(0x7f968406b320 msgr2=0x7f96840af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.407+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 shutdown_connections 2024-04-24T23:10:00.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.407+0000 7f968c600640 1 -- 172.21.15.146:0/2053019282 wait complete. 2024-04-24T23:10:00.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.624+0000 7f724fe00640 1 Processor -- start 2024-04-24T23:10:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.624+0000 7f724fe00640 1 -- start start 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 0x7f72500cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72500709d0 0x7f725015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72500cfb30 0x7f72500cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f72500b4310 con 0x7f72500cfb30 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f72500d04e0 con 0x7f72501561c0 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f72501565a0 con 0x7f72500709d0 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72500cfb30 0x7f72500cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72500cfb30 0x7f72500cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37484/0 (socket says 172.21.15.146:37484) 2024-04-24T23:10:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724f400640 1 -- 172.21.15.146:0/3245862521 learned_addr learned my addr 172.21.15.146:0/3245862521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724ea00640 1 --2- 172.21.15.146:0/3245862521 >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 0x7f72500cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f7246000640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72500709d0 0x7f725015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.626+0000 7f724f400640 1 -- 172.21.15.146:0/3245862521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72500709d0 msgr2=0x7f725015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.627+0000 7f724f400640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72500709d0 0x7f725015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.627+0000 7f724f400640 1 -- 172.21.15.146:0/3245862521 >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 msgr2=0x7f72500cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.627+0000 7f724f400640 1 --2- 172.21.15.146:0/3245862521 >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 0x7f72500cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.627+0000 7f724f400640 1 -- 172.21.15.146:0/3245862521 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7250070f90 con 0x7f72500cfb30 2024-04-24T23:10:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.627+0000 7f724ea00640 1 --2- 172.21.15.146:0/3245862521 >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 0x7f72500cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.628+0000 7f724f400640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f72500cffa0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f72500706c0 tx=0x7f724802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b610f3734f90dc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.628+0000 7f724e000640 1 -- 172.21.15.146:0/3245862521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248037070 con 0x7f72500cfb30 2024-04-24T23:10:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.628+0000 7f724e000640 1 -- 172.21.15.146:0/3245862521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724802ae00 con 0x7f72500cfb30 2024-04-24T23:10:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.628+0000 7f724e000640 1 -- 172.21.15.146:0/3245862521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248032660 con 0x7f72500cfb30 2024-04-24T23:10:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 -- 172.21.15.146:0/3245862521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 msgr2=0x7f72500cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f72500cffa0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f72500706c0 tx=0x7f724802a0b0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 -- 172.21.15.146:0/3245862521 shutdown_connections 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f72500cffa0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 --2- 172.21.15.146:0/3245862521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72500709d0 0x7f725015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 --2- 172.21.15.146:0/3245862521 >> v2:172.21.15.203:3300/0 conn(0x7f72501561c0 0x7f72500cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 -- 172.21.15.146:0/3245862521 >> 172.21.15.146:0/3245862521 conn(0x7f725006b320 msgr2=0x7f725006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 -- 172.21.15.146:0/3245862521 shutdown_connections 2024-04-24T23:10:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.629+0000 7f724fe00640 1 -- 172.21.15.146:0/3245862521 wait complete. 2024-04-24T23:10:00.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.630+0000 7f724fe00640 1 Processor -- start 2024-04-24T23:10:00.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.631+0000 7f724fe00640 1 -- start start 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.631+0000 7f724fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72500709d0 0x7f7250149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.631+0000 7f724fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.631+0000 7f724fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72501561c0 0x7f7250158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f724fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7250071830 con 0x7f72500cfb30 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f724fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7250071550 con 0x7f72500709d0 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f724fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f72500b2c20 con 0x7f72501561c0 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37496/0 (socket says 172.21.15.146:37496) 2024-04-24T23:10:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 -- 172.21.15.146:0/1533672345 learned_addr learned my addr 172.21.15.146:0/1533672345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 -- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72501561c0 msgr2=0x7f7250158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72501561c0 0x7f7250158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f724ea00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72500709d0 0x7f7250149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 -- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72500709d0 msgr2=0x7f7250149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72500709d0 0x7f7250149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 -- 172.21.15.146:0/1533672345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7250159380 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.632+0000 7f7246000640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f723800c7f0 tx=0x7f723800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.633+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238015070 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.633+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7238004240 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.633+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725006cbd0 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.633+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238007620 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.633+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7250144450 con 0x7f72500cfb30 2024-04-24T23:10:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.634+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f725004f500 con 0x7f72500cfb30 2024-04-24T23:10:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.635+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72380079d0 con 0x7f72500cfb30 2024-04-24T23:10:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.636+0000 7f7247400640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 0x7f722c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.636+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f723808b190 con 0x7f72500cfb30 2024-04-24T23:10:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.637+0000 7f724ea00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 0x7f722c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.638+0000 7f724ea00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 0x7f722c06e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7240008e60 tx=0x7f72400083b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.641+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7238059910 con 0x7f72500cfb30 2024-04-24T23:10:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.839+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72501557b0 con 0x7f72500cfb30 2024-04-24T23:10:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.841+0000 7f7247400640 1 -- 172.21.15.146:0/1533672345 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16957 (secure 0 0 0) 0x7f7238059210 con 0x7f72500cfb30 2024-04-24T23:10:00.843 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:00.843 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:57.917411+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 msgr2=0x7f722c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 0x7f722c06e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7240008e60 tx=0x7f72400083b0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 msgr2=0x7f7250143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f723800c7f0 tx=0x7f723800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 shutdown_connections 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f722c06be30 0x7f722c06e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72501561c0 0x7f7250158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72500cfb30 0x7f7250143f10 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 --2- 172.21.15.146:0/1533672345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72500709d0 0x7f7250149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 >> 172.21.15.146:0/1533672345 conn(0x7f725006b320 msgr2=0x7f72500b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 shutdown_connections 2024-04-24T23:10:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:00.843+0000 7f724fe00640 1 -- 172.21.15.146:0/1533672345 wait complete. 2024-04-24T23:10:00.864 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:10:00.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:01.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.063+0000 7f87ae400640 1 Processor -- start 2024-04-24T23:10:01.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.063+0000 7f87ae400640 1 -- start start 2024-04-24T23:10:01.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.064+0000 7f87ae400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f87a815b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87ae400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a80b3dd0 con 0x7f87a8071630 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87ae400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a80b3530 con 0x7f87a8154d30 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87ae400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80b3810 con 0x7f87a80cf3e0 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87a7400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f87a8071630 0x7f87a8072890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41998/0 (socket says 172.21.15.146:41998) 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87a7400640 1 -- 172.21.15.146:0/2350956572 learned_addr learned my addr 172.21.15.146:0/2350956572 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87a7e00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f87a815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160839778 0 0) 0x7f87a80b3dd0 con 0x7f87a8071630 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.065+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f878c003520 con 0x7f87a8071630 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 732279668 0 0) 0x7f878c003520 con 0x7f87a8071630 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 msgr2=0x7f87a815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f87a815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 >> v1:172.21.15.203:6789/0 conn(0x7f87a8154d30 legacy=0x7f87a8071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a80b3af0 con 0x7f87a8071630 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f8798001670 con 0x7f87a8071630 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 >> v1:172.21.15.146:6789/0 conn(0x7f87a8071630 legacy=0x7f87a8072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f878c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004010 0x7f878c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f878c004d40 0x7f878c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80b3810 con 0x7f878c004d40 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f878c00bb80 con 0x7f878c004010 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f878c00bd80 con 0x7f87a80cf3e0 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a7e00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f878c004d40 0x7f878c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f879ea00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004010 0x7f878c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a7400640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f878c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a7e00640 1 -- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 msgr2=0x7f878c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:01.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.066+0000 7f87a7e00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f878c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f87a7e00640 1 -- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004010 msgr2=0x7f878c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:01.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f87a7e00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004010 0x7f878c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f87a7e00640 1 -- 172.21.15.146:0/2350956572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878c003520 con 0x7f878c004d40 2024-04-24T23:10:01.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f879ea00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004010 0x7f878c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:01.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f87a7400640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a80cf3e0 0x7f878c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:01.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.067+0000 7f87a7e00640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f878c004d40 0x7f878c0051c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f87a0007360 tx=0x7f878c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ded4254efa01e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0009be0 con 0x7f878c004d40 2024-04-24T23:10:01.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0036600 con 0x7f878c004d40 2024-04-24T23:10:01.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87a6a00640 1 -- 172.21.15.146:0/2350956572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a00369d0 con 0x7f878c004d40 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 -- 172.21.15.146:0/2350956572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f878c004d40 msgr2=0x7f878c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 --2- 172.21.15.146:0/2350956572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f878c004d40 0x7f878c0051c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f87a0007360 tx=0x7f878c005830 comp rx=0 tx=0).stop 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87a7e00640 1 -- 172.21.15.146:0/2350956572 reap_dead start 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 -- 172.21.15.146:0/2350956572 shutdown_connections 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 -- 172.21.15.146:0/2350956572 >> 172.21.15.146:0/2350956572 conn(0x7f87a806b320 msgr2=0x7f87a806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 -- 172.21.15.146:0/2350956572 shutdown_connections 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.068+0000 7f87ae400640 1 -- 172.21.15.146:0/2350956572 wait complete. 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.070+0000 7f87ae400640 1 Processor -- start 2024-04-24T23:10:01.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.070+0000 7f87ae400640 1 -- start start 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004d40 0x7f87a80b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a8159520 0x7f87a8159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80cfe10 con 0x7f87a80b06e0 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80cfc90 con 0x7f878c004d40 2024-04-24T23:10:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.071+0000 7f87ae400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80cff90 con 0x7f87a8159520 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37508/0 (socket says 172.21.15.146:37508) 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 -- 172.21.15.146:0/4174321832 learned_addr learned my addr 172.21.15.146:0/4174321832 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f879ea00640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a8159520 0x7f87a8159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004d40 0x7f87a80b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 -- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a8159520 msgr2=0x7f87a8159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a8159520 0x7f87a8159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 -- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004d40 msgr2=0x7f87a80b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004d40 0x7f87a80b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.072+0000 7f87a7e00640 1 -- 172.21.15.146:0/4174321832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a8151280 con 0x7f87a80b06e0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f87a7e00640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f87a0007450 tx=0x7f87a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0009be0 con 0x7f87a80b06e0 2024-04-24T23:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0003990 con 0x7f87a80b06e0 2024-04-24T23:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0003d60 con 0x7f87a80b06e0 2024-04-24T23:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a8151540 con 0x7f87a80b06e0 2024-04-24T23:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.073+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a8151b00 con 0x7f87a80b06e0 2024-04-24T23:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.074+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a8151d00 con 0x7f87a80b06e0 2024-04-24T23:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.075+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87a0048020 con 0x7f87a80b06e0 2024-04-24T23:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.076+0000 7f879fe00640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 0x7f878406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.076+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f87a00ab5d0 con 0x7f87a80b06e0 2024-04-24T23:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.077+0000 7f87a7400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 0x7f878406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.078+0000 7f87a7400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 0x7f878406e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f87980017e0 tx=0x7f8798001c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.080+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f87a8151d00 con 0x7f87a80b06e0 2024-04-24T23:10:01.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.275+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87a8068190 con 0x7f878406be60 2024-04-24T23:10:01.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.294+0000 7f879fe00640 1 -- 172.21.15.146:0/4174321832 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251448 (secure 0 0 0) 0x7f87a8068190 con 0x7f878406be60 2024-04-24T23:10:01.300 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 msgr2=0x7f878406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 0x7f878406e320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f87980017e0 tx=0x7f8798001c40 comp rx=0 tx=0).stop 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 msgr2=0x7f87a80b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f87a0007450 tx=0x7f87a0004ab0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 shutdown_connections 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a80b06e0 0x7f87a80b0b90 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f878406be60 0x7f878406e320 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87a8159520 0x7f87a8159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 --2- 172.21.15.146:0/4174321832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f878c004d40 0x7f87a80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.300+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 >> 172.21.15.146:0/4174321832 conn(0x7f87a806b320 msgr2=0x7f87a815b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.301+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 shutdown_connections 2024-04-24T23:10:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.301+0000 7f87ae400640 1 -- 172.21.15.146:0/4174321832 wait complete. 2024-04-24T23:10:01.322 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2024-04-24T23:09:59.815938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259608,"kb_used_data":10148,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715112,"statfs":{"total":773094113280,"available":772828274688,"internally_reserved":0,"allocated":10391552,"data_stored":5404617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960765"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946727+0000","last_change":"2024-04-24T23:09:56.940409+0000","last_active":"2024-04-24T23:09:56.946727+0000","last_peered":"2024-04-24T23:09:56.946727+0000","last_clean":"2024-04-24T23:09:56.946727+0000","last_became_active":"2024-04-24T23:09:56.940129+0000","last_became_peered":"2024-04-24T23:09:56.940129+0000","last_unstale":"2024-04-24T23:09:56.946727+0000","last_undegraded":"2024-04-24T23:09:56.946727+0000","last_fullsized":"2024-04-24T23:09:56.946727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925255+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.925255+0000","last_peered":"2024-04-24T23:09:56.925255+0000","last_clean":"2024-04-24T23:09:56.925255+0000","last_became_active":"2024-04-24T23:09:56.917999+0000","last_became_peered":"2024-04-24T23:09:56.917999+0000","last_unstale":"2024-04-24T23:09:56.925255+0000","last_undegraded":"2024-04-24T23:09:56.925255+0000","last_fullsized":"2024-04-24T23:09:56.925255+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:13.452094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945404+0000","last_change":"2024-04-24T23:09:56.924994+0000","last_active":"2024-04-24T23:09:56.945404+0000","last_peered":"2024-04-24T23:09:56.945404+0000","last_clean":"2024-04-24T23:09:56.945404+0000","last_became_active":"2024-04-24T23:09:56.921828+0000","last_became_peered":"2024-04-24T23:09:56.921828+0000","last_unstale":"2024-04-24T23:09:56.945404+0000","last_undegraded":"2024-04-24T23:09:56.945404+0000","last_fullsized":"2024-04-24T23:09:56.945404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:36.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946983+0000","last_change":"2024-04-24T23:09:56.932969+0000","last_active":"2024-04-24T23:09:56.946983+0000","last_peered":"2024-04-24T23:09:56.946983+0000","last_clean":"2024-04-24T23:09:56.946983+0000","last_became_active":"2024-04-24T23:09:56.932433+0000","last_became_peered":"2024-04-24T23:09:56.932433+0000","last_unstale":"2024-04-24T23:09:56.946983+0000","last_undegraded":"2024-04-24T23:09:56.946983+0000","last_fullsized":"2024-04-24T23:09:56.946983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:24.516515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937107+0000","last_change":"2024-04-24T23:09:56.933631+0000","last_active":"2024-04-24T23:09:56.937107+0000","last_peered":"2024-04-24T23:09:56.937107+0000","last_clean":"2024-04-24T23:09:56.937107+0000","last_became_active":"2024-04-24T23:09:56.932689+0000","last_became_peered":"2024-04-24T23:09:56.932689+0000","last_unstale":"2024-04-24T23:09:56.937107+0000","last_undegraded":"2024-04-24T23:09:56.937107+0000","last_fullsized":"2024-04-24T23:09:56.937107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946339+0000","last_change":"2024-04-24T23:09:56.939868+0000","last_active":"2024-04-24T23:09:56.946339+0000","last_peered":"2024-04-24T23:09:56.946339+0000","last_clean":"2024-04-24T23:09:56.946339+0000","last_became_active":"2024-04-24T23:09:56.939581+0000","last_became_peered":"2024-04-24T23:09:56.939581+0000","last_unstale":"2024-04-24T23:09:56.946339+0000","last_undegraded":"2024-04-24T23:09:56.946339+0000","last_fullsized":"2024-04-24T23:09:56.946339+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:50.677141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952631+0000","last_change":"2024-04-24T23:09:56.949125+0000","last_active":"2024-04-24T23:09:56.952631+0000","last_peered":"2024-04-24T23:09:56.952631+0000","last_clean":"2024-04-24T23:09:56.952631+0000","last_became_active":"2024-04-24T23:09:56.948828+0000","last_became_peered":"2024-04-24T23:09:56.948828+0000","last_unstale":"2024-04-24T23:09:56.952631+0000","last_undegraded":"2024-04-24T23:09:56.952631+0000","last_fullsized":"2024-04-24T23:09:56.952631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:02.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938647+0000","last_change":"2024-04-24T23:09:56.927536+0000","last_active":"2024-04-24T23:09:56.938647+0000","last_peered":"2024-04-24T23:09:56.938647+0000","last_clean":"2024-04-24T23:09:56.938647+0000","last_became_active":"2024-04-24T23:09:56.926961+0000","last_became_peered":"2024-04-24T23:09:56.926961+0000","last_unstale":"2024-04-24T23:09:56.938647+0000","last_undegraded":"2024-04-24T23:09:56.938647+0000","last_fullsized":"2024-04-24T23:09:56.938647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:25.403855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938149+0000","last_change":"2024-04-24T23:09:56.936517+0000","last_active":"2024-04-24T23:09:56.938149+0000","last_peered":"2024-04-24T23:09:56.938149+0000","last_clean":"2024-04-24T23:09:56.938149+0000","last_became_active":"2024-04-24T23:09:56.936129+0000","last_became_peered":"2024-04-24T23:09:56.936129+0000","last_unstale":"2024-04-24T23:09:56.938149+0000","last_undegraded":"2024-04-24T23:09:56.938149+0000","last_fullsized":"2024-04-24T23:09:56.938149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:46.003977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945923+0000","last_change":"2024-04-24T23:09:56.928806+0000","last_active":"2024-04-24T23:09:56.945923+0000","last_peered":"2024-04-24T23:09:56.945923+0000","last_clean":"2024-04-24T23:09:56.945923+0000","last_became_active":"2024-04-24T23:09:56.925611+0000","last_became_peered":"2024-04-24T23:09:56.925611+0000","last_unstale":"2024-04-24T23:09:56.945923+0000","last_undegraded":"2024-04-24T23:09:56.945923+0000","last_fullsized":"2024-04-24T23:09:56.945923+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:55.912721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952132+0000","last_change":"2024-04-24T23:09:56.950003+0000","last_active":"2024-04-24T23:09:56.952132+0000","last_peered":"2024-04-24T23:09:56.952132+0000","last_clean":"2024-04-24T23:09:56.952132+0000","last_became_active":"2024-04-24T23:09:56.949677+0000","last_became_peered":"2024-04-24T23:09:56.949677+0000","last_unstale":"2024-04-24T23:09:56.952132+0000","last_undegraded":"2024-04-24T23:09:56.952132+0000","last_fullsized":"2024-04-24T23:09:56.952132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:27:59.773669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947104+0000","last_change":"2024-04-24T23:09:56.941322+0000","last_active":"2024-04-24T23:09:56.947104+0000","last_peered":"2024-04-24T23:09:56.947104+0000","last_clean":"2024-04-24T23:09:56.947104+0000","last_became_active":"2024-04-24T23:09:56.941057+0000","last_became_peered":"2024-04-24T23:09:56.941057+0000","last_unstale":"2024-04-24T23:09:56.947104+0000","last_undegraded":"2024-04-24T23:09:56.947104+0000","last_fullsized":"2024-04-24T23:09:56.947104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:34.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.877695+0000","last_change":"2024-04-24T23:09:55.877695+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.877695+0000","last_undegraded":"2024-04-24T23:09:55.877695+0000","last_fullsized":"2024-04-24T23:09:55.877695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949645+0000","last_change":"2024-04-24T23:09:56.946705+0000","last_active":"2024-04-24T23:09:56.949645+0000","last_peered":"2024-04-24T23:09:56.949645+0000","last_clean":"2024-04-24T23:09:56.949645+0000","last_became_active":"2024-04-24T23:09:56.946427+0000","last_became_peered":"2024-04-24T23:09:56.946427+0000","last_unstale":"2024-04-24T23:09:56.949645+0000","last_undegraded":"2024-04-24T23:09:56.949645+0000","last_fullsized":"2024-04-24T23:09:56.949645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947290+0000","last_change":"2024-04-24T23:09:56.931525+0000","last_active":"2024-04-24T23:09:56.947290+0000","last_peered":"2024-04-24T23:09:56.947290+0000","last_clean":"2024-04-24T23:09:56.947290+0000","last_became_active":"2024-04-24T23:09:56.925661+0000","last_became_peered":"2024-04-24T23:09:56.925661+0000","last_unstale":"2024-04-24T23:09:56.947290+0000","last_undegraded":"2024-04-24T23:09:56.947290+0000","last_fullsized":"2024-04-24T23:09:56.947290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:00.260147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932106+0000","last_change":"2024-04-24T23:09:56.919116+0000","last_active":"2024-04-24T23:09:56.932106+0000","last_peered":"2024-04-24T23:09:56.932106+0000","last_clean":"2024-04-24T23:09:56.932106+0000","last_became_active":"2024-04-24T23:09:56.918824+0000","last_became_peered":"2024-04-24T23:09:56.918824+0000","last_unstale":"2024-04-24T23:09:56.932106+0000","last_undegraded":"2024-04-24T23:09:56.932106+0000","last_fullsized":"2024-04-24T23:09:56.932106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:46.503606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949070+0000","last_change":"2024-04-24T23:09:56.944906+0000","last_active":"2024-04-24T23:09:56.949070+0000","last_peered":"2024-04-24T23:09:56.949070+0000","last_clean":"2024-04-24T23:09:56.949070+0000","last_became_active":"2024-04-24T23:09:56.944626+0000","last_became_peered":"2024-04-24T23:09:56.944626+0000","last_unstale":"2024-04-24T23:09:56.949070+0000","last_undegraded":"2024-04-24T23:09:56.949070+0000","last_fullsized":"2024-04-24T23:09:56.949070+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:28.600192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947065+0000","last_change":"2024-04-24T23:09:56.925763+0000","last_active":"2024-04-24T23:09:56.947065+0000","last_peered":"2024-04-24T23:09:56.947065+0000","last_clean":"2024-04-24T23:09:56.947065+0000","last_became_active":"2024-04-24T23:09:56.925443+0000","last_became_peered":"2024-04-24T23:09:56.925443+0000","last_unstale":"2024-04-24T23:09:56.947065+0000","last_undegraded":"2024-04-24T23:09:56.947065+0000","last_fullsized":"2024-04-24T23:09:56.947065+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:42.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935106+0000","last_change":"2024-04-24T23:09:56.930342+0000","last_active":"2024-04-24T23:09:56.935106+0000","last_peered":"2024-04-24T23:09:56.935106+0000","last_clean":"2024-04-24T23:09:56.935106+0000","last_became_active":"2024-04-24T23:09:56.929614+0000","last_became_peered":"2024-04-24T23:09:56.929614+0000","last_unstale":"2024-04-24T23:09:56.935106+0000","last_undegraded":"2024-04-24T23:09:56.935106+0000","last_fullsized":"2024-04-24T23:09:56.935106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946212+0000","last_change":"2024-04-24T23:09:56.941593+0000","last_active":"2024-04-24T23:09:56.946212+0000","last_peered":"2024-04-24T23:09:56.946212+0000","last_clean":"2024-04-24T23:09:56.946212+0000","last_became_active":"2024-04-24T23:09:56.939699+0000","last_became_peered":"2024-04-24T23:09:56.939699+0000","last_unstale":"2024-04-24T23:09:56.946212+0000","last_undegraded":"2024-04-24T23:09:56.946212+0000","last_fullsized":"2024-04-24T23:09:56.946212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:57.844085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937154+0000","last_change":"2024-04-24T23:09:56.934769+0000","last_active":"2024-04-24T23:09:56.937154+0000","last_peered":"2024-04-24T23:09:56.937154+0000","last_clean":"2024-04-24T23:09:56.937154+0000","last_became_active":"2024-04-24T23:09:56.933079+0000","last_became_peered":"2024-04-24T23:09:56.933079+0000","last_unstale":"2024-04-24T23:09:56.937154+0000","last_undegraded":"2024-04-24T23:09:56.937154+0000","last_fullsized":"2024-04-24T23:09:56.937154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.929291+0000","last_change":"2024-04-24T23:09:56.927450+0000","last_active":"2024-04-24T23:09:56.929291+0000","last_peered":"2024-04-24T23:09:56.929291+0000","last_clean":"2024-04-24T23:09:56.929291+0000","last_became_active":"2024-04-24T23:09:56.927016+0000","last_became_peered":"2024-04-24T23:09:56.927016+0000","last_unstale":"2024-04-24T23:09:56.929291+0000","last_undegraded":"2024-04-24T23:09:56.929291+0000","last_fullsized":"2024-04-24T23:09:56.929291+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937104+0000","last_change":"2024-04-24T23:09:56.933202+0000","last_active":"2024-04-24T23:09:56.937104+0000","last_peered":"2024-04-24T23:09:56.937104+0000","last_clean":"2024-04-24T23:09:56.937104+0000","last_became_active":"2024-04-24T23:09:56.932903+0000","last_became_peered":"2024-04-24T23:09:56.932903+0000","last_unstale":"2024-04-24T23:09:56.937104+0000","last_undegraded":"2024-04-24T23:09:56.937104+0000","last_fullsized":"2024-04-24T23:09:56.937104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:19.829265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933845+0000","last_change":"2024-04-24T23:09:56.927531+0000","last_active":"2024-04-24T23:09:56.933845+0000","last_peered":"2024-04-24T23:09:56.933845+0000","last_clean":"2024-04-24T23:09:56.933845+0000","last_became_active":"2024-04-24T23:09:56.927243+0000","last_became_peered":"2024-04-24T23:09:56.927243+0000","last_unstale":"2024-04-24T23:09:56.933845+0000","last_undegraded":"2024-04-24T23:09:56.933845+0000","last_fullsized":"2024-04-24T23:09:56.933845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.928096+0000","last_change":"2024-04-24T23:09:56.925843+0000","last_active":"2024-04-24T23:09:56.928096+0000","last_peered":"2024-04-24T23:09:56.928096+0000","last_clean":"2024-04-24T23:09:56.928096+0000","last_became_active":"2024-04-24T23:09:56.925556+0000","last_became_peered":"2024-04-24T23:09:56.925556+0000","last_unstale":"2024-04-24T23:09:56.928096+0000","last_undegraded":"2024-04-24T23:09:56.928096+0000","last_fullsized":"2024-04-24T23:09:56.928096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:44.189224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.920681+0000","last_change":"2024-04-24T23:09:56.915444+0000","last_active":"2024-04-24T23:09:56.920681+0000","last_peered":"2024-04-24T23:09:56.920681+0000","last_clean":"2024-04-24T23:09:56.920681+0000","last_became_active":"2024-04-24T23:09:56.914704+0000","last_became_peered":"2024-04-24T23:09:56.914704+0000","last_unstale":"2024-04-24T23:09:56.920681+0000","last_undegraded":"2024-04-24T23:09:56.920681+0000","last_fullsized":"2024-04-24T23:09:56.920681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:45.239398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945435+0000","last_change":"2024-04-24T23:09:56.925404+0000","last_active":"2024-04-24T23:09:56.945435+0000","last_peered":"2024-04-24T23:09:56.945435+0000","last_clean":"2024-04-24T23:09:56.945435+0000","last_became_active":"2024-04-24T23:09:56.925111+0000","last_became_peered":"2024-04-24T23:09:56.925111+0000","last_unstale":"2024-04-24T23:09:56.945435+0000","last_undegraded":"2024-04-24T23:09:56.945435+0000","last_fullsized":"2024-04-24T23:09:56.945435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:31.210094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.876587+0000","last_change":"2024-04-24T23:09:55.876587+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.876587+0000","last_undegraded":"2024-04-24T23:09:55.876587+0000","last_fullsized":"2024-04-24T23:09:55.876587+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937132+0000","last_change":"2024-04-24T23:09:56.933867+0000","last_active":"2024-04-24T23:09:56.937132+0000","last_peered":"2024-04-24T23:09:56.937132+0000","last_clean":"2024-04-24T23:09:56.937132+0000","last_became_active":"2024-04-24T23:09:56.933359+0000","last_became_peered":"2024-04-24T23:09:56.933359+0000","last_unstale":"2024-04-24T23:09:56.937132+0000","last_undegraded":"2024-04-24T23:09:56.937132+0000","last_fullsized":"2024-04-24T23:09:56.937132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936138+0000","last_change":"2024-04-24T23:09:56.931228+0000","last_active":"2024-04-24T23:09:56.936138+0000","last_peered":"2024-04-24T23:09:56.936138+0000","last_clean":"2024-04-24T23:09:56.936138+0000","last_became_active":"2024-04-24T23:09:56.930831+0000","last_became_peered":"2024-04-24T23:09:56.930831+0000","last_unstale":"2024-04-24T23:09:56.936138+0000","last_undegraded":"2024-04-24T23:09:56.936138+0000","last_fullsized":"2024-04-24T23:09:56.936138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936036+0000","last_change":"2024-04-24T23:09:56.932993+0000","last_active":"2024-04-24T23:09:56.936036+0000","last_peered":"2024-04-24T23:09:56.936036+0000","last_clean":"2024-04-24T23:09:56.936036+0000","last_became_active":"2024-04-24T23:09:56.932707+0000","last_became_peered":"2024-04-24T23:09:56.932707+0000","last_unstale":"2024-04-24T23:09:56.936036+0000","last_undegraded":"2024-04-24T23:09:56.936036+0000","last_fullsized":"2024-04-24T23:09:56.936036+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.930748+0000","last_change":"2024-04-24T23:09:56.917318+0000","last_active":"2024-04-24T23:09:56.930748+0000","last_peered":"2024-04-24T23:09:56.930748+0000","last_clean":"2024-04-24T23:09:56.930748+0000","last_became_active":"2024-04-24T23:09:56.916979+0000","last_became_peered":"2024-04-24T23:09:56.916979+0000","last_unstale":"2024-04-24T23:09:56.930748+0000","last_undegraded":"2024-04-24T23:09:56.930748+0000","last_fullsized":"2024-04-24T23:09:56.930748+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.944480+0000","last_change":"2024-04-24T23:09:56.935573+0000","last_active":"2024-04-24T23:09:56.944480+0000","last_peered":"2024-04-24T23:09:56.944480+0000","last_clean":"2024-04-24T23:09:56.944480+0000","last_became_active":"2024-04-24T23:09:56.935267+0000","last_became_peered":"2024-04-24T23:09:56.935267+0000","last_unstale":"2024-04-24T23:09:56.944480+0000","last_undegraded":"2024-04-24T23:09:56.944480+0000","last_fullsized":"2024-04-24T23:09:56.944480+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950958+0000","last_change":"2024-04-24T23:09:55.878169+0000","last_active":"2024-04-24T23:09:56.950958+0000","last_peered":"2024-04-24T23:09:56.950958+0000","last_clean":"2024-04-24T23:09:56.950958+0000","last_became_active":"2024-04-24T23:09:55.877826+0000","last_became_peered":"2024-04-24T23:09:55.877826+0000","last_unstale":"2024-04-24T23:09:56.950958+0000","last_undegraded":"2024-04-24T23:09:56.950958+0000","last_fullsized":"2024-04-24T23:09:56.950958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:29.372680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946413+0000","last_change":"2024-04-24T23:09:56.942471+0000","last_active":"2024-04-24T23:09:56.946413+0000","last_peered":"2024-04-24T23:09:56.946413+0000","last_clean":"2024-04-24T23:09:56.946413+0000","last_became_active":"2024-04-24T23:09:56.942154+0000","last_became_peered":"2024-04-24T23:09:56.942154+0000","last_unstale":"2024-04-24T23:09:56.946413+0000","last_undegraded":"2024-04-24T23:09:56.946413+0000","last_fullsized":"2024-04-24T23:09:56.946413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:05.671071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953281+0000","last_change":"2024-04-24T23:09:55.885462+0000","last_active":"2024-04-24T23:09:56.953281+0000","last_peered":"2024-04-24T23:09:56.953281+0000","last_clean":"2024-04-24T23:09:56.953281+0000","last_became_active":"2024-04-24T23:09:55.885156+0000","last_became_peered":"2024-04-24T23:09:55.885156+0000","last_unstale":"2024-04-24T23:09:56.953281+0000","last_undegraded":"2024-04-24T23:09:56.953281+0000","last_fullsized":"2024-04-24T23:09:56.953281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:32.759204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.948053+0000","last_change":"2024-04-24T23:09:56.945032+0000","last_active":"2024-04-24T23:09:56.948053+0000","last_peered":"2024-04-24T23:09:56.948053+0000","last_clean":"2024-04-24T23:09:56.948053+0000","last_became_active":"2024-04-24T23:09:56.944757+0000","last_became_peered":"2024-04-24T23:09:56.944757+0000","last_unstale":"2024-04-24T23:09:56.948053+0000","last_undegraded":"2024-04-24T23:09:56.948053+0000","last_fullsized":"2024-04-24T23:09:56.948053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:16.993406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953127+0000","last_change":"2024-04-24T23:09:55.901246+0000","last_active":"2024-04-24T23:09:56.953127+0000","last_peered":"2024-04-24T23:09:56.953127+0000","last_clean":"2024-04-24T23:09:56.953127+0000","last_became_active":"2024-04-24T23:09:55.900510+0000","last_became_peered":"2024-04-24T23:09:55.900510+0000","last_unstale":"2024-04-24T23:09:56.953127+0000","last_undegraded":"2024-04-24T23:09:56.953127+0000","last_fullsized":"2024-04-24T23:09:56.953127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:33.972115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942803+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.942803+0000","last_peered":"2024-04-24T23:09:56.942803+0000","last_clean":"2024-04-24T23:09:56.942803+0000","last_became_active":"2024-04-24T23:09:56.920155+0000","last_became_peered":"2024-04-24T23:09:56.920155+0000","last_unstale":"2024-04-24T23:09:56.942803+0000","last_undegraded":"2024-04-24T23:09:56.942803+0000","last_fullsized":"2024-04-24T23:09:56.942803+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:28.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955535+0000","last_change":"2024-04-24T23:09:55.888998+0000","last_active":"2024-04-24T23:09:56.955535+0000","last_peered":"2024-04-24T23:09:56.955535+0000","last_clean":"2024-04-24T23:09:56.955535+0000","last_became_active":"2024-04-24T23:09:55.888687+0000","last_became_peered":"2024-04-24T23:09:55.888687+0000","last_unstale":"2024-04-24T23:09:56.955535+0000","last_undegraded":"2024-04-24T23:09:56.955535+0000","last_fullsized":"2024-04-24T23:09:56.955535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.825617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874832+0000","last_change":"2024-04-24T23:09:55.874832+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874832+0000","last_undegraded":"2024-04-24T23:09:55.874832+0000","last_fullsized":"2024-04-24T23:09:55.874832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952882+0000","last_change":"2024-04-24T23:09:55.895038+0000","last_active":"2024-04-24T23:09:56.952882+0000","last_peered":"2024-04-24T23:09:56.952882+0000","last_clean":"2024-04-24T23:09:56.952882+0000","last_became_active":"2024-04-24T23:09:55.894708+0000","last_became_peered":"2024-04-24T23:09:55.894708+0000","last_unstale":"2024-04-24T23:09:56.952882+0000","last_undegraded":"2024-04-24T23:09:56.952882+0000","last_fullsized":"2024-04-24T23:09:56.952882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952187+0000","last_change":"2024-04-24T23:09:56.950756+0000","last_active":"2024-04-24T23:09:56.952187+0000","last_peered":"2024-04-24T23:09:56.952187+0000","last_clean":"2024-04-24T23:09:56.952187+0000","last_became_active":"2024-04-24T23:09:56.950487+0000","last_became_peered":"2024-04-24T23:09:56.950487+0000","last_unstale":"2024-04-24T23:09:56.952187+0000","last_undegraded":"2024-04-24T23:09:56.952187+0000","last_fullsized":"2024-04-24T23:09:56.952187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-24T23:09:55.904512+0000","last_change":"2024-04-24T23:09:55.902440+0000","last_active":"2024-04-24T23:09:55.904512+0000","last_peered":"2024-04-24T23:09:55.904512+0000","last_clean":"2024-04-24T23:09:55.904512+0000","last_became_active":"2024-04-24T23:09:55.901950+0000","last_became_peered":"2024-04-24T23:09:55.901950+0000","last_unstale":"2024-04-24T23:09:55.904512+0000","last_undegraded":"2024-04-24T23:09:55.904512+0000","last_fullsized":"2024-04-24T23:09:55.904512+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:26.947931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941364+0000","last_change":"2024-04-24T23:09:56.935846+0000","last_active":"2024-04-24T23:09:56.941364+0000","last_peered":"2024-04-24T23:09:56.941364+0000","last_clean":"2024-04-24T23:09:56.941364+0000","last_became_active":"2024-04-24T23:09:56.935571+0000","last_became_peered":"2024-04-24T23:09:56.935571+0000","last_unstale":"2024-04-24T23:09:56.941364+0000","last_undegraded":"2024-04-24T23:09:56.941364+0000","last_fullsized":"2024-04-24T23:09:56.941364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:32:59.681587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.906824+0000","last_change":"2024-04-24T23:09:55.899264+0000","last_active":"2024-04-24T23:09:56.906824+0000","last_peered":"2024-04-24T23:09:56.906824+0000","last_clean":"2024-04-24T23:09:56.906824+0000","last_became_active":"2024-04-24T23:09:55.898514+0000","last_became_peered":"2024-04-24T23:09:55.898514+0000","last_unstale":"2024-04-24T23:09:56.906824+0000","last_undegraded":"2024-04-24T23:09:56.906824+0000","last_fullsized":"2024-04-24T23:09:56.906824+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:24.586695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937832+0000","last_change":"2024-04-24T23:09:56.931992+0000","last_active":"2024-04-24T23:09:56.937832+0000","last_peered":"2024-04-24T23:09:56.937832+0000","last_clean":"2024-04-24T23:09:56.937832+0000","last_became_active":"2024-04-24T23:09:56.931619+0000","last_became_peered":"2024-04-24T23:09:56.931619+0000","last_unstale":"2024-04-24T23:09:56.937832+0000","last_undegraded":"2024-04-24T23:09:56.937832+0000","last_fullsized":"2024-04-24T23:09:56.937832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898773+0000","last_change":"2024-04-24T23:09:55.897787+0000","last_active":"2024-04-24T23:09:56.898773+0000","last_peered":"2024-04-24T23:09:56.898773+0000","last_clean":"2024-04-24T23:09:56.898773+0000","last_became_active":"2024-04-24T23:09:55.897129+0000","last_became_peered":"2024-04-24T23:09:55.897129+0000","last_unstale":"2024-04-24T23:09:56.898773+0000","last_undegraded":"2024-04-24T23:09:56.898773+0000","last_fullsized":"2024-04-24T23:09:56.898773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:59.244632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941212+0000","last_change":"2024-04-24T23:09:56.940662+0000","last_active":"2024-04-24T23:09:56.941212+0000","last_peered":"2024-04-24T23:09:56.941212+0000","last_clean":"2024-04-24T23:09:56.941212+0000","last_became_active":"2024-04-24T23:09:56.940303+0000","last_became_peered":"2024-04-24T23:09:56.940303+0000","last_unstale":"2024-04-24T23:09:56.941212+0000","last_undegraded":"2024-04-24T23:09:56.941212+0000","last_fullsized":"2024-04-24T23:09:56.941212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901961+0000","last_change":"2024-04-24T23:09:55.901003+0000","last_active":"2024-04-24T23:09:56.901961+0000","last_peered":"2024-04-24T23:09:56.901961+0000","last_clean":"2024-04-24T23:09:56.901961+0000","last_became_active":"2024-04-24T23:09:55.900616+0000","last_became_peered":"2024-04-24T23:09:55.900616+0000","last_unstale":"2024-04-24T23:09:56.901961+0000","last_undegraded":"2024-04-24T23:09:56.901961+0000","last_fullsized":"2024-04-24T23:09:56.901961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:41.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935853+0000","last_change":"2024-04-24T23:09:56.929324+0000","last_active":"2024-04-24T23:09:56.935853+0000","last_peered":"2024-04-24T23:09:56.935853+0000","last_clean":"2024-04-24T23:09:56.935853+0000","last_became_active":"2024-04-24T23:09:56.928972+0000","last_became_peered":"2024-04-24T23:09:56.928972+0000","last_unstale":"2024-04-24T23:09:56.935853+0000","last_undegraded":"2024-04-24T23:09:56.935853+0000","last_fullsized":"2024-04-24T23:09:56.935853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:20.967828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.909826+0000","last_change":"2024-04-24T23:09:55.897350+0000","last_active":"2024-04-24T23:09:56.909826+0000","last_peered":"2024-04-24T23:09:56.909826+0000","last_clean":"2024-04-24T23:09:56.909826+0000","last_became_active":"2024-04-24T23:09:55.896165+0000","last_became_peered":"2024-04-24T23:09:55.896165+0000","last_unstale":"2024-04-24T23:09:56.909826+0000","last_undegraded":"2024-04-24T23:09:56.909826+0000","last_fullsized":"2024-04-24T23:09:56.909826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:39.578060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942948+0000","last_change":"2024-04-24T23:09:56.937575+0000","last_active":"2024-04-24T23:09:56.942948+0000","last_peered":"2024-04-24T23:09:56.942948+0000","last_clean":"2024-04-24T23:09:56.942948+0000","last_became_active":"2024-04-24T23:09:56.936720+0000","last_became_peered":"2024-04-24T23:09:56.936720+0000","last_unstale":"2024-04-24T23:09:56.942948+0000","last_undegraded":"2024-04-24T23:09:56.942948+0000","last_fullsized":"2024-04-24T23:09:56.942948+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955776+0000","last_change":"2024-04-24T23:09:55.900879+0000","last_active":"2024-04-24T23:09:56.955776+0000","last_peered":"2024-04-24T23:09:56.955776+0000","last_clean":"2024-04-24T23:09:56.955776+0000","last_became_active":"2024-04-24T23:09:55.900538+0000","last_became_peered":"2024-04-24T23:09:55.900538+0000","last_unstale":"2024-04-24T23:09:56.955776+0000","last_undegraded":"2024-04-24T23:09:56.955776+0000","last_fullsized":"2024-04-24T23:09:56.955776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:55.974696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941176+0000","last_change":"2024-04-24T23:09:56.929691+0000","last_active":"2024-04-24T23:09:56.941176+0000","last_peered":"2024-04-24T23:09:56.941176+0000","last_clean":"2024-04-24T23:09:56.941176+0000","last_became_active":"2024-04-24T23:09:56.928870+0000","last_became_peered":"2024-04-24T23:09:56.928870+0000","last_unstale":"2024-04-24T23:09:56.941176+0000","last_undegraded":"2024-04-24T23:09:56.941176+0000","last_fullsized":"2024-04-24T23:09:56.941176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:10.293838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955766+0000","last_change":"2024-04-24T23:09:55.904255+0000","last_active":"2024-04-24T23:09:56.955766+0000","last_peered":"2024-04-24T23:09:56.955766+0000","last_clean":"2024-04-24T23:09:56.955766+0000","last_became_active":"2024-04-24T23:09:55.903943+0000","last_became_peered":"2024-04-24T23:09:55.903943+0000","last_unstale":"2024-04-24T23:09:56.955766+0000","last_undegraded":"2024-04-24T23:09:56.955766+0000","last_fullsized":"2024-04-24T23:09:56.955766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933825+0000","last_change":"2024-04-24T23:09:56.927437+0000","last_active":"2024-04-24T23:09:56.933825+0000","last_peered":"2024-04-24T23:09:56.933825+0000","last_clean":"2024-04-24T23:09:56.933825+0000","last_became_active":"2024-04-24T23:09:56.927140+0000","last_became_peered":"2024-04-24T23:09:56.927140+0000","last_unstale":"2024-04-24T23:09:56.933825+0000","last_undegraded":"2024-04-24T23:09:56.933825+0000","last_fullsized":"2024-04-24T23:09:56.933825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953002+0000","last_change":"2024-04-24T23:09:55.906123+0000","last_active":"2024-04-24T23:09:56.953002+0000","last_peered":"2024-04-24T23:09:56.953002+0000","last_clean":"2024-04-24T23:09:56.953002+0000","last_became_active":"2024-04-24T23:09:55.905737+0000","last_became_peered":"2024-04-24T23:09:55.905737+0000","last_unstale":"2024-04-24T23:09:56.953002+0000","last_undegraded":"2024-04-24T23:09:56.953002+0000","last_fullsized":"2024-04-24T23:09:56.953002+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:38.938789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.934150+0000","last_change":"2024-04-24T23:09:56.927890+0000","last_active":"2024-04-24T23:09:56.934150+0000","last_peered":"2024-04-24T23:09:56.934150+0000","last_clean":"2024-04-24T23:09:56.934150+0000","last_became_active":"2024-04-24T23:09:56.927603+0000","last_became_peered":"2024-04-24T23:09:56.927603+0000","last_unstale":"2024-04-24T23:09:56.934150+0000","last_undegraded":"2024-04-24T23:09:56.934150+0000","last_fullsized":"2024-04-24T23:09:56.934150+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:01.841132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924687+0000","last_change":"2024-04-24T23:09:55.905608+0000","last_active":"2024-04-24T23:09:56.924687+0000","last_peered":"2024-04-24T23:09:56.924687+0000","last_clean":"2024-04-24T23:09:56.924687+0000","last_became_active":"2024-04-24T23:09:55.904448+0000","last_became_peered":"2024-04-24T23:09:55.904448+0000","last_unstale":"2024-04-24T23:09:56.924687+0000","last_undegraded":"2024-04-24T23:09:56.924687+0000","last_fullsized":"2024-04-24T23:09:56.924687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:20.397547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952525+0000","last_change":"2024-04-24T23:09:56.947148+0000","last_active":"2024-04-24T23:09:56.952525+0000","last_peered":"2024-04-24T23:09:56.952525+0000","last_clean":"2024-04-24T23:09:56.952525+0000","last_became_active":"2024-04-24T23:09:56.946870+0000","last_became_peered":"2024-04-24T23:09:56.946870+0000","last_unstale":"2024-04-24T23:09:56.952525+0000","last_undegraded":"2024-04-24T23:09:56.952525+0000","last_fullsized":"2024-04-24T23:09:56.952525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924073+0000","last_change":"2024-04-24T23:09:55.903305+0000","last_active":"2024-04-24T23:09:56.924073+0000","last_peered":"2024-04-24T23:09:56.924073+0000","last_clean":"2024-04-24T23:09:56.924073+0000","last_became_active":"2024-04-24T23:09:55.902795+0000","last_became_peered":"2024-04-24T23:09:55.902795+0000","last_unstale":"2024-04-24T23:09:56.924073+0000","last_undegraded":"2024-04-24T23:09:56.924073+0000","last_fullsized":"2024-04-24T23:09:56.924073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.876558+0000","last_change":"2024-04-24T23:09:55.876558+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.876558+0000","last_undegraded":"2024-04-24T23:09:55.876558+0000","last_fullsized":"2024-04-24T23:09:55.876558+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":20,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955864+0000","last_change":"2024-04-24T23:09:55.905976+0000","last_active":"2024-04-24T23:09:56.955864+0000","last_peered":"2024-04-24T23:09:56.955864+0000","last_clean":"2024-04-24T23:09:56.955864+0000","last_became_active":"2024-04-24T23:09:55.905574+0000","last_became_peered":"2024-04-24T23:09:55.905574+0000","last_unstale":"2024-04-24T23:09:56.955864+0000","last_undegraded":"2024-04-24T23:09:56.955864+0000","last_fullsized":"2024-04-24T23:09:56.955864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:05.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874856+0000","last_change":"2024-04-24T23:09:55.874856+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874856+0000","last_undegraded":"2024-04-24T23:09:55.874856+0000","last_fullsized":"2024-04-24T23:09:55.874856+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953278+0000","last_change":"2024-04-24T23:09:55.886430+0000","last_active":"2024-04-24T23:09:56.953278+0000","last_peered":"2024-04-24T23:09:56.953278+0000","last_clean":"2024-04-24T23:09:56.953278+0000","last_became_active":"2024-04-24T23:09:55.884169+0000","last_became_peered":"2024-04-24T23:09:55.884169+0000","last_unstale":"2024-04-24T23:09:56.953278+0000","last_undegraded":"2024-04-24T23:09:56.953278+0000","last_fullsized":"2024-04-24T23:09:56.953278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937512+0000","last_change":"2024-04-24T23:09:56.931170+0000","last_active":"2024-04-24T23:09:56.937512+0000","last_peered":"2024-04-24T23:09:56.937512+0000","last_clean":"2024-04-24T23:09:56.937512+0000","last_became_active":"2024-04-24T23:09:56.930874+0000","last_became_peered":"2024-04-24T23:09:56.930874+0000","last_unstale":"2024-04-24T23:09:56.937512+0000","last_undegraded":"2024-04-24T23:09:56.937512+0000","last_fullsized":"2024-04-24T23:09:56.937512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:05.428941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950150+0000","last_change":"2024-04-24T23:09:55.883074+0000","last_active":"2024-04-24T23:09:56.950150+0000","last_peered":"2024-04-24T23:09:56.950150+0000","last_clean":"2024-04-24T23:09:56.950150+0000","last_became_active":"2024-04-24T23:09:55.882760+0000","last_became_peered":"2024-04-24T23:09:55.882760+0000","last_unstale":"2024-04-24T23:09:56.950150+0000","last_undegraded":"2024-04-24T23:09:56.950150+0000","last_fullsized":"2024-04-24T23:09:56.950150+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:53.982280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935244+0000","last_change":"2024-04-24T23:09:56.928012+0000","last_active":"2024-04-24T23:09:56.935244+0000","last_peered":"2024-04-24T23:09:56.935244+0000","last_clean":"2024-04-24T23:09:56.935244+0000","last_became_active":"2024-04-24T23:09:56.927729+0000","last_became_peered":"2024-04-24T23:09:56.927729+0000","last_unstale":"2024-04-24T23:09:56.935244+0000","last_undegraded":"2024-04-24T23:09:56.935244+0000","last_fullsized":"2024-04-24T23:09:56.935244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:33.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949330+0000","last_change":"2024-04-24T23:09:55.880315+0000","last_active":"2024-04-24T23:09:56.949330+0000","last_peered":"2024-04-24T23:09:56.949330+0000","last_clean":"2024-04-24T23:09:56.949330+0000","last_became_active":"2024-04-24T23:09:55.880011+0000","last_became_peered":"2024-04-24T23:09:55.880011+0000","last_unstale":"2024-04-24T23:09:56.949330+0000","last_undegraded":"2024-04-24T23:09:56.949330+0000","last_fullsized":"2024-04-24T23:09:56.949330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:43.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943735+0000","last_change":"2024-04-24T23:09:56.930919+0000","last_active":"2024-04-24T23:09:56.943735+0000","last_peered":"2024-04-24T23:09:56.943735+0000","last_clean":"2024-04-24T23:09:56.943735+0000","last_became_active":"2024-04-24T23:09:56.930597+0000","last_became_peered":"2024-04-24T23:09:56.930597+0000","last_unstale":"2024-04-24T23:09:56.943735+0000","last_undegraded":"2024-04-24T23:09:56.943735+0000","last_fullsized":"2024-04-24T23:09:56.943735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:09.506531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955656+0000","last_change":"2024-04-24T23:09:55.905783+0000","last_active":"2024-04-24T23:09:56.955656+0000","last_peered":"2024-04-24T23:09:56.955656+0000","last_clean":"2024-04-24T23:09:56.955656+0000","last_became_active":"2024-04-24T23:09:55.905510+0000","last_became_peered":"2024-04-24T23:09:55.905510+0000","last_unstale":"2024-04-24T23:09:56.955656+0000","last_undegraded":"2024-04-24T23:09:56.955656+0000","last_fullsized":"2024-04-24T23:09:56.955656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:04.655556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943540+0000","last_change":"2024-04-24T23:09:56.942600+0000","last_active":"2024-04-24T23:09:56.943540+0000","last_peered":"2024-04-24T23:09:56.943540+0000","last_clean":"2024-04-24T23:09:56.943540+0000","last_became_active":"2024-04-24T23:09:56.941777+0000","last_became_peered":"2024-04-24T23:09:56.941777+0000","last_unstale":"2024-04-24T23:09:56.943540+0000","last_undegraded":"2024-04-24T23:09:56.943540+0000","last_fullsized":"2024-04-24T23:09:56.943540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.913506+0000","last_change":"2024-04-24T23:09:55.904339+0000","last_active":"2024-04-24T23:09:56.913506+0000","last_peered":"2024-04-24T23:09:56.913506+0000","last_clean":"2024-04-24T23:09:56.913506+0000","last_became_active":"2024-04-24T23:09:55.904059+0000","last_became_peered":"2024-04-24T23:09:55.904059+0000","last_unstale":"2024-04-24T23:09:56.913506+0000","last_undegraded":"2024-04-24T23:09:56.913506+0000","last_fullsized":"2024-04-24T23:09:56.913506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:49.851813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932089+0000","last_change":"2024-04-24T23:09:56.928338+0000","last_active":"2024-04-24T23:09:56.932089+0000","last_peered":"2024-04-24T23:09:56.932089+0000","last_clean":"2024-04-24T23:09:56.932089+0000","last_became_active":"2024-04-24T23:09:56.926921+0000","last_became_peered":"2024-04-24T23:09:56.926921+0000","last_unstale":"2024-04-24T23:09:56.932089+0000","last_undegraded":"2024-04-24T23:09:56.932089+0000","last_fullsized":"2024-04-24T23:09:56.932089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919267+0000","last_change":"2024-04-24T23:09:55.887859+0000","last_active":"2024-04-24T23:09:56.919267+0000","last_peered":"2024-04-24T23:09:56.919267+0000","last_clean":"2024-04-24T23:09:56.919267+0000","last_became_active":"2024-04-24T23:09:55.887578+0000","last_became_peered":"2024-04-24T23:09:55.887578+0000","last_unstale":"2024-04-24T23:09:56.919267+0000","last_undegraded":"2024-04-24T23:09:56.919267+0000","last_fullsized":"2024-04-24T23:09:56.919267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:12.436579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952491+0000","last_change":"2024-04-24T23:09:56.947213+0000","last_active":"2024-04-24T23:09:56.952491+0000","last_peered":"2024-04-24T23:09:56.952491+0000","last_clean":"2024-04-24T23:09:56.952491+0000","last_became_active":"2024-04-24T23:09:56.946885+0000","last_became_peered":"2024-04-24T23:09:56.946885+0000","last_unstale":"2024-04-24T23:09:56.952491+0000","last_undegraded":"2024-04-24T23:09:56.952491+0000","last_fullsized":"2024-04-24T23:09:56.952491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-24T23:09:55.894700+0000","last_change":"2024-04-24T23:09:55.891391+0000","last_active":"2024-04-24T23:09:55.894700+0000","last_peered":"2024-04-24T23:09:55.894700+0000","last_clean":"2024-04-24T23:09:55.894700+0000","last_became_active":"2024-04-24T23:09:55.889562+0000","last_became_peered":"2024-04-24T23:09:55.889562+0000","last_unstale":"2024-04-24T23:09:55.894700+0000","last_undegraded":"2024-04-24T23:09:55.894700+0000","last_fullsized":"2024-04-24T23:09:55.894700+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:26.495584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.927477+0000","last_change":"2024-04-24T23:09:56.921036+0000","last_active":"2024-04-24T23:09:56.927477+0000","last_peered":"2024-04-24T23:09:56.927477+0000","last_clean":"2024-04-24T23:09:56.927477+0000","last_became_active":"2024-04-24T23:09:56.920703+0000","last_became_peered":"2024-04-24T23:09:56.920703+0000","last_unstale":"2024-04-24T23:09:56.927477+0000","last_undegraded":"2024-04-24T23:09:56.927477+0000","last_fullsized":"2024-04-24T23:09:56.927477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953519+0000","last_change":"2024-04-24T23:09:55.885776+0000","last_active":"2024-04-24T23:09:56.953519+0000","last_peered":"2024-04-24T23:09:56.953519+0000","last_clean":"2024-04-24T23:09:56.953519+0000","last_became_active":"2024-04-24T23:09:55.884367+0000","last_became_peered":"2024-04-24T23:09:55.884367+0000","last_unstale":"2024-04-24T23:09:56.953519+0000","last_undegraded":"2024-04-24T23:09:56.953519+0000","last_fullsized":"2024-04-24T23:09:56.953519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:07.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.873938+0000","last_change":"2024-04-24T23:09:55.873938+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.873938+0000","last_undegraded":"2024-04-24T23:09:55.873938+0000","last_fullsized":"2024-04-24T23:09:55.873938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.926815+0000","last_change":"2024-04-24T23:09:55.872709+0000","last_active":"2024-04-24T23:09:56.926815+0000","last_peered":"2024-04-24T23:09:56.926815+0000","last_clean":"2024-04-24T23:09:56.926815+0000","last_became_active":"2024-04-24T23:09:55.872409+0000","last_became_peered":"2024-04-24T23:09:55.872409+0000","last_unstale":"2024-04-24T23:09:56.926815+0000","last_undegraded":"2024-04-24T23:09:56.926815+0000","last_fullsized":"2024-04-24T23:09:56.926815+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:38.852012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874147+0000","last_change":"2024-04-24T23:09:55.874147+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874147+0000","last_undegraded":"2024-04-24T23:09:55.874147+0000","last_fullsized":"2024-04-24T23:09:55.874147+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.915565+0000","last_change":"2024-04-24T23:09:55.899285+0000","last_active":"2024-04-24T23:09:56.915565+0000","last_peered":"2024-04-24T23:09:56.915565+0000","last_clean":"2024-04-24T23:09:56.915565+0000","last_became_active":"2024-04-24T23:09:55.899020+0000","last_became_peered":"2024-04-24T23:09:55.899020+0000","last_unstale":"2024-04-24T23:09:56.915565+0000","last_undegraded":"2024-04-24T23:09:56.915565+0000","last_fullsized":"2024-04-24T23:09:56.915565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935286+0000","last_change":"2024-04-24T23:09:56.928574+0000","last_active":"2024-04-24T23:09:56.935286+0000","last_peered":"2024-04-24T23:09:56.935286+0000","last_clean":"2024-04-24T23:09:56.935286+0000","last_became_active":"2024-04-24T23:09:56.927898+0000","last_became_peered":"2024-04-24T23:09:56.927898+0000","last_unstale":"2024-04-24T23:09:56.935286+0000","last_undegraded":"2024-04-24T23:09:56.935286+0000","last_fullsized":"2024-04-24T23:09:56.935286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:54.997795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.922565+0000","last_change":"2024-04-24T23:09:55.897509+0000","last_active":"2024-04-24T23:09:56.922565+0000","last_peered":"2024-04-24T23:09:56.922565+0000","last_clean":"2024-04-24T23:09:56.922565+0000","last_became_active":"2024-04-24T23:09:55.896981+0000","last_became_peered":"2024-04-24T23:09:55.896981+0000","last_unstale":"2024-04-24T23:09:56.922565+0000","last_undegraded":"2024-04-24T23:09:56.922565+0000","last_fullsized":"2024-04-24T23:09:56.922565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:27.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943712+0000","last_change":"2024-04-24T23:09:56.930569+0000","last_active":"2024-04-24T23:09:56.943712+0000","last_peered":"2024-04-24T23:09:56.943712+0000","last_clean":"2024-04-24T23:09:56.943712+0000","last_became_active":"2024-04-24T23:09:56.928323+0000","last_became_peered":"2024-04-24T23:09:56.928323+0000","last_unstale":"2024-04-24T23:09:56.943712+0000","last_undegraded":"2024-04-24T23:09:56.943712+0000","last_fullsized":"2024-04-24T23:09:56.943712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:33.076696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925658+0000","last_change":"2024-04-24T23:09:55.902928+0000","last_active":"2024-04-24T23:09:56.925658+0000","last_peered":"2024-04-24T23:09:56.925658+0000","last_clean":"2024-04-24T23:09:56.925658+0000","last_became_active":"2024-04-24T23:09:55.902393+0000","last_became_peered":"2024-04-24T23:09:55.902393+0000","last_unstale":"2024-04-24T23:09:56.925658+0000","last_undegraded":"2024-04-24T23:09:56.925658+0000","last_fullsized":"2024-04-24T23:09:56.925658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.285345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947313+0000","last_change":"2024-04-24T23:09:56.933724+0000","last_active":"2024-04-24T23:09:56.947313+0000","last_peered":"2024-04-24T23:09:56.947313+0000","last_clean":"2024-04-24T23:09:56.947313+0000","last_became_active":"2024-04-24T23:09:56.933457+0000","last_became_peered":"2024-04-24T23:09:56.933457+0000","last_unstale":"2024-04-24T23:09:56.947313+0000","last_undegraded":"2024-04-24T23:09:56.947313+0000","last_fullsized":"2024-04-24T23:09:56.947313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:01.896202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.899329+0000","last_change":"2024-04-24T23:09:55.878355+0000","last_active":"2024-04-24T23:09:56.899329+0000","last_peered":"2024-04-24T23:09:56.899329+0000","last_clean":"2024-04-24T23:09:56.899329+0000","last_became_active":"2024-04-24T23:09:55.877074+0000","last_became_peered":"2024-04-24T23:09:55.877074+0000","last_unstale":"2024-04-24T23:09:56.899329+0000","last_undegraded":"2024-04-24T23:09:56.899329+0000","last_fullsized":"2024-04-24T23:09:56.899329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:00.880687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.940512+0000","last_change":"2024-04-24T23:09:56.939521+0000","last_active":"2024-04-24T23:09:56.940512+0000","last_peered":"2024-04-24T23:09:56.940512+0000","last_clean":"2024-04-24T23:09:56.940512+0000","last_became_active":"2024-04-24T23:09:56.936959+0000","last_became_peered":"2024-04-24T23:09:56.936959+0000","last_unstale":"2024-04-24T23:09:56.940512+0000","last_undegraded":"2024-04-24T23:09:56.940512+0000","last_fullsized":"2024-04-24T23:09:56.940512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901862+0000","last_change":"2024-04-24T23:09:55.895704+0000","last_active":"2024-04-24T23:09:56.901862+0000","last_peered":"2024-04-24T23:09:56.901862+0000","last_clean":"2024-04-24T23:09:56.901862+0000","last_became_active":"2024-04-24T23:09:55.895351+0000","last_became_peered":"2024-04-24T23:09:55.895351+0000","last_unstale":"2024-04-24T23:09:56.901862+0000","last_undegraded":"2024-04-24T23:09:56.901862+0000","last_fullsized":"2024-04-24T23:09:56.901862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:39.281068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949211+0000","last_change":"2024-04-24T23:09:56.945238+0000","last_active":"2024-04-24T23:09:56.949211+0000","last_peered":"2024-04-24T23:09:56.949211+0000","last_clean":"2024-04-24T23:09:56.949211+0000","last_became_active":"2024-04-24T23:09:56.944093+0000","last_became_peered":"2024-04-24T23:09:56.944093+0000","last_unstale":"2024-04-24T23:09:56.949211+0000","last_undegraded":"2024-04-24T23:09:56.949211+0000","last_fullsized":"2024-04-24T23:09:56.949211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:56.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898863+0000","last_change":"2024-04-24T23:09:55.877706+0000","last_active":"2024-04-24T23:09:56.898863+0000","last_peered":"2024-04-24T23:09:56.898863+0000","last_clean":"2024-04-24T23:09:56.898863+0000","last_became_active":"2024-04-24T23:09:55.877145+0000","last_became_peered":"2024-04-24T23:09:55.877145+0000","last_unstale":"2024-04-24T23:09:56.898863+0000","last_undegraded":"2024-04-24T23:09:56.898863+0000","last_fullsized":"2024-04-24T23:09:56.898863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:23.501000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935247+0000","last_change":"2024-04-24T23:09:56.928920+0000","last_active":"2024-04-24T23:09:56.935247+0000","last_peered":"2024-04-24T23:09:56.935247+0000","last_clean":"2024-04-24T23:09:56.935247+0000","last_became_active":"2024-04-24T23:09:56.928293+0000","last_became_peered":"2024-04-24T23:09:56.928293+0000","last_unstale":"2024-04-24T23:09:56.935247+0000","last_undegraded":"2024-04-24T23:09:56.935247+0000","last_fullsized":"2024-04-24T23:09:56.935247+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919578+0000","last_change":"2024-04-24T23:09:55.903234+0000","last_active":"2024-04-24T23:09:56.919578+0000","last_peered":"2024-04-24T23:09:56.919578+0000","last_clean":"2024-04-24T23:09:56.919578+0000","last_became_active":"2024-04-24T23:09:55.900164+0000","last_became_peered":"2024-04-24T23:09:55.900164+0000","last_unstale":"2024-04-24T23:09:56.919578+0000","last_undegraded":"2024-04-24T23:09:56.919578+0000","last_fullsized":"2024-04-24T23:09:56.919578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":308,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898934+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:56.898934+0000","last_peered":"2024-04-24T23:09:56.898934+0000","last_clean":"2024-04-24T23:09:56.898934+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:56.898934+0000","last_undegraded":"2024-04-24T23:09:56.898934+0000","last_fullsized":"2024-04-24T23:09:56.898934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509566,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":523206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509566,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1171456,"data_stored":532097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":530977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509565,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":530443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542270,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:01.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.570+0000 7f756ea00640 1 Processor -- start 2024-04-24T23:10:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.570+0000 7f756ea00640 1 -- start start 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756ea00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75680b2dc0 0x7f756815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756ea00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75680d4bc0 con 0x7f75680d0ac0 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756ea00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f75680cf5b0 con 0x7f75680b2dc0 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75680d48e0 con 0x7f75680d06e0 2024-04-24T23:10:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.571+0000 7f756d600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756cc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75680b2dc0 0x7f756815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:43748/0 (socket says 172.21.15.146:43748) 2024-04-24T23:10:01.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 -- 172.21.15.146:0/2078745677 learned_addr learned my addr 172.21.15.146:0/2078745677 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 -- 172.21.15.146:0/2078745677 >> v2:172.21.15.203:3300/0 conn(0x7f75680b2dc0 msgr2=0x7f756815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 --2- 172.21.15.146:0/2078745677 >> v2:172.21.15.203:3300/0 conn(0x7f75680b2dc0 0x7f756815dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 -- 172.21.15.146:0/2078745677 >> v1:172.21.15.203:6789/0 conn(0x7f75680d0ac0 legacy=0x7f75680d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.572+0000 7f756d600640 1 -- 172.21.15.146:0/2078745677 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75680cf850 con 0x7f75680d06e0 2024-04-24T23:10:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.574+0000 7f756d600640 1 --2- 172.21.15.146:0/2078745677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aa6b00fc047d416 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.575+0000 7f7567e00640 1 -- 172.21.15.146:0/2078745677 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c037070 con 0x7f75680d06e0 2024-04-24T23:10:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.575+0000 7f7567e00640 1 -- 172.21.15.146:0/2078745677 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c032440 con 0x7f75680d06e0 2024-04-24T23:10:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.575+0000 7f7567e00640 1 -- 172.21.15.146:0/2078745677 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c032810 con 0x7f75680d06e0 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 -- 172.21.15.146:0/2078745677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 msgr2=0x7f75680b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 --2- 172.21.15.146:0/2078745677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02a250 comp rx=0 tx=0).stop 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 -- 172.21.15.146:0/2078745677 shutdown_connections 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 --2- 172.21.15.146:0/2078745677 >> v2:172.21.15.203:3300/0 conn(0x7f75680b2dc0 0x7f756815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 --2- 172.21.15.146:0/2078745677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680d06e0 0x7f75680b52d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 -- 172.21.15.146:0/2078745677 >> 172.21.15.146:0/2078745677 conn(0x7f75680d3d20 msgr2=0x7f75680d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 -- 172.21.15.146:0/2078745677 shutdown_connections 2024-04-24T23:10:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.576+0000 7f756ea00640 1 -- 172.21.15.146:0/2078745677 wait complete. 2024-04-24T23:10:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.578+0000 7f756ea00640 1 Processor -- start 2024-04-24T23:10:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.578+0000 7f756ea00640 1 -- start start 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680b2dc0 0x7f756815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 0x7f75680c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d2e40 con 0x7f75680d0ac0 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d2cc0 con 0x7f75680d06e0 2024-04-24T23:10:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75680b4460 con 0x7f75680b2dc0 2024-04-24T23:10:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37514/0 (socket says 172.21.15.146:37514) 2024-04-24T23:10:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756e000640 1 -- 172.21.15.146:0/1641324986 learned_addr learned my addr 172.21.15.146:0/1641324986 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.579+0000 7f756d600640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680b2dc0 0x7f756815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756cc00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 0x7f75680c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 -- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680b2dc0 msgr2=0x7f756815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680b2dc0 0x7f756815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 -- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 msgr2=0x7f75680c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 0x7f75680c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 -- 172.21.15.146:0/1641324986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756815b800 con 0x7f75680d0ac0 2024-04-24T23:10:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756cc00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 0x7f75680c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756e000640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f756000c6b0 tx=0x7f756000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560003b70 con 0x7f75680d0ac0 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7560003d30 con 0x7f75680d0ac0 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560005310 con 0x7f75680d0ac0 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756815cc20 con 0x7f75680d0ac0 2024-04-24T23:10:01.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.580+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756815d1e0 con 0x7f75680d0ac0 2024-04-24T23:10:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.582+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756804f500 con 0x7f75680d0ac0 2024-04-24T23:10:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.583+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75600054b0 con 0x7f75680d0ac0 2024-04-24T23:10:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.584+0000 7f7565600640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.584+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f756008af40 con 0x7f75680d0ac0 2024-04-24T23:10:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.584+0000 7f756d600640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.586+0000 7f756d600640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 0x7f754806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f755c034000 tx=0x7f755c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:01.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.588+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f75600596c0 con 0x7f75680d0ac0 2024-04-24T23:10:01.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.786+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f756815d830 con 0x7f754806be30 2024-04-24T23:10:01.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.804+0000 7f7565600640 1 -- 172.21.15.146:0/1641324986 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251448 (secure 0 0 0) 0x7f756815d830 con 0x7f754806be30 2024-04-24T23:10:01.810 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:01.811 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:01.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 msgr2=0x7f754806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 0x7f754806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f755c034000 tx=0x7f755c02e000 comp rx=0 tx=0).stop 2024-04-24T23:10:01.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 msgr2=0x7f75680c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f756000c6b0 tx=0x7f756000cb70 comp rx=0 tx=0).stop 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 shutdown_connections 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75680d0ac0 0x7f75680c7d90 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75680d06e0 0x7f75680c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 --2- 172.21.15.146:0/1641324986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75680b2dc0 0x7f756815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.809+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 >> 172.21.15.146:0/1641324986 conn(0x7f75680d3d20 msgr2=0x7f75680cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.810+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 shutdown_connections 2024-04-24T23:10:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:01.810+0000 7f756ea00640 1 -- 172.21.15.146:0/1641324986 wait complete. 2024-04-24T23:10:01.830 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2024-04-24T23:09:59.815938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259608,"kb_used_data":10148,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715112,"statfs":{"total":773094113280,"available":772828274688,"internally_reserved":0,"allocated":10391552,"data_stored":5404617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960765"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946727+0000","last_change":"2024-04-24T23:09:56.940409+0000","last_active":"2024-04-24T23:09:56.946727+0000","last_peered":"2024-04-24T23:09:56.946727+0000","last_clean":"2024-04-24T23:09:56.946727+0000","last_became_active":"2024-04-24T23:09:56.940129+0000","last_became_peered":"2024-04-24T23:09:56.940129+0000","last_unstale":"2024-04-24T23:09:56.946727+0000","last_undegraded":"2024-04-24T23:09:56.946727+0000","last_fullsized":"2024-04-24T23:09:56.946727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925255+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.925255+0000","last_peered":"2024-04-24T23:09:56.925255+0000","last_clean":"2024-04-24T23:09:56.925255+0000","last_became_active":"2024-04-24T23:09:56.917999+0000","last_became_peered":"2024-04-24T23:09:56.917999+0000","last_unstale":"2024-04-24T23:09:56.925255+0000","last_undegraded":"2024-04-24T23:09:56.925255+0000","last_fullsized":"2024-04-24T23:09:56.925255+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:13.452094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945404+0000","last_change":"2024-04-24T23:09:56.924994+0000","last_active":"2024-04-24T23:09:56.945404+0000","last_peered":"2024-04-24T23:09:56.945404+0000","last_clean":"2024-04-24T23:09:56.945404+0000","last_became_active":"2024-04-24T23:09:56.921828+0000","last_became_peered":"2024-04-24T23:09:56.921828+0000","last_unstale":"2024-04-24T23:09:56.945404+0000","last_undegraded":"2024-04-24T23:09:56.945404+0000","last_fullsized":"2024-04-24T23:09:56.945404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:36.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946983+0000","last_change":"2024-04-24T23:09:56.932969+0000","last_active":"2024-04-24T23:09:56.946983+0000","last_peered":"2024-04-24T23:09:56.946983+0000","last_clean":"2024-04-24T23:09:56.946983+0000","last_became_active":"2024-04-24T23:09:56.932433+0000","last_became_peered":"2024-04-24T23:09:56.932433+0000","last_unstale":"2024-04-24T23:09:56.946983+0000","last_undegraded":"2024-04-24T23:09:56.946983+0000","last_fullsized":"2024-04-24T23:09:56.946983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:24.516515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937107+0000","last_change":"2024-04-24T23:09:56.933631+0000","last_active":"2024-04-24T23:09:56.937107+0000","last_peered":"2024-04-24T23:09:56.937107+0000","last_clean":"2024-04-24T23:09:56.937107+0000","last_became_active":"2024-04-24T23:09:56.932689+0000","last_became_peered":"2024-04-24T23:09:56.932689+0000","last_unstale":"2024-04-24T23:09:56.937107+0000","last_undegraded":"2024-04-24T23:09:56.937107+0000","last_fullsized":"2024-04-24T23:09:56.937107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946339+0000","last_change":"2024-04-24T23:09:56.939868+0000","last_active":"2024-04-24T23:09:56.946339+0000","last_peered":"2024-04-24T23:09:56.946339+0000","last_clean":"2024-04-24T23:09:56.946339+0000","last_became_active":"2024-04-24T23:09:56.939581+0000","last_became_peered":"2024-04-24T23:09:56.939581+0000","last_unstale":"2024-04-24T23:09:56.946339+0000","last_undegraded":"2024-04-24T23:09:56.946339+0000","last_fullsized":"2024-04-24T23:09:56.946339+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:50.677141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952631+0000","last_change":"2024-04-24T23:09:56.949125+0000","last_active":"2024-04-24T23:09:56.952631+0000","last_peered":"2024-04-24T23:09:56.952631+0000","last_clean":"2024-04-24T23:09:56.952631+0000","last_became_active":"2024-04-24T23:09:56.948828+0000","last_became_peered":"2024-04-24T23:09:56.948828+0000","last_unstale":"2024-04-24T23:09:56.952631+0000","last_undegraded":"2024-04-24T23:09:56.952631+0000","last_fullsized":"2024-04-24T23:09:56.952631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:02.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938647+0000","last_change":"2024-04-24T23:09:56.927536+0000","last_active":"2024-04-24T23:09:56.938647+0000","last_peered":"2024-04-24T23:09:56.938647+0000","last_clean":"2024-04-24T23:09:56.938647+0000","last_became_active":"2024-04-24T23:09:56.926961+0000","last_became_peered":"2024-04-24T23:09:56.926961+0000","last_unstale":"2024-04-24T23:09:56.938647+0000","last_undegraded":"2024-04-24T23:09:56.938647+0000","last_fullsized":"2024-04-24T23:09:56.938647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:25.403855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938149+0000","last_change":"2024-04-24T23:09:56.936517+0000","last_active":"2024-04-24T23:09:56.938149+0000","last_peered":"2024-04-24T23:09:56.938149+0000","last_clean":"2024-04-24T23:09:56.938149+0000","last_became_active":"2024-04-24T23:09:56.936129+0000","last_became_peered":"2024-04-24T23:09:56.936129+0000","last_unstale":"2024-04-24T23:09:56.938149+0000","last_undegraded":"2024-04-24T23:09:56.938149+0000","last_fullsized":"2024-04-24T23:09:56.938149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:46.003977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945923+0000","last_change":"2024-04-24T23:09:56.928806+0000","last_active":"2024-04-24T23:09:56.945923+0000","last_peered":"2024-04-24T23:09:56.945923+0000","last_clean":"2024-04-24T23:09:56.945923+0000","last_became_active":"2024-04-24T23:09:56.925611+0000","last_became_peered":"2024-04-24T23:09:56.925611+0000","last_unstale":"2024-04-24T23:09:56.945923+0000","last_undegraded":"2024-04-24T23:09:56.945923+0000","last_fullsized":"2024-04-24T23:09:56.945923+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:55.912721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952132+0000","last_change":"2024-04-24T23:09:56.950003+0000","last_active":"2024-04-24T23:09:56.952132+0000","last_peered":"2024-04-24T23:09:56.952132+0000","last_clean":"2024-04-24T23:09:56.952132+0000","last_became_active":"2024-04-24T23:09:56.949677+0000","last_became_peered":"2024-04-24T23:09:56.949677+0000","last_unstale":"2024-04-24T23:09:56.952132+0000","last_undegraded":"2024-04-24T23:09:56.952132+0000","last_fullsized":"2024-04-24T23:09:56.952132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:27:59.773669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947104+0000","last_change":"2024-04-24T23:09:56.941322+0000","last_active":"2024-04-24T23:09:56.947104+0000","last_peered":"2024-04-24T23:09:56.947104+0000","last_clean":"2024-04-24T23:09:56.947104+0000","last_became_active":"2024-04-24T23:09:56.941057+0000","last_became_peered":"2024-04-24T23:09:56.941057+0000","last_unstale":"2024-04-24T23:09:56.947104+0000","last_undegraded":"2024-04-24T23:09:56.947104+0000","last_fullsized":"2024-04-24T23:09:56.947104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:34.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.877695+0000","last_change":"2024-04-24T23:09:55.877695+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.877695+0000","last_undegraded":"2024-04-24T23:09:55.877695+0000","last_fullsized":"2024-04-24T23:09:55.877695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949645+0000","last_change":"2024-04-24T23:09:56.946705+0000","last_active":"2024-04-24T23:09:56.949645+0000","last_peered":"2024-04-24T23:09:56.949645+0000","last_clean":"2024-04-24T23:09:56.949645+0000","last_became_active":"2024-04-24T23:09:56.946427+0000","last_became_peered":"2024-04-24T23:09:56.946427+0000","last_unstale":"2024-04-24T23:09:56.949645+0000","last_undegraded":"2024-04-24T23:09:56.949645+0000","last_fullsized":"2024-04-24T23:09:56.949645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947290+0000","last_change":"2024-04-24T23:09:56.931525+0000","last_active":"2024-04-24T23:09:56.947290+0000","last_peered":"2024-04-24T23:09:56.947290+0000","last_clean":"2024-04-24T23:09:56.947290+0000","last_became_active":"2024-04-24T23:09:56.925661+0000","last_became_peered":"2024-04-24T23:09:56.925661+0000","last_unstale":"2024-04-24T23:09:56.947290+0000","last_undegraded":"2024-04-24T23:09:56.947290+0000","last_fullsized":"2024-04-24T23:09:56.947290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:00.260147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932106+0000","last_change":"2024-04-24T23:09:56.919116+0000","last_active":"2024-04-24T23:09:56.932106+0000","last_peered":"2024-04-24T23:09:56.932106+0000","last_clean":"2024-04-24T23:09:56.932106+0000","last_became_active":"2024-04-24T23:09:56.918824+0000","last_became_peered":"2024-04-24T23:09:56.918824+0000","last_unstale":"2024-04-24T23:09:56.932106+0000","last_undegraded":"2024-04-24T23:09:56.932106+0000","last_fullsized":"2024-04-24T23:09:56.932106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:46.503606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949070+0000","last_change":"2024-04-24T23:09:56.944906+0000","last_active":"2024-04-24T23:09:56.949070+0000","last_peered":"2024-04-24T23:09:56.949070+0000","last_clean":"2024-04-24T23:09:56.949070+0000","last_became_active":"2024-04-24T23:09:56.944626+0000","last_became_peered":"2024-04-24T23:09:56.944626+0000","last_unstale":"2024-04-24T23:09:56.949070+0000","last_undegraded":"2024-04-24T23:09:56.949070+0000","last_fullsized":"2024-04-24T23:09:56.949070+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:28.600192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947065+0000","last_change":"2024-04-24T23:09:56.925763+0000","last_active":"2024-04-24T23:09:56.947065+0000","last_peered":"2024-04-24T23:09:56.947065+0000","last_clean":"2024-04-24T23:09:56.947065+0000","last_became_active":"2024-04-24T23:09:56.925443+0000","last_became_peered":"2024-04-24T23:09:56.925443+0000","last_unstale":"2024-04-24T23:09:56.947065+0000","last_undegraded":"2024-04-24T23:09:56.947065+0000","last_fullsized":"2024-04-24T23:09:56.947065+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:42.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935106+0000","last_change":"2024-04-24T23:09:56.930342+0000","last_active":"2024-04-24T23:09:56.935106+0000","last_peered":"2024-04-24T23:09:56.935106+0000","last_clean":"2024-04-24T23:09:56.935106+0000","last_became_active":"2024-04-24T23:09:56.929614+0000","last_became_peered":"2024-04-24T23:09:56.929614+0000","last_unstale":"2024-04-24T23:09:56.935106+0000","last_undegraded":"2024-04-24T23:09:56.935106+0000","last_fullsized":"2024-04-24T23:09:56.935106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946212+0000","last_change":"2024-04-24T23:09:56.941593+0000","last_active":"2024-04-24T23:09:56.946212+0000","last_peered":"2024-04-24T23:09:56.946212+0000","last_clean":"2024-04-24T23:09:56.946212+0000","last_became_active":"2024-04-24T23:09:56.939699+0000","last_became_peered":"2024-04-24T23:09:56.939699+0000","last_unstale":"2024-04-24T23:09:56.946212+0000","last_undegraded":"2024-04-24T23:09:56.946212+0000","last_fullsized":"2024-04-24T23:09:56.946212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:57.844085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937154+0000","last_change":"2024-04-24T23:09:56.934769+0000","last_active":"2024-04-24T23:09:56.937154+0000","last_peered":"2024-04-24T23:09:56.937154+0000","last_clean":"2024-04-24T23:09:56.937154+0000","last_became_active":"2024-04-24T23:09:56.933079+0000","last_became_peered":"2024-04-24T23:09:56.933079+0000","last_unstale":"2024-04-24T23:09:56.937154+0000","last_undegraded":"2024-04-24T23:09:56.937154+0000","last_fullsized":"2024-04-24T23:09:56.937154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.929291+0000","last_change":"2024-04-24T23:09:56.927450+0000","last_active":"2024-04-24T23:09:56.929291+0000","last_peered":"2024-04-24T23:09:56.929291+0000","last_clean":"2024-04-24T23:09:56.929291+0000","last_became_active":"2024-04-24T23:09:56.927016+0000","last_became_peered":"2024-04-24T23:09:56.927016+0000","last_unstale":"2024-04-24T23:09:56.929291+0000","last_undegraded":"2024-04-24T23:09:56.929291+0000","last_fullsized":"2024-04-24T23:09:56.929291+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937104+0000","last_change":"2024-04-24T23:09:56.933202+0000","last_active":"2024-04-24T23:09:56.937104+0000","last_peered":"2024-04-24T23:09:56.937104+0000","last_clean":"2024-04-24T23:09:56.937104+0000","last_became_active":"2024-04-24T23:09:56.932903+0000","last_became_peered":"2024-04-24T23:09:56.932903+0000","last_unstale":"2024-04-24T23:09:56.937104+0000","last_undegraded":"2024-04-24T23:09:56.937104+0000","last_fullsized":"2024-04-24T23:09:56.937104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:19.829265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933845+0000","last_change":"2024-04-24T23:09:56.927531+0000","last_active":"2024-04-24T23:09:56.933845+0000","last_peered":"2024-04-24T23:09:56.933845+0000","last_clean":"2024-04-24T23:09:56.933845+0000","last_became_active":"2024-04-24T23:09:56.927243+0000","last_became_peered":"2024-04-24T23:09:56.927243+0000","last_unstale":"2024-04-24T23:09:56.933845+0000","last_undegraded":"2024-04-24T23:09:56.933845+0000","last_fullsized":"2024-04-24T23:09:56.933845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.928096+0000","last_change":"2024-04-24T23:09:56.925843+0000","last_active":"2024-04-24T23:09:56.928096+0000","last_peered":"2024-04-24T23:09:56.928096+0000","last_clean":"2024-04-24T23:09:56.928096+0000","last_became_active":"2024-04-24T23:09:56.925556+0000","last_became_peered":"2024-04-24T23:09:56.925556+0000","last_unstale":"2024-04-24T23:09:56.928096+0000","last_undegraded":"2024-04-24T23:09:56.928096+0000","last_fullsized":"2024-04-24T23:09:56.928096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:44.189224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.920681+0000","last_change":"2024-04-24T23:09:56.915444+0000","last_active":"2024-04-24T23:09:56.920681+0000","last_peered":"2024-04-24T23:09:56.920681+0000","last_clean":"2024-04-24T23:09:56.920681+0000","last_became_active":"2024-04-24T23:09:56.914704+0000","last_became_peered":"2024-04-24T23:09:56.914704+0000","last_unstale":"2024-04-24T23:09:56.920681+0000","last_undegraded":"2024-04-24T23:09:56.920681+0000","last_fullsized":"2024-04-24T23:09:56.920681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:45.239398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945435+0000","last_change":"2024-04-24T23:09:56.925404+0000","last_active":"2024-04-24T23:09:56.945435+0000","last_peered":"2024-04-24T23:09:56.945435+0000","last_clean":"2024-04-24T23:09:56.945435+0000","last_became_active":"2024-04-24T23:09:56.925111+0000","last_became_peered":"2024-04-24T23:09:56.925111+0000","last_unstale":"2024-04-24T23:09:56.945435+0000","last_undegraded":"2024-04-24T23:09:56.945435+0000","last_fullsized":"2024-04-24T23:09:56.945435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:31.210094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.876587+0000","last_change":"2024-04-24T23:09:55.876587+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.876587+0000","last_undegraded":"2024-04-24T23:09:55.876587+0000","last_fullsized":"2024-04-24T23:09:55.876587+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937132+0000","last_change":"2024-04-24T23:09:56.933867+0000","last_active":"2024-04-24T23:09:56.937132+0000","last_peered":"2024-04-24T23:09:56.937132+0000","last_clean":"2024-04-24T23:09:56.937132+0000","last_became_active":"2024-04-24T23:09:56.933359+0000","last_became_peered":"2024-04-24T23:09:56.933359+0000","last_unstale":"2024-04-24T23:09:56.937132+0000","last_undegraded":"2024-04-24T23:09:56.937132+0000","last_fullsized":"2024-04-24T23:09:56.937132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936138+0000","last_change":"2024-04-24T23:09:56.931228+0000","last_active":"2024-04-24T23:09:56.936138+0000","last_peered":"2024-04-24T23:09:56.936138+0000","last_clean":"2024-04-24T23:09:56.936138+0000","last_became_active":"2024-04-24T23:09:56.930831+0000","last_became_peered":"2024-04-24T23:09:56.930831+0000","last_unstale":"2024-04-24T23:09:56.936138+0000","last_undegraded":"2024-04-24T23:09:56.936138+0000","last_fullsized":"2024-04-24T23:09:56.936138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936036+0000","last_change":"2024-04-24T23:09:56.932993+0000","last_active":"2024-04-24T23:09:56.936036+0000","last_peered":"2024-04-24T23:09:56.936036+0000","last_clean":"2024-04-24T23:09:56.936036+0000","last_became_active":"2024-04-24T23:09:56.932707+0000","last_became_peered":"2024-04-24T23:09:56.932707+0000","last_unstale":"2024-04-24T23:09:56.936036+0000","last_undegraded":"2024-04-24T23:09:56.936036+0000","last_fullsized":"2024-04-24T23:09:56.936036+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.930748+0000","last_change":"2024-04-24T23:09:56.917318+0000","last_active":"2024-04-24T23:09:56.930748+0000","last_peered":"2024-04-24T23:09:56.930748+0000","last_clean":"2024-04-24T23:09:56.930748+0000","last_became_active":"2024-04-24T23:09:56.916979+0000","last_became_peered":"2024-04-24T23:09:56.916979+0000","last_unstale":"2024-04-24T23:09:56.930748+0000","last_undegraded":"2024-04-24T23:09:56.930748+0000","last_fullsized":"2024-04-24T23:09:56.930748+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.944480+0000","last_change":"2024-04-24T23:09:56.935573+0000","last_active":"2024-04-24T23:09:56.944480+0000","last_peered":"2024-04-24T23:09:56.944480+0000","last_clean":"2024-04-24T23:09:56.944480+0000","last_became_active":"2024-04-24T23:09:56.935267+0000","last_became_peered":"2024-04-24T23:09:56.935267+0000","last_unstale":"2024-04-24T23:09:56.944480+0000","last_undegraded":"2024-04-24T23:09:56.944480+0000","last_fullsized":"2024-04-24T23:09:56.944480+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950958+0000","last_change":"2024-04-24T23:09:55.878169+0000","last_active":"2024-04-24T23:09:56.950958+0000","last_peered":"2024-04-24T23:09:56.950958+0000","last_clean":"2024-04-24T23:09:56.950958+0000","last_became_active":"2024-04-24T23:09:55.877826+0000","last_became_peered":"2024-04-24T23:09:55.877826+0000","last_unstale":"2024-04-24T23:09:56.950958+0000","last_undegraded":"2024-04-24T23:09:56.950958+0000","last_fullsized":"2024-04-24T23:09:56.950958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:29.372680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946413+0000","last_change":"2024-04-24T23:09:56.942471+0000","last_active":"2024-04-24T23:09:56.946413+0000","last_peered":"2024-04-24T23:09:56.946413+0000","last_clean":"2024-04-24T23:09:56.946413+0000","last_became_active":"2024-04-24T23:09:56.942154+0000","last_became_peered":"2024-04-24T23:09:56.942154+0000","last_unstale":"2024-04-24T23:09:56.946413+0000","last_undegraded":"2024-04-24T23:09:56.946413+0000","last_fullsized":"2024-04-24T23:09:56.946413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:05.671071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953281+0000","last_change":"2024-04-24T23:09:55.885462+0000","last_active":"2024-04-24T23:09:56.953281+0000","last_peered":"2024-04-24T23:09:56.953281+0000","last_clean":"2024-04-24T23:09:56.953281+0000","last_became_active":"2024-04-24T23:09:55.885156+0000","last_became_peered":"2024-04-24T23:09:55.885156+0000","last_unstale":"2024-04-24T23:09:56.953281+0000","last_undegraded":"2024-04-24T23:09:56.953281+0000","last_fullsized":"2024-04-24T23:09:56.953281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:32.759204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.948053+0000","last_change":"2024-04-24T23:09:56.945032+0000","last_active":"2024-04-24T23:09:56.948053+0000","last_peered":"2024-04-24T23:09:56.948053+0000","last_clean":"2024-04-24T23:09:56.948053+0000","last_became_active":"2024-04-24T23:09:56.944757+0000","last_became_peered":"2024-04-24T23:09:56.944757+0000","last_unstale":"2024-04-24T23:09:56.948053+0000","last_undegraded":"2024-04-24T23:09:56.948053+0000","last_fullsized":"2024-04-24T23:09:56.948053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:16.993406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953127+0000","last_change":"2024-04-24T23:09:55.901246+0000","last_active":"2024-04-24T23:09:56.953127+0000","last_peered":"2024-04-24T23:09:56.953127+0000","last_clean":"2024-04-24T23:09:56.953127+0000","last_became_active":"2024-04-24T23:09:55.900510+0000","last_became_peered":"2024-04-24T23:09:55.900510+0000","last_unstale":"2024-04-24T23:09:56.953127+0000","last_undegraded":"2024-04-24T23:09:56.953127+0000","last_fullsized":"2024-04-24T23:09:56.953127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:33.972115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942803+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.942803+0000","last_peered":"2024-04-24T23:09:56.942803+0000","last_clean":"2024-04-24T23:09:56.942803+0000","last_became_active":"2024-04-24T23:09:56.920155+0000","last_became_peered":"2024-04-24T23:09:56.920155+0000","last_unstale":"2024-04-24T23:09:56.942803+0000","last_undegraded":"2024-04-24T23:09:56.942803+0000","last_fullsized":"2024-04-24T23:09:56.942803+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:28.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955535+0000","last_change":"2024-04-24T23:09:55.888998+0000","last_active":"2024-04-24T23:09:56.955535+0000","last_peered":"2024-04-24T23:09:56.955535+0000","last_clean":"2024-04-24T23:09:56.955535+0000","last_became_active":"2024-04-24T23:09:55.888687+0000","last_became_peered":"2024-04-24T23:09:55.888687+0000","last_unstale":"2024-04-24T23:09:56.955535+0000","last_undegraded":"2024-04-24T23:09:56.955535+0000","last_fullsized":"2024-04-24T23:09:56.955535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.825617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874832+0000","last_change":"2024-04-24T23:09:55.874832+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874832+0000","last_undegraded":"2024-04-24T23:09:55.874832+0000","last_fullsized":"2024-04-24T23:09:55.874832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952882+0000","last_change":"2024-04-24T23:09:55.895038+0000","last_active":"2024-04-24T23:09:56.952882+0000","last_peered":"2024-04-24T23:09:56.952882+0000","last_clean":"2024-04-24T23:09:56.952882+0000","last_became_active":"2024-04-24T23:09:55.894708+0000","last_became_peered":"2024-04-24T23:09:55.894708+0000","last_unstale":"2024-04-24T23:09:56.952882+0000","last_undegraded":"2024-04-24T23:09:56.952882+0000","last_fullsized":"2024-04-24T23:09:56.952882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952187+0000","last_change":"2024-04-24T23:09:56.950756+0000","last_active":"2024-04-24T23:09:56.952187+0000","last_peered":"2024-04-24T23:09:56.952187+0000","last_clean":"2024-04-24T23:09:56.952187+0000","last_became_active":"2024-04-24T23:09:56.950487+0000","last_became_peered":"2024-04-24T23:09:56.950487+0000","last_unstale":"2024-04-24T23:09:56.952187+0000","last_undegraded":"2024-04-24T23:09:56.952187+0000","last_fullsized":"2024-04-24T23:09:56.952187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-24T23:09:55.904512+0000","last_change":"2024-04-24T23:09:55.902440+0000","last_active":"2024-04-24T23:09:55.904512+0000","last_peered":"2024-04-24T23:09:55.904512+0000","last_clean":"2024-04-24T23:09:55.904512+0000","last_became_active":"2024-04-24T23:09:55.901950+0000","last_became_peered":"2024-04-24T23:09:55.901950+0000","last_unstale":"2024-04-24T23:09:55.904512+0000","last_undegraded":"2024-04-24T23:09:55.904512+0000","last_fullsized":"2024-04-24T23:09:55.904512+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:26.947931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941364+0000","last_change":"2024-04-24T23:09:56.935846+0000","last_active":"2024-04-24T23:09:56.941364+0000","last_peered":"2024-04-24T23:09:56.941364+0000","last_clean":"2024-04-24T23:09:56.941364+0000","last_became_active":"2024-04-24T23:09:56.935571+0000","last_became_peered":"2024-04-24T23:09:56.935571+0000","last_unstale":"2024-04-24T23:09:56.941364+0000","last_undegraded":"2024-04-24T23:09:56.941364+0000","last_fullsized":"2024-04-24T23:09:56.941364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:32:59.681587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.906824+0000","last_change":"2024-04-24T23:09:55.899264+0000","last_active":"2024-04-24T23:09:56.906824+0000","last_peered":"2024-04-24T23:09:56.906824+0000","last_clean":"2024-04-24T23:09:56.906824+0000","last_became_active":"2024-04-24T23:09:55.898514+0000","last_became_peered":"2024-04-24T23:09:55.898514+0000","last_unstale":"2024-04-24T23:09:56.906824+0000","last_undegraded":"2024-04-24T23:09:56.906824+0000","last_fullsized":"2024-04-24T23:09:56.906824+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:24.586695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937832+0000","last_change":"2024-04-24T23:09:56.931992+0000","last_active":"2024-04-24T23:09:56.937832+0000","last_peered":"2024-04-24T23:09:56.937832+0000","last_clean":"2024-04-24T23:09:56.937832+0000","last_became_active":"2024-04-24T23:09:56.931619+0000","last_became_peered":"2024-04-24T23:09:56.931619+0000","last_unstale":"2024-04-24T23:09:56.937832+0000","last_undegraded":"2024-04-24T23:09:56.937832+0000","last_fullsized":"2024-04-24T23:09:56.937832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898773+0000","last_change":"2024-04-24T23:09:55.897787+0000","last_active":"2024-04-24T23:09:56.898773+0000","last_peered":"2024-04-24T23:09:56.898773+0000","last_clean":"2024-04-24T23:09:56.898773+0000","last_became_active":"2024-04-24T23:09:55.897129+0000","last_became_peered":"2024-04-24T23:09:55.897129+0000","last_unstale":"2024-04-24T23:09:56.898773+0000","last_undegraded":"2024-04-24T23:09:56.898773+0000","last_fullsized":"2024-04-24T23:09:56.898773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:59.244632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941212+0000","last_change":"2024-04-24T23:09:56.940662+0000","last_active":"2024-04-24T23:09:56.941212+0000","last_peered":"2024-04-24T23:09:56.941212+0000","last_clean":"2024-04-24T23:09:56.941212+0000","last_became_active":"2024-04-24T23:09:56.940303+0000","last_became_peered":"2024-04-24T23:09:56.940303+0000","last_unstale":"2024-04-24T23:09:56.941212+0000","last_undegraded":"2024-04-24T23:09:56.941212+0000","last_fullsized":"2024-04-24T23:09:56.941212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901961+0000","last_change":"2024-04-24T23:09:55.901003+0000","last_active":"2024-04-24T23:09:56.901961+0000","last_peered":"2024-04-24T23:09:56.901961+0000","last_clean":"2024-04-24T23:09:56.901961+0000","last_became_active":"2024-04-24T23:09:55.900616+0000","last_became_peered":"2024-04-24T23:09:55.900616+0000","last_unstale":"2024-04-24T23:09:56.901961+0000","last_undegraded":"2024-04-24T23:09:56.901961+0000","last_fullsized":"2024-04-24T23:09:56.901961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:41.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935853+0000","last_change":"2024-04-24T23:09:56.929324+0000","last_active":"2024-04-24T23:09:56.935853+0000","last_peered":"2024-04-24T23:09:56.935853+0000","last_clean":"2024-04-24T23:09:56.935853+0000","last_became_active":"2024-04-24T23:09:56.928972+0000","last_became_peered":"2024-04-24T23:09:56.928972+0000","last_unstale":"2024-04-24T23:09:56.935853+0000","last_undegraded":"2024-04-24T23:09:56.935853+0000","last_fullsized":"2024-04-24T23:09:56.935853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:20.967828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.909826+0000","last_change":"2024-04-24T23:09:55.897350+0000","last_active":"2024-04-24T23:09:56.909826+0000","last_peered":"2024-04-24T23:09:56.909826+0000","last_clean":"2024-04-24T23:09:56.909826+0000","last_became_active":"2024-04-24T23:09:55.896165+0000","last_became_peered":"2024-04-24T23:09:55.896165+0000","last_unstale":"2024-04-24T23:09:56.909826+0000","last_undegraded":"2024-04-24T23:09:56.909826+0000","last_fullsized":"2024-04-24T23:09:56.909826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:39.578060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942948+0000","last_change":"2024-04-24T23:09:56.937575+0000","last_active":"2024-04-24T23:09:56.942948+0000","last_peered":"2024-04-24T23:09:56.942948+0000","last_clean":"2024-04-24T23:09:56.942948+0000","last_became_active":"2024-04-24T23:09:56.936720+0000","last_became_peered":"2024-04-24T23:09:56.936720+0000","last_unstale":"2024-04-24T23:09:56.942948+0000","last_undegraded":"2024-04-24T23:09:56.942948+0000","last_fullsized":"2024-04-24T23:09:56.942948+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955776+0000","last_change":"2024-04-24T23:09:55.900879+0000","last_active":"2024-04-24T23:09:56.955776+0000","last_peered":"2024-04-24T23:09:56.955776+0000","last_clean":"2024-04-24T23:09:56.955776+0000","last_became_active":"2024-04-24T23:09:55.900538+0000","last_became_peered":"2024-04-24T23:09:55.900538+0000","last_unstale":"2024-04-24T23:09:56.955776+0000","last_undegraded":"2024-04-24T23:09:56.955776+0000","last_fullsized":"2024-04-24T23:09:56.955776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:55.974696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941176+0000","last_change":"2024-04-24T23:09:56.929691+0000","last_active":"2024-04-24T23:09:56.941176+0000","last_peered":"2024-04-24T23:09:56.941176+0000","last_clean":"2024-04-24T23:09:56.941176+0000","last_became_active":"2024-04-24T23:09:56.928870+0000","last_became_peered":"2024-04-24T23:09:56.928870+0000","last_unstale":"2024-04-24T23:09:56.941176+0000","last_undegraded":"2024-04-24T23:09:56.941176+0000","last_fullsized":"2024-04-24T23:09:56.941176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:10.293838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955766+0000","last_change":"2024-04-24T23:09:55.904255+0000","last_active":"2024-04-24T23:09:56.955766+0000","last_peered":"2024-04-24T23:09:56.955766+0000","last_clean":"2024-04-24T23:09:56.955766+0000","last_became_active":"2024-04-24T23:09:55.903943+0000","last_became_peered":"2024-04-24T23:09:55.903943+0000","last_unstale":"2024-04-24T23:09:56.955766+0000","last_undegraded":"2024-04-24T23:09:56.955766+0000","last_fullsized":"2024-04-24T23:09:56.955766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933825+0000","last_change":"2024-04-24T23:09:56.927437+0000","last_active":"2024-04-24T23:09:56.933825+0000","last_peered":"2024-04-24T23:09:56.933825+0000","last_clean":"2024-04-24T23:09:56.933825+0000","last_became_active":"2024-04-24T23:09:56.927140+0000","last_became_peered":"2024-04-24T23:09:56.927140+0000","last_unstale":"2024-04-24T23:09:56.933825+0000","last_undegraded":"2024-04-24T23:09:56.933825+0000","last_fullsized":"2024-04-24T23:09:56.933825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953002+0000","last_change":"2024-04-24T23:09:55.906123+0000","last_active":"2024-04-24T23:09:56.953002+0000","last_peered":"2024-04-24T23:09:56.953002+0000","last_clean":"2024-04-24T23:09:56.953002+0000","last_became_active":"2024-04-24T23:09:55.905737+0000","last_became_peered":"2024-04-24T23:09:55.905737+0000","last_unstale":"2024-04-24T23:09:56.953002+0000","last_undegraded":"2024-04-24T23:09:56.953002+0000","last_fullsized":"2024-04-24T23:09:56.953002+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:38.938789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.934150+0000","last_change":"2024-04-24T23:09:56.927890+0000","last_active":"2024-04-24T23:09:56.934150+0000","last_peered":"2024-04-24T23:09:56.934150+0000","last_clean":"2024-04-24T23:09:56.934150+0000","last_became_active":"2024-04-24T23:09:56.927603+0000","last_became_peered":"2024-04-24T23:09:56.927603+0000","last_unstale":"2024-04-24T23:09:56.934150+0000","last_undegraded":"2024-04-24T23:09:56.934150+0000","last_fullsized":"2024-04-24T23:09:56.934150+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:01.841132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924687+0000","last_change":"2024-04-24T23:09:55.905608+0000","last_active":"2024-04-24T23:09:56.924687+0000","last_peered":"2024-04-24T23:09:56.924687+0000","last_clean":"2024-04-24T23:09:56.924687+0000","last_became_active":"2024-04-24T23:09:55.904448+0000","last_became_peered":"2024-04-24T23:09:55.904448+0000","last_unstale":"2024-04-24T23:09:56.924687+0000","last_undegraded":"2024-04-24T23:09:56.924687+0000","last_fullsized":"2024-04-24T23:09:56.924687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:20.397547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952525+0000","last_change":"2024-04-24T23:09:56.947148+0000","last_active":"2024-04-24T23:09:56.952525+0000","last_peered":"2024-04-24T23:09:56.952525+0000","last_clean":"2024-04-24T23:09:56.952525+0000","last_became_active":"2024-04-24T23:09:56.946870+0000","last_became_peered":"2024-04-24T23:09:56.946870+0000","last_unstale":"2024-04-24T23:09:56.952525+0000","last_undegraded":"2024-04-24T23:09:56.952525+0000","last_fullsized":"2024-04-24T23:09:56.952525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924073+0000","last_change":"2024-04-24T23:09:55.903305+0000","last_active":"2024-04-24T23:09:56.924073+0000","last_peered":"2024-04-24T23:09:56.924073+0000","last_clean":"2024-04-24T23:09:56.924073+0000","last_became_active":"2024-04-24T23:09:55.902795+0000","last_became_peered":"2024-04-24T23:09:55.902795+0000","last_unstale":"2024-04-24T23:09:56.924073+0000","last_undegraded":"2024-04-24T23:09:56.924073+0000","last_fullsized":"2024-04-24T23:09:56.924073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.876558+0000","last_change":"2024-04-24T23:09:55.876558+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.876558+0000","last_undegraded":"2024-04-24T23:09:55.876558+0000","last_fullsized":"2024-04-24T23:09:55.876558+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":20,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955864+0000","last_change":"2024-04-24T23:09:55.905976+0000","last_active":"2024-04-24T23:09:56.955864+0000","last_peered":"2024-04-24T23:09:56.955864+0000","last_clean":"2024-04-24T23:09:56.955864+0000","last_became_active":"2024-04-24T23:09:55.905574+0000","last_became_peered":"2024-04-24T23:09:55.905574+0000","last_unstale":"2024-04-24T23:09:56.955864+0000","last_undegraded":"2024-04-24T23:09:56.955864+0000","last_fullsized":"2024-04-24T23:09:56.955864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:05.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874856+0000","last_change":"2024-04-24T23:09:55.874856+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874856+0000","last_undegraded":"2024-04-24T23:09:55.874856+0000","last_fullsized":"2024-04-24T23:09:55.874856+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953278+0000","last_change":"2024-04-24T23:09:55.886430+0000","last_active":"2024-04-24T23:09:56.953278+0000","last_peered":"2024-04-24T23:09:56.953278+0000","last_clean":"2024-04-24T23:09:56.953278+0000","last_became_active":"2024-04-24T23:09:55.884169+0000","last_became_peered":"2024-04-24T23:09:55.884169+0000","last_unstale":"2024-04-24T23:09:56.953278+0000","last_undegraded":"2024-04-24T23:09:56.953278+0000","last_fullsized":"2024-04-24T23:09:56.953278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937512+0000","last_change":"2024-04-24T23:09:56.931170+0000","last_active":"2024-04-24T23:09:56.937512+0000","last_peered":"2024-04-24T23:09:56.937512+0000","last_clean":"2024-04-24T23:09:56.937512+0000","last_became_active":"2024-04-24T23:09:56.930874+0000","last_became_peered":"2024-04-24T23:09:56.930874+0000","last_unstale":"2024-04-24T23:09:56.937512+0000","last_undegraded":"2024-04-24T23:09:56.937512+0000","last_fullsized":"2024-04-24T23:09:56.937512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:05.428941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950150+0000","last_change":"2024-04-24T23:09:55.883074+0000","last_active":"2024-04-24T23:09:56.950150+0000","last_peered":"2024-04-24T23:09:56.950150+0000","last_clean":"2024-04-24T23:09:56.950150+0000","last_became_active":"2024-04-24T23:09:55.882760+0000","last_became_peered":"2024-04-24T23:09:55.882760+0000","last_unstale":"2024-04-24T23:09:56.950150+0000","last_undegraded":"2024-04-24T23:09:56.950150+0000","last_fullsized":"2024-04-24T23:09:56.950150+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:53.982280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935244+0000","last_change":"2024-04-24T23:09:56.928012+0000","last_active":"2024-04-24T23:09:56.935244+0000","last_peered":"2024-04-24T23:09:56.935244+0000","last_clean":"2024-04-24T23:09:56.935244+0000","last_became_active":"2024-04-24T23:09:56.927729+0000","last_became_peered":"2024-04-24T23:09:56.927729+0000","last_unstale":"2024-04-24T23:09:56.935244+0000","last_undegraded":"2024-04-24T23:09:56.935244+0000","last_fullsized":"2024-04-24T23:09:56.935244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:33.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949330+0000","last_change":"2024-04-24T23:09:55.880315+0000","last_active":"2024-04-24T23:09:56.949330+0000","last_peered":"2024-04-24T23:09:56.949330+0000","last_clean":"2024-04-24T23:09:56.949330+0000","last_became_active":"2024-04-24T23:09:55.880011+0000","last_became_peered":"2024-04-24T23:09:55.880011+0000","last_unstale":"2024-04-24T23:09:56.949330+0000","last_undegraded":"2024-04-24T23:09:56.949330+0000","last_fullsized":"2024-04-24T23:09:56.949330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:43.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943735+0000","last_change":"2024-04-24T23:09:56.930919+0000","last_active":"2024-04-24T23:09:56.943735+0000","last_peered":"2024-04-24T23:09:56.943735+0000","last_clean":"2024-04-24T23:09:56.943735+0000","last_became_active":"2024-04-24T23:09:56.930597+0000","last_became_peered":"2024-04-24T23:09:56.930597+0000","last_unstale":"2024-04-24T23:09:56.943735+0000","last_undegraded":"2024-04-24T23:09:56.943735+0000","last_fullsized":"2024-04-24T23:09:56.943735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:09.506531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955656+0000","last_change":"2024-04-24T23:09:55.905783+0000","last_active":"2024-04-24T23:09:56.955656+0000","last_peered":"2024-04-24T23:09:56.955656+0000","last_clean":"2024-04-24T23:09:56.955656+0000","last_became_active":"2024-04-24T23:09:55.905510+0000","last_became_peered":"2024-04-24T23:09:55.905510+0000","last_unstale":"2024-04-24T23:09:56.955656+0000","last_undegraded":"2024-04-24T23:09:56.955656+0000","last_fullsized":"2024-04-24T23:09:56.955656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:04.655556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943540+0000","last_change":"2024-04-24T23:09:56.942600+0000","last_active":"2024-04-24T23:09:56.943540+0000","last_peered":"2024-04-24T23:09:56.943540+0000","last_clean":"2024-04-24T23:09:56.943540+0000","last_became_active":"2024-04-24T23:09:56.941777+0000","last_became_peered":"2024-04-24T23:09:56.941777+0000","last_unstale":"2024-04-24T23:09:56.943540+0000","last_undegraded":"2024-04-24T23:09:56.943540+0000","last_fullsized":"2024-04-24T23:09:56.943540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.913506+0000","last_change":"2024-04-24T23:09:55.904339+0000","last_active":"2024-04-24T23:09:56.913506+0000","last_peered":"2024-04-24T23:09:56.913506+0000","last_clean":"2024-04-24T23:09:56.913506+0000","last_became_active":"2024-04-24T23:09:55.904059+0000","last_became_peered":"2024-04-24T23:09:55.904059+0000","last_unstale":"2024-04-24T23:09:56.913506+0000","last_undegraded":"2024-04-24T23:09:56.913506+0000","last_fullsized":"2024-04-24T23:09:56.913506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:49.851813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932089+0000","last_change":"2024-04-24T23:09:56.928338+0000","last_active":"2024-04-24T23:09:56.932089+0000","last_peered":"2024-04-24T23:09:56.932089+0000","last_clean":"2024-04-24T23:09:56.932089+0000","last_became_active":"2024-04-24T23:09:56.926921+0000","last_became_peered":"2024-04-24T23:09:56.926921+0000","last_unstale":"2024-04-24T23:09:56.932089+0000","last_undegraded":"2024-04-24T23:09:56.932089+0000","last_fullsized":"2024-04-24T23:09:56.932089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919267+0000","last_change":"2024-04-24T23:09:55.887859+0000","last_active":"2024-04-24T23:09:56.919267+0000","last_peered":"2024-04-24T23:09:56.919267+0000","last_clean":"2024-04-24T23:09:56.919267+0000","last_became_active":"2024-04-24T23:09:55.887578+0000","last_became_peered":"2024-04-24T23:09:55.887578+0000","last_unstale":"2024-04-24T23:09:56.919267+0000","last_undegraded":"2024-04-24T23:09:56.919267+0000","last_fullsized":"2024-04-24T23:09:56.919267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:12.436579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952491+0000","last_change":"2024-04-24T23:09:56.947213+0000","last_active":"2024-04-24T23:09:56.952491+0000","last_peered":"2024-04-24T23:09:56.952491+0000","last_clean":"2024-04-24T23:09:56.952491+0000","last_became_active":"2024-04-24T23:09:56.946885+0000","last_became_peered":"2024-04-24T23:09:56.946885+0000","last_unstale":"2024-04-24T23:09:56.952491+0000","last_undegraded":"2024-04-24T23:09:56.952491+0000","last_fullsized":"2024-04-24T23:09:56.952491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-24T23:09:55.894700+0000","last_change":"2024-04-24T23:09:55.891391+0000","last_active":"2024-04-24T23:09:55.894700+0000","last_peered":"2024-04-24T23:09:55.894700+0000","last_clean":"2024-04-24T23:09:55.894700+0000","last_became_active":"2024-04-24T23:09:55.889562+0000","last_became_peered":"2024-04-24T23:09:55.889562+0000","last_unstale":"2024-04-24T23:09:55.894700+0000","last_undegraded":"2024-04-24T23:09:55.894700+0000","last_fullsized":"2024-04-24T23:09:55.894700+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:26.495584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.927477+0000","last_change":"2024-04-24T23:09:56.921036+0000","last_active":"2024-04-24T23:09:56.927477+0000","last_peered":"2024-04-24T23:09:56.927477+0000","last_clean":"2024-04-24T23:09:56.927477+0000","last_became_active":"2024-04-24T23:09:56.920703+0000","last_became_peered":"2024-04-24T23:09:56.920703+0000","last_unstale":"2024-04-24T23:09:56.927477+0000","last_undegraded":"2024-04-24T23:09:56.927477+0000","last_fullsized":"2024-04-24T23:09:56.927477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953519+0000","last_change":"2024-04-24T23:09:55.885776+0000","last_active":"2024-04-24T23:09:56.953519+0000","last_peered":"2024-04-24T23:09:56.953519+0000","last_clean":"2024-04-24T23:09:56.953519+0000","last_became_active":"2024-04-24T23:09:55.884367+0000","last_became_peered":"2024-04-24T23:09:55.884367+0000","last_unstale":"2024-04-24T23:09:56.953519+0000","last_undegraded":"2024-04-24T23:09:56.953519+0000","last_fullsized":"2024-04-24T23:09:56.953519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:07.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.873938+0000","last_change":"2024-04-24T23:09:55.873938+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.873938+0000","last_undegraded":"2024-04-24T23:09:55.873938+0000","last_fullsized":"2024-04-24T23:09:55.873938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.926815+0000","last_change":"2024-04-24T23:09:55.872709+0000","last_active":"2024-04-24T23:09:56.926815+0000","last_peered":"2024-04-24T23:09:56.926815+0000","last_clean":"2024-04-24T23:09:56.926815+0000","last_became_active":"2024-04-24T23:09:55.872409+0000","last_became_peered":"2024-04-24T23:09:55.872409+0000","last_unstale":"2024-04-24T23:09:56.926815+0000","last_undegraded":"2024-04-24T23:09:56.926815+0000","last_fullsized":"2024-04-24T23:09:56.926815+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:38.852012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-04-24T23:09:55.874147+0000","last_change":"2024-04-24T23:09:55.874147+0000","last_active":"2024-04-24T23:09:55.851649+0000","last_peered":"2024-04-24T23:09:55.851649+0000","last_clean":"2024-04-24T23:09:55.851649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-24T23:09:55.874147+0000","last_undegraded":"2024-04-24T23:09:55.874147+0000","last_fullsized":"2024-04-24T23:09:55.874147+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.915565+0000","last_change":"2024-04-24T23:09:55.899285+0000","last_active":"2024-04-24T23:09:56.915565+0000","last_peered":"2024-04-24T23:09:56.915565+0000","last_clean":"2024-04-24T23:09:56.915565+0000","last_became_active":"2024-04-24T23:09:55.899020+0000","last_became_peered":"2024-04-24T23:09:55.899020+0000","last_unstale":"2024-04-24T23:09:56.915565+0000","last_undegraded":"2024-04-24T23:09:56.915565+0000","last_fullsized":"2024-04-24T23:09:56.915565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935286+0000","last_change":"2024-04-24T23:09:56.928574+0000","last_active":"2024-04-24T23:09:56.935286+0000","last_peered":"2024-04-24T23:09:56.935286+0000","last_clean":"2024-04-24T23:09:56.935286+0000","last_became_active":"2024-04-24T23:09:56.927898+0000","last_became_peered":"2024-04-24T23:09:56.927898+0000","last_unstale":"2024-04-24T23:09:56.935286+0000","last_undegraded":"2024-04-24T23:09:56.935286+0000","last_fullsized":"2024-04-24T23:09:56.935286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:54.997795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.922565+0000","last_change":"2024-04-24T23:09:55.897509+0000","last_active":"2024-04-24T23:09:56.922565+0000","last_peered":"2024-04-24T23:09:56.922565+0000","last_clean":"2024-04-24T23:09:56.922565+0000","last_became_active":"2024-04-24T23:09:55.896981+0000","last_became_peered":"2024-04-24T23:09:55.896981+0000","last_unstale":"2024-04-24T23:09:56.922565+0000","last_undegraded":"2024-04-24T23:09:56.922565+0000","last_fullsized":"2024-04-24T23:09:56.922565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:27.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943712+0000","last_change":"2024-04-24T23:09:56.930569+0000","last_active":"2024-04-24T23:09:56.943712+0000","last_peered":"2024-04-24T23:09:56.943712+0000","last_clean":"2024-04-24T23:09:56.943712+0000","last_became_active":"2024-04-24T23:09:56.928323+0000","last_became_peered":"2024-04-24T23:09:56.928323+0000","last_unstale":"2024-04-24T23:09:56.943712+0000","last_undegraded":"2024-04-24T23:09:56.943712+0000","last_fullsized":"2024-04-24T23:09:56.943712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:33.076696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925658+0000","last_change":"2024-04-24T23:09:55.902928+0000","last_active":"2024-04-24T23:09:56.925658+0000","last_peered":"2024-04-24T23:09:56.925658+0000","last_clean":"2024-04-24T23:09:56.925658+0000","last_became_active":"2024-04-24T23:09:55.902393+0000","last_became_peered":"2024-04-24T23:09:55.902393+0000","last_unstale":"2024-04-24T23:09:56.925658+0000","last_undegraded":"2024-04-24T23:09:56.925658+0000","last_fullsized":"2024-04-24T23:09:56.925658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.285345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947313+0000","last_change":"2024-04-24T23:09:56.933724+0000","last_active":"2024-04-24T23:09:56.947313+0000","last_peered":"2024-04-24T23:09:56.947313+0000","last_clean":"2024-04-24T23:09:56.947313+0000","last_became_active":"2024-04-24T23:09:56.933457+0000","last_became_peered":"2024-04-24T23:09:56.933457+0000","last_unstale":"2024-04-24T23:09:56.947313+0000","last_undegraded":"2024-04-24T23:09:56.947313+0000","last_fullsized":"2024-04-24T23:09:56.947313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:01.896202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.899329+0000","last_change":"2024-04-24T23:09:55.878355+0000","last_active":"2024-04-24T23:09:56.899329+0000","last_peered":"2024-04-24T23:09:56.899329+0000","last_clean":"2024-04-24T23:09:56.899329+0000","last_became_active":"2024-04-24T23:09:55.877074+0000","last_became_peered":"2024-04-24T23:09:55.877074+0000","last_unstale":"2024-04-24T23:09:56.899329+0000","last_undegraded":"2024-04-24T23:09:56.899329+0000","last_fullsized":"2024-04-24T23:09:56.899329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:00.880687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.940512+0000","last_change":"2024-04-24T23:09:56.939521+0000","last_active":"2024-04-24T23:09:56.940512+0000","last_peered":"2024-04-24T23:09:56.940512+0000","last_clean":"2024-04-24T23:09:56.940512+0000","last_became_active":"2024-04-24T23:09:56.936959+0000","last_became_peered":"2024-04-24T23:09:56.936959+0000","last_unstale":"2024-04-24T23:09:56.940512+0000","last_undegraded":"2024-04-24T23:09:56.940512+0000","last_fullsized":"2024-04-24T23:09:56.940512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901862+0000","last_change":"2024-04-24T23:09:55.895704+0000","last_active":"2024-04-24T23:09:56.901862+0000","last_peered":"2024-04-24T23:09:56.901862+0000","last_clean":"2024-04-24T23:09:56.901862+0000","last_became_active":"2024-04-24T23:09:55.895351+0000","last_became_peered":"2024-04-24T23:09:55.895351+0000","last_unstale":"2024-04-24T23:09:56.901862+0000","last_undegraded":"2024-04-24T23:09:56.901862+0000","last_fullsized":"2024-04-24T23:09:56.901862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:39.281068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949211+0000","last_change":"2024-04-24T23:09:56.945238+0000","last_active":"2024-04-24T23:09:56.949211+0000","last_peered":"2024-04-24T23:09:56.949211+0000","last_clean":"2024-04-24T23:09:56.949211+0000","last_became_active":"2024-04-24T23:09:56.944093+0000","last_became_peered":"2024-04-24T23:09:56.944093+0000","last_unstale":"2024-04-24T23:09:56.949211+0000","last_undegraded":"2024-04-24T23:09:56.949211+0000","last_fullsized":"2024-04-24T23:09:56.949211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:56.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898863+0000","last_change":"2024-04-24T23:09:55.877706+0000","last_active":"2024-04-24T23:09:56.898863+0000","last_peered":"2024-04-24T23:09:56.898863+0000","last_clean":"2024-04-24T23:09:56.898863+0000","last_became_active":"2024-04-24T23:09:55.877145+0000","last_became_peered":"2024-04-24T23:09:55.877145+0000","last_unstale":"2024-04-24T23:09:56.898863+0000","last_undegraded":"2024-04-24T23:09:56.898863+0000","last_fullsized":"2024-04-24T23:09:56.898863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:23.501000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935247+0000","last_change":"2024-04-24T23:09:56.928920+0000","last_active":"2024-04-24T23:09:56.935247+0000","last_peered":"2024-04-24T23:09:56.935247+0000","last_clean":"2024-04-24T23:09:56.935247+0000","last_became_active":"2024-04-24T23:09:56.928293+0000","last_became_peered":"2024-04-24T23:09:56.928293+0000","last_unstale":"2024-04-24T23:09:56.935247+0000","last_undegraded":"2024-04-24T23:09:56.935247+0000","last_fullsized":"2024-04-24T23:09:56.935247+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919578+0000","last_change":"2024-04-24T23:09:55.903234+0000","last_active":"2024-04-24T23:09:56.919578+0000","last_peered":"2024-04-24T23:09:56.919578+0000","last_clean":"2024-04-24T23:09:56.919578+0000","last_became_active":"2024-04-24T23:09:55.900164+0000","last_became_peered":"2024-04-24T23:09:55.900164+0000","last_unstale":"2024-04-24T23:09:56.919578+0000","last_undegraded":"2024-04-24T23:09:56.919578+0000","last_fullsized":"2024-04-24T23:09:56.919578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":308,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898934+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:56.898934+0000","last_peered":"2024-04-24T23:09:56.898934+0000","last_clean":"2024-04-24T23:09:56.898934+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:56.898934+0000","last_undegraded":"2024-04-24T23:09:56.898934+0000","last_fullsized":"2024-04-24T23:09:56.898934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509566,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":523206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509566,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1171456,"data_stored":532097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":530977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509565,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":530443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542270,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:01.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.074+0000 7f9c16000640 1 Processor -- start 2024-04-24T23:10:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.074+0000 7f9c16000640 1 -- start start 2024-04-24T23:10:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c10145640 0x7f9c1015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9c100b2a20 0x7f9c100cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c1006cbc0 0x7f9c100d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100cdf70 con 0x7f9c1006cbc0 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1015d360 con 0x7f9c100b2a20 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c16000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9c10145a20 con 0x7f9c10145640 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c1006cbc0 0x7f9c100d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c1006cbc0 0x7f9c100d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37520/0 (socket says 172.21.15.146:37520) 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 -- 172.21.15.146:0/1249870917 learned_addr learned my addr 172.21.15.146:0/1249870917 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0f400640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c10145640 0x7f9c1015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c06a00640 1 --2- 172.21.15.146:0/1249870917 >> v2:172.21.15.203:3300/0 conn(0x7f9c100b2a20 0x7f9c100cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 -- 172.21.15.146:0/1249870917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c10145640 msgr2=0x7f9c1015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c10145640 0x7f9c1015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 -- 172.21.15.146:0/1249870917 >> v2:172.21.15.203:3300/0 conn(0x7f9c100b2a20 msgr2=0x7f9c100cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 --2- 172.21.15.146:0/1249870917 >> v2:172.21.15.203:3300/0 conn(0x7f9c100b2a20 0x7f9c100cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.076+0000 7f9c0fe00640 1 -- 172.21.15.146:0/1249870917 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1006d140 con 0x7f9c1006cbc0 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.077+0000 7f9c0fe00640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c1006cbc0 0x7f9c100d01d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f9c10072f60 tx=0x7f9c0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ce431143f5168 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.077+0000 7f9c0ea00640 1 -- 172.21.15.146:0/1249870917 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08036070 con 0x7f9c1006cbc0 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.077+0000 7f9c0ea00640 1 -- 172.21.15.146:0/1249870917 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c08031600 con 0x7f9c1006cbc0 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.077+0000 7f9c0ea00640 1 -- 172.21.15.146:0/1249870917 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c080319d0 con 0x7f9c1006cbc0 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 -- 172.21.15.146:0/1249870917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c1006cbc0 msgr2=0x7f9c100d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c1006cbc0 0x7f9c100d01d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f9c10072f60 tx=0x7f9c0802a6a0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 -- 172.21.15.146:0/1249870917 shutdown_connections 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c1006cbc0 0x7f9c100d01d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 --2- 172.21.15.146:0/1249870917 >> v2:172.21.15.203:3300/0 conn(0x7f9c100b2a20 0x7f9c100cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 --2- 172.21.15.146:0/1249870917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c10145640 0x7f9c1015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 -- 172.21.15.146:0/1249870917 >> 172.21.15.146:0/1249870917 conn(0x7f9c1006b320 msgr2=0x7f9c1006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 -- 172.21.15.146:0/1249870917 shutdown_connections 2024-04-24T23:10:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.078+0000 7f9c16000640 1 -- 172.21.15.146:0/1249870917 wait complete. 2024-04-24T23:10:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.080+0000 7f9c16000640 1 Processor -- start 2024-04-24T23:10:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.080+0000 7f9c16000640 1 -- start start 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c1006cbc0 0x7f9c10138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c10145640 0x7f9c10140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1006d9e0 con 0x7f9c100b2a20 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1006d700 con 0x7f9c10145640 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c16000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1015f9c0 con 0x7f9c1006cbc0 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37522/0 (socket says 172.21.15.146:37522) 2024-04-24T23:10:02.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 -- 172.21.15.146:0/2547734469 learned_addr learned my addr 172.21.15.146:0/2547734469 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:02.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c0f400640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c1006cbc0 0x7f9c10138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 -- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c1006cbc0 msgr2=0x7f9c10138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c1006cbc0 0x7f9c10138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 -- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c10145640 msgr2=0x7f9c10140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c10145640 0x7f9c10140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.081+0000 7f9c06a00640 1 -- 172.21.15.146:0/2547734469 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101389b0 con 0x7f9c100b2a20 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c06a00640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800d800 tx=0x7f9bf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8018020 con 0x7f9c100b2a20 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf80096a0 con 0x7f9c100b2a20 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8009a70 con 0x7f9c100b2a20 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1015a4d0 con 0x7f9c100b2a20 2024-04-24T23:10:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.082+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1015aa50 con 0x7f9c100b2a20 2024-04-24T23:10:02.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.083+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10068190 con 0x7f9c100b2a20 2024-04-24T23:10:02.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.084+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bf801b020 con 0x7f9c100b2a20 2024-04-24T23:10:02.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.085+0000 7f9c07e00640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.085+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f9bf808b270 con 0x7f9c100b2a20 2024-04-24T23:10:02.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.086+0000 7f9c0f400640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.087+0000 7f9c0f400640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 0x7f9bec06e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.089+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9bf8022030 con 0x7f9c100b2a20 2024-04-24T23:10:02.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.284+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c100adb10 con 0x7f9bec06be30 2024-04-24T23:10:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.302+0000 7f9c07e00640 1 -- 172.21.15.146:0/2547734469 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252019 (secure 0 0 0) 0x7f9c100adb10 con 0x7f9bec06be30 2024-04-24T23:10:02.309 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 msgr2=0x7f9bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 0x7f9bec06e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00008040 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 msgr2=0x7f9c1013ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800d800 tx=0x7f9bf800dcc0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 shutdown_connections 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c10145640 0x7f9c10140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c100b2a20 0x7f9c1013ff30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 --2- 172.21.15.146:0/2547734469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9c1006cbc0 0x7f9c10138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 >> 172.21.15.146:0/2547734469 conn(0x7f9c1006b320 msgr2=0x7f9c100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 shutdown_connections 2024-04-24T23:10:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.309+0000 7f9c16000640 1 -- 172.21.15.146:0/2547734469 wait complete. 2024-04-24T23:10:02.329 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-04-24T23:10:01.816593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259640,"kb_used_data":10172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715080,"statfs":{"total":773094113280,"available":772828241920,"internally_reserved":0,"allocated":10416128,"data_stored":5418476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002215"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946727+0000","last_change":"2024-04-24T23:09:56.940409+0000","last_active":"2024-04-24T23:09:56.946727+0000","last_peered":"2024-04-24T23:09:56.946727+0000","last_clean":"2024-04-24T23:09:56.946727+0000","last_became_active":"2024-04-24T23:09:56.940129+0000","last_became_peered":"2024-04-24T23:09:56.940129+0000","last_unstale":"2024-04-24T23:09:56.946727+0000","last_undegraded":"2024-04-24T23:09:56.946727+0000","last_fullsized":"2024-04-24T23:09:56.946727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925255+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.925255+0000","last_peered":"2024-04-24T23:09:56.925255+0000","last_clean":"2024-04-24T23:09:56.925255+0000","last_became_active":"2024-04-24T23:09:56.917999+0000","last_became_peered":"2024-04-24T23:09:56.917999+0000","last_unstale":"2024-04-24T23:09:56.925255+0000","last_undegraded":"2024-04-24T23:09:56.925255+0000","last_fullsized":"2024-04-24T23:09:56.925255+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:13.452094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945404+0000","last_change":"2024-04-24T23:09:56.924994+0000","last_active":"2024-04-24T23:09:56.945404+0000","last_peered":"2024-04-24T23:09:56.945404+0000","last_clean":"2024-04-24T23:09:56.945404+0000","last_became_active":"2024-04-24T23:09:56.921828+0000","last_became_peered":"2024-04-24T23:09:56.921828+0000","last_unstale":"2024-04-24T23:09:56.945404+0000","last_undegraded":"2024-04-24T23:09:56.945404+0000","last_fullsized":"2024-04-24T23:09:56.945404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:36.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946983+0000","last_change":"2024-04-24T23:09:56.932969+0000","last_active":"2024-04-24T23:09:56.946983+0000","last_peered":"2024-04-24T23:09:56.946983+0000","last_clean":"2024-04-24T23:09:56.946983+0000","last_became_active":"2024-04-24T23:09:56.932433+0000","last_became_peered":"2024-04-24T23:09:56.932433+0000","last_unstale":"2024-04-24T23:09:56.946983+0000","last_undegraded":"2024-04-24T23:09:56.946983+0000","last_fullsized":"2024-04-24T23:09:56.946983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:24.516515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937107+0000","last_change":"2024-04-24T23:09:56.933631+0000","last_active":"2024-04-24T23:09:56.937107+0000","last_peered":"2024-04-24T23:09:56.937107+0000","last_clean":"2024-04-24T23:09:56.937107+0000","last_became_active":"2024-04-24T23:09:56.932689+0000","last_became_peered":"2024-04-24T23:09:56.932689+0000","last_unstale":"2024-04-24T23:09:56.937107+0000","last_undegraded":"2024-04-24T23:09:56.937107+0000","last_fullsized":"2024-04-24T23:09:56.937107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946339+0000","last_change":"2024-04-24T23:09:56.939868+0000","last_active":"2024-04-24T23:09:56.946339+0000","last_peered":"2024-04-24T23:09:56.946339+0000","last_clean":"2024-04-24T23:09:56.946339+0000","last_became_active":"2024-04-24T23:09:56.939581+0000","last_became_peered":"2024-04-24T23:09:56.939581+0000","last_unstale":"2024-04-24T23:09:56.946339+0000","last_undegraded":"2024-04-24T23:09:56.946339+0000","last_fullsized":"2024-04-24T23:09:56.946339+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:50.677141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952631+0000","last_change":"2024-04-24T23:09:56.949125+0000","last_active":"2024-04-24T23:09:56.952631+0000","last_peered":"2024-04-24T23:09:56.952631+0000","last_clean":"2024-04-24T23:09:56.952631+0000","last_became_active":"2024-04-24T23:09:56.948828+0000","last_became_peered":"2024-04-24T23:09:56.948828+0000","last_unstale":"2024-04-24T23:09:56.952631+0000","last_undegraded":"2024-04-24T23:09:56.952631+0000","last_fullsized":"2024-04-24T23:09:56.952631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:02.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938647+0000","last_change":"2024-04-24T23:09:56.927536+0000","last_active":"2024-04-24T23:09:56.938647+0000","last_peered":"2024-04-24T23:09:56.938647+0000","last_clean":"2024-04-24T23:09:56.938647+0000","last_became_active":"2024-04-24T23:09:56.926961+0000","last_became_peered":"2024-04-24T23:09:56.926961+0000","last_unstale":"2024-04-24T23:09:56.938647+0000","last_undegraded":"2024-04-24T23:09:56.938647+0000","last_fullsized":"2024-04-24T23:09:56.938647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:25.403855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938149+0000","last_change":"2024-04-24T23:09:56.936517+0000","last_active":"2024-04-24T23:09:56.938149+0000","last_peered":"2024-04-24T23:09:56.938149+0000","last_clean":"2024-04-24T23:09:56.938149+0000","last_became_active":"2024-04-24T23:09:56.936129+0000","last_became_peered":"2024-04-24T23:09:56.936129+0000","last_unstale":"2024-04-24T23:09:56.938149+0000","last_undegraded":"2024-04-24T23:09:56.938149+0000","last_fullsized":"2024-04-24T23:09:56.938149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:46.003977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945923+0000","last_change":"2024-04-24T23:09:56.928806+0000","last_active":"2024-04-24T23:09:56.945923+0000","last_peered":"2024-04-24T23:09:56.945923+0000","last_clean":"2024-04-24T23:09:56.945923+0000","last_became_active":"2024-04-24T23:09:56.925611+0000","last_became_peered":"2024-04-24T23:09:56.925611+0000","last_unstale":"2024-04-24T23:09:56.945923+0000","last_undegraded":"2024-04-24T23:09:56.945923+0000","last_fullsized":"2024-04-24T23:09:56.945923+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:55.912721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952132+0000","last_change":"2024-04-24T23:09:56.950003+0000","last_active":"2024-04-24T23:09:56.952132+0000","last_peered":"2024-04-24T23:09:56.952132+0000","last_clean":"2024-04-24T23:09:56.952132+0000","last_became_active":"2024-04-24T23:09:56.949677+0000","last_became_peered":"2024-04-24T23:09:56.949677+0000","last_unstale":"2024-04-24T23:09:56.952132+0000","last_undegraded":"2024-04-24T23:09:56.952132+0000","last_fullsized":"2024-04-24T23:09:56.952132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:27:59.773669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947104+0000","last_change":"2024-04-24T23:09:56.941322+0000","last_active":"2024-04-24T23:09:56.947104+0000","last_peered":"2024-04-24T23:09:56.947104+0000","last_clean":"2024-04-24T23:09:56.947104+0000","last_became_active":"2024-04-24T23:09:56.941057+0000","last_became_peered":"2024-04-24T23:09:56.941057+0000","last_unstale":"2024-04-24T23:09:56.947104+0000","last_undegraded":"2024-04-24T23:09:56.947104+0000","last_fullsized":"2024-04-24T23:09:56.947104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:34.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.929799+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.929479+0000","last_became_peered":"2024-04-24T23:09:56.929479+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:08.145163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949645+0000","last_change":"2024-04-24T23:09:56.946705+0000","last_active":"2024-04-24T23:09:56.949645+0000","last_peered":"2024-04-24T23:09:56.949645+0000","last_clean":"2024-04-24T23:09:56.949645+0000","last_became_active":"2024-04-24T23:09:56.946427+0000","last_became_peered":"2024-04-24T23:09:56.946427+0000","last_unstale":"2024-04-24T23:09:56.949645+0000","last_undegraded":"2024-04-24T23:09:56.949645+0000","last_fullsized":"2024-04-24T23:09:56.949645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947290+0000","last_change":"2024-04-24T23:09:56.931525+0000","last_active":"2024-04-24T23:09:56.947290+0000","last_peered":"2024-04-24T23:09:56.947290+0000","last_clean":"2024-04-24T23:09:56.947290+0000","last_became_active":"2024-04-24T23:09:56.925661+0000","last_became_peered":"2024-04-24T23:09:56.925661+0000","last_unstale":"2024-04-24T23:09:56.947290+0000","last_undegraded":"2024-04-24T23:09:56.947290+0000","last_fullsized":"2024-04-24T23:09:56.947290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:00.260147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932106+0000","last_change":"2024-04-24T23:09:56.919116+0000","last_active":"2024-04-24T23:09:56.932106+0000","last_peered":"2024-04-24T23:09:56.932106+0000","last_clean":"2024-04-24T23:09:56.932106+0000","last_became_active":"2024-04-24T23:09:56.918824+0000","last_became_peered":"2024-04-24T23:09:56.918824+0000","last_unstale":"2024-04-24T23:09:56.932106+0000","last_undegraded":"2024-04-24T23:09:56.932106+0000","last_fullsized":"2024-04-24T23:09:56.932106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:46.503606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949070+0000","last_change":"2024-04-24T23:09:56.944906+0000","last_active":"2024-04-24T23:09:56.949070+0000","last_peered":"2024-04-24T23:09:56.949070+0000","last_clean":"2024-04-24T23:09:56.949070+0000","last_became_active":"2024-04-24T23:09:56.944626+0000","last_became_peered":"2024-04-24T23:09:56.944626+0000","last_unstale":"2024-04-24T23:09:56.949070+0000","last_undegraded":"2024-04-24T23:09:56.949070+0000","last_fullsized":"2024-04-24T23:09:56.949070+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:28.600192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947065+0000","last_change":"2024-04-24T23:09:56.925763+0000","last_active":"2024-04-24T23:09:56.947065+0000","last_peered":"2024-04-24T23:09:56.947065+0000","last_clean":"2024-04-24T23:09:56.947065+0000","last_became_active":"2024-04-24T23:09:56.925443+0000","last_became_peered":"2024-04-24T23:09:56.925443+0000","last_unstale":"2024-04-24T23:09:56.947065+0000","last_undegraded":"2024-04-24T23:09:56.947065+0000","last_fullsized":"2024-04-24T23:09:56.947065+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:42.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935106+0000","last_change":"2024-04-24T23:09:56.930342+0000","last_active":"2024-04-24T23:09:56.935106+0000","last_peered":"2024-04-24T23:09:56.935106+0000","last_clean":"2024-04-24T23:09:56.935106+0000","last_became_active":"2024-04-24T23:09:56.929614+0000","last_became_peered":"2024-04-24T23:09:56.929614+0000","last_unstale":"2024-04-24T23:09:56.935106+0000","last_undegraded":"2024-04-24T23:09:56.935106+0000","last_fullsized":"2024-04-24T23:09:56.935106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946212+0000","last_change":"2024-04-24T23:09:56.941593+0000","last_active":"2024-04-24T23:09:56.946212+0000","last_peered":"2024-04-24T23:09:56.946212+0000","last_clean":"2024-04-24T23:09:56.946212+0000","last_became_active":"2024-04-24T23:09:56.939699+0000","last_became_peered":"2024-04-24T23:09:56.939699+0000","last_unstale":"2024-04-24T23:09:56.946212+0000","last_undegraded":"2024-04-24T23:09:56.946212+0000","last_fullsized":"2024-04-24T23:09:56.946212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:57.844085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937154+0000","last_change":"2024-04-24T23:09:56.934769+0000","last_active":"2024-04-24T23:09:56.937154+0000","last_peered":"2024-04-24T23:09:56.937154+0000","last_clean":"2024-04-24T23:09:56.937154+0000","last_became_active":"2024-04-24T23:09:56.933079+0000","last_became_peered":"2024-04-24T23:09:56.933079+0000","last_unstale":"2024-04-24T23:09:56.937154+0000","last_undegraded":"2024-04-24T23:09:56.937154+0000","last_fullsized":"2024-04-24T23:09:56.937154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.929291+0000","last_change":"2024-04-24T23:09:56.927450+0000","last_active":"2024-04-24T23:09:56.929291+0000","last_peered":"2024-04-24T23:09:56.929291+0000","last_clean":"2024-04-24T23:09:56.929291+0000","last_became_active":"2024-04-24T23:09:56.927016+0000","last_became_peered":"2024-04-24T23:09:56.927016+0000","last_unstale":"2024-04-24T23:09:56.929291+0000","last_undegraded":"2024-04-24T23:09:56.929291+0000","last_fullsized":"2024-04-24T23:09:56.929291+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937104+0000","last_change":"2024-04-24T23:09:56.933202+0000","last_active":"2024-04-24T23:09:56.937104+0000","last_peered":"2024-04-24T23:09:56.937104+0000","last_clean":"2024-04-24T23:09:56.937104+0000","last_became_active":"2024-04-24T23:09:56.932903+0000","last_became_peered":"2024-04-24T23:09:56.932903+0000","last_unstale":"2024-04-24T23:09:56.937104+0000","last_undegraded":"2024-04-24T23:09:56.937104+0000","last_fullsized":"2024-04-24T23:09:56.937104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:19.829265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933845+0000","last_change":"2024-04-24T23:09:56.927531+0000","last_active":"2024-04-24T23:09:56.933845+0000","last_peered":"2024-04-24T23:09:56.933845+0000","last_clean":"2024-04-24T23:09:56.933845+0000","last_became_active":"2024-04-24T23:09:56.927243+0000","last_became_peered":"2024-04-24T23:09:56.927243+0000","last_unstale":"2024-04-24T23:09:56.933845+0000","last_undegraded":"2024-04-24T23:09:56.933845+0000","last_fullsized":"2024-04-24T23:09:56.933845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.928096+0000","last_change":"2024-04-24T23:09:56.925843+0000","last_active":"2024-04-24T23:09:56.928096+0000","last_peered":"2024-04-24T23:09:56.928096+0000","last_clean":"2024-04-24T23:09:56.928096+0000","last_became_active":"2024-04-24T23:09:56.925556+0000","last_became_peered":"2024-04-24T23:09:56.925556+0000","last_unstale":"2024-04-24T23:09:56.928096+0000","last_undegraded":"2024-04-24T23:09:56.928096+0000","last_fullsized":"2024-04-24T23:09:56.928096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:44.189224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.920681+0000","last_change":"2024-04-24T23:09:56.915444+0000","last_active":"2024-04-24T23:09:56.920681+0000","last_peered":"2024-04-24T23:09:56.920681+0000","last_clean":"2024-04-24T23:09:56.920681+0000","last_became_active":"2024-04-24T23:09:56.914704+0000","last_became_peered":"2024-04-24T23:09:56.914704+0000","last_unstale":"2024-04-24T23:09:56.920681+0000","last_undegraded":"2024-04-24T23:09:56.920681+0000","last_fullsized":"2024-04-24T23:09:56.920681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:45.239398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945435+0000","last_change":"2024-04-24T23:09:56.925404+0000","last_active":"2024-04-24T23:09:56.945435+0000","last_peered":"2024-04-24T23:09:56.945435+0000","last_clean":"2024-04-24T23:09:56.945435+0000","last_became_active":"2024-04-24T23:09:56.925111+0000","last_became_peered":"2024-04-24T23:09:56.925111+0000","last_unstale":"2024-04-24T23:09:56.945435+0000","last_undegraded":"2024-04-24T23:09:56.945435+0000","last_fullsized":"2024-04-24T23:09:56.945435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:31.210094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.941120+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.940621+0000","last_became_peered":"2024-04-24T23:09:56.940621+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:01.281459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937132+0000","last_change":"2024-04-24T23:09:56.933867+0000","last_active":"2024-04-24T23:09:56.937132+0000","last_peered":"2024-04-24T23:09:56.937132+0000","last_clean":"2024-04-24T23:09:56.937132+0000","last_became_active":"2024-04-24T23:09:56.933359+0000","last_became_peered":"2024-04-24T23:09:56.933359+0000","last_unstale":"2024-04-24T23:09:56.937132+0000","last_undegraded":"2024-04-24T23:09:56.937132+0000","last_fullsized":"2024-04-24T23:09:56.937132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936138+0000","last_change":"2024-04-24T23:09:56.931228+0000","last_active":"2024-04-24T23:09:56.936138+0000","last_peered":"2024-04-24T23:09:56.936138+0000","last_clean":"2024-04-24T23:09:56.936138+0000","last_became_active":"2024-04-24T23:09:56.930831+0000","last_became_peered":"2024-04-24T23:09:56.930831+0000","last_unstale":"2024-04-24T23:09:56.936138+0000","last_undegraded":"2024-04-24T23:09:56.936138+0000","last_fullsized":"2024-04-24T23:09:56.936138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936036+0000","last_change":"2024-04-24T23:09:56.932993+0000","last_active":"2024-04-24T23:09:56.936036+0000","last_peered":"2024-04-24T23:09:56.936036+0000","last_clean":"2024-04-24T23:09:56.936036+0000","last_became_active":"2024-04-24T23:09:56.932707+0000","last_became_peered":"2024-04-24T23:09:56.932707+0000","last_unstale":"2024-04-24T23:09:56.936036+0000","last_undegraded":"2024-04-24T23:09:56.936036+0000","last_fullsized":"2024-04-24T23:09:56.936036+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.930748+0000","last_change":"2024-04-24T23:09:56.917318+0000","last_active":"2024-04-24T23:09:56.930748+0000","last_peered":"2024-04-24T23:09:56.930748+0000","last_clean":"2024-04-24T23:09:56.930748+0000","last_became_active":"2024-04-24T23:09:56.916979+0000","last_became_peered":"2024-04-24T23:09:56.916979+0000","last_unstale":"2024-04-24T23:09:56.930748+0000","last_undegraded":"2024-04-24T23:09:56.930748+0000","last_fullsized":"2024-04-24T23:09:56.930748+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.944480+0000","last_change":"2024-04-24T23:09:56.935573+0000","last_active":"2024-04-24T23:09:56.944480+0000","last_peered":"2024-04-24T23:09:56.944480+0000","last_clean":"2024-04-24T23:09:56.944480+0000","last_became_active":"2024-04-24T23:09:56.935267+0000","last_became_peered":"2024-04-24T23:09:56.935267+0000","last_unstale":"2024-04-24T23:09:56.944480+0000","last_undegraded":"2024-04-24T23:09:56.944480+0000","last_fullsized":"2024-04-24T23:09:56.944480+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950958+0000","last_change":"2024-04-24T23:09:55.878169+0000","last_active":"2024-04-24T23:09:56.950958+0000","last_peered":"2024-04-24T23:09:56.950958+0000","last_clean":"2024-04-24T23:09:56.950958+0000","last_became_active":"2024-04-24T23:09:55.877826+0000","last_became_peered":"2024-04-24T23:09:55.877826+0000","last_unstale":"2024-04-24T23:09:56.950958+0000","last_undegraded":"2024-04-24T23:09:56.950958+0000","last_fullsized":"2024-04-24T23:09:56.950958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:29.372680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946413+0000","last_change":"2024-04-24T23:09:56.942471+0000","last_active":"2024-04-24T23:09:56.946413+0000","last_peered":"2024-04-24T23:09:56.946413+0000","last_clean":"2024-04-24T23:09:56.946413+0000","last_became_active":"2024-04-24T23:09:56.942154+0000","last_became_peered":"2024-04-24T23:09:56.942154+0000","last_unstale":"2024-04-24T23:09:56.946413+0000","last_undegraded":"2024-04-24T23:09:56.946413+0000","last_fullsized":"2024-04-24T23:09:56.946413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:05.671071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953281+0000","last_change":"2024-04-24T23:09:55.885462+0000","last_active":"2024-04-24T23:09:56.953281+0000","last_peered":"2024-04-24T23:09:56.953281+0000","last_clean":"2024-04-24T23:09:56.953281+0000","last_became_active":"2024-04-24T23:09:55.885156+0000","last_became_peered":"2024-04-24T23:09:55.885156+0000","last_unstale":"2024-04-24T23:09:56.953281+0000","last_undegraded":"2024-04-24T23:09:56.953281+0000","last_fullsized":"2024-04-24T23:09:56.953281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:32.759204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.948053+0000","last_change":"2024-04-24T23:09:56.945032+0000","last_active":"2024-04-24T23:09:56.948053+0000","last_peered":"2024-04-24T23:09:56.948053+0000","last_clean":"2024-04-24T23:09:56.948053+0000","last_became_active":"2024-04-24T23:09:56.944757+0000","last_became_peered":"2024-04-24T23:09:56.944757+0000","last_unstale":"2024-04-24T23:09:56.948053+0000","last_undegraded":"2024-04-24T23:09:56.948053+0000","last_fullsized":"2024-04-24T23:09:56.948053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:16.993406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953127+0000","last_change":"2024-04-24T23:09:55.901246+0000","last_active":"2024-04-24T23:09:56.953127+0000","last_peered":"2024-04-24T23:09:56.953127+0000","last_clean":"2024-04-24T23:09:56.953127+0000","last_became_active":"2024-04-24T23:09:55.900510+0000","last_became_peered":"2024-04-24T23:09:55.900510+0000","last_unstale":"2024-04-24T23:09:56.953127+0000","last_undegraded":"2024-04-24T23:09:56.953127+0000","last_fullsized":"2024-04-24T23:09:56.953127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:33.972115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942803+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.942803+0000","last_peered":"2024-04-24T23:09:56.942803+0000","last_clean":"2024-04-24T23:09:56.942803+0000","last_became_active":"2024-04-24T23:09:56.920155+0000","last_became_peered":"2024-04-24T23:09:56.920155+0000","last_unstale":"2024-04-24T23:09:56.942803+0000","last_undegraded":"2024-04-24T23:09:56.942803+0000","last_fullsized":"2024-04-24T23:09:56.942803+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:28.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955535+0000","last_change":"2024-04-24T23:09:55.888998+0000","last_active":"2024-04-24T23:09:56.955535+0000","last_peered":"2024-04-24T23:09:56.955535+0000","last_clean":"2024-04-24T23:09:56.955535+0000","last_became_active":"2024-04-24T23:09:55.888687+0000","last_became_peered":"2024-04-24T23:09:55.888687+0000","last_unstale":"2024-04-24T23:09:56.955535+0000","last_undegraded":"2024-04-24T23:09:56.955535+0000","last_fullsized":"2024-04-24T23:09:56.955535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.825617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935285+0000","last_change":"2024-04-24T23:09:56.937409+0000","last_active":"2024-04-24T23:09:57.935285+0000","last_peered":"2024-04-24T23:09:57.935285+0000","last_clean":"2024-04-24T23:09:57.935285+0000","last_became_active":"2024-04-24T23:09:56.934198+0000","last_became_peered":"2024-04-24T23:09:56.934198+0000","last_unstale":"2024-04-24T23:09:57.935285+0000","last_undegraded":"2024-04-24T23:09:57.935285+0000","last_fullsized":"2024-04-24T23:09:57.935285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:30.100419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952882+0000","last_change":"2024-04-24T23:09:55.895038+0000","last_active":"2024-04-24T23:09:56.952882+0000","last_peered":"2024-04-24T23:09:56.952882+0000","last_clean":"2024-04-24T23:09:56.952882+0000","last_became_active":"2024-04-24T23:09:55.894708+0000","last_became_peered":"2024-04-24T23:09:55.894708+0000","last_unstale":"2024-04-24T23:09:56.952882+0000","last_undegraded":"2024-04-24T23:09:56.952882+0000","last_fullsized":"2024-04-24T23:09:56.952882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952187+0000","last_change":"2024-04-24T23:09:56.950756+0000","last_active":"2024-04-24T23:09:56.952187+0000","last_peered":"2024-04-24T23:09:56.952187+0000","last_clean":"2024-04-24T23:09:56.952187+0000","last_became_active":"2024-04-24T23:09:56.950487+0000","last_became_peered":"2024-04-24T23:09:56.950487+0000","last_unstale":"2024-04-24T23:09:56.952187+0000","last_undegraded":"2024-04-24T23:09:56.952187+0000","last_fullsized":"2024-04-24T23:09:56.952187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935400+0000","last_change":"2024-04-24T23:09:55.902440+0000","last_active":"2024-04-24T23:09:57.935400+0000","last_peered":"2024-04-24T23:09:57.935400+0000","last_clean":"2024-04-24T23:09:57.935400+0000","last_became_active":"2024-04-24T23:09:55.901950+0000","last_became_peered":"2024-04-24T23:09:55.901950+0000","last_unstale":"2024-04-24T23:09:57.935400+0000","last_undegraded":"2024-04-24T23:09:57.935400+0000","last_fullsized":"2024-04-24T23:09:57.935400+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:38:35.121590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941364+0000","last_change":"2024-04-24T23:09:56.935846+0000","last_active":"2024-04-24T23:09:56.941364+0000","last_peered":"2024-04-24T23:09:56.941364+0000","last_clean":"2024-04-24T23:09:56.941364+0000","last_became_active":"2024-04-24T23:09:56.935571+0000","last_became_peered":"2024-04-24T23:09:56.935571+0000","last_unstale":"2024-04-24T23:09:56.941364+0000","last_undegraded":"2024-04-24T23:09:56.941364+0000","last_fullsized":"2024-04-24T23:09:56.941364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:32:59.681587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.906824+0000","last_change":"2024-04-24T23:09:55.899264+0000","last_active":"2024-04-24T23:09:56.906824+0000","last_peered":"2024-04-24T23:09:56.906824+0000","last_clean":"2024-04-24T23:09:56.906824+0000","last_became_active":"2024-04-24T23:09:55.898514+0000","last_became_peered":"2024-04-24T23:09:55.898514+0000","last_unstale":"2024-04-24T23:09:56.906824+0000","last_undegraded":"2024-04-24T23:09:56.906824+0000","last_fullsized":"2024-04-24T23:09:56.906824+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:24.586695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937832+0000","last_change":"2024-04-24T23:09:56.931992+0000","last_active":"2024-04-24T23:09:56.937832+0000","last_peered":"2024-04-24T23:09:56.937832+0000","last_clean":"2024-04-24T23:09:56.937832+0000","last_became_active":"2024-04-24T23:09:56.931619+0000","last_became_peered":"2024-04-24T23:09:56.931619+0000","last_unstale":"2024-04-24T23:09:56.937832+0000","last_undegraded":"2024-04-24T23:09:56.937832+0000","last_fullsized":"2024-04-24T23:09:56.937832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898773+0000","last_change":"2024-04-24T23:09:55.897787+0000","last_active":"2024-04-24T23:09:56.898773+0000","last_peered":"2024-04-24T23:09:56.898773+0000","last_clean":"2024-04-24T23:09:56.898773+0000","last_became_active":"2024-04-24T23:09:55.897129+0000","last_became_peered":"2024-04-24T23:09:55.897129+0000","last_unstale":"2024-04-24T23:09:56.898773+0000","last_undegraded":"2024-04-24T23:09:56.898773+0000","last_fullsized":"2024-04-24T23:09:56.898773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:59.244632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941212+0000","last_change":"2024-04-24T23:09:56.940662+0000","last_active":"2024-04-24T23:09:56.941212+0000","last_peered":"2024-04-24T23:09:56.941212+0000","last_clean":"2024-04-24T23:09:56.941212+0000","last_became_active":"2024-04-24T23:09:56.940303+0000","last_became_peered":"2024-04-24T23:09:56.940303+0000","last_unstale":"2024-04-24T23:09:56.941212+0000","last_undegraded":"2024-04-24T23:09:56.941212+0000","last_fullsized":"2024-04-24T23:09:56.941212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901961+0000","last_change":"2024-04-24T23:09:55.901003+0000","last_active":"2024-04-24T23:09:56.901961+0000","last_peered":"2024-04-24T23:09:56.901961+0000","last_clean":"2024-04-24T23:09:56.901961+0000","last_became_active":"2024-04-24T23:09:55.900616+0000","last_became_peered":"2024-04-24T23:09:55.900616+0000","last_unstale":"2024-04-24T23:09:56.901961+0000","last_undegraded":"2024-04-24T23:09:56.901961+0000","last_fullsized":"2024-04-24T23:09:56.901961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:41.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935853+0000","last_change":"2024-04-24T23:09:56.929324+0000","last_active":"2024-04-24T23:09:56.935853+0000","last_peered":"2024-04-24T23:09:56.935853+0000","last_clean":"2024-04-24T23:09:56.935853+0000","last_became_active":"2024-04-24T23:09:56.928972+0000","last_became_peered":"2024-04-24T23:09:56.928972+0000","last_unstale":"2024-04-24T23:09:56.935853+0000","last_undegraded":"2024-04-24T23:09:56.935853+0000","last_fullsized":"2024-04-24T23:09:56.935853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:20.967828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.909826+0000","last_change":"2024-04-24T23:09:55.897350+0000","last_active":"2024-04-24T23:09:56.909826+0000","last_peered":"2024-04-24T23:09:56.909826+0000","last_clean":"2024-04-24T23:09:56.909826+0000","last_became_active":"2024-04-24T23:09:55.896165+0000","last_became_peered":"2024-04-24T23:09:55.896165+0000","last_unstale":"2024-04-24T23:09:56.909826+0000","last_undegraded":"2024-04-24T23:09:56.909826+0000","last_fullsized":"2024-04-24T23:09:56.909826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:39.578060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942948+0000","last_change":"2024-04-24T23:09:56.937575+0000","last_active":"2024-04-24T23:09:56.942948+0000","last_peered":"2024-04-24T23:09:56.942948+0000","last_clean":"2024-04-24T23:09:56.942948+0000","last_became_active":"2024-04-24T23:09:56.936720+0000","last_became_peered":"2024-04-24T23:09:56.936720+0000","last_unstale":"2024-04-24T23:09:56.942948+0000","last_undegraded":"2024-04-24T23:09:56.942948+0000","last_fullsized":"2024-04-24T23:09:56.942948+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955776+0000","last_change":"2024-04-24T23:09:55.900879+0000","last_active":"2024-04-24T23:09:56.955776+0000","last_peered":"2024-04-24T23:09:56.955776+0000","last_clean":"2024-04-24T23:09:56.955776+0000","last_became_active":"2024-04-24T23:09:55.900538+0000","last_became_peered":"2024-04-24T23:09:55.900538+0000","last_unstale":"2024-04-24T23:09:56.955776+0000","last_undegraded":"2024-04-24T23:09:56.955776+0000","last_fullsized":"2024-04-24T23:09:56.955776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:55.974696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941176+0000","last_change":"2024-04-24T23:09:56.929691+0000","last_active":"2024-04-24T23:09:56.941176+0000","last_peered":"2024-04-24T23:09:56.941176+0000","last_clean":"2024-04-24T23:09:56.941176+0000","last_became_active":"2024-04-24T23:09:56.928870+0000","last_became_peered":"2024-04-24T23:09:56.928870+0000","last_unstale":"2024-04-24T23:09:56.941176+0000","last_undegraded":"2024-04-24T23:09:56.941176+0000","last_fullsized":"2024-04-24T23:09:56.941176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:10.293838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955766+0000","last_change":"2024-04-24T23:09:55.904255+0000","last_active":"2024-04-24T23:09:56.955766+0000","last_peered":"2024-04-24T23:09:56.955766+0000","last_clean":"2024-04-24T23:09:56.955766+0000","last_became_active":"2024-04-24T23:09:55.903943+0000","last_became_peered":"2024-04-24T23:09:55.903943+0000","last_unstale":"2024-04-24T23:09:56.955766+0000","last_undegraded":"2024-04-24T23:09:56.955766+0000","last_fullsized":"2024-04-24T23:09:56.955766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933825+0000","last_change":"2024-04-24T23:09:56.927437+0000","last_active":"2024-04-24T23:09:56.933825+0000","last_peered":"2024-04-24T23:09:56.933825+0000","last_clean":"2024-04-24T23:09:56.933825+0000","last_became_active":"2024-04-24T23:09:56.927140+0000","last_became_peered":"2024-04-24T23:09:56.927140+0000","last_unstale":"2024-04-24T23:09:56.933825+0000","last_undegraded":"2024-04-24T23:09:56.933825+0000","last_fullsized":"2024-04-24T23:09:56.933825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953002+0000","last_change":"2024-04-24T23:09:55.906123+0000","last_active":"2024-04-24T23:09:56.953002+0000","last_peered":"2024-04-24T23:09:56.953002+0000","last_clean":"2024-04-24T23:09:56.953002+0000","last_became_active":"2024-04-24T23:09:55.905737+0000","last_became_peered":"2024-04-24T23:09:55.905737+0000","last_unstale":"2024-04-24T23:09:56.953002+0000","last_undegraded":"2024-04-24T23:09:56.953002+0000","last_fullsized":"2024-04-24T23:09:56.953002+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:38.938789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.934150+0000","last_change":"2024-04-24T23:09:56.927890+0000","last_active":"2024-04-24T23:09:56.934150+0000","last_peered":"2024-04-24T23:09:56.934150+0000","last_clean":"2024-04-24T23:09:56.934150+0000","last_became_active":"2024-04-24T23:09:56.927603+0000","last_became_peered":"2024-04-24T23:09:56.927603+0000","last_unstale":"2024-04-24T23:09:56.934150+0000","last_undegraded":"2024-04-24T23:09:56.934150+0000","last_fullsized":"2024-04-24T23:09:56.934150+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:01.841132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924687+0000","last_change":"2024-04-24T23:09:55.905608+0000","last_active":"2024-04-24T23:09:56.924687+0000","last_peered":"2024-04-24T23:09:56.924687+0000","last_clean":"2024-04-24T23:09:56.924687+0000","last_became_active":"2024-04-24T23:09:55.904448+0000","last_became_peered":"2024-04-24T23:09:55.904448+0000","last_unstale":"2024-04-24T23:09:56.924687+0000","last_undegraded":"2024-04-24T23:09:56.924687+0000","last_fullsized":"2024-04-24T23:09:56.924687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:20.397547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952525+0000","last_change":"2024-04-24T23:09:56.947148+0000","last_active":"2024-04-24T23:09:56.952525+0000","last_peered":"2024-04-24T23:09:56.952525+0000","last_clean":"2024-04-24T23:09:56.952525+0000","last_became_active":"2024-04-24T23:09:56.946870+0000","last_became_peered":"2024-04-24T23:09:56.946870+0000","last_unstale":"2024-04-24T23:09:56.952525+0000","last_undegraded":"2024-04-24T23:09:56.952525+0000","last_fullsized":"2024-04-24T23:09:56.952525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924073+0000","last_change":"2024-04-24T23:09:55.903305+0000","last_active":"2024-04-24T23:09:56.924073+0000","last_peered":"2024-04-24T23:09:56.924073+0000","last_clean":"2024-04-24T23:09:56.924073+0000","last_became_active":"2024-04-24T23:09:55.902795+0000","last_became_peered":"2024-04-24T23:09:55.902795+0000","last_unstale":"2024-04-24T23:09:56.924073+0000","last_undegraded":"2024-04-24T23:09:56.924073+0000","last_fullsized":"2024-04-24T23:09:56.924073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935894+0000","last_change":"2024-04-24T23:09:56.935577+0000","last_active":"2024-04-24T23:09:57.935894+0000","last_peered":"2024-04-24T23:09:57.935894+0000","last_clean":"2024-04-24T23:09:57.935894+0000","last_became_active":"2024-04-24T23:09:56.935239+0000","last_became_peered":"2024-04-24T23:09:56.935239+0000","last_unstale":"2024-04-24T23:09:57.935894+0000","last_undegraded":"2024-04-24T23:09:57.935894+0000","last_fullsized":"2024-04-24T23:09:57.935894+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:50.182143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":20,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955864+0000","last_change":"2024-04-24T23:09:55.905976+0000","last_active":"2024-04-24T23:09:56.955864+0000","last_peered":"2024-04-24T23:09:56.955864+0000","last_clean":"2024-04-24T23:09:56.955864+0000","last_became_active":"2024-04-24T23:09:55.905574+0000","last_became_peered":"2024-04-24T23:09:55.905574+0000","last_unstale":"2024-04-24T23:09:56.955864+0000","last_undegraded":"2024-04-24T23:09:56.955864+0000","last_fullsized":"2024-04-24T23:09:56.955864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:05.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936606+0000","last_change":"2024-04-24T23:09:56.940911+0000","last_active":"2024-04-24T23:09:57.936606+0000","last_peered":"2024-04-24T23:09:57.936606+0000","last_clean":"2024-04-24T23:09:57.936606+0000","last_became_active":"2024-04-24T23:09:56.940191+0000","last_became_peered":"2024-04-24T23:09:56.940191+0000","last_unstale":"2024-04-24T23:09:57.936606+0000","last_undegraded":"2024-04-24T23:09:57.936606+0000","last_fullsized":"2024-04-24T23:09:57.936606+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:14.482544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953278+0000","last_change":"2024-04-24T23:09:55.886430+0000","last_active":"2024-04-24T23:09:56.953278+0000","last_peered":"2024-04-24T23:09:56.953278+0000","last_clean":"2024-04-24T23:09:56.953278+0000","last_became_active":"2024-04-24T23:09:55.884169+0000","last_became_peered":"2024-04-24T23:09:55.884169+0000","last_unstale":"2024-04-24T23:09:56.953278+0000","last_undegraded":"2024-04-24T23:09:56.953278+0000","last_fullsized":"2024-04-24T23:09:56.953278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937512+0000","last_change":"2024-04-24T23:09:56.931170+0000","last_active":"2024-04-24T23:09:56.937512+0000","last_peered":"2024-04-24T23:09:56.937512+0000","last_clean":"2024-04-24T23:09:56.937512+0000","last_became_active":"2024-04-24T23:09:56.930874+0000","last_became_peered":"2024-04-24T23:09:56.930874+0000","last_unstale":"2024-04-24T23:09:56.937512+0000","last_undegraded":"2024-04-24T23:09:56.937512+0000","last_fullsized":"2024-04-24T23:09:56.937512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:05.428941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950150+0000","last_change":"2024-04-24T23:09:55.883074+0000","last_active":"2024-04-24T23:09:56.950150+0000","last_peered":"2024-04-24T23:09:56.950150+0000","last_clean":"2024-04-24T23:09:56.950150+0000","last_became_active":"2024-04-24T23:09:55.882760+0000","last_became_peered":"2024-04-24T23:09:55.882760+0000","last_unstale":"2024-04-24T23:09:56.950150+0000","last_undegraded":"2024-04-24T23:09:56.950150+0000","last_fullsized":"2024-04-24T23:09:56.950150+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:53.982280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935244+0000","last_change":"2024-04-24T23:09:56.928012+0000","last_active":"2024-04-24T23:09:56.935244+0000","last_peered":"2024-04-24T23:09:56.935244+0000","last_clean":"2024-04-24T23:09:56.935244+0000","last_became_active":"2024-04-24T23:09:56.927729+0000","last_became_peered":"2024-04-24T23:09:56.927729+0000","last_unstale":"2024-04-24T23:09:56.935244+0000","last_undegraded":"2024-04-24T23:09:56.935244+0000","last_fullsized":"2024-04-24T23:09:56.935244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:33.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949330+0000","last_change":"2024-04-24T23:09:55.880315+0000","last_active":"2024-04-24T23:09:56.949330+0000","last_peered":"2024-04-24T23:09:56.949330+0000","last_clean":"2024-04-24T23:09:56.949330+0000","last_became_active":"2024-04-24T23:09:55.880011+0000","last_became_peered":"2024-04-24T23:09:55.880011+0000","last_unstale":"2024-04-24T23:09:56.949330+0000","last_undegraded":"2024-04-24T23:09:56.949330+0000","last_fullsized":"2024-04-24T23:09:56.949330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:43.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943735+0000","last_change":"2024-04-24T23:09:56.930919+0000","last_active":"2024-04-24T23:09:56.943735+0000","last_peered":"2024-04-24T23:09:56.943735+0000","last_clean":"2024-04-24T23:09:56.943735+0000","last_became_active":"2024-04-24T23:09:56.930597+0000","last_became_peered":"2024-04-24T23:09:56.930597+0000","last_unstale":"2024-04-24T23:09:56.943735+0000","last_undegraded":"2024-04-24T23:09:56.943735+0000","last_fullsized":"2024-04-24T23:09:56.943735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:09.506531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955656+0000","last_change":"2024-04-24T23:09:55.905783+0000","last_active":"2024-04-24T23:09:56.955656+0000","last_peered":"2024-04-24T23:09:56.955656+0000","last_clean":"2024-04-24T23:09:56.955656+0000","last_became_active":"2024-04-24T23:09:55.905510+0000","last_became_peered":"2024-04-24T23:09:55.905510+0000","last_unstale":"2024-04-24T23:09:56.955656+0000","last_undegraded":"2024-04-24T23:09:56.955656+0000","last_fullsized":"2024-04-24T23:09:56.955656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:04.655556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943540+0000","last_change":"2024-04-24T23:09:56.942600+0000","last_active":"2024-04-24T23:09:56.943540+0000","last_peered":"2024-04-24T23:09:56.943540+0000","last_clean":"2024-04-24T23:09:56.943540+0000","last_became_active":"2024-04-24T23:09:56.941777+0000","last_became_peered":"2024-04-24T23:09:56.941777+0000","last_unstale":"2024-04-24T23:09:56.943540+0000","last_undegraded":"2024-04-24T23:09:56.943540+0000","last_fullsized":"2024-04-24T23:09:56.943540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.913506+0000","last_change":"2024-04-24T23:09:55.904339+0000","last_active":"2024-04-24T23:09:56.913506+0000","last_peered":"2024-04-24T23:09:56.913506+0000","last_clean":"2024-04-24T23:09:56.913506+0000","last_became_active":"2024-04-24T23:09:55.904059+0000","last_became_peered":"2024-04-24T23:09:55.904059+0000","last_unstale":"2024-04-24T23:09:56.913506+0000","last_undegraded":"2024-04-24T23:09:56.913506+0000","last_fullsized":"2024-04-24T23:09:56.913506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:49.851813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932089+0000","last_change":"2024-04-24T23:09:56.928338+0000","last_active":"2024-04-24T23:09:56.932089+0000","last_peered":"2024-04-24T23:09:56.932089+0000","last_clean":"2024-04-24T23:09:56.932089+0000","last_became_active":"2024-04-24T23:09:56.926921+0000","last_became_peered":"2024-04-24T23:09:56.926921+0000","last_unstale":"2024-04-24T23:09:56.932089+0000","last_undegraded":"2024-04-24T23:09:56.932089+0000","last_fullsized":"2024-04-24T23:09:56.932089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919267+0000","last_change":"2024-04-24T23:09:55.887859+0000","last_active":"2024-04-24T23:09:56.919267+0000","last_peered":"2024-04-24T23:09:56.919267+0000","last_clean":"2024-04-24T23:09:56.919267+0000","last_became_active":"2024-04-24T23:09:55.887578+0000","last_became_peered":"2024-04-24T23:09:55.887578+0000","last_unstale":"2024-04-24T23:09:56.919267+0000","last_undegraded":"2024-04-24T23:09:56.919267+0000","last_fullsized":"2024-04-24T23:09:56.919267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:12.436579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952491+0000","last_change":"2024-04-24T23:09:56.947213+0000","last_active":"2024-04-24T23:09:56.952491+0000","last_peered":"2024-04-24T23:09:56.952491+0000","last_clean":"2024-04-24T23:09:56.952491+0000","last_became_active":"2024-04-24T23:09:56.946885+0000","last_became_peered":"2024-04-24T23:09:56.946885+0000","last_unstale":"2024-04-24T23:09:56.952491+0000","last_undegraded":"2024-04-24T23:09:56.952491+0000","last_fullsized":"2024-04-24T23:09:56.952491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935117+0000","last_change":"2024-04-24T23:09:55.891391+0000","last_active":"2024-04-24T23:09:57.935117+0000","last_peered":"2024-04-24T23:09:57.935117+0000","last_clean":"2024-04-24T23:09:57.935117+0000","last_became_active":"2024-04-24T23:09:55.889562+0000","last_became_peered":"2024-04-24T23:09:55.889562+0000","last_unstale":"2024-04-24T23:09:57.935117+0000","last_undegraded":"2024-04-24T23:09:57.935117+0000","last_fullsized":"2024-04-24T23:09:57.935117+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:29.685328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.927477+0000","last_change":"2024-04-24T23:09:56.921036+0000","last_active":"2024-04-24T23:09:56.927477+0000","last_peered":"2024-04-24T23:09:56.927477+0000","last_clean":"2024-04-24T23:09:56.927477+0000","last_became_active":"2024-04-24T23:09:56.920703+0000","last_became_peered":"2024-04-24T23:09:56.920703+0000","last_unstale":"2024-04-24T23:09:56.927477+0000","last_undegraded":"2024-04-24T23:09:56.927477+0000","last_fullsized":"2024-04-24T23:09:56.927477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953519+0000","last_change":"2024-04-24T23:09:55.885776+0000","last_active":"2024-04-24T23:09:56.953519+0000","last_peered":"2024-04-24T23:09:56.953519+0000","last_clean":"2024-04-24T23:09:56.953519+0000","last_became_active":"2024-04-24T23:09:55.884367+0000","last_became_peered":"2024-04-24T23:09:55.884367+0000","last_unstale":"2024-04-24T23:09:56.953519+0000","last_undegraded":"2024-04-24T23:09:56.953519+0000","last_fullsized":"2024-04-24T23:09:56.953519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:07.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936212+0000","last_change":"2024-04-24T23:09:56.940835+0000","last_active":"2024-04-24T23:09:57.936212+0000","last_peered":"2024-04-24T23:09:57.936212+0000","last_clean":"2024-04-24T23:09:57.936212+0000","last_became_active":"2024-04-24T23:09:56.940545+0000","last_became_peered":"2024-04-24T23:09:56.940545+0000","last_unstale":"2024-04-24T23:09:57.936212+0000","last_undegraded":"2024-04-24T23:09:57.936212+0000","last_fullsized":"2024-04-24T23:09:57.936212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:29.634674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.926815+0000","last_change":"2024-04-24T23:09:55.872709+0000","last_active":"2024-04-24T23:09:56.926815+0000","last_peered":"2024-04-24T23:09:56.926815+0000","last_clean":"2024-04-24T23:09:56.926815+0000","last_became_active":"2024-04-24T23:09:55.872409+0000","last_became_peered":"2024-04-24T23:09:55.872409+0000","last_unstale":"2024-04-24T23:09:56.926815+0000","last_undegraded":"2024-04-24T23:09:56.926815+0000","last_fullsized":"2024-04-24T23:09:56.926815+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:38.852012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936275+0000","last_change":"2024-04-24T23:09:56.937062+0000","last_active":"2024-04-24T23:09:57.936275+0000","last_peered":"2024-04-24T23:09:57.936275+0000","last_clean":"2024-04-24T23:09:57.936275+0000","last_became_active":"2024-04-24T23:09:56.936317+0000","last_became_peered":"2024-04-24T23:09:56.936317+0000","last_unstale":"2024-04-24T23:09:57.936275+0000","last_undegraded":"2024-04-24T23:09:57.936275+0000","last_fullsized":"2024-04-24T23:09:57.936275+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:09.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.915565+0000","last_change":"2024-04-24T23:09:55.899285+0000","last_active":"2024-04-24T23:09:56.915565+0000","last_peered":"2024-04-24T23:09:56.915565+0000","last_clean":"2024-04-24T23:09:56.915565+0000","last_became_active":"2024-04-24T23:09:55.899020+0000","last_became_peered":"2024-04-24T23:09:55.899020+0000","last_unstale":"2024-04-24T23:09:56.915565+0000","last_undegraded":"2024-04-24T23:09:56.915565+0000","last_fullsized":"2024-04-24T23:09:56.915565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935286+0000","last_change":"2024-04-24T23:09:56.928574+0000","last_active":"2024-04-24T23:09:56.935286+0000","last_peered":"2024-04-24T23:09:56.935286+0000","last_clean":"2024-04-24T23:09:56.935286+0000","last_became_active":"2024-04-24T23:09:56.927898+0000","last_became_peered":"2024-04-24T23:09:56.927898+0000","last_unstale":"2024-04-24T23:09:56.935286+0000","last_undegraded":"2024-04-24T23:09:56.935286+0000","last_fullsized":"2024-04-24T23:09:56.935286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:54.997795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.922565+0000","last_change":"2024-04-24T23:09:55.897509+0000","last_active":"2024-04-24T23:09:56.922565+0000","last_peered":"2024-04-24T23:09:56.922565+0000","last_clean":"2024-04-24T23:09:56.922565+0000","last_became_active":"2024-04-24T23:09:55.896981+0000","last_became_peered":"2024-04-24T23:09:55.896981+0000","last_unstale":"2024-04-24T23:09:56.922565+0000","last_undegraded":"2024-04-24T23:09:56.922565+0000","last_fullsized":"2024-04-24T23:09:56.922565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:27.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943712+0000","last_change":"2024-04-24T23:09:56.930569+0000","last_active":"2024-04-24T23:09:56.943712+0000","last_peered":"2024-04-24T23:09:56.943712+0000","last_clean":"2024-04-24T23:09:56.943712+0000","last_became_active":"2024-04-24T23:09:56.928323+0000","last_became_peered":"2024-04-24T23:09:56.928323+0000","last_unstale":"2024-04-24T23:09:56.943712+0000","last_undegraded":"2024-04-24T23:09:56.943712+0000","last_fullsized":"2024-04-24T23:09:56.943712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:33.076696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925658+0000","last_change":"2024-04-24T23:09:55.902928+0000","last_active":"2024-04-24T23:09:56.925658+0000","last_peered":"2024-04-24T23:09:56.925658+0000","last_clean":"2024-04-24T23:09:56.925658+0000","last_became_active":"2024-04-24T23:09:55.902393+0000","last_became_peered":"2024-04-24T23:09:55.902393+0000","last_unstale":"2024-04-24T23:09:56.925658+0000","last_undegraded":"2024-04-24T23:09:56.925658+0000","last_fullsized":"2024-04-24T23:09:56.925658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.285345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947313+0000","last_change":"2024-04-24T23:09:56.933724+0000","last_active":"2024-04-24T23:09:56.947313+0000","last_peered":"2024-04-24T23:09:56.947313+0000","last_clean":"2024-04-24T23:09:56.947313+0000","last_became_active":"2024-04-24T23:09:56.933457+0000","last_became_peered":"2024-04-24T23:09:56.933457+0000","last_unstale":"2024-04-24T23:09:56.947313+0000","last_undegraded":"2024-04-24T23:09:56.947313+0000","last_fullsized":"2024-04-24T23:09:56.947313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:01.896202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.899329+0000","last_change":"2024-04-24T23:09:55.878355+0000","last_active":"2024-04-24T23:09:56.899329+0000","last_peered":"2024-04-24T23:09:56.899329+0000","last_clean":"2024-04-24T23:09:56.899329+0000","last_became_active":"2024-04-24T23:09:55.877074+0000","last_became_peered":"2024-04-24T23:09:55.877074+0000","last_unstale":"2024-04-24T23:09:56.899329+0000","last_undegraded":"2024-04-24T23:09:56.899329+0000","last_fullsized":"2024-04-24T23:09:56.899329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:00.880687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.940512+0000","last_change":"2024-04-24T23:09:56.939521+0000","last_active":"2024-04-24T23:09:56.940512+0000","last_peered":"2024-04-24T23:09:56.940512+0000","last_clean":"2024-04-24T23:09:56.940512+0000","last_became_active":"2024-04-24T23:09:56.936959+0000","last_became_peered":"2024-04-24T23:09:56.936959+0000","last_unstale":"2024-04-24T23:09:56.940512+0000","last_undegraded":"2024-04-24T23:09:56.940512+0000","last_fullsized":"2024-04-24T23:09:56.940512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901862+0000","last_change":"2024-04-24T23:09:55.895704+0000","last_active":"2024-04-24T23:09:56.901862+0000","last_peered":"2024-04-24T23:09:56.901862+0000","last_clean":"2024-04-24T23:09:56.901862+0000","last_became_active":"2024-04-24T23:09:55.895351+0000","last_became_peered":"2024-04-24T23:09:55.895351+0000","last_unstale":"2024-04-24T23:09:56.901862+0000","last_undegraded":"2024-04-24T23:09:56.901862+0000","last_fullsized":"2024-04-24T23:09:56.901862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:39.281068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949211+0000","last_change":"2024-04-24T23:09:56.945238+0000","last_active":"2024-04-24T23:09:56.949211+0000","last_peered":"2024-04-24T23:09:56.949211+0000","last_clean":"2024-04-24T23:09:56.949211+0000","last_became_active":"2024-04-24T23:09:56.944093+0000","last_became_peered":"2024-04-24T23:09:56.944093+0000","last_unstale":"2024-04-24T23:09:56.949211+0000","last_undegraded":"2024-04-24T23:09:56.949211+0000","last_fullsized":"2024-04-24T23:09:56.949211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:56.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898863+0000","last_change":"2024-04-24T23:09:55.877706+0000","last_active":"2024-04-24T23:09:56.898863+0000","last_peered":"2024-04-24T23:09:56.898863+0000","last_clean":"2024-04-24T23:09:56.898863+0000","last_became_active":"2024-04-24T23:09:55.877145+0000","last_became_peered":"2024-04-24T23:09:55.877145+0000","last_unstale":"2024-04-24T23:09:56.898863+0000","last_undegraded":"2024-04-24T23:09:56.898863+0000","last_fullsized":"2024-04-24T23:09:56.898863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:23.501000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935247+0000","last_change":"2024-04-24T23:09:56.928920+0000","last_active":"2024-04-24T23:09:56.935247+0000","last_peered":"2024-04-24T23:09:56.935247+0000","last_clean":"2024-04-24T23:09:56.935247+0000","last_became_active":"2024-04-24T23:09:56.928293+0000","last_became_peered":"2024-04-24T23:09:56.928293+0000","last_unstale":"2024-04-24T23:09:56.935247+0000","last_undegraded":"2024-04-24T23:09:56.935247+0000","last_fullsized":"2024-04-24T23:09:56.935247+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919578+0000","last_change":"2024-04-24T23:09:55.903234+0000","last_active":"2024-04-24T23:09:56.919578+0000","last_peered":"2024-04-24T23:09:56.919578+0000","last_clean":"2024-04-24T23:09:56.919578+0000","last_became_active":"2024-04-24T23:09:55.900164+0000","last_became_peered":"2024-04-24T23:09:55.900164+0000","last_unstale":"2024-04-24T23:09:56.919578+0000","last_undegraded":"2024-04-24T23:09:56.919578+0000","last_fullsized":"2024-04-24T23:09:56.919578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":308,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898934+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:56.898934+0000","last_peered":"2024-04-24T23:09:56.898934+0000","last_clean":"2024-04-24T23:09:56.898934+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:56.898934+0000","last_undegraded":"2024-04-24T23:09:56.898934+0000","last_fullsized":"2024-04-24T23:09:56.898934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509566,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":523206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509566,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1171456,"data_stored":532097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":530977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509565,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":530443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1127433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:02.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-24T23:10:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.574+0000 7f1b7a800640 1 Processor -- start 2024-04-24T23:10:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.574+0000 7f1b7a800640 1 -- start start 2024-04-24T23:10:02.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 0x7f1b7406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b7a800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b7415f3c0 0x7f1b7415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b7a800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b74071960 con 0x7f1b7415e8b0 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b7a800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1b74071c40 con 0x7f1b7415f3c0 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b7a800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b74071f20 con 0x7f1b7415abb0 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b7415f3c0 0x7f1b7415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b7415f3c0 0x7f1b7415c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37538/0 (socket says 172.21.15.146:37538) 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b73e00640 1 -- 172.21.15.146:0/731152478 learned_addr learned my addr 172.21.15.146:0/731152478 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b6be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b7415e8b0 0x7f1b7415ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42004/0 (socket says 172.21.15.146:42004) 2024-04-24T23:10:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.575+0000 7f1b73400640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 0x7f1b7406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.576+0000 7f1b73e00640 1 -- 172.21.15.146:0/731152478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 msgr2=0x7f1b7406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.576+0000 7f1b73e00640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 0x7f1b7406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.576+0000 7f1b73e00640 1 -- 172.21.15.146:0/731152478 >> v1:172.21.15.146:6789/0 conn(0x7f1b7415e8b0 legacy=0x7f1b7415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.576+0000 7f1b73e00640 1 -- 172.21.15.146:0/731152478 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b74072200 con 0x7f1b7415f3c0 2024-04-24T23:10:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.576+0000 7f1b73400640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 0x7f1b7406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:02.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b73e00640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415f3c0 0x7f1b7415c7b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009e50 tx=0x7f1b6c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48599f2bc65c95e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b72a00640 1 -- 172.21.15.146:0/731152478 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c036070 con 0x7f1b7415f3c0 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b72a00640 1 -- 172.21.15.146:0/731152478 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c031600 con 0x7f1b7415f3c0 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b72a00640 1 -- 172.21.15.146:0/731152478 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0319d0 con 0x7f1b7415f3c0 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b7a800640 1 -- 172.21.15.146:0/731152478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415f3c0 msgr2=0x7f1b7415c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.577+0000 7f1b7a800640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415f3c0 0x7f1b7415c7b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009e50 tx=0x7f1b6c02a680 comp rx=0 tx=0).stop 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 -- 172.21.15.146:0/731152478 shutdown_connections 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415f3c0 0x7f1b7415c7b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 --2- 172.21.15.146:0/731152478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415abb0 0x7f1b7406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 -- 172.21.15.146:0/731152478 >> 172.21.15.146:0/731152478 conn(0x7f1b7406b140 msgr2=0x7f1b7406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 -- 172.21.15.146:0/731152478 shutdown_connections 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.578+0000 7f1b7a800640 1 -- 172.21.15.146:0/731152478 wait complete. 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.579+0000 7f1b7a800640 1 Processor -- start 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.580+0000 7f1b7a800640 1 -- start start 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.580+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7415e8b0 0x7f1b740ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415f3c0 0x7f1b74155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b7a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415c120 con 0x7f1b7415abb0 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b7a800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7415bfa0 con 0x7f1b7415e8b0 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b7a800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7415ccf0 con 0x7f1b7415f3c0 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37552/0 (socket says 172.21.15.146:37552) 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 -- 172.21.15.146:0/433096568 learned_addr learned my addr 172.21.15.146:0/433096568 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 -- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415f3c0 msgr2=0x7f1b74155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415f3c0 0x7f1b74155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 -- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7415e8b0 msgr2=0x7f1b740ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7415e8b0 0x7f1b740ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 -- 172.21.15.146:0/433096568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b740ce970 con 0x7f1b7415abb0 2024-04-24T23:10:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.581+0000 7f1b73400640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c7f0 tx=0x7f1b6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.582+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64015070 con 0x7f1b7415abb0 2024-04-24T23:10:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.582+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64007a30 con 0x7f1b7415abb0 2024-04-24T23:10:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.582+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b740cec50 con 0x7f1b7415abb0 2024-04-24T23:10:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.582+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64007e00 con 0x7f1b7415abb0 2024-04-24T23:10:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.582+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b740cf210 con 0x7f1b7415abb0 2024-04-24T23:10:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.583+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7404f5a0 con 0x7f1b7415abb0 2024-04-24T23:10:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.584+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b64018070 con 0x7f1b7415abb0 2024-04-24T23:10:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.585+0000 7f1b6b400640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 0x7f1b5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.585+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f1b6408af50 con 0x7f1b7415abb0 2024-04-24T23:10:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.586+0000 7f1b6be00640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 0x7f1b5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.587+0000 7f1b6be00640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 0x7f1b5006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f60 tx=0x7f1b5c007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.589+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b64059800 con 0x7f1b7415abb0 2024-04-24T23:10:02.839 INFO:tasks.ceph.mds.d.smithi203.stderr:2024-04-24T23:10:02.837+0000 7f70e6400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:10:02.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.863+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1b7406b730 con 0x7f1b7415abb0 2024-04-24T23:10:02.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.863+0000 7f1b6b400640 1 -- 172.21.15.146:0/433096568 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1433 (secure 0 0 0) 0x7f1b64059100 con 0x7f1b7415abb0 2024-04-24T23:10:02.865 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:02.865 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":632,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1713999582,"num_in_osds":8,"osd_in_since":1713999573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":265871360,"bytes_avail":772828241920,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":83,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7956}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-04-24T23:09:43.810815+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 msgr2=0x7f1b5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 0x7f1b5006e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f60 tx=0x7f1b5c007a00 comp rx=0 tx=0).stop 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 msgr2=0x7f1b74148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c7f0 tx=0x7f1b6400cbf0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 shutdown_connections 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b5006be30 0x7f1b5006e2f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b7415f3c0 0x7f1b74155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b7415e8b0 0x7f1b740ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 --2- 172.21.15.146:0/433096568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7415abb0 0x7f1b74148db0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 >> 172.21.15.146:0/433096568 conn(0x7f1b7406b140 msgr2=0x7f1b74070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 shutdown_connections 2024-04-24T23:10:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:02.866+0000 7f1b7a800640 1 -- 172.21.15.146:0/433096568 wait complete. 2024-04-24T23:10:02.887 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-24T23:10:02.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.086+0000 7f730be00640 1 Processor -- start 2024-04-24T23:10:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.086+0000 7f730be00640 1 -- start start 2024-04-24T23:10:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f730c15a410 0x7f730c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730c15e330 0x7f730c0709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f730c06e120 con 0x7f730c15e330 2024-04-24T23:10:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f730c06e400 con 0x7f730c15a410 2024-04-24T23:10:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.087+0000 7f730be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f730c06e6e0 con 0x7f730c06dc50 2024-04-24T23:10:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730c15e330 0x7f730c0709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730c15e330 0x7f730c0709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37564/0 (socket says 172.21.15.146:37564) 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 -- 172.21.15.146:0/3648732218 learned_addr learned my addr 172.21.15.146:0/3648732218 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730aa00640 1 --2- 172.21.15.146:0/3648732218 >> v2:172.21.15.203:3300/0 conn(0x7f730c15a410 0x7f730c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f7302000640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 -- 172.21.15.146:0/3648732218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 msgr2=0x7f730c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 -- 172.21.15.146:0/3648732218 >> v2:172.21.15.203:3300/0 conn(0x7f730c15a410 msgr2=0x7f730c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 --2- 172.21.15.146:0/3648732218 >> v2:172.21.15.203:3300/0 conn(0x7f730c15a410 0x7f730c0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.088+0000 7f730b400640 1 -- 172.21.15.146:0/3648732218 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c0af130 con 0x7f730c15e330 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.089+0000 7f730b400640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c0709d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f730c0b4950 tx=0x7f730402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a40d8b6a5aa3a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.090+0000 7f730a000640 1 -- 172.21.15.146:0/3648732218 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304036070 con 0x7f730c15e330 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.090+0000 7f730a000640 1 -- 172.21.15.146:0/3648732218 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304031600 con 0x7f730c15e330 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.090+0000 7f730a000640 1 -- 172.21.15.146:0/3648732218 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040319d0 con 0x7f730c15e330 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.090+0000 7f730be00640 1 -- 172.21.15.146:0/3648732218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 msgr2=0x7f730c0709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.090+0000 7f730be00640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c0709d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f730c0b4950 tx=0x7f730402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 -- 172.21.15.146:0/3648732218 shutdown_connections 2024-04-24T23:10:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c0709d0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 --2- 172.21.15.146:0/3648732218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 --2- 172.21.15.146:0/3648732218 >> v2:172.21.15.203:3300/0 conn(0x7f730c15a410 0x7f730c0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 -- 172.21.15.146:0/3648732218 >> 172.21.15.146:0/3648732218 conn(0x7f730c06b320 msgr2=0x7f730c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 -- 172.21.15.146:0/3648732218 shutdown_connections 2024-04-24T23:10:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.091+0000 7f730be00640 1 -- 172.21.15.146:0/3648732218 wait complete. 2024-04-24T23:10:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.092+0000 7f730be00640 1 Processor -- start 2024-04-24T23:10:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.093+0000 7f730be00640 1 -- start start 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.093+0000 7f730be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.093+0000 7f730be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c15a410 0x7f730c0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f730c0cfec0 con 0x7f730c15e330 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f730c0cfd40 con 0x7f730c15a410 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f730c0d0040 con 0x7f730c06dc50 2024-04-24T23:10:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37568/0 (socket says 172.21.15.146:37568) 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 -- 172.21.15.146:0/3975439740 learned_addr learned my addr 172.21.15.146:0/3975439740 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730aa00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f7302000640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c15a410 0x7f730c0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 -- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 msgr2=0x7f730c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 -- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c15a410 msgr2=0x7f730c0ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c15a410 0x7f730c0ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.094+0000 7f730b400640 1 -- 172.21.15.146:0/3975439740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c0c4bb0 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f730b400640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f7304034040 tx=0x7f7304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304036050 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304042070 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c0c4e90 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304009510 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.095+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c0c5450 con 0x7f730c15e330 2024-04-24T23:10:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.096+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c04f500 con 0x7f730c15e330 2024-04-24T23:10:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.097+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7304007bd0 con 0x7f730c15e330 2024-04-24T23:10:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.098+0000 7f7303400640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.098+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f73040abee0 con 0x7f730c15e330 2024-04-24T23:10:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.099+0000 7f730aa00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.100+0000 7f730aa00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 0x7f72e806e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006fd0 tx=0x7f72fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:03.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.102+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f730407a6f0 con 0x7f730c15e330 2024-04-24T23:10:03.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.296+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f730c06d410 con 0x7f72e806be30 2024-04-24T23:10:03.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.315+0000 7f7303400640 1 -- 172.21.15.146:0/3975439740 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252019 (secure 0 0 0) 0x7f730c06d410 con 0x7f72e806be30 2024-04-24T23:10:03.320 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:03.321 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 msgr2=0x7f72e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 0x7f72e806e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006fd0 tx=0x7f72fc008040 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 msgr2=0x7f730c1f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f7304034040 tx=0x7f7304004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 shutdown_connections 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730c15e330 0x7f730c1f0dc0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c15a410 0x7f730c0ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f72e806be30 0x7f72e806e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 --2- 172.21.15.146:0/3975439740 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f730c06dc50 0x7f730c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 >> 172.21.15.146:0/3975439740 conn(0x7f730c06b320 msgr2=0x7f730c1591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 shutdown_connections 2024-04-24T23:10:03.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:03.321+0000 7f730be00640 1 -- 172.21.15.146:0/3975439740 wait complete. 2024-04-24T23:10:03.341 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-04-24T23:10:01.816593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259640,"kb_used_data":10172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715080,"statfs":{"total":773094113280,"available":772828241920,"internally_reserved":0,"allocated":10416128,"data_stored":5418476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002215"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946727+0000","last_change":"2024-04-24T23:09:56.940409+0000","last_active":"2024-04-24T23:09:56.946727+0000","last_peered":"2024-04-24T23:09:56.946727+0000","last_clean":"2024-04-24T23:09:56.946727+0000","last_became_active":"2024-04-24T23:09:56.940129+0000","last_became_peered":"2024-04-24T23:09:56.940129+0000","last_unstale":"2024-04-24T23:09:56.946727+0000","last_undegraded":"2024-04-24T23:09:56.946727+0000","last_fullsized":"2024-04-24T23:09:56.946727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925255+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.925255+0000","last_peered":"2024-04-24T23:09:56.925255+0000","last_clean":"2024-04-24T23:09:56.925255+0000","last_became_active":"2024-04-24T23:09:56.917999+0000","last_became_peered":"2024-04-24T23:09:56.917999+0000","last_unstale":"2024-04-24T23:09:56.925255+0000","last_undegraded":"2024-04-24T23:09:56.925255+0000","last_fullsized":"2024-04-24T23:09:56.925255+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:13.452094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945404+0000","last_change":"2024-04-24T23:09:56.924994+0000","last_active":"2024-04-24T23:09:56.945404+0000","last_peered":"2024-04-24T23:09:56.945404+0000","last_clean":"2024-04-24T23:09:56.945404+0000","last_became_active":"2024-04-24T23:09:56.921828+0000","last_became_peered":"2024-04-24T23:09:56.921828+0000","last_unstale":"2024-04-24T23:09:56.945404+0000","last_undegraded":"2024-04-24T23:09:56.945404+0000","last_fullsized":"2024-04-24T23:09:56.945404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:36.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946983+0000","last_change":"2024-04-24T23:09:56.932969+0000","last_active":"2024-04-24T23:09:56.946983+0000","last_peered":"2024-04-24T23:09:56.946983+0000","last_clean":"2024-04-24T23:09:56.946983+0000","last_became_active":"2024-04-24T23:09:56.932433+0000","last_became_peered":"2024-04-24T23:09:56.932433+0000","last_unstale":"2024-04-24T23:09:56.946983+0000","last_undegraded":"2024-04-24T23:09:56.946983+0000","last_fullsized":"2024-04-24T23:09:56.946983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:24.516515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937107+0000","last_change":"2024-04-24T23:09:56.933631+0000","last_active":"2024-04-24T23:09:56.937107+0000","last_peered":"2024-04-24T23:09:56.937107+0000","last_clean":"2024-04-24T23:09:56.937107+0000","last_became_active":"2024-04-24T23:09:56.932689+0000","last_became_peered":"2024-04-24T23:09:56.932689+0000","last_unstale":"2024-04-24T23:09:56.937107+0000","last_undegraded":"2024-04-24T23:09:56.937107+0000","last_fullsized":"2024-04-24T23:09:56.937107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946339+0000","last_change":"2024-04-24T23:09:56.939868+0000","last_active":"2024-04-24T23:09:56.946339+0000","last_peered":"2024-04-24T23:09:56.946339+0000","last_clean":"2024-04-24T23:09:56.946339+0000","last_became_active":"2024-04-24T23:09:56.939581+0000","last_became_peered":"2024-04-24T23:09:56.939581+0000","last_unstale":"2024-04-24T23:09:56.946339+0000","last_undegraded":"2024-04-24T23:09:56.946339+0000","last_fullsized":"2024-04-24T23:09:56.946339+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:50.677141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952631+0000","last_change":"2024-04-24T23:09:56.949125+0000","last_active":"2024-04-24T23:09:56.952631+0000","last_peered":"2024-04-24T23:09:56.952631+0000","last_clean":"2024-04-24T23:09:56.952631+0000","last_became_active":"2024-04-24T23:09:56.948828+0000","last_became_peered":"2024-04-24T23:09:56.948828+0000","last_unstale":"2024-04-24T23:09:56.952631+0000","last_undegraded":"2024-04-24T23:09:56.952631+0000","last_fullsized":"2024-04-24T23:09:56.952631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:02.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938647+0000","last_change":"2024-04-24T23:09:56.927536+0000","last_active":"2024-04-24T23:09:56.938647+0000","last_peered":"2024-04-24T23:09:56.938647+0000","last_clean":"2024-04-24T23:09:56.938647+0000","last_became_active":"2024-04-24T23:09:56.926961+0000","last_became_peered":"2024-04-24T23:09:56.926961+0000","last_unstale":"2024-04-24T23:09:56.938647+0000","last_undegraded":"2024-04-24T23:09:56.938647+0000","last_fullsized":"2024-04-24T23:09:56.938647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:25.403855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.938149+0000","last_change":"2024-04-24T23:09:56.936517+0000","last_active":"2024-04-24T23:09:56.938149+0000","last_peered":"2024-04-24T23:09:56.938149+0000","last_clean":"2024-04-24T23:09:56.938149+0000","last_became_active":"2024-04-24T23:09:56.936129+0000","last_became_peered":"2024-04-24T23:09:56.936129+0000","last_unstale":"2024-04-24T23:09:56.938149+0000","last_undegraded":"2024-04-24T23:09:56.938149+0000","last_fullsized":"2024-04-24T23:09:56.938149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:46.003977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945923+0000","last_change":"2024-04-24T23:09:56.928806+0000","last_active":"2024-04-24T23:09:56.945923+0000","last_peered":"2024-04-24T23:09:56.945923+0000","last_clean":"2024-04-24T23:09:56.945923+0000","last_became_active":"2024-04-24T23:09:56.925611+0000","last_became_peered":"2024-04-24T23:09:56.925611+0000","last_unstale":"2024-04-24T23:09:56.945923+0000","last_undegraded":"2024-04-24T23:09:56.945923+0000","last_fullsized":"2024-04-24T23:09:56.945923+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:55.912721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952132+0000","last_change":"2024-04-24T23:09:56.950003+0000","last_active":"2024-04-24T23:09:56.952132+0000","last_peered":"2024-04-24T23:09:56.952132+0000","last_clean":"2024-04-24T23:09:56.952132+0000","last_became_active":"2024-04-24T23:09:56.949677+0000","last_became_peered":"2024-04-24T23:09:56.949677+0000","last_unstale":"2024-04-24T23:09:56.952132+0000","last_undegraded":"2024-04-24T23:09:56.952132+0000","last_fullsized":"2024-04-24T23:09:56.952132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:27:59.773669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947104+0000","last_change":"2024-04-24T23:09:56.941322+0000","last_active":"2024-04-24T23:09:56.947104+0000","last_peered":"2024-04-24T23:09:56.947104+0000","last_clean":"2024-04-24T23:09:56.947104+0000","last_became_active":"2024-04-24T23:09:56.941057+0000","last_became_peered":"2024-04-24T23:09:56.941057+0000","last_unstale":"2024-04-24T23:09:56.947104+0000","last_undegraded":"2024-04-24T23:09:56.947104+0000","last_fullsized":"2024-04-24T23:09:56.947104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:34.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.929799+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.929479+0000","last_became_peered":"2024-04-24T23:09:56.929479+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:08.145163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949645+0000","last_change":"2024-04-24T23:09:56.946705+0000","last_active":"2024-04-24T23:09:56.949645+0000","last_peered":"2024-04-24T23:09:56.949645+0000","last_clean":"2024-04-24T23:09:56.949645+0000","last_became_active":"2024-04-24T23:09:56.946427+0000","last_became_peered":"2024-04-24T23:09:56.946427+0000","last_unstale":"2024-04-24T23:09:56.949645+0000","last_undegraded":"2024-04-24T23:09:56.949645+0000","last_fullsized":"2024-04-24T23:09:56.949645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947290+0000","last_change":"2024-04-24T23:09:56.931525+0000","last_active":"2024-04-24T23:09:56.947290+0000","last_peered":"2024-04-24T23:09:56.947290+0000","last_clean":"2024-04-24T23:09:56.947290+0000","last_became_active":"2024-04-24T23:09:56.925661+0000","last_became_peered":"2024-04-24T23:09:56.925661+0000","last_unstale":"2024-04-24T23:09:56.947290+0000","last_undegraded":"2024-04-24T23:09:56.947290+0000","last_fullsized":"2024-04-24T23:09:56.947290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:00.260147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932106+0000","last_change":"2024-04-24T23:09:56.919116+0000","last_active":"2024-04-24T23:09:56.932106+0000","last_peered":"2024-04-24T23:09:56.932106+0000","last_clean":"2024-04-24T23:09:56.932106+0000","last_became_active":"2024-04-24T23:09:56.918824+0000","last_became_peered":"2024-04-24T23:09:56.918824+0000","last_unstale":"2024-04-24T23:09:56.932106+0000","last_undegraded":"2024-04-24T23:09:56.932106+0000","last_fullsized":"2024-04-24T23:09:56.932106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:46.503606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949070+0000","last_change":"2024-04-24T23:09:56.944906+0000","last_active":"2024-04-24T23:09:56.949070+0000","last_peered":"2024-04-24T23:09:56.949070+0000","last_clean":"2024-04-24T23:09:56.949070+0000","last_became_active":"2024-04-24T23:09:56.944626+0000","last_became_peered":"2024-04-24T23:09:56.944626+0000","last_unstale":"2024-04-24T23:09:56.949070+0000","last_undegraded":"2024-04-24T23:09:56.949070+0000","last_fullsized":"2024-04-24T23:09:56.949070+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:28.600192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947065+0000","last_change":"2024-04-24T23:09:56.925763+0000","last_active":"2024-04-24T23:09:56.947065+0000","last_peered":"2024-04-24T23:09:56.947065+0000","last_clean":"2024-04-24T23:09:56.947065+0000","last_became_active":"2024-04-24T23:09:56.925443+0000","last_became_peered":"2024-04-24T23:09:56.925443+0000","last_unstale":"2024-04-24T23:09:56.947065+0000","last_undegraded":"2024-04-24T23:09:56.947065+0000","last_fullsized":"2024-04-24T23:09:56.947065+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:13:42.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935106+0000","last_change":"2024-04-24T23:09:56.930342+0000","last_active":"2024-04-24T23:09:56.935106+0000","last_peered":"2024-04-24T23:09:56.935106+0000","last_clean":"2024-04-24T23:09:56.935106+0000","last_became_active":"2024-04-24T23:09:56.929614+0000","last_became_peered":"2024-04-24T23:09:56.929614+0000","last_unstale":"2024-04-24T23:09:56.935106+0000","last_undegraded":"2024-04-24T23:09:56.935106+0000","last_fullsized":"2024-04-24T23:09:56.935106+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946212+0000","last_change":"2024-04-24T23:09:56.941593+0000","last_active":"2024-04-24T23:09:56.946212+0000","last_peered":"2024-04-24T23:09:56.946212+0000","last_clean":"2024-04-24T23:09:56.946212+0000","last_became_active":"2024-04-24T23:09:56.939699+0000","last_became_peered":"2024-04-24T23:09:56.939699+0000","last_unstale":"2024-04-24T23:09:56.946212+0000","last_undegraded":"2024-04-24T23:09:56.946212+0000","last_fullsized":"2024-04-24T23:09:56.946212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:57.844085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937154+0000","last_change":"2024-04-24T23:09:56.934769+0000","last_active":"2024-04-24T23:09:56.937154+0000","last_peered":"2024-04-24T23:09:56.937154+0000","last_clean":"2024-04-24T23:09:56.937154+0000","last_became_active":"2024-04-24T23:09:56.933079+0000","last_became_peered":"2024-04-24T23:09:56.933079+0000","last_unstale":"2024-04-24T23:09:56.937154+0000","last_undegraded":"2024-04-24T23:09:56.937154+0000","last_fullsized":"2024-04-24T23:09:56.937154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.929291+0000","last_change":"2024-04-24T23:09:56.927450+0000","last_active":"2024-04-24T23:09:56.929291+0000","last_peered":"2024-04-24T23:09:56.929291+0000","last_clean":"2024-04-24T23:09:56.929291+0000","last_became_active":"2024-04-24T23:09:56.927016+0000","last_became_peered":"2024-04-24T23:09:56.927016+0000","last_unstale":"2024-04-24T23:09:56.929291+0000","last_undegraded":"2024-04-24T23:09:56.929291+0000","last_fullsized":"2024-04-24T23:09:56.929291+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937104+0000","last_change":"2024-04-24T23:09:56.933202+0000","last_active":"2024-04-24T23:09:56.937104+0000","last_peered":"2024-04-24T23:09:56.937104+0000","last_clean":"2024-04-24T23:09:56.937104+0000","last_became_active":"2024-04-24T23:09:56.932903+0000","last_became_peered":"2024-04-24T23:09:56.932903+0000","last_unstale":"2024-04-24T23:09:56.937104+0000","last_undegraded":"2024-04-24T23:09:56.937104+0000","last_fullsized":"2024-04-24T23:09:56.937104+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:19.829265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933845+0000","last_change":"2024-04-24T23:09:56.927531+0000","last_active":"2024-04-24T23:09:56.933845+0000","last_peered":"2024-04-24T23:09:56.933845+0000","last_clean":"2024-04-24T23:09:56.933845+0000","last_became_active":"2024-04-24T23:09:56.927243+0000","last_became_peered":"2024-04-24T23:09:56.927243+0000","last_unstale":"2024-04-24T23:09:56.933845+0000","last_undegraded":"2024-04-24T23:09:56.933845+0000","last_fullsized":"2024-04-24T23:09:56.933845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.928096+0000","last_change":"2024-04-24T23:09:56.925843+0000","last_active":"2024-04-24T23:09:56.928096+0000","last_peered":"2024-04-24T23:09:56.928096+0000","last_clean":"2024-04-24T23:09:56.928096+0000","last_became_active":"2024-04-24T23:09:56.925556+0000","last_became_peered":"2024-04-24T23:09:56.925556+0000","last_unstale":"2024-04-24T23:09:56.928096+0000","last_undegraded":"2024-04-24T23:09:56.928096+0000","last_fullsized":"2024-04-24T23:09:56.928096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:44.189224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.920681+0000","last_change":"2024-04-24T23:09:56.915444+0000","last_active":"2024-04-24T23:09:56.920681+0000","last_peered":"2024-04-24T23:09:56.920681+0000","last_clean":"2024-04-24T23:09:56.920681+0000","last_became_active":"2024-04-24T23:09:56.914704+0000","last_became_peered":"2024-04-24T23:09:56.914704+0000","last_unstale":"2024-04-24T23:09:56.920681+0000","last_undegraded":"2024-04-24T23:09:56.920681+0000","last_fullsized":"2024-04-24T23:09:56.920681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:45.239398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.945435+0000","last_change":"2024-04-24T23:09:56.925404+0000","last_active":"2024-04-24T23:09:56.945435+0000","last_peered":"2024-04-24T23:09:56.945435+0000","last_clean":"2024-04-24T23:09:56.945435+0000","last_became_active":"2024-04-24T23:09:56.925111+0000","last_became_peered":"2024-04-24T23:09:56.925111+0000","last_unstale":"2024-04-24T23:09:56.945435+0000","last_undegraded":"2024-04-24T23:09:56.945435+0000","last_fullsized":"2024-04-24T23:09:56.945435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:31.210094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.941120+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.940621+0000","last_became_peered":"2024-04-24T23:09:56.940621+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:01.281459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937132+0000","last_change":"2024-04-24T23:09:56.933867+0000","last_active":"2024-04-24T23:09:56.937132+0000","last_peered":"2024-04-24T23:09:56.937132+0000","last_clean":"2024-04-24T23:09:56.937132+0000","last_became_active":"2024-04-24T23:09:56.933359+0000","last_became_peered":"2024-04-24T23:09:56.933359+0000","last_unstale":"2024-04-24T23:09:56.937132+0000","last_undegraded":"2024-04-24T23:09:56.937132+0000","last_fullsized":"2024-04-24T23:09:56.937132+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936138+0000","last_change":"2024-04-24T23:09:56.931228+0000","last_active":"2024-04-24T23:09:56.936138+0000","last_peered":"2024-04-24T23:09:56.936138+0000","last_clean":"2024-04-24T23:09:56.936138+0000","last_became_active":"2024-04-24T23:09:56.930831+0000","last_became_peered":"2024-04-24T23:09:56.930831+0000","last_unstale":"2024-04-24T23:09:56.936138+0000","last_undegraded":"2024-04-24T23:09:56.936138+0000","last_fullsized":"2024-04-24T23:09:56.936138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:35.806223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.936036+0000","last_change":"2024-04-24T23:09:56.932993+0000","last_active":"2024-04-24T23:09:56.936036+0000","last_peered":"2024-04-24T23:09:56.936036+0000","last_clean":"2024-04-24T23:09:56.936036+0000","last_became_active":"2024-04-24T23:09:56.932707+0000","last_became_peered":"2024-04-24T23:09:56.932707+0000","last_unstale":"2024-04-24T23:09:56.936036+0000","last_undegraded":"2024-04-24T23:09:56.936036+0000","last_fullsized":"2024-04-24T23:09:56.936036+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.930748+0000","last_change":"2024-04-24T23:09:56.917318+0000","last_active":"2024-04-24T23:09:56.930748+0000","last_peered":"2024-04-24T23:09:56.930748+0000","last_clean":"2024-04-24T23:09:56.930748+0000","last_became_active":"2024-04-24T23:09:56.916979+0000","last_became_peered":"2024-04-24T23:09:56.916979+0000","last_unstale":"2024-04-24T23:09:56.930748+0000","last_undegraded":"2024-04-24T23:09:56.930748+0000","last_fullsized":"2024-04-24T23:09:56.930748+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.944480+0000","last_change":"2024-04-24T23:09:56.935573+0000","last_active":"2024-04-24T23:09:56.944480+0000","last_peered":"2024-04-24T23:09:56.944480+0000","last_clean":"2024-04-24T23:09:56.944480+0000","last_became_active":"2024-04-24T23:09:56.935267+0000","last_became_peered":"2024-04-24T23:09:56.935267+0000","last_unstale":"2024-04-24T23:09:56.944480+0000","last_undegraded":"2024-04-24T23:09:56.944480+0000","last_fullsized":"2024-04-24T23:09:56.944480+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950958+0000","last_change":"2024-04-24T23:09:55.878169+0000","last_active":"2024-04-24T23:09:56.950958+0000","last_peered":"2024-04-24T23:09:56.950958+0000","last_clean":"2024-04-24T23:09:56.950958+0000","last_became_active":"2024-04-24T23:09:55.877826+0000","last_became_peered":"2024-04-24T23:09:55.877826+0000","last_unstale":"2024-04-24T23:09:56.950958+0000","last_undegraded":"2024-04-24T23:09:56.950958+0000","last_fullsized":"2024-04-24T23:09:56.950958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:29.372680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.946413+0000","last_change":"2024-04-24T23:09:56.942471+0000","last_active":"2024-04-24T23:09:56.946413+0000","last_peered":"2024-04-24T23:09:56.946413+0000","last_clean":"2024-04-24T23:09:56.946413+0000","last_became_active":"2024-04-24T23:09:56.942154+0000","last_became_peered":"2024-04-24T23:09:56.942154+0000","last_unstale":"2024-04-24T23:09:56.946413+0000","last_undegraded":"2024-04-24T23:09:56.946413+0000","last_fullsized":"2024-04-24T23:09:56.946413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:05.671071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953281+0000","last_change":"2024-04-24T23:09:55.885462+0000","last_active":"2024-04-24T23:09:56.953281+0000","last_peered":"2024-04-24T23:09:56.953281+0000","last_clean":"2024-04-24T23:09:56.953281+0000","last_became_active":"2024-04-24T23:09:55.885156+0000","last_became_peered":"2024-04-24T23:09:55.885156+0000","last_unstale":"2024-04-24T23:09:56.953281+0000","last_undegraded":"2024-04-24T23:09:56.953281+0000","last_fullsized":"2024-04-24T23:09:56.953281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:32.759204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.948053+0000","last_change":"2024-04-24T23:09:56.945032+0000","last_active":"2024-04-24T23:09:56.948053+0000","last_peered":"2024-04-24T23:09:56.948053+0000","last_clean":"2024-04-24T23:09:56.948053+0000","last_became_active":"2024-04-24T23:09:56.944757+0000","last_became_peered":"2024-04-24T23:09:56.944757+0000","last_unstale":"2024-04-24T23:09:56.948053+0000","last_undegraded":"2024-04-24T23:09:56.948053+0000","last_fullsized":"2024-04-24T23:09:56.948053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:16.993406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953127+0000","last_change":"2024-04-24T23:09:55.901246+0000","last_active":"2024-04-24T23:09:56.953127+0000","last_peered":"2024-04-24T23:09:56.953127+0000","last_clean":"2024-04-24T23:09:56.953127+0000","last_became_active":"2024-04-24T23:09:55.900510+0000","last_became_peered":"2024-04-24T23:09:55.900510+0000","last_unstale":"2024-04-24T23:09:56.953127+0000","last_undegraded":"2024-04-24T23:09:56.953127+0000","last_fullsized":"2024-04-24T23:09:56.953127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:33.972115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942803+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:56.942803+0000","last_peered":"2024-04-24T23:09:56.942803+0000","last_clean":"2024-04-24T23:09:56.942803+0000","last_became_active":"2024-04-24T23:09:56.920155+0000","last_became_peered":"2024-04-24T23:09:56.920155+0000","last_unstale":"2024-04-24T23:09:56.942803+0000","last_undegraded":"2024-04-24T23:09:56.942803+0000","last_fullsized":"2024-04-24T23:09:56.942803+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:28.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955535+0000","last_change":"2024-04-24T23:09:55.888998+0000","last_active":"2024-04-24T23:09:56.955535+0000","last_peered":"2024-04-24T23:09:56.955535+0000","last_clean":"2024-04-24T23:09:56.955535+0000","last_became_active":"2024-04-24T23:09:55.888687+0000","last_became_peered":"2024-04-24T23:09:55.888687+0000","last_unstale":"2024-04-24T23:09:56.955535+0000","last_undegraded":"2024-04-24T23:09:56.955535+0000","last_fullsized":"2024-04-24T23:09:56.955535+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.825617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935285+0000","last_change":"2024-04-24T23:09:56.937409+0000","last_active":"2024-04-24T23:09:57.935285+0000","last_peered":"2024-04-24T23:09:57.935285+0000","last_clean":"2024-04-24T23:09:57.935285+0000","last_became_active":"2024-04-24T23:09:56.934198+0000","last_became_peered":"2024-04-24T23:09:56.934198+0000","last_unstale":"2024-04-24T23:09:57.935285+0000","last_undegraded":"2024-04-24T23:09:57.935285+0000","last_fullsized":"2024-04-24T23:09:57.935285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:30.100419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952882+0000","last_change":"2024-04-24T23:09:55.895038+0000","last_active":"2024-04-24T23:09:56.952882+0000","last_peered":"2024-04-24T23:09:56.952882+0000","last_clean":"2024-04-24T23:09:56.952882+0000","last_became_active":"2024-04-24T23:09:55.894708+0000","last_became_peered":"2024-04-24T23:09:55.894708+0000","last_unstale":"2024-04-24T23:09:56.952882+0000","last_undegraded":"2024-04-24T23:09:56.952882+0000","last_fullsized":"2024-04-24T23:09:56.952882+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952187+0000","last_change":"2024-04-24T23:09:56.950756+0000","last_active":"2024-04-24T23:09:56.952187+0000","last_peered":"2024-04-24T23:09:56.952187+0000","last_clean":"2024-04-24T23:09:56.952187+0000","last_became_active":"2024-04-24T23:09:56.950487+0000","last_became_peered":"2024-04-24T23:09:56.950487+0000","last_unstale":"2024-04-24T23:09:56.952187+0000","last_undegraded":"2024-04-24T23:09:56.952187+0000","last_fullsized":"2024-04-24T23:09:56.952187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935400+0000","last_change":"2024-04-24T23:09:55.902440+0000","last_active":"2024-04-24T23:09:57.935400+0000","last_peered":"2024-04-24T23:09:57.935400+0000","last_clean":"2024-04-24T23:09:57.935400+0000","last_became_active":"2024-04-24T23:09:55.901950+0000","last_became_peered":"2024-04-24T23:09:55.901950+0000","last_unstale":"2024-04-24T23:09:57.935400+0000","last_undegraded":"2024-04-24T23:09:57.935400+0000","last_fullsized":"2024-04-24T23:09:57.935400+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:38:35.121590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941364+0000","last_change":"2024-04-24T23:09:56.935846+0000","last_active":"2024-04-24T23:09:56.941364+0000","last_peered":"2024-04-24T23:09:56.941364+0000","last_clean":"2024-04-24T23:09:56.941364+0000","last_became_active":"2024-04-24T23:09:56.935571+0000","last_became_peered":"2024-04-24T23:09:56.935571+0000","last_unstale":"2024-04-24T23:09:56.941364+0000","last_undegraded":"2024-04-24T23:09:56.941364+0000","last_fullsized":"2024-04-24T23:09:56.941364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:32:59.681587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.906824+0000","last_change":"2024-04-24T23:09:55.899264+0000","last_active":"2024-04-24T23:09:56.906824+0000","last_peered":"2024-04-24T23:09:56.906824+0000","last_clean":"2024-04-24T23:09:56.906824+0000","last_became_active":"2024-04-24T23:09:55.898514+0000","last_became_peered":"2024-04-24T23:09:55.898514+0000","last_unstale":"2024-04-24T23:09:56.906824+0000","last_undegraded":"2024-04-24T23:09:56.906824+0000","last_fullsized":"2024-04-24T23:09:56.906824+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:24.586695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937832+0000","last_change":"2024-04-24T23:09:56.931992+0000","last_active":"2024-04-24T23:09:56.937832+0000","last_peered":"2024-04-24T23:09:56.937832+0000","last_clean":"2024-04-24T23:09:56.937832+0000","last_became_active":"2024-04-24T23:09:56.931619+0000","last_became_peered":"2024-04-24T23:09:56.931619+0000","last_unstale":"2024-04-24T23:09:56.937832+0000","last_undegraded":"2024-04-24T23:09:56.937832+0000","last_fullsized":"2024-04-24T23:09:56.937832+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898773+0000","last_change":"2024-04-24T23:09:55.897787+0000","last_active":"2024-04-24T23:09:56.898773+0000","last_peered":"2024-04-24T23:09:56.898773+0000","last_clean":"2024-04-24T23:09:56.898773+0000","last_became_active":"2024-04-24T23:09:55.897129+0000","last_became_peered":"2024-04-24T23:09:55.897129+0000","last_unstale":"2024-04-24T23:09:56.898773+0000","last_undegraded":"2024-04-24T23:09:56.898773+0000","last_fullsized":"2024-04-24T23:09:56.898773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:59.244632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941212+0000","last_change":"2024-04-24T23:09:56.940662+0000","last_active":"2024-04-24T23:09:56.941212+0000","last_peered":"2024-04-24T23:09:56.941212+0000","last_clean":"2024-04-24T23:09:56.941212+0000","last_became_active":"2024-04-24T23:09:56.940303+0000","last_became_peered":"2024-04-24T23:09:56.940303+0000","last_unstale":"2024-04-24T23:09:56.941212+0000","last_undegraded":"2024-04-24T23:09:56.941212+0000","last_fullsized":"2024-04-24T23:09:56.941212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:52.609904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901961+0000","last_change":"2024-04-24T23:09:55.901003+0000","last_active":"2024-04-24T23:09:56.901961+0000","last_peered":"2024-04-24T23:09:56.901961+0000","last_clean":"2024-04-24T23:09:56.901961+0000","last_became_active":"2024-04-24T23:09:55.900616+0000","last_became_peered":"2024-04-24T23:09:55.900616+0000","last_unstale":"2024-04-24T23:09:56.901961+0000","last_undegraded":"2024-04-24T23:09:56.901961+0000","last_fullsized":"2024-04-24T23:09:56.901961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:41.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935853+0000","last_change":"2024-04-24T23:09:56.929324+0000","last_active":"2024-04-24T23:09:56.935853+0000","last_peered":"2024-04-24T23:09:56.935853+0000","last_clean":"2024-04-24T23:09:56.935853+0000","last_became_active":"2024-04-24T23:09:56.928972+0000","last_became_peered":"2024-04-24T23:09:56.928972+0000","last_unstale":"2024-04-24T23:09:56.935853+0000","last_undegraded":"2024-04-24T23:09:56.935853+0000","last_fullsized":"2024-04-24T23:09:56.935853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:20.967828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.909826+0000","last_change":"2024-04-24T23:09:55.897350+0000","last_active":"2024-04-24T23:09:56.909826+0000","last_peered":"2024-04-24T23:09:56.909826+0000","last_clean":"2024-04-24T23:09:56.909826+0000","last_became_active":"2024-04-24T23:09:55.896165+0000","last_became_peered":"2024-04-24T23:09:55.896165+0000","last_unstale":"2024-04-24T23:09:56.909826+0000","last_undegraded":"2024-04-24T23:09:56.909826+0000","last_fullsized":"2024-04-24T23:09:56.909826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:39.578060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.942948+0000","last_change":"2024-04-24T23:09:56.937575+0000","last_active":"2024-04-24T23:09:56.942948+0000","last_peered":"2024-04-24T23:09:56.942948+0000","last_clean":"2024-04-24T23:09:56.942948+0000","last_became_active":"2024-04-24T23:09:56.936720+0000","last_became_peered":"2024-04-24T23:09:56.936720+0000","last_unstale":"2024-04-24T23:09:56.942948+0000","last_undegraded":"2024-04-24T23:09:56.942948+0000","last_fullsized":"2024-04-24T23:09:56.942948+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955776+0000","last_change":"2024-04-24T23:09:55.900879+0000","last_active":"2024-04-24T23:09:56.955776+0000","last_peered":"2024-04-24T23:09:56.955776+0000","last_clean":"2024-04-24T23:09:56.955776+0000","last_became_active":"2024-04-24T23:09:55.900538+0000","last_became_peered":"2024-04-24T23:09:55.900538+0000","last_unstale":"2024-04-24T23:09:56.955776+0000","last_undegraded":"2024-04-24T23:09:56.955776+0000","last_fullsized":"2024-04-24T23:09:56.955776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:55.974696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.941176+0000","last_change":"2024-04-24T23:09:56.929691+0000","last_active":"2024-04-24T23:09:56.941176+0000","last_peered":"2024-04-24T23:09:56.941176+0000","last_clean":"2024-04-24T23:09:56.941176+0000","last_became_active":"2024-04-24T23:09:56.928870+0000","last_became_peered":"2024-04-24T23:09:56.928870+0000","last_unstale":"2024-04-24T23:09:56.941176+0000","last_undegraded":"2024-04-24T23:09:56.941176+0000","last_fullsized":"2024-04-24T23:09:56.941176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:05:10.293838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955766+0000","last_change":"2024-04-24T23:09:55.904255+0000","last_active":"2024-04-24T23:09:56.955766+0000","last_peered":"2024-04-24T23:09:56.955766+0000","last_clean":"2024-04-24T23:09:56.955766+0000","last_became_active":"2024-04-24T23:09:55.903943+0000","last_became_peered":"2024-04-24T23:09:55.903943+0000","last_unstale":"2024-04-24T23:09:56.955766+0000","last_undegraded":"2024-04-24T23:09:56.955766+0000","last_fullsized":"2024-04-24T23:09:56.955766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.933825+0000","last_change":"2024-04-24T23:09:56.927437+0000","last_active":"2024-04-24T23:09:56.933825+0000","last_peered":"2024-04-24T23:09:56.933825+0000","last_clean":"2024-04-24T23:09:56.933825+0000","last_became_active":"2024-04-24T23:09:56.927140+0000","last_became_peered":"2024-04-24T23:09:56.927140+0000","last_unstale":"2024-04-24T23:09:56.933825+0000","last_undegraded":"2024-04-24T23:09:56.933825+0000","last_fullsized":"2024-04-24T23:09:56.933825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953002+0000","last_change":"2024-04-24T23:09:55.906123+0000","last_active":"2024-04-24T23:09:56.953002+0000","last_peered":"2024-04-24T23:09:56.953002+0000","last_clean":"2024-04-24T23:09:56.953002+0000","last_became_active":"2024-04-24T23:09:55.905737+0000","last_became_peered":"2024-04-24T23:09:55.905737+0000","last_unstale":"2024-04-24T23:09:56.953002+0000","last_undegraded":"2024-04-24T23:09:56.953002+0000","last_fullsized":"2024-04-24T23:09:56.953002+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:38.938789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.934150+0000","last_change":"2024-04-24T23:09:56.927890+0000","last_active":"2024-04-24T23:09:56.934150+0000","last_peered":"2024-04-24T23:09:56.934150+0000","last_clean":"2024-04-24T23:09:56.934150+0000","last_became_active":"2024-04-24T23:09:56.927603+0000","last_became_peered":"2024-04-24T23:09:56.927603+0000","last_unstale":"2024-04-24T23:09:56.934150+0000","last_undegraded":"2024-04-24T23:09:56.934150+0000","last_fullsized":"2024-04-24T23:09:56.934150+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:01.841132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924687+0000","last_change":"2024-04-24T23:09:55.905608+0000","last_active":"2024-04-24T23:09:56.924687+0000","last_peered":"2024-04-24T23:09:56.924687+0000","last_clean":"2024-04-24T23:09:56.924687+0000","last_became_active":"2024-04-24T23:09:55.904448+0000","last_became_peered":"2024-04-24T23:09:55.904448+0000","last_unstale":"2024-04-24T23:09:56.924687+0000","last_undegraded":"2024-04-24T23:09:56.924687+0000","last_fullsized":"2024-04-24T23:09:56.924687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:20.397547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952525+0000","last_change":"2024-04-24T23:09:56.947148+0000","last_active":"2024-04-24T23:09:56.952525+0000","last_peered":"2024-04-24T23:09:56.952525+0000","last_clean":"2024-04-24T23:09:56.952525+0000","last_became_active":"2024-04-24T23:09:56.946870+0000","last_became_peered":"2024-04-24T23:09:56.946870+0000","last_unstale":"2024-04-24T23:09:56.952525+0000","last_undegraded":"2024-04-24T23:09:56.952525+0000","last_fullsized":"2024-04-24T23:09:56.952525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.924073+0000","last_change":"2024-04-24T23:09:55.903305+0000","last_active":"2024-04-24T23:09:56.924073+0000","last_peered":"2024-04-24T23:09:56.924073+0000","last_clean":"2024-04-24T23:09:56.924073+0000","last_became_active":"2024-04-24T23:09:55.902795+0000","last_became_peered":"2024-04-24T23:09:55.902795+0000","last_unstale":"2024-04-24T23:09:56.924073+0000","last_undegraded":"2024-04-24T23:09:56.924073+0000","last_fullsized":"2024-04-24T23:09:56.924073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935894+0000","last_change":"2024-04-24T23:09:56.935577+0000","last_active":"2024-04-24T23:09:57.935894+0000","last_peered":"2024-04-24T23:09:57.935894+0000","last_clean":"2024-04-24T23:09:57.935894+0000","last_became_active":"2024-04-24T23:09:56.935239+0000","last_became_peered":"2024-04-24T23:09:56.935239+0000","last_unstale":"2024-04-24T23:09:57.935894+0000","last_undegraded":"2024-04-24T23:09:57.935894+0000","last_fullsized":"2024-04-24T23:09:57.935894+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:50.182143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":20,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955864+0000","last_change":"2024-04-24T23:09:55.905976+0000","last_active":"2024-04-24T23:09:56.955864+0000","last_peered":"2024-04-24T23:09:56.955864+0000","last_clean":"2024-04-24T23:09:56.955864+0000","last_became_active":"2024-04-24T23:09:55.905574+0000","last_became_peered":"2024-04-24T23:09:55.905574+0000","last_unstale":"2024-04-24T23:09:56.955864+0000","last_undegraded":"2024-04-24T23:09:56.955864+0000","last_fullsized":"2024-04-24T23:09:56.955864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:05.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936606+0000","last_change":"2024-04-24T23:09:56.940911+0000","last_active":"2024-04-24T23:09:57.936606+0000","last_peered":"2024-04-24T23:09:57.936606+0000","last_clean":"2024-04-24T23:09:57.936606+0000","last_became_active":"2024-04-24T23:09:56.940191+0000","last_became_peered":"2024-04-24T23:09:56.940191+0000","last_unstale":"2024-04-24T23:09:57.936606+0000","last_undegraded":"2024-04-24T23:09:57.936606+0000","last_fullsized":"2024-04-24T23:09:57.936606+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:14.482544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953278+0000","last_change":"2024-04-24T23:09:55.886430+0000","last_active":"2024-04-24T23:09:56.953278+0000","last_peered":"2024-04-24T23:09:56.953278+0000","last_clean":"2024-04-24T23:09:56.953278+0000","last_became_active":"2024-04-24T23:09:55.884169+0000","last_became_peered":"2024-04-24T23:09:55.884169+0000","last_unstale":"2024-04-24T23:09:56.953278+0000","last_undegraded":"2024-04-24T23:09:56.953278+0000","last_fullsized":"2024-04-24T23:09:56.953278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.937512+0000","last_change":"2024-04-24T23:09:56.931170+0000","last_active":"2024-04-24T23:09:56.937512+0000","last_peered":"2024-04-24T23:09:56.937512+0000","last_clean":"2024-04-24T23:09:56.937512+0000","last_became_active":"2024-04-24T23:09:56.930874+0000","last_became_peered":"2024-04-24T23:09:56.930874+0000","last_unstale":"2024-04-24T23:09:56.937512+0000","last_undegraded":"2024-04-24T23:09:56.937512+0000","last_fullsized":"2024-04-24T23:09:56.937512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:05.428941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.950150+0000","last_change":"2024-04-24T23:09:55.883074+0000","last_active":"2024-04-24T23:09:56.950150+0000","last_peered":"2024-04-24T23:09:56.950150+0000","last_clean":"2024-04-24T23:09:56.950150+0000","last_became_active":"2024-04-24T23:09:55.882760+0000","last_became_peered":"2024-04-24T23:09:55.882760+0000","last_unstale":"2024-04-24T23:09:56.950150+0000","last_undegraded":"2024-04-24T23:09:56.950150+0000","last_fullsized":"2024-04-24T23:09:56.950150+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:53.982280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935244+0000","last_change":"2024-04-24T23:09:56.928012+0000","last_active":"2024-04-24T23:09:56.935244+0000","last_peered":"2024-04-24T23:09:56.935244+0000","last_clean":"2024-04-24T23:09:56.935244+0000","last_became_active":"2024-04-24T23:09:56.927729+0000","last_became_peered":"2024-04-24T23:09:56.927729+0000","last_unstale":"2024-04-24T23:09:56.935244+0000","last_undegraded":"2024-04-24T23:09:56.935244+0000","last_fullsized":"2024-04-24T23:09:56.935244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:33.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949330+0000","last_change":"2024-04-24T23:09:55.880315+0000","last_active":"2024-04-24T23:09:56.949330+0000","last_peered":"2024-04-24T23:09:56.949330+0000","last_clean":"2024-04-24T23:09:56.949330+0000","last_became_active":"2024-04-24T23:09:55.880011+0000","last_became_peered":"2024-04-24T23:09:55.880011+0000","last_unstale":"2024-04-24T23:09:56.949330+0000","last_undegraded":"2024-04-24T23:09:56.949330+0000","last_fullsized":"2024-04-24T23:09:56.949330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:43.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943735+0000","last_change":"2024-04-24T23:09:56.930919+0000","last_active":"2024-04-24T23:09:56.943735+0000","last_peered":"2024-04-24T23:09:56.943735+0000","last_clean":"2024-04-24T23:09:56.943735+0000","last_became_active":"2024-04-24T23:09:56.930597+0000","last_became_peered":"2024-04-24T23:09:56.930597+0000","last_unstale":"2024-04-24T23:09:56.943735+0000","last_undegraded":"2024-04-24T23:09:56.943735+0000","last_fullsized":"2024-04-24T23:09:56.943735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:09.506531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.955656+0000","last_change":"2024-04-24T23:09:55.905783+0000","last_active":"2024-04-24T23:09:56.955656+0000","last_peered":"2024-04-24T23:09:56.955656+0000","last_clean":"2024-04-24T23:09:56.955656+0000","last_became_active":"2024-04-24T23:09:55.905510+0000","last_became_peered":"2024-04-24T23:09:55.905510+0000","last_unstale":"2024-04-24T23:09:56.955656+0000","last_undegraded":"2024-04-24T23:09:56.955656+0000","last_fullsized":"2024-04-24T23:09:56.955656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:04.655556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943540+0000","last_change":"2024-04-24T23:09:56.942600+0000","last_active":"2024-04-24T23:09:56.943540+0000","last_peered":"2024-04-24T23:09:56.943540+0000","last_clean":"2024-04-24T23:09:56.943540+0000","last_became_active":"2024-04-24T23:09:56.941777+0000","last_became_peered":"2024-04-24T23:09:56.941777+0000","last_unstale":"2024-04-24T23:09:56.943540+0000","last_undegraded":"2024-04-24T23:09:56.943540+0000","last_fullsized":"2024-04-24T23:09:56.943540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.913506+0000","last_change":"2024-04-24T23:09:55.904339+0000","last_active":"2024-04-24T23:09:56.913506+0000","last_peered":"2024-04-24T23:09:56.913506+0000","last_clean":"2024-04-24T23:09:56.913506+0000","last_became_active":"2024-04-24T23:09:55.904059+0000","last_became_peered":"2024-04-24T23:09:55.904059+0000","last_unstale":"2024-04-24T23:09:56.913506+0000","last_undegraded":"2024-04-24T23:09:56.913506+0000","last_fullsized":"2024-04-24T23:09:56.913506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:49.851813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.932089+0000","last_change":"2024-04-24T23:09:56.928338+0000","last_active":"2024-04-24T23:09:56.932089+0000","last_peered":"2024-04-24T23:09:56.932089+0000","last_clean":"2024-04-24T23:09:56.932089+0000","last_became_active":"2024-04-24T23:09:56.926921+0000","last_became_peered":"2024-04-24T23:09:56.926921+0000","last_unstale":"2024-04-24T23:09:56.932089+0000","last_undegraded":"2024-04-24T23:09:56.932089+0000","last_fullsized":"2024-04-24T23:09:56.932089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:51.877207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919267+0000","last_change":"2024-04-24T23:09:55.887859+0000","last_active":"2024-04-24T23:09:56.919267+0000","last_peered":"2024-04-24T23:09:56.919267+0000","last_clean":"2024-04-24T23:09:56.919267+0000","last_became_active":"2024-04-24T23:09:55.887578+0000","last_became_peered":"2024-04-24T23:09:55.887578+0000","last_unstale":"2024-04-24T23:09:56.919267+0000","last_undegraded":"2024-04-24T23:09:56.919267+0000","last_fullsized":"2024-04-24T23:09:56.919267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:12.436579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.952491+0000","last_change":"2024-04-24T23:09:56.947213+0000","last_active":"2024-04-24T23:09:56.952491+0000","last_peered":"2024-04-24T23:09:56.952491+0000","last_clean":"2024-04-24T23:09:56.952491+0000","last_became_active":"2024-04-24T23:09:56.946885+0000","last_became_peered":"2024-04-24T23:09:56.946885+0000","last_unstale":"2024-04-24T23:09:56.952491+0000","last_undegraded":"2024-04-24T23:09:56.952491+0000","last_fullsized":"2024-04-24T23:09:56.952491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935117+0000","last_change":"2024-04-24T23:09:55.891391+0000","last_active":"2024-04-24T23:09:57.935117+0000","last_peered":"2024-04-24T23:09:57.935117+0000","last_clean":"2024-04-24T23:09:57.935117+0000","last_became_active":"2024-04-24T23:09:55.889562+0000","last_became_peered":"2024-04-24T23:09:55.889562+0000","last_unstale":"2024-04-24T23:09:57.935117+0000","last_undegraded":"2024-04-24T23:09:57.935117+0000","last_fullsized":"2024-04-24T23:09:57.935117+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:29.685328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.927477+0000","last_change":"2024-04-24T23:09:56.921036+0000","last_active":"2024-04-24T23:09:56.927477+0000","last_peered":"2024-04-24T23:09:56.927477+0000","last_clean":"2024-04-24T23:09:56.927477+0000","last_became_active":"2024-04-24T23:09:56.920703+0000","last_became_peered":"2024-04-24T23:09:56.920703+0000","last_unstale":"2024-04-24T23:09:56.927477+0000","last_undegraded":"2024-04-24T23:09:56.927477+0000","last_fullsized":"2024-04-24T23:09:56.927477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.953519+0000","last_change":"2024-04-24T23:09:55.885776+0000","last_active":"2024-04-24T23:09:56.953519+0000","last_peered":"2024-04-24T23:09:56.953519+0000","last_clean":"2024-04-24T23:09:56.953519+0000","last_became_active":"2024-04-24T23:09:55.884367+0000","last_became_peered":"2024-04-24T23:09:55.884367+0000","last_unstale":"2024-04-24T23:09:56.953519+0000","last_undegraded":"2024-04-24T23:09:56.953519+0000","last_fullsized":"2024-04-24T23:09:56.953519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:07.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936212+0000","last_change":"2024-04-24T23:09:56.940835+0000","last_active":"2024-04-24T23:09:57.936212+0000","last_peered":"2024-04-24T23:09:57.936212+0000","last_clean":"2024-04-24T23:09:57.936212+0000","last_became_active":"2024-04-24T23:09:56.940545+0000","last_became_peered":"2024-04-24T23:09:56.940545+0000","last_unstale":"2024-04-24T23:09:57.936212+0000","last_undegraded":"2024-04-24T23:09:57.936212+0000","last_fullsized":"2024-04-24T23:09:57.936212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:29.634674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.926815+0000","last_change":"2024-04-24T23:09:55.872709+0000","last_active":"2024-04-24T23:09:56.926815+0000","last_peered":"2024-04-24T23:09:56.926815+0000","last_clean":"2024-04-24T23:09:56.926815+0000","last_became_active":"2024-04-24T23:09:55.872409+0000","last_became_peered":"2024-04-24T23:09:55.872409+0000","last_unstale":"2024-04-24T23:09:56.926815+0000","last_undegraded":"2024-04-24T23:09:56.926815+0000","last_fullsized":"2024-04-24T23:09:56.926815+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:38.852012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936275+0000","last_change":"2024-04-24T23:09:56.937062+0000","last_active":"2024-04-24T23:09:57.936275+0000","last_peered":"2024-04-24T23:09:57.936275+0000","last_clean":"2024-04-24T23:09:57.936275+0000","last_became_active":"2024-04-24T23:09:56.936317+0000","last_became_peered":"2024-04-24T23:09:56.936317+0000","last_unstale":"2024-04-24T23:09:57.936275+0000","last_undegraded":"2024-04-24T23:09:57.936275+0000","last_fullsized":"2024-04-24T23:09:57.936275+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:09.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.915565+0000","last_change":"2024-04-24T23:09:55.899285+0000","last_active":"2024-04-24T23:09:56.915565+0000","last_peered":"2024-04-24T23:09:56.915565+0000","last_clean":"2024-04-24T23:09:56.915565+0000","last_became_active":"2024-04-24T23:09:55.899020+0000","last_became_peered":"2024-04-24T23:09:55.899020+0000","last_unstale":"2024-04-24T23:09:56.915565+0000","last_undegraded":"2024-04-24T23:09:56.915565+0000","last_fullsized":"2024-04-24T23:09:56.915565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935286+0000","last_change":"2024-04-24T23:09:56.928574+0000","last_active":"2024-04-24T23:09:56.935286+0000","last_peered":"2024-04-24T23:09:56.935286+0000","last_clean":"2024-04-24T23:09:56.935286+0000","last_became_active":"2024-04-24T23:09:56.927898+0000","last_became_peered":"2024-04-24T23:09:56.927898+0000","last_unstale":"2024-04-24T23:09:56.935286+0000","last_undegraded":"2024-04-24T23:09:56.935286+0000","last_fullsized":"2024-04-24T23:09:56.935286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:54.997795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.922565+0000","last_change":"2024-04-24T23:09:55.897509+0000","last_active":"2024-04-24T23:09:56.922565+0000","last_peered":"2024-04-24T23:09:56.922565+0000","last_clean":"2024-04-24T23:09:56.922565+0000","last_became_active":"2024-04-24T23:09:55.896981+0000","last_became_peered":"2024-04-24T23:09:55.896981+0000","last_unstale":"2024-04-24T23:09:56.922565+0000","last_undegraded":"2024-04-24T23:09:56.922565+0000","last_fullsized":"2024-04-24T23:09:56.922565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:27.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.943712+0000","last_change":"2024-04-24T23:09:56.930569+0000","last_active":"2024-04-24T23:09:56.943712+0000","last_peered":"2024-04-24T23:09:56.943712+0000","last_clean":"2024-04-24T23:09:56.943712+0000","last_became_active":"2024-04-24T23:09:56.928323+0000","last_became_peered":"2024-04-24T23:09:56.928323+0000","last_unstale":"2024-04-24T23:09:56.943712+0000","last_undegraded":"2024-04-24T23:09:56.943712+0000","last_fullsized":"2024-04-24T23:09:56.943712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:33.076696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.925658+0000","last_change":"2024-04-24T23:09:55.902928+0000","last_active":"2024-04-24T23:09:56.925658+0000","last_peered":"2024-04-24T23:09:56.925658+0000","last_clean":"2024-04-24T23:09:56.925658+0000","last_became_active":"2024-04-24T23:09:55.902393+0000","last_became_peered":"2024-04-24T23:09:55.902393+0000","last_unstale":"2024-04-24T23:09:56.925658+0000","last_undegraded":"2024-04-24T23:09:56.925658+0000","last_fullsized":"2024-04-24T23:09:56.925658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.285345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.947313+0000","last_change":"2024-04-24T23:09:56.933724+0000","last_active":"2024-04-24T23:09:56.947313+0000","last_peered":"2024-04-24T23:09:56.947313+0000","last_clean":"2024-04-24T23:09:56.947313+0000","last_became_active":"2024-04-24T23:09:56.933457+0000","last_became_peered":"2024-04-24T23:09:56.933457+0000","last_unstale":"2024-04-24T23:09:56.947313+0000","last_undegraded":"2024-04-24T23:09:56.947313+0000","last_fullsized":"2024-04-24T23:09:56.947313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:01.896202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.899329+0000","last_change":"2024-04-24T23:09:55.878355+0000","last_active":"2024-04-24T23:09:56.899329+0000","last_peered":"2024-04-24T23:09:56.899329+0000","last_clean":"2024-04-24T23:09:56.899329+0000","last_became_active":"2024-04-24T23:09:55.877074+0000","last_became_peered":"2024-04-24T23:09:55.877074+0000","last_unstale":"2024-04-24T23:09:56.899329+0000","last_undegraded":"2024-04-24T23:09:56.899329+0000","last_fullsized":"2024-04-24T23:09:56.899329+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:00.880687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.940512+0000","last_change":"2024-04-24T23:09:56.939521+0000","last_active":"2024-04-24T23:09:56.940512+0000","last_peered":"2024-04-24T23:09:56.940512+0000","last_clean":"2024-04-24T23:09:56.940512+0000","last_became_active":"2024-04-24T23:09:56.936959+0000","last_became_peered":"2024-04-24T23:09:56.936959+0000","last_unstale":"2024-04-24T23:09:56.940512+0000","last_undegraded":"2024-04-24T23:09:56.940512+0000","last_fullsized":"2024-04-24T23:09:56.940512+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.901862+0000","last_change":"2024-04-24T23:09:55.895704+0000","last_active":"2024-04-24T23:09:56.901862+0000","last_peered":"2024-04-24T23:09:56.901862+0000","last_clean":"2024-04-24T23:09:56.901862+0000","last_became_active":"2024-04-24T23:09:55.895351+0000","last_became_peered":"2024-04-24T23:09:55.895351+0000","last_unstale":"2024-04-24T23:09:56.901862+0000","last_undegraded":"2024-04-24T23:09:56.901862+0000","last_fullsized":"2024-04-24T23:09:56.901862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:39.281068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.949211+0000","last_change":"2024-04-24T23:09:56.945238+0000","last_active":"2024-04-24T23:09:56.949211+0000","last_peered":"2024-04-24T23:09:56.949211+0000","last_clean":"2024-04-24T23:09:56.949211+0000","last_became_active":"2024-04-24T23:09:56.944093+0000","last_became_peered":"2024-04-24T23:09:56.944093+0000","last_unstale":"2024-04-24T23:09:56.949211+0000","last_undegraded":"2024-04-24T23:09:56.949211+0000","last_fullsized":"2024-04-24T23:09:56.949211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:56.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898863+0000","last_change":"2024-04-24T23:09:55.877706+0000","last_active":"2024-04-24T23:09:56.898863+0000","last_peered":"2024-04-24T23:09:56.898863+0000","last_clean":"2024-04-24T23:09:56.898863+0000","last_became_active":"2024-04-24T23:09:55.877145+0000","last_became_peered":"2024-04-24T23:09:55.877145+0000","last_unstale":"2024-04-24T23:09:56.898863+0000","last_undegraded":"2024-04-24T23:09:56.898863+0000","last_fullsized":"2024-04-24T23:09:56.898863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:23.501000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.935247+0000","last_change":"2024-04-24T23:09:56.928920+0000","last_active":"2024-04-24T23:09:56.935247+0000","last_peered":"2024-04-24T23:09:56.935247+0000","last_clean":"2024-04-24T23:09:56.935247+0000","last_became_active":"2024-04-24T23:09:56.928293+0000","last_became_peered":"2024-04-24T23:09:56.928293+0000","last_unstale":"2024-04-24T23:09:56.935247+0000","last_undegraded":"2024-04-24T23:09:56.935247+0000","last_fullsized":"2024-04-24T23:09:56.935247+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.048105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.919578+0000","last_change":"2024-04-24T23:09:55.903234+0000","last_active":"2024-04-24T23:09:56.919578+0000","last_peered":"2024-04-24T23:09:56.919578+0000","last_clean":"2024-04-24T23:09:56.919578+0000","last_became_active":"2024-04-24T23:09:55.900164+0000","last_became_peered":"2024-04-24T23:09:55.900164+0000","last_unstale":"2024-04-24T23:09:56.919578+0000","last_undegraded":"2024-04-24T23:09:56.919578+0000","last_fullsized":"2024-04-24T23:09:56.919578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":308,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-24T23:09:56.898934+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:56.898934+0000","last_peered":"2024-04-24T23:09:56.898934+0000","last_clean":"2024-04-24T23:09:56.898934+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:56.898934+0000","last_undegraded":"2024-04-24T23:09:56.898934+0000","last_fullsized":"2024-04-24T23:09:56.898934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509566,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":523206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":530373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509566,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1171456,"data_stored":532097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":530977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1732608,"data_stored":1113574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509565,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":530443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1127433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:06.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:06.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.563+0000 7f429c800640 1 Processor -- start 2024-04-24T23:10:06.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.563+0000 7f429c800640 1 -- start start 2024-04-24T23:10:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f429c800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f42940d03a0 0x7f4294071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f429c800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4294158970 con 0x7f42940715f0 2024-04-24T23:10:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f429c800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4294070c10 con 0x7f4294158590 2024-04-24T23:10:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f429c800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4294070ef0 con 0x7f42940d03a0 2024-04-24T23:10:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f4299400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f42940715f0 0x7f42940cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42008/0 (socket says 172.21.15.146:42008) 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.565+0000 7f4299400640 1 -- 172.21.15.146:0/3334911825 learned_addr learned my addr 172.21.15.146:0/3334911825 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725562224 0 0) 0x7f4294158970 con 0x7f42940715f0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f427c003520 con 0x7f42940715f0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> v2:172.21.15.203:3300/0 conn(0x7f42940d03a0 0x7f4294071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3642252971 0 0) 0x7f427c003520 con 0x7f42940715f0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 >> v2:172.21.15.203:3300/0 conn(0x7f42940d03a0 msgr2=0x7f4294071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 --2- 172.21.15.146:0/3334911825 >> v2:172.21.15.203:3300/0 conn(0x7f42940d03a0 0x7f4294071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 >> v1:172.21.15.203:6789/0 conn(0x7f4294158590 legacy=0x7f4294162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940711d0 con 0x7f42940715f0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f4284001670 con 0x7f42940715f0 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 >> v1:172.21.15.146:6789/0 conn(0x7f42940715f0 legacy=0x7f42940cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f427c0039b0 0x7f427c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c004800 0x7f427c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 0x7f427c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4294070ef0 con 0x7f427c0052e0 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f427c00c1d0 con 0x7f427c0039b0 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f427c00c3d0 con 0x7f427c004800 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.566+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> v2:172.21.15.203:3300/0 conn(0x7f42940d03a0 0x7f4294071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 0x7f427c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f4299400640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c004800 0x7f427c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f4299e00640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f427c0039b0 0x7f427c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 -- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c004800 msgr2=0x7f427c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c004800 0x7f427c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 -- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f427c0039b0 msgr2=0x7f427c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f427c0039b0 0x7f427c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.567+0000 7f429a800640 1 -- 172.21.15.146:0/3334911825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c003520 con 0x7f427c0052e0 2024-04-24T23:10:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.568+0000 7f429a800640 1 -- 172.21.15.146:0/3334911825 reap_dead start 2024-04-24T23:10:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.568+0000 7f429a800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 0x7f427c00b9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f42940af5e0 tx=0x7f427c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82780a4ea3fb7790 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.568+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290038070 con 0x7f427c0052e0 2024-04-24T23:10:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.568+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429002bb30 con 0x7f427c0052e0 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.568+0000 7f4298a00640 1 -- 172.21.15.146:0/3334911825 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290007c30 con 0x7f427c0052e0 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 -- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 msgr2=0x7f427c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 0x7f427c00b9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f42940af5e0 tx=0x7f427c005830 comp rx=0 tx=0).stop 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 -- 172.21.15.146:0/3334911825 shutdown_connections 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 --2- 172.21.15.146:0/3334911825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f427c0052e0 0x7f427c00b9c0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 -- 172.21.15.146:0/3334911825 >> 172.21.15.146:0/3334911825 conn(0x7f429406b320 msgr2=0x7f429406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 -- 172.21.15.146:0/3334911825 shutdown_connections 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.569+0000 7f429c800640 1 -- 172.21.15.146:0/3334911825 wait complete. 2024-04-24T23:10:06.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.571+0000 7f429c800640 1 Processor -- start 2024-04-24T23:10:06.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.571+0000 7f429c800640 1 -- start start 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c0052e0 0x7f42940b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429415b970 0x7f42940b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4294071a70 con 0x7f4294141bb0 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4294161f30 con 0x7f429415b970 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4294071bf0 con 0x7f427c0052e0 2024-04-24T23:10:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.572+0000 7f429a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37598/0 (socket says 172.21.15.146:37598) 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 -- 172.21.15.146:0/1619922733 learned_addr learned my addr 172.21.15.146:0/1619922733 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f4299400640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429415b970 0x7f42940b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f4299e00640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c0052e0 0x7f42940b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 -- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c0052e0 msgr2=0x7f42940b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c0052e0 0x7f42940b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 -- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429415b970 msgr2=0x7f42940b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429415b970 0x7f42940b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 -- 172.21.15.146:0/1619922733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940b0e30 con 0x7f4294141bb0 2024-04-24T23:10:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.573+0000 7f429a800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f429002b620 tx=0x7f4290004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.574+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290044070 con 0x7f4294141bb0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.574+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42900041e0 con 0x7f4294141bb0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.574+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290038040 con 0x7f4294141bb0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.574+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42940b1110 con 0x7f4294141bb0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.574+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42940b16d0 con 0x7f4294141bb0 2024-04-24T23:10:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.575+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4294068190 con 0x7f4294141bb0 2024-04-24T23:10:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.576+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4290047070 con 0x7f4294141bb0 2024-04-24T23:10:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.577+0000 7f428e000640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 0x7f427806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.577+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f42900ab450 con 0x7f4294141bb0 2024-04-24T23:10:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.578+0000 7f4299e00640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 0x7f427806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.579+0000 7f4299e00640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 0x7f427806e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4288001670 tx=0x7f4288009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.582+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4290079580 con 0x7f4294141bb0 2024-04-24T23:10:06.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.776+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42940cfc90 con 0x7f427806be60 2024-04-24T23:10:06.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.795+0000 7f428e000640 1 -- 172.21.15.146:0/1619922733 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252078 (secure 0 0 0) 0x7f42940cfc90 con 0x7f427806be60 2024-04-24T23:10:06.800 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:06.801 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 msgr2=0x7f427806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 0x7f427806e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4288001670 tx=0x7f4288009040 comp rx=0 tx=0).stop 2024-04-24T23:10:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 msgr2=0x7f4294142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f429002b620 tx=0x7f4290004ab0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 shutdown_connections 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4294141bb0 0x7f4294142060 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429415b970 0x7f42940b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f427806be60 0x7f427806e320 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 --2- 172.21.15.146:0/1619922733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f427c0052e0 0x7f42940b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 >> 172.21.15.146:0/1619922733 conn(0x7f429406b320 msgr2=0x7f42940b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 shutdown_connections 2024-04-24T23:10:06.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:06.801+0000 7f429c800640 1 -- 172.21.15.146:0/1619922733 wait complete. 2024-04-24T23:10:06.822 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-04-24T23:10:05.818230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259772,"kb_used_data":10312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714948,"statfs":{"total":773094113280,"available":772828106752,"internally_reserved":0,"allocated":10559488,"data_stored":5482076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.921577"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370164+0000","last_change":"2024-04-24T23:09:56.940409+0000","last_active":"2024-04-24T23:09:58.370164+0000","last_peered":"2024-04-24T23:09:58.370164+0000","last_clean":"2024-04-24T23:09:58.370164+0000","last_became_active":"2024-04-24T23:09:56.940129+0000","last_became_peered":"2024-04-24T23:09:56.940129+0000","last_unstale":"2024-04-24T23:09:58.370164+0000","last_undegraded":"2024-04-24T23:09:58.370164+0000","last_fullsized":"2024-04-24T23:09:58.370164+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:25.403855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935667+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:57.935667+0000","last_peered":"2024-04-24T23:09:57.935667+0000","last_clean":"2024-04-24T23:09:57.935667+0000","last_became_active":"2024-04-24T23:09:56.917999+0000","last_became_peered":"2024-04-24T23:09:56.917999+0000","last_unstale":"2024-04-24T23:09:57.935667+0000","last_undegraded":"2024-04-24T23:09:57.935667+0000","last_fullsized":"2024-04-24T23:09:57.935667+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:19.743279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.371040+0000","last_change":"2024-04-24T23:09:56.924994+0000","last_active":"2024-04-24T23:09:58.371040+0000","last_peered":"2024-04-24T23:09:58.371040+0000","last_clean":"2024-04-24T23:09:58.371040+0000","last_became_active":"2024-04-24T23:09:56.921828+0000","last_became_peered":"2024-04-24T23:09:56.921828+0000","last_unstale":"2024-04-24T23:09:58.371040+0000","last_undegraded":"2024-04-24T23:09:58.371040+0000","last_fullsized":"2024-04-24T23:09:58.371040+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:54.997795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368353+0000","last_change":"2024-04-24T23:09:56.932969+0000","last_active":"2024-04-24T23:09:58.368353+0000","last_peered":"2024-04-24T23:09:58.368353+0000","last_clean":"2024-04-24T23:09:58.368353+0000","last_became_active":"2024-04-24T23:09:56.932433+0000","last_became_peered":"2024-04-24T23:09:56.932433+0000","last_unstale":"2024-04-24T23:09:58.368353+0000","last_undegraded":"2024-04-24T23:09:58.368353+0000","last_fullsized":"2024-04-24T23:09:58.368353+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:40.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934851+0000","last_change":"2024-04-24T23:09:56.933631+0000","last_active":"2024-04-24T23:09:57.934851+0000","last_peered":"2024-04-24T23:09:57.934851+0000","last_clean":"2024-04-24T23:09:57.934851+0000","last_became_active":"2024-04-24T23:09:56.932689+0000","last_became_peered":"2024-04-24T23:09:56.932689+0000","last_unstale":"2024-04-24T23:09:57.934851+0000","last_undegraded":"2024-04-24T23:09:57.934851+0000","last_fullsized":"2024-04-24T23:09:57.934851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370731+0000","last_change":"2024-04-24T23:09:56.939868+0000","last_active":"2024-04-24T23:09:58.370731+0000","last_peered":"2024-04-24T23:09:58.370731+0000","last_clean":"2024-04-24T23:09:58.370731+0000","last_became_active":"2024-04-24T23:09:56.939581+0000","last_became_peered":"2024-04-24T23:09:56.939581+0000","last_unstale":"2024-04-24T23:09:58.370731+0000","last_undegraded":"2024-04-24T23:09:58.370731+0000","last_fullsized":"2024-04-24T23:09:58.370731+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:43.293942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933374+0000","last_change":"2024-04-24T23:09:56.949125+0000","last_active":"2024-04-24T23:09:57.933374+0000","last_peered":"2024-04-24T23:09:57.933374+0000","last_clean":"2024-04-24T23:09:57.933374+0000","last_became_active":"2024-04-24T23:09:56.948828+0000","last_became_peered":"2024-04-24T23:09:56.948828+0000","last_unstale":"2024-04-24T23:09:57.933374+0000","last_undegraded":"2024-04-24T23:09:57.933374+0000","last_fullsized":"2024-04-24T23:09:57.933374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:43.293942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366223+0000","last_change":"2024-04-24T23:09:56.927536+0000","last_active":"2024-04-24T23:09:58.366223+0000","last_peered":"2024-04-24T23:09:58.366223+0000","last_clean":"2024-04-24T23:09:58.366223+0000","last_became_active":"2024-04-24T23:09:56.926961+0000","last_became_peered":"2024-04-24T23:09:56.926961+0000","last_unstale":"2024-04-24T23:09:58.366223+0000","last_undegraded":"2024-04-24T23:09:58.366223+0000","last_fullsized":"2024-04-24T23:09:58.366223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:39.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935138+0000","last_change":"2024-04-24T23:09:56.936517+0000","last_active":"2024-04-24T23:09:57.935138+0000","last_peered":"2024-04-24T23:09:57.935138+0000","last_clean":"2024-04-24T23:09:57.935138+0000","last_became_active":"2024-04-24T23:09:56.936129+0000","last_became_peered":"2024-04-24T23:09:56.936129+0000","last_unstale":"2024-04-24T23:09:57.935138+0000","last_undegraded":"2024-04-24T23:09:57.935138+0000","last_fullsized":"2024-04-24T23:09:57.935138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:15.268036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368614+0000","last_change":"2024-04-24T23:09:56.928806+0000","last_active":"2024-04-24T23:09:58.368614+0000","last_peered":"2024-04-24T23:09:58.368614+0000","last_clean":"2024-04-24T23:09:58.368614+0000","last_became_active":"2024-04-24T23:09:56.925611+0000","last_became_peered":"2024-04-24T23:09:56.925611+0000","last_unstale":"2024-04-24T23:09:58.368614+0000","last_undegraded":"2024-04-24T23:09:58.368614+0000","last_fullsized":"2024-04-24T23:09:58.368614+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:42.424719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933788+0000","last_change":"2024-04-24T23:09:56.950003+0000","last_active":"2024-04-24T23:09:57.933788+0000","last_peered":"2024-04-24T23:09:57.933788+0000","last_clean":"2024-04-24T23:09:57.933788+0000","last_became_active":"2024-04-24T23:09:56.949677+0000","last_became_peered":"2024-04-24T23:09:56.949677+0000","last_unstale":"2024-04-24T23:09:57.933788+0000","last_undegraded":"2024-04-24T23:09:57.933788+0000","last_fullsized":"2024-04-24T23:09:57.933788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:57:35.749544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368767+0000","last_change":"2024-04-24T23:09:56.941322+0000","last_active":"2024-04-24T23:09:58.368767+0000","last_peered":"2024-04-24T23:09:58.368767+0000","last_clean":"2024-04-24T23:09:58.368767+0000","last_became_active":"2024-04-24T23:09:56.941057+0000","last_became_peered":"2024-04-24T23:09:56.941057+0000","last_unstale":"2024-04-24T23:09:58.368767+0000","last_undegraded":"2024-04-24T23:09:58.368767+0000","last_fullsized":"2024-04-24T23:09:58.368767+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:39.954304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.929799+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.929479+0000","last_became_peered":"2024-04-24T23:09:56.929479+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:08.145163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365344+0000","last_change":"2024-04-24T23:09:56.946705+0000","last_active":"2024-04-24T23:09:58.365344+0000","last_peered":"2024-04-24T23:09:58.365344+0000","last_clean":"2024-04-24T23:09:58.365344+0000","last_became_active":"2024-04-24T23:09:56.946427+0000","last_became_peered":"2024-04-24T23:09:56.946427+0000","last_unstale":"2024-04-24T23:09:58.365344+0000","last_undegraded":"2024-04-24T23:09:58.365344+0000","last_fullsized":"2024-04-24T23:09:58.365344+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:33.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369203+0000","last_change":"2024-04-24T23:09:56.931525+0000","last_active":"2024-04-24T23:09:58.369203+0000","last_peered":"2024-04-24T23:09:58.369203+0000","last_clean":"2024-04-24T23:09:58.369203+0000","last_became_active":"2024-04-24T23:09:56.925661+0000","last_became_peered":"2024-04-24T23:09:56.925661+0000","last_unstale":"2024-04-24T23:09:58.369203+0000","last_undegraded":"2024-04-24T23:09:58.369203+0000","last_fullsized":"2024-04-24T23:09:58.369203+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:13.452094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366647+0000","last_change":"2024-04-24T23:09:56.919116+0000","last_active":"2024-04-24T23:09:58.366647+0000","last_peered":"2024-04-24T23:09:58.366647+0000","last_clean":"2024-04-24T23:09:58.366647+0000","last_became_active":"2024-04-24T23:09:56.918824+0000","last_became_peered":"2024-04-24T23:09:56.918824+0000","last_unstale":"2024-04-24T23:09:58.366647+0000","last_undegraded":"2024-04-24T23:09:58.366647+0000","last_fullsized":"2024-04-24T23:09:58.366647+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:08.554766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368285+0000","last_change":"2024-04-24T23:09:56.944906+0000","last_active":"2024-04-24T23:09:58.368285+0000","last_peered":"2024-04-24T23:09:58.368285+0000","last_clean":"2024-04-24T23:09:58.368285+0000","last_became_active":"2024-04-24T23:09:56.944626+0000","last_became_peered":"2024-04-24T23:09:56.944626+0000","last_unstale":"2024-04-24T23:09:58.368285+0000","last_undegraded":"2024-04-24T23:09:58.368285+0000","last_fullsized":"2024-04-24T23:09:58.368285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:27:59.773669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369036+0000","last_change":"2024-04-24T23:09:56.925763+0000","last_active":"2024-04-24T23:09:58.369036+0000","last_peered":"2024-04-24T23:09:58.369036+0000","last_clean":"2024-04-24T23:09:58.369036+0000","last_became_active":"2024-04-24T23:09:56.925443+0000","last_became_peered":"2024-04-24T23:09:56.925443+0000","last_unstale":"2024-04-24T23:09:58.369036+0000","last_undegraded":"2024-04-24T23:09:58.369036+0000","last_fullsized":"2024-04-24T23:09:58.369036+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:45.239398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367515+0000","last_change":"2024-04-24T23:09:56.930342+0000","last_active":"2024-04-24T23:09:58.367515+0000","last_peered":"2024-04-24T23:09:58.367515+0000","last_clean":"2024-04-24T23:09:58.367515+0000","last_became_active":"2024-04-24T23:09:56.929614+0000","last_became_peered":"2024-04-24T23:09:56.929614+0000","last_unstale":"2024-04-24T23:09:58.367515+0000","last_undegraded":"2024-04-24T23:09:58.367515+0000","last_fullsized":"2024-04-24T23:09:58.367515+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:19.743279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368084+0000","last_change":"2024-04-24T23:09:56.941593+0000","last_active":"2024-04-24T23:09:58.368084+0000","last_peered":"2024-04-24T23:09:58.368084+0000","last_clean":"2024-04-24T23:09:58.368084+0000","last_became_active":"2024-04-24T23:09:56.939699+0000","last_became_peered":"2024-04-24T23:09:56.939699+0000","last_unstale":"2024-04-24T23:09:58.368084+0000","last_undegraded":"2024-04-24T23:09:58.368084+0000","last_fullsized":"2024-04-24T23:09:58.368084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:16.993406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935337+0000","last_change":"2024-04-24T23:09:56.934769+0000","last_active":"2024-04-24T23:09:57.935337+0000","last_peered":"2024-04-24T23:09:57.935337+0000","last_clean":"2024-04-24T23:09:57.935337+0000","last_became_active":"2024-04-24T23:09:56.933079+0000","last_became_peered":"2024-04-24T23:09:56.933079+0000","last_unstale":"2024-04-24T23:09:57.935337+0000","last_undegraded":"2024-04-24T23:09:57.935337+0000","last_fullsized":"2024-04-24T23:09:57.935337+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368014+0000","last_change":"2024-04-24T23:09:56.927450+0000","last_active":"2024-04-24T23:09:58.368014+0000","last_peered":"2024-04-24T23:09:58.368014+0000","last_clean":"2024-04-24T23:09:58.368014+0000","last_became_active":"2024-04-24T23:09:56.927016+0000","last_became_peered":"2024-04-24T23:09:56.927016+0000","last_unstale":"2024-04-24T23:09:58.368014+0000","last_undegraded":"2024-04-24T23:09:58.368014+0000","last_fullsized":"2024-04-24T23:09:58.368014+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:15:02.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.932654+0000","last_change":"2024-04-24T23:09:56.933202+0000","last_active":"2024-04-24T23:09:57.932654+0000","last_peered":"2024-04-24T23:09:57.932654+0000","last_clean":"2024-04-24T23:09:57.932654+0000","last_became_active":"2024-04-24T23:09:56.932903+0000","last_became_peered":"2024-04-24T23:09:56.932903+0000","last_unstale":"2024-04-24T23:09:57.932654+0000","last_undegraded":"2024-04-24T23:09:57.932654+0000","last_fullsized":"2024-04-24T23:09:57.932654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:37:09.621340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366741+0000","last_change":"2024-04-24T23:09:56.927531+0000","last_active":"2024-04-24T23:09:58.366741+0000","last_peered":"2024-04-24T23:09:58.366741+0000","last_clean":"2024-04-24T23:09:58.366741+0000","last_became_active":"2024-04-24T23:09:56.927243+0000","last_became_peered":"2024-04-24T23:09:56.927243+0000","last_unstale":"2024-04-24T23:09:58.366741+0000","last_undegraded":"2024-04-24T23:09:58.366741+0000","last_fullsized":"2024-04-24T23:09:58.366741+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:15:02.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936091+0000","last_change":"2024-04-24T23:09:56.925843+0000","last_active":"2024-04-24T23:09:57.936091+0000","last_peered":"2024-04-24T23:09:57.936091+0000","last_clean":"2024-04-24T23:09:57.936091+0000","last_became_active":"2024-04-24T23:09:56.925556+0000","last_became_peered":"2024-04-24T23:09:56.925556+0000","last_unstale":"2024-04-24T23:09:57.936091+0000","last_undegraded":"2024-04-24T23:09:57.936091+0000","last_fullsized":"2024-04-24T23:09:57.936091+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:22.202462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936077+0000","last_change":"2024-04-24T23:09:56.915444+0000","last_active":"2024-04-24T23:09:57.936077+0000","last_peered":"2024-04-24T23:09:57.936077+0000","last_clean":"2024-04-24T23:09:57.936077+0000","last_became_active":"2024-04-24T23:09:56.914704+0000","last_became_peered":"2024-04-24T23:09:56.914704+0000","last_unstale":"2024-04-24T23:09:57.936077+0000","last_undegraded":"2024-04-24T23:09:57.936077+0000","last_fullsized":"2024-04-24T23:09:57.936077+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:15:02.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.371040+0000","last_change":"2024-04-24T23:09:56.925404+0000","last_active":"2024-04-24T23:09:58.371040+0000","last_peered":"2024-04-24T23:09:58.371040+0000","last_clean":"2024-04-24T23:09:58.371040+0000","last_became_active":"2024-04-24T23:09:56.925111+0000","last_became_peered":"2024-04-24T23:09:56.925111+0000","last_unstale":"2024-04-24T23:09:58.371040+0000","last_undegraded":"2024-04-24T23:09:58.371040+0000","last_fullsized":"2024-04-24T23:09:58.371040+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:33.774720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936351+0000","last_change":"2024-04-24T23:09:56.941120+0000","last_active":"2024-04-24T23:09:57.936351+0000","last_peered":"2024-04-24T23:09:57.936351+0000","last_clean":"2024-04-24T23:09:57.936351+0000","last_became_active":"2024-04-24T23:09:56.940621+0000","last_became_peered":"2024-04-24T23:09:56.940621+0000","last_unstale":"2024-04-24T23:09:57.936351+0000","last_undegraded":"2024-04-24T23:09:57.936351+0000","last_fullsized":"2024-04-24T23:09:57.936351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:01.281459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935224+0000","last_change":"2024-04-24T23:09:56.933867+0000","last_active":"2024-04-24T23:09:57.935224+0000","last_peered":"2024-04-24T23:09:57.935224+0000","last_clean":"2024-04-24T23:09:57.935224+0000","last_became_active":"2024-04-24T23:09:56.933359+0000","last_became_peered":"2024-04-24T23:09:56.933359+0000","last_unstale":"2024-04-24T23:09:57.935224+0000","last_undegraded":"2024-04-24T23:09:57.935224+0000","last_fullsized":"2024-04-24T23:09:57.935224+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933676+0000","last_change":"2024-04-24T23:09:56.931228+0000","last_active":"2024-04-24T23:09:57.933676+0000","last_peered":"2024-04-24T23:09:57.933676+0000","last_clean":"2024-04-24T23:09:57.933676+0000","last_became_active":"2024-04-24T23:09:56.930831+0000","last_became_peered":"2024-04-24T23:09:56.930831+0000","last_unstale":"2024-04-24T23:09:57.933676+0000","last_undegraded":"2024-04-24T23:09:57.933676+0000","last_fullsized":"2024-04-24T23:09:57.933676+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366801+0000","last_change":"2024-04-24T23:09:56.932993+0000","last_active":"2024-04-24T23:09:58.366801+0000","last_peered":"2024-04-24T23:09:58.366801+0000","last_clean":"2024-04-24T23:09:58.366801+0000","last_became_active":"2024-04-24T23:09:56.932707+0000","last_became_peered":"2024-04-24T23:09:56.932707+0000","last_unstale":"2024-04-24T23:09:58.366801+0000","last_undegraded":"2024-04-24T23:09:58.366801+0000","last_fullsized":"2024-04-24T23:09:58.366801+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:03.009859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367046+0000","last_change":"2024-04-24T23:09:56.917318+0000","last_active":"2024-04-24T23:09:58.367046+0000","last_peered":"2024-04-24T23:09:58.367046+0000","last_clean":"2024-04-24T23:09:58.367046+0000","last_became_active":"2024-04-24T23:09:56.916979+0000","last_became_peered":"2024-04-24T23:09:56.916979+0000","last_unstale":"2024-04-24T23:09:58.367046+0000","last_undegraded":"2024-04-24T23:09:58.367046+0000","last_fullsized":"2024-04-24T23:09:58.367046+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:20.967828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370173+0000","last_change":"2024-04-24T23:09:56.935573+0000","last_active":"2024-04-24T23:09:58.370173+0000","last_peered":"2024-04-24T23:09:58.370173+0000","last_clean":"2024-04-24T23:09:58.370173+0000","last_became_active":"2024-04-24T23:09:56.935267+0000","last_became_peered":"2024-04-24T23:09:56.935267+0000","last_unstale":"2024-04-24T23:09:58.370173+0000","last_undegraded":"2024-04-24T23:09:58.370173+0000","last_fullsized":"2024-04-24T23:09:58.370173+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:46.503606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.937140+0000","last_change":"2024-04-24T23:09:55.878169+0000","last_active":"2024-04-24T23:09:57.937140+0000","last_peered":"2024-04-24T23:09:57.937140+0000","last_clean":"2024-04-24T23:09:57.937140+0000","last_became_active":"2024-04-24T23:09:55.877826+0000","last_became_peered":"2024-04-24T23:09:55.877826+0000","last_unstale":"2024-04-24T23:09:57.937140+0000","last_undegraded":"2024-04-24T23:09:57.937140+0000","last_fullsized":"2024-04-24T23:09:57.937140+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:49:29.372680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367975+0000","last_change":"2024-04-24T23:09:56.942471+0000","last_active":"2024-04-24T23:09:58.367975+0000","last_peered":"2024-04-24T23:09:58.367975+0000","last_clean":"2024-04-24T23:09:58.367975+0000","last_became_active":"2024-04-24T23:09:56.942154+0000","last_became_peered":"2024-04-24T23:09:56.942154+0000","last_unstale":"2024-04-24T23:09:58.367975+0000","last_undegraded":"2024-04-24T23:09:58.367975+0000","last_fullsized":"2024-04-24T23:09:58.367975+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:22:09.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365566+0000","last_change":"2024-04-24T23:09:55.885462+0000","last_active":"2024-04-24T23:09:58.365566+0000","last_peered":"2024-04-24T23:09:58.365566+0000","last_clean":"2024-04-24T23:09:58.365566+0000","last_became_active":"2024-04-24T23:09:55.885156+0000","last_became_peered":"2024-04-24T23:09:55.885156+0000","last_unstale":"2024-04-24T23:09:58.365566+0000","last_undegraded":"2024-04-24T23:09:58.365566+0000","last_fullsized":"2024-04-24T23:09:58.365566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:12:32.759204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934714+0000","last_change":"2024-04-24T23:09:56.945032+0000","last_active":"2024-04-24T23:09:57.934714+0000","last_peered":"2024-04-24T23:09:57.934714+0000","last_clean":"2024-04-24T23:09:57.934714+0000","last_became_active":"2024-04-24T23:09:56.944757+0000","last_became_peered":"2024-04-24T23:09:56.944757+0000","last_unstale":"2024-04-24T23:09:57.934714+0000","last_undegraded":"2024-04-24T23:09:57.934714+0000","last_fullsized":"2024-04-24T23:09:57.934714+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:42.857042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935687+0000","last_change":"2024-04-24T23:09:55.901246+0000","last_active":"2024-04-24T23:09:57.935687+0000","last_peered":"2024-04-24T23:09:57.935687+0000","last_clean":"2024-04-24T23:09:57.935687+0000","last_became_active":"2024-04-24T23:09:55.900510+0000","last_became_peered":"2024-04-24T23:09:55.900510+0000","last_unstale":"2024-04-24T23:09:57.935687+0000","last_undegraded":"2024-04-24T23:09:57.935687+0000","last_fullsized":"2024-04-24T23:09:57.935687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:50:33.972115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370082+0000","last_change":"2024-04-24T23:09:56.920458+0000","last_active":"2024-04-24T23:09:58.370082+0000","last_peered":"2024-04-24T23:09:58.370082+0000","last_clean":"2024-04-24T23:09:58.370082+0000","last_became_active":"2024-04-24T23:09:56.920155+0000","last_became_peered":"2024-04-24T23:09:56.920155+0000","last_unstale":"2024-04-24T23:09:58.370082+0000","last_undegraded":"2024-04-24T23:09:58.370082+0000","last_fullsized":"2024-04-24T23:09:58.370082+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:01.841132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365151+0000","last_change":"2024-04-24T23:09:55.888998+0000","last_active":"2024-04-24T23:09:58.365151+0000","last_peered":"2024-04-24T23:09:58.365151+0000","last_clean":"2024-04-24T23:09:58.365151+0000","last_became_active":"2024-04-24T23:09:55.888687+0000","last_became_peered":"2024-04-24T23:09:55.888687+0000","last_unstale":"2024-04-24T23:09:58.365151+0000","last_undegraded":"2024-04-24T23:09:58.365151+0000","last_fullsized":"2024-04-24T23:09:58.365151+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:00.825617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935285+0000","last_change":"2024-04-24T23:09:56.937409+0000","last_active":"2024-04-24T23:09:57.935285+0000","last_peered":"2024-04-24T23:09:57.935285+0000","last_clean":"2024-04-24T23:09:57.935285+0000","last_became_active":"2024-04-24T23:09:56.934198+0000","last_became_peered":"2024-04-24T23:09:56.934198+0000","last_unstale":"2024-04-24T23:09:57.935285+0000","last_undegraded":"2024-04-24T23:09:57.935285+0000","last_fullsized":"2024-04-24T23:09:57.935285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:30.100419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367046+0000","last_change":"2024-04-24T23:09:55.895038+0000","last_active":"2024-04-24T23:09:58.367046+0000","last_peered":"2024-04-24T23:09:58.367046+0000","last_clean":"2024-04-24T23:09:58.367046+0000","last_became_active":"2024-04-24T23:09:55.894708+0000","last_became_peered":"2024-04-24T23:09:55.894708+0000","last_unstale":"2024-04-24T23:09:58.367046+0000","last_undegraded":"2024-04-24T23:09:58.367046+0000","last_fullsized":"2024-04-24T23:09:58.367046+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933214+0000","last_change":"2024-04-24T23:09:56.950756+0000","last_active":"2024-04-24T23:09:57.933214+0000","last_peered":"2024-04-24T23:09:57.933214+0000","last_clean":"2024-04-24T23:09:57.933214+0000","last_became_active":"2024-04-24T23:09:56.950487+0000","last_became_peered":"2024-04-24T23:09:56.950487+0000","last_unstale":"2024-04-24T23:09:57.933214+0000","last_undegraded":"2024-04-24T23:09:57.933214+0000","last_fullsized":"2024-04-24T23:09:57.933214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:22:09.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935400+0000","last_change":"2024-04-24T23:09:55.902440+0000","last_active":"2024-04-24T23:09:57.935400+0000","last_peered":"2024-04-24T23:09:57.935400+0000","last_clean":"2024-04-24T23:09:57.935400+0000","last_became_active":"2024-04-24T23:09:55.901950+0000","last_became_peered":"2024-04-24T23:09:55.901950+0000","last_unstale":"2024-04-24T23:09:57.935400+0000","last_undegraded":"2024-04-24T23:09:57.935400+0000","last_fullsized":"2024-04-24T23:09:57.935400+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:38:35.121590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370969+0000","last_change":"2024-04-24T23:09:56.935846+0000","last_active":"2024-04-24T23:09:58.370969+0000","last_peered":"2024-04-24T23:09:58.370969+0000","last_clean":"2024-04-24T23:09:58.370969+0000","last_became_active":"2024-04-24T23:09:56.935571+0000","last_became_peered":"2024-04-24T23:09:56.935571+0000","last_unstale":"2024-04-24T23:09:58.370969+0000","last_undegraded":"2024-04-24T23:09:58.370969+0000","last_fullsized":"2024-04-24T23:09:58.370969+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:57:35.749544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369820+0000","last_change":"2024-04-24T23:09:55.899264+0000","last_active":"2024-04-24T23:09:58.369820+0000","last_peered":"2024-04-24T23:09:58.369820+0000","last_clean":"2024-04-24T23:09:58.369820+0000","last_became_active":"2024-04-24T23:09:55.898514+0000","last_became_peered":"2024-04-24T23:09:55.898514+0000","last_unstale":"2024-04-24T23:09:58.369820+0000","last_undegraded":"2024-04-24T23:09:58.369820+0000","last_fullsized":"2024-04-24T23:09:58.369820+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:24.586695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367898+0000","last_change":"2024-04-24T23:09:56.931992+0000","last_active":"2024-04-24T23:09:58.367898+0000","last_peered":"2024-04-24T23:09:58.367898+0000","last_clean":"2024-04-24T23:09:58.367898+0000","last_became_active":"2024-04-24T23:09:56.931619+0000","last_became_peered":"2024-04-24T23:09:56.931619+0000","last_unstale":"2024-04-24T23:09:58.367898+0000","last_undegraded":"2024-04-24T23:09:58.367898+0000","last_fullsized":"2024-04-24T23:09:58.367898+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:53:07.367625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.932609+0000","last_change":"2024-04-24T23:09:55.897787+0000","last_active":"2024-04-24T23:09:57.932609+0000","last_peered":"2024-04-24T23:09:57.932609+0000","last_clean":"2024-04-24T23:09:57.932609+0000","last_became_active":"2024-04-24T23:09:55.897129+0000","last_became_peered":"2024-04-24T23:09:55.897129+0000","last_unstale":"2024-04-24T23:09:57.932609+0000","last_undegraded":"2024-04-24T23:09:57.932609+0000","last_fullsized":"2024-04-24T23:09:57.932609+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:59.244632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936146+0000","last_change":"2024-04-24T23:09:56.940662+0000","last_active":"2024-04-24T23:09:57.936146+0000","last_peered":"2024-04-24T23:09:57.936146+0000","last_clean":"2024-04-24T23:09:57.936146+0000","last_became_active":"2024-04-24T23:09:56.940303+0000","last_became_peered":"2024-04-24T23:09:56.940303+0000","last_unstale":"2024-04-24T23:09:57.936146+0000","last_undegraded":"2024-04-24T23:09:57.936146+0000","last_fullsized":"2024-04-24T23:09:57.936146+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:53:19.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.937202+0000","last_change":"2024-04-24T23:09:55.901003+0000","last_active":"2024-04-24T23:09:57.937202+0000","last_peered":"2024-04-24T23:09:57.937202+0000","last_clean":"2024-04-24T23:09:57.937202+0000","last_became_active":"2024-04-24T23:09:55.900616+0000","last_became_peered":"2024-04-24T23:09:55.900616+0000","last_unstale":"2024-04-24T23:09:57.937202+0000","last_undegraded":"2024-04-24T23:09:57.937202+0000","last_fullsized":"2024-04-24T23:09:57.937202+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:00:41.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934166+0000","last_change":"2024-04-24T23:09:56.929324+0000","last_active":"2024-04-24T23:09:57.934166+0000","last_peered":"2024-04-24T23:09:57.934166+0000","last_clean":"2024-04-24T23:09:57.934166+0000","last_became_active":"2024-04-24T23:09:56.928972+0000","last_became_peered":"2024-04-24T23:09:56.928972+0000","last_unstale":"2024-04-24T23:09:57.934166+0000","last_undegraded":"2024-04-24T23:09:57.934166+0000","last_fullsized":"2024-04-24T23:09:57.934166+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.917222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369905+0000","last_change":"2024-04-24T23:09:55.897350+0000","last_active":"2024-04-24T23:09:58.369905+0000","last_peered":"2024-04-24T23:09:58.369905+0000","last_clean":"2024-04-24T23:09:58.369905+0000","last_became_active":"2024-04-24T23:09:55.896165+0000","last_became_peered":"2024-04-24T23:09:55.896165+0000","last_unstale":"2024-04-24T23:09:58.369905+0000","last_undegraded":"2024-04-24T23:09:58.369905+0000","last_fullsized":"2024-04-24T23:09:58.369905+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:39.578060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369651+0000","last_change":"2024-04-24T23:09:56.937575+0000","last_active":"2024-04-24T23:09:58.369651+0000","last_peered":"2024-04-24T23:09:58.369651+0000","last_clean":"2024-04-24T23:09:58.369651+0000","last_became_active":"2024-04-24T23:09:56.936720+0000","last_became_peered":"2024-04-24T23:09:56.936720+0000","last_unstale":"2024-04-24T23:09:58.369651+0000","last_undegraded":"2024-04-24T23:09:58.369651+0000","last_fullsized":"2024-04-24T23:09:58.369651+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934482+0000","last_change":"2024-04-24T23:09:55.900879+0000","last_active":"2024-04-24T23:09:57.934482+0000","last_peered":"2024-04-24T23:09:57.934482+0000","last_clean":"2024-04-24T23:09:57.934482+0000","last_became_active":"2024-04-24T23:09:55.900538+0000","last_became_peered":"2024-04-24T23:09:55.900538+0000","last_unstale":"2024-04-24T23:09:57.934482+0000","last_undegraded":"2024-04-24T23:09:57.934482+0000","last_fullsized":"2024-04-24T23:09:57.934482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:55.974696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368698+0000","last_change":"2024-04-24T23:09:56.929691+0000","last_active":"2024-04-24T23:09:58.368698+0000","last_peered":"2024-04-24T23:09:58.368698+0000","last_clean":"2024-04-24T23:09:58.368698+0000","last_became_active":"2024-04-24T23:09:56.928870+0000","last_became_peered":"2024-04-24T23:09:56.928870+0000","last_unstale":"2024-04-24T23:09:58.368698+0000","last_undegraded":"2024-04-24T23:09:58.368698+0000","last_fullsized":"2024-04-24T23:09:58.368698+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:04.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":20,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369260+0000","last_change":"2024-04-24T23:09:55.904255+0000","last_active":"2024-04-24T23:09:58.369260+0000","last_peered":"2024-04-24T23:09:58.369260+0000","last_clean":"2024-04-24T23:09:58.369260+0000","last_became_active":"2024-04-24T23:09:55.903943+0000","last_became_peered":"2024-04-24T23:09:55.903943+0000","last_unstale":"2024-04-24T23:09:58.369260+0000","last_undegraded":"2024-04-24T23:09:58.369260+0000","last_fullsized":"2024-04-24T23:09:58.369260+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:29.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367154+0000","last_change":"2024-04-24T23:09:56.927437+0000","last_active":"2024-04-24T23:09:58.367154+0000","last_peered":"2024-04-24T23:09:58.367154+0000","last_clean":"2024-04-24T23:09:58.367154+0000","last_became_active":"2024-04-24T23:09:56.927140+0000","last_became_peered":"2024-04-24T23:09:56.927140+0000","last_unstale":"2024-04-24T23:09:58.367154+0000","last_undegraded":"2024-04-24T23:09:58.367154+0000","last_fullsized":"2024-04-24T23:09:58.367154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:53:19.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935323+0000","last_change":"2024-04-24T23:09:55.906123+0000","last_active":"2024-04-24T23:09:57.935323+0000","last_peered":"2024-04-24T23:09:57.935323+0000","last_clean":"2024-04-24T23:09:57.935323+0000","last_became_active":"2024-04-24T23:09:55.905737+0000","last_became_peered":"2024-04-24T23:09:55.905737+0000","last_unstale":"2024-04-24T23:09:57.935323+0000","last_undegraded":"2024-04-24T23:09:57.935323+0000","last_fullsized":"2024-04-24T23:09:57.935323+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:38.938789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.932950+0000","last_change":"2024-04-24T23:09:56.927890+0000","last_active":"2024-04-24T23:09:57.932950+0000","last_peered":"2024-04-24T23:09:57.932950+0000","last_clean":"2024-04-24T23:09:57.932950+0000","last_became_active":"2024-04-24T23:09:56.927603+0000","last_became_peered":"2024-04-24T23:09:56.927603+0000","last_unstale":"2024-04-24T23:09:57.932950+0000","last_undegraded":"2024-04-24T23:09:57.932950+0000","last_fullsized":"2024-04-24T23:09:57.932950+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:42.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367291+0000","last_change":"2024-04-24T23:09:55.905608+0000","last_active":"2024-04-24T23:09:58.367291+0000","last_peered":"2024-04-24T23:09:58.367291+0000","last_clean":"2024-04-24T23:09:58.367291+0000","last_became_active":"2024-04-24T23:09:55.904448+0000","last_became_peered":"2024-04-24T23:09:55.904448+0000","last_unstale":"2024-04-24T23:09:58.367291+0000","last_undegraded":"2024-04-24T23:09:58.367291+0000","last_fullsized":"2024-04-24T23:09:58.367291+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:20.397547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366902+0000","last_change":"2024-04-24T23:09:56.947148+0000","last_active":"2024-04-24T23:09:58.366902+0000","last_peered":"2024-04-24T23:09:58.366902+0000","last_clean":"2024-04-24T23:09:58.366902+0000","last_became_active":"2024-04-24T23:09:56.946870+0000","last_became_peered":"2024-04-24T23:09:56.946870+0000","last_unstale":"2024-04-24T23:09:58.366902+0000","last_undegraded":"2024-04-24T23:09:58.366902+0000","last_fullsized":"2024-04-24T23:09:58.366902+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:32:22.202462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366774+0000","last_change":"2024-04-24T23:09:55.903305+0000","last_active":"2024-04-24T23:09:58.366774+0000","last_peered":"2024-04-24T23:09:58.366774+0000","last_clean":"2024-04-24T23:09:58.366774+0000","last_became_active":"2024-04-24T23:09:55.902795+0000","last_became_peered":"2024-04-24T23:09:55.902795+0000","last_unstale":"2024-04-24T23:09:58.366774+0000","last_undegraded":"2024-04-24T23:09:58.366774+0000","last_fullsized":"2024-04-24T23:09:58.366774+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935894+0000","last_change":"2024-04-24T23:09:56.935577+0000","last_active":"2024-04-24T23:09:57.935894+0000","last_peered":"2024-04-24T23:09:57.935894+0000","last_clean":"2024-04-24T23:09:57.935894+0000","last_became_active":"2024-04-24T23:09:56.935239+0000","last_became_peered":"2024-04-24T23:09:56.935239+0000","last_unstale":"2024-04-24T23:09:57.935894+0000","last_undegraded":"2024-04-24T23:09:57.935894+0000","last_fullsized":"2024-04-24T23:09:57.935894+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:50.182143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368685+0000","last_change":"2024-04-24T23:09:55.905976+0000","last_active":"2024-04-24T23:09:58.368685+0000","last_peered":"2024-04-24T23:09:58.368685+0000","last_clean":"2024-04-24T23:09:58.368685+0000","last_became_active":"2024-04-24T23:09:55.905574+0000","last_became_peered":"2024-04-24T23:09:55.905574+0000","last_unstale":"2024-04-24T23:09:58.368685+0000","last_undegraded":"2024-04-24T23:09:58.368685+0000","last_fullsized":"2024-04-24T23:09:58.368685+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:05.236089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936606+0000","last_change":"2024-04-24T23:09:56.940911+0000","last_active":"2024-04-24T23:09:57.936606+0000","last_peered":"2024-04-24T23:09:57.936606+0000","last_clean":"2024-04-24T23:09:57.936606+0000","last_became_active":"2024-04-24T23:09:56.940191+0000","last_became_peered":"2024-04-24T23:09:56.940191+0000","last_unstale":"2024-04-24T23:09:57.936606+0000","last_undegraded":"2024-04-24T23:09:57.936606+0000","last_fullsized":"2024-04-24T23:09:57.936606+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:14.482544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368089+0000","last_change":"2024-04-24T23:09:55.886430+0000","last_active":"2024-04-24T23:09:58.368089+0000","last_peered":"2024-04-24T23:09:58.368089+0000","last_clean":"2024-04-24T23:09:58.368089+0000","last_became_active":"2024-04-24T23:09:55.884169+0000","last_became_peered":"2024-04-24T23:09:55.884169+0000","last_unstale":"2024-04-24T23:09:58.368089+0000","last_undegraded":"2024-04-24T23:09:58.368089+0000","last_fullsized":"2024-04-24T23:09:58.368089+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:18.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934187+0000","last_change":"2024-04-24T23:09:56.931170+0000","last_active":"2024-04-24T23:09:57.934187+0000","last_peered":"2024-04-24T23:09:57.934187+0000","last_clean":"2024-04-24T23:09:57.934187+0000","last_became_active":"2024-04-24T23:09:56.930874+0000","last_became_peered":"2024-04-24T23:09:56.930874+0000","last_unstale":"2024-04-24T23:09:57.934187+0000","last_undegraded":"2024-04-24T23:09:57.934187+0000","last_fullsized":"2024-04-24T23:09:57.934187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:07.185572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365770+0000","last_change":"2024-04-24T23:09:55.883074+0000","last_active":"2024-04-24T23:09:58.365770+0000","last_peered":"2024-04-24T23:09:58.365770+0000","last_clean":"2024-04-24T23:09:58.365770+0000","last_became_active":"2024-04-24T23:09:55.882760+0000","last_became_peered":"2024-04-24T23:09:55.882760+0000","last_unstale":"2024-04-24T23:09:58.365770+0000","last_undegraded":"2024-04-24T23:09:58.365770+0000","last_fullsized":"2024-04-24T23:09:58.365770+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:53.982280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936467+0000","last_change":"2024-04-24T23:09:56.928012+0000","last_active":"2024-04-24T23:09:57.936467+0000","last_peered":"2024-04-24T23:09:57.936467+0000","last_clean":"2024-04-24T23:09:57.936467+0000","last_became_active":"2024-04-24T23:09:56.927729+0000","last_became_peered":"2024-04-24T23:09:56.927729+0000","last_unstale":"2024-04-24T23:09:57.936467+0000","last_undegraded":"2024-04-24T23:09:57.936467+0000","last_fullsized":"2024-04-24T23:09:57.936467+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:53:07.367625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365398+0000","last_change":"2024-04-24T23:09:55.880315+0000","last_active":"2024-04-24T23:09:58.365398+0000","last_peered":"2024-04-24T23:09:58.365398+0000","last_clean":"2024-04-24T23:09:58.365398+0000","last_became_active":"2024-04-24T23:09:55.880011+0000","last_became_peered":"2024-04-24T23:09:55.880011+0000","last_unstale":"2024-04-24T23:09:58.365398+0000","last_undegraded":"2024-04-24T23:09:58.365398+0000","last_fullsized":"2024-04-24T23:09:58.365398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:43.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367200+0000","last_change":"2024-04-24T23:09:56.930919+0000","last_active":"2024-04-24T23:09:58.367200+0000","last_peered":"2024-04-24T23:09:58.367200+0000","last_clean":"2024-04-24T23:09:58.367200+0000","last_became_active":"2024-04-24T23:09:56.930597+0000","last_became_peered":"2024-04-24T23:09:56.930597+0000","last_unstale":"2024-04-24T23:09:58.367200+0000","last_undegraded":"2024-04-24T23:09:58.367200+0000","last_fullsized":"2024-04-24T23:09:58.367200+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:05.428941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933512+0000","last_change":"2024-04-24T23:09:55.905783+0000","last_active":"2024-04-24T23:09:57.933512+0000","last_peered":"2024-04-24T23:09:57.933512+0000","last_clean":"2024-04-24T23:09:57.933512+0000","last_became_active":"2024-04-24T23:09:55.905510+0000","last_became_peered":"2024-04-24T23:09:55.905510+0000","last_unstale":"2024-04-24T23:09:57.933512+0000","last_undegraded":"2024-04-24T23:09:57.933512+0000","last_fullsized":"2024-04-24T23:09:57.933512+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:04.655556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.365055+0000","last_change":"2024-04-24T23:09:56.942600+0000","last_active":"2024-04-24T23:09:58.365055+0000","last_peered":"2024-04-24T23:09:58.365055+0000","last_clean":"2024-04-24T23:09:58.365055+0000","last_became_active":"2024-04-24T23:09:56.941777+0000","last_became_peered":"2024-04-24T23:09:56.941777+0000","last_unstale":"2024-04-24T23:09:58.365055+0000","last_undegraded":"2024-04-24T23:09:58.365055+0000","last_fullsized":"2024-04-24T23:09:58.365055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:34:21.413063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.371016+0000","last_change":"2024-04-24T23:09:55.904339+0000","last_active":"2024-04-24T23:09:58.371016+0000","last_peered":"2024-04-24T23:09:58.371016+0000","last_clean":"2024-04-24T23:09:58.371016+0000","last_became_active":"2024-04-24T23:09:55.904059+0000","last_became_peered":"2024-04-24T23:09:55.904059+0000","last_unstale":"2024-04-24T23:09:58.371016+0000","last_undegraded":"2024-04-24T23:09:58.371016+0000","last_fullsized":"2024-04-24T23:09:58.371016+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:49.851813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366989+0000","last_change":"2024-04-24T23:09:56.928338+0000","last_active":"2024-04-24T23:09:58.366989+0000","last_peered":"2024-04-24T23:09:58.366989+0000","last_clean":"2024-04-24T23:09:58.366989+0000","last_became_active":"2024-04-24T23:09:56.926921+0000","last_became_peered":"2024-04-24T23:09:56.926921+0000","last_unstale":"2024-04-24T23:09:58.366989+0000","last_undegraded":"2024-04-24T23:09:58.366989+0000","last_fullsized":"2024-04-24T23:09:58.366989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:27.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.364902+0000","last_change":"2024-04-24T23:09:55.887859+0000","last_active":"2024-04-24T23:09:58.364902+0000","last_peered":"2024-04-24T23:09:58.364902+0000","last_clean":"2024-04-24T23:09:58.364902+0000","last_became_active":"2024-04-24T23:09:55.887578+0000","last_became_peered":"2024-04-24T23:09:55.887578+0000","last_unstale":"2024-04-24T23:09:58.364902+0000","last_undegraded":"2024-04-24T23:09:58.364902+0000","last_fullsized":"2024-04-24T23:09:58.364902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:39:12.436579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369269+0000","last_change":"2024-04-24T23:09:56.947213+0000","last_active":"2024-04-24T23:09:58.369269+0000","last_peered":"2024-04-24T23:09:58.369269+0000","last_clean":"2024-04-24T23:09:58.369269+0000","last_became_active":"2024-04-24T23:09:56.946885+0000","last_became_peered":"2024-04-24T23:09:56.946885+0000","last_unstale":"2024-04-24T23:09:58.369269+0000","last_undegraded":"2024-04-24T23:09:58.369269+0000","last_fullsized":"2024-04-24T23:09:58.369269+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:50.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935117+0000","last_change":"2024-04-24T23:09:55.891391+0000","last_active":"2024-04-24T23:09:57.935117+0000","last_peered":"2024-04-24T23:09:57.935117+0000","last_clean":"2024-04-24T23:09:57.935117+0000","last_became_active":"2024-04-24T23:09:55.889562+0000","last_became_peered":"2024-04-24T23:09:55.889562+0000","last_unstale":"2024-04-24T23:09:57.935117+0000","last_undegraded":"2024-04-24T23:09:57.935117+0000","last_fullsized":"2024-04-24T23:09:57.935117+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:29.685328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.366962+0000","last_change":"2024-04-24T23:09:56.921036+0000","last_active":"2024-04-24T23:09:58.366962+0000","last_peered":"2024-04-24T23:09:58.366962+0000","last_clean":"2024-04-24T23:09:58.366962+0000","last_became_active":"2024-04-24T23:09:56.920703+0000","last_became_peered":"2024-04-24T23:09:56.920703+0000","last_unstale":"2024-04-24T23:09:58.366962+0000","last_undegraded":"2024-04-24T23:09:58.366962+0000","last_fullsized":"2024-04-24T23:09:58.366962+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:39.371922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.935023+0000","last_change":"2024-04-24T23:09:55.885776+0000","last_active":"2024-04-24T23:09:57.935023+0000","last_peered":"2024-04-24T23:09:57.935023+0000","last_clean":"2024-04-24T23:09:57.935023+0000","last_became_active":"2024-04-24T23:09:55.884367+0000","last_became_peered":"2024-04-24T23:09:55.884367+0000","last_unstale":"2024-04-24T23:09:57.935023+0000","last_undegraded":"2024-04-24T23:09:57.935023+0000","last_fullsized":"2024-04-24T23:09:57.935023+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:59:07.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936212+0000","last_change":"2024-04-24T23:09:56.940835+0000","last_active":"2024-04-24T23:09:57.936212+0000","last_peered":"2024-04-24T23:09:57.936212+0000","last_clean":"2024-04-24T23:09:57.936212+0000","last_became_active":"2024-04-24T23:09:56.940545+0000","last_became_peered":"2024-04-24T23:09:56.940545+0000","last_unstale":"2024-04-24T23:09:57.936212+0000","last_undegraded":"2024-04-24T23:09:57.936212+0000","last_fullsized":"2024-04-24T23:09:57.936212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:29.634674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"95'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934861+0000","last_change":"2024-04-24T23:09:55.872709+0000","last_active":"2024-04-24T23:09:57.934861+0000","last_peered":"2024-04-24T23:09:57.934861+0000","last_clean":"2024-04-24T23:09:57.934861+0000","last_became_active":"2024-04-24T23:09:55.872409+0000","last_became_peered":"2024-04-24T23:09:55.872409+0000","last_unstale":"2024-04-24T23:09:57.934861+0000","last_undegraded":"2024-04-24T23:09:57.934861+0000","last_fullsized":"2024-04-24T23:09:57.934861+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:38.852012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936275+0000","last_change":"2024-04-24T23:09:56.937062+0000","last_active":"2024-04-24T23:09:57.936275+0000","last_peered":"2024-04-24T23:09:57.936275+0000","last_clean":"2024-04-24T23:09:57.936275+0000","last_became_active":"2024-04-24T23:09:56.936317+0000","last_became_peered":"2024-04-24T23:09:56.936317+0000","last_unstale":"2024-04-24T23:09:57.936275+0000","last_undegraded":"2024-04-24T23:09:57.936275+0000","last_fullsized":"2024-04-24T23:09:57.936275+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:09.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367506+0000","last_change":"2024-04-24T23:09:55.899285+0000","last_active":"2024-04-24T23:09:58.367506+0000","last_peered":"2024-04-24T23:09:58.367506+0000","last_clean":"2024-04-24T23:09:58.367506+0000","last_became_active":"2024-04-24T23:09:55.899020+0000","last_became_peered":"2024-04-24T23:09:55.899020+0000","last_unstale":"2024-04-24T23:09:58.367506+0000","last_undegraded":"2024-04-24T23:09:58.367506+0000","last_fullsized":"2024-04-24T23:09:58.367506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936907+0000","last_change":"2024-04-24T23:09:56.928574+0000","last_active":"2024-04-24T23:09:57.936907+0000","last_peered":"2024-04-24T23:09:57.936907+0000","last_clean":"2024-04-24T23:09:57.936907+0000","last_became_active":"2024-04-24T23:09:56.927898+0000","last_became_peered":"2024-04-24T23:09:56.927898+0000","last_unstale":"2024-04-24T23:09:57.936907+0000","last_undegraded":"2024-04-24T23:09:57.936907+0000","last_fullsized":"2024-04-24T23:09:57.936907+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:25.848924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934559+0000","last_change":"2024-04-24T23:09:55.897509+0000","last_active":"2024-04-24T23:09:57.934559+0000","last_peered":"2024-04-24T23:09:57.934559+0000","last_clean":"2024-04-24T23:09:57.934559+0000","last_became_active":"2024-04-24T23:09:55.896981+0000","last_became_peered":"2024-04-24T23:09:55.896981+0000","last_unstale":"2024-04-24T23:09:57.934559+0000","last_undegraded":"2024-04-24T23:09:57.934559+0000","last_fullsized":"2024-04-24T23:09:57.934559+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:56:27.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367471+0000","last_change":"2024-04-24T23:09:56.930569+0000","last_active":"2024-04-24T23:09:58.367471+0000","last_peered":"2024-04-24T23:09:58.367471+0000","last_clean":"2024-04-24T23:09:58.367471+0000","last_became_active":"2024-04-24T23:09:56.928323+0000","last_became_peered":"2024-04-24T23:09:56.928323+0000","last_unstale":"2024-04-24T23:09:58.367471+0000","last_undegraded":"2024-04-24T23:09:58.367471+0000","last_fullsized":"2024-04-24T23:09:58.367471+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:46.003977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.370023+0000","last_change":"2024-04-24T23:09:55.902928+0000","last_active":"2024-04-24T23:09:58.370023+0000","last_peered":"2024-04-24T23:09:58.370023+0000","last_clean":"2024-04-24T23:09:58.370023+0000","last_became_active":"2024-04-24T23:09:55.902393+0000","last_became_peered":"2024-04-24T23:09:55.902393+0000","last_unstale":"2024-04-24T23:09:58.370023+0000","last_undegraded":"2024-04-24T23:09:58.370023+0000","last_fullsized":"2024-04-24T23:09:58.370023+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.285345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369638+0000","last_change":"2024-04-24T23:09:56.933724+0000","last_active":"2024-04-24T23:09:58.369638+0000","last_peered":"2024-04-24T23:09:58.369638+0000","last_clean":"2024-04-24T23:09:58.369638+0000","last_became_active":"2024-04-24T23:09:56.933457+0000","last_became_peered":"2024-04-24T23:09:56.933457+0000","last_unstale":"2024-04-24T23:09:58.369638+0000","last_undegraded":"2024-04-24T23:09:58.369638+0000","last_fullsized":"2024-04-24T23:09:58.369638+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:44.189224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.934615+0000","last_change":"2024-04-24T23:09:55.878355+0000","last_active":"2024-04-24T23:09:57.934615+0000","last_peered":"2024-04-24T23:09:57.934615+0000","last_clean":"2024-04-24T23:09:57.934615+0000","last_became_active":"2024-04-24T23:09:55.877074+0000","last_became_peered":"2024-04-24T23:09:55.877074+0000","last_unstale":"2024-04-24T23:09:57.934615+0000","last_undegraded":"2024-04-24T23:09:57.934615+0000","last_fullsized":"2024-04-24T23:09:57.934615+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:00.880687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.367439+0000","last_change":"2024-04-24T23:09:56.939521+0000","last_active":"2024-04-24T23:09:58.367439+0000","last_peered":"2024-04-24T23:09:58.367439+0000","last_clean":"2024-04-24T23:09:58.367439+0000","last_became_active":"2024-04-24T23:09:56.936959+0000","last_became_peered":"2024-04-24T23:09:56.936959+0000","last_unstale":"2024-04-24T23:09:58.367439+0000","last_undegraded":"2024-04-24T23:09:58.367439+0000","last_fullsized":"2024-04-24T23:09:58.367439+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:35.423485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.933303+0000","last_change":"2024-04-24T23:09:55.895704+0000","last_active":"2024-04-24T23:09:57.933303+0000","last_peered":"2024-04-24T23:09:57.933303+0000","last_clean":"2024-04-24T23:09:57.933303+0000","last_became_active":"2024-04-24T23:09:55.895351+0000","last_became_peered":"2024-04-24T23:09:55.895351+0000","last_unstale":"2024-04-24T23:09:57.933303+0000","last_undegraded":"2024-04-24T23:09:57.933303+0000","last_fullsized":"2024-04-24T23:09:57.933303+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:39.281068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.368090+0000","last_change":"2024-04-24T23:09:56.945238+0000","last_active":"2024-04-24T23:09:58.368090+0000","last_peered":"2024-04-24T23:09:58.368090+0000","last_clean":"2024-04-24T23:09:58.368090+0000","last_became_active":"2024-04-24T23:09:56.944093+0000","last_became_peered":"2024-04-24T23:09:56.944093+0000","last_unstale":"2024-04-24T23:09:58.368090+0000","last_undegraded":"2024-04-24T23:09:58.368090+0000","last_fullsized":"2024-04-24T23:09:58.368090+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:02.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.932628+0000","last_change":"2024-04-24T23:09:55.877706+0000","last_active":"2024-04-24T23:09:57.932628+0000","last_peered":"2024-04-24T23:09:57.932628+0000","last_clean":"2024-04-24T23:09:57.932628+0000","last_became_active":"2024-04-24T23:09:55.877145+0000","last_became_peered":"2024-04-24T23:09:55.877145+0000","last_unstale":"2024-04-24T23:09:57.932628+0000","last_undegraded":"2024-04-24T23:09:57.932628+0000","last_fullsized":"2024-04-24T23:09:57.932628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:23.501000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.936525+0000","last_change":"2024-04-24T23:09:56.928920+0000","last_active":"2024-04-24T23:09:57.936525+0000","last_peered":"2024-04-24T23:09:57.936525+0000","last_clean":"2024-04-24T23:09:57.936525+0000","last_became_active":"2024-04-24T23:09:56.928293+0000","last_became_peered":"2024-04-24T23:09:56.928293+0000","last_unstale":"2024-04-24T23:09:57.936525+0000","last_undegraded":"2024-04-24T23:09:57.936525+0000","last_fullsized":"2024-04-24T23:09:57.936525+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:55.851649+0000","last_clean_scrub_stamp":"2024-04-24T23:09:55.851649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:50.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:58.369538+0000","last_change":"2024-04-24T23:09:55.903234+0000","last_active":"2024-04-24T23:09:58.369538+0000","last_peered":"2024-04-24T23:09:58.369538+0000","last_clean":"2024-04-24T23:09:58.369538+0000","last_became_active":"2024-04-24T23:09:55.900164+0000","last_became_peered":"2024-04-24T23:09:55.900164+0000","last_unstale":"2024-04-24T23:09:58.369538+0000","last_undegraded":"2024-04-24T23:09:58.369538+0000","last_fullsized":"2024-04-24T23:09:58.369538+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:09:54.836134+0000","last_clean_scrub_stamp":"2024-04-24T23:09:54.836134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:12:34.790708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":310,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-24T23:09:57.932890+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:09:57.932890+0000","last_peered":"2024-04-24T23:09:57.932890+0000","last_clean":"2024-04-24T23:09:57.932890+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:09:57.932890+0000","last_undegraded":"2024-04-24T23:09:57.932890+0000","last_fullsized":"2024-04-24T23:09:57.932890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":537065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509567,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1183744,"data_stored":538801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509566,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1163264,"data_stored":537065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509567,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1183744,"data_stored":538789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509568,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":537669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509568,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":1128119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509566,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":537135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1127433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:06.825 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:10:06.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-24T23:10:07.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.075+0000 7fd954600640 1 Processor -- start 2024-04-24T23:10:07.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.076+0000 7fd954600640 1 -- start start 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd954600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94c0b60b0 0x7fd94c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd954600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0ca9c0 0x7fd94c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd954600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c0cb370 con 0x7fd94c0d0d80 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd954600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd94c161e10 con 0x7fd94c0b60b0 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd954600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c073760 con 0x7fd94c0ca9c0 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd951c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd94c0d0d80 0x7fd94c06b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42022/0 (socket says 172.21.15.146:42022) 2024-04-24T23:10:07.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd951c00640 1 -- 172.21.15.146:0/2972122142 learned_addr learned my addr 172.21.15.146:0/2972122142 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:07.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.077+0000 7fd951200640 1 --2- 172.21.15.146:0/2972122142 >> v2:172.21.15.146:3300/0 conn(0x7fd94c0b60b0 0x7fd94c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd952600640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0ca9c0 0x7fd94c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd951200640 1 -- 172.21.15.146:0/2972122142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0ca9c0 msgr2=0x7fd94c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:07.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd951200640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0ca9c0 0x7fd94c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd951200640 1 -- 172.21.15.146:0/2972122142 >> v1:172.21.15.146:6789/0 conn(0x7fd94c0d0d80 legacy=0x7fd94c06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd951200640 1 -- 172.21.15.146:0/2972122142 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0cd850 con 0x7fd94c0b60b0 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.078+0000 7fd94be00640 1 -- 172.21.15.146:0/2972122142 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479590460 0 0) 0x7fd94c0cb370 con 0x7fd94c0d0d80 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.079+0000 7fd951200640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c0b57a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd940009d90 tx=0x7fd94002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f7a2164787bbc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.079+0000 7fd94be00640 1 -- 172.21.15.146:0/2972122142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940031600 con 0x7fd94c0b60b0 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.079+0000 7fd94be00640 1 -- 172.21.15.146:0/2972122142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9400317a0 con 0x7fd94c0b60b0 2024-04-24T23:10:07.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.079+0000 7fd94be00640 1 -- 172.21.15.146:0/2972122142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940031b70 con 0x7fd94c0b60b0 2024-04-24T23:10:07.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 -- 172.21.15.146:0/2972122142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 msgr2=0x7fd94c0b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c0b57a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd940009d90 tx=0x7fd94002a5d0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 -- 172.21.15.146:0/2972122142 shutdown_connections 2024-04-24T23:10:07.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0ca9c0 0x7fd94c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 --2- 172.21.15.146:0/2972122142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c0b57a0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 -- 172.21.15.146:0/2972122142 >> 172.21.15.146:0/2972122142 conn(0x7fd94c072880 msgr2=0x7fd94c072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:07.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 -- 172.21.15.146:0/2972122142 shutdown_connections 2024-04-24T23:10:07.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.080+0000 7fd954600640 1 -- 172.21.15.146:0/2972122142 wait complete. 2024-04-24T23:10:07.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.082+0000 7fd954600640 1 Processor -- start 2024-04-24T23:10:07.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.082+0000 7fd954600640 1 -- start start 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 0x7fd94c099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0d0d80 0x7fd94c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0b53c0 con 0x7fd94c0b60b0 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0b50e0 con 0x7fd94c0ca9c0 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd954600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c06b8c0 con 0x7fd94c0d0d80 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd951c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd951c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37614/0 (socket says 172.21.15.146:37614) 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.083+0000 7fd951c00640 1 -- 172.21.15.146:0/3980082551 learned_addr learned my addr 172.21.15.146:0/3980082551 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:07.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd952600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0d0d80 0x7fd94c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951200640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 0x7fd94c099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 -- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0d0d80 msgr2=0x7fd94c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0d0d80 0x7fd94c06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 -- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 msgr2=0x7fd94c099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 0x7fd94c099910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 -- 172.21.15.146:0/3980082551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c153890 con 0x7fd94c0b60b0 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951200640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 0x7fd94c099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:07.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd951c00640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c430 tx=0x7fd93c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c017070 con 0x7fd94c0b60b0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c005ce0 con 0x7fd94c0b60b0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c007310 con 0x7fd94c0b60b0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.084+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c0c77e0 con 0x7fd94c0b60b0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.085+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c0c7da0 con 0x7fd94c0b60b0 2024-04-24T23:10:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.086+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c0d0280 con 0x7fd94c0b60b0 2024-04-24T23:10:07.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.087+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd93c01a070 con 0x7fd94c0b60b0 2024-04-24T23:10:07.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.088+0000 7fd949600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.088+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fd93c08a560 con 0x7fd94c0b60b0 2024-04-24T23:10:07.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.089+0000 7fd951200640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.090+0000 7fd951200640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 0x7fd93006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd940034000 tx=0x7fd94002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.093+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd94c0d0280 con 0x7fd94c0b60b0 2024-04-24T23:10:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.370+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd94c073030 con 0x7fd94c0b60b0 2024-04-24T23:10:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.375+0000 7fd949600640 1 -- 172.21.15.146:0/3980082551 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fd94c153890 con 0x7fd94c0b60b0 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCmjilmtF2QNhAAGlAOM3GvnL7uDPWgSdvugw== 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-24T23:10:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 msgr2=0x7fd93006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 0x7fd93006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd940034000 tx=0x7fd94002f000 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 msgr2=0x7fd94c153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c430 tx=0x7fd93c00c8f0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 shutdown_connections 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c0d0d80 0x7fd94c06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c0ca9c0 0x7fd94c099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 --2- 172.21.15.146:0/3980082551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0b60b0 0x7fd94c153350 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.378+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 >> 172.21.15.146:0/3980082551 conn(0x7fd94c072880 msgr2=0x7fd94c0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.379+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 shutdown_connections 2024-04-24T23:10:07.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.379+0000 7fd954600640 1 -- 172.21.15.146:0/3980082551 wait complete. 2024-04-24T23:10:07.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:07.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.598+0000 7fab78600640 1 Processor -- start 2024-04-24T23:10:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.598+0000 7fab78600640 1 -- start start 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab78600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fab70145640 0x7fab7015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab78600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab700cdf70 con 0x7fab700b2a20 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab78600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7015d360 con 0x7fab700d03a0 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab78600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fab70145a20 con 0x7fab70145640 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab75200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fab700b2a20 0x7fab700cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42034/0 (socket says 172.21.15.146:42034) 2024-04-24T23:10:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.600+0000 7fab75200640 1 -- 172.21.15.146:0/2781927152 learned_addr learned my addr 172.21.15.146:0/2781927152 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab75c00640 1 --2- 172.21.15.146:0/2781927152 >> v2:172.21.15.203:3300/0 conn(0x7fab70145640 0x7fab7015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845567797 0 0) 0x7fab700cdf70 con 0x7fab700b2a20 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab58003520 con 0x7fab700b2a20 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4098917667 0 0) 0x7fab58003520 con 0x7fab700b2a20 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 >> v2:172.21.15.203:3300/0 conn(0x7fab70145640 msgr2=0x7fab7015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 --2- 172.21.15.146:0/2781927152 >> v2:172.21.15.203:3300/0 conn(0x7fab70145640 0x7fab7015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 >> v1:172.21.15.203:6789/0 conn(0x7fab700d03a0 legacy=0x7fab700ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7006d140 con 0x7fab700b2a20 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fab5c001690 con 0x7fab700b2a20 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 >> v1:172.21.15.146:6789/0 conn(0x7fab700b2a20 legacy=0x7fab700cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab580039b0 0x7fab58003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab58004800 0x7fab58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 0x7fab5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab70145a20 con 0x7fab580051c0 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab5800c0f0 con 0x7fab58004800 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fab5800c2f0 con 0x7fab580039b0 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.601+0000 7fab76600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 0x7fab5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab75c00640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab580039b0 0x7fab58003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab75200640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab58004800 0x7fab58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab76600640 1 -- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab580039b0 msgr2=0x7fab58003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab76600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab580039b0 0x7fab58003db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab76600640 1 -- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab58004800 msgr2=0x7fab58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab76600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab58004800 0x7fab58004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.602+0000 7fab76600640 1 -- 172.21.15.146:0/2781927152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab58003520 con 0x7fab580051c0 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.603+0000 7fab76600640 1 -- 172.21.15.146:0/2781927152 reap_dead start 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.603+0000 7fab76600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 0x7fab5800b9c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fab68004480 tx=0x7fab58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de61fe2aed66ee07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.603+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68004080 con 0x7fab580051c0 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.603+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6802ad80 con 0x7fab580051c0 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.603+0000 7fab6fe00640 1 -- 172.21.15.146:0/2781927152 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68006d90 con 0x7fab580051c0 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 -- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 msgr2=0x7fab5800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 0x7fab5800b9c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fab68004480 tx=0x7fab58005830 comp rx=0 tx=0).stop 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 -- 172.21.15.146:0/2781927152 shutdown_connections 2024-04-24T23:10:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 --2- 172.21.15.146:0/2781927152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab580051c0 0x7fab5800b9c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 -- 172.21.15.146:0/2781927152 >> 172.21.15.146:0/2781927152 conn(0x7fab7006b320 msgr2=0x7fab7006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:07.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 -- 172.21.15.146:0/2781927152 shutdown_connections 2024-04-24T23:10:07.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.604+0000 7fab78600640 1 -- 172.21.15.146:0/2781927152 wait complete. 2024-04-24T23:10:07.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.606+0000 7fab78600640 1 Processor -- start 2024-04-24T23:10:07.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.606+0000 7fab78600640 1 -- start start 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 0x7fab701399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab701363e0 0x7fab701f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab7006d9e0 con 0x7fab70070c10 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab7006d700 con 0x7fab580051c0 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab78600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fab7006cbc0 con 0x7fab701363e0 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab76600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab76600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37630/0 (socket says 172.21.15.146:37630) 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab76600640 1 -- 172.21.15.146:0/1547979068 learned_addr learned my addr 172.21.15.146:0/1547979068 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab75c00640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 0x7fab701399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.607+0000 7fab75200640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab701363e0 0x7fab701f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 -- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab701363e0 msgr2=0x7fab701f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab701363e0 0x7fab701f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 -- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 msgr2=0x7fab701399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 0x7fab701399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 -- 172.21.15.146:0/1547979068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab70137b60 con 0x7fab70070c10 2024-04-24T23:10:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab75c00640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 0x7fab701399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab76600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fab68004480 tx=0x7fab68003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68007860 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68043070 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68032440 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab701f4870 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.608+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab70137dd0 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.610+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab70068190 con 0x7fab70070c10 2024-04-24T23:10:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.611+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab680325e0 con 0x7fab70070c10 2024-04-24T23:10:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.611+0000 7fab6d600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 0x7fab5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.612+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fab680ab810 con 0x7fab70070c10 2024-04-24T23:10:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.612+0000 7fab75c00640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 0x7fab5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:07.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.613+0000 7fab75c00640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 0x7fab5006e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fab64006fd0 tx=0x7fab64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:07.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.616+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fab701f4870 con 0x7fab70070c10 2024-04-24T23:10:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.855+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab7013d360 con 0x7fab70070c10 2024-04-24T23:10:07.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.856+0000 7fab6d600640 1 -- 172.21.15.146:0/1547979068 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7fab6807a0b0 con 0x7fab70070c10 2024-04-24T23:10:07.857 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:07.857 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 msgr2=0x7fab5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 0x7fab5006e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fab64006fd0 tx=0x7fab64008040 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 msgr2=0x7fab700af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fab68004480 tx=0x7fab68003a70 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 shutdown_connections 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab70070c10 0x7fab700af880 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fab5006be30 0x7fab5006e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab701363e0 0x7fab701f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 --2- 172.21.15.146:0/1547979068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab580051c0 0x7fab701399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 >> 172.21.15.146:0/1547979068 conn(0x7fab7006b320 msgr2=0x7fab700b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 shutdown_connections 2024-04-24T23:10:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:07.859+0000 7fab78600640 1 -- 172.21.15.146:0/1547979068 wait complete. 2024-04-24T23:10:08.281 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:09:56.332407+0000', 'modified': '2024-04-24T23:09:59.413973+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7956}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7956': {'gid': 7956, 'name': 'd', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6837/1394221718', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6835', 'nonce': 1394221718}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 1394221718}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7956, 'qdb_cluster': [7956]} 2024-04-24T23:10:08.281 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:10:08.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-24T23:10:08.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.496+0000 7f4da3800640 1 Processor -- start 2024-04-24T23:10:08.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.496+0000 7f4da3800640 1 -- start start 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4da3800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4d9c15ae10 0x7f4d9c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4da3800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c06e6d0 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4da3800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c06e9b0 con 0x7f4d9c072330 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4da3800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9c06ec90 con 0x7f4d9c15ae10 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4d9be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d9c06e1c0 0x7f4d9c071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49778/0 (socket says 172.21.15.146:49778) 2024-04-24T23:10:08.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.498+0000 7f4d9be00640 1 -- 172.21.15.146:0/2963187704 learned_addr learned my addr 172.21.15.146:0/2963187704 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:08.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2963187704 >> v2:172.21.15.203:3300/0 conn(0x7f4d9c15ae10 0x7f4d9c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595261526 0 0) 0x7f4d9c06e6d0 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d80003520 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2767014930 0 0) 0x7f4d80003520 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 >> v2:172.21.15.203:3300/0 conn(0x7f4d9c15ae10 msgr2=0x7f4d9c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 --2- 172.21.15.146:0/2963187704 >> v2:172.21.15.203:3300/0 conn(0x7f4d9c15ae10 0x7f4d9c06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 >> v1:172.21.15.203:6789/0 conn(0x7f4d9c072330 legacy=0x7f4d9c0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c15ea30 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f4d88001670 con 0x7f4d9c06e1c0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 >> v1:172.21.15.146:6789/0 conn(0x7f4d9c06e1c0 legacy=0x7f4d9c071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80004800 0x7f4d80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d800051c0 0x7f4d8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c06ec90 con 0x7f4d800039b0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8000c110 con 0x7f4d80004800 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.499+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8000c310 con 0x7f4d800051c0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4d9be00640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80004800 0x7f4d80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 -- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d800051c0 msgr2=0x7f4d8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d800051c0 0x7f4d8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 -- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80004800 msgr2=0x7f4d80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d80004800 0x7f4d80004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da0e00640 1 -- 172.21.15.146:0/2963187704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d80003520 con 0x7f4d800039b0 2024-04-24T23:10:08.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.500+0000 7f4da1800640 1 -- 172.21.15.146:0/2963187704 reap_dead start 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.501+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d80003dd0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009ba0 tx=0x7f4d80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e1c6f7fe14c0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.501+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c03a070 con 0x7f4d800039b0 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.501+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c02d790 con 0x7f4d800039b0 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.501+0000 7f4d9b400640 1 -- 172.21.15.146:0/2963187704 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c009be0 con 0x7f4d800039b0 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 -- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 msgr2=0x7f4d80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d80003dd0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009ba0 tx=0x7f4d80005830 comp rx=0 tx=0).stop 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 -- 172.21.15.146:0/2963187704 shutdown_connections 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 --2- 172.21.15.146:0/2963187704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d80003dd0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 -- 172.21.15.146:0/2963187704 >> 172.21.15.146:0/2963187704 conn(0x7f4d9c0b2830 msgr2=0x7f4d9c0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 -- 172.21.15.146:0/2963187704 shutdown_connections 2024-04-24T23:10:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.502+0000 7f4da3800640 1 -- 172.21.15.146:0/2963187704 wait complete. 2024-04-24T23:10:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.504+0000 7f4da3800640 1 Processor -- start 2024-04-24T23:10:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.504+0000 7f4da3800640 1 -- start start 2024-04-24T23:10:08.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d9c0cf5b0 0x7f4d9c0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d9c0cfa30 0x7f4d9c0af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c06e010 con 0x7f4d800039b0 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c06de90 con 0x7f4d9c0cfa30 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da3800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c071c20 con 0x7f4d9c0cf5b0 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38110/0 (socket says 172.21.15.146:38110) 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da0e00640 1 -- 172.21.15.146:0/3577957387 learned_addr learned my addr 172.21.15.146:0/3577957387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.505+0000 7f4da1800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d9c0cfa30 0x7f4d9c0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4d9be00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d9c0cf5b0 0x7f4d9c0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 -- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d9c0cf5b0 msgr2=0x7f4d9c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d9c0cf5b0 0x7f4d9c0aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 -- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d9c0cfa30 msgr2=0x7f4d9c0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d9c0cfa30 0x7f4d9c0af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 -- 172.21.15.146:0/3577957387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c14ad70 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c038040 tx=0x7f4d8c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4d98c00640 1 -- 172.21.15.146:0/3577957387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c045070 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4d98c00640 1 -- 172.21.15.146:0/3577957387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c003990 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4d98c00640 1 -- 172.21.15.146:0/3577957387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c03a040 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c15d6c0 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.506+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c15dc80 con 0x7f4d800039b0 2024-04-24T23:10:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.509+0000 7f4d98c00640 1 -- 172.21.15.146:0/3577957387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d8c048070 con 0x7f4d800039b0 2024-04-24T23:10:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.510+0000 7f4d98c00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 0x7f4d7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.510+0000 7f4d98c00640 1 -- 172.21.15.146:0/3577957387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f4d8c0ab520 con 0x7f4d800039b0 2024-04-24T23:10:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.511+0000 7f4d9be00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 0x7f4d7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.511+0000 7f4da6593740 1 Processor -- start 2024-04-24T23:10:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.511+0000 7f4da6593740 1 -- start start 2024-04-24T23:10:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 0x560b64b76470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b64a2fed0 con 0x560b64b77db0 2024-04-24T23:10:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560b64a92df0 con 0x560b64b301f0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560b64a3b8d0 con 0x560b64b5a510 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4d9be00640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 0x7f4d7c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4d9be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4d9be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38122/0 (socket says 172.21.15.146:38122) 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.512+0000 7f4d9be00640 1 -- 172.21.15.146:0/394642562 learned_addr learned my addr 172.21.15.146:0/394642562 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4da1800640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 0x560b64b76470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4da0e00640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 -- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 msgr2=0x560b64b5a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b5a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 -- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 msgr2=0x560b64b76470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 0x560b64b76470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 -- 172.21.15.146:0/394642562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b647a72d0 con 0x560b64b77db0 2024-04-24T23:10:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4da1800640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 0x560b64b76470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d9be00640 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800ee00 tx=0x7f4d88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87bf41e81c39add server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d91600640 1 -- 172.21.15.146:0/394642562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88007460 con 0x560b64b77db0 2024-04-24T23:10:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d91600640 1 -- 172.21.15.146:0/394642562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88007600 con 0x560b64b77db0 2024-04-24T23:10:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.513+0000 7f4d91600640 1 -- 172.21.15.146:0/394642562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88013680 con 0x560b64b77db0 2024-04-24T23:10:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 -- 172.21.15.146:0/394642562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 msgr2=0x560b64b78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800ee00 tx=0x7f4d88011000 comp rx=0 tx=0).stop 2024-04-24T23:10:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 -- 172.21.15.146:0/394642562 shutdown_connections 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b301f0 0x560b64b76470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b78300 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 --2- 172.21.15.146:0/394642562 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b5a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 -- 172.21.15.146:0/394642562 >> 172.21.15.146:0/394642562 conn(0x560b64b2cb20 msgr2=0x560b64b75320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 -- 172.21.15.146:0/394642562 shutdown_connections 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.514+0000 7f4da6593740 1 -- 172.21.15.146:0/394642562 wait complete. 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.515+0000 7f4da6593740 1 -- start start 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.515+0000 7f4da6593740 1 Processor -- start 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b6e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b77db0 0x560b64b6e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b64a4ed20 con 0x560b64b5cc00 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560b64a8edb0 con 0x560b64b5a510 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560b64b30f90 con 0x560b64b77db0 2024-04-24T23:10:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da6593740 10 client.0 _ll_register_callbacks cb 0x560b64a89f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38130/0 (socket says 172.21.15.146:38130) 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.516+0000 7f4da1800640 1 -- 172.21.15.146:0/3127333318 learned_addr learned my addr 172.21.15.146:0/3127333318 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b6e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4d9be00640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b77db0 0x560b64b6e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 -- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b77db0 msgr2=0x560b64b6e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b77db0 0x560b64b6e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 -- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 msgr2=0x560b64b6e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b6e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 -- 172.21.15.146:0/3127333318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b648716b0 con 0x560b64b5cc00 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4da1800640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0b37d0 tx=0x7f4d9400d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2031e29ad563836 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4d86000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94001d20 con 0x560b64b5cc00 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.517+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f4d9400de20 con 0x560b64b5cc00 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d88007600 con 0x560b64b5cc00 2024-04-24T23:10:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4d9401e050 con 0x560b64b5cc00 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 10 client.8103 fetch_fsmap learned FSMap version 83 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x560b64b5c400 con 0x560b64b5cc00 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88007600 con 0x560b64b5cc00 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f4d94021020 con 0x560b64b5cc00 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 10 client.8103 fetch_fsmap finished waiting for FSMap version 83 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 10 client.8103 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 20 client.8103 populate_metadata read hostname 'smithi146' 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64b912c0 0x560b64b936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 4 client.8103 mds_command: new command op to 7956 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:10:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.518+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 --> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b64aa0330 con 0x560b64b912c0 2024-04-24T23:10:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.519+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64b912c0 0x560b64b936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.520+0000 7f4da0e00640 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64b912c0 0x560b64b936b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc87580c41569bb server_cookie=f8cdc519375b5a9 in_seq=0 out_seq=0 2024-04-24T23:10:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.520+0000 7f4d86000640 10 client.8103 ms_handle_connect on v2:172.21.15.203:6835/1394221718 2024-04-24T23:10:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.522+0000 7f4d86000640 1 -- 172.21.15.146:0/3127333318 <== mds.0 v2:172.21.15.203:6835/1394221718 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560b64aa0330 con 0x560b64b912c0 2024-04-24T23:10:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.522+0000 7f4d86000640 10 client.8103 handle_command_reply: tid=0 2024-04-24T23:10:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 client.8103 shutdown 2024-04-24T23:10:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 msgr2=0x560b64b85280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0b37d0 tx=0x7f4d9400d580 comp rx=0 tx=0).stop 2024-04-24T23:10:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 shutdown_connections 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64b912c0 0x560b64b936b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b5cc00 0x560b64b85280 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b77db0 0x560b64b6e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 --2- 172.21.15.146:0/3127333318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b6e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4d86000640 0 client.8103 ms_handle_reset on v2:172.21.15.203:6835/1394221718 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 >> 172.21.15.146:0/3127333318 conn(0x560b64b301f0 msgr2=0x560b64b79130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 shutdown_connections 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 1 -- 172.21.15.146:0/3127333318 wait complete. 2024-04-24T23:10:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.523+0000 7f4da6593740 20 client.8103 trim_cache size 0 max 16384 2024-04-24T23:10:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.543+0000 7f4da6593740 1 Processor -- start 2024-04-24T23:10:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.543+0000 7f4da6593740 1 -- start start 2024-04-24T23:10:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b76560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5cc00 0x560b64b990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c200380 con 0x560b64b77db0 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1ff710 con 0x560b64b5a510 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c1ffd60 con 0x560b64b5cc00 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38142/0 (socket says 172.21.15.146:38142) 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.544+0000 7f4da1800640 1 -- 172.21.15.146:0/2248401995 learned_addr learned my addr 172.21.15.146:0/2248401995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b76560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4d9be00640 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5cc00 0x560b64b990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 -- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5cc00 msgr2=0x560b64b990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5cc00 0x560b64b990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 -- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 msgr2=0x560b64b76560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b76560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 -- 172.21.15.146:0/2248401995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b64ac70f0 con 0x560b64b77db0 2024-04-24T23:10:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4da1800640 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4d94001620 tx=0x7f4d94011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78c1ef8625d7a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4d90c00640 1 -- 172.21.15.146:0/2248401995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004210 con 0x560b64b77db0 2024-04-24T23:10:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4d90c00640 1 -- 172.21.15.146:0/2248401995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9400de20 con 0x560b64b77db0 2024-04-24T23:10:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.545+0000 7f4d90c00640 1 -- 172.21.15.146:0/2248401995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94007b30 con 0x560b64b77db0 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 -- 172.21.15.146:0/2248401995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 msgr2=0x560b64b76f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4d94001620 tx=0x7f4d94011000 comp rx=0 tx=0).stop 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 -- 172.21.15.146:0/2248401995 shutdown_connections 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b76f40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5cc00 0x560b64b990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 --2- 172.21.15.146:0/2248401995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5a510 0x560b64b76560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 -- 172.21.15.146:0/2248401995 >> 172.21.15.146:0/2248401995 conn(0x560b64b301f0 msgr2=0x560b64b5b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 -- 172.21.15.146:0/2248401995 shutdown_connections 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.546+0000 7f4da6593740 1 -- 172.21.15.146:0/2248401995 wait complete. 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.547+0000 7f4da6593740 1 -- start start 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.547+0000 7f4da6593740 1 Processor -- start 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5cc00 0x560b64b6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b64b85ee0 con 0x560b64b77db0 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560b64b5c6e0 con 0x560b64b5cc00 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x560b64b6db20 con 0x560b64b5a510 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da6593740 10 client.0 _ll_register_callbacks cb 0x7f4d94008bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38154/0 (socket says 172.21.15.146:38154) 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.548+0000 7f4da1800640 1 -- 172.21.15.146:0/2743315834 learned_addr learned my addr 172.21.15.146:0/2743315834 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b6dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4d9be00640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5cc00 0x560b64b6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 -- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 msgr2=0x560b64b6dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b6dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 -- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5cc00 msgr2=0x560b64b6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5cc00 0x560b64b6e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 -- 172.21.15.146:0/2743315834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b64b4a250 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da1800640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e010 tx=0x7f4d94001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3585e14cfb35a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4d86000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94007070 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f4d940309c0 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.549+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d9400de20 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4d94030c20 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 10 client.8109 fetch_fsmap learned FSMap version 83 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x560b64b98bf0 con 0x560b64b77db0 2024-04-24T23:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9400de20 con 0x560b64b77db0 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f4d94021070 con 0x560b64b77db0 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 10 client.8109 fetch_fsmap finished waiting for FSMap version 83 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 10 client.8109 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 20 client.8109 populate_metadata read hostname 'smithi146' 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64be7270 0x560b64be7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 4 client.8109 mds_command: new command op to 7956 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.550+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 --> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] -- command(tid 0: {"prefix": "status"}) -- 0x560b64a9a680 con 0x560b64be7270 2024-04-24T23:10:08.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.551+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64be7270 0x560b64be7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4da0e00640 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64be7270 0x560b64be7650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca53c3ca596a9810 server_cookie=9ccbcf1d1de86368 in_seq=0 out_seq=0 2024-04-24T23:10:08.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4d86000640 10 client.8109 ms_handle_connect on v2:172.21.15.203:6835/1394221718 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4d86000640 1 -- 172.21.15.146:0/2743315834 <== mds.0 v2:172.21.15.203:6835/1394221718 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x560b64a9a680 con 0x560b64be7270 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4d86000640 10 client.8109 handle_command_reply: tid=0 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4da6593740 1 client.8109 shutdown 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 msgr2=0x560b64b29680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.552+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e010 tx=0x7f4d94001120 comp rx=0 tx=0).stop 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 shutdown_connections 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:6835/1394221718,v1:172.21.15.203:6837/1394221718] conn(0x560b64be7270 0x560b64be7650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b64b77db0 0x560b64b29680 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560b64b5cc00 0x560b64b6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4d86000640 0 client.8109 ms_handle_reset on v2:172.21.15.203:6835/1394221718 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 --2- 172.21.15.146:0/2743315834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x560b64b5a510 0x560b64b6dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 >> 172.21.15.146:0/2743315834 conn(0x560b64b301f0 msgr2=0x560b64b305d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 shutdown_connections 2024-04-24T23:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 1 -- 172.21.15.146:0/2743315834 wait complete. 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da6593740 20 client.8109 trim_cache size 0 max 16384 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "6a930041-393c-45a0-b3d3-8568bdacde7e", 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7956, 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 11.6326283, 2024-04-24T23:10:08.558 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 83, 2024-04-24T23:10:08.559 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 95, 2024-04-24T23:10:08.559 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 95, 2024-04-24T23:10:08.559 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 17.114293308000001 2024-04-24T23:10:08.559 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 msgr2=0x7f4d7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 0x7f4d7c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d88009040 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 msgr2=0x7f4d9c14a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.553+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c038040 tx=0x7f4d8c004ab0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 shutdown_connections 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d9c0cfa30 0x7f4d9c0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d7c06be30 0x7f4d7c06e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d9c0cf5b0 0x7f4d9c0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 --2- 172.21.15.146:0/3577957387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d800039b0 0x7f4d9c14a830 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 >> 172.21.15.146:0/3577957387 conn(0x7f4d9c0b2830 msgr2=0x7f4d9c15b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 shutdown_connections 2024-04-24T23:10:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.554+0000 7f4da3800640 1 -- 172.21.15.146:0/3577957387 wait complete. 2024-04-24T23:10:08.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:10:08.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.765+0000 7f362a200640 1 Processor -- start 2024-04-24T23:10:08.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.765+0000 7f362a200640 1 -- start start 2024-04-24T23:10:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f362a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f36240cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f362a200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36240d0070 0x7f36240709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f362a200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36240b3810 con 0x7f362415bab0 2024-04-24T23:10:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f362a200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f36240d04d0 con 0x7f36240d0070 2024-04-24T23:10:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f362a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f362415cb30 con 0x7f3624072700 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f3629800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36240d0070 0x7f36240709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f3629800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36240d0070 0x7f36240709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38156/0 (socket says 172.21.15.146:38156) 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f3629800640 1 -- 172.21.15.146:0/4081755503 learned_addr learned my addr 172.21.15.146:0/4081755503 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.767+0000 7f3623e00640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f36240cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.768+0000 7f3629800640 1 -- 172.21.15.146:0/4081755503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 msgr2=0x7f36240cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.768+0000 7f3629800640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f36240cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.768+0000 7f3629800640 1 -- 172.21.15.146:0/4081755503 >> v1:172.21.15.203:6789/0 conn(0x7f362415bab0 legacy=0x7f36240b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.768+0000 7f3629800640 1 -- 172.21.15.146:0/4081755503 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362415ce10 con 0x7f36240d0070 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.769+0000 7f3629800640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36240d0070 0x7f36240709d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f361c009e50 tx=0x7f361c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5492f7a1a769288 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.769+0000 7f3623400640 1 -- 172.21.15.146:0/4081755503 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c036070 con 0x7f36240d0070 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.769+0000 7f3623400640 1 -- 172.21.15.146:0/4081755503 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c031600 con 0x7f36240d0070 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.769+0000 7f3623400640 1 -- 172.21.15.146:0/4081755503 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c0319d0 con 0x7f36240d0070 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 -- 172.21.15.146:0/4081755503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36240d0070 msgr2=0x7f36240709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36240d0070 0x7f36240709d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f361c009e50 tx=0x7f361c02a710 comp rx=0 tx=0).stop 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 -- 172.21.15.146:0/4081755503 shutdown_connections 2024-04-24T23:10:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36240d0070 0x7f36240709d0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 --2- 172.21.15.146:0/4081755503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f36240cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 -- 172.21.15.146:0/4081755503 >> 172.21.15.146:0/4081755503 conn(0x7f362406b320 msgr2=0x7f362406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 -- 172.21.15.146:0/4081755503 shutdown_connections 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.770+0000 7f362a200640 1 -- 172.21.15.146:0/4081755503 wait complete. 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.772+0000 7f362a200640 1 Processor -- start 2024-04-24T23:10:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.772+0000 7f362a200640 1 -- start start 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f362414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36240d0070 0x7f3624156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36240b2be0 con 0x7f362415bab0 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36240b2900 con 0x7f36240d0070 2024-04-24T23:10:08.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f362a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3624070f10 con 0x7f3624072700 2024-04-24T23:10:08.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38158/0 (socket says 172.21.15.146:38158) 2024-04-24T23:10:08.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 -- 172.21.15.146:0/2997583388 learned_addr learned my addr 172.21.15.146:0/2997583388 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:08.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3623e00640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36240d0070 0x7f3624156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3628e00640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f362414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 -- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 msgr2=0x7f362414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f362414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 -- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36240d0070 msgr2=0x7f3624156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36240d0070 0x7f3624156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.773+0000 7f3629800640 1 -- 172.21.15.146:0/2997583388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36240af8a0 con 0x7f362415bab0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f3629800640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f361c034040 tx=0x7f361c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c036050 con 0x7f362415bab0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c042070 con 0x7f362415bab0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c009510 con 0x7f362415bab0 2024-04-24T23:10:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36240afb80 con 0x7f362415bab0 2024-04-24T23:10:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.774+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36240b0140 con 0x7f362415bab0 2024-04-24T23:10:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.775+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362404f500 con 0x7f362415bab0 2024-04-24T23:10:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.776+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f361c007bd0 con 0x7f362415bab0 2024-04-24T23:10:08.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.777+0000 7f3620c00640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 0x7f360406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:08.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.777+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f361c0abee0 con 0x7f362415bab0 2024-04-24T23:10:08.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.778+0000 7f3628e00640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 0x7f360406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:08.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.779+0000 7f3628e00640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 0x7f360406e340 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3618000f60 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:08.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:08.782+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f361c045360 con 0x7f362415bab0 2024-04-24T23:10:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.019+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3624068bd0 con 0x7f362415bab0 2024-04-24T23:10:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.020+0000 7f3620c00640 1 -- 172.21.15.146:0/2997583388 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f361c07a6e0 con 0x7f362415bab0 2024-04-24T23:10:09.021 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-24T23:10:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.022+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 msgr2=0x7f360406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.022+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 0x7f360406e340 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3618000f60 tx=0x7f3618009040 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.022+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 msgr2=0x7f362414c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.022+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f361c034040 tx=0x7f361c004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 shutdown_connections 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f362415bab0 0x7f362414c2b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36240d0070 0x7f3624156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f360406be80 0x7f360406e340 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 --2- 172.21.15.146:0/2997583388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3624072700 0x7f362414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 >> 172.21.15.146:0/2997583388 conn(0x7f362406b320 msgr2=0x7f36240ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 shutdown_connections 2024-04-24T23:10:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09.023+0000 7f362a200640 1 -- 172.21.15.146:0/2997583388 wait complete. 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:10:09.042 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-24T23:10:09.043 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:10:09.043 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:10:09.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.043 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:10:09.092 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42027sec preferred_lft 42027sec 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-24T23:10:09.093 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::68a7:2cff:fe15:2864/64 scope link 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether b6:8b:24:85:d0:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b48b:24ff:fe85:d0ba/64 scope link 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 4e:21:34:37:a5:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4c21:34ff:fe37:a5f6/64 scope link 2024-04-24T23:10:09.094 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:10:09.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.095 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:10:09.211 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-04-24T23:10:09.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.216 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-04-24T23:10:09.267 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-04-24T23:10:09.267 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:10:09.267 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:10:09.267 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:10:09.267 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:10:09.267 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:10:09.267 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-04-24T23:10:09.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:10:09.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:10:09.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:10:09.268 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-04-24T23:10:09.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:10:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:10:09.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.477 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:10:09.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:10:09.529 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:10:09.530 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:10:09.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-04-24T23:10:09.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:10:09.615 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:10:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:10:09.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:10:09.666 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:10:09.715 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-24T23:10:09.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:10:09.838 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:10:09.838 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:10:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-24T23:10:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-24T23:10:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-04-24T23:10:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@6a930041-393c-45a0-b3d3-8568bdacde7e.cephfs=/ 2024-04-24T23:10:09.873 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.203:3300/172.21.15.203:3301" will pass to kernel 2024-04-24T23:10:09.876 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-24T23:10:09.876 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-04-24T23:10:09.876 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-24T23:10:09.876 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-04-24T23:10:09.876 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-24T23:10:09.880 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-24T23:10:09.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:09.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:10:09.948 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-24T23:10:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:10:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:10:10.080 INFO:teuthology.orchestra.run.smithi146.stdout:client8118 2024-04-24T23:10:10.080 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:10.080 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:10.131 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-04-24T23:10:10.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.218+0000 7f3fb3f29280 1 -- start start 2024-04-24T23:10:10.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.218+0000 7f3fb3f29280 1 Processor -- start 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166060000 0x559165305080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166060800 0x559165305b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559166152000 con 0x559165299c00 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559166152180 con 0x559166060800 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559166152300 con 0x559166060000 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38170/0 (socket says 172.21.15.146:38170) 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.219+0000 7f3fb1600640 1 -- 172.21.15.146:0/3198135376 learned_addr learned my addr 172.21.15.146:0/3198135376 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb2000640 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166060000 0x559165305080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb2a00640 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166060800 0x559165305b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 -- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166060000 msgr2=0x559165305080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166060000 0x559165305080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 -- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166060800 msgr2=0x559165305b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166060800 0x559165305b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 -- 172.21.15.146:0/3198135376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591652cc780 con 0x559165299c00 2024-04-24T23:10:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb1600640 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x5591660b9560 tx=0x55916602c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1771281db264d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3faee00640 1 -- 172.21.15.146:0/3198135376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652bed00 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3faee00640 1 -- 172.21.15.146:0/3198135376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5591652c4700 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591652cc000 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5591652cd680 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3fb3f29280 4 waiting for MDS map... 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.220+0000 7f3faee00640 1 -- 172.21.15.146:0/3198135376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652be680 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.221+0000 7f3faee00640 1 -- 172.21.15.146:0/3198135376 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x559166164600 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.221+0000 7f3faee00640 1 -- 172.21.15.146:0/3198135376 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x5591652f3180 con 0x559165299c00 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.221+0000 7f3fb3f29280 4 Got MDS map 83 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.221+0000 7f3fb3f29280 10 main: main 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.221+0000 7f3fb3f29280 4 main: connecting to RADOS... 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.222+0000 7f3fb3f29280 1 Processor -- start 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.222+0000 7f3fb3f29280 1 -- start start 2024-04-24T23:10:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166161c00 0x559165305600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591661ce400 0x559165306100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559166152480 con 0x5591661ce000 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559166152600 con 0x5591661ce400 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559166152780 con 0x559166161c00 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38178/0 (socket says 172.21.15.146:38178) 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 -- 172.21.15.146:0/2016482355 learned_addr learned my addr 172.21.15.146:0/2016482355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2a00640 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166161c00 0x559165305600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb1600640 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591661ce400 0x559165306100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 -- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166161c00 msgr2=0x559165305600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166161c00 0x559165305600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 -- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591661ce400 msgr2=0x559165306100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591661ce400 0x559165306100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.223+0000 7f3fb2000640 1 -- 172.21.15.146:0/2016482355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591652cd860 con 0x5591661ce000 2024-04-24T23:10:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.224+0000 7f3fb2000640 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x5591660b8c00 tx=0x55916602c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bababbbb881eaea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.224+0000 7f3fac600640 1 -- 172.21.15.146:0/2016482355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652bed00 con 0x5591661ce000 2024-04-24T23:10:10.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.224+0000 7f3fac600640 1 -- 172.21.15.146:0/2016482355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5591652c4e00 con 0x5591661ce000 2024-04-24T23:10:10.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.224+0000 7f3fac600640 1 -- 172.21.15.146:0/2016482355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652be680 con 0x5591661ce000 2024-04-24T23:10:10.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.224+0000 7f3fb3f29280 1 -- 172.21.15.146:0/2016482355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 msgr2=0x559165304580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x5591660b8c00 tx=0x55916602c240 comp rx=0 tx=0).stop 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 -- 172.21.15.146:0/2016482355 shutdown_connections 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591661ce400 0x559165306100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591661ce000 0x559165304580 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/2016482355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166161c00 0x559165305600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 -- 172.21.15.146:0/2016482355 >> 172.21.15.146:0/2016482355 conn(0x559166060400 msgr2=0x559166015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 -- 172.21.15.146:0/2016482355 shutdown_connections 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 -- 172.21.15.146:0/2016482355 wait complete. 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.225+0000 7f3fb3f29280 1 Processor -- start 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 -- start start 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166161c00 0x559165307180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166092000 0x559165306c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 0x559165306680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559166153e00 con 0x559166092400 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559166152d80 con 0x559166161c00 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.226+0000 7f3fb3f29280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x559166152f00 con 0x559166092000 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 0x559165306680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 0x559165306680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38194/0 (socket says 172.21.15.146:38194) 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 -- 172.21.15.146:0/84103477 learned_addr learned my addr 172.21.15.146:0/84103477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb2a00640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166161c00 0x559165307180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb2000640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166092000 0x559165306c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 -- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166092000 msgr2=0x559165306c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166092000 0x559165306c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 -- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166161c00 msgr2=0x559165307180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166161c00 0x559165307180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 -- 172.21.15.146:0/84103477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591652cc3c0 con 0x559166092400 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb2a00640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166161c00 0x559165307180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb2000640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166092000 0x559165306c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.227+0000 7f3fb1600640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 0x559165306680 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x5591660b8e10 tx=0x55916602ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3faa800640 1 -- 172.21.15.146:0/84103477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652beb60 con 0x559166092400 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3faa800640 1 -- 172.21.15.146:0/84103477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5591652c4c40 con 0x559166092400 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3faa800640 1 -- 172.21.15.146:0/84103477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591652bed00 con 0x559166092400 2024-04-24T23:10:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591652cc780 con 0x559166092400 2024-04-24T23:10:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591652cc000 con 0x559166092400 2024-04-24T23:10:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.228+0000 7f3fb3f29280 4 main: resolving pool 13 2024-04-24T23:10:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.229+0000 7f3faa800640 1 -- 172.21.15.146:0/84103477 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x5591661cec00 con 0x559166092400 2024-04-24T23:10:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.230+0000 7f3faa800640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559166099000 0x559165307700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.230+0000 7f3faa800640 1 -- 172.21.15.146:0/84103477 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x559166074c00 con 0x559166092400 2024-04-24T23:10:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.230+0000 7f3fb3f29280 4 main: creating IoCtx.. 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.230+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559166092800 0x559165306100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.230+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95) -- 0x559166092c00 con 0x559166092800 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.231+0000 7f3fb2000640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559166092800 0x559165306100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.231+0000 7f3fb2a00640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559166099000 0x559165307700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.231+0000 7f3fb2000640 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559166092800 0x559165306100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb2000640 1 -- 172.21.15.146:0/84103477 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55916601a000 con 0x559166092800 2024-04-24T23:10:10.235 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 0, 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:10:10.236 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627776, 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627776 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:10.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:10.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559166092800 msgr2=0x559165306100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x559166092800 0x559165306100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559166099000 msgr2=0x559165307700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x559166099000 0x559165307700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x559165329cb0 tx=0x559165596ae0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 msgr2=0x559165306680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/84103477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559166092400 0x559165306680 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x5591660b8e10 tx=0x55916602ab40 comp rx=0 tx=0).stop 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb2000640 1 -- 172.21.15.146:0/84103477 reap_dead start 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 shutdown_connections 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 >> 172.21.15.146:0/84103477 conn(0x559166060400 msgr2=0x559166015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 shutdown_connections 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.232+0000 7f3fb3f29280 1 -- 172.21.15.146:0/84103477 wait complete. 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 msgr2=0x559165304b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x5591660b9560 tx=0x55916602c000 comp rx=0 tx=0).stop 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 shutdown_connections 2024-04-24T23:10:10.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559166060800 0x559165305b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559165299c00 0x559165304b00 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 --2- 172.21.15.146:0/3198135376 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x559166060000 0x559165305080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 >> 172.21.15.146:0/3198135376 conn(0x559165299000 msgr2=0x559166016000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 shutdown_connections 2024-04-24T23:10:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.233+0000 7f3fb3f29280 1 -- 172.21.15.146:0/3198135376 wait complete. 2024-04-24T23:10:10.241 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.110518, result: { "0": { "data": { "version": 0, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-04-24T23:10:10.241 DEBUG:teuthology.orchestra.run.smithi146:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all take_inos 1099511627876 2024-04-24T23:10:10.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.322+0000 7fe30fb5e280 1 -- start start 2024-04-24T23:10:10.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.322+0000 7fe30fb5e280 1 Processor -- start 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.322+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127b392c00 0x56127b3fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127b393800 0x56127b3feb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56127c168180 con 0x56127b393c00 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56127c168300 con 0x56127b393800 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56127c168480 con 0x56127b392c00 2024-04-24T23:10:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38216/0 (socket says 172.21.15.146:38216) 2024-04-24T23:10:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 -- 172.21.15.146:0/1176854946 learned_addr learned my addr 172.21.15.146:0/1176854946 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30dc00640 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127b392c00 0x56127b3fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30d200640 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127b393800 0x56127b3feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 -- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127b392c00 msgr2=0x56127b3fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127b392c00 0x56127b3fe580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 -- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127b393800 msgr2=0x56127b3feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127b393800 0x56127b3feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.323+0000 7fe30e600640 1 -- 172.21.15.146:0/1176854946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127b3c6780 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30e600640 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x56127c1b3200 tx=0x56127c126180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90d1fd815197708 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30aa00640 1 -- 172.21.15.146:0/1176854946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b8680 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30aa00640 1 -- 172.21.15.146:0/1176854946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56127b3be700 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30aa00640 1 -- 172.21.15.146:0/1176854946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b8b60 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127b3c74a0 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56127b3c6000 con 0x56127b393c00 2024-04-24T23:10:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30fb5e280 4 waiting for MDS map... 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.324+0000 7fe30aa00640 1 -- 172.21.15.146:0/1176854946 <== mon.0 v2:172.21.15.146:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x56127c25e600 con 0x56127b393c00 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.325+0000 7fe30aa00640 1 -- 172.21.15.146:0/1176854946 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x56127b3ed180 con 0x56127b393c00 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.325+0000 7fe30fb5e280 4 Got MDS map 83 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.325+0000 7fe30fb5e280 10 main: main 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.325+0000 7fe30fb5e280 4 main: connecting to RADOS... 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 Processor -- start 2024-04-24T23:10:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 -- start start 2024-04-24T23:10:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 0x56127b3ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261c00 0x56127b400100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56127c168600 con 0x56127c261800 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56127c168780 con 0x56127c261c00 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.326+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56127c168900 con 0x56127c261400 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38218/0 (socket says 172.21.15.146:38218) 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 -- 172.21.15.146:0/151771091 learned_addr learned my addr 172.21.15.146:0/151771091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30d200640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 0x56127b3ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30d200640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261c00 0x56127b400100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 -- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 msgr2=0x56127b3ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 0x56127b3ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 -- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261c00 msgr2=0x56127b400100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261c00 0x56127b400100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30dc00640 1 -- 172.21.15.146:0/151771091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127b3c63c0 con 0x56127c261800 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.327+0000 7fe30d200640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 0x56127b3ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30dc00640 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x56127c2ca090 tx=0x56127c27d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fc89c7eb83a097 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe308200640 1 -- 172.21.15.146:0/151771091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b8680 con 0x56127c261800 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe308200640 1 -- 172.21.15.146:0/151771091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56127b3befc0 con 0x56127c261800 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe308200640 1 -- 172.21.15.146:0/151771091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b8b60 con 0x56127c261800 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 -- 172.21.15.146:0/151771091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 msgr2=0x56127b3ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x56127c2ca090 tx=0x56127c27d800 comp rx=0 tx=0).stop 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 -- 172.21.15.146:0/151771091 shutdown_connections 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261c00 0x56127b400100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b3ffb80 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/151771091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261400 0x56127b3ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.328+0000 7fe30fb5e280 1 -- 172.21.15.146:0/151771091 >> 172.21.15.146:0/151771091 conn(0x56127c261000 msgr2=0x56127c111000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.329+0000 7fe30fb5e280 1 -- 172.21.15.146:0/151771091 shutdown_connections 2024-04-24T23:10:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.329+0000 7fe30fb5e280 1 -- 172.21.15.146:0/151771091 wait complete. 2024-04-24T23:10:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.329+0000 7fe30fb5e280 1 Processor -- start 2024-04-24T23:10:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.329+0000 7fe30fb5e280 1 -- start start 2024-04-24T23:10:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261400 0x56127b401180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b400c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261c00 0x56127b400680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56127c168900 con 0x56127c261800 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56127c168a80 con 0x56127c261400 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30fb5e280 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x56127c168780 con 0x56127c261c00 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b400c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b400c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38226/0 (socket says 172.21.15.146:38226) 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.330+0000 7fe30dc00640 1 -- 172.21.15.146:0/723530399 learned_addr learned my addr 172.21.15.146:0/723530399 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 -- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261c00 msgr2=0x56127b400680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30d200640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261400 0x56127b401180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127c261c00 0x56127b400680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 -- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261400 msgr2=0x56127b401180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127c261400 0x56127b401180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 -- 172.21.15.146:0/723530399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127b3c6780 con 0x56127c261800 2024-04-24T23:10:10.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30dc00640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b400c00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x56127c2cb350 tx=0x56127c124720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe306400640 1 -- 172.21.15.146:0/723530399 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b84e0 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe306400640 1 -- 172.21.15.146:0/723530399 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56127b3bee00 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe306400640 1 -- 172.21.15.146:0/723530399 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56127b3b8680 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.331+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56127b3c74a0 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.332+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127b3c6960 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.332+0000 7fe30fb5e280 4 main: resolving pool 13 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.333+0000 7fe306400640 1 -- 172.21.15.146:0/723530399 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x56127c2d8c00 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe306400640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56127c2d0c00 0x56127b401700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe306400640 1 -- 172.21.15.146:0/723530399 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x56127c2d2a00 con 0x56127c261800 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30fb5e280 4 main: creating IoCtx.. 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30fb5e280 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30fb5e280 10 mds.0.inotable: skip_inos now [0x10000000065~0xffffffff9b] 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56127c2d1000 0x56127b400100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- osd_op(unknown.0.0:1 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x56127c2d1400 con 0x56127c2d1000 2024-04-24T23:10:10.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.334+0000 7fe30d200640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56127c2d1000 0x56127b400100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.335+0000 7fe30d200640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56127c2d0c00 0x56127b401700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.335+0000 7fe30d200640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56127c2d1000 0x56127b400100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.336+0000 7fe30d200640 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56127c2d0c00 0x56127b401700 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x56127c1b2a20 tx=0x56127c125f80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30d200640 1 -- 172.21.15.146:0/723530399 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v95'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x56127c114000 con 0x56127c2d1000 2024-04-24T23:10:10.339 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:10.339 INFO:teuthology.orchestra.run.smithi146.stdout: "0": { 2024-04-24T23:10:10.339 INFO:teuthology.orchestra.run.smithi146.stdout: "data": { 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 1, 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "inotable": { 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "projected_free": [ 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627877, 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627675 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: "free": [ 2024-04-24T23:10:10.340 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: "start": 1099511627877, 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: "len": 1099511627675 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-24T23:10:10.342 INFO:teuthology.orchestra.run.smithi146.stdout: "result": 0 2024-04-24T23:10:10.342 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-24T23:10:10.342 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:10.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:10.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56127c2d1000 msgr2=0x56127b400100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x56127c2d1000 0x56127b400100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56127c2d0c00 msgr2=0x56127b401700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x56127c2d0c00 0x56127b401700 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x56127c1b2a20 tx=0x56127c125f80 comp rx=0 tx=0).stop 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 msgr2=0x56127b400c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/723530399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127c261800 0x56127b400c00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x56127c2cb350 tx=0x56127c124720 comp rx=0 tx=0).stop 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30dc00640 1 -- 172.21.15.146:0/723530399 reap_dead start 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 shutdown_connections 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.338+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 >> 172.21.15.146:0/723530399 conn(0x56127c261000 msgr2=0x56127c111000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 shutdown_connections 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/723530399 wait complete. 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 msgr2=0x56127b3ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x56127c1b3200 tx=0x56127c126180 comp rx=0 tx=0).stop 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 shutdown_connections 2024-04-24T23:10:10.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56127b393c00 0x56127b3ff080 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56127b393800 0x56127b3feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 --2- 172.21.15.146:0/1176854946 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x56127b392c00 0x56127b3fe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 >> 172.21.15.146:0/1176854946 conn(0x56127b393000 msgr2=0x56127c110800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 shutdown_connections 2024-04-24T23:10:10.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.339+0000 7fe30fb5e280 1 -- 172.21.15.146:0/1176854946 wait complete. 2024-04-24T23:10:10.346 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'take_inos', '1099511627876'] in time 0:00:00.104924, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627877, "len": 1099511627675 } ], "free": [ { "start": 1099511627877, "len": 1099511627675 } ] } }, "result": 0 } } 2024-04-24T23:10:10.346 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-24T23:10:10.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:10:10.440 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-24T23:10:10.543 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-24T23:10:10.543 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:10:10.543 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:10.543 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:10.591 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:10.592 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:10.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:10.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.899+0000 7f4d38c00640 1 Processor -- start 2024-04-24T23:10:10.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.900+0000 7f4d38c00640 1 -- start start 2024-04-24T23:10:10.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.901+0000 7f4d38c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4d34145640 0x7f4d3415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.901+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340d03a0 0x7f4d340ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.901+0000 7f4d38c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d340cdf70 con 0x7f4d340b2a20 2024-04-24T23:10:10.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.901+0000 7f4d38c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4d3415d360 con 0x7f4d34145640 2024-04-24T23:10:10.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.901+0000 7f4d38c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4d34145a20 con 0x7f4d340d03a0 2024-04-24T23:10:10.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d32800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340d03a0 0x7f4d340ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4d34145640 0x7f4d3415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4d34145640 0x7f4d3415ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:57966/0 (socket says 172.21.15.146:57966) 2024-04-24T23:10:10.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 -- 172.21.15.146:0/3627853021 learned_addr learned my addr 172.21.15.146:0/3627853021 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 -- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340d03a0 msgr2=0x7f4d340ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:10.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 --2- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340d03a0 0x7f4d340ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.902+0000 7f4d31e00640 1 -- 172.21.15.146:0/3627853021 >> v1:172.21.15.203:6789/0 conn(0x7f4d340b2a20 legacy=0x7f4d340cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.903+0000 7f4d31e00640 1 -- 172.21.15.146:0/3627853021 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3406d140 con 0x7f4d34145640 2024-04-24T23:10:10.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.904+0000 7f4d31e00640 1 --2- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d3415ce20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009870 tx=0x7f4d2402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ec5095498bc4752 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.904+0000 7f4d31400640 1 -- 172.21.15.146:0/3627853021 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24037070 con 0x7f4d34145640 2024-04-24T23:10:10.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.904+0000 7f4d31400640 1 -- 172.21.15.146:0/3627853021 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d24032440 con 0x7f4d34145640 2024-04-24T23:10:10.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.904+0000 7f4d31400640 1 -- 172.21.15.146:0/3627853021 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24032810 con 0x7f4d34145640 2024-04-24T23:10:10.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 -- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 msgr2=0x7f4d3415ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 --2- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d3415ce20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009870 tx=0x7f4d2402a270 comp rx=0 tx=0).stop 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 -- 172.21.15.146:0/3627853021 shutdown_connections 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 --2- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340d03a0 0x7f4d340ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 --2- 172.21.15.146:0/3627853021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d3415ce20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 -- 172.21.15.146:0/3627853021 >> 172.21.15.146:0/3627853021 conn(0x7f4d3406b320 msgr2=0x7f4d3406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 -- 172.21.15.146:0/3627853021 shutdown_connections 2024-04-24T23:10:10.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.905+0000 7f4d38c00640 1 -- 172.21.15.146:0/3627853021 wait complete. 2024-04-24T23:10:10.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.907+0000 7f4d38c00640 1 Processor -- start 2024-04-24T23:10:10.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.907+0000 7f4d38c00640 1 -- start start 2024-04-24T23:10:10.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 0x7f4d3415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d340724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3406d9e0 con 0x7f4d340d03a0 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3406d700 con 0x7f4d34145640 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d38c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3406cbc0 con 0x7f4d340b2a20 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38232/0 (socket says 172.21.15.146:38232) 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d2be00640 1 -- 172.21.15.146:0/875937014 learned_addr learned my addr 172.21.15.146:0/875937014 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.908+0000 7f4d31e00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 0x7f4d3415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d32800640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d340724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 -- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 msgr2=0x7f4d3415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 0x7f4d3415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 -- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 msgr2=0x7f4d340724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d340724f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 -- 172.21.15.146:0/875937014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341f41b0 con 0x7f4d340d03a0 2024-04-24T23:10:10.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d31e00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 0x7f4d3415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d32800640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d340724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2be00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c460 tx=0x7f4d1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.909+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c017070 con 0x7f4d340d03a0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.910+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c005310 con 0x7f4d340d03a0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.910+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341f4490 con 0x7f4d340d03a0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.910+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c003850 con 0x7f4d340d03a0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.910+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341f4a50 con 0x7f4d340d03a0 2024-04-24T23:10:10.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.911+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d341f4d80 con 0x7f4d340d03a0 2024-04-24T23:10:10.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.913+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d1c01a070 con 0x7f4d340d03a0 2024-04-24T23:10:10.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.914+0000 7f4d2a000640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 0x7f4d1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:10.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.914+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f4d1c08a1e0 con 0x7f4d340d03a0 2024-04-24T23:10:10.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.914+0000 7f4d31e00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 0x7f4d1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:10.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.916+0000 7f4d31e00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 0x7f4d1006e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4d24034000 tx=0x7f4d2402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:10.923+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d1c0583b0 con 0x7f4d340d03a0 2024-04-24T23:10:11.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.122+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d34068190 con 0x7f4d340d03a0 2024-04-24T23:10:11.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.124+0000 7f4d2a000640 1 -- 172.21.15.146:0/875937014 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16957 (secure 0 0 0) 0x7f4d1c05c6b0 con 0x7f4d340d03a0 2024-04-24T23:10:11.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:11.125 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:57.917411+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 msgr2=0x7f4d1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 0x7f4d1006e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4d24034000 tx=0x7f4d2402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 msgr2=0x7f4d34158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c460 tx=0x7f4d1c00c920 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 shutdown_connections 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d34145640 0x7f4d340724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d340d03a0 0x7f4d34158770 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f4d1006be30 0x7f4d1006e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 --2- 172.21.15.146:0/875937014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4d340b2a20 0x7f4d3415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.126+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 >> 172.21.15.146:0/875937014 conn(0x7f4d3406b320 msgr2=0x7f4d340cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.127+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 shutdown_connections 2024-04-24T23:10:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.127+0000 7f4d38c00640 1 -- 172.21.15.146:0/875937014 wait complete. 2024-04-24T23:10:11.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:09:54.095904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:09:55.340076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:10:11.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:10:11.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.330+0000 7f9a22200640 1 Processor -- start 2024-04-24T23:10:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.330+0000 7f9a22200640 1 -- start start 2024-04-24T23:10:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a22200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 0x7f9a1c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a22200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9a1c141ab0 0x7f9a1c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a22200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c0ced40 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a22200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c1423d0 con 0x7f9a1c141ab0 2024-04-24T23:10:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a22200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c070f80 con 0x7f9a1c13ef30 2024-04-24T23:10:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a1be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a1c0ce5a0 0x7f9a1c15fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49808/0 (socket says 172.21.15.146:49808) 2024-04-24T23:10:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.332+0000 7f9a1be00640 1 -- 172.21.15.146:0/445047187 learned_addr learned my addr 172.21.15.146:0/445047187 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:11.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1b400640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 0x7f9a1c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1aa00640 1 --2- 172.21.15.146:0/445047187 >> v2:172.21.15.203:3300/0 conn(0x7f9a1c141ab0 0x7f9a1c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131779331 0 0) 0x7f9a1c0ced40 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a00003520 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 603284880 0 0) 0x7f9a00003520 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 msgr2=0x7f9a1c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 0x7f9a1c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 >> v2:172.21.15.203:3300/0 conn(0x7f9a1c141ab0 msgr2=0x7f9a1c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 --2- 172.21.15.146:0/445047187 >> v2:172.21.15.203:3300/0 conn(0x7f9a1c141ab0 0x7f9a1c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c0cf020 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9a140019f0 con 0x7f9a1c0ce5a0 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 >> v1:172.21.15.146:6789/0 conn(0x7f9a1c0ce5a0 legacy=0x7f9a1c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.333+0000 7f9a1a000640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a000039b0 0x7f9a00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1a000640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 0x7f9a00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1a000640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a00004d40 0x7f9a000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c070f80 con 0x7f9a000039b0 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0000b9c0 con 0x7f9a00004d40 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0000bb40 con 0x7f9a1c13ef30 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a000039b0 0x7f9a00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 -- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 msgr2=0x7f9a00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c13ef30 0x7f9a00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 -- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a00004d40 msgr2=0x7f9a000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a00004d40 0x7f9a000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.334+0000 7f9a1b400640 1 -- 172.21.15.146:0/445047187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a00003520 con 0x7f9a000039b0 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.335+0000 7f9a1b400640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a000039b0 0x7f9a00003dd0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009ac0 tx=0x7f9a00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a83968a2047e61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.335+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c036070 con 0x7f9a000039b0 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.335+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c031400 con 0x7f9a000039b0 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a1a000640 1 -- 172.21.15.146:0/445047187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c009690 con 0x7f9a000039b0 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 -- 172.21.15.146:0/445047187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a000039b0 msgr2=0x7f9a00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 --2- 172.21.15.146:0/445047187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a000039b0 0x7f9a00003dd0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009ac0 tx=0x7f9a00005830 comp rx=0 tx=0).stop 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a1be00640 1 -- 172.21.15.146:0/445047187 reap_dead start 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 -- 172.21.15.146:0/445047187 shutdown_connections 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 -- 172.21.15.146:0/445047187 >> 172.21.15.146:0/445047187 conn(0x7f9a1c0b17b0 msgr2=0x7f9a1c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 -- 172.21.15.146:0/445047187 shutdown_connections 2024-04-24T23:10:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.336+0000 7f9a22200640 1 -- 172.21.15.146:0/445047187 wait complete. 2024-04-24T23:10:11.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.338+0000 7f9a22200640 1 Processor -- start 2024-04-24T23:10:11.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.338+0000 7f9a22200640 1 -- start start 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a000039b0 0x7f9a1c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c15b890 0x7f9a1c13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0cea30 con 0x7f9a1c15e000 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c070c10 con 0x7f9a000039b0 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a22200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c072420 con 0x7f9a1c15b890 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a1aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a1aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38252/0 (socket says 172.21.15.146:38252) 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.339+0000 7f9a1aa00640 1 -- 172.21.15.146:0/1725030312 learned_addr learned my addr 172.21.15.146:0/1725030312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 -- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c15b890 msgr2=0x7f9a1c13da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1be00640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c15b890 0x7f9a1c13da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1b400640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a000039b0 0x7f9a1c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c15b890 0x7f9a1c13da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 -- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a000039b0 msgr2=0x7f9a1c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a000039b0 0x7f9a1c15d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 -- 172.21.15.146:0/1725030312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c1f50d0 con 0x7f9a1c15e000 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a1aa00640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800e860 tx=0x7f9a0800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08017070 con 0x7f9a1c15e000 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.340+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0800c940 con 0x7f9a1c15e000 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.341+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c15af20 con 0x7f9a1c15e000 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.341+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800cd10 con 0x7f9a1c15e000 2024-04-24T23:10:11.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.341+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c15b4e0 con 0x7f9a1c15e000 2024-04-24T23:10:11.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.342+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c04f5a0 con 0x7f9a1c15e000 2024-04-24T23:10:11.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.343+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a0801a070 con 0x7f9a1c15e000 2024-04-24T23:10:11.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.344+0000 7f9a13400640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.344+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f9a0808b360 con 0x7f9a1c15e000 2024-04-24T23:10:11.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.345+0000 7f9a1b400640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.346+0000 7f9a1b400640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 0x7f99fc06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c033000 tx=0x7f9a0c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.349+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a08059ae0 con 0x7f9a1c15e000 2024-04-24T23:10:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.540+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a1c06ec70 con 0x7f9a1c15e000 2024-04-24T23:10:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.541+0000 7f9a13400640 1 -- 172.21.15.146:0/1725030312 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f9a080593e0 con 0x7f9a1c15e000 2024-04-24T23:10:11.542 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:10:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 msgr2=0x7f99fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 0x7f99fc06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c033000 tx=0x7f9a0c008030 comp rx=0 tx=0).stop 2024-04-24T23:10:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 msgr2=0x7f9a1c13d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800e860 tx=0x7f9a0800ed20 comp rx=0 tx=0).stop 2024-04-24T23:10:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 shutdown_connections 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f99fc06be30 0x7f99fc06e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a1c15b890 0x7f9a1c13da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a1c15e000 0x7f9a1c13d4c0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 --2- 172.21.15.146:0/1725030312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a000039b0 0x7f9a1c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 >> 172.21.15.146:0/1725030312 conn(0x7f9a1c0b17b0 msgr2=0x7f9a1c15ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 shutdown_connections 2024-04-24T23:10:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.544+0000 7f9a22200640 1 -- 172.21.15.146:0/1725030312 wait complete. 2024-04-24T23:10:11.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:10:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.748+0000 7f1971000640 1 Processor -- start 2024-04-24T23:10:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.748+0000 7f1971000640 1 -- start start 2024-04-24T23:10:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f1971000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f196c155120 0x7f196c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f1971000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c0d0120 0x7f196c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f1971000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f196c071ab0 con 0x7f196c0cfcc0 2024-04-24T23:10:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f1971000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f196c155500 con 0x7f196c155120 2024-04-24T23:10:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f1971000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f196c15d1b0 con 0x7f196c0d0120 2024-04-24T23:10:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.750+0000 7f196b400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f196c155120 0x7f196c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c0d0120 0x7f196c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f196c155120 0x7f196c0b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:58016/0 (socket says 172.21.15.146:58016) 2024-04-24T23:10:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 -- 172.21.15.146:0/1084714380 learned_addr learned my addr 172.21.15.146:0/1084714380 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 -- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c0d0120 msgr2=0x7f196c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 --2- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c0d0120 0x7f196c06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 -- 172.21.15.146:0/1084714380 >> v1:172.21.15.203:6789/0 conn(0x7f196c0cfcc0 legacy=0x7f196c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.751+0000 7f196b400640 1 -- 172.21.15.146:0/1084714380 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c071d90 con 0x7f196c155120 2024-04-24T23:10:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.753+0000 7f196b400640 1 --2- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c155120 0x7f196c0b3d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f195c009870 tx=0x7f195c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be86ca3c0c81428 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.753+0000 7f196a000640 1 -- 172.21.15.146:0/1084714380 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c037070 con 0x7f196c155120 2024-04-24T23:10:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.753+0000 7f196a000640 1 -- 172.21.15.146:0/1084714380 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c032440 con 0x7f196c155120 2024-04-24T23:10:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.753+0000 7f196a000640 1 -- 172.21.15.146:0/1084714380 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c032810 con 0x7f196c155120 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 -- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c155120 msgr2=0x7f196c0b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 --2- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c155120 0x7f196c0b3d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f195c009870 tx=0x7f195c02a250 comp rx=0 tx=0).stop 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 -- 172.21.15.146:0/1084714380 shutdown_connections 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 --2- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c0d0120 0x7f196c06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 --2- 172.21.15.146:0/1084714380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c155120 0x7f196c0b3d40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 -- 172.21.15.146:0/1084714380 >> 172.21.15.146:0/1084714380 conn(0x7f196c06b560 msgr2=0x7f196c06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 -- 172.21.15.146:0/1084714380 shutdown_connections 2024-04-24T23:10:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.754+0000 7f1971000640 1 -- 172.21.15.146:0/1084714380 wait complete. 2024-04-24T23:10:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.756+0000 7f1971000640 1 Processor -- start 2024-04-24T23:10:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.756+0000 7f1971000640 1 -- start start 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.757+0000 7f1971000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.757+0000 7f1971000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c0d0120 0x7f196c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f1971000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c155120 0x7f196c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f1971000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f196c072630 con 0x7f196c0cfcc0 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f1971000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f196c072350 con 0x7f196c0d0120 2024-04-24T23:10:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f1971000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f196c0d05b0 con 0x7f196c155120 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38260/0 (socket says 172.21.15.146:38260) 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 -- 172.21.15.146:0/2695963593 learned_addr learned my addr 172.21.15.146:0/2695963593 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196aa00640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c0d0120 0x7f196c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196be00640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c155120 0x7f196c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 -- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c155120 msgr2=0x7f196c143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c155120 0x7f196c143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 -- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c0d0120 msgr2=0x7f196c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c0d0120 0x7f196c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.758+0000 7f196b400640 1 -- 172.21.15.146:0/2695963593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c0ccd80 con 0x7f196c0cfcc0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f196b400640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c037040 con 0x7f196c0cfcc0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c042070 con 0x7f196c0cfcc0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c030880 con 0x7f196c0cfcc0 2024-04-24T23:10:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196c0cd060 con 0x7f196c0cfcc0 2024-04-24T23:10:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.759+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f196c0cd620 con 0x7f196c0cfcc0 2024-04-24T23:10:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.760+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f196c04f500 con 0x7f196c0cfcc0 2024-04-24T23:10:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.761+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f195c030a20 con 0x7f196c0cfcc0 2024-04-24T23:10:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.762+0000 7f1963400640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 0x7f194c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.762+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f195c0ab8d0 con 0x7f196c0cfcc0 2024-04-24T23:10:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.763+0000 7f196aa00640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 0x7f194c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.764+0000 7f196aa00640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 0x7f194c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1958007fd0 tx=0x7f1958009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:11.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.768+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f195c07a050 con 0x7f196c0cfcc0 2024-04-24T23:10:11.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.968+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f196c06bd90 con 0x7f196c0cfcc0 2024-04-24T23:10:11.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.969+0000 7f1963400640 1 -- 172.21.15.146:0/2695963593 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f195c079950 con 0x7f196c0cfcc0 2024-04-24T23:10:11.970 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.971+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 msgr2=0x7f194c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.971+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 0x7f194c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1958007fd0 tx=0x7f1958009040 comp rx=0 tx=0).stop 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.971+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 msgr2=0x7f196c0ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.971+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f195c000c00 tx=0x7f195c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 shutdown_connections 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f194c06be30 0x7f194c06e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f196c155120 0x7f196c143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f196c0d0120 0x7f196c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 --2- 172.21.15.146:0/2695963593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f196c0cfcc0 0x7f196c0ce890 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 >> 172.21.15.146:0/2695963593 conn(0x7f196c06b560 msgr2=0x7f196c14a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 shutdown_connections 2024-04-24T23:10:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:11.972+0000 7f1971000640 1 -- 172.21.15.146:0/2695963593 wait complete. 2024-04-24T23:10:11.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:10:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.188+0000 7ff71a600640 1 Processor -- start 2024-04-24T23:10:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.188+0000 7ff71a600640 1 -- start start 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.189+0000 7ff71a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff71406ec10 0x7ff7140cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff71a600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71415b530 con 0x7ff714071b30 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff71a600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71415b810 con 0x7ff71415ed20 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff71a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140cf8d0 con 0x7ff71406ec10 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff713e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff714071b30 0x7ff714150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49822/0 (socket says 172.21.15.146:49822) 2024-04-24T23:10:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff713e00640 1 -- 172.21.15.146:0/3424166066 learned_addr learned my addr 172.21.15.146:0/3424166066 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff713400640 1 --2- 172.21.15.146:0/3424166066 >> v2:172.21.15.203:3300/0 conn(0x7ff71406ec10 0x7ff7140cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376657542 0 0) 0x7ff71415b530 con 0x7ff714071b30 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.190+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f8003520 con 0x7ff714071b30 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3228163762 0 0) 0x7ff6f8003520 con 0x7ff714071b30 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 >> v2:172.21.15.203:3300/0 conn(0x7ff71406ec10 msgr2=0x7ff7140cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 --2- 172.21.15.146:0/3424166066 >> v2:172.21.15.203:3300/0 conn(0x7ff71406ec10 0x7ff7140cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 >> v1:172.21.15.203:6789/0 conn(0x7ff71415ed20 legacy=0x7ff714071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71415e240 con 0x7ff714071b30 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7ff70c001670 con 0x7ff714071b30 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 >> v1:172.21.15.146:6789/0 conn(0x7ff714071b30 legacy=0x7ff714150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f80039b0 0x7ff6f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff6f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f80051c0 0x7ff6f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140cf8d0 con 0x7ff6f8004800 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f800c160 con 0x7ff6f80039b0 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f800c360 con 0x7ff6f80051c0 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff70aa00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff6f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.191+0000 7ff713400640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f80039b0 0x7ff6f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff713e00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f80051c0 0x7ff6f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff70aa00640 1 -- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f80051c0 msgr2=0x7ff6f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff70aa00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6f80051c0 0x7ff6f800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff70aa00640 1 -- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f80039b0 msgr2=0x7ff6f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff70aa00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f80039b0 0x7ff6f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff70aa00640 1 -- 172.21.15.146:0/3424166066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f8003520 con 0x7ff6f8004800 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff713400640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f80039b0 0x7ff6f8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.192+0000 7ff713e00640 1 -- 172.21.15.146:0/3424166066 reap_dead start 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff70aa00640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff6f8004c80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001750 tx=0x7ff6f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2153e5f9915204 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc001370 con 0x7ff6f8004800 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0052d0 con 0x7ff6f8004800 2024-04-24T23:10:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff712a00640 1 -- 172.21.15.146:0/3424166066 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc02abe0 con 0x7ff6f8004800 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff71a600640 1 -- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 msgr2=0x7ff6f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.193+0000 7ff71a600640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff6f8004c80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc001750 tx=0x7ff6f8005830 comp rx=0 tx=0).stop 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.194+0000 7ff71a600640 1 -- 172.21.15.146:0/3424166066 shutdown_connections 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.194+0000 7ff71a600640 1 --2- 172.21.15.146:0/3424166066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff6f8004c80 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.194+0000 7ff71a600640 1 -- 172.21.15.146:0/3424166066 >> 172.21.15.146:0/3424166066 conn(0x7ff7140b17b0 msgr2=0x7ff7140b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.194+0000 7ff71a600640 1 -- 172.21.15.146:0/3424166066 shutdown_connections 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.194+0000 7ff71a600640 1 -- 172.21.15.146:0/3424166066 wait complete. 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.195+0000 7ff71a600640 1 Processor -- start 2024-04-24T23:10:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.196+0000 7ff71a600640 1 -- start start 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff714143010 0x7ff7141f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7140adca0 0x7ff7141e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140b4b00 con 0x7ff6f8004800 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff71415e800 con 0x7ff714143010 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff71a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140b4c80 con 0x7ff7140adca0 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38284/0 (socket says 172.21.15.146:38284) 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 -- 172.21.15.146:0/627594691 learned_addr learned my addr 172.21.15.146:0/627594691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 -- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7140adca0 msgr2=0x7ff7141e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7140adca0 0x7ff7141e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff70aa00640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff714143010 0x7ff7141f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 -- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff714143010 msgr2=0x7ff7141f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff714143010 0x7ff7141f8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.197+0000 7ff713400640 1 -- 172.21.15.146:0/627594691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff714144010 con 0x7ff6f8004800 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff713400640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff70400f3b0 tx=0x7ff70400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704003990 con 0x7ff6f8004800 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704003b30 con 0x7ff6f8004800 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7141f8670 con 0x7ff6f8004800 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704004020 con 0x7ff6f8004800 2024-04-24T23:10:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.198+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff714143770 con 0x7ff6f8004800 2024-04-24T23:10:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.199+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71404f5a0 con 0x7ff6f8004800 2024-04-24T23:10:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.200+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff704005d10 con 0x7ff6f8004800 2024-04-24T23:10:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.201+0000 7ff70be00640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.201+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7ff70408bac0 con 0x7ff6f8004800 2024-04-24T23:10:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.201+0000 7ff70aa00640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.203+0000 7ff70aa00640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 0x7ff6f006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc032000 tx=0x7ff6fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.205+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff704024020 con 0x7ff6f8004800 2024-04-24T23:10:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.384+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7140b2fc0 con 0x7ff6f8004800 2024-04-24T23:10:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.386+0000 7ff70be00640 1 -- 172.21.15.146:0/627594691 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7ff70405a240 con 0x7ff6f8004800 2024-04-24T23:10:12.387 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:10:12.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 msgr2=0x7ff6f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 0x7ff6f006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc032000 tx=0x7ff6fc02e000 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 msgr2=0x7ff714141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff70400f3b0 tx=0x7ff70400f870 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 shutdown_connections 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff6f006be30 0x7ff6f006e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7140adca0 0x7ff7141e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff714143010 0x7ff7141f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 --2- 172.21.15.146:0/627594691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f8004800 0x7ff714141020 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 >> 172.21.15.146:0/627594691 conn(0x7ff7140b17b0 msgr2=0x7ff71406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.388+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 shutdown_connections 2024-04-24T23:10:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.389+0000 7ff71a600640 1 -- 172.21.15.146:0/627594691 wait complete. 2024-04-24T23:10:12.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:10:12.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.588+0000 7f6a30800640 1 Processor -- start 2024-04-24T23:10:12.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.588+0000 7f6a30800640 1 -- start start 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a30800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a2815abb0 0x7f6a2806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a30800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a2815f3f0 0x7f6a2815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a30800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a28071960 con 0x7f6a2815e8b0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a30800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6a28071c40 con 0x7f6a2815f3f0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a30800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a28071f20 con 0x7f6a2815abb0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a2d400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a2815e8b0 0x7f6a2815ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49836/0 (socket says 172.21.15.146:49836) 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a2d400640 1 -- 172.21.15.146:0/3433108983 learned_addr learned my addr 172.21.15.146:0/3433108983 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.590+0000 7f6a2e800640 1 --2- 172.21.15.146:0/3433108983 >> v2:172.21.15.146:3300/0 conn(0x7f6a2815f3f0 0x7f6a2815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2ca00640 1 -- 172.21.15.146:0/3433108983 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334149980 0 0) 0x7f6a28071960 con 0x7f6a2815e8b0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2ca00640 1 -- 172.21.15.146:0/3433108983 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a10003520 con 0x7f6a2815e8b0 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2e800640 1 -- 172.21.15.146:0/3433108983 >> v2:172.21.15.203:3300/0 conn(0x7f6a2815abb0 msgr2=0x7f6a2806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2e800640 1 --2- 172.21.15.146:0/3433108983 >> v2:172.21.15.203:3300/0 conn(0x7f6a2815abb0 0x7f6a2806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2e800640 1 -- 172.21.15.146:0/3433108983 >> v1:172.21.15.146:6789/0 conn(0x7f6a2815e8b0 legacy=0x7f6a2815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.591+0000 7f6a2e800640 1 -- 172.21.15.146:0/3433108983 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a28072200 con 0x7f6a2815f3f0 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.592+0000 7f6a2e800640 1 --2- 172.21.15.146:0/3433108983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a2815c7b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6a280d0b20 tx=0x7f6a2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15d575f08b3a195 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.592+0000 7f6a2ca00640 1 -- 172.21.15.146:0/3433108983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007740 con 0x7f6a2815f3f0 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.592+0000 7f6a2ca00640 1 -- 172.21.15.146:0/3433108983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a240078e0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.592+0000 7f6a2ca00640 1 -- 172.21.15.146:0/3433108983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007cb0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 -- 172.21.15.146:0/3433108983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 msgr2=0x7f6a2815c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 --2- 172.21.15.146:0/3433108983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a2815c7b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6a280d0b20 tx=0x7f6a2402a680 comp rx=0 tx=0).stop 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 -- 172.21.15.146:0/3433108983 shutdown_connections 2024-04-24T23:10:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 --2- 172.21.15.146:0/3433108983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a2815c7b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 --2- 172.21.15.146:0/3433108983 >> v2:172.21.15.203:3300/0 conn(0x7f6a2815abb0 0x7f6a2806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 -- 172.21.15.146:0/3433108983 >> 172.21.15.146:0/3433108983 conn(0x7f6a2806b140 msgr2=0x7f6a2806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 -- 172.21.15.146:0/3433108983 shutdown_connections 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.593+0000 7f6a30800640 1 -- 172.21.15.146:0/3433108983 wait complete. 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.594+0000 7f6a30800640 1 Processor -- start 2024-04-24T23:10:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 -- start start 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 0x7f6a2813c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2815e8b0 0x7f6a28158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2815c120 con 0x7f6a2815f3f0 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2815bfa0 con 0x7f6a2815abb0 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.595+0000 7f6a30800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2815ccf0 con 0x7f6a2815e8b0 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38296/0 (socket says 172.21.15.146:38296) 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 -- 172.21.15.146:0/4168567687 learned_addr learned my addr 172.21.15.146:0/4168567687 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2de00640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 0x7f6a2813c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 -- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2815e8b0 msgr2=0x7f6a28158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2815e8b0 0x7f6a28158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 -- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 msgr2=0x7f6a2813c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 0x7f6a2813c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 -- 172.21.15.146:0/4168567687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2814e470 con 0x7f6a2815f3f0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2de00640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 0x7f6a2813c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.596+0000 7f6a2e800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6a2402ac70 tx=0x7f6a24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.597+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2403f070 con 0x7f6a2815f3f0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.597+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24031bc0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.597+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24009450 con 0x7f6a2815f3f0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.597+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2814e750 con 0x7f6a2815f3f0 2024-04-24T23:10:12.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.597+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2814ed10 con 0x7f6a2815f3f0 2024-04-24T23:10:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.598+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2815d940 con 0x7f6a2815f3f0 2024-04-24T23:10:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.599+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a2403b410 con 0x7f6a2815f3f0 2024-04-24T23:10:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.600+0000 7f6a22000640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 0x7f6a0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.600+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f6a240ac8f0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.600+0000 7f6a2de00640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 0x7f6a0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:12.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.601+0000 7f6a2de00640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 0x7f6a0c06e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:12.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.604+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a2815d940 con 0x7f6a2815f3f0 2024-04-24T23:10:12.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.815+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6a2804f5a0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.815+0000 7f6a22000640 1 -- 172.21.15.146:0/4168567687 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) ==== 80+0+0 (secure 0 0 0) 0x7f6a2407afe0 con 0x7f6a2815f3f0 2024-04-24T23:10:12.819 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 msgr2=0x7f6a0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 0x7f6a0c06e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 msgr2=0x7f6a280ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6a2402ac70 tx=0x7f6a24004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 shutdown_connections 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2815f3f0 0x7f6a280ccee0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f6a0c06be60 0x7f6a0c06e320 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2815e8b0 0x7f6a28158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 --2- 172.21.15.146:0/4168567687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a2815abb0 0x7f6a2813c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.818+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 >> 172.21.15.146:0/4168567687 conn(0x7f6a2806b140 msgr2=0x7f6a2806d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.819+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 shutdown_connections 2024-04-24T23:10:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:12.819+0000 7f6a30800640 1 -- 172.21.15.146:0/4168567687 wait complete. 2024-04-24T23:10:12.839 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-24T23:10:12.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:12.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-24T23:10:12.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:10:12.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:12.928 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:10:12.977 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:10:12.977 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:10:12.977 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:13.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:10:13.030 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:10:13.030 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:13.030 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:13.082 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:10:13.083 INFO:tasks.cephfs.mount:Terminating background process 2024-04-24T23:10:13.083 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:10:13.083 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:13.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:10:13.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.349+0000 7f7987e00640 1 Processor -- start 2024-04-24T23:10:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.349+0000 7f7987e00640 1 -- start start 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7987e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f79881561c0 0x7f79880cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7987e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79880709d0 0x7f798815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7987e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7988070f90 con 0x7f79880cfb30 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7987e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f79880b4310 con 0x7f79880709d0 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7987e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f79881565a0 con 0x7f79881561c0 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7986000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79880709d0 0x7f798815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7986000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79880709d0 0x7f798815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38312/0 (socket says 172.21.15.146:38312) 2024-04-24T23:10:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7986000640 1 -- 172.21.15.146:0/3360955429 learned_addr learned my addr 172.21.15.146:0/3360955429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7986000640 1 -- 172.21.15.146:0/3360955429 >> v2:172.21.15.203:3300/0 conn(0x7f79881561c0 msgr2=0x7f79880cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.351+0000 7f7986a00640 1 --2- 172.21.15.146:0/3360955429 >> v2:172.21.15.203:3300/0 conn(0x7f79881561c0 0x7f79880cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.352+0000 7f7986000640 1 --2- 172.21.15.146:0/3360955429 >> v2:172.21.15.203:3300/0 conn(0x7f79881561c0 0x7f79880cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.352+0000 7f7986000640 1 -- 172.21.15.146:0/3360955429 >> v1:172.21.15.203:6789/0 conn(0x7f79880cfb30 legacy=0x7f79880cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.352+0000 7f7986000640 1 -- 172.21.15.146:0/3360955429 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7988071270 con 0x7f79880709d0 2024-04-24T23:10:13.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.353+0000 7f7986000640 1 --2- 172.21.15.146:0/3360955429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f798815cb80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f79880706c0 tx=0x7f797402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7aa9da586009fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.353+0000 7f7985600640 1 -- 172.21.15.146:0/3360955429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974037070 con 0x7f79880709d0 2024-04-24T23:10:13.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.353+0000 7f7985600640 1 -- 172.21.15.146:0/3360955429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797402ae20 con 0x7f79880709d0 2024-04-24T23:10:13.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.353+0000 7f7985600640 1 -- 172.21.15.146:0/3360955429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974032660 con 0x7f79880709d0 2024-04-24T23:10:13.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 -- 172.21.15.146:0/3360955429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 msgr2=0x7f798815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 --2- 172.21.15.146:0/3360955429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f798815cb80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f79880706c0 tx=0x7f797402a110 comp rx=0 tx=0).stop 2024-04-24T23:10:13.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 -- 172.21.15.146:0/3360955429 shutdown_connections 2024-04-24T23:10:13.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 --2- 172.21.15.146:0/3360955429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f798815cb80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 --2- 172.21.15.146:0/3360955429 >> v2:172.21.15.203:3300/0 conn(0x7f79881561c0 0x7f79880cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 -- 172.21.15.146:0/3360955429 >> 172.21.15.146:0/3360955429 conn(0x7f798806b320 msgr2=0x7f798806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 -- 172.21.15.146:0/3360955429 shutdown_connections 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.354+0000 7f7987e00640 1 -- 172.21.15.146:0/3360955429 wait complete. 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.355+0000 7f7987e00640 1 Processor -- start 2024-04-24T23:10:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.356+0000 7f7987e00640 1 -- start start 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79880cfb30 0x7f7988144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79881561c0 0x7f79880b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79880b2c20 con 0x7f79880709d0 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7988071830 con 0x7f79881561c0 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f79880b2da0 con 0x7f79880cfb30 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38328/0 (socket says 172.21.15.146:38328) 2024-04-24T23:10:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 -- 172.21.15.146:0/1172257980 learned_addr learned my addr 172.21.15.146:0/1172257980 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 -- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79880cfb30 msgr2=0x7f7988144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7987400640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79881561c0 0x7f79880b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986000640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79880cfb30 0x7f7988144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79880cfb30 0x7f7988144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 -- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79881561c0 msgr2=0x7f79880b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79881561c0 0x7f79880b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.357+0000 7f7986a00640 1 -- 172.21.15.146:0/1172257980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7988156c70 con 0x7f79880709d0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f7986a00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f797800c820 tx=0x7f797800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978015070 con 0x7f79880709d0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978004020 con 0x7f79880709d0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79780043f0 con 0x7f79880709d0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7988152f50 con 0x7f79880709d0 2024-04-24T23:10:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.358+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7988147400 con 0x7f79880709d0 2024-04-24T23:10:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.359+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798804f500 con 0x7f79880709d0 2024-04-24T23:10:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.360+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79780077d0 con 0x7f79880709d0 2024-04-24T23:10:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.362+0000 7f797f400640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.362+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f797808add0 con 0x7f79880709d0 2024-04-24T23:10:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.362+0000 7f7986000640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.364+0000 7f7986000640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 0x7f796806e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7974034000 tx=0x7f797402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.366+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7978059550 con 0x7f79880709d0 2024-04-24T23:10:13.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.613+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79881556a0 con 0x7f79880709d0 2024-04-24T23:10:13.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.614+0000 7f797f400640 1 -- 172.21.15.146:0/1172257980 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7f7978058e50 con 0x7f79880709d0 2024-04-24T23:10:13.615 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:13.616 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:13.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 msgr2=0x7f796806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 0x7f796806e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7974034000 tx=0x7f797402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:13.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 msgr2=0x7f7988156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f797800c820 tx=0x7f797800cce0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 shutdown_connections 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79881561c0 0x7f79880b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79880cfb30 0x7f7988144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 --2- 172.21.15.146:0/1172257980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79880709d0 0x7f7988156730 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 >> 172.21.15.146:0/1172257980 conn(0x7f798806b320 msgr2=0x7f79880b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 shutdown_connections 2024-04-24T23:10:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.617+0000 7f7987e00640 1 -- 172.21.15.146:0/1172257980 wait complete. 2024-04-24T23:10:13.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.837+0000 7f0e9a000640 1 Processor -- start 2024-04-24T23:10:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.837+0000 7f0e9a000640 1 -- start start 2024-04-24T23:10:13.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e9a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0e9406b850 0x7f0e94168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e9a000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940b0730 con 0x7f0e940b01e0 2024-04-24T23:10:13.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e9a000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940b0a10 con 0x7f0e94161880 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e9a000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0e940b1340 con 0x7f0e9406b850 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e92a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0e940b01e0 0x7f0e9406b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49840/0 (socket says 172.21.15.146:49840) 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e92a00640 1 -- 172.21.15.146:0/2443310838 learned_addr learned my addr 172.21.15.146:0/2443310838 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.839+0000 7f0e93e00640 1 --2- 172.21.15.146:0/2443310838 >> v2:172.21.15.203:3300/0 conn(0x7f0e9406b850 0x7f0e94168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458516146 0 0) 0x7f0e940b0730 con 0x7f0e940b01e0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e74003520 con 0x7f0e940b01e0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2071004798 0 0) 0x7f0e74003520 con 0x7f0e940b01e0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 >> v2:172.21.15.203:3300/0 conn(0x7f0e9406b850 msgr2=0x7f0e94168fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 --2- 172.21.15.146:0/2443310838 >> v2:172.21.15.203:3300/0 conn(0x7f0e9406b850 0x7f0e94168fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 >> v1:172.21.15.203:6789/0 conn(0x7f0e94161880 legacy=0x7f0e940cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940b0cf0 con 0x7f0e940b01e0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f0e7c0019f0 con 0x7f0e940b01e0 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 >> v1:172.21.15.146:6789/0 conn(0x7f0e940b01e0 legacy=0x7f0e9406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 0x7f0e74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e74004800 0x7f0e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740051c0 0x7f0e7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940b1340 con 0x7f0e740039b0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7400c060 con 0x7f0e74004800 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.840+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7400c260 con 0x7f0e740051c0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 0x7f0e74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e92a00640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e74004800 0x7f0e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93e00640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740051c0 0x7f0e7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 -- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740051c0 msgr2=0x7f0e7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740051c0 0x7f0e7400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 -- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e74004800 msgr2=0x7f0e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e74004800 0x7f0e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93400640 1 -- 172.21.15.146:0/2443310838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e74003520 con 0x7f0e740039b0 2024-04-24T23:10:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.841+0000 7f0e93e00640 1 -- 172.21.15.146:0/2443310838 reap_dead start 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.842+0000 7f0e93400640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 0x7f0e74003dd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0e84001750 tx=0x7f0e74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337685ac86abe9c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.842+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84001370 con 0x7f0e740039b0 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.842+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e840052d0 con 0x7f0e740039b0 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.842+0000 7f0e92000640 1 -- 172.21.15.146:0/2443310838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8402abc0 con 0x7f0e740039b0 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 -- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 msgr2=0x7f0e74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 0x7f0e74003dd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0e84001750 tx=0x7f0e74005830 comp rx=0 tx=0).stop 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 -- 172.21.15.146:0/2443310838 shutdown_connections 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 --2- 172.21.15.146:0/2443310838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e740039b0 0x7f0e74003dd0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 -- 172.21.15.146:0/2443310838 >> 172.21.15.146:0/2443310838 conn(0x7f0e94072880 msgr2=0x7f0e94072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 -- 172.21.15.146:0/2443310838 shutdown_connections 2024-04-24T23:10:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.843+0000 7f0e9a000640 1 -- 172.21.15.146:0/2443310838 wait complete. 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.845+0000 7f0e9a000640 1 Processor -- start 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.845+0000 7f0e9a000640 1 -- start start 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740039b0 0x7f0e941f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e940af450 0x7f0e940c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9406b140 con 0x7f0e9415f620 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94161c60 con 0x7f0e940af450 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e9a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9406b2c0 con 0x7f0e740039b0 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e93e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e93e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38348/0 (socket says 172.21.15.146:38348) 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.846+0000 7f0e93e00640 1 -- 172.21.15.146:0/3092446291 learned_addr learned my addr 172.21.15.146:0/3092446291 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 -- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740039b0 msgr2=0x7f0e941f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740039b0 0x7f0e941f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 -- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e940af450 msgr2=0x7f0e940c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e940af450 0x7f0e940c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 -- 172.21.15.146:0/3092446291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940c4760 con 0x7f0e9415f620 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e93e00640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c010790 tx=0x7f0e8c010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00f040 con 0x7f0e9415f620 2024-04-24T23:10:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c01c070 con 0x7f0e9415f620 2024-04-24T23:10:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00eb10 con 0x7f0e9415f620 2024-04-24T23:10:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e940c4a40 con 0x7f0e9415f620 2024-04-24T23:10:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.847+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e940c5000 con 0x7f0e9415f620 2024-04-24T23:10:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.849+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e940688a0 con 0x7f0e9415f620 2024-04-24T23:10:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.850+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e8c00ecb0 con 0x7f0e9415f620 2024-04-24T23:10:13.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.851+0000 7f0e8b400640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 0x7f0e7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:13.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.851+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f0e8c08aae0 con 0x7f0e9415f620 2024-04-24T23:10:13.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.852+0000 7f0e93400640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 0x7f0e7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:13.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.853+0000 7f0e93400640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 0x7f0e7006e320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0e84032000 tx=0x7f0e8402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:13.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:13.855+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0e8c026020 con 0x7f0e9415f620 2024-04-24T23:10:14.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.061+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e940b2f60 con 0x7f0e9415f620 2024-04-24T23:10:14.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.063+0000 7f0e8b400640 1 -- 172.21.15.146:0/3092446291 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16957 (secure 0 0 0) 0x7f0e8c059260 con 0x7f0e9415f620 2024-04-24T23:10:14.065 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:14.065 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:57.917411+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.066+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 msgr2=0x7f0e7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.066+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 0x7f0e7006e320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0e84032000 tx=0x7f0e8402c000 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.066+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 msgr2=0x7f0e9415fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.066+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c010790 tx=0x7f0e8c010c50 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 shutdown_connections 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9415f620 0x7f0e9415fad0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0e940af450 0x7f0e940c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f0e7006be60 0x7f0e7006e320 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 --2- 172.21.15.146:0/3092446291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0e740039b0 0x7f0e941f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 >> 172.21.15.146:0/3092446291 conn(0x7f0e94072880 msgr2=0x7f0e9406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 shutdown_connections 2024-04-24T23:10:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.067+0000 7f0e9a000640 1 -- 172.21.15.146:0/3092446291 wait complete. 2024-04-24T23:10:14.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T22:59:43.648960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:09:54.095904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:09:55.340076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:10:14.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:10:14.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.300+0000 7fcf6ec00640 1 Processor -- start 2024-04-24T23:10:14.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.300+0000 7fcf6ec00640 1 -- start start 2024-04-24T23:10:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.301+0000 7fcf6ec00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf68155460 0x7fcf6815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.301+0000 7fcf6ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6806ea40 0x7fcf680713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.301+0000 7fcf6ec00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf680b3250 con 0x7fcf680b2ab0 2024-04-24T23:10:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.301+0000 7fcf6ec00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcf680b3530 con 0x7fcf68155460 2024-04-24T23:10:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.301+0000 7fcf6ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b3810 con 0x7fcf6806ea40 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf68155460 0x7fcf6815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf680b2ab0 0x7fcf6806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49846/0 (socket says 172.21.15.146:49846) 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf68155460 0x7fcf6815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38364/0 (socket says 172.21.15.146:38364) 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67400640 1 -- 172.21.15.146:0/1562113448 learned_addr learned my addr 172.21.15.146:0/1562113448 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf6cc00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6806ea40 0x7fcf680713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 -- 172.21.15.146:0/1562113448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6806ea40 msgr2=0x7fcf680713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6806ea40 0x7fcf680713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 -- 172.21.15.146:0/1562113448 >> v1:172.21.15.146:6789/0 conn(0x7fcf680b2ab0 legacy=0x7fcf6806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.302+0000 7fcf67e00640 1 -- 172.21.15.146:0/1562113448 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68070ec0 con 0x7fcf68155460 2024-04-24T23:10:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.303+0000 7fcf67e00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68155460 0x7fcf6815be40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcf580097a0 tx=0x7fcf5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f703ce3459a24830 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf66a00640 1 -- 172.21.15.146:0/1562113448 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037070 con 0x7fcf68155460 2024-04-24T23:10:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf66a00640 1 -- 172.21.15.146:0/1562113448 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58032440 con 0x7fcf68155460 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf66a00640 1 -- 172.21.15.146:0/1562113448 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58032810 con 0x7fcf68155460 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 -- 172.21.15.146:0/1562113448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68155460 msgr2=0x7fcf6815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68155460 0x7fcf6815be40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcf580097a0 tx=0x7fcf5802a180 comp rx=0 tx=0).stop 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 -- 172.21.15.146:0/1562113448 shutdown_connections 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf6806ea40 0x7fcf680713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/1562113448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68155460 0x7fcf6815be40 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 -- 172.21.15.146:0/1562113448 >> 172.21.15.146:0/1562113448 conn(0x7fcf680b17b0 msgr2=0x7fcf680b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.304+0000 7fcf6ec00640 1 -- 172.21.15.146:0/1562113448 shutdown_connections 2024-04-24T23:10:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.305+0000 7fcf6ec00640 1 -- 172.21.15.146:0/1562113448 wait complete. 2024-04-24T23:10:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.306+0000 7fcf6ec00640 1 Processor -- start 2024-04-24T23:10:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.306+0000 7fcf6ec00640 1 -- start start 2024-04-24T23:10:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf680b2ab0 0x7fcf681409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 0x7fcf6806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6815c480 con 0x7fcf6806ea40 2024-04-24T23:10:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b3af0 con 0x7fcf680b2ab0 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf6ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6815c600 con 0x7fcf68155460 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.307+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38376/0 (socket says 172.21.15.146:38376) 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 -- 172.21.15.146:0/2917066837 learned_addr learned my addr 172.21.15.146:0/2917066837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 -- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 msgr2=0x7fcf6806dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf6cc00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 0x7fcf6806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67400640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf680b2ab0 0x7fcf681409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 0x7fcf6806dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 -- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf680b2ab0 msgr2=0x7fcf681409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf680b2ab0 0x7fcf681409f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 -- 172.21.15.146:0/2917066837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6813eb10 con 0x7fcf6806ea40 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf6cc00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 0x7fcf6806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.308+0000 7fcf67e00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcf58035040 tx=0x7fcf580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.309+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037040 con 0x7fcf6806ea40 2024-04-24T23:10:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.309+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58030770 con 0x7fcf6806ea40 2024-04-24T23:10:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.309+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58030b80 con 0x7fcf6806ea40 2024-04-24T23:10:14.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.309+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf68141470 con 0x7fcf6806ea40 2024-04-24T23:10:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.309+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6814dbe0 con 0x7fcf6806ea40 2024-04-24T23:10:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.310+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6806f460 con 0x7fcf6806ea40 2024-04-24T23:10:14.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.311+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf58044020 con 0x7fcf6806ea40 2024-04-24T23:10:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.312+0000 7fcf5fe00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 0x7fcf44072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.312+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fcf580ab5d0 con 0x7fcf6806ea40 2024-04-24T23:10:14.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.313+0000 7fcf67400640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 0x7fcf44072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.314+0000 7fcf67400640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 0x7fcf44072700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fcf681507d0 tx=0x7fcf50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.316+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf6806f460 con 0x7fcf6806ea40 2024-04-24T23:10:14.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.517+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf6806ce50 con 0x7fcf6806ea40 2024-04-24T23:10:14.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.518+0000 7fcf5fe00640 1 -- 172.21.15.146:0/2917066837 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fcf58032e20 con 0x7fcf6806ea40 2024-04-24T23:10:14.519 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-04-24T23:10:14.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 msgr2=0x7fcf44072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 0x7fcf44072700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fcf681507d0 tx=0x7fcf50009040 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 msgr2=0x7fcf6813e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcf58035040 tx=0x7fcf580046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 shutdown_connections 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcf44070240 0x7fcf44072700 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf68155460 0x7fcf6806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf680b2ab0 0x7fcf681409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 --2- 172.21.15.146:0/2917066837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6806ea40 0x7fcf6813e2d0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 >> 172.21.15.146:0/2917066837 conn(0x7fcf680b17b0 msgr2=0x7fcf680b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 shutdown_connections 2024-04-24T23:10:14.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.521+0000 7fcf6ec00640 1 -- 172.21.15.146:0/2917066837 wait complete. 2024-04-24T23:10:14.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:10:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.749+0000 7f1408a00640 1 Processor -- start 2024-04-24T23:10:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.749+0000 7f1408a00640 1 -- start start 2024-04-24T23:10:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.750+0000 7f1408a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f140415bcd0 0x7f14040cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.750+0000 7f1408a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14040b4df0 con 0x7f14040d03d0 2024-04-24T23:10:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.750+0000 7f1408a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14040b4b10 con 0x7f140415cd60 2024-04-24T23:10:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.750+0000 7f1408a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f140415c8d0 con 0x7f140415bcd0 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.751+0000 7f1403200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f14040d03d0 0x7f140415f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49848/0 (socket says 172.21.15.146:49848) 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.751+0000 7f1403200640 1 -- 172.21.15.146:0/64149806 learned_addr learned my addr 172.21.15.146:0/64149806 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.751+0000 7f1402800640 1 --2- 172.21.15.146:0/64149806 >> v2:172.21.15.203:3300/0 conn(0x7f140415bcd0 0x7f14040cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.751+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878359542 0 0) 0x7f14040b4df0 con 0x7f14040d03d0 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.751+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e8003520 con 0x7f14040d03d0 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 153417328 0 0) 0x7f13e8003520 con 0x7f14040d03d0 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 >> v2:172.21.15.203:3300/0 conn(0x7f140415bcd0 msgr2=0x7f14040cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 --2- 172.21.15.146:0/64149806 >> v2:172.21.15.203:3300/0 conn(0x7f140415bcd0 0x7f14040cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 >> v1:172.21.15.203:6789/0 conn(0x7f140415cd60 legacy=0x7f14040cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140415c280 con 0x7f14040d03d0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f13fc001a10 con 0x7f14040d03d0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 >> v1:172.21.15.146:6789/0 conn(0x7f14040d03d0 legacy=0x7f140415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80039b0 0x7f13e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13e8004800 0x7f13e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 0x7f13e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f140415c8d0 con 0x7f13e80051c0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f13e800c060 con 0x7f13e80039b0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f13e800c260 con 0x7f13e8004800 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1403200640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 0x7f13e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.752+0000 7f1402800640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80039b0 0x7f13e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1401e00640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13e8004800 0x7f13e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1403200640 1 -- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13e8004800 msgr2=0x7f13e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1403200640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f13e8004800 0x7f13e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1403200640 1 -- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80039b0 msgr2=0x7f13e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1403200640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80039b0 0x7f13e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.753+0000 7f1403200640 1 -- 172.21.15.146:0/64149806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e8003520 con 0x7f13e80051c0 2024-04-24T23:10:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.754+0000 7f1403200640 1 -- 172.21.15.146:0/64149806 reap_dead start 2024-04-24T23:10:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.754+0000 7f1403200640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 0x7f13e800b9c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f14040d0900 tx=0x7f13e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b684ac02a6628da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.754+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00a4d0 con 0x7f13e80051c0 2024-04-24T23:10:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.754+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc02f070 con 0x7f13e80051c0 2024-04-24T23:10:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.754+0000 7f1401400640 1 -- 172.21.15.146:0/64149806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc02bc50 con 0x7f13e80051c0 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 -- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 msgr2=0x7f13e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 0x7f13e800b9c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f14040d0900 tx=0x7f13e8005830 comp rx=0 tx=0).stop 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 -- 172.21.15.146:0/64149806 shutdown_connections 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 --2- 172.21.15.146:0/64149806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13e80051c0 0x7f13e800b9c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 -- 172.21.15.146:0/64149806 >> 172.21.15.146:0/64149806 conn(0x7f140406b560 msgr2=0x7f140406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 -- 172.21.15.146:0/64149806 shutdown_connections 2024-04-24T23:10:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.755+0000 7f1408a00640 1 -- 172.21.15.146:0/64149806 wait complete. 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.757+0000 7f1408a00640 1 Processor -- start 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.757+0000 7f1408a00640 1 -- start start 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80051c0 0x7f1404147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14040cb2b0 0x7f1404158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14040b4790 con 0x7f1404156190 2024-04-24T23:10:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f140406e590 con 0x7f13e80051c0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1408a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f14040cfcc0 con 0x7f14040cb2b0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38384/0 (socket says 172.21.15.146:38384) 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 -- 172.21.15.146:0/2310206129 learned_addr learned my addr 172.21.15.146:0/2310206129 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1402800640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80051c0 0x7f1404147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1403200640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14040cb2b0 0x7f1404158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 -- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14040cb2b0 msgr2=0x7f1404158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14040cb2b0 0x7f1404158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 -- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80051c0 msgr2=0x7f1404147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80051c0 0x7f1404147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.758+0000 7f1401e00640 1 -- 172.21.15.146:0/2310206129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1404153d10 con 0x7f1404156190 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f1401e00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00e4b0 tx=0x7f13ec00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0052e0 con 0x7f1404156190 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ec018070 con 0x7f1404156190 2024-04-24T23:10:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1404153ff0 con 0x7f1404156190 2024-04-24T23:10:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec003830 con 0x7f1404156190 2024-04-24T23:10:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.759+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1404147860 con 0x7f1404156190 2024-04-24T23:10:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.760+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140404f500 con 0x7f1404156190 2024-04-24T23:10:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.761+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13ec0039d0 con 0x7f1404156190 2024-04-24T23:10:14.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.762+0000 7f13faa00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 0x7f13e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:14.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.762+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f13ec08ad80 con 0x7f1404156190 2024-04-24T23:10:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.763+0000 7f1402800640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 0x7f13e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.764+0000 7f1402800640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 0x7f13e006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009990 tx=0x7f13f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:14.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.768+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f13ec059470 con 0x7f1404156190 2024-04-24T23:10:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.965+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f14040cb690 con 0x7f1404156190 2024-04-24T23:10:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.966+0000 7f13faa00640 1 -- 172.21.15.146:0/2310206129 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f13ec058d70 con 0x7f1404156190 2024-04-24T23:10:14.967 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.968+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 msgr2=0x7f13e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.968+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 0x7f13e006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009990 tx=0x7f13f4008040 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.968+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 msgr2=0x7f14040cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.968+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00e4b0 tx=0x7f13ec00e970 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 shutdown_connections 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f13e006be30 0x7f13e006e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14040cb2b0 0x7f1404158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1404156190 0x7f14040cad70 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 --2- 172.21.15.146:0/2310206129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13e80051c0 0x7f1404147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 >> 172.21.15.146:0/2310206129 conn(0x7f140406b560 msgr2=0x7f14040cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:14.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 shutdown_connections 2024-04-24T23:10:14.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:14.969+0000 7f1408a00640 1 -- 172.21.15.146:0/2310206129 wait complete. 2024-04-24T23:10:14.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:10:15.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.191+0000 7f8bb2400640 1 Processor -- start 2024-04-24T23:10:15.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.191+0000 7f8bb2400640 1 -- start start 2024-04-24T23:10:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bac15a550 0x7f8bac15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb2400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8bac15af00 0x7f8bac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb2400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac0af350 con 0x7f8bac15a170 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb2400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac0b3460 con 0x7f8bac15a550 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb2400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac0b3720 con 0x7f8bac15af00 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8babe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bac15a550 0x7f8bac15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8babe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bac15a550 0x7f8bac15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38398/0 (socket says 172.21.15.146:38398) 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8babe00640 1 -- 172.21.15.146:0/2925702133 learned_addr learned my addr 172.21.15.146:0/2925702133 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.193+0000 7f8bb1a00640 1 --2- 172.21.15.146:0/2925702133 >> v2:172.21.15.203:3300/0 conn(0x7f8bac15af00 0x7f8bac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.194+0000 7f8babe00640 1 -- 172.21.15.146:0/2925702133 >> v2:172.21.15.203:3300/0 conn(0x7f8bac15af00 msgr2=0x7f8bac06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.194+0000 7f8babe00640 1 --2- 172.21.15.146:0/2925702133 >> v2:172.21.15.203:3300/0 conn(0x7f8bac15af00 0x7f8bac06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.194+0000 7f8babe00640 1 -- 172.21.15.146:0/2925702133 >> v1:172.21.15.203:6789/0 conn(0x7f8bac15a170 legacy=0x7f8bac0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.194+0000 7f8babe00640 1 -- 172.21.15.146:0/2925702133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac06c7f0 con 0x7f8bac15a550 2024-04-24T23:10:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.195+0000 7f8babe00640 1 --2- 172.21.15.146:0/2925702133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a550 0x7f8bac15a9c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0aea00 tx=0x7f8b9802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa91da45f107b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.195+0000 7f8bab400640 1 -- 172.21.15.146:0/2925702133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98037070 con 0x7f8bac15a550 2024-04-24T23:10:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.195+0000 7f8bab400640 1 -- 172.21.15.146:0/2925702133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b98032440 con 0x7f8bac15a550 2024-04-24T23:10:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.195+0000 7f8bab400640 1 -- 172.21.15.146:0/2925702133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98032810 con 0x7f8bac15a550 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 -- 172.21.15.146:0/2925702133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a550 msgr2=0x7f8bac15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 --2- 172.21.15.146:0/2925702133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a550 0x7f8bac15a9c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0aea00 tx=0x7f8b9802a2c0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 -- 172.21.15.146:0/2925702133 shutdown_connections 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 --2- 172.21.15.146:0/2925702133 >> v2:172.21.15.203:3300/0 conn(0x7f8bac15af00 0x7f8bac06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 --2- 172.21.15.146:0/2925702133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a550 0x7f8bac15a9c0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 -- 172.21.15.146:0/2925702133 >> 172.21.15.146:0/2925702133 conn(0x7f8bac06b560 msgr2=0x7f8bac06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 -- 172.21.15.146:0/2925702133 shutdown_connections 2024-04-24T23:10:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.196+0000 7f8bb2400640 1 -- 172.21.15.146:0/2925702133 wait complete. 2024-04-24T23:10:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.198+0000 7f8bb2400640 1 Processor -- start 2024-04-24T23:10:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.198+0000 7f8bb2400640 1 -- start start 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac15a550 0x7f8bac149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8bac15af00 0x7f8bac1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac15b5b0 con 0x7f8bac15a170 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0b3a00 con 0x7f8bac15a550 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb2400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0cd050 con 0x7f8bac15af00 2024-04-24T23:10:15.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38404/0 (socket says 172.21.15.146:38404) 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 -- 172.21.15.146:0/3260054387 learned_addr learned my addr 172.21.15.146:0/3260054387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8babe00640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac15a550 0x7f8bac149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 -- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8bac15af00 msgr2=0x7f8bac1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8bac15af00 0x7f8bac1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 -- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac15a550 msgr2=0x7f8bac149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.199+0000 7f8bb1000640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac15a550 0x7f8bac149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8bb1000640 1 -- 172.21.15.146:0/3260054387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac0cd5c0 con 0x7f8bac15a170 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8bb1000640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c460 tx=0x7f8ba000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0016020 con 0x7f8bac15a170 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0012870 con 0x7f8bac15a170 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac152460 con 0x7f8bac15a170 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0012c60 con 0x7f8bac15a170 2024-04-24T23:10:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.200+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac0cdb40 con 0x7f8bac15a170 2024-04-24T23:10:15.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.202+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac04f500 con 0x7f8bac15a170 2024-04-24T23:10:15.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.202+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ba0019020 con 0x7f8bac15a170 2024-04-24T23:10:15.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.203+0000 7f8ba8c00640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 0x7f8b8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.203+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f8ba008aa70 con 0x7f8bac15a170 2024-04-24T23:10:15.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.204+0000 7f8babe00640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 0x7f8b8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.205+0000 7f8babe00640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 0x7f8b8c06e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8b98034000 tx=0x7f8b9802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.208+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8ba0020070 con 0x7f8bac15a170 2024-04-24T23:10:15.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.404+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8bac0b29d0 con 0x7f8bac15a170 2024-04-24T23:10:15.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.410+0000 7f8ba8c00640 1 -- 172.21.15.146:0/3260054387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7f8ba0059280 con 0x7f8bac15a170 2024-04-24T23:10:15.411 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 msgr2=0x7f8b8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 0x7f8b8c06e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8b98034000 tx=0x7f8b9802e000 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 msgr2=0x7f8bac14d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c460 tx=0x7f8ba000c920 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 shutdown_connections 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f8b8c06be30 0x7f8b8c06e2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8bac15af00 0x7f8bac1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bac15a550 0x7f8bac149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 --2- 172.21.15.146:0/3260054387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bac15a170 0x7f8bac14d290 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.412+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 >> 172.21.15.146:0/3260054387 conn(0x7f8bac06b560 msgr2=0x7f8bac0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.413+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 shutdown_connections 2024-04-24T23:10:15.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.413+0000 7f8bb2400640 1 -- 172.21.15.146:0/3260054387 wait complete. 2024-04-24T23:10:15.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:15.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.637+0000 7f3e3c000640 1 Processor -- start 2024-04-24T23:10:15.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.638+0000 7f3e3c000640 1 -- start start 2024-04-24T23:10:15.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.639+0000 7f3e3c000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e34145640 0x7f3e3415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.639+0000 7f3e3c000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e340ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.639+0000 7f3e3c000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e340cdf70 con 0x7f3e340b2a20 2024-04-24T23:10:15.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.639+0000 7f3e3c000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3415d360 con 0x7f3e34145640 2024-04-24T23:10:15.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.639+0000 7f3e3c000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e34145a20 con 0x7f3e340d03a0 2024-04-24T23:10:15.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e38c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e340b2a20 0x7f3e340cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49850/0 (socket says 172.21.15.146:49850) 2024-04-24T23:10:15.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e39600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e34145640 0x7f3e3415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e38c00640 1 -- 172.21.15.146:0/3774821813 learned_addr learned my addr 172.21.15.146:0/3774821813 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e3a000640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e340ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e33e00640 1 -- 172.21.15.146:0/3774821813 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458833873 0 0) 0x7f3e340cdf70 con 0x7f3e340b2a20 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e33e00640 1 -- 172.21.15.146:0/3774821813 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e1c003520 con 0x7f3e340b2a20 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e39600640 1 -- 172.21.15.146:0/3774821813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 msgr2=0x7f3e340ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e39600640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e340ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e39600640 1 -- 172.21.15.146:0/3774821813 >> v1:172.21.15.146:6789/0 conn(0x7f3e340b2a20 legacy=0x7f3e340cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.640+0000 7f3e39600640 1 -- 172.21.15.146:0/3774821813 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3406d140 con 0x7f3e34145640 2024-04-24T23:10:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.641+0000 7f3e39600640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e3415ce20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3e280097a0 tx=0x7f3e2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2d8d9db2a4633 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e33e00640 1 -- 172.21.15.146:0/3774821813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28037070 con 0x7f3e34145640 2024-04-24T23:10:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e33e00640 1 -- 172.21.15.146:0/3774821813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e28032440 con 0x7f3e34145640 2024-04-24T23:10:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e33e00640 1 -- 172.21.15.146:0/3774821813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28032810 con 0x7f3e34145640 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 -- 172.21.15.146:0/3774821813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 msgr2=0x7f3e3415ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e3415ce20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3e280097a0 tx=0x7f3e2802a180 comp rx=0 tx=0).stop 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 -- 172.21.15.146:0/3774821813 shutdown_connections 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e340ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 --2- 172.21.15.146:0/3774821813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e3415ce20 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 -- 172.21.15.146:0/3774821813 >> 172.21.15.146:0/3774821813 conn(0x7f3e3406b320 msgr2=0x7f3e3406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.642+0000 7f3e3c000640 1 -- 172.21.15.146:0/3774821813 shutdown_connections 2024-04-24T23:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.643+0000 7f3e3c000640 1 -- 172.21.15.146:0/3774821813 wait complete. 2024-04-24T23:10:15.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.644+0000 7f3e3c000640 1 Processor -- start 2024-04-24T23:10:15.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.644+0000 7f3e3c000640 1 -- start start 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e340b2a20 0x7f3e3415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e3415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3406d9e0 con 0x7f3e34145640 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3406d700 con 0x7f3e340b2a20 2024-04-24T23:10:15.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.645+0000 7f3e3c000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3406cbc0 con 0x7f3e340d03a0 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38426/0 (socket says 172.21.15.146:38426) 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 -- 172.21.15.146:0/468759569 learned_addr learned my addr 172.21.15.146:0/468759569 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e39600640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e340b2a20 0x7f3e3415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e38c00640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e3415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 -- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 msgr2=0x7f3e3415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e3415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 -- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e340b2a20 msgr2=0x7f3e3415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e340b2a20 0x7f3e3415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e3a000640 1 -- 172.21.15.146:0/468759569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3415b5c0 con 0x7f3e34145640 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.646+0000 7f3e38c00640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e3415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:15.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e3a000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c007e70 tx=0x7f3e2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c014620 con 0x7f3e34145640 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2c019070 con 0x7f3e34145640 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c014a20 con 0x7f3e34145640 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3415b8a0 con 0x7f3e34145640 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.647+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3413a4f0 con 0x7f3e34145640 2024-04-24T23:10:15.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.648+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e34068190 con 0x7f3e34145640 2024-04-24T23:10:15.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.649+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e2c014bc0 con 0x7f3e34145640 2024-04-24T23:10:15.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.650+0000 7f3e31600640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:15.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.650+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f3e2c08b810 con 0x7f3e34145640 2024-04-24T23:10:15.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.651+0000 7f3e39600640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.652+0000 7f3e39600640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 0x7f3e1406e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3e28034000 tx=0x7f3e2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:15.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.655+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e2c05a0c0 con 0x7f3e34145640 2024-04-24T23:10:15.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.893+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e340cf570 con 0x7f3e34145640 2024-04-24T23:10:15.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.894+0000 7f3e31600640 1 -- 172.21.15.146:0/468759569 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7f3e2c0599c0 con 0x7f3e34145640 2024-04-24T23:10:15.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:15.895 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.896+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 msgr2=0x7f3e1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.896+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 0x7f3e1406e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3e28034000 tx=0x7f3e2802e000 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.896+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 msgr2=0x7f3e34139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.896+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c007e70 tx=0x7f3e2c00e4b0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 shutdown_connections 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e34145640 0x7f3e34139fb0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e340d03a0 0x7f3e3415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 --2- 172.21.15.146:0/468759569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e340b2a20 0x7f3e3415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 >> 172.21.15.146:0/468759569 conn(0x7f3e3406b320 msgr2=0x7f3e340b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 shutdown_connections 2024-04-24T23:10:15.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:15.897+0000 7f3e3c000640 1 -- 172.21.15.146:0/468759569 wait complete. 2024-04-24T23:10:15.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.118+0000 7f7d3f200640 1 Processor -- start 2024-04-24T23:10:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.118+0000 7f7d3f200640 1 -- start start 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d400cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3f200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d40070f90 con 0x7f7d401561c0 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d40071270 con 0x7f7d400d0240 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d400b4310 con 0x7f7d400709d0 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d401561c0 0x7f7d400cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49864/0 (socket says 172.21.15.146:49864) 2024-04-24T23:10:16.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3de00640 1 -- 172.21.15.146:0/871617061 learned_addr learned my addr 172.21.15.146:0/871617061 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.120+0000 7f7d3e800640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d400cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790452670 0 0) 0x7f7d40070f90 con 0x7f7d401561c0 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d24003520 con 0x7f7d401561c0 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367646184 0 0) 0x7f7d24003520 con 0x7f7d401561c0 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 msgr2=0x7f7d400cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d400cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 >> v1:172.21.15.203:6789/0 conn(0x7f7d400d0240 legacy=0x7f7d400b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d40071550 con 0x7f7d401561c0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f7d300019f0 con 0x7f7d401561c0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 >> v1:172.21.15.146:6789/0 conn(0x7f7d401561c0 legacy=0x7f7d400cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d240039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d24004d40 0x7f7d240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400b4310 con 0x7f7d24003f60 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2400bc00 con 0x7f7d24004d40 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.121+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2400be00 con 0x7f7d400709d0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3e800640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d24004d40 0x7f7d240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3de00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d240039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 -- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 msgr2=0x7f7d240039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d240039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 -- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d24004d40 msgr2=0x7f7d240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d24004d40 0x7f7d240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3d400640 1 -- 172.21.15.146:0/871617061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24003520 con 0x7f7d24003f60 2024-04-24T23:10:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3de00640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400709d0 0x7f7d240039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.122+0000 7f7d3e800640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d24004d40 0x7f7d240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.123+0000 7f7d3d400640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d24004800 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9111e7f618e24f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c001370 con 0x7f7d24003f60 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0052d0 con 0x7f7d24003f60 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3ca00640 1 -- 172.21.15.146:0/871617061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c02abe0 con 0x7f7d24003f60 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 -- 172.21.15.146:0/871617061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 msgr2=0x7f7d24004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 --2- 172.21.15.146:0/871617061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d24004800 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d24005830 comp rx=0 tx=0).stop 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3e800640 1 -- 172.21.15.146:0/871617061 reap_dead start 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 -- 172.21.15.146:0/871617061 shutdown_connections 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 -- 172.21.15.146:0/871617061 >> 172.21.15.146:0/871617061 conn(0x7f7d4006b320 msgr2=0x7f7d4006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 -- 172.21.15.146:0/871617061 shutdown_connections 2024-04-24T23:10:16.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.124+0000 7f7d3f200640 1 -- 172.21.15.146:0/871617061 wait complete. 2024-04-24T23:10:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.126+0000 7f7d3f200640 1 Processor -- start 2024-04-24T23:10:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.126+0000 7f7d3f200640 1 -- start start 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 0x7f7d40140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400adfb0 0x7f7d401412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400cdbf0 con 0x7f7d24003f60 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400cdd70 con 0x7f7d400adb30 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d400cdef0 con 0x7f7d400adfb0 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38444/0 (socket says 172.21.15.146:38444) 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.127+0000 7f7d3de00640 1 -- 172.21.15.146:0/1924004457 learned_addr learned my addr 172.21.15.146:0/1924004457 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3d400640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 0x7f7d40140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3e800640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400adfb0 0x7f7d401412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 -- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400adfb0 msgr2=0x7f7d401412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400adfb0 0x7f7d401412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 -- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 msgr2=0x7f7d40140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 0x7f7d40140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 -- 172.21.15.146:0/1924004457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d40148c30 con 0x7f7d24003f60 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3d400640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 0x7f7d40140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:16.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d3de00640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001370 tx=0x7f7d3000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.128+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30019070 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.129+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d30004d60 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.129+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4006cc10 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.129+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300072d0 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.129+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4006d450 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.130+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4004f500 con 0x7f7d24003f60 2024-04-24T23:10:16.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.131+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d3001c070 con 0x7f7d24003f60 2024-04-24T23:10:16.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.132+0000 7f7d36000640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 0x7f7d2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.132+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f7d3008b210 con 0x7f7d24003f60 2024-04-24T23:10:16.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.132+0000 7f7d3d400640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 0x7f7d2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.134+0000 7f7d3d400640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 0x7f7d2006e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c032000 tx=0x7f7d2c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.137+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7d4006cc10 con 0x7f7d24003f60 2024-04-24T23:10:16.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.335+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d40141810 con 0x7f7d24003f60 2024-04-24T23:10:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.336+0000 7f7d36000640 1 -- 172.21.15.146:0/1924004457 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16957 (secure 0 0 0) 0x7f7d30059990 con 0x7f7d24003f60 2024-04-24T23:10:16.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:16.338 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:57.917411+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 msgr2=0x7f7d2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 0x7f7d2006e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c032000 tx=0x7f7d2c02e000 comp rx=0 tx=0).stop 2024-04-24T23:10:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 msgr2=0x7f7d401486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001370 tx=0x7f7d3000b4a0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 shutdown_connections 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f7d2006be30 0x7f7d2006e2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d400adfb0 0x7f7d401412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d400adb30 0x7f7d40140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 --2- 172.21.15.146:0/1924004457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d24003f60 0x7f7d401486f0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 >> 172.21.15.146:0/1924004457 conn(0x7f7d4006b320 msgr2=0x7f7d4015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 shutdown_connections 2024-04-24T23:10:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.339+0000 7f7d3f200640 1 -- 172.21.15.146:0/1924004457 wait complete. 2024-04-24T23:10:16.357 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:10:16.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:16.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.558+0000 7f8316e00640 1 Processor -- start 2024-04-24T23:10:16.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.558+0000 7f8316e00640 1 -- start start 2024-04-24T23:10:16.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8316e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83100715f0 0x7f8310071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8316e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8310158970 con 0x7f83100cfc90 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8316e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8310070c10 con 0x7f8310158590 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8316e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8310070ef0 con 0x7f83100715f0 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8307400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83100715f0 0x7f8310071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8314e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f83100cfc90 0x7f831015e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49876/0 (socket says 172.21.15.146:49876) 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.560+0000 7f8314e00640 1 -- 172.21.15.146:0/377872884 learned_addr learned my addr 172.21.15.146:0/377872884 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.561+0000 7f8307400640 1 -- 172.21.15.146:0/377872884 >> v1:172.21.15.203:6789/0 conn(0x7f8310158590 legacy=0x7f8310162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.561+0000 7f830f400640 1 -- 172.21.15.146:0/377872884 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884286303 0 0) 0x7f8310158970 con 0x7f83100cfc90 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.561+0000 7f8307400640 1 -- 172.21.15.146:0/377872884 >> v1:172.21.15.146:6789/0 conn(0x7f83100cfc90 legacy=0x7f831015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.561+0000 7f8307400640 1 -- 172.21.15.146:0/377872884 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100711d0 con 0x7f83100715f0 2024-04-24T23:10:16.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f8307400640 1 --2- 172.21.15.146:0/377872884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f8310071a70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9433522c99e4e9ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f830f400640 1 -- 172.21.15.146:0/377872884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8037070 con 0x7f83100715f0 2024-04-24T23:10:16.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f830f400640 1 -- 172.21.15.146:0/377872884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f8032440 con 0x7f83100715f0 2024-04-24T23:10:16.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f830f400640 1 -- 172.21.15.146:0/377872884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032810 con 0x7f83100715f0 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f8316e00640 1 -- 172.21.15.146:0/377872884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 msgr2=0x7f8310071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.562+0000 7f8316e00640 1 --2- 172.21.15.146:0/377872884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f8310071a70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802a270 comp rx=0 tx=0).stop 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.563+0000 7f8316e00640 1 -- 172.21.15.146:0/377872884 shutdown_connections 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.563+0000 7f8316e00640 1 --2- 172.21.15.146:0/377872884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f8310071a70 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.563+0000 7f8316e00640 1 -- 172.21.15.146:0/377872884 >> 172.21.15.146:0/377872884 conn(0x7f831006b320 msgr2=0x7f831006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.563+0000 7f8316e00640 1 -- 172.21.15.146:0/377872884 shutdown_connections 2024-04-24T23:10:16.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.563+0000 7f8316e00640 1 -- 172.21.15.146:0/377872884 wait complete. 2024-04-24T23:10:16.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.564+0000 7f8316e00640 1 Processor -- start 2024-04-24T23:10:16.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.564+0000 7f8316e00640 1 -- start start 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100cfc90 0x7f8310144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8310158590 0x7f831015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83100d0100 con 0x7f83100715f0 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8310161f30 con 0x7f83100cfc90 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.565+0000 7f8316e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f83100d0280 con 0x7f8310158590 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38460/0 (socket says 172.21.15.146:38460) 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 -- 172.21.15.146:0/994582404 learned_addr learned my addr 172.21.15.146:0/994582404 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f8307400640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100cfc90 0x7f8310144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f8314e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8310158590 0x7f831015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 -- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8310158590 msgr2=0x7f831015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8310158590 0x7f831015fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 -- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100cfc90 msgr2=0x7f8310144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100cfc90 0x7f8310144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.566+0000 7f830fe00640 1 -- 172.21.15.146:0/994582404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100b0350 con 0x7f83100715f0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f830fe00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f830000b420 tx=0x7f830000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300011830 con 0x7f83100715f0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8300016070 con 0x7f83100715f0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83100b0630 con 0x7f83100715f0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300011c10 con 0x7f83100715f0 2024-04-24T23:10:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.567+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83100b0bf0 con 0x7f83100715f0 2024-04-24T23:10:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.568+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8310068190 con 0x7f83100715f0 2024-04-24T23:10:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.569+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f830001b460 con 0x7f83100715f0 2024-04-24T23:10:16.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.570+0000 7f830cc00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 0x7f82ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:16.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.570+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f830008ab40 con 0x7f83100715f0 2024-04-24T23:10:16.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.571+0000 7f8307400640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 0x7f82ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.572+0000 7f8307400640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 0x7f82ec06e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.575+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8300020020 con 0x7f83100715f0 2024-04-24T23:10:16.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.798+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83100b4020 con 0x7f83100715f0 2024-04-24T23:10:16.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.800+0000 7f830cc00640 1 -- 172.21.15.146:0/994582404 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7f83000592c0 con 0x7f83100715f0 2024-04-24T23:10:16.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:16.801 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:16.801 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 msgr2=0x7f82ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 0x7f82ec06e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).stop 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 msgr2=0x7f83100b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f830000b420 tx=0x7f830000b8e0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 shutdown_connections 2024-04-24T23:10:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f82ec06be30 0x7f82ec06e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8310158590 0x7f831015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100cfc90 0x7f8310144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 --2- 172.21.15.146:0/994582404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83100715f0 0x7f83100b13f0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 >> 172.21.15.146:0/994582404 conn(0x7f831006b320 msgr2=0x7f8310162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 shutdown_connections 2024-04-24T23:10:16.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:16.803+0000 7f8316e00640 1 -- 172.21.15.146:0/994582404 wait complete. 2024-04-24T23:10:16.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.018+0000 7f6a25600640 1 Processor -- start 2024-04-24T23:10:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.019+0000 7f6a25600640 1 -- start start 2024-04-24T23:10:17.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.020+0000 7f6a25600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a2015e250 0x7f6a200cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.020+0000 7f6a25600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a200cfd30 con 0x7f6a200d4910 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.020+0000 7f6a25600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a200c7a70 con 0x7f6a200d0ea0 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.020+0000 7f6a25600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6a200c80c0 con 0x7f6a2015e250 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a2015e250 0x7f6a200cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a17400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a200d4910 0x7f6a200d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49890/0 (socket says 172.21.15.146:49890) 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a2015e250 0x7f6a200cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38472/0 (socket says 172.21.15.146:38472) 2024-04-24T23:10:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a17400640 1 -- 172.21.15.146:0/2561256392 learned_addr learned my addr 172.21.15.146:0/2561256392 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1fe00640 1 -- 172.21.15.146:0/2561256392 >> v1:172.21.15.203:6789/0 conn(0x7f6a200d0ea0 legacy=0x7f6a200b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1fe00640 1 -- 172.21.15.146:0/2561256392 >> v1:172.21.15.146:6789/0 conn(0x7f6a200d4910 legacy=0x7f6a200d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1fe00640 1 -- 172.21.15.146:0/2561256392 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a200c7d50 con 0x7f6a2015e250 2024-04-24T23:10:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.021+0000 7f6a1f400640 1 -- 172.21.15.146:0/2561256392 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528389851 0 0) 0x7f6a200cfd30 con 0x7f6a200d4910 2024-04-24T23:10:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.022+0000 7f6a1fe00640 1 --2- 172.21.15.146:0/2561256392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2015e250 0x7f6a200cf3e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097a0 tx=0x7f6a1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca326a383f1a472 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a1f400640 1 -- 172.21.15.146:0/2561256392 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10037070 con 0x7f6a2015e250 2024-04-24T23:10:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a1f400640 1 -- 172.21.15.146:0/2561256392 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1002ae50 con 0x7f6a2015e250 2024-04-24T23:10:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a1f400640 1 -- 172.21.15.146:0/2561256392 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10032660 con 0x7f6a2015e250 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a25600640 1 -- 172.21.15.146:0/2561256392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2015e250 msgr2=0x7f6a200cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a25600640 1 --2- 172.21.15.146:0/2561256392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2015e250 0x7f6a200cf3e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097a0 tx=0x7f6a1002a140 comp rx=0 tx=0).stop 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a25600640 1 -- 172.21.15.146:0/2561256392 shutdown_connections 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a25600640 1 --2- 172.21.15.146:0/2561256392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a2015e250 0x7f6a200cf3e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.023+0000 7f6a25600640 1 -- 172.21.15.146:0/2561256392 >> 172.21.15.146:0/2561256392 conn(0x7f6a200d3d80 msgr2=0x7f6a200d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.024+0000 7f6a25600640 1 -- 172.21.15.146:0/2561256392 shutdown_connections 2024-04-24T23:10:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.024+0000 7f6a25600640 1 -- 172.21.15.146:0/2561256392 wait complete. 2024-04-24T23:10:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.025+0000 7f6a25600640 1 Processor -- start 2024-04-24T23:10:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.025+0000 7f6a25600640 1 -- start start 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a200d0ea0 0x7f6a2014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2015e250 0x7f6a200b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a200cfaa0 con 0x7f6a200d4910 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a200cf920 con 0x7f6a200d0ea0 2024-04-24T23:10:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a25600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a200c9560 con 0x7f6a2015e250 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a17400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.026+0000 7f6a17400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38482/0 (socket says 172.21.15.146:38482) 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 -- 172.21.15.146:0/3795927308 learned_addr learned my addr 172.21.15.146:0/3795927308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a1fe00640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a200d0ea0 0x7f6a2014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a24c00640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2015e250 0x7f6a200b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 -- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2015e250 msgr2=0x7f6a200b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2015e250 0x7f6a200b97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 -- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a200d0ea0 msgr2=0x7f6a2014bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a200d0ea0 0x7f6a2014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 -- 172.21.15.146:0/3795927308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a200cd470 con 0x7f6a200d4910 2024-04-24T23:10:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.027+0000 7f6a17400640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c4d0 tx=0x7f6a0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.028+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08018070 con 0x7f6a200d4910 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.028+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a08007500 con 0x7f6a200d4910 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.028+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a200cd750 con 0x7f6a200d4910 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.028+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004a20 con 0x7f6a200d4910 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.028+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2014c5d0 con 0x7f6a200d4910 2024-04-24T23:10:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.029+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a200c72b0 con 0x7f6a200d4910 2024-04-24T23:10:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.030+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a0801b070 con 0x7f6a200d4910 2024-04-24T23:10:17.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.031+0000 7f6a1cc00640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 0x7f69fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.031+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f6a0808a3d0 con 0x7f6a200d4910 2024-04-24T23:10:17.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.032+0000 7f6a1fe00640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 0x7f69fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.033+0000 7f6a1fe00640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 0x7f69fc06e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.036+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a200c72b0 con 0x7f6a200d4910 2024-04-24T23:10:17.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.256+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a2004f500 con 0x7f6a200d4910 2024-04-24T23:10:17.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.257+0000 7f6a1cc00640 1 -- 172.21.15.146:0/3795927308 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5195 (secure 0 0 0) 0x7f6a08058b90 con 0x7f6a200d4910 2024-04-24T23:10:17.259 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:17.259 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:09:56.332407+0000","modified":"2024-04-24T23:09:59.413973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6837/1394221718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":1394221718},{"type":"v1","addr":"172.21.15.203:6837","nonce":1394221718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7956,"qdb_cluster":[7956]},"id":6}]} 2024-04-24T23:10:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 83 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 msgr2=0x7f69fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 0x7f69fc06e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).stop 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 msgr2=0x7f6a200b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c4d0 tx=0x7f6a0800c990 comp rx=0 tx=0).stop 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 shutdown_connections 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f69fc06be30 0x7f69fc06e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a2015e250 0x7f6a200b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a200d4910 0x7f6a200b9280 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 --2- 172.21.15.146:0/3795927308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a200d0ea0 0x7f6a2014bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.260+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 >> 172.21.15.146:0/3795927308 conn(0x7f6a200d3d80 msgr2=0x7f6a2006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:17.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.261+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 shutdown_connections 2024-04-24T23:10:17.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.261+0000 7f6a25600640 1 -- 172.21.15.146:0/3795927308 wait complete. 2024-04-24T23:10:17.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:17.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:17.456 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:17.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.475+0000 7f6604a00640 1 Processor -- start 2024-04-24T23:10:17.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.475+0000 7f6604a00640 1 -- start start 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f6604a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f660006f750 0x7f66000b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f6604a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f660006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f6604a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66000b59b0 con 0x7f660015dfd0 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f6604a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f66000d10a0 con 0x7f660006f750 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f6604a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f66000b5c50 con 0x7f660015e3b0 2024-04-24T23:10:17.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f65fd400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f660006f750 0x7f66000b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f65fd400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f660006f750 0x7f66000b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38490/0 (socket says 172.21.15.146:38490) 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f65fd400640 1 -- 172.21.15.146:0/3096512542 learned_addr learned my addr 172.21.15.146:0/3096512542 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.477+0000 7f65fe800640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f660006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.478+0000 7f65fd400640 1 -- 172.21.15.146:0/3096512542 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 msgr2=0x7f660006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.478+0000 7f65fd400640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f660006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.478+0000 7f65fd400640 1 -- 172.21.15.146:0/3096512542 >> v1:172.21.15.203:6789/0 conn(0x7f660015dfd0 legacy=0x7f66000d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.478+0000 7f65fd400640 1 -- 172.21.15.146:0/3096512542 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000b5f30 con 0x7f660006f750 2024-04-24T23:10:17.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.479+0000 7f65fd400640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66000b3c40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f66000d1220 tx=0x7f65ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb4afd616365b20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.479+0000 7f65fca00640 1 -- 172.21.15.146:0/3096512542 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec037070 con 0x7f660006f750 2024-04-24T23:10:17.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.479+0000 7f65fca00640 1 -- 172.21.15.146:0/3096512542 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec032440 con 0x7f660006f750 2024-04-24T23:10:17.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.479+0000 7f65fca00640 1 -- 172.21.15.146:0/3096512542 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec032810 con 0x7f660006f750 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 -- 172.21.15.146:0/3096512542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 msgr2=0x7f66000b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66000b3c40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f66000d1220 tx=0x7f65ec02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 -- 172.21.15.146:0/3096512542 shutdown_connections 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f660006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 --2- 172.21.15.146:0/3096512542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66000b3c40 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 -- 172.21.15.146:0/3096512542 >> 172.21.15.146:0/3096512542 conn(0x7f660006c250 msgr2=0x7f660006c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:17.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 -- 172.21.15.146:0/3096512542 shutdown_connections 2024-04-24T23:10:17.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.480+0000 7f6604a00640 1 -- 172.21.15.146:0/3096512542 wait complete. 2024-04-24T23:10:17.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.482+0000 7f6604a00640 1 Processor -- start 2024-04-24T23:10:17.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.482+0000 7f6604a00640 1 -- start start 2024-04-24T23:10:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 0x7f6600155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f6600155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66000b4410 con 0x7f660006f750 2024-04-24T23:10:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f66000b4290 con 0x7f660015dfd0 2024-04-24T23:10:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f6604a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f660006b680 con 0x7f660015e3b0 2024-04-24T23:10:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f65fde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f65fde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38492/0 (socket says 172.21.15.146:38492) 2024-04-24T23:10:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.483+0000 7f65fde00640 1 -- 172.21.15.146:0/3007329343 learned_addr learned my addr 172.21.15.146:0/3007329343 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fd400640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 0x7f6600155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 -- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 msgr2=0x7f6600155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f6600155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 -- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 msgr2=0x7f6600155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 0x7f6600155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 -- 172.21.15.146:0/3007329343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6600155e80 con 0x7f660006f750 2024-04-24T23:10:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fd400640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 0x7f6600155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65fde00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c480 tx=0x7f65f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.484+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00052d0 con 0x7f660006f750 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.485+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f0005470 con 0x7f660006f750 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.485+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6600156150 con 0x7f660006f750 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.485+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0012870 con 0x7f660006f750 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.485+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6600156710 con 0x7f660006f750 2024-04-24T23:10:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.486+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6600068190 con 0x7f660006f750 2024-04-24T23:10:17.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.487+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65f0012a10 con 0x7f660006f750 2024-04-24T23:10:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.488+0000 7f65f6000640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.488+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7f65f008ac10 con 0x7f660006f750 2024-04-24T23:10:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.489+0000 7f65fd400640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.490+0000 7f65fd400640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 0x7f65e006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f65ec034000 tx=0x7f65ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.493+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f65f00594c0 con 0x7f660006f750 2024-04-24T23:10:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.695+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66000726a0 con 0x7f660006f750 2024-04-24T23:10:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.697+0000 7f65f6000640 1 -- 172.21.15.146:0/3007329343 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16957 (secure 0 0 0) 0x7f65f0058dc0 con 0x7f660006f750 2024-04-24T23:10:17.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:17.699 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:09:57.917411+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:09:54.095904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-24T23:09:55.340076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 msgr2=0x7f65e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 0x7f65e006e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f65ec034000 tx=0x7f65ec02e000 comp rx=0 tx=0).stop 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 msgr2=0x7f66001f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c480 tx=0x7f65f000c940 comp rx=0 tx=0).stop 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 shutdown_connections 2024-04-24T23:10:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f65e006be30 0x7f65e006e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f660015e3b0 0x7f6600155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660015dfd0 0x7f6600155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 --2- 172.21.15.146:0/3007329343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660006f750 0x7f66001f7bd0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 >> 172.21.15.146:0/3007329343 conn(0x7f660006c250 msgr2=0x7f66001601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 shutdown_connections 2024-04-24T23:10:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.700+0000 7f6604a00640 1 -- 172.21.15.146:0/3007329343 wait complete. 2024-04-24T23:10:17.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:10:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.912+0000 7fe93e000640 1 Processor -- start 2024-04-24T23:10:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.912+0000 7fe93e000640 1 -- start start 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe93815bdc0 0x7fe938072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 0x7fe9380718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9380ae830 0x7fe9380aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe9380cc5d0 con 0x7fe9380ae830 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe9380cf6b0 con 0x7fe93815cd80 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe938071e00 con 0x7fe93815bdc0 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93d600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9380ae830 0x7fe9380aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93d600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9380ae830 0x7fe9380aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33576/0 (socket says 172.21.15.146:33576) 2024-04-24T23:10:17.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.914+0000 7fe93d600640 1 -- 172.21.15.146:0/4155654203 learned_addr learned my addr 172.21.15.146:0/4155654203 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:17.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93cc00640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe93815bdc0 0x7fe938072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe937e00640 1 --2- 172.21.15.146:0/4155654203 >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 0x7fe9380718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93d600640 1 -- 172.21.15.146:0/4155654203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe93815bdc0 msgr2=0x7fe938072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93d600640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe93815bdc0 0x7fe938072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93d600640 1 -- 172.21.15.146:0/4155654203 >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 msgr2=0x7fe9380718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93d600640 1 --2- 172.21.15.146:0/4155654203 >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 0x7fe9380718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe93d600640 1 -- 172.21.15.146:0/4155654203 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93815c1a0 con 0x7fe9380ae830 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.915+0000 7fe937e00640 1 --2- 172.21.15.146:0/4155654203 >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 0x7fe9380718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.916+0000 7fe93d600640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9380ae830 0x7fe9380aec60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe9380d0910 tx=0x7fe93002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19781b4552acce5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.916+0000 7fe937400640 1 -- 172.21.15.146:0/4155654203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930036070 con 0x7fe9380ae830 2024-04-24T23:10:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.916+0000 7fe937400640 1 -- 172.21.15.146:0/4155654203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe930031600 con 0x7fe9380ae830 2024-04-24T23:10:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.916+0000 7fe937400640 1 -- 172.21.15.146:0/4155654203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300319d0 con 0x7fe9380ae830 2024-04-24T23:10:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 -- 172.21.15.146:0/4155654203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9380ae830 msgr2=0x7fe9380aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9380ae830 0x7fe9380aec60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe9380d0910 tx=0x7fe93002a630 comp rx=0 tx=0).stop 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 -- 172.21.15.146:0/4155654203 shutdown_connections 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9380ae830 0x7fe9380aec60 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 --2- 172.21.15.146:0/4155654203 >> v2:172.21.15.203:3300/0 conn(0x7fe93815cd80 0x7fe9380718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 --2- 172.21.15.146:0/4155654203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe93815bdc0 0x7fe938072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 -- 172.21.15.146:0/4155654203 >> 172.21.15.146:0/4155654203 conn(0x7fe9380b1560 msgr2=0x7fe9380b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 -- 172.21.15.146:0/4155654203 shutdown_connections 2024-04-24T23:10:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.917+0000 7fe93e000640 1 -- 172.21.15.146:0/4155654203 wait complete. 2024-04-24T23:10:17.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.919+0000 7fe93e000640 1 Processor -- start 2024-04-24T23:10:17.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.919+0000 7fe93e000640 1 -- start start 2024-04-24T23:10:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9380ae830 0x7fe9381f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe93815bdc0 0x7fe938159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe938070b00 con 0x7fe93815cd80 2024-04-24T23:10:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9380af1a0 con 0x7fe93815bdc0 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.920+0000 7fe93e000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe938070de0 con 0x7fe9380ae830 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33590/0 (socket says 172.21.15.146:33590) 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 -- 172.21.15.146:0/3650124692 learned_addr learned my addr 172.21.15.146:0/3650124692 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93cc00640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9380ae830 0x7fe9381f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe937e00640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe93815bdc0 0x7fe938159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 -- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9380ae830 msgr2=0x7fe9381f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9380ae830 0x7fe9381f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 -- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe93815bdc0 msgr2=0x7fe938159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe93815bdc0 0x7fe938159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.921+0000 7fe93d600640 1 -- 172.21.15.146:0/3650124692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9381f51f0 con 0x7fe93815cd80 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe93d600640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe930009f70 tx=0x7fe930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93003f020 con 0x7fe93815cd80 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe930037040 con 0x7fe93815cd80 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930036070 con 0x7fe93815cd80 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe938159d70 con 0x7fe93815cd80 2024-04-24T23:10:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.922+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93815a330 con 0x7fe93815cd80 2024-04-24T23:10:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.923+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9380704b0 con 0x7fe93815cd80 2024-04-24T23:10:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.924+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe930042020 con 0x7fe93815cd80 2024-04-24T23:10:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.925+0000 7fe934c00640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.925+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6101+0+0 (secure 0 0 0) 0x7fe9300ab650 con 0x7fe93815cd80 2024-04-24T23:10:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.925+0000 7fe93cc00640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:17.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.927+0000 7fe93cc00640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 0x7fe91806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00a990 tx=0x7fe92c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:17.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:17.930+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe9380704b0 con 0x7fe93815cd80 2024-04-24T23:10:18.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.166+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe93804f500 con 0x7fe93815cd80 2024-04-24T23:10:18.168 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-04-24T23:10:18.167+0000 7fc7b8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-24T23:10:18.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.171+0000 7fe934c00640 1 -- 172.21.15.146:0/3650124692 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7fe930049030 con 0x7fe93815cd80 2024-04-24T23:10:18.172 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.173+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 msgr2=0x7fe91806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.173+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 0x7fe91806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00a990 tx=0x7fe92c008040 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.173+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 msgr2=0x7fe93815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.173+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe930009f70 tx=0x7fe930004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 shutdown_connections 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe93815cd80 0x7fe93815ab30 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe93815bdc0 0x7fe938159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 --2- 172.21.15.146:0/3650124692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9380ae830 0x7fe9381f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 >> 172.21.15.146:0/3650124692 conn(0x7fe9380b1560 msgr2=0x7fe938157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:18.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 shutdown_connections 2024-04-24T23:10:18.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.174+0000 7fe93e000640 1 -- 172.21.15.146:0/3650124692 wait complete. 2024-04-24T23:10:18.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:10:18.197 INFO:tasks.ceph.mds.d.smithi203.stderr: -1997> 2024-04-24T23:10:02.837+0000 7f70e6400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:10:18.288 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-24T23:10:18.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.395+0000 7fe0ac000640 1 Processor -- start 2024-04-24T23:10:18.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.395+0000 7fe0ac000640 1 -- start start 2024-04-24T23:10:18.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.396+0000 7fe0ac000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a4141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.396+0000 7fe0ac000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe0a40ce770 0x7fe0a4071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.396+0000 7fe0ac000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a40ced40 con 0x7fe0a4141ab0 2024-04-24T23:10:18.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.396+0000 7fe0ac000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a41423d0 con 0x7fe0a40ce770 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.396+0000 7fe0ac000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a4070f80 con 0x7fe0a413ef30 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0a8c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0a4141ab0 0x7fe0a40ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53072/0 (socket says 172.21.15.146:53072) 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0a8c00640 1 -- 172.21.15.146:0/1415159834 learned_addr learned my addr 172.21.15.146:0/1415159834 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1415159834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a4141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0aa000640 1 --2- 172.21.15.146:0/1415159834 >> v2:172.21.15.203:3300/0 conn(0x7fe0a40ce770 0x7fe0a4071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377358432 0 0) 0x7fe0a40ced40 con 0x7fe0a4141ab0 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.397+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c003520 con 0x7fe0a4141ab0 2024-04-24T23:10:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.398+0000 7fe0a9600640 1 -- 172.21.15.146:0/1415159834 >> v2:172.21.15.203:3300/0 conn(0x7fe0a40ce770 msgr2=0x7fe0a4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.398+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1415159834 >> v2:172.21.15.203:3300/0 conn(0x7fe0a40ce770 0x7fe0a4071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.398+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3498159271 0 0) 0x7fe08c003520 con 0x7fe0a4141ab0 2024-04-24T23:10:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.398+0000 7fe0a9600640 1 -- 172.21.15.146:0/1415159834 >> v1:172.21.15.146:6789/0 conn(0x7fe0a4141ab0 legacy=0x7fe0a40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.398+0000 7fe0a9600640 1 -- 172.21.15.146:0/1415159834 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40cf020 con 0x7fe0a413ef30 2024-04-24T23:10:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.399+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1415159834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a4141570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0980097a0 tx=0x7fe09802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d453aed232a9aaa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:18.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.400+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098037070 con 0x7fe0a413ef30 2024-04-24T23:10:18.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.400+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09802aba0 con 0x7fe0a413ef30 2024-04-24T23:10:18.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.400+0000 7fe0a3e00640 1 -- 172.21.15.146:0/1415159834 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090001670 con 0x7fe0a413ef30 2024-04-24T23:10:18.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 -- 172.21.15.146:0/1415159834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 msgr2=0x7fe0a4141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1415159834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a4141570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0980097a0 tx=0x7fe09802a110 comp rx=0 tx=0).stop 2024-04-24T23:10:18.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 -- 172.21.15.146:0/1415159834 shutdown_connections 2024-04-24T23:10:18.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1415159834 >> v2:172.21.15.203:3300/0 conn(0x7fe0a40ce770 0x7fe0a4071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1415159834 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a4141570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 -- 172.21.15.146:0/1415159834 >> 172.21.15.146:0/1415159834 conn(0x7fe0a40b17b0 msgr2=0x7fe0a40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:18.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 -- 172.21.15.146:0/1415159834 shutdown_connections 2024-04-24T23:10:18.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.401+0000 7fe0ac000640 1 -- 172.21.15.146:0/1415159834 wait complete. 2024-04-24T23:10:18.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.403+0000 7fe0ac000640 1 Processor -- start 2024-04-24T23:10:18.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.403+0000 7fe0ac000640 1 -- start start 2024-04-24T23:10:18.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0a40ce770 0x7fe0a41f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a413a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4071950 con 0x7fe0a4141ab0 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4070c10 con 0x7fe0a40ce770 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0ac000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a4071ad0 con 0x7fe0a413ef30 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0aa000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0aa000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33592/0 (socket says 172.21.15.146:33592) 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0aa000640 1 -- 172.21.15.146:0/1414208773 learned_addr learned my addr 172.21.15.146:0/1414208773 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0a40ce770 0x7fe0a41f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.404+0000 7fe0a8c00640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a413a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 -- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 msgr2=0x7fe0a413a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a413a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 -- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0a40ce770 msgr2=0x7fe0a41f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0a40ce770 0x7fe0a41f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 -- 172.21.15.146:0/1414208773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a413aa00 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0aa000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009dd0 tx=0x7fe09c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c018020 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c014480 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c014870 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a4143980 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.405+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a4143f00 con 0x7fe0a4141ab0 2024-04-24T23:10:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.407+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a404f5a0 con 0x7fe0a4141ab0 2024-04-24T23:10:18.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.408+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe09c005d10 con 0x7fe0a4141ab0 2024-04-24T23:10:18.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.408+0000 7fe0a1600640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 0x7fe08406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:18.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.409+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6187+0+0 (secure 0 0 0) 0x7fe09c08bb40 con 0x7fe0a4141ab0 2024-04-24T23:10:18.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.409+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 0x7fe08406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.410+0000 7fe0a9600640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 0x7fe08406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe098034000 tx=0x7fe09802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:18.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.413+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe09c022070 con 0x7fe0a4141ab0 2024-04-24T23:10:18.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:18.662+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe0a41457c0 con 0x7fe0a4141ab0 2024-04-24T23:10:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.174+0000 7fe0a1600640 1 -- 172.21.15.146:0/1414208773 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) ==== 104+0+0 (secure 0 0 0) 0x7fe0a413aa00 con 0x7fe0a4141ab0 2024-04-24T23:10:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 msgr2=0x7fe08406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 0x7fe08406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe098034000 tx=0x7fe09802e000 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 msgr2=0x7fe0a4142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009dd0 tx=0x7fe09c00c490 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 shutdown_connections 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a4141ab0 0x7fe0a4142560 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe08406be30 0x7fe08406e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0a413ef30 0x7fe0a413a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 --2- 172.21.15.146:0/1414208773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0a40ce770 0x7fe0a41f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.179+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 >> 172.21.15.146:0/1414208773 conn(0x7fe0a40b17b0 msgr2=0x7fe0a4071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.180+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 shutdown_connections 2024-04-24T23:10:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.180+0000 7fe0ac000640 1 -- 172.21.15.146:0/1414208773 wait complete. 2024-04-24T23:10:19.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:10:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.405+0000 7f508ac00640 1 Processor -- start 2024-04-24T23:10:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.406+0000 7f508ac00640 1 -- start start 2024-04-24T23:10:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5084071f10 0x7f50840cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508406db30 0x7f508415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f508406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f50840722f0 con 0x7f508406db30 2024-04-24T23:10:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f508415c700 con 0x7f5084071f10 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.407+0000 7f508ac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5084159ce0 con 0x7f508406e230 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508406db30 0x7f508415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508406db30 0x7f508415cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33606/0 (socket says 172.21.15.146:33606) 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 -- 172.21.15.146:0/2354545676 learned_addr learned my addr 172.21.15.146:0/2354545676 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f508a200640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f508406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5089800640 1 --2- 172.21.15.146:0/2354545676 >> v2:172.21.15.203:3300/0 conn(0x7f5084071f10 0x7f50840cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 -- 172.21.15.146:0/2354545676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 msgr2=0x7f508406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f508406e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 -- 172.21.15.146:0/2354545676 >> v2:172.21.15.203:3300/0 conn(0x7f5084071f10 msgr2=0x7f50840cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 --2- 172.21.15.146:0/2354545676 >> v2:172.21.15.203:3300/0 conn(0x7f5084071f10 0x7f50840cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.408+0000 7f5088e00640 1 -- 172.21.15.146:0/2354545676 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508406dfe0 con 0x7f508406db30 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.409+0000 7f5088e00640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508415cb90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f50840d08d0 tx=0x7f507002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e49684491953cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f5083e00640 1 -- 172.21.15.146:0/2354545676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070037070 con 0x7f508406db30 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f5083e00640 1 -- 172.21.15.146:0/2354545676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5070032440 con 0x7f508406db30 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f5083e00640 1 -- 172.21.15.146:0/2354545676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070032810 con 0x7f508406db30 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 -- 172.21.15.146:0/2354545676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 msgr2=0x7f508415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508415cb90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f50840d08d0 tx=0x7f507002a1e0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 -- 172.21.15.146:0/2354545676 shutdown_connections 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508415cb90 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 --2- 172.21.15.146:0/2354545676 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f508406e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 --2- 172.21.15.146:0/2354545676 >> v2:172.21.15.203:3300/0 conn(0x7f5084071f10 0x7f50840cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 -- 172.21.15.146:0/2354545676 >> 172.21.15.146:0/2354545676 conn(0x7f50840b1460 msgr2=0x7f50840b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 -- 172.21.15.146:0/2354545676 shutdown_connections 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.410+0000 7f508ac00640 1 -- 172.21.15.146:0/2354545676 wait complete. 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.412+0000 7f508ac00640 1 Processor -- start 2024-04-24T23:10:19.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.412+0000 7f508ac00640 1 -- start start 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f50841f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5084071f10 0x7f508415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f508415c390 con 0x7f508406db30 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f508406eba0 con 0x7f5084071f10 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f508ac00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5084160700 con 0x7f508406e230 2024-04-24T23:10:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.413+0000 7f5089800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33622/0 (socket says 172.21.15.146:33622) 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 -- 172.21.15.146:0/1295513287 learned_addr learned my addr 172.21.15.146:0/1295513287 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5088e00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f50841f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f508a200640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5084071f10 0x7f508415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 -- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 msgr2=0x7f50841f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f50841f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 -- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5084071f10 msgr2=0x7f508415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5084071f10 0x7f508415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 -- 172.21.15.146:0/1295513287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50841f2b70 con 0x7f508406db30 2024-04-24T23:10:19.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.414+0000 7f5089800640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f507800d5f0 tx=0x7f507800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:19.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.415+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50780125f0 con 0x7f508406db30 2024-04-24T23:10:19.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.415+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5078019070 con 0x7f508406db30 2024-04-24T23:10:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.415+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50780129d0 con 0x7f508406db30 2024-04-24T23:10:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.415+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50841f25b0 con 0x7f508406db30 2024-04-24T23:10:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.415+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508414f120 con 0x7f508406db30 2024-04-24T23:10:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.416+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50840ce7a0 con 0x7f508406db30 2024-04-24T23:10:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.417+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5078012b70 con 0x7f508406db30 2024-04-24T23:10:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.418+0000 7f5081600640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.418+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6187+0+0 (secure 0 0 0) 0x7f507808b450 con 0x7f508406db30 2024-04-24T23:10:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.419+0000 7f5088e00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.420+0000 7f5088e00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 0x7f506406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5070034000 tx=0x7f507002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.423+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f50840ce7a0 con 0x7f508406db30 2024-04-24T23:10:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:19.612+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5084072b00 con 0x7f508406db30 2024-04-24T23:10:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.441+0000 7f5081600640 1 -- 172.21.15.146:0/1295513287 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f5084072b00 con 0x7f508406db30 2024-04-24T23:10:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:10:20.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.446+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 msgr2=0x7f506406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.446+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 0x7f506406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5070034000 tx=0x7f507002e000 comp rx=0 tx=0).stop 2024-04-24T23:10:20.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.446+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 msgr2=0x7f508414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.446+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f507800d5f0 tx=0x7f507800dab0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 shutdown_connections 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5084071f10 0x7f508415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f508406e230 0x7f50841f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 --2- 172.21.15.146:0/1295513287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508406db30 0x7f508414df30 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 >> 172.21.15.146:0/1295513287 conn(0x7f50840b1460 msgr2=0x7f5084071200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 shutdown_connections 2024-04-24T23:10:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.448+0000 7f508ac00640 1 -- 172.21.15.146:0/1295513287 wait complete. 2024-04-24T23:10:20.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:10:20.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.656+0000 7f9a6fe00640 1 Processor -- start 2024-04-24T23:10:20.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.656+0000 7f9a6fe00640 1 -- start start 2024-04-24T23:10:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a700cc200 0x7f9a7006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6fe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a70160420 con 0x7f9a7006e230 2024-04-24T23:10:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6fe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7015c390 con 0x7f9a70071f10 2024-04-24T23:10:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7015d2a0 con 0x7f9a700cc200 2024-04-24T23:10:20.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a7006e230 0x7f9a700cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53088/0 (socket says 172.21.15.146:53088) 2024-04-24T23:10:20.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.658+0000 7f9a6f400640 1 -- 172.21.15.146:0/1916733926 learned_addr learned my addr 172.21.15.146:0/1916733926 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a67e00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a700cc200 0x7f9a7006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482559040 0 0) 0x7f9a70160420 con 0x7f9a7006e230 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a54003520 con 0x7f9a7006e230 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1479876300 0 0) 0x7f9a54003520 con 0x7f9a7006e230 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a700cc200 msgr2=0x7f9a7006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a700cc200 0x7f9a7006db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 >> v1:172.21.15.203:6789/0 conn(0x7f9a70071f10 legacy=0x7f9a7015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a70160700 con 0x7f9a7006e230 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f9a680019f0 con 0x7f9a7006e230 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 >> v1:172.21.15.146:6789/0 conn(0x7f9a7006e230 legacy=0x7f9a700cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a54003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a54004800 0x7f9a54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a540052e0 0x7f9a5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7015d2a0 con 0x7f9a54003a50 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5400c140 con 0x7f9a54004800 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5400c340 con 0x7f9a540052e0 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a67e00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a700cc200 0x7f9a7006db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.659+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a54003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6ea00640 1 -- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a540052e0 msgr2=0x7f9a5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6f400640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a540052e0 0x7f9a5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a67e00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a54004800 0x7f9a54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a540052e0 0x7f9a5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6ea00640 1 -- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a54004800 msgr2=0x7f9a54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a54004800 0x7f9a54004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6ea00640 1 -- 172.21.15.146:0/1916733926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a54003520 con 0x7f9a54003a50 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.660+0000 7f9a6f400640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a540052e0 0x7f9a5400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.661+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a54003e70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001720 tx=0x7f9a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82faf2f8c6e1b73a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.661+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60001370 con 0x7f9a54003a50 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.661+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a600052d0 con 0x7f9a54003a50 2024-04-24T23:10:20.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.661+0000 7f9a6e000640 1 -- 172.21.15.146:0/1916733926 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6002ab90 con 0x7f9a54003a50 2024-04-24T23:10:20.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 -- 172.21.15.146:0/1916733926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 msgr2=0x7f9a54003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/1916733926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a54003e70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001720 tx=0x7f9a54005830 comp rx=0 tx=0).stop 2024-04-24T23:10:20.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6f400640 1 -- 172.21.15.146:0/1916733926 reap_dead start 2024-04-24T23:10:20.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 -- 172.21.15.146:0/1916733926 shutdown_connections 2024-04-24T23:10:20.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 -- 172.21.15.146:0/1916733926 >> 172.21.15.146:0/1916733926 conn(0x7f9a700b1460 msgr2=0x7f9a700b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:20.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 -- 172.21.15.146:0/1916733926 shutdown_connections 2024-04-24T23:10:20.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.662+0000 7f9a6fe00640 1 -- 172.21.15.146:0/1916733926 wait complete. 2024-04-24T23:10:20.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.664+0000 7f9a6fe00640 1 Processor -- start 2024-04-24T23:10:20.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.664+0000 7f9a6fe00640 1 -- start start 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 0x7f9a701566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a70155630 0x7f9a70157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a700ce760 con 0x7f9a54003a50 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a700ce5e0 con 0x7f9a70155630 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a700722f0 con 0x7f9a7015b8f0 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33648/0 (socket says 172.21.15.146:33648) 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a6ea00640 1 -- 172.21.15.146:0/3066915291 learned_addr learned my addr 172.21.15.146:0/3066915291 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.665+0000 7f9a67e00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 0x7f9a701566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6f400640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a70155630 0x7f9a70157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 -- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 msgr2=0x7f9a701566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 0x7f9a701566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 -- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a70155630 msgr2=0x7f9a70157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a70155630 0x7f9a70157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 -- 172.21.15.146:0/3066915291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a701e7da0 con 0x7f9a54003a50 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a67e00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 0x7f9a701566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6ea00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001840 tx=0x7f9a60001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60037040 con 0x7f9a54003a50 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a60005480 con 0x7f9a54003a50 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60007a30 con 0x7f9a54003a50 2024-04-24T23:10:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a701e8080 con 0x7f9a54003a50 2024-04-24T23:10:20.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.666+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a70159f30 con 0x7f9a54003a50 2024-04-24T23:10:20.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.668+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7004f500 con 0x7f9a54003a50 2024-04-24T23:10:20.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.669+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a60044020 con 0x7f9a54003a50 2024-04-24T23:10:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.669+0000 7f9a66a00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 0x7f9a4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.669+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5749+0+0 (secure 0 0 0) 0x7f9a600aa900 con 0x7f9a54003a50 2024-04-24T23:10:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.670+0000 7f9a67e00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 0x7f9a4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:20.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.671+0000 7f9a67e00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 0x7f9a4c06e320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9a701590b0 tx=0x7f9a58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:20.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.674+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a6004b020 con 0x7f9a54003a50 2024-04-24T23:10:20.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:20.883+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a7015bcd0 con 0x7f9a54003a50 2024-04-24T23:10:21.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.453+0000 7f9a66a00640 1 -- 172.21.15.146:0/3066915291 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7f9a60079280 con 0x7f9a54003a50 2024-04-24T23:10:21.455 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-04-24T23:10:21.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.457+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 msgr2=0x7f9a4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.457+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 0x7f9a4c06e320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9a701590b0 tx=0x7f9a58008040 comp rx=0 tx=0).stop 2024-04-24T23:10:21.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.458+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 msgr2=0x7f9a701e7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.458+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001840 tx=0x7f9a60001120 comp rx=0 tx=0).stop 2024-04-24T23:10:21.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 shutdown_connections 2024-04-24T23:10:21.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a70155630 0x7f9a70157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f9a4c06be60 0x7f9a4c06e320 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a7015b8f0 0x7f9a701566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 --2- 172.21.15.146:0/3066915291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a54003a50 0x7f9a701e7710 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.461+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 >> 172.21.15.146:0/3066915291 conn(0x7f9a700b1460 msgr2=0x7f9a7006e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:21.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.462+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 shutdown_connections 2024-04-24T23:10:21.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.462+0000 7f9a6fe00640 1 -- 172.21.15.146:0/3066915291 wait complete. 2024-04-24T23:10:21.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-24T23:10:21.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.667+0000 7f68c3200640 1 Processor -- start 2024-04-24T23:10:21.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.667+0000 7f68c3200640 1 -- start start 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68c3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68bc162260 0x7f68bc168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68c3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68bc0b4880 con 0x7f68bc06ef30 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68c3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68bc0b4b60 con 0x7f68bc0afbd0 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68c3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f68bc0b5120 con 0x7f68bc162260 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68bb400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f68bc06ef30 0x7f68bc161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53102/0 (socket says 172.21.15.146:53102) 2024-04-24T23:10:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68bb400640 1 -- 172.21.15.146:0/1803786150 learned_addr learned my addr 172.21.15.146:0/1803786150 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.669+0000 7f68c1200640 1 --2- 172.21.15.146:0/1803786150 >> v2:172.21.15.146:3300/0 conn(0x7f68bc162260 0x7f68bc168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.670+0000 7f68c1200640 1 -- 172.21.15.146:0/1803786150 >> v1:172.21.15.203:6789/0 conn(0x7f68bc0afbd0 legacy=0x7f68bc0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.670+0000 7f68c1200640 1 -- 172.21.15.146:0/1803786150 >> v1:172.21.15.146:6789/0 conn(0x7f68bc06ef30 legacy=0x7f68bc161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.670+0000 7f68baa00640 1 -- 172.21.15.146:0/1803786150 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252979489 0 0) 0x7f68bc0b4880 con 0x7f68bc06ef30 2024-04-24T23:10:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.670+0000 7f68c1200640 1 -- 172.21.15.146:0/1803786150 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc0b4e40 con 0x7f68bc162260 2024-04-24T23:10:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.671+0000 7f68c1200640 1 --2- 172.21.15.146:0/1803786150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc162260 0x7f68bc168ee0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009dc0 tx=0x7f68b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37259ee2312e90d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68baa00640 1 -- 172.21.15.146:0/1803786150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007740 con 0x7f68bc162260 2024-04-24T23:10:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68baa00640 1 -- 172.21.15.146:0/1803786150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b40078e0 con 0x7f68bc162260 2024-04-24T23:10:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68baa00640 1 -- 172.21.15.146:0/1803786150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007cb0 con 0x7f68bc162260 2024-04-24T23:10:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 -- 172.21.15.146:0/1803786150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc162260 msgr2=0x7f68bc168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 --2- 172.21.15.146:0/1803786150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc162260 0x7f68bc168ee0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009dc0 tx=0x7f68b402a6a0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 -- 172.21.15.146:0/1803786150 shutdown_connections 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 --2- 172.21.15.146:0/1803786150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc162260 0x7f68bc168ee0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 -- 172.21.15.146:0/1803786150 >> 172.21.15.146:0/1803786150 conn(0x7f68bc0b2570 msgr2=0x7f68bc0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 -- 172.21.15.146:0/1803786150 shutdown_connections 2024-04-24T23:10:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.672+0000 7f68c3200640 1 -- 172.21.15.146:0/1803786150 wait complete. 2024-04-24T23:10:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.674+0000 7f68c3200640 1 Processor -- start 2024-04-24T23:10:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.674+0000 7f68c3200640 1 -- start start 2024-04-24T23:10:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68bc0afbd0 0x7f68bc157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68bc162260 0x7f68bc0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc06c970 con 0x7f68bc06ef30 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc06c7f0 con 0x7f68bc162260 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68c3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f68bc169420 con 0x7f68bc0afbd0 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.675+0000 7f68bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33674/0 (socket says 172.21.15.146:33674) 2024-04-24T23:10:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 -- 172.21.15.146:0/1139192595 learned_addr learned my addr 172.21.15.146:0/1139192595 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 -- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68bc0afbd0 msgr2=0x7f68bc157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68bc0afbd0 0x7f68bc157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 -- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68bc162260 msgr2=0x7f68bc0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68c1200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68bc162260 0x7f68bc0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68bc162260 0x7f68bc0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 -- 172.21.15.146:0/1139192595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc1513b0 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.676+0000 7f68bbe00640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c450 tx=0x7f68ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.677+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0052d0 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.677+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac005470 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.677+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac012870 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.677+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68bc0ce170 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.677+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68bc0ce730 con 0x7f68bc06ef30 2024-04-24T23:10:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.678+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68bc04f5a0 con 0x7f68bc06ef30 2024-04-24T23:10:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.679+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68ac012a10 con 0x7f68bc06ef30 2024-04-24T23:10:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.680+0000 7f68b3e00640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.680+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f68ac08a890 con 0x7f68bc06ef30 2024-04-24T23:10:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.681+0000 7f68bb400640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.682+0000 7f68bb400640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 0x7f689806e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f68a4000c00 tx=0x7f68a40079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:21.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.684+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f68ac059440 con 0x7f68bc06ef30 2024-04-24T23:10:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.882+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f68bc15f970 con 0x7f68bc06ef30 2024-04-24T23:10:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.889+0000 7f68b3e00640 1 -- 172.21.15.146:0/1139192595 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f68ac058d40 con 0x7f68bc06ef30 2024-04-24T23:10:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 msgr2=0x7f689806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 0x7f689806e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f68a4000c00 tx=0x7f68a40079c0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 msgr2=0x7f68bc154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c450 tx=0x7f68ac00c910 comp rx=0 tx=0).stop 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 shutdown_connections 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68bc162260 0x7f68bc0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f689806be30 0x7f689806e2f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68bc0afbd0 0x7f68bc157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 --2- 172.21.15.146:0/1139192595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68bc06ef30 0x7f68bc154b00 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 >> 172.21.15.146:0/1139192595 conn(0x7f68bc0b2570 msgr2=0x7f68bc15ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 shutdown_connections 2024-04-24T23:10:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:21.892+0000 7f68c3200640 1 -- 172.21.15.146:0/1139192595 wait complete. 2024-04-24T23:10:21.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-04-24T23:10:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.110+0000 7f37b3200640 1 Processor -- start 2024-04-24T23:10:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.110+0000 7f37b3200640 1 -- start start 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37b41561c0 0x7f37b40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b4070f90 con 0x7f37b40709d0 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f37b40b4310 con 0x7f37b41561c0 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f37b41565a0 con 0x7f37b40d0240 2024-04-24T23:10:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37b41561c0 0x7f37b40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b1400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37b40709d0 0x7f37b40cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53114/0 (socket says 172.21.15.146:53114) 2024-04-24T23:10:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b1400640 1 -- 172.21.15.146:0/3992320171 learned_addr learned my addr 172.21.15.146:0/3992320171 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.112+0000 7f37b0a00640 1 -- 172.21.15.146:0/3992320171 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859321252 0 0) 0x7f37b4070f90 con 0x7f37b40709d0 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.113+0000 7f37b1e00640 1 -- 172.21.15.146:0/3992320171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 msgr2=0x7f37b415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.113+0000 7f37b2800640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.113+0000 7f37b1e00640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.113+0000 7f37b1e00640 1 -- 172.21.15.146:0/3992320171 >> v1:172.21.15.146:6789/0 conn(0x7f37b40709d0 legacy=0x7f37b40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.113+0000 7f37b1e00640 1 -- 172.21.15.146:0/3992320171 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b4071270 con 0x7f37b41561c0 2024-04-24T23:10:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.114+0000 7f37b1e00640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b40cdbf0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f37a40097a0 tx=0x7f37a402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9453febfddddc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.114+0000 7f37b0a00640 1 -- 172.21.15.146:0/3992320171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4037070 con 0x7f37b41561c0 2024-04-24T23:10:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.114+0000 7f37b0a00640 1 -- 172.21.15.146:0/3992320171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a402adb0 con 0x7f37b41561c0 2024-04-24T23:10:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.114+0000 7f37b0a00640 1 -- 172.21.15.146:0/3992320171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4032660 con 0x7f37b41561c0 2024-04-24T23:10:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 -- 172.21.15.146:0/3992320171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 msgr2=0x7f37b40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b40cdbf0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f37a40097a0 tx=0x7f37a402a060 comp rx=0 tx=0).stop 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 -- 172.21.15.146:0/3992320171 shutdown_connections 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 --2- 172.21.15.146:0/3992320171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b40cdbf0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 -- 172.21.15.146:0/3992320171 >> 172.21.15.146:0/3992320171 conn(0x7f37b406b320 msgr2=0x7f37b406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 -- 172.21.15.146:0/3992320171 shutdown_connections 2024-04-24T23:10:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.115+0000 7f37b3200640 1 -- 172.21.15.146:0/3992320171 wait complete. 2024-04-24T23:10:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.117+0000 7f37b3200640 1 Processor -- start 2024-04-24T23:10:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.117+0000 7f37b3200640 1 -- start start 2024-04-24T23:10:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37b40709d0 0x7f37b4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b4148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f37b40b2c20 con 0x7f37b41561c0 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37b4071830 con 0x7f37b40709d0 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f37b40b2da0 con 0x7f37b40d0240 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33698/0 (socket says 172.21.15.146:33698) 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.118+0000 7f37b2800640 1 -- 172.21.15.146:0/2248246349 learned_addr learned my addr 172.21.15.146:0/2248246349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b1e00640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37b40709d0 0x7f37b4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b1400640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b4148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 -- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 msgr2=0x7f37b4148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b4148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 -- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37b40709d0 msgr2=0x7f37b4152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37b40709d0 0x7f37b4152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 -- 172.21.15.146:0/2248246349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b4151970 con 0x7f37b41561c0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b2800640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cd70 tx=0x7f37ac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac003b90 con 0x7f37b41561c0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac003d30 con 0x7f37b41561c0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b4151c50 con 0x7f37b41561c0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac004240 con 0x7f37b41561c0 2024-04-24T23:10:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.119+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b4152210 con 0x7f37b41561c0 2024-04-24T23:10:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.121+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b404f500 con 0x7f37b41561c0 2024-04-24T23:10:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.121+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37ac0043e0 con 0x7f37b41561c0 2024-04-24T23:10:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.122+0000 7f37aa000640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 0x7f379406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.122+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f37ac08b920 con 0x7f37b41561c0 2024-04-24T23:10:22.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.123+0000 7f37b1e00640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 0x7f379406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:22.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.124+0000 7f37b1e00640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 0x7f379406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f37a4034000 tx=0x7f37a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.126+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f37ac05a310 con 0x7f37b41561c0 2024-04-24T23:10:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.397+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) -- 0x7f37b41557c0 con 0x7f37b41561c0 2024-04-24T23:10:22.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.463+0000 7f37aa000640 1 -- 172.21.15.146:0/2248246349 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v466) ==== 155+0+0 (secure 0 0 0) 0x7f37ac059c10 con 0x7f37b41561c0 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 msgr2=0x7f379406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 0x7f379406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f37a4034000 tx=0x7f37a402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 msgr2=0x7f37b4150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cd70 tx=0x7f37ac00a660 comp rx=0 tx=0).stop 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 shutdown_connections 2024-04-24T23:10:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37b41561c0 0x7f37b4150f20 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f379406be30 0x7f379406e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f37b40d0240 0x7f37b4148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 --2- 172.21.15.146:0/2248246349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37b40709d0 0x7f37b4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 >> 172.21.15.146:0/2248246349 conn(0x7f37b406b320 msgr2=0x7f37b40723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 shutdown_connections 2024-04-24T23:10:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:22.467+0000 7f37b3200640 1 -- 172.21.15.146:0/2248246349 wait complete. 2024-04-24T23:10:22.490 INFO:tasks.cephfs_test_runner:test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-04-24T23:10:22.490 INFO:tasks.cephfs_test_runner: 2024-04-24T23:10:22.491 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-24T23:10:22.491 INFO:tasks.cephfs_test_runner:Ran 5 tests in 561.530s 2024-04-24T23:10:22.491 INFO:tasks.cephfs_test_runner: 2024-04-24T23:10:22.491 INFO:tasks.cephfs_test_runner:OK 2024-04-24T23:10:22.491 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-24T23:10:22.502 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-24T23:10:22.512 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-24T23:10:22.513 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:22.513 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:22.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:10:22.565 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-24T23:10:22.565 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:22.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052733,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249000k,nr_inodes=812250,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498004k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-24T23:10:22.617 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:10:22.617 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:22.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:10:22.676 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-24T23:10:22.676 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:10:22.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052713,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-24T23:10:22.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:22.729 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:10:22.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:10:22.787 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-24T23:10:22.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:22.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:10:22.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:22.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-24T23:10:22.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:22.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-04-24T23:10:23.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.059 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-04-24T23:10:23.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-04-24T23:10:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-04-24T23:10:23.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:10:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.226 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:10:23.283 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:10:23.283 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-24T23:10:23.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:10:23.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.370 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-24T23:10:23.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.440 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-24T23:10:23.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.564 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-24T23:10:23.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:10:23.605 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-24T23:10:23.718 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-24T23:10:23.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:10:23.721 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T23:10:23.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:10:23.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:23.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.941+0000 7fbefd000640 1 Processor -- start 2024-04-24T23:10:23.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.941+0000 7fbefd000640 1 -- start start 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.942+0000 7fbefd000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbef80cfda0 0x7fbef81638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.942+0000 7fbefd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 0x7fbef8161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.942+0000 7fbefd000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef8163e10 con 0x7fbef8072560 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.942+0000 7fbefd000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbef8072cc0 con 0x7fbef80cfda0 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.942+0000 7fbefd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80cf4b0 con 0x7fbef80d0180 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbeeea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbef8072560 0x7fbef8163190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53126/0 (socket says 172.21.15.146:53126) 2024-04-24T23:10:23.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbeeea00640 1 -- 172.21.15.146:0/3222250924 learned_addr learned my addr 172.21.15.146:0/3222250924 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbef7400640 1 --2- 172.21.15.146:0/3222250924 >> v2:172.21.15.203:3300/0 conn(0x7fbef80cfda0 0x7fbef81638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664815029 0 0) 0x7fbef8163e10 con 0x7fbef8072560 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc003520 con 0x7fbef8072560 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.943+0000 7fbef7e00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 0x7fbef8161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 463365547 0 0) 0x7fbedc003520 con 0x7fbef8072560 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 msgr2=0x7fbef8161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 0x7fbef8161be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 >> v2:172.21.15.203:3300/0 conn(0x7fbef80cfda0 msgr2=0x7fbef81638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 --2- 172.21.15.146:0/3222250924 >> v2:172.21.15.203:3300/0 conn(0x7fbef80cfda0 0x7fbef81638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef8070b00 con 0x7fbef8072560 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fbee8001670 con 0x7fbef8072560 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 >> v1:172.21.15.146:6789/0 conn(0x7fbef8072560 legacy=0x7fbef8163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 0x7fbedc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc003fe0 0x7fbedc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc004d40 0x7fbedc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8072cc0 con 0x7fbedc003fe0 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80cf4b0 con 0x7fbedc004d40 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc00bc30 con 0x7fbef80d0180 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbef7400640 1 --2- 172.21.15.146:0/3222250924 >> v2:172.21.15.203:3300/0 conn(0x7fbef80cfda0 0x7fbef81638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbeeea00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc003fe0 0x7fbedc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbeeea00640 1 -- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 msgr2=0x7fbedc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbeeea00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80d0180 0x7fbedc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbeeea00640 1 -- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc004d40 msgr2=0x7fbedc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:23.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.944+0000 7fbeeea00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc004d40 0x7fbedc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.945+0000 7fbeeea00640 1 -- 172.21.15.146:0/3222250924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc003520 con 0x7fbedc003fe0 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbeeea00640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc003fe0 0x7fbedc004800 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c210 tx=0x7fbedc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771632e54877e93d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8007d50 con 0x7fbedc003fe0 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8005af0 con 0x7fbedc003fe0 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbef6a00640 1 -- 172.21.15.146:0/3222250924 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8007070 con 0x7fbedc003fe0 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbefd000640 1 -- 172.21.15.146:0/3222250924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc003fe0 msgr2=0x7fbedc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbefd000640 1 --2- 172.21.15.146:0/3222250924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc003fe0 0x7fbedc004800 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c210 tx=0x7fbedc005830 comp rx=0 tx=0).stop 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.946+0000 7fbef7e00640 1 -- 172.21.15.146:0/3222250924 reap_dead start 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.947+0000 7fbefd000640 1 -- 172.21.15.146:0/3222250924 shutdown_connections 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.947+0000 7fbefd000640 1 -- 172.21.15.146:0/3222250924 >> 172.21.15.146:0/3222250924 conn(0x7fbef806b320 msgr2=0x7fbef806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.947+0000 7fbefd000640 1 -- 172.21.15.146:0/3222250924 shutdown_connections 2024-04-24T23:10:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.947+0000 7fbefd000640 1 -- 172.21.15.146:0/3222250924 wait complete. 2024-04-24T23:10:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.948+0000 7fbefd000640 1 Processor -- start 2024-04-24T23:10:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.949+0000 7fbefd000640 1 -- start start 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc003fe0 0x7fbef8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80aa250 0x7fbef806d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8161be0 con 0x7fbef806de80 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8070da0 con 0x7fbedc003fe0 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbefd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbef8161d60 con 0x7fbef80aa250 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33730/0 (socket says 172.21.15.146:33730) 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 -- 172.21.15.146:0/3339336349 learned_addr learned my addr 172.21.15.146:0/3339336349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7400640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc003fe0 0x7fbef8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbeeea00640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80aa250 0x7fbef806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 -- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80aa250 msgr2=0x7fbef806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80aa250 0x7fbef806d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 -- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc003fe0 msgr2=0x7fbef8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc003fe0 0x7fbef8150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.950+0000 7fbef7e00640 1 -- 172.21.15.146:0/3339336349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef80a94b0 con 0x7fbef806de80 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbef7e00640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fbef80d0630 tx=0x7fbef000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000edc0 con 0x7fbef806de80 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef0019070 con 0x7fbef806de80 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef815dc00 con 0x7fbef806de80 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0014660 con 0x7fbef806de80 2024-04-24T23:10:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.951+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef80a9a50 con 0x7fbef806de80 2024-04-24T23:10:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.952+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef804f500 con 0x7fbef806de80 2024-04-24T23:10:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.953+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef0014800 con 0x7fbef806de80 2024-04-24T23:10:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.954+0000 7fbeefe00640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 0x7fbed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.954+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7fbef008b0f0 con 0x7fbef806de80 2024-04-24T23:10:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.955+0000 7fbef7400640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 0x7fbed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.956+0000 7fbef7400640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 0x7fbed406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbee0004790 tx=0x7fbee0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:23.959+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbef0059ae0 con 0x7fbef806de80 2024-04-24T23:10:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.153+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbef806cf60 con 0x7fbed406be30 2024-04-24T23:10:24.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.155+0000 7fbeefe00640 1 -- 172.21.15.146:0/3339336349 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13506 (secure 0 0 0) 0x7fbef806cf60 con 0x7fbed406be30 2024-04-24T23:10:24.157 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:24.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 msgr2=0x7fbed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 0x7fbed406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbee0004790 tx=0x7fbee0008040 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 msgr2=0x7fbef815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fbef80d0630 tx=0x7fbef000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 shutdown_connections 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef806de80 0x7fbef815cf40 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fbed406be30 0x7fbed406e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbef80aa250 0x7fbef806d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 --2- 172.21.15.146:0/3339336349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbedc003fe0 0x7fbef8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 >> 172.21.15.146:0/3339336349 conn(0x7fbef806b320 msgr2=0x7fbef81638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.158+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 shutdown_connections 2024-04-24T23:10:24.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.159+0000 7fbefd000640 1 -- 172.21.15.146:0/3339336349 wait complete. 2024-04-24T23:10:24.177 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-04-24T23:10:23.825064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260040,"kb_used_data":10584,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714680,"statfs":{"total":773094113280,"available":772827832320,"internally_reserved":0,"allocated":10838016,"data_stored":5621899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3796,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001951"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-24T23:10:21.458758+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:10:21.458758+0000","last_peered":"2024-04-24T23:10:21.458758+0000","last_clean":"2024-04-24T23:10:21.458758+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:10:21.458758+0000","last_undegraded":"2024-04-24T23:10:21.458758+0000","last_fullsized":"2024-04-24T23:10:21.458758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509570,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509571,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509570,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542275,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1785856,"data_stored":1140301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:24.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:24.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.381+0000 7f7210a00640 1 Processor -- start 2024-04-24T23:10:24.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.381+0000 7f7210a00640 1 -- start start 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7210a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f720c158590 0x7f720c162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7210a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0715f0 0x7f720c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7210a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720c162990 con 0x7f720c0cfc90 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7210a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f720c158970 con 0x7f720c158590 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7210a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f720c070c10 con 0x7f720c0715f0 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7209e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f720c158590 0x7f720c162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7209e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f720c158590 0x7f720c162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33740/0 (socket says 172.21.15.146:33740) 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.383+0000 7f7209e00640 1 -- 172.21.15.146:0/2952505354 learned_addr learned my addr 172.21.15.146:0/2952505354 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.384+0000 7f7209400640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0715f0 0x7f720c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.384+0000 7f7209e00640 1 -- 172.21.15.146:0/2952505354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0715f0 msgr2=0x7f720c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.384+0000 7f7209e00640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0715f0 0x7f720c071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.384+0000 7f7209e00640 1 -- 172.21.15.146:0/2952505354 >> v1:172.21.15.203:6789/0 conn(0x7f720c0cfc90 legacy=0x7f720c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.384+0000 7f7209e00640 1 -- 172.21.15.146:0/2952505354 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c070ef0 con 0x7f720c158590 2024-04-24T23:10:24.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.386+0000 7f7209e00640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c158590 0x7f720c162450 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b193657bcf78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.386+0000 7f7208a00640 1 -- 172.21.15.146:0/2952505354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc037070 con 0x7f720c158590 2024-04-24T23:10:24.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.386+0000 7f7208a00640 1 -- 172.21.15.146:0/2952505354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc02ae50 con 0x7f720c158590 2024-04-24T23:10:24.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.386+0000 7f7208a00640 1 -- 172.21.15.146:0/2952505354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc032860 con 0x7f720c158590 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 -- 172.21.15.146:0/2952505354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c158590 msgr2=0x7f720c162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c158590 0x7f720c162450 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc02a300 comp rx=0 tx=0).stop 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 -- 172.21.15.146:0/2952505354 shutdown_connections 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0715f0 0x7f720c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 --2- 172.21.15.146:0/2952505354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c158590 0x7f720c162450 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 -- 172.21.15.146:0/2952505354 >> 172.21.15.146:0/2952505354 conn(0x7f720c06b320 msgr2=0x7f720c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 -- 172.21.15.146:0/2952505354 shutdown_connections 2024-04-24T23:10:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.387+0000 7f7210a00640 1 -- 172.21.15.146:0/2952505354 wait complete. 2024-04-24T23:10:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.389+0000 7f7210a00640 1 Processor -- start 2024-04-24T23:10:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.389+0000 7f7210a00640 1 -- start start 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.390+0000 7f7210a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7210a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0cfc90 0x7f720c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7210a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 0x7f720c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7210a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f720c161f30 con 0x7f720c0715f0 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7210a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f720c161c50 con 0x7f720c158590 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7210a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f720c0d0120 con 0x7f720c0cfc90 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33754/0 (socket says 172.21.15.146:33754) 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 -- 172.21.15.146:0/3727338870 learned_addr learned my addr 172.21.15.146:0/3727338870 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f720a800640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 0x7f720c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209400640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0cfc90 0x7f720c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 -- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0cfc90 msgr2=0x7f720c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0cfc90 0x7f720c0b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 -- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 msgr2=0x7f720c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 0x7f720c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f7209e00640 1 -- 172.21.15.146:0/3727338870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c1fbdf0 con 0x7f720c0715f0 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.391+0000 7f720a800640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 0x7f720c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.392+0000 7f7209e00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.392+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc042070 con 0x7f720c0715f0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.392+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc03e670 con 0x7f720c0715f0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.392+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc037040 con 0x7f720c0715f0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.392+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c1fc0d0 con 0x7f720c0715f0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.393+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c1fc690 con 0x7f720c0715f0 2024-04-24T23:10:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.394+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720c068190 con 0x7f720c0715f0 2024-04-24T23:10:24.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.395+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71fc045070 con 0x7f720c0715f0 2024-04-24T23:10:24.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.396+0000 7f7202000640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.396+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f71fc0ab660 con 0x7f720c0715f0 2024-04-24T23:10:24.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.396+0000 7f7209400640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.397+0000 7f7209400640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 0x7f71ec06e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f720c0b0ef0 tx=0x7f71f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.402+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f71fc07a0e0 con 0x7f720c0715f0 2024-04-24T23:10:24.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.600+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f720c0b1e70 con 0x7f71ec06be30 2024-04-24T23:10:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.603+0000 7f7202000640 1 -- 172.21.15.146:0/3727338870 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13506 (secure 0 0 0) 0x7f720c0b1e70 con 0x7f71ec06be30 2024-04-24T23:10:24.604 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 msgr2=0x7f71ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 0x7f71ec06e2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f720c0b0ef0 tx=0x7f71f8008040 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 msgr2=0x7f720c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 shutdown_connections 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f720c158590 0x7f720c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f720c0cfc90 0x7f720c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 --2- 172.21.15.146:0/3727338870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f720c0715f0 0x7f720c0ce460 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 >> 172.21.15.146:0/3727338870 conn(0x7f720c06b320 msgr2=0x7f720c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 shutdown_connections 2024-04-24T23:10:24.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.605+0000 7f7210a00640 1 -- 172.21.15.146:0/3727338870 wait complete. 2024-04-24T23:10:24.625 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-04-24T23:10:23.825064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260040,"kb_used_data":10584,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714680,"statfs":{"total":773094113280,"available":772827832320,"internally_reserved":0,"allocated":10838016,"data_stored":5621899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3796,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001951"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-24T23:10:21.458758+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:10:21.458758+0000","last_peered":"2024-04-24T23:10:21.458758+0000","last_clean":"2024-04-24T23:10:21.458758+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:10:21.458758+0000","last_undegraded":"2024-04-24T23:10:21.458758+0000","last_fullsized":"2024-04-24T23:10:21.458758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509570,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509571,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509570,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542275,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1785856,"data_stored":1140301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:24.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:10:24.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:24.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.823+0000 7f3eb9c00640 1 Processor -- start 2024-04-24T23:10:24.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.823+0000 7f3eb9c00640 1 -- start start 2024-04-24T23:10:24.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.824+0000 7f3eb9c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3eb415e5b0 0x7f3eb40b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.824+0000 7f3eb9c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb40d4bc0 con 0x7f3eb40d06e0 2024-04-24T23:10:24.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.824+0000 7f3eb9c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb40cf5b0 con 0x7f3eb40b2dc0 2024-04-24T23:10:24.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb9c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb40d48e0 con 0x7f3eb415e5b0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3eb40d06e0 0x7f3eb415dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53130/0 (socket says 172.21.15.146:53130) 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb3e00640 1 -- 172.21.15.146:0/1546118329 learned_addr learned my addr 172.21.15.146:0/1546118329 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1546118329 >> v2:172.21.15.203:3300/0 conn(0x7f3eb415e5b0 0x7f3eb40b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749141375 0 0) 0x7f3eb40d4bc0 con 0x7f3eb40d06e0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.825+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e98003520 con 0x7f3eb40d06e0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2535522634 0 0) 0x7f3e98003520 con 0x7f3eb40d06e0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 >> v2:172.21.15.203:3300/0 conn(0x7f3eb415e5b0 msgr2=0x7f3eb40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 --2- 172.21.15.146:0/1546118329 >> v2:172.21.15.203:3300/0 conn(0x7f3eb415e5b0 0x7f3eb40b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 >> v1:172.21.15.203:6789/0 conn(0x7f3eb40b2dc0 legacy=0x7f3eb40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb40cf850 con 0x7f3eb40d06e0 2024-04-24T23:10:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f3ea4001670 con 0x7f3eb40d06e0 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 >> v1:172.21.15.146:6789/0 conn(0x7f3eb40d06e0 legacy=0x7f3eb415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e98003a00 0x7f3e98003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98004800 0x7f3e98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 0x7f3e9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb40d48e0 con 0x7f3e98005210 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9800c140 con 0x7f3e98004800 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9800c340 con 0x7f3e98003a00 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb9200640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 0x7f3e9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.826+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98004800 0x7f3e98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb3e00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e98003a00 0x7f3e98003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb9200640 1 -- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e98003a00 msgr2=0x7f3e98003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb9200640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e98003a00 0x7f3e98003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb9200640 1 -- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98004800 msgr2=0x7f3e98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb9200640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98004800 0x7f3e98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb9200640 1 -- 172.21.15.146:0/1546118329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e98003520 con 0x7f3e98005210 2024-04-24T23:10:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.827+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98004800 0x7f3e98004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb9200640 1 -- 172.21.15.146:0/1546118329 reap_dead start 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb9200640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 0x7f3e9800b9c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b3270 tx=0x7f3e98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f341a894edef23 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac004080 con 0x7f3e98005210 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac006d70 con 0x7f3e98005210 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb2a00640 1 -- 172.21.15.146:0/1546118329 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac02ad70 con 0x7f3e98005210 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 msgr2=0x7f3e9800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.828+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 0x7f3e9800b9c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b3270 tx=0x7f3e98005830 comp rx=0 tx=0).stop 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.829+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1546118329 shutdown_connections 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.829+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1546118329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e98005210 0x7f3e9800b9c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.829+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1546118329 >> 172.21.15.146:0/1546118329 conn(0x7f3eb40d3d20 msgr2=0x7f3eb40d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.829+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1546118329 shutdown_connections 2024-04-24T23:10:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.829+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1546118329 wait complete. 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.830+0000 7f3eb9c00640 1 Processor -- start 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 -- start start 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 0x7f3eb415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3eb406cd40 0x7f3eb40cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb40d2e40 con 0x7f3eb41f4330 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb40d2cc0 con 0x7f3e98005210 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.831+0000 7f3eb9c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb40d0ac0 con 0x7f3eb406cd40 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33764/0 (socket says 172.21.15.146:33764) 2024-04-24T23:10:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 -- 172.21.15.146:0/1196614131 learned_addr learned my addr 172.21.15.146:0/1196614131 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3e00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 0x7f3eb415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb9200640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3eb406cd40 0x7f3eb40cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 -- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3eb406cd40 msgr2=0x7f3eb40cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3eb406cd40 0x7f3eb40cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 -- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 msgr2=0x7f3eb415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 0x7f3eb415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3400640 1 -- 172.21.15.146:0/1196614131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb40cd300 con 0x7f3eb41f4330 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.832+0000 7f3eb3e00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 0x7f3eb415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eb3400640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000e810 tx=0x7f3ea000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0017070 con 0x7f3eb41f4330 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea000c6d0 con 0x7f3eb41f4330 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb40cd5e0 con 0x7f3eb41f4330 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000f040 con 0x7f3eb41f4330 2024-04-24T23:10:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.833+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb40cdba0 con 0x7f3eb41f4330 2024-04-24T23:10:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.834+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb406d150 con 0x7f3eb41f4330 2024-04-24T23:10:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.835+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ea001a070 con 0x7f3eb41f4330 2024-04-24T23:10:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.836+0000 7f3eabe00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 0x7f3e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.836+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f3ea008a910 con 0x7f3eb41f4330 2024-04-24T23:10:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.837+0000 7f3eb3e00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 0x7f3e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.838+0000 7f3eb3e00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 0x7f3e9406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4001e70 tx=0x7f3ea4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:24.840+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3eb406d150 con 0x7f3eb41f4330 2024-04-24T23:10:25.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.037+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3eb404f500 con 0x7f3e9406be30 2024-04-24T23:10:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.040+0000 7f3eabe00640 1 -- 172.21.15.146:0/1196614131 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13506 (secure 0 0 0) 0x7f3eb404f500 con 0x7f3e9406be30 2024-04-24T23:10:25.041 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 msgr2=0x7f3e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 0x7f3e9406e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4001e70 tx=0x7f3ea4009040 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 msgr2=0x7f3eb406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000e810 tx=0x7f3ea000ecd0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 shutdown_connections 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3e9406be30 0x7f3e9406e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3eb406cd40 0x7f3eb40cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eb41f4330 0x7f3eb406c800 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 --2- 172.21.15.146:0/1196614131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e98005210 0x7f3eb415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.042+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 >> 172.21.15.146:0/1196614131 conn(0x7f3eb40d3d20 msgr2=0x7f3eb415d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.043+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 shutdown_connections 2024-04-24T23:10:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.043+0000 7f3eb9c00640 1 -- 172.21.15.146:0/1196614131 wait complete. 2024-04-24T23:10:25.062 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-04-24T23:10:23.825064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260040,"kb_used_data":10584,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714680,"statfs":{"total":773094113280,"available":772827832320,"internally_reserved":0,"allocated":10838016,"data_stored":5621899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3796,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001951"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-24T23:10:21.458758+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:10:21.458758+0000","last_peered":"2024-04-24T23:10:21.458758+0000","last_clean":"2024-04-24T23:10:21.458758+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:10:21.458758+0000","last_undegraded":"2024-04-24T23:10:21.458758+0000","last_fullsized":"2024-04-24T23:10:21.458758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509570,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509571,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509571,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509572,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509570,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542275,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1785856,"data_stored":1140301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:25.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:10:25.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.261+0000 7f168be00640 1 Processor -- start 2024-04-24T23:10:25.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.261+0000 7f168be00640 1 -- start start 2024-04-24T23:10:25.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f168c15e2e0 0x7f168c0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c0d48c0 0x7f168c0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168c0d2f50 con 0x7f168c15e6c0 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f168c0d26b0 con 0x7f168c15e2e0 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f168c0cfe90 con 0x7f168c0d48c0 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f168c15e2e0 0x7f168c0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f168c15e2e0 0x7f168c0d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33768/0 (socket says 172.21.15.146:33768) 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168aa00640 1 -- 172.21.15.146:0/883823560 learned_addr learned my addr 172.21.15.146:0/883823560 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f1682000640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c0d48c0 0x7f168c0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168aa00640 1 -- 172.21.15.146:0/883823560 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c0d48c0 msgr2=0x7f168c0d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.263+0000 7f168aa00640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c0d48c0 0x7f168c0d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.264+0000 7f168aa00640 1 -- 172.21.15.146:0/883823560 >> v1:172.21.15.203:6789/0 conn(0x7f168c15e6c0 legacy=0x7f168c0ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.264+0000 7f168aa00640 1 -- 172.21.15.146:0/883823560 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c0d2330 con 0x7f168c15e2e0 2024-04-24T23:10:25.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.265+0000 7f168aa00640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c15e2e0 0x7f168c0d1ca0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627d62c6a1cbce26 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:25.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.265+0000 7f168a000640 1 -- 172.21.15.146:0/883823560 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c037070 con 0x7f168c15e2e0 2024-04-24T23:10:25.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.265+0000 7f168a000640 1 -- 172.21.15.146:0/883823560 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c02ae10 con 0x7f168c15e2e0 2024-04-24T23:10:25.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.265+0000 7f168a000640 1 -- 172.21.15.146:0/883823560 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c032660 con 0x7f168c15e2e0 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 -- 172.21.15.146:0/883823560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c15e2e0 msgr2=0x7f168c0d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c15e2e0 0x7f168c0d1ca0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f167c009870 tx=0x7f167c02a100 comp rx=0 tx=0).stop 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 -- 172.21.15.146:0/883823560 shutdown_connections 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c0d48c0 0x7f168c0d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 --2- 172.21.15.146:0/883823560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c15e2e0 0x7f168c0d1ca0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 -- 172.21.15.146:0/883823560 >> 172.21.15.146:0/883823560 conn(0x7f168c0d3da0 msgr2=0x7f168c0d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 -- 172.21.15.146:0/883823560 shutdown_connections 2024-04-24T23:10:25.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.266+0000 7f168be00640 1 -- 172.21.15.146:0/883823560 wait complete. 2024-04-24T23:10:25.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.267+0000 7f168be00640 1 Processor -- start 2024-04-24T23:10:25.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.268+0000 7f168be00640 1 -- start start 2024-04-24T23:10:25.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 0x7f168c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 0x7f168c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f168c0b8940 con 0x7f168c0d48c0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f168c0d2be0 con 0x7f168c15e6c0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f168c0b8ac0 con 0x7f168c15e2e0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33770/0 (socket says 172.21.15.146:33770) 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 -- 172.21.15.146:0/513005438 learned_addr learned my addr 172.21.15.146:0/513005438 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f1682000640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 0x7f168c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168b400640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 0x7f168c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 -- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 msgr2=0x7f168c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 0x7f168c0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 -- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 msgr2=0x7f168c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 0x7f168c160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168aa00640 1 -- 172.21.15.146:0/513005438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c0cd370 con 0x7f168c0d48c0 2024-04-24T23:10:25.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f168b400640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 0x7f168c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:25.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.269+0000 7f1682000640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 0x7f168c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:25.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f168aa00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f167c000c00 tx=0x7f167c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:25.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c041070 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c03c670 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c037040 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c0c7710 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.270+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c0c7cd0 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.271+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168c04f500 con 0x7f168c0d48c0 2024-04-24T23:10:25.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.272+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f167c044070 con 0x7f168c0d48c0 2024-04-24T23:10:25.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.273+0000 7f1683400640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 0x7f166806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:25.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.273+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f167c0ab660 con 0x7f168c0d48c0 2024-04-24T23:10:25.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.274+0000 7f1682000640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 0x7f166806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:25.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.275+0000 7f1682000640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 0x7f166806e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f168c1f7270 tx=0x7f1674008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:25.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.278+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f167c07a290 con 0x7f168c0d48c0 2024-04-24T23:10:25.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.480+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f168c06d330 con 0x7f168c0d48c0 2024-04-24T23:10:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.482+0000 7f1683400640 1 -- 172.21.15.146:0/513005438 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+13320 (secure 0 0 0) 0x7f167c079b90 con 0x7f168c0d48c0 2024-04-24T23:10:25.483 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:25.483 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":98,"fsid":"6a930041-393c-45a0-b3d3-8568bdacde7e","created":"2024-04-24T22:59:30.356456+0000","modified":"2024-04-24T23:10:21.442603+0000","last_up_change":"2024-04-24T22:59:42.483018+0000","last_in_change":"2024-04-24T22:59:33.641836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T22:59:43.648960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7bfdd19-10ad-47af-b27b-8ac9a3422e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6814","nonce":1520723108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6820","nonce":1520723108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6831","nonce":1520723108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":1520723108},{"type":"v1","addr":"172.21.15.146:6826","nonce":1520723108}]},"public_addr":"172.21.15.146:6814/1520723108","cluster_addr":"172.21.15.146:6820/1520723108","heartbeat_back_addr":"172.21.15.146:6831/1520723108","heartbeat_front_addr":"172.21.15.146:6826/1520723108","state":["exists","up"]},{"osd":1,"uuid":"238828a7-6d52-413e-9bee-f2a9a1094639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6801","nonce":2440725071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6803","nonce":2440725071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6807","nonce":2440725071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2440725071},{"type":"v1","addr":"172.21.15.146:6805","nonce":2440725071}]},"public_addr":"172.21.15.146:6801/2440725071","cluster_addr":"172.21.15.146:6803/2440725071","heartbeat_back_addr":"172.21.15.146:6807/2440725071","heartbeat_front_addr":"172.21.15.146:6805/2440725071","state":["exists","up"]},{"osd":2,"uuid":"4a942edf-7466-4679-860b-618c48d5e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6813","nonce":29852179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6819","nonce":29852179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6830","nonce":29852179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":29852179},{"type":"v1","addr":"172.21.15.146:6825","nonce":29852179}]},"public_addr":"172.21.15.146:6813/29852179","cluster_addr":"172.21.15.146:6819/29852179","heartbeat_back_addr":"172.21.15.146:6830/29852179","heartbeat_front_addr":"172.21.15.146:6825/29852179","state":["exists","up"]},{"osd":3,"uuid":"78236845-93e8-4d5f-8e17-88f4809d9dbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6810","nonce":1724749641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6815","nonce":1724749641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6827","nonce":1724749641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1724749641},{"type":"v1","addr":"172.21.15.146:6821","nonce":1724749641}]},"public_addr":"172.21.15.146:6810/1724749641","cluster_addr":"172.21.15.146:6815/1724749641","heartbeat_back_addr":"172.21.15.146:6827/1724749641","heartbeat_front_addr":"172.21.15.146:6821/1724749641","state":["exists","up"]},{"osd":4,"uuid":"f9ff459d-61ed-4c46-9db2-7dc0eb39d077","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6812","nonce":306347931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6815","nonce":306347931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6819","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6821","nonce":306347931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":306347931},{"type":"v1","addr":"172.21.15.203:6818","nonce":306347931}]},"public_addr":"172.21.15.203:6812/306347931","cluster_addr":"172.21.15.203:6815/306347931","heartbeat_back_addr":"172.21.15.203:6821/306347931","heartbeat_front_addr":"172.21.15.203:6818/306347931","state":["exists","up"]},{"osd":5,"uuid":"3ac8d24a-a4bf-48ba-a6ae-38e487d56c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6801","nonce":1152275008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6803","nonce":1152275008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6808","nonce":1152275008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1152275008},{"type":"v1","addr":"172.21.15.203:6805","nonce":1152275008}]},"public_addr":"172.21.15.203:6801/1152275008","cluster_addr":"172.21.15.203:6803/1152275008","heartbeat_back_addr":"172.21.15.203:6808/1152275008","heartbeat_front_addr":"172.21.15.203:6805/1152275008","state":["exists","up"]},{"osd":6,"uuid":"d82169d1-4d53-4a51-bcc6-8fafa822b739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6809","nonce":3736386787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6814","nonce":3736386787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6823","nonce":3736386787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":3736386787},{"type":"v1","addr":"172.21.15.203:6820","nonce":3736386787}]},"public_addr":"172.21.15.203:6809/3736386787","cluster_addr":"172.21.15.203:6814/3736386787","heartbeat_back_addr":"172.21.15.203:6823/3736386787","heartbeat_front_addr":"172.21.15.203:6820/3736386787","state":["exists","up"]},{"osd":7,"uuid":"ff36822a-47f2-4e33-85ed-9c36c6db612b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6825","nonce":1423940067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6827","nonce":1423940067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6831","nonce":1423940067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":1423940067},{"type":"v1","addr":"172.21.15.203:6829","nonce":1423940067}]},"public_addr":"172.21.15.203:6825/1423940067","cluster_addr":"172.21.15.203:6827/1423940067","heartbeat_back_addr":"172.21.15.203:6831/1423940067","heartbeat_front_addr":"172.21.15.203:6829/1423940067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.081995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.990719+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.694630+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.019813+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.838687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.562895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:38.975929+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:39.086624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.203:6837/1394221718":"2024-04-25T23:10:18.167552+0000","172.21.15.203:6835/1394221718":"2024-04-25T23:10:18.167552+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:10:25.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 msgr2=0x7f166806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 0x7f166806e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f168c1f7270 tx=0x7f1674008040 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 msgr2=0x7f168c1f3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f167c000c00 tx=0x7f167c0046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 shutdown_connections 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f168c15e6c0 0x7f168c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f166806be30 0x7f166806e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f168c15e2e0 0x7f168c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 --2- 172.21.15.146:0/513005438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0d48c0 0x7f168c1f3470 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 >> 172.21.15.146:0/513005438 conn(0x7f168c0d3da0 msgr2=0x7f168c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.485+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 shutdown_connections 2024-04-24T23:10:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:25.486+0000 7f168be00640 1 -- 172.21.15.146:0/513005438 wait complete. 2024-04-24T23:10:26.506 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T23:10:26.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.719+0000 7f032ae00640 1 Processor -- start 2024-04-24T23:10:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.719+0000 7f032ae00640 1 -- start start 2024-04-24T23:10:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f032ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0324145510 0x7f03240728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f032ae00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03240ceaf0 0x7f032406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f032ae00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03240cf040 con 0x7f032406d0c0 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f032ae00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f03240cf320 con 0x7f03240ceaf0 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f032ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0324070c70 con 0x7f0324145510 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03240ceaf0 0x7f032406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03240ceaf0 0x7f032406cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33776/0 (socket says 172.21.15.146:33776) 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 -- 172.21.15.146:0/3514792959 learned_addr learned my addr 172.21.15.146:0/3514792959 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323e00640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0324145510 0x7f03240728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 -- 172.21.15.146:0/3514792959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0324145510 msgr2=0x7f03240728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0324145510 0x7f03240728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.721+0000 7f0323400640 1 -- 172.21.15.146:0/3514792959 >> v1:172.21.15.146:6789/0 conn(0x7f032406d0c0 legacy=0x7f032415f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.722+0000 7f0323400640 1 -- 172.21.15.146:0/3514792959 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0324070f50 con 0x7f03240ceaf0 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f0323400640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f032406cb80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0310009870 tx=0x7f031002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96708c3f944f6eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f0322a00640 1 -- 172.21.15.146:0/3514792959 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310037070 con 0x7f03240ceaf0 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f0322a00640 1 -- 172.21.15.146:0/3514792959 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310032440 con 0x7f03240ceaf0 2024-04-24T23:10:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f0322a00640 1 -- 172.21.15.146:0/3514792959 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310032810 con 0x7f03240ceaf0 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f032ae00640 1 -- 172.21.15.146:0/3514792959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 msgr2=0x7f032406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f032ae00640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f032406cb80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0310009870 tx=0x7f031002a1c0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f032ae00640 1 -- 172.21.15.146:0/3514792959 shutdown_connections 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f032ae00640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f032406cb80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.723+0000 7f032ae00640 1 --2- 172.21.15.146:0/3514792959 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0324145510 0x7f03240728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.724+0000 7f032ae00640 1 -- 172.21.15.146:0/3514792959 >> 172.21.15.146:0/3514792959 conn(0x7f03240b16b0 msgr2=0x7f03240b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.724+0000 7f032ae00640 1 -- 172.21.15.146:0/3514792959 shutdown_connections 2024-04-24T23:10:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.724+0000 7f032ae00640 1 -- 172.21.15.146:0/3514792959 wait complete. 2024-04-24T23:10:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.725+0000 7f032ae00640 1 Processor -- start 2024-04-24T23:10:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.725+0000 7f032ae00640 1 -- start start 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f032406d0c0 0x7f0324155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f0324157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0324145510 0x7f0324143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f03241458f0 con 0x7f03240ceaf0 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0324072e10 con 0x7f0324145510 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.726+0000 7f032ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0324145a70 con 0x7f032406d0c0 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f0324157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f0324157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33788/0 (socket says 172.21.15.146:33788) 2024-04-24T23:10:26.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 -- 172.21.15.146:0/406275213 learned_addr learned my addr 172.21.15.146:0/406275213 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 -- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f032406d0c0 msgr2=0x7f0324155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323e00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f032406d0c0 0x7f0324155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f032406d0c0 0x7f0324155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 -- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0324145510 msgr2=0x7f0324143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0324145510 0x7f0324143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0324158920 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.727+0000 7f0323400640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f0324157490 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0310000c00 tx=0x7f03100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.728+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310041020 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.728+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03100306c0 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.728+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310037040 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.728+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0324158c00 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.728+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03241591c0 con 0x7f03240ceaf0 2024-04-24T23:10:26.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.729+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03240cd300 con 0x7f03240ceaf0 2024-04-24T23:10:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.730+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0310044020 con 0x7f03240ceaf0 2024-04-24T23:10:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f031be00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f030406be30 0x7f030406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f03100ab6a0 con 0x7f03240ceaf0 2024-04-24T23:10:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f031be00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f03040722d0 0x7f0304074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f031004de50 con 0x7f03040722d0 2024-04-24T23:10:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f03100b2050 con 0x7f03240ceaf0 2024-04-24T23:10:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.731+0000 7f0328e00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f03040722d0 0x7f0304074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.732+0000 7f0323e00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f030406be30 0x7f030406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.732+0000 7f0328e00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f03040722d0 0x7f0304074710 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.733+0000 7f0323e00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f030406be30 0x7f030406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0314006fd0 tx=0x7f0314008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.733+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== osd.0 v2:172.21.15.146:6811/1520723108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f031004de50 con 0x7f03040722d0 2024-04-24T23:10:26.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.748+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 --> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0324068190 con 0x7f03040722d0 2024-04-24T23:10:26.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.748+0000 7f031be00640 1 -- 172.21.15.146:0/406275213 <== osd.0 v2:172.21.15.146:6811/1520723108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0324068190 con 0x7f03040722d0 2024-04-24T23:10:26.750 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:26.750 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:26.750 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:26.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f03040722d0 msgr2=0x7f0304074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:6811/1520723108,v1:172.21.15.146:6814/1520723108] conn(0x7f03040722d0 0x7f0304074710 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f030406be30 msgr2=0x7f030406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f030406be30 0x7f030406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0314006fd0 tx=0x7f0314008040 comp rx=0 tx=0).stop 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 msgr2=0x7f0324157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 --2- 172.21.15.146:0/406275213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03240ceaf0 0x7f0324157490 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0310000c00 tx=0x7f03100046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f0328e00640 1 -- 172.21.15.146:0/406275213 reap_dead start 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 shutdown_connections 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 >> 172.21.15.146:0/406275213 conn(0x7f03240b16b0 msgr2=0x7f03240cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 shutdown_connections 2024-04-24T23:10:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.749+0000 7f032ae00640 1 -- 172.21.15.146:0/406275213 wait complete. 2024-04-24T23:10:26.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T23:10:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.966+0000 7fcee8c00640 1 Processor -- start 2024-04-24T23:10:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.966+0000 7fcee8c00640 1 -- start start 2024-04-24T23:10:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.967+0000 7fcee8c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcee40720d0 0x7fcee4166f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.967+0000 7fcee8c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee4142950 con 0x7fcee4070ba0 2024-04-24T23:10:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.967+0000 7fcee8c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee4071030 con 0x7fcee4142570 2024-04-24T23:10:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.967+0000 7fcee8c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcee4071c40 con 0x7fcee40720d0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee1400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcee4070ba0 0x7fcee406d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53138/0 (socket says 172.21.15.146:53138) 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee1400640 1 -- 172.21.15.146:0/1119404235 learned_addr learned my addr 172.21.15.146:0/1119404235 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335194896 0 0) 0x7fcee4142950 con 0x7fcee4070ba0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec8003520 con 0x7fcee4070ba0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee2800640 1 --2- 172.21.15.146:0/1119404235 >> v2:172.21.15.203:3300/0 conn(0x7fcee40720d0 0x7fcee4166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738071920 0 0) 0x7fcec8003520 con 0x7fcee4070ba0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 >> v2:172.21.15.203:3300/0 conn(0x7fcee40720d0 msgr2=0x7fcee4166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 --2- 172.21.15.146:0/1119404235 >> v2:172.21.15.203:3300/0 conn(0x7fcee40720d0 0x7fcee4166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 >> v1:172.21.15.203:6789/0 conn(0x7fcee4142570 legacy=0x7fcee406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee4071310 con 0x7fcee4070ba0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.968+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fced0001670 con 0x7fcee4070ba0 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 >> v1:172.21.15.146:6789/0 conn(0x7fcee4070ba0 legacy=0x7fcee406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80039b0 0x7fcec8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec8004800 0x7fcec8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 0x7fcec800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4071c40 con 0x7fcec80051c0 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcec800c0f0 con 0x7fcec80039b0 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcec800c2f0 con 0x7fcec8004800 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee2800640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 0x7fcec800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee1400640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec8004800 0x7fcec8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.969+0000 7fcee1e00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80039b0 0x7fcec8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.970+0000 7fcee2800640 1 -- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec8004800 msgr2=0x7fcec8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.970+0000 7fcee2800640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec8004800 0x7fcec8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.970+0000 7fcee2800640 1 -- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80039b0 msgr2=0x7fcec8003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.970+0000 7fcee2800640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80039b0 0x7fcec8003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.970+0000 7fcee2800640 1 -- 172.21.15.146:0/1119404235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec8003520 con 0x7fcec80051c0 2024-04-24T23:10:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.971+0000 7fcee2800640 1 -- 172.21.15.146:0/1119404235 reap_dead start 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.971+0000 7fcee2800640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 0x7fcec800b9c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007330 tx=0x7fcec8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692cd160d61a9b85 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.971+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc009be0 con 0x7fcec80051c0 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.971+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc003b90 con 0x7fcec80051c0 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.971+0000 7fcee0a00640 1 -- 172.21.15.146:0/1119404235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc004020 con 0x7fcec80051c0 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 -- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 msgr2=0x7fcec800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 0x7fcec800b9c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007330 tx=0x7fcec8005830 comp rx=0 tx=0).stop 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 -- 172.21.15.146:0/1119404235 shutdown_connections 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 --2- 172.21.15.146:0/1119404235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec80051c0 0x7fcec800b9c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 -- 172.21.15.146:0/1119404235 >> 172.21.15.146:0/1119404235 conn(0x7fcee406b140 msgr2=0x7fcee406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 -- 172.21.15.146:0/1119404235 shutdown_connections 2024-04-24T23:10:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.972+0000 7fcee8c00640 1 -- 172.21.15.146:0/1119404235 wait complete. 2024-04-24T23:10:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.974+0000 7fcee8c00640 1 Processor -- start 2024-04-24T23:10:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.974+0000 7fcee8c00640 1 -- start start 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80051c0 0x7fcee41377e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 0x7fcee40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4072c60 con 0x7fcee4137fa0 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40718d0 con 0x7fcec80051c0 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.975+0000 7fcee8c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcee4072de0 con 0x7fcee41f2170 2024-04-24T23:10:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33798/0 (socket says 172.21.15.146:33798) 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 -- 172.21.15.146:0/4027891377 learned_addr learned my addr 172.21.15.146:0/4027891377 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee2800640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 0x7fcee40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1e00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80051c0 0x7fcee41377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 -- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 msgr2=0x7fcee40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 0x7fcee40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 -- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80051c0 msgr2=0x7fcee41377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80051c0 0x7fcee41377e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 -- 172.21.15.146:0/4027891377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee415d670 con 0x7fcee4137fa0 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee2800640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 0x7fcee40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.976+0000 7fcee1400640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fced000e7b0 tx=0x7fced000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.977+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000c8d0 con 0x7fcee4137fa0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.977+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced0018070 con 0x7fcee4137fa0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.977+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000ccb0 con 0x7fcee4137fa0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.977+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee415de60 con 0x7fcee4137fa0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.977+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee415e3e0 con 0x7fcee4137fa0 2024-04-24T23:10:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.978+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee404f5a0 con 0x7fcee4137fa0 2024-04-24T23:10:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.979+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fced001d460 con 0x7fcee4137fa0 2024-04-24T23:10:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.980+0000 7fceda000640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.980+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7fced008ac80 con 0x7fcee4137fa0 2024-04-24T23:10:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.981+0000 7fcee1e00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.982+0000 7fcee1e00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 0x7fcec406e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcee415dc10 tx=0x7fced4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:26.984+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcee415d670 con 0x7fcee4137fa0 2024-04-24T23:10:27.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.184+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fcee40684a0 con 0x7fcec406be30 2024-04-24T23:10:27.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.185+0000 7fceda000640 1 -- 172.21.15.146:0/4027891377 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcee40684a0 con 0x7fcec406be30 2024-04-24T23:10:27.186 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T23:10:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 msgr2=0x7fcec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 0x7fcec406e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcee415dc10 tx=0x7fced4009040 comp rx=0 tx=0).stop 2024-04-24T23:10:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 msgr2=0x7fcee415d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fced000e7b0 tx=0x7fced000ec70 comp rx=0 tx=0).stop 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 shutdown_connections 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fcec406be30 0x7fcec406e2f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcee41f2170 0x7fcee40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee4137fa0 0x7fcee415d130 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 --2- 172.21.15.146:0/4027891377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec80051c0 0x7fcee41377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 >> 172.21.15.146:0/4027891377 conn(0x7fcee406b140 msgr2=0x7fcee4144ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 shutdown_connections 2024-04-24T23:10:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.188+0000 7fcee8c00640 1 -- 172.21.15.146:0/4027891377 wait complete. 2024-04-24T23:10:27.208 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T23:10:27.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.407+0000 7f1b2f200640 1 Processor -- start 2024-04-24T23:10:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.407+0000 7f1b2f200640 1 -- start start 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b2f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b2815da70 0x7f1b280b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b2f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1b280cf310 0x7f1b280712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b2f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2815de50 con 0x7f1b28071800 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b2f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1b28071c50 con 0x7f1b2815da70 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b2f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280b3380 con 0x7f1b280cf310 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b27e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b2815da70 0x7f1b280b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b27e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b2815da70 0x7f1b280b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33804/0 (socket says 172.21.15.146:33804) 2024-04-24T23:10:27.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b27e00640 1 -- 172.21.15.146:0/3632835448 learned_addr learned my addr 172.21.15.146:0/3632835448 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.409+0000 7f1b27400640 1 --2- 172.21.15.146:0/3632835448 >> v2:172.21.15.203:3300/0 conn(0x7f1b280cf310 0x7f1b280712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.410+0000 7f1b27e00640 1 -- 172.21.15.146:0/3632835448 >> v2:172.21.15.203:3300/0 conn(0x7f1b280cf310 msgr2=0x7f1b280712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.410+0000 7f1b27e00640 1 --2- 172.21.15.146:0/3632835448 >> v2:172.21.15.203:3300/0 conn(0x7f1b280cf310 0x7f1b280712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.410+0000 7f1b27e00640 1 -- 172.21.15.146:0/3632835448 >> v1:172.21.15.203:6789/0 conn(0x7f1b28071800 legacy=0x7f1b2806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:27.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.410+0000 7f1b27e00640 1 -- 172.21.15.146:0/3632835448 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280b35d0 con 0x7f1b2815da70 2024-04-24T23:10:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.411+0000 7f1b27e00640 1 --2- 172.21.15.146:0/3632835448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2815da70 0x7f1b280b44d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806f780 tx=0x7f1b1802b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d58b91442943ac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.411+0000 7f1b26a00640 1 -- 172.21.15.146:0/3632835448 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800b040 con 0x7f1b2815da70 2024-04-24T23:10:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.411+0000 7f1b26a00640 1 -- 172.21.15.146:0/3632835448 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1802be50 con 0x7f1b2815da70 2024-04-24T23:10:27.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.411+0000 7f1b26a00640 1 -- 172.21.15.146:0/3632835448 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18030930 con 0x7f1b2815da70 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 -- 172.21.15.146:0/3632835448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2815da70 msgr2=0x7f1b280b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3632835448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2815da70 0x7f1b280b44d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806f780 tx=0x7f1b1802b670 comp rx=0 tx=0).stop 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 -- 172.21.15.146:0/3632835448 shutdown_connections 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3632835448 >> v2:172.21.15.203:3300/0 conn(0x7f1b280cf310 0x7f1b280712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3632835448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2815da70 0x7f1b280b44d0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 -- 172.21.15.146:0/3632835448 >> 172.21.15.146:0/3632835448 conn(0x7f1b280b16b0 msgr2=0x7f1b280b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 -- 172.21.15.146:0/3632835448 shutdown_connections 2024-04-24T23:10:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.412+0000 7f1b2f200640 1 -- 172.21.15.146:0/3632835448 wait complete. 2024-04-24T23:10:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.414+0000 7f1b2f200640 1 Processor -- start 2024-04-24T23:10:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.414+0000 7f1b2f200640 1 -- start start 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b28071800 0x7f1b28156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 0x7f1b281527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b2815da70 0x7f1b28152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280b3b90 con 0x7f1b280cf310 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280b3f00 con 0x7f1b28071800 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280b4a10 con 0x7f1b2815da70 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 0x7f1b281527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 0x7f1b281527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33808/0 (socket says 172.21.15.146:33808) 2024-04-24T23:10:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 -- 172.21.15.146:0/3412573505 learned_addr learned my addr 172.21.15.146:0/3412573505 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27e00640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b28071800 0x7f1b28156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 -- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b2815da70 msgr2=0x7f1b28152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b2d200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b2815da70 0x7f1b28152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b2815da70 0x7f1b28152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 -- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b28071800 msgr2=0x7f1b28156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.415+0000 7f1b27400640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b28071800 0x7f1b28156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b27400640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b28153250 con 0x7f1b280cf310 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b2d200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b2815da70 0x7f1b28152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b27400640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 0x7f1b281527d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400d800 tx=0x7f1b1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400b6c0 con 0x7f1b280cf310 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b14019070 con 0x7f1b280cf310 2024-04-24T23:10:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b28158a40 con 0x7f1b280cf310 2024-04-24T23:10:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400ba80 con 0x7f1b280cf310 2024-04-24T23:10:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.416+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b28159000 con 0x7f1b280cf310 2024-04-24T23:10:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.417+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b28068190 con 0x7f1b280cf310 2024-04-24T23:10:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.418+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b1400bc20 con 0x7f1b280cf310 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.419+0000 7f1b1fe00640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f1b1408b260 con 0x7f1b280cf310 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b1fe00640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f1b080722d0 0x7f1b08074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b14001d30 con 0x7f1b080722d0 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f1b14092050 con 0x7f1b280cf310 2024-04-24T23:10:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b2d200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f1b080722d0 0x7f1b08074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.420+0000 7f1b27e00640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.421+0000 7f1b2d200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f1b080722d0 0x7f1b08074710 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.421+0000 7f1b27e00640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1b18035000 tx=0x7f1b18034040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.422+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== osd.1 v2:172.21.15.146:6800/2440725071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b14001d30 con 0x7f1b080722d0 2024-04-24T23:10:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.436+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 --> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b28071580 con 0x7f1b080722d0 2024-04-24T23:10:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.436+0000 7f1b1fe00640 1 -- 172.21.15.146:0/3412573505 <== osd.1 v2:172.21.15.146:6800/2440725071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b28071580 con 0x7f1b080722d0 2024-04-24T23:10:27.438 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:27.438 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:27.438 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f1b080722d0 msgr2=0x7f1b08074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:6800/2440725071,v1:172.21.15.146:6801/2440725071] conn(0x7f1b080722d0 0x7f1b08074710 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b0806be30 msgr2=0x7f1b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1b18035000 tx=0x7f1b18034040 comp rx=0 tx=0).stop 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 msgr2=0x7f1b281527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2f200640 1 --2- 172.21.15.146:0/3412573505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b280cf310 0x7f1b281527d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400d800 tx=0x7f1b1400dcc0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.437+0000 7f1b2d200640 1 -- 172.21.15.146:0/3412573505 reap_dead start 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.438+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 shutdown_connections 2024-04-24T23:10:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.438+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 >> 172.21.15.146:0/3412573505 conn(0x7f1b280b16b0 msgr2=0x7f1b2806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.438+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 shutdown_connections 2024-04-24T23:10:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.438+0000 7f1b2f200640 1 -- 172.21.15.146:0/3412573505 wait complete. 2024-04-24T23:10:27.457 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T23:10:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.657+0000 7f35b3000640 1 Processor -- start 2024-04-24T23:10:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.657+0000 7f35b3000640 1 -- start start 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b3000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f35ac06cbc0 0x7f35ac15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b3000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35ac15c7b0 0x7f35ac15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b3000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac06cff0 con 0x7f35ac15abb0 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b3000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac071960 con 0x7f35ac15c7b0 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b3000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac071c40 con 0x7f35ac06cbc0 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35abe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35ac15abb0 0x7f35ac15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53154/0 (socket says 172.21.15.146:53154) 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35abe00640 1 -- 172.21.15.146:0/2071020971 learned_addr learned my addr 172.21.15.146:0/2071020971 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.659+0000 7f35b1000640 1 --2- 172.21.15.146:0/2071020971 >> v2:172.21.15.146:3300/0 conn(0x7f35ac15c7b0 0x7f35ac15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35aaa00640 1 -- 172.21.15.146:0/2071020971 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106582198 0 0) 0x7f35ac06cff0 con 0x7f35ac15abb0 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35aaa00640 1 -- 172.21.15.146:0/2071020971 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f358c003520 con 0x7f35ac15abb0 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35ab400640 1 --2- 172.21.15.146:0/2071020971 >> v2:172.21.15.203:3300/0 conn(0x7f35ac06cbc0 0x7f35ac15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35b1000640 1 -- 172.21.15.146:0/2071020971 >> v2:172.21.15.203:3300/0 conn(0x7f35ac06cbc0 msgr2=0x7f35ac15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35b1000640 1 --2- 172.21.15.146:0/2071020971 >> v2:172.21.15.203:3300/0 conn(0x7f35ac06cbc0 0x7f35ac15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35b1000640 1 -- 172.21.15.146:0/2071020971 >> v1:172.21.15.146:6789/0 conn(0x7f35ac15abb0 legacy=0x7f35ac15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.660+0000 7f35b1000640 1 -- 172.21.15.146:0/2071020971 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac071f20 con 0x7f35ac15c7b0 2024-04-24T23:10:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.661+0000 7f35b1000640 1 --2- 172.21.15.146:0/2071020971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15c7b0 0x7f35ac15cbe0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f35ac070890 tx=0x7f35a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd617c53a0e64cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.661+0000 7f35aaa00640 1 -- 172.21.15.146:0/2071020971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4037070 con 0x7f35ac15c7b0 2024-04-24T23:10:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.661+0000 7f35aaa00640 1 -- 172.21.15.146:0/2071020971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4032440 con 0x7f35ac15c7b0 2024-04-24T23:10:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.661+0000 7f35aaa00640 1 -- 172.21.15.146:0/2071020971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4032810 con 0x7f35ac15c7b0 2024-04-24T23:10:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 -- 172.21.15.146:0/2071020971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15c7b0 msgr2=0x7f35ac15cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 --2- 172.21.15.146:0/2071020971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15c7b0 0x7f35ac15cbe0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f35ac070890 tx=0x7f35a402a1a0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 -- 172.21.15.146:0/2071020971 shutdown_connections 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 --2- 172.21.15.146:0/2071020971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15c7b0 0x7f35ac15cbe0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 --2- 172.21.15.146:0/2071020971 >> v2:172.21.15.203:3300/0 conn(0x7f35ac06cbc0 0x7f35ac15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 -- 172.21.15.146:0/2071020971 >> 172.21.15.146:0/2071020971 conn(0x7f35ac06b140 msgr2=0x7f35ac06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 -- 172.21.15.146:0/2071020971 shutdown_connections 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.662+0000 7f35b3000640 1 -- 172.21.15.146:0/2071020971 wait complete. 2024-04-24T23:10:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.664+0000 7f35b3000640 1 Processor -- start 2024-04-24T23:10:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.664+0000 7f35b3000640 1 -- start start 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35ac06cbc0 0x7f35ac14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35ac15c7b0 0x7f35ac1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac15bfa0 con 0x7f35ac15abb0 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0cc2f0 con 0x7f35ac06cbc0 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35b3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac15c120 con 0x7f35ac15c7b0 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33824/0 (socket says 172.21.15.146:33824) 2024-04-24T23:10:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 -- 172.21.15.146:0/1597806262 learned_addr learned my addr 172.21.15.146:0/1597806262 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 -- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35ac15c7b0 msgr2=0x7f35ac1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35ac15c7b0 0x7f35ac1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35ab400640 1 -- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35ac06cbc0 msgr2=0x7f35ac14ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.665+0000 7f35abe00640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35ac06cbc0 0x7f35ac14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35ab400640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35ac06cbc0 0x7f35ac14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35ab400640 1 -- 172.21.15.146:0/1597806262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac0cf010 con 0x7f35ac15abb0 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35ab400640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f359400ccd0 tx=0x7f359400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594003990 con 0x7f35ac15abb0 2024-04-24T23:10:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3594003b30 con 0x7f35ac15abb0 2024-04-24T23:10:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac14d260 con 0x7f35ac15abb0 2024-04-24T23:10:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594004020 con 0x7f35ac15abb0 2024-04-24T23:10:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.666+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac14d820 con 0x7f35ac15abb0 2024-04-24T23:10:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.667+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac04f5a0 con 0x7f35ac15abb0 2024-04-24T23:10:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.668+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35940041c0 con 0x7f35ac15abb0 2024-04-24T23:10:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.669+0000 7f35a3e00640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 0x7f358806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.669+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f359408b1e0 con 0x7f35ac15abb0 2024-04-24T23:10:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.670+0000 7f35abe00640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 0x7f358806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.671+0000 7f35abe00640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 0x7f358806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f35ac15e4c0 tx=0x7f359c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.674+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3594014030 con 0x7f35ac15abb0 2024-04-24T23:10:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.872+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f35ac14d010 con 0x7f358806be30 2024-04-24T23:10:27.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.873+0000 7f35a3e00640 1 -- 172.21.15.146:0/1597806262 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f35ac14d010 con 0x7f358806be30 2024-04-24T23:10:27.874 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.875+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 msgr2=0x7f358806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.875+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 0x7f358806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f35ac15e4c0 tx=0x7f359c009040 comp rx=0 tx=0).stop 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.875+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 msgr2=0x7f35ac14dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.875+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f359400ccd0 tx=0x7f359400a5c0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 shutdown_connections 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f358806be30 0x7f358806e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35ac15c7b0 0x7f35ac1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac15abb0 0x7f35ac14dd40 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 --2- 172.21.15.146:0/1597806262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35ac06cbc0 0x7f35ac14ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 >> 172.21.15.146:0/1597806262 conn(0x7f35ac06b140 msgr2=0x7f35ac070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 shutdown_connections 2024-04-24T23:10:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:27.876+0000 7f35b3000640 1 -- 172.21.15.146:0/1597806262 wait complete. 2024-04-24T23:10:27.897 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T23:10:27.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.105+0000 7f52fa200640 1 Processor -- start 2024-04-24T23:10:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.106+0000 7f52fa200640 1 -- start start 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.107+0000 7f52fa200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f41616f0 0x7f52f4161b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.107+0000 7f52fa200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52f4072620 0x7f52f41620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52fa200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f40af170 con 0x7f52f4162610 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52fa200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f52f4071c10 con 0x7f52f4072620 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52fa200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52f4071ef0 con 0x7f52f41616f0 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52f4072620 0x7f52f41620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52f3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f52f4162610 0x7f52f40b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50650/0 (socket says 172.21.15.146:50650) 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52f4072620 0x7f52f41620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40622/0 (socket says 172.21.15.146:40622) 2024-04-24T23:10:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52f3e00640 1 -- 172.21.15.146:0/4001596231 learned_addr learned my addr 172.21.15.146:0/4001596231 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52f3400640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f41616f0 0x7f52f4161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 -- 172.21.15.146:0/4001596231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f41616f0 msgr2=0x7f52f4161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f41616f0 0x7f52f4161b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 -- 172.21.15.146:0/4001596231 >> v1:172.21.15.146:6789/0 conn(0x7f52f4162610 legacy=0x7f52f40b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52ebe00640 1 -- 172.21.15.146:0/4001596231 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f40721d0 con 0x7f52f4072620 2024-04-24T23:10:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.108+0000 7f52f2a00640 1 -- 172.21.15.146:0/4001596231 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690419456 0 0) 0x7f52f40af170 con 0x7f52f4162610 2024-04-24T23:10:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.109+0000 7f52ebe00640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f4072620 0x7f52f41620d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0097d0 tx=0x7f52dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c306d2b1ddcd1458 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52f2a00640 1 -- 172.21.15.146:0/4001596231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc037070 con 0x7f52f4072620 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52f2a00640 1 -- 172.21.15.146:0/4001596231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc032440 con 0x7f52f4072620 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52f2a00640 1 -- 172.21.15.146:0/4001596231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc032810 con 0x7f52f4072620 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 -- 172.21.15.146:0/4001596231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f4072620 msgr2=0x7f52f41620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f4072620 0x7f52f41620d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0097d0 tx=0x7f52dc02a1c0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 -- 172.21.15.146:0/4001596231 shutdown_connections 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f4072620 0x7f52f41620d0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 --2- 172.21.15.146:0/4001596231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f41616f0 0x7f52f4161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.110+0000 7f52fa200640 1 -- 172.21.15.146:0/4001596231 >> 172.21.15.146:0/4001596231 conn(0x7f52f40b16b0 msgr2=0x7f52f40b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.111+0000 7f52fa200640 1 -- 172.21.15.146:0/4001596231 shutdown_connections 2024-04-24T23:10:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.111+0000 7f52fa200640 1 -- 172.21.15.146:0/4001596231 wait complete. 2024-04-24T23:10:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.112+0000 7f52fa200640 1 Processor -- start 2024-04-24T23:10:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.112+0000 7f52fa200640 1 -- start start 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52f4072620 0x7f52f414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 0x7f52f415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f4162610 0x7f52f40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40718c0 con 0x7f52f41616f0 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40adc40 con 0x7f52f4072620 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.113+0000 7f52fa200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52f406cdf0 con 0x7f52f4162610 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 0x7f52f415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 0x7f52f415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40626/0 (socket says 172.21.15.146:40626) 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 -- 172.21.15.146:0/755746192 learned_addr learned my addr 172.21.15.146:0/755746192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52f3400640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52f4072620 0x7f52f414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 -- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f4162610 msgr2=0x7f52f40b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52f4162610 0x7f52f40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 -- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52f4072620 msgr2=0x7f52f414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52f4072620 0x7f52f414d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f415bca0 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.114+0000 7f52ebe00640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 0x7f52f415b760 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f52dc035040 tx=0x7f52dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.115+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc037040 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.115+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc030770 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.115+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc030b80 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.115+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f40b0e20 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.115+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f4152100 con 0x7f52f41616f0 2024-04-24T23:10:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.116+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52f414dca0 con 0x7f52f41616f0 2024-04-24T23:10:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.117+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52dc044020 con 0x7f52f41616f0 2024-04-24T23:10:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.118+0000 7f52eb400640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52d006be30 0x7f52d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.118+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f52dc0ab240 con 0x7f52f41616f0 2024-04-24T23:10:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.118+0000 7f52eb400640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f52d00722d0 0x7f52d0074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.118+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52dc008eb0 con 0x7f52d00722d0 2024-04-24T23:10:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.118+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f52dc0b2050 con 0x7f52f41616f0 2024-04-24T23:10:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.119+0000 7f52f3e00640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f52d00722d0 0x7f52d0074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.119+0000 7f52f3400640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52d006be30 0x7f52d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.119+0000 7f52f3e00640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f52d00722d0 0x7f52d0074710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.120+0000 7f52f3400640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52d006be30 0x7f52d006e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f52e4006fd0 tx=0x7f52e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.120+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== osd.2 v2:172.21.15.146:6809/29852179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52dc008eb0 con 0x7f52d00722d0 2024-04-24T23:10:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.135+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 --> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52f4068190 con 0x7f52d00722d0 2024-04-24T23:10:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.135+0000 7f52eb400640 1 -- 172.21.15.146:0/755746192 <== osd.2 v2:172.21.15.146:6809/29852179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52f4068190 con 0x7f52d00722d0 2024-04-24T23:10:28.136 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:28.136 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:28.136 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.135+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f52d00722d0 msgr2=0x7f52d0074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.135+0000 7f52fa200640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:6809/29852179,v1:172.21.15.146:6813/29852179] conn(0x7f52d00722d0 0x7f52d0074710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52d006be30 msgr2=0x7f52d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f52d006be30 0x7f52d006e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f52e4006fd0 tx=0x7f52e4008040 comp rx=0 tx=0).stop 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 msgr2=0x7f52f415b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 --2- 172.21.15.146:0/755746192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f41616f0 0x7f52f415b760 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f52dc035040 tx=0x7f52dc0046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52f3e00640 1 -- 172.21.15.146:0/755746192 reap_dead start 2024-04-24T23:10:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 shutdown_connections 2024-04-24T23:10:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 >> 172.21.15.146:0/755746192 conn(0x7f52f40b16b0 msgr2=0x7f52f4159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 shutdown_connections 2024-04-24T23:10:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.136+0000 7f52fa200640 1 -- 172.21.15.146:0/755746192 wait complete. 2024-04-24T23:10:28.155 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T23:10:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.354+0000 7f240be00640 1 Processor -- start 2024-04-24T23:10:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.354+0000 7f240be00640 1 -- start start 2024-04-24T23:10:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.355+0000 7f240be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f240c0d2720 0x7f240c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.355+0000 7f240be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f240c0d0d20 0x7f240c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.355+0000 7f240be00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240c0d4a50 con 0x7f240c15e050 2024-04-24T23:10:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f240c0d4800 con 0x7f240c0d0d20 2024-04-24T23:10:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240be00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f240c0b3190 con 0x7f240c0d2720 2024-04-24T23:10:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f240c0d0d20 0x7f240c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f240c0d0d20 0x7f240c0b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40636/0 (socket says 172.21.15.146:40636) 2024-04-24T23:10:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240b400640 1 -- 172.21.15.146:0/1713478312 learned_addr learned my addr 172.21.15.146:0/1713478312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.356+0000 7f240a000640 1 --2- 172.21.15.146:0/1713478312 >> v2:172.21.15.203:3300/0 conn(0x7f240c0d2720 0x7f240c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.357+0000 7f240b400640 1 -- 172.21.15.146:0/1713478312 >> v2:172.21.15.203:3300/0 conn(0x7f240c0d2720 msgr2=0x7f240c0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.357+0000 7f240b400640 1 --2- 172.21.15.146:0/1713478312 >> v2:172.21.15.203:3300/0 conn(0x7f240c0d2720 0x7f240c0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.357+0000 7f240b400640 1 -- 172.21.15.146:0/1713478312 >> v1:172.21.15.203:6789/0 conn(0x7f240c15e050 legacy=0x7f240c0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.357+0000 7f240b400640 1 -- 172.21.15.146:0/1713478312 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c0b33e0 con 0x7f240c0d0d20 2024-04-24T23:10:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.358+0000 7f240b400640 1 --2- 172.21.15.146:0/1713478312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c0d0d20 0x7f240c0b4120 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f240c161b90 tx=0x7f240402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9e44244ea0da9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.358+0000 7f2409600640 1 -- 172.21.15.146:0/1713478312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404037070 con 0x7f240c0d0d20 2024-04-24T23:10:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.358+0000 7f2409600640 1 -- 172.21.15.146:0/1713478312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2404032440 con 0x7f240c0d0d20 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.358+0000 7f2409600640 1 -- 172.21.15.146:0/1713478312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404032810 con 0x7f240c0d0d20 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 -- 172.21.15.146:0/1713478312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c0d0d20 msgr2=0x7f240c0b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 --2- 172.21.15.146:0/1713478312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c0d0d20 0x7f240c0b4120 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f240c161b90 tx=0x7f240402a1e0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 -- 172.21.15.146:0/1713478312 shutdown_connections 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 --2- 172.21.15.146:0/1713478312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c0d0d20 0x7f240c0b4120 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 --2- 172.21.15.146:0/1713478312 >> v2:172.21.15.203:3300/0 conn(0x7f240c0d2720 0x7f240c0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 -- 172.21.15.146:0/1713478312 >> 172.21.15.146:0/1713478312 conn(0x7f240c0d3ce0 msgr2=0x7f240c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 -- 172.21.15.146:0/1713478312 shutdown_connections 2024-04-24T23:10:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.359+0000 7f240be00640 1 -- 172.21.15.146:0/1713478312 wait complete. 2024-04-24T23:10:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.361+0000 7f240be00640 1 Processor -- start 2024-04-24T23:10:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.361+0000 7f240be00640 1 -- start start 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c0d0d20 0x7f240c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f240c0d2720 0x7f240c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0cfa70 con 0x7f240c15e050 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0b3750 con 0x7f240c0d0d20 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240be00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f240c0cfbf0 con 0x7f240c0d2720 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40640/0 (socket says 172.21.15.146:40640) 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.362+0000 7f240b400640 1 -- 172.21.15.146:0/3653520646 learned_addr learned my addr 172.21.15.146:0/3653520646 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 -- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f240c0d2720 msgr2=0x7f240c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f240c0d2720 0x7f240c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 -- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c0d0d20 msgr2=0x7f240c152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240aa00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c0d0d20 0x7f240c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c0d0d20 0x7f240c152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 -- 172.21.15.146:0/3653520646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c15e640 con 0x7f240c15e050 2024-04-24T23:10:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240b400640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f240402a220 tx=0x7f24040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404037040 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2404042070 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404030920 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.363+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c15e920 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.364+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c15eee0 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.365+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c0d3780 con 0x7f240c15e050 2024-04-24T23:10:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.366+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2404030ac0 con 0x7f240c15e050 2024-04-24T23:10:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.366+0000 7f2402a00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.367+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f24040ab600 con 0x7f240c15e050 2024-04-24T23:10:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.367+0000 7f240aa00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.368+0000 7f240aa00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 0x7f23e806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f240c0cdc10 tx=0x7f23f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.371+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f240c0d3780 con 0x7f240c15e050 2024-04-24T23:10:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.572+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f240c06c780 con 0x7f23e806be30 2024-04-24T23:10:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.573+0000 7f2402a00640 1 -- 172.21.15.146:0/3653520646 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f240c06c780 con 0x7f23e806be30 2024-04-24T23:10:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T23:10:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 msgr2=0x7f23e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 0x7f23e806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f240c0cdc10 tx=0x7f23f4009040 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 msgr2=0x7f240c0cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f240402a220 tx=0x7f24040046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 shutdown_connections 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f240c15e050 0x7f240c0cd4c0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f240c0d2720 0x7f240c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 --2- 172.21.15.146:0/3653520646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c0d0d20 0x7f240c152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 >> 172.21.15.146:0/3653520646 conn(0x7f240c0d3ce0 msgr2=0x7f240c0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.576+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 shutdown_connections 2024-04-24T23:10:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.577+0000 7f240be00640 1 -- 172.21.15.146:0/3653520646 wait complete. 2024-04-24T23:10:28.598 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T23:10:28.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.804+0000 7fd56b200640 1 Processor -- start 2024-04-24T23:10:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.805+0000 7fd56b200640 1 -- start start 2024-04-24T23:10:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.806+0000 7fd56b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd56c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.806+0000 7fd56b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56c15e980 con 0x7fd56c0ce360 2024-04-24T23:10:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.806+0000 7fd56b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56c0b1190 con 0x7fd56c0cfbf0 2024-04-24T23:10:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.806+0000 7fd56b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd56c0b3450 con 0x7fd56c0b2dc0 2024-04-24T23:10:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.807+0000 7fd569e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd56c0ce360 0x7fd56c0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50658/0 (socket says 172.21.15.146:50658) 2024-04-24T23:10:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.807+0000 7fd569e00640 1 -- 172.21.15.146:0/4112507609 learned_addr learned my addr 172.21.15.146:0/4112507609 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.807+0000 7fd56a800640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd56c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.807+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918906915 0 0) 0x7fd56c15e980 con 0x7fd56c0ce360 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.807+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd550003520 con 0x7fd56c0ce360 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1574357443 0 0) 0x7fd550003520 con 0x7fd56c0ce360 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 msgr2=0x7fd56c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd56c06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 >> v1:172.21.15.203:6789/0 conn(0x7fd56c0cfbf0 legacy=0x7fd56c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56c0b25f0 con 0x7fd56c0ce360 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fd55c001670 con 0x7fd56c0ce360 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 >> v1:172.21.15.146:6789/0 conn(0x7fd56c0ce360 legacy=0x7fd56c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd550003a50 0x7fd550003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd550005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c0b3450 con 0x7fd550004800 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd55000bb80 con 0x7fd550003a50 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd55000bd80 con 0x7fd56c0b2dc0 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd561400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd569e00640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd550003a50 0x7fd550003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.808+0000 7fd56a800640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd550005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.809+0000 7fd561400640 1 -- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 msgr2=0x7fd550005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.809+0000 7fd561400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0b2dc0 0x7fd550005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.809+0000 7fd561400640 1 -- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd550003a50 msgr2=0x7fd550003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.809+0000 7fd561400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd550003a50 0x7fd550003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.809+0000 7fd561400640 1 -- 172.21.15.146:0/4112507609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd550003520 con 0x7fd550004800 2024-04-24T23:10:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd561400640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd550004c80 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd554001750 tx=0x7fd550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21228b88c163d43e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554001370 con 0x7fd550004800 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5540052d0 con 0x7fd550004800 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd569400640 1 -- 172.21.15.146:0/4112507609 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55402abe0 con 0x7fd550004800 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd56b200640 1 -- 172.21.15.146:0/4112507609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 msgr2=0x7fd550004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.810+0000 7fd56b200640 1 --2- 172.21.15.146:0/4112507609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd550004c80 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd554001750 tx=0x7fd550005830 comp rx=0 tx=0).stop 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.811+0000 7fd56a800640 1 -- 172.21.15.146:0/4112507609 reap_dead start 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.811+0000 7fd56b200640 1 -- 172.21.15.146:0/4112507609 shutdown_connections 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.811+0000 7fd56b200640 1 -- 172.21.15.146:0/4112507609 >> 172.21.15.146:0/4112507609 conn(0x7fd56c0d1ae0 msgr2=0x7fd56c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.811+0000 7fd56b200640 1 -- 172.21.15.146:0/4112507609 shutdown_connections 2024-04-24T23:10:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.811+0000 7fd56b200640 1 -- 172.21.15.146:0/4112507609 wait complete. 2024-04-24T23:10:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.813+0000 7fd56b200640 1 Processor -- start 2024-04-24T23:10:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.813+0000 7fd56b200640 1 -- start start 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd56c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0c55f0 0x7fd56c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd56c0cc740 0x7fd56c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c06caf0 con 0x7fd550004800 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c0b2890 con 0x7fd56c0cc740 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd56c0cddb0 con 0x7fd56c0c55f0 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd569e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd56c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd569e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd56c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40662/0 (socket says 172.21.15.146:40662) 2024-04-24T23:10:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd569e00640 1 -- 172.21.15.146:0/3422854638 learned_addr learned my addr 172.21.15.146:0/3422854638 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd561400640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0c55f0 0x7fd56c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd569e00640 1 -- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0c55f0 msgr2=0x7fd56c158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd56a800640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd56c0cc740 0x7fd56c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.814+0000 7fd569e00640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd56c0c55f0 0x7fd56c158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd569e00640 1 -- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd56c0cc740 msgr2=0x7fd56c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd569e00640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd56c0cc740 0x7fd56c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd569e00640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56c0c8c50 con 0x7fd550004800 2024-04-24T23:10:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd569e00640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd56c0c8400 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00e780 tx=0x7fd55c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c00c660 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd55c018070 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c00ca40 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56c1f42c0 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.815+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd56c0c6040 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.816+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd56c04f500 con 0x7fd550004800 2024-04-24T23:10:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.817+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd55c00cbe0 con 0x7fd550004800 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.818+0000 7fd562a00640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd54806be30 0x7fd54806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.818+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7fd55c08aae0 con 0x7fd550004800 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.819+0000 7fd562a00640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7fd5480722d0 0x7fd548074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.819+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd55c019ec0 con 0x7fd5480722d0 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.819+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd55c08f2c0 con 0x7fd550004800 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.819+0000 7fd561400640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd54806be30 0x7fd54806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.819+0000 7fd56a800640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7fd5480722d0 0x7fd548074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.820+0000 7fd56a800640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7fd5480722d0 0x7fd548074710 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.820+0000 7fd561400640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd54806be30 0x7fd54806e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd554032000 tx=0x7fd55402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.820+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== osd.3 v2:172.21.15.146:6808/1724749641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd55c019ec0 con 0x7fd5480722d0 2024-04-24T23:10:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.835+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 --> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd56c0b0cc0 con 0x7fd5480722d0 2024-04-24T23:10:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.836+0000 7fd562a00640 1 -- 172.21.15.146:0/3422854638 <== osd.3 v2:172.21.15.146:6808/1724749641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd56c0b0cc0 con 0x7fd5480722d0 2024-04-24T23:10:28.838 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:28.838 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:28.838 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.836+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7fd5480722d0 msgr2=0x7fd548074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.836+0000 7fd56b200640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:6808/1724749641,v1:172.21.15.146:6810/1724749641] conn(0x7fd5480722d0 0x7fd548074710 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.836+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd54806be30 msgr2=0x7fd54806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.836+0000 7fd56b200640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fd54806be30 0x7fd54806e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd554032000 tx=0x7fd55402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 msgr2=0x7fd56c0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 --2- 172.21.15.146:0/3422854638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd550004800 0x7fd56c0c8400 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00e780 tx=0x7fd55c00ec40 comp rx=0 tx=0).stop 2024-04-24T23:10:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56a800640 1 -- 172.21.15.146:0/3422854638 reap_dead start 2024-04-24T23:10:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 shutdown_connections 2024-04-24T23:10:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 >> 172.21.15.146:0/3422854638 conn(0x7fd56c0d1ae0 msgr2=0x7fd56c15b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 shutdown_connections 2024-04-24T23:10:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:28.837+0000 7fd56b200640 1 -- 172.21.15.146:0/3422854638 wait complete. 2024-04-24T23:10:28.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T23:10:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.050+0000 7fe169000640 1 Processor -- start 2024-04-24T23:10:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.050+0000 7fe169000640 1 -- start start 2024-04-24T23:10:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.051+0000 7fe169000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe16415d7c0 0x7fe164165a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe169000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16406cff0 con 0x7fe16406cbc0 2024-04-24T23:10:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe169000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16415f6d0 con 0x7fe16415abb0 2024-04-24T23:10:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe169000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe164071960 con 0x7fe16415d7c0 2024-04-24T23:10:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe159400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe16406cbc0 0x7fe16415efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50670/0 (socket says 172.21.15.146:50670) 2024-04-24T23:10:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe159400640 1 -- 172.21.15.146:0/605882928 learned_addr learned my addr 172.21.15.146:0/605882928 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe162800640 1 --2- 172.21.15.146:0/605882928 >> v2:172.21.15.203:3300/0 conn(0x7fe16415d7c0 0x7fe164165a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454098212 0 0) 0x7fe16406cff0 con 0x7fe16406cbc0 2024-04-24T23:10:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.052+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe148003520 con 0x7fe16406cbc0 2024-04-24T23:10:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2138050079 0 0) 0x7fe148003520 con 0x7fe16406cbc0 2024-04-24T23:10:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 >> v2:172.21.15.203:3300/0 conn(0x7fe16415d7c0 msgr2=0x7fe164165a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 --2- 172.21.15.146:0/605882928 >> v2:172.21.15.203:3300/0 conn(0x7fe16415d7c0 0x7fe164165a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 >> v1:172.21.15.203:6789/0 conn(0x7fe16415abb0 legacy=0x7fe16415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe164071c40 con 0x7fe16406cbc0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7fe14c001a10 con 0x7fe16406cbc0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 >> v1:172.21.15.146:6789/0 conn(0x7fe16406cbc0 legacy=0x7fe16415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 0x7fe148003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe148004800 0x7fe148004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1480051c0 0x7fe14800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe164071960 con 0x7fe1480039b0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe14800e270 con 0x7fe1480051c0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe14800e470 con 0x7fe148004800 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.053+0000 7fe161e00640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 0x7fe148003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe162800640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1480051c0 0x7fe14800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe161e00640 1 -- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe148004800 msgr2=0x7fe148004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe161e00640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe148004800 0x7fe148004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe161e00640 1 -- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1480051c0 msgr2=0x7fe14800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe161e00640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1480051c0 0x7fe14800dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe161e00640 1 -- 172.21.15.146:0/605882928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148003520 con 0x7fe1480039b0 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.054+0000 7fe162800640 1 -- 172.21.15.146:0/605882928 reap_dead start 2024-04-24T23:10:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe161e00640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 0x7fe148003dd0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe154001750 tx=0x7fe148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d7808c771562f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154001370 con 0x7fe1480039b0 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1540052d0 con 0x7fe1480039b0 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe161400640 1 -- 172.21.15.146:0/605882928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15402abc0 con 0x7fe1480039b0 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe169000640 1 -- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 msgr2=0x7fe148003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.055+0000 7fe169000640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 0x7fe148003dd0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe154001750 tx=0x7fe148005830 comp rx=0 tx=0).stop 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.056+0000 7fe169000640 1 -- 172.21.15.146:0/605882928 shutdown_connections 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.056+0000 7fe169000640 1 --2- 172.21.15.146:0/605882928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1480039b0 0x7fe148003dd0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.056+0000 7fe169000640 1 -- 172.21.15.146:0/605882928 >> 172.21.15.146:0/605882928 conn(0x7fe16406b140 msgr2=0x7fe16406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.056+0000 7fe169000640 1 -- 172.21.15.146:0/605882928 shutdown_connections 2024-04-24T23:10:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.056+0000 7fe169000640 1 -- 172.21.15.146:0/605882928 wait complete. 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.057+0000 7fe169000640 1 Processor -- start 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.058+0000 7fe169000640 1 -- start start 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.058+0000 7fe169000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 0x7fe16414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.058+0000 7fe169000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.058+0000 7fe169000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 0x7fe16414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe169000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1640cc2f0 con 0x7fe16414b280 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe169000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe164072200 con 0x7fe16414d660 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe169000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe16415e8b0 con 0x7fe1480039b0 2024-04-24T23:10:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40680/0 (socket says 172.21.15.146:40680) 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 -- 172.21.15.146:0/479881474 learned_addr learned my addr 172.21.15.146:0/479881474 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe162800640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 0x7fe16414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe161e00640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 0x7fe16414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 -- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 msgr2=0x7fe16414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 0x7fe16414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 -- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 msgr2=0x7fe16414db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 0x7fe16414db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe159400640 1 -- 172.21.15.146:0/479881474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16414e5d0 con 0x7fe16414b280 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe161e00640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 0x7fe16414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.059+0000 7fe162800640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 0x7fe16414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe159400640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00caa0 tx=0x7fe14c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c018070 con 0x7fe16414b280 2024-04-24T23:10:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c00a730 con 0x7fe16414b280 2024-04-24T23:10:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00ab20 con 0x7fe16414b280 2024-04-24T23:10:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1640cd930 con 0x7fe16414b280 2024-04-24T23:10:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.060+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1640cdeb0 con 0x7fe16414b280 2024-04-24T23:10:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.061+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe164155100 con 0x7fe16414b280 2024-04-24T23:10:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.062+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe14c01b070 con 0x7fe16414b280 2024-04-24T23:10:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.063+0000 7fe15aa00640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 0x7fe14006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.063+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7fe14c08a450 con 0x7fe16414b280 2024-04-24T23:10:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.064+0000 7fe161e00640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 0x7fe14006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.065+0000 7fe161e00640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 0x7fe14006e320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe154032000 tx=0x7fe15402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.068+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe164155100 con 0x7fe16414b280 2024-04-24T23:10:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.266+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe16414e050 con 0x7fe14006be60 2024-04-24T23:10:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.267+0000 7fe15aa00640 1 -- 172.21.15.146:0/479881474 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe16414e050 con 0x7fe14006be60 2024-04-24T23:10:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.269+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 msgr2=0x7fe14006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.269+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 0x7fe14006e320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe154032000 tx=0x7fe15402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.269+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 msgr2=0x7fe1641f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.269+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00caa0 tx=0x7fe14c00cf60 comp rx=0 tx=0).stop 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 shutdown_connections 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe16414d660 0x7fe16414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16414b280 0x7fe1641f3f40 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7fe14006be60 0x7fe14006e320 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 --2- 172.21.15.146:0/479881474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1480039b0 0x7fe16414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 >> 172.21.15.146:0/479881474 conn(0x7fe16406b140 msgr2=0x7fe16415b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 shutdown_connections 2024-04-24T23:10:29.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.270+0000 7fe169000640 1 -- 172.21.15.146:0/479881474 wait complete. 2024-04-24T23:10:29.290 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T23:10:29.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:29.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.478+0000 7f1ae1000640 1 Processor -- start 2024-04-24T23:10:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.479+0000 7f1ae1000640 1 -- start start 2024-04-24T23:10:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.480+0000 7f1ae1000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1adc071f10 0x7f1adc0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.480+0000 7f1ae1000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1adc06dfe0 con 0x7f1adc06e230 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.480+0000 7f1ae1000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1adc160420 con 0x7f1adc06db30 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.480+0000 7f1ae1000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc15d2a0 con 0x7f1adc071f10 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adbe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1adc06e230 0x7f1adc0cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50672/0 (socket says 172.21.15.146:50672) 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adbe00640 1 -- 172.21.15.146:0/3993556410 learned_addr learned my addr 172.21.15.146:0/3993556410 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adb400640 1 --2- 172.21.15.146:0/3993556410 >> v2:172.21.15.203:3300/0 conn(0x7f1adc071f10 0x7f1adc0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312198975 0 0) 0x7f1adc06dfe0 con 0x7f1adc06e230 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ac0003520 con 0x7f1adc06e230 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.481+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2647308037 0 0) 0x7f1ac0003520 con 0x7f1adc06e230 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 >> v2:172.21.15.203:3300/0 conn(0x7f1adc071f10 msgr2=0x7f1adc0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 --2- 172.21.15.146:0/3993556410 >> v2:172.21.15.203:3300/0 conn(0x7f1adc071f10 0x7f1adc0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 >> v1:172.21.15.203:6789/0 conn(0x7f1adc06db30 legacy=0x7f1adc15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc15c390 con 0x7f1adc06e230 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f1ad40019f0 con 0x7f1adc06e230 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 >> v1:172.21.15.146:6789/0 conn(0x7f1adc06e230 legacy=0x7f1adc0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1ac0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac00051c0 0x7f1ac000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc15d2a0 con 0x7f1ac0004800 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac000c0f0 con 0x7f1ac0003a20 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac000c2f0 con 0x7f1ac00051c0 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1ac0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adb400640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1adbe00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac00051c0 0x7f1ac000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1ad3e00640 1 -- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac00051c0 msgr2=0x7f1ac000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac00051c0 0x7f1ac000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1ad3e00640 1 -- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac0003a20 msgr2=0x7f1ac0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.482+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.483+0000 7f1ad3e00640 1 -- 172.21.15.146:0/3993556410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac0003520 con 0x7f1ac0004800 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.483+0000 7f1adbe00640 1 -- 172.21.15.146:0/3993556410 reap_dead start 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1ac0004c80 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4001750 tx=0x7f1ac0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40edf5d58996996a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4001370 con 0x7f1ac0004800 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac40052d0 con 0x7f1ac0004800 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1adaa00640 1 -- 172.21.15.146:0/3993556410 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac402abc0 con 0x7f1ac0004800 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1ae1000640 1 -- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 msgr2=0x7f1ac0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.484+0000 7f1ae1000640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1ac0004c80 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4001750 tx=0x7f1ac0005830 comp rx=0 tx=0).stop 2024-04-24T23:10:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.485+0000 7f1ae1000640 1 -- 172.21.15.146:0/3993556410 shutdown_connections 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.485+0000 7f1ae1000640 1 --2- 172.21.15.146:0/3993556410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1ac0004c80 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.485+0000 7f1ae1000640 1 -- 172.21.15.146:0/3993556410 >> 172.21.15.146:0/3993556410 conn(0x7f1adc0b1460 msgr2=0x7f1adc0b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.485+0000 7f1ae1000640 1 -- 172.21.15.146:0/3993556410 shutdown_connections 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.485+0000 7f1ae1000640 1 -- 172.21.15.146:0/3993556410 wait complete. 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.486+0000 7f1ae1000640 1 Processor -- start 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.487+0000 7f1ae1000640 1 -- start start 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.487+0000 7f1ae1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1adc144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.487+0000 7f1ae1000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1adc157170 0x7f1adc1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1ae1000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1adc142ae0 0x7f1adc0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1ae1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc15c700 con 0x7f1ac0004800 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1ae1000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0722f0 con 0x7f1adc157170 2024-04-24T23:10:29.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1ae1000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc159ce0 con 0x7f1adc142ae0 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1adc144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1adc144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40688/0 (socket says 172.21.15.146:40688) 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 -- 172.21.15.146:0/1846124975 learned_addr learned my addr 172.21.15.146:0/1846124975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adbe00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1adc142ae0 0x7f1adc0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 -- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1adc142ae0 msgr2=0x7f1adc0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1adc157170 0x7f1adc1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1adc142ae0 0x7f1adc0b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 -- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1adc157170 msgr2=0x7f1adc1f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1adc157170 0x7f1adc1f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.488+0000 7f1adb400640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc145150 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1adb400640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1adc144b40 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1acc011510 tx=0x7f1acc0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc015870 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc015a10 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc015dc0 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc145430 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.489+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc148e30 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.490+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1adc04f500 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.491+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1acc013400 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.492+0000 7f1ad3400640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ab806be30 0x7f1ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.492+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f1acc08b6c0 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.492+0000 7f1ad3400640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f1ab80722d0 0x7f1ab8074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.492+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1acc004490 con 0x7f1ab80722d0 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.492+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f1acc092050 con 0x7f1ac0004800 2024-04-24T23:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.493+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ab806be30 0x7f1ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.493+0000 7f1adbe00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f1ab80722d0 0x7f1ab8074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.494+0000 7f1ad3e00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ab806be30 0x7f1ab806e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4032000 tx=0x7f1ac402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.494+0000 7f1adbe00640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f1ab80722d0 0x7f1ab8074710 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.497+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== osd.4 v2:172.21.15.203:6810/306347931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1acc004490 con 0x7f1ab80722d0 2024-04-24T23:10:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.511+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 --> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1adc0724a0 con 0x7f1ab80722d0 2024-04-24T23:10:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.513+0000 7f1ad3400640 1 -- 172.21.15.146:0/1846124975 <== osd.4 v2:172.21.15.203:6810/306347931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1adc0724a0 con 0x7f1ab80722d0 2024-04-24T23:10:29.515 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:29.515 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:29.515 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.513+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f1ab80722d0 msgr2=0x7f1ab8074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.513+0000 7f1ae1000640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6810/306347931,v1:172.21.15.203:6812/306347931] conn(0x7f1ab80722d0 0x7f1ab8074710 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ab806be30 msgr2=0x7f1ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f1ab806be30 0x7f1ab806e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4032000 tx=0x7f1ac402e000 comp rx=0 tx=0).stop 2024-04-24T23:10:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 msgr2=0x7f1adc144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 --2- 172.21.15.146:0/1846124975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ac0004800 0x7f1adc144b40 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1acc011510 tx=0x7f1acc0119d0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1adbe00640 1 -- 172.21.15.146:0/1846124975 reap_dead start 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 shutdown_connections 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 >> 172.21.15.146:0/1846124975 conn(0x7f1adc0b1460 msgr2=0x7f1adc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 shutdown_connections 2024-04-24T23:10:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.514+0000 7f1ae1000640 1 -- 172.21.15.146:0/1846124975 wait complete. 2024-04-24T23:10:29.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T23:10:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.727+0000 7f2277200640 1 Processor -- start 2024-04-24T23:10:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.727+0000 7f2277200640 1 -- start start 2024-04-24T23:10:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2277200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f2278072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2277200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227815c1a0 con 0x7f22780aef40 2024-04-24T23:10:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2277200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2278072c70 con 0x7f227815cd80 2024-04-24T23:10:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2277200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f22780cc5d0 con 0x7f227815bdc0 2024-04-24T23:10:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2276800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f22780aef40 0x7f22780cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50684/0 (socket says 172.21.15.146:50684) 2024-04-24T23:10:29.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.729+0000 7f2276800640 1 -- 172.21.15.146:0/98054528 learned_addr learned my addr 172.21.15.146:0/98054528 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275e00640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f2278072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315755224 0 0) 0x7f227815c1a0 con 0x7f22780aef40 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f225c003520 con 0x7f22780aef40 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 643191122 0 0) 0x7f225c003520 con 0x7f22780aef40 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 msgr2=0x7f2278072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f2278072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 >> v1:172.21.15.203:6789/0 conn(0x7f227815cd80 legacy=0x7f22780ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278070b00 con 0x7f22780aef40 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f22700019f0 con 0x7f22780aef40 2024-04-24T23:10:29.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 >> v1:172.21.15.146:6789/0 conn(0x7f22780aef40 legacy=0x7f22780cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f225c0039e0 0x7f225c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.730+0000 7f2275400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f225c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2275400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22780cc5d0 con 0x7f225c004d40 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f225c00baf0 con 0x7f225c0039e0 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f225c00bcf0 con 0x7f227815bdc0 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2275e00640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f225c0039e0 0x7f225c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f226d400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f225c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 -- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 msgr2=0x7f225c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f225c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 -- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f225c0039e0 msgr2=0x7f225c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:29.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f225c0039e0 0x7f225c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f2276800640 1 -- 172.21.15.146:0/98054528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c003520 con 0x7f225c004d40 2024-04-24T23:10:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.731+0000 7f226d400640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f227815bdc0 0x7f225c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.732+0000 7f2276800640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f227000a840 tx=0x7f225c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aca860e012b442 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227000a460 con 0x7f225c004d40 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227002f070 con 0x7f225c004d40 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2275400640 1 -- 172.21.15.146:0/98054528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227002bcb0 con 0x7f225c004d40 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 -- 172.21.15.146:0/98054528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f225c004d40 msgr2=0x7f225c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 --2- 172.21.15.146:0/98054528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f227000a840 tx=0x7f225c005830 comp rx=0 tx=0).stop 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2276800640 1 -- 172.21.15.146:0/98054528 reap_dead start 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 -- 172.21.15.146:0/98054528 shutdown_connections 2024-04-24T23:10:29.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 -- 172.21.15.146:0/98054528 >> 172.21.15.146:0/98054528 conn(0x7f22780b1560 msgr2=0x7f22780b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 -- 172.21.15.146:0/98054528 shutdown_connections 2024-04-24T23:10:29.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.733+0000 7f2277200640 1 -- 172.21.15.146:0/98054528 wait complete. 2024-04-24T23:10:29.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.735+0000 7f2277200640 1 Processor -- start 2024-04-24T23:10:29.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.735+0000 7f2277200640 1 -- start start 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f225c004d40 0x7f22780b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 0x7f22780b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22780710c0 con 0x7f22780b08b0 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22780cf6b0 con 0x7f22781504f0 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2277200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f22780713a0 con 0x7f225c004d40 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.736+0000 7f2276800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40704/0 (socket says 172.21.15.146:40704) 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 -- 172.21.15.146:0/3101171048 learned_addr learned my addr 172.21.15.146:0/3101171048 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f226d400640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 0x7f22780b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 -- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f225c004d40 msgr2=0x7f22780b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2275e00640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f225c004d40 0x7f22780b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f225c004d40 0x7f22780b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 -- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 msgr2=0x7f22780b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 0x7f22780b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 -- 172.21.15.146:0/3101171048 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22780b4910 con 0x7f22780b08b0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f226d400640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 0x7f22780b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.737+0000 7f2276800640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2270000f80 tx=0x7f2278070cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.738+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227000a460 con 0x7f22780b08b0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.738+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227002cb10 con 0x7f22780b08b0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.738+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270001fb0 con 0x7f22780b08b0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.738+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2278155a00 con 0x7f22780b08b0 2024-04-24T23:10:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.738+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2278155fc0 con 0x7f22780b08b0 2024-04-24T23:10:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.739+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22780b0d30 con 0x7f22780b08b0 2024-04-24T23:10:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.740+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2270046060 con 0x7f22780b08b0 2024-04-24T23:10:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.741+0000 7f226ea00640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.741+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f22700aa9e0 con 0x7f22780b08b0 2024-04-24T23:10:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.742+0000 7f2275e00640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:29.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.743+0000 7f2275e00640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2268009950 tx=0x7f2268008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.745+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f22700794f0 con 0x7f22780b08b0 2024-04-24T23:10:29.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.945+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f227804f560 con 0x7f225406be30 2024-04-24T23:10:29.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.946+0000 7f226ea00640 1 -- 172.21.15.146:0/3101171048 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f227804f560 con 0x7f225406be30 2024-04-24T23:10:29.948 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T23:10:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 msgr2=0x7f225406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2268009950 tx=0x7f2268008040 comp rx=0 tx=0).stop 2024-04-24T23:10:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 msgr2=0x7f2278154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2270000f80 tx=0x7f2278070cd0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 shutdown_connections 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22780b08b0 0x7f2278154290 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22781504f0 0x7f22780b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 --2- 172.21.15.146:0/3101171048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f225c004d40 0x7f22780b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 >> 172.21.15.146:0/3101171048 conn(0x7f22780b1560 msgr2=0x7f227815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 shutdown_connections 2024-04-24T23:10:29.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:29.949+0000 7f2277200640 1 -- 172.21.15.146:0/3101171048 wait complete. 2024-04-24T23:10:29.970 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T23:10:29.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.175+0000 7f33c1800640 1 Processor -- start 2024-04-24T23:10:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.176+0000 7f33c1800640 1 -- start start 2024-04-24T23:10:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.177+0000 7f33c1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 0x7f33bc1622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.177+0000 7f33c1800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33bc0ae160 0x7f33bc0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.177+0000 7f33c1800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33bc071c10 con 0x7f33bc1616f0 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.177+0000 7f33c1800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc071ef0 con 0x7f33bc0ae160 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.177+0000 7f33c1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc0721d0 con 0x7f33bc072620 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33baa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f33bc1616f0 0x7f33bc161b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50696/0 (socket says 172.21.15.146:50696) 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33baa00640 1 -- 172.21.15.146:0/3758500570 learned_addr learned my addr 172.21.15.146:0/3758500570 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33bb400640 1 --2- 172.21.15.146:0/3758500570 >> v2:172.21.15.146:3300/0 conn(0x7f33bc0ae160 0x7f33bc0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33b3e00640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 0x7f33bc1622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33ba000640 1 -- 172.21.15.146:0/3758500570 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382395062 0 0) 0x7f33bc071c10 con 0x7f33bc1616f0 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33ba000640 1 -- 172.21.15.146:0/3758500570 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a0003520 con 0x7f33bc1616f0 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33bb400640 1 -- 172.21.15.146:0/3758500570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 msgr2=0x7f33bc1622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33bb400640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 0x7f33bc1622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33bb400640 1 -- 172.21.15.146:0/3758500570 >> v1:172.21.15.146:6789/0 conn(0x7f33bc1616f0 legacy=0x7f33bc161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33bb400640 1 -- 172.21.15.146:0/3758500570 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc0ad960 con 0x7f33bc0ae160 2024-04-24T23:10:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.178+0000 7f33b3e00640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 0x7f33bc1622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.179+0000 7f33bb400640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc0ae160 0x7f33bc0ae5f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009dc0 tx=0x7f33b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef5409d12f7c509 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.179+0000 7f33ba000640 1 -- 172.21.15.146:0/3758500570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b402ae60 con 0x7f33bc0ae160 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33ba000640 1 -- 172.21.15.146:0/3758500570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4007740 con 0x7f33bc0ae160 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33ba000640 1 -- 172.21.15.146:0/3758500570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4007b10 con 0x7f33bc0ae160 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 -- 172.21.15.146:0/3758500570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc0ae160 msgr2=0x7f33bc0ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc0ae160 0x7f33bc0ae5f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009dc0 tx=0x7f33b402a680 comp rx=0 tx=0).stop 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 -- 172.21.15.146:0/3758500570 shutdown_connections 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc0ae160 0x7f33bc0ae5f0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 --2- 172.21.15.146:0/3758500570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc072620 0x7f33bc1622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 -- 172.21.15.146:0/3758500570 >> 172.21.15.146:0/3758500570 conn(0x7f33bc0b16b0 msgr2=0x7f33bc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.180+0000 7f33c1800640 1 -- 172.21.15.146:0/3758500570 shutdown_connections 2024-04-24T23:10:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.181+0000 7f33c1800640 1 -- 172.21.15.146:0/3758500570 wait complete. 2024-04-24T23:10:30.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.182+0000 7f33c1800640 1 Processor -- start 2024-04-24T23:10:30.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.182+0000 7f33c1800640 1 -- start start 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33bc072620 0x7f33bc1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc0ae160 0x7f33bc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 0x7f33bc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc06cdf0 con 0x7f33bc1616f0 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc0718c0 con 0x7f33bc072620 2024-04-24T23:10:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.183+0000 7f33c1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc1627e0 con 0x7f33bc0ae160 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 0x7f33bc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 0x7f33bc0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40724/0 (socket says 172.21.15.146:40724) 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 -- 172.21.15.146:0/258177912 learned_addr learned my addr 172.21.15.146:0/258177912 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33b3e00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc0ae160 0x7f33bc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 -- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc0ae160 msgr2=0x7f33bc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33bc0ae160 0x7f33bc0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 -- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33bc072620 msgr2=0x7f33bc1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33bc072620 0x7f33bc1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc0ccbf0 con 0x7f33bc1616f0 2024-04-24T23:10:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.184+0000 7f33bb400640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 0x7f33bc0cc6b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f33b402ac70 tx=0x7f33b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.185+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4040070 con 0x7f33bc1616f0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.185+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4031a40 con 0x7f33bc1616f0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.185+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4031c10 con 0x7f33bc1616f0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.185+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc0af770 con 0x7f33bc1616f0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.185+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc0afd30 con 0x7f33bc1616f0 2024-04-24T23:10:30.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.186+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33bc0af520 con 0x7f33bc1616f0 2024-04-24T23:10:30.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.187+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33b4039040 con 0x7f33bc1616f0 2024-04-24T23:10:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.188+0000 7f33b2a00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f339806be30 0x7f339806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.188+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f33b40ac370 con 0x7f33bc1616f0 2024-04-24T23:10:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.188+0000 7f33b2a00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f33980722d0 0x7f3398074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.188+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33b403ee50 con 0x7f33980722d0 2024-04-24T23:10:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.188+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f33b40b3050 con 0x7f33bc1616f0 2024-04-24T23:10:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.189+0000 7f33baa00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f339806be30 0x7f339806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.189+0000 7f33b3e00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f33980722d0 0x7f3398074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.190+0000 7f33baa00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f339806be30 0x7f339806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000f60 tx=0x7f33ac0078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.190+0000 7f33b3e00640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f33980722d0 0x7f3398074710 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.192+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== osd.5 v2:172.21.15.203:6800/1152275008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33b403ee50 con 0x7f33980722d0 2024-04-24T23:10:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.207+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 --> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33bc0b0230 con 0x7f33980722d0 2024-04-24T23:10:30.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.208+0000 7f33b2a00640 1 -- 172.21.15.146:0/258177912 <== osd.5 v2:172.21.15.203:6800/1152275008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f33a4008540 con 0x7f33980722d0 2024-04-24T23:10:30.210 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:30.210 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:30.210 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:30.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.208+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f33980722d0 msgr2=0x7f3398074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.208+0000 7f33c1800640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6800/1152275008,v1:172.21.15.203:6801/1152275008] conn(0x7f33980722d0 0x7f3398074710 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f339806be30 msgr2=0x7f339806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f339806be30 0x7f339806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000f60 tx=0x7f33ac0078f0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 msgr2=0x7f33bc0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 --2- 172.21.15.146:0/258177912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc1616f0 0x7f33bc0cc6b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f33b402ac70 tx=0x7f33b4004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33bb400640 1 -- 172.21.15.146:0/258177912 reap_dead start 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 shutdown_connections 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 >> 172.21.15.146:0/258177912 conn(0x7f33bc0b16b0 msgr2=0x7f33bc06daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 shutdown_connections 2024-04-24T23:10:30.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.209+0000 7f33c1800640 1 -- 172.21.15.146:0/258177912 wait complete. 2024-04-24T23:10:30.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T23:10:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.428+0000 7f5908400640 1 Processor -- start 2024-04-24T23:10:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.428+0000 7f5908400640 1 -- start start 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.429+0000 7f5908400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59001619c0 0x7f59000b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.429+0000 7f5908400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 0x7f59000d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.429+0000 7f5908400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59000cf7a0 con 0x7f59000d2a90 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.429+0000 7f5908400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f59000d2f00 con 0x7f59001619c0 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.429+0000 7f5908400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f59000b6dc0 con 0x7f59000b5590 2024-04-24T23:10:30.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.430+0000 7f5905a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59001619c0 0x7f59000b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.430+0000 7f5905000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 0x7f59000d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.430+0000 7f5905a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59001619c0 0x7f59000b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.146:47616/0 (socket says 172.21.15.146:47616) 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.430+0000 7f5905a00640 1 -- 172.21.15.146:0/3133669713 learned_addr learned my addr 172.21.15.146:0/3133669713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.430+0000 7f5906400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f59000d2a90 0x7f59000d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.146:34616/0 (socket says 172.21.15.146:34616) 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.431+0000 7f5905a00640 1 -- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 msgr2=0x7f59000d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.431+0000 7f5905a00640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 0x7f59000d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.431+0000 7f5905a00640 1 -- 172.21.15.146:0/3133669713 >> v1:172.21.15.203:6789/0 conn(0x7f59000d2a90 legacy=0x7f59000d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.431+0000 7f5905a00640 1 -- 172.21.15.146:0/3133669713 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59000cfa40 con 0x7f59001619c0 2024-04-24T23:10:30.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.431+0000 7f5905000640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 0x7f59000d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.433+0000 7f5905a00640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59001619c0 0x7f59000b5050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009e50 tx=0x7f58f002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0fa18c202f92064 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.433+0000 7f58ffe00640 1 -- 172.21.15.146:0/3133669713 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0036070 con 0x7f59001619c0 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.433+0000 7f58ffe00640 1 -- 172.21.15.146:0/3133669713 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0031600 con 0x7f59001619c0 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.433+0000 7f58ffe00640 1 -- 172.21.15.146:0/3133669713 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00319d0 con 0x7f59001619c0 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 -- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59001619c0 msgr2=0x7f59000b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59001619c0 0x7f59000b5050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009e50 tx=0x7f58f002a5f0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 -- 172.21.15.146:0/3133669713 shutdown_connections 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59000b5590 0x7f59000d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 --2- 172.21.15.146:0/3133669713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59001619c0 0x7f59000b5050 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 -- 172.21.15.146:0/3133669713 >> 172.21.15.146:0/3133669713 conn(0x7f59000d3f70 msgr2=0x7f59000d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 -- 172.21.15.146:0/3133669713 shutdown_connections 2024-04-24T23:10:30.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.434+0000 7f5908400640 1 -- 172.21.15.146:0/3133669713 wait complete. 2024-04-24T23:10:30.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.436+0000 7f5908400640 1 Processor -- start 2024-04-24T23:10:30.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.436+0000 7f5908400640 1 -- start start 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59000b5590 0x7f59000ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59001619c0 0x7f59000d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f59000d1f70 con 0x7f59000d2a90 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59000b7010 con 0x7f59000b5590 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5908400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5900161da0 con 0x7f59001619c0 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.437+0000 7f5905000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40730/0 (socket says 172.21.15.146:40730) 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 -- 172.21.15.146:0/1884129862 learned_addr learned my addr 172.21.15.146:0/1884129862 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905a00640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59000b5590 0x7f59000ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5906400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59001619c0 0x7f59000d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 -- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59001619c0 msgr2=0x7f59000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59001619c0 0x7f59000d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 -- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59000b5590 msgr2=0x7f59000ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59000b5590 0x7f59000ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 -- 172.21.15.146:0/1884129862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59000b21f0 con 0x7f59000d2a90 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.438+0000 7f5905000640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00e960 tx=0x7f58ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.439+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec017070 con 0x7f59000d2a90 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.439+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec00ca00 con 0x7f59000d2a90 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.439+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00cdd0 con 0x7f59000d2a90 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.439+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59000b24d0 con 0x7f59000d2a90 2024-04-24T23:10:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.439+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59000b2a90 con 0x7f59000d2a90 2024-04-24T23:10:30.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.440+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590015bad0 con 0x7f59000d2a90 2024-04-24T23:10:30.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.441+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58ec01a070 con 0x7f59000d2a90 2024-04-24T23:10:30.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.442+0000 7f58fd600640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 0x7f58e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.442+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f58ec08afe0 con 0x7f59000d2a90 2024-04-24T23:10:30.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.443+0000 7f5905a00640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 0x7f58e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.444+0000 7f5905a00640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 0x7f58e006e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f58f0033000 tx=0x7f58f0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.447+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f58ec059a80 con 0x7f59000d2a90 2024-04-24T23:10:30.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.647+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f59000d2330 con 0x7f58e006be30 2024-04-24T23:10:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.648+0000 7f58fd600640 1 -- 172.21.15.146:0/1884129862 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59000d2330 con 0x7f58e006be30 2024-04-24T23:10:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 msgr2=0x7f58e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 0x7f58e006e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f58f0033000 tx=0x7f58f0009000 comp rx=0 tx=0).stop 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 msgr2=0x7f59000b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00e960 tx=0x7f58ec00ee20 comp rx=0 tx=0).stop 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 shutdown_connections 2024-04-24T23:10:30.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f58e006be30 0x7f58e006e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59001619c0 0x7f59000d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59000d2a90 0x7f59000b1630 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 --2- 172.21.15.146:0/1884129862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59000b5590 0x7f59000ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 >> 172.21.15.146:0/1884129862 conn(0x7f59000d3f70 msgr2=0x7f590015f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 shutdown_connections 2024-04-24T23:10:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.651+0000 7f5908400640 1 -- 172.21.15.146:0/1884129862 wait complete. 2024-04-24T23:10:30.674 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T23:10:30.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.883+0000 7f4555200640 1 Processor -- start 2024-04-24T23:10:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.883+0000 7f4555200640 1 -- start start 2024-04-24T23:10:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f4555200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f455006dcd0 0x7f455006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f4555200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f455006e110 0x7f455006b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f4555200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45500af920 con 0x7f455015de40 2024-04-24T23:10:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f4555200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f45500d0a60 con 0x7f455006dcd0 2024-04-24T23:10:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f4555200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f45500afc00 con 0x7f455006e110 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f454d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f455006dcd0 0x7f455006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f454d400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f455006dcd0 0x7f455006b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40742/0 (socket says 172.21.15.146:40742) 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.885+0000 7f454d400640 1 -- 172.21.15.146:0/3382985520 learned_addr learned my addr 172.21.15.146:0/3382985520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.886+0000 7f454e800640 1 --2- 172.21.15.146:0/3382985520 >> v2:172.21.15.203:3300/0 conn(0x7f455006e110 0x7f455006b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.886+0000 7f454d400640 1 -- 172.21.15.146:0/3382985520 >> v2:172.21.15.203:3300/0 conn(0x7f455006e110 msgr2=0x7f455006b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.886+0000 7f454d400640 1 --2- 172.21.15.146:0/3382985520 >> v2:172.21.15.203:3300/0 conn(0x7f455006e110 0x7f455006b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.886+0000 7f454d400640 1 -- 172.21.15.146:0/3382985520 >> v1:172.21.15.203:6789/0 conn(0x7f455015de40 legacy=0x7f455006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.886+0000 7f454d400640 1 -- 172.21.15.146:0/3382985520 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45500afee0 con 0x7f455006dcd0 2024-04-24T23:10:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.887+0000 7f454d400640 1 --2- 172.21.15.146:0/3382985520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455006dcd0 0x7f455006b140 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f45500b36f0 tx=0x7f453c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84862579f3f696bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.887+0000 7f454ca00640 1 -- 172.21.15.146:0/3382985520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c037070 con 0x7f455006dcd0 2024-04-24T23:10:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.887+0000 7f454ca00640 1 -- 172.21.15.146:0/3382985520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c032440 con 0x7f455006dcd0 2024-04-24T23:10:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.887+0000 7f454ca00640 1 -- 172.21.15.146:0/3382985520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c032810 con 0x7f455006dcd0 2024-04-24T23:10:30.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 -- 172.21.15.146:0/3382985520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455006dcd0 msgr2=0x7f455006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 --2- 172.21.15.146:0/3382985520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455006dcd0 0x7f455006b140 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f45500b36f0 tx=0x7f453c02a230 comp rx=0 tx=0).stop 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 -- 172.21.15.146:0/3382985520 shutdown_connections 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 --2- 172.21.15.146:0/3382985520 >> v2:172.21.15.203:3300/0 conn(0x7f455006e110 0x7f455006b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 --2- 172.21.15.146:0/3382985520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455006dcd0 0x7f455006b140 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 -- 172.21.15.146:0/3382985520 >> 172.21.15.146:0/3382985520 conn(0x7f45500b27c0 msgr2=0x7f45500b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 -- 172.21.15.146:0/3382985520 shutdown_connections 2024-04-24T23:10:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.888+0000 7f4555200640 1 -- 172.21.15.146:0/3382985520 wait complete. 2024-04-24T23:10:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.890+0000 7f4555200640 1 Processor -- start 2024-04-24T23:10:30.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.890+0000 7f4555200640 1 -- start start 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f455006dcd0 0x7f4550156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455006e110 0x7f4550149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 0x7f45501f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45500b5ac0 con 0x7f455015de40 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45500b04a0 con 0x7f455006e110 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f4555200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f45500b5c40 con 0x7f455006dcd0 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.891+0000 7f454e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 0x7f45501f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 0x7f45501f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40744/0 (socket says 172.21.15.146:40744) 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 -- 172.21.15.146:0/1141376337 learned_addr learned my addr 172.21.15.146:0/1141376337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454d400640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455006e110 0x7f4550149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 -- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f455006dcd0 msgr2=0x7f4550156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f455006dcd0 0x7f4550156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 -- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455006e110 msgr2=0x7f4550149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455006e110 0x7f4550149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550156720 con 0x7f455015de40 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454d400640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f455006e110 0x7f4550149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f454e800640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 0x7f45501f4560 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f4548007e30 tx=0x7f454800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.892+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548014620 con 0x7f455015de40 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.893+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548019070 con 0x7f455015de40 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.893+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4550156a00 con 0x7f455015de40 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.893+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548014a00 con 0x7f455015de40 2024-04-24T23:10:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.893+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4550156fc0 con 0x7f455015de40 2024-04-24T23:10:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.893+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45501573a0 con 0x7f455015de40 2024-04-24T23:10:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.895+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4548014ba0 con 0x7f455015de40 2024-04-24T23:10:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f4546000640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453006be30 0x7f453006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f454808b6a0 con 0x7f455015de40 2024-04-24T23:10:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f4546000640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f45300722d0 0x7f4530074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f454800ce50 con 0x7f45300722d0 2024-04-24T23:10:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f4548092050 con 0x7f455015de40 2024-04-24T23:10:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.896+0000 7f454de00640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453006be30 0x7f453006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.897+0000 7f454d400640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f45300722d0 0x7f4530074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.898+0000 7f454de00640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453006be30 0x7f453006e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4540006fd0 tx=0x7f4540006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.898+0000 7f454d400640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f45300722d0 0x7f4530074710 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.900+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== osd.6 v2:172.21.15.203:6807/3736386787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f454800ce50 con 0x7f45300722d0 2024-04-24T23:10:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.915+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 --> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4550068190 con 0x7f45300722d0 2024-04-24T23:10:30.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.916+0000 7f4546000640 1 -- 172.21.15.146:0/1141376337 <== osd.6 v2:172.21.15.203:6807/3736386787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4550068190 con 0x7f45300722d0 2024-04-24T23:10:30.919 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:30.919 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:30.919 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f45300722d0 msgr2=0x7f4530074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6807/3736386787,v1:172.21.15.203:6809/3736386787] conn(0x7f45300722d0 0x7f4530074710 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453006be30 msgr2=0x7f453006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f453006be30 0x7f453006e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4540006fd0 tx=0x7f4540006bc0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 msgr2=0x7f45501f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 --2- 172.21.15.146:0/1141376337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f455015de40 0x7f45501f4560 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f4548007e30 tx=0x7f454800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f454e800640 1 -- 172.21.15.146:0/1141376337 reap_dead start 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 shutdown_connections 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 >> 172.21.15.146:0/1141376337 conn(0x7f45500b27c0 msgr2=0x7f45500b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 shutdown_connections 2024-04-24T23:10:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:30.917+0000 7f4555200640 1 -- 172.21.15.146:0/1141376337 wait complete. 2024-04-24T23:10:30.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T23:10:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.141+0000 7f3d6f200640 1 Processor -- start 2024-04-24T23:10:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.142+0000 7f3d6f200640 1 -- start start 2024-04-24T23:10:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d7015bdc0 0x7f3d70072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 0x7f3d700718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d700aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3d700cc5d0 con 0x7f3d7015bdc0 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3d700cf6b0 con 0x7f3d7015cd80 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3d70071e00 con 0x7f3d700ae830 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.143+0000 7f3d6de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d7015bdc0 0x7f3d70072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d7015bdc0 0x7f3d70072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40756/0 (socket says 172.21.15.146:40756) 2024-04-24T23:10:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 -- 172.21.15.146:0/1073889985 learned_addr learned my addr 172.21.15.146:0/1073889985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6e800640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d700aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d65400640 1 --2- 172.21.15.146:0/1073889985 >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 0x7f3d700718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 -- 172.21.15.146:0/1073889985 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 msgr2=0x7f3d700aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d700aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 -- 172.21.15.146:0/1073889985 >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 msgr2=0x7f3d700718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 --2- 172.21.15.146:0/1073889985 >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 0x7f3d700718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6de00640 1 -- 172.21.15.146:0/1073889985 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7015c1a0 con 0x7f3d7015bdc0 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d65400640 1 --2- 172.21.15.146:0/1073889985 >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 0x7f3d700718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.144+0000 7f3d6e800640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d700aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:31.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.145+0000 7f3d6de00640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d70072690 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3d700cc1c0 tx=0x7f3d6002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbb896e438d0d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.145+0000 7f3d6d400640 1 -- 172.21.15.146:0/1073889985 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60037070 con 0x7f3d7015bdc0 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6d400640 1 -- 172.21.15.146:0/1073889985 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d60032440 con 0x7f3d7015bdc0 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6d400640 1 -- 172.21.15.146:0/1073889985 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60032810 con 0x7f3d7015bdc0 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 -- 172.21.15.146:0/1073889985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 msgr2=0x7f3d70072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d70072690 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3d700cc1c0 tx=0x7f3d6002a180 comp rx=0 tx=0).stop 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 -- 172.21.15.146:0/1073889985 shutdown_connections 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d700aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 --2- 172.21.15.146:0/1073889985 >> v2:172.21.15.203:3300/0 conn(0x7f3d7015cd80 0x7f3d700718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 --2- 172.21.15.146:0/1073889985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d70072690 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 -- 172.21.15.146:0/1073889985 >> 172.21.15.146:0/1073889985 conn(0x7f3d700b1560 msgr2=0x7f3d700b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 -- 172.21.15.146:0/1073889985 shutdown_connections 2024-04-24T23:10:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.146+0000 7f3d6f200640 1 -- 172.21.15.146:0/1073889985 wait complete. 2024-04-24T23:10:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.148+0000 7f3d6f200640 1 Processor -- start 2024-04-24T23:10:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.148+0000 7f3d6f200640 1 -- start start 2024-04-24T23:10:31.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d70150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d7015cd80 0x7f3d70154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70070b00 con 0x7f3d7015bdc0 2024-04-24T23:10:31.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70072c70 con 0x7f3d7015cd80 2024-04-24T23:10:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d6f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3d70070de0 con 0x7f3d700ae830 2024-04-24T23:10:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d65400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d65400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40764/0 (socket says 172.21.15.146:40764) 2024-04-24T23:10:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.149+0000 7f3d65400640 1 -- 172.21.15.146:0/681818550 learned_addr learned my addr 172.21.15.146:0/681818550 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 -- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 msgr2=0x7f3d70150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d70150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 -- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d7015cd80 msgr2=0x7f3d70154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d7015cd80 0x7f3d70154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 -- 172.21.15.146:0/681818550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7015a720 con 0x7f3d7015bdc0 2024-04-24T23:10:31.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d65400640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c7f0 tx=0x7f3d5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58015070 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d58007820 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58007bd0 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.150+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d70159140 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.151+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d70159700 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.152+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7004f500 con 0x7f3d7015bdc0 2024-04-24T23:10:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.153+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d58018070 con 0x7f3d7015bdc0 2024-04-24T23:10:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.153+0000 7f3d66a00640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 0x7f3d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.154+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f3d5808ae50 con 0x7f3d7015bdc0 2024-04-24T23:10:31.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.154+0000 7f3d6de00640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 0x7f3d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.155+0000 7f3d6de00640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 0x7f3d4c06e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.158+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d580598d0 con 0x7f3d7015bdc0 2024-04-24T23:10:31.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.357+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3d700b2050 con 0x7f3d4c06be30 2024-04-24T23:10:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.358+0000 7f3d66a00640 1 -- 172.21.15.146:0/681818550 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d700b2050 con 0x7f3d4c06be30 2024-04-24T23:10:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 msgr2=0x7f3d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 0x7f3d4c06e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3d60034000 tx=0x7f3d6002c000 comp rx=0 tx=0).stop 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 msgr2=0x7f3d7015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c7f0 tx=0x7f3d5800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 shutdown_connections 2024-04-24T23:10:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d7015cd80 0x7f3d70154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d7015bdc0 0x7f3d7015a1e0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3d4c06be30 0x7f3d4c06e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 --2- 172.21.15.146:0/681818550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3d700ae830 0x7f3d70150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 >> 172.21.15.146:0/681818550 conn(0x7f3d700b1560 msgr2=0x7f3d700b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 shutdown_connections 2024-04-24T23:10:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.361+0000 7f3d6f200640 1 -- 172.21.15.146:0/681818550 wait complete. 2024-04-24T23:10:31.383 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T23:10:31.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:10:31.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.588+0000 7f7260200640 1 Processor -- start 2024-04-24T23:10:31.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.589+0000 7f7260200640 1 -- start start 2024-04-24T23:10:31.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.590+0000 7f7260200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72581622e0 0x7f725815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.590+0000 7f7260200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72580d0300 con 0x7f72580cdce0 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.590+0000 7f7260200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72580d05e0 con 0x7f7258161ea0 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.590+0000 7f7260200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7258162d00 con 0x7f72581622e0 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725d800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f72580cdce0 0x7f725806fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50700/0 (socket says 172.21.15.146:50700) 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725d800640 1 -- 172.21.15.146:0/2537304677 learned_addr learned my addr 172.21.15.146:0/2537304677 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725e200640 1 --2- 172.21.15.146:0/2537304677 >> v2:172.21.15.146:3300/0 conn(0x7f72581622e0 0x7f725815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f7257e00640 1 -- 172.21.15.146:0/2537304677 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709617752 0 0) 0x7f72580d0300 con 0x7f72580cdce0 2024-04-24T23:10:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f7257e00640 1 -- 172.21.15.146:0/2537304677 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7240003520 con 0x7f72580cdce0 2024-04-24T23:10:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725e200640 1 -- 172.21.15.146:0/2537304677 >> v1:172.21.15.203:6789/0 conn(0x7f7258161ea0 legacy=0x7f725815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725e200640 1 -- 172.21.15.146:0/2537304677 >> v1:172.21.15.146:6789/0 conn(0x7f72580cdce0 legacy=0x7f725806fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.591+0000 7f725e200640 1 -- 172.21.15.146:0/2537304677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72580d08c0 con 0x7f72581622e0 2024-04-24T23:10:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.592+0000 7f725e200640 1 --2- 172.21.15.146:0/2537304677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f725815e060 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7250009d90 tx=0x7f725002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1337cce29bf97656 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7257e00640 1 -- 172.21.15.146:0/2537304677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250037070 con 0x7f72581622e0 2024-04-24T23:10:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7257e00640 1 -- 172.21.15.146:0/2537304677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7250007740 con 0x7f72581622e0 2024-04-24T23:10:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7257e00640 1 -- 172.21.15.146:0/2537304677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250007b10 con 0x7f72581622e0 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 -- 172.21.15.146:0/2537304677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 msgr2=0x7f725815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 --2- 172.21.15.146:0/2537304677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f725815e060 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7250009d90 tx=0x7f725002a780 comp rx=0 tx=0).stop 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 -- 172.21.15.146:0/2537304677 shutdown_connections 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 --2- 172.21.15.146:0/2537304677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f725815e060 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 -- 172.21.15.146:0/2537304677 >> 172.21.15.146:0/2537304677 conn(0x7f72580b37f0 msgr2=0x7f72580b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 -- 172.21.15.146:0/2537304677 shutdown_connections 2024-04-24T23:10:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.593+0000 7f7260200640 1 -- 172.21.15.146:0/2537304677 wait complete. 2024-04-24T23:10:31.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.595+0000 7f7260200640 1 Processor -- start 2024-04-24T23:10:31.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.595+0000 7f7260200640 1 -- start start 2024-04-24T23:10:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72580cdce0 0x7f725815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7258161ea0 0x7f72580c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f72581e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7258070180 con 0x7f72581622e0 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72580d0f10 con 0x7f7258161ea0 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.596+0000 7f7260200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7258162770 con 0x7f72580cdce0 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f72581e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f72581e9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40774/0 (socket says 172.21.15.146:40774) 2024-04-24T23:10:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 -- 172.21.15.146:0/3564589157 learned_addr learned my addr 172.21.15.146:0/3564589157 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725d800640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72580cdce0 0x7f725815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 -- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72580cdce0 msgr2=0x7f725815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f72580cdce0 0x7f725815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 -- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7258161ea0 msgr2=0x7f72580c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7258161ea0 0x7f72580c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725815c470 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.597+0000 7f725e200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f72581e9020 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7250009eb0 tx=0x7f7250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.598+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250042020 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.598+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72500327f0 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.598+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250037040 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.598+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72581e7ca0 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.598+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72581e8260 con 0x7f72581622e0 2024-04-24T23:10:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.599+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7258068190 con 0x7f72581622e0 2024-04-24T23:10:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.600+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7250045020 con 0x7f72581622e0 2024-04-24T23:10:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.601+0000 7f7255600640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f723c06be30 0x7f723c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.601+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f72500abea0 con 0x7f72581622e0 2024-04-24T23:10:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.601+0000 7f7255600640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f723c0722d0 0x7f723c074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.602+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7250007740 con 0x7f723c0722d0 2024-04-24T23:10:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.602+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f72500ae4c0 con 0x7f72581622e0 2024-04-24T23:10:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.602+0000 7f725d800640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f723c06be30 0x7f723c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.602+0000 7f725ce00640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f723c0722d0 0x7f723c074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.603+0000 7f725d800640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f723c06be30 0x7f723c06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f72480011e0 tx=0x7f7248009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.604+0000 7f725ce00640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f723c0722d0 0x7f723c074710 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.606+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== osd.7 v2:172.21.15.203:6824/1423940067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7250007740 con 0x7f723c0722d0 2024-04-24T23:10:31.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.620+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 --> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f725815c6a0 con 0x7f723c0722d0 2024-04-24T23:10:31.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.621+0000 7f7255600640 1 -- 172.21.15.146:0/3564589157 <== osd.7 v2:172.21.15.203:6824/1423940067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f725815c6a0 con 0x7f723c0722d0 2024-04-24T23:10:31.623 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-24T23:10:31.624 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:10:31.624 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f723c0722d0 msgr2=0x7f723c074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6824/1423940067,v1:172.21.15.203:6825/1423940067] conn(0x7f723c0722d0 0x7f723c074710 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f723c06be30 msgr2=0x7f723c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f723c06be30 0x7f723c06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f72480011e0 tx=0x7f7248009040 comp rx=0 tx=0).stop 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 msgr2=0x7f72581e9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 --2- 172.21.15.146:0/3564589157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72581622e0 0x7f72581e9020 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7250009eb0 tx=0x7f7250004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f725e200640 1 -- 172.21.15.146:0/3564589157 reap_dead start 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 shutdown_connections 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 >> 172.21.15.146:0/3564589157 conn(0x7f72580b37f0 msgr2=0x7f725806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:31.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 shutdown_connections 2024-04-24T23:10:31.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.622+0000 7f7260200640 1 -- 172.21.15.146:0/3564589157 wait complete. 2024-04-24T23:10:31.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-24T23:10:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.841+0000 7f2dde800640 1 Processor -- start 2024-04-24T23:10:31.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.842+0000 7f2dde800640 1 -- start start 2024-04-24T23:10:31.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.843+0000 7f2dde800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.843+0000 7f2dde800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2dd815f3c0 0x7f2dd815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.843+0000 7f2dde800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd8071960 con 0x7f2dd815e8b0 2024-04-24T23:10:31.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.843+0000 7f2dde800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd8071c40 con 0x7f2dd815f3c0 2024-04-24T23:10:31.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.843+0000 7f2dde800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd8071f20 con 0x7f2dd815abb0 2024-04-24T23:10:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.844+0000 7f2dd7400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.844+0000 7f2dd7e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2dd815f3c0 0x7f2dd815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.844+0000 7f2dd7400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.146:35256/0 (socket says 172.21.15.146:35256) 2024-04-24T23:10:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.844+0000 7f2dd7400640 1 -- 172.21.15.146:0/3662608146 learned_addr learned my addr 172.21.15.146:0/3662608146 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.845+0000 7f2dd7400640 1 -- 172.21.15.146:0/3662608146 >> v2:172.21.15.203:3300/0 conn(0x7f2dd815f3c0 msgr2=0x7f2dd815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.845+0000 7f2dd7400640 1 --2- 172.21.15.146:0/3662608146 >> v2:172.21.15.203:3300/0 conn(0x7f2dd815f3c0 0x7f2dd815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.845+0000 7f2dd7400640 1 -- 172.21.15.146:0/3662608146 >> v1:172.21.15.203:6789/0 conn(0x7f2dd815e8b0 legacy=0x7f2dd815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.845+0000 7f2dd7400640 1 -- 172.21.15.146:0/3662608146 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd8072200 con 0x7f2dd815abb0 2024-04-24T23:10:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.846+0000 7f2dd7400640 1 --2- 172.21.15.146:0/3662608146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009e50 tx=0x7f2dc802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c698d5a31d838651 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.846+0000 7f2dd6000640 1 -- 172.21.15.146:0/3662608146 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8036070 con 0x7f2dd815abb0 2024-04-24T23:10:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dd6000640 1 -- 172.21.15.146:0/3662608146 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8031600 con 0x7f2dd815abb0 2024-04-24T23:10:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dd6000640 1 -- 172.21.15.146:0/3662608146 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80319d0 con 0x7f2dd815abb0 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 -- 172.21.15.146:0/3662608146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 msgr2=0x7f2dd806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 --2- 172.21.15.146:0/3662608146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009e50 tx=0x7f2dc802a680 comp rx=0 tx=0).stop 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 -- 172.21.15.146:0/3662608146 shutdown_connections 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 --2- 172.21.15.146:0/3662608146 >> v2:172.21.15.203:3300/0 conn(0x7f2dd815f3c0 0x7f2dd815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 --2- 172.21.15.146:0/3662608146 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815abb0 0x7f2dd806cbc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.847+0000 7f2dde800640 1 -- 172.21.15.146:0/3662608146 >> 172.21.15.146:0/3662608146 conn(0x7f2dd806b140 msgr2=0x7f2dd806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.848+0000 7f2dde800640 1 -- 172.21.15.146:0/3662608146 shutdown_connections 2024-04-24T23:10:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.848+0000 7f2dde800640 1 -- 172.21.15.146:0/3662608146 wait complete. 2024-04-24T23:10:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.849+0000 7f2dde800640 1 Processor -- start 2024-04-24T23:10:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.849+0000 7f2dde800640 1 -- start start 2024-04-24T23:10:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2dd815e8b0 0x7f2dd815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815f3c0 0x7f2dd815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd815c120 con 0x7f2dd815abb0 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd815bfa0 con 0x7f2dd815e8b0 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.850+0000 7f2dde800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd815ccf0 con 0x7f2dd815f3c0 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40790/0 (socket says 172.21.15.146:40790) 2024-04-24T23:10:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 -- 172.21.15.146:0/1977456108 learned_addr learned my addr 172.21.15.146:0/1977456108 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd6a00640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2dd815e8b0 0x7f2dd815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7e00640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815f3c0 0x7f2dd815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 -- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815f3c0 msgr2=0x7f2dd815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815f3c0 0x7f2dd815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 -- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2dd815e8b0 msgr2=0x7f2dd815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2dd815e8b0 0x7f2dd815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 -- 172.21.15.146:0/1977456108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd8144d10 con 0x7f2dd815abb0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.851+0000 7f2dd7400640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8034040 tx=0x7f2dc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.852+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8036050 con 0x7f2dd815abb0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.852+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8042070 con 0x7f2dd815abb0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.852+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd80c9fa0 con 0x7f2dd815abb0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.852+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8009510 con 0x7f2dd815abb0 2024-04-24T23:10:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.852+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd80ca240 con 0x7f2dd815abb0 2024-04-24T23:10:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.853+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd80712f0 con 0x7f2dd815abb0 2024-04-24T23:10:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.854+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dc8007c70 con 0x7f2dd815abb0 2024-04-24T23:10:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.855+0000 7f2dcf400640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 0x7f2db406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.855+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f2dc80abaf0 con 0x7f2dd815abb0 2024-04-24T23:10:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.856+0000 7f2dd6a00640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 0x7f2db406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:31.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.857+0000 7f2dd6a00640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 0x7f2db406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80c50a0 tx=0x7f2dc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:31.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:31.859+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2dd80712f0 con 0x7f2dd815abb0 2024-04-24T23:10:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.057+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2dd815ed50 con 0x7f2db406be30 2024-04-24T23:10:32.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.058+0000 7f2dcf400640 1 -- 172.21.15.146:0/1977456108 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2dd815ed50 con 0x7f2db406be30 2024-04-24T23:10:32.060 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 msgr2=0x7f2db406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 0x7f2db406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80c50a0 tx=0x7f2dc0009040 comp rx=0 tx=0).stop 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 msgr2=0x7f2dd81447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8034040 tx=0x7f2dc8004a40 comp rx=0 tx=0).stop 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 shutdown_connections 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2db406be30 0x7f2db406e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2dd815f3c0 0x7f2dd815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2dd815e8b0 0x7f2dd815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 --2- 172.21.15.146:0/1977456108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd815abb0 0x7f2dd81447d0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 >> 172.21.15.146:0/1977456108 conn(0x7f2dd806b140 msgr2=0x7f2dd80cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 shutdown_connections 2024-04-24T23:10:32.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.061+0000 7f2dde800640 1 -- 172.21.15.146:0/1977456108 wait complete. 2024-04-24T23:10:32.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.280+0000 7ff855e00640 1 Processor -- start 2024-04-24T23:10:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.280+0000 7ff855e00640 1 -- start start 2024-04-24T23:10:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8501561c0 0x7ff8500cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500709d0 0x7ff85015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 0x7ff8500cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff8500b4310 con 0x7ff8501561c0 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff8500d04e0 con 0x7ff8500cfb30 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff855e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff8501565a0 con 0x7ff8500709d0 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff854a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8501561c0 0x7ff8500cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff854a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8501561c0 0x7ff8500cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40800/0 (socket says 172.21.15.146:40800) 2024-04-24T23:10:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.281+0000 7ff854a00640 1 -- 172.21.15.146:0/2604069699 learned_addr learned my addr 172.21.15.146:0/2604069699 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff855400640 1 --2- 172.21.15.146:0/2604069699 >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 0x7ff8500cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff854a00640 1 -- 172.21.15.146:0/2604069699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500709d0 msgr2=0x7ff85015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff847e00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500709d0 0x7ff85015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff854a00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500709d0 0x7ff85015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff854a00640 1 -- 172.21.15.146:0/2604069699 >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 msgr2=0x7ff8500cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff854a00640 1 --2- 172.21.15.146:0/2604069699 >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 0x7ff8500cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff854a00640 1 -- 172.21.15.146:0/2604069699 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff850070f90 con 0x7ff8501561c0 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.282+0000 7ff855400640 1 --2- 172.21.15.146:0/2604069699 >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 0x7ff8500cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.283+0000 7ff854a00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8501561c0 0x7ff8500cdbf0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff8500cd9c0 tx=0x7ff84002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8df7ca4cd66481d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.283+0000 7ff84fe00640 1 -- 172.21.15.146:0/2604069699 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840037070 con 0x7ff8501561c0 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff84fe00640 1 -- 172.21.15.146:0/2604069699 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84002ae00 con 0x7ff8501561c0 2024-04-24T23:10:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff84fe00640 1 -- 172.21.15.146:0/2604069699 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840032660 con 0x7ff8501561c0 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 -- 172.21.15.146:0/2604069699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8501561c0 msgr2=0x7ff8500cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8501561c0 0x7ff8500cdbf0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff8500cd9c0 tx=0x7ff84002a0b0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 -- 172.21.15.146:0/2604069699 shutdown_connections 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 --2- 172.21.15.146:0/2604069699 >> v2:172.21.15.203:3300/0 conn(0x7ff8500cfb30 0x7ff8500cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500709d0 0x7ff85015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 --2- 172.21.15.146:0/2604069699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8501561c0 0x7ff8500cdbf0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 -- 172.21.15.146:0/2604069699 >> 172.21.15.146:0/2604069699 conn(0x7ff85006b320 msgr2=0x7ff85006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 -- 172.21.15.146:0/2604069699 shutdown_connections 2024-04-24T23:10:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.284+0000 7ff855e00640 1 -- 172.21.15.146:0/2604069699 wait complete. 2024-04-24T23:10:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.286+0000 7ff855e00640 1 Processor -- start 2024-04-24T23:10:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.286+0000 7ff855e00640 1 -- start start 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 0x7ff8500ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 0x7ff8500ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff850071830 con 0x7ff8500709d0 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff850071550 con 0x7ff8501561c0 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff855e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500b2c20 con 0x7ff8500cfb30 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff854a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff854a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40802/0 (socket says 172.21.15.146:40802) 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.287+0000 7ff854a00640 1 -- 172.21.15.146:0/1426792927 learned_addr learned my addr 172.21.15.146:0/1426792927 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff855400640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 0x7ff8500ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff847e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 0x7ff8500ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 -- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 msgr2=0x7ff8500ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 0x7ff8500ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 -- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 msgr2=0x7ff8500ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 0x7ff8500ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 -- 172.21.15.146:0/1426792927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8501f4650 con 0x7ff8500709d0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff855400640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 0x7ff8500ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff847e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 0x7ff8500ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.288+0000 7ff854a00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff84002a0f0 tx=0x7ff8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.289+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840041030 con 0x7ff8500709d0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.289+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84003c670 con 0x7ff8500709d0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.289+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840037040 con 0x7ff8500709d0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.289+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85014ca40 con 0x7ff8500709d0 2024-04-24T23:10:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.289+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85014d000 con 0x7ff8500709d0 2024-04-24T23:10:32.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.290+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8500cf000 con 0x7ff8500709d0 2024-04-24T23:10:32.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.291+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff840044070 con 0x7ff8500709d0 2024-04-24T23:10:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.292+0000 7ff84d600640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.292+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7ff8400ab240 con 0x7ff8500709d0 2024-04-24T23:10:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.292+0000 7ff847e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:32.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.294+0000 7ff847e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 0x7ff82c06e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff8500af9e0 tx=0x7ff838008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:32.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.297+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff8500cf000 con 0x7ff8500709d0 2024-04-24T23:10:32.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.490+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff85004f500 con 0x7ff82c06be30 2024-04-24T23:10:32.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.493+0000 7ff84d600640 1 -- 172.21.15.146:0/1426792927 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13393 (secure 0 0 0) 0x7ff85004f500 con 0x7ff82c06be30 2024-04-24T23:10:32.495 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:32.495 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.495+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 msgr2=0x7ff82c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.495+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 0x7ff82c06e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff8500af9e0 tx=0x7ff838008040 comp rx=0 tx=0).stop 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 msgr2=0x7ff85014d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff84002a0f0 tx=0x7ff8400046c0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 shutdown_connections 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8501561c0 0x7ff8500ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8500cfb30 0x7ff8500ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 --2- 172.21.15.146:0/1426792927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8500709d0 0x7ff85014d520 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 >> 172.21.15.146:0/1426792927 conn(0x7ff85006b320 msgr2=0x7ff8500b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 shutdown_connections 2024-04-24T23:10:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:32.496+0000 7ff855e00640 1 -- 172.21.15.146:0/1426792927 wait complete. 2024-04-24T23:10:32.516 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":416,"stamp":"2024-04-24T23:10:31.827404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260052,"kb_used_data":10600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714668,"statfs":{"total":773094113280,"available":772827820032,"internally_reserved":0,"allocated":10854400,"data_stored":5627856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.371201"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-24T23:10:21.458758+0000","last_change":"2024-04-24T22:59:45.573728+0000","last_active":"2024-04-24T23:10:21.458758+0000","last_peered":"2024-04-24T23:10:21.458758+0000","last_clean":"2024-04-24T23:10:21.458758+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:10:21.458758+0000","last_undegraded":"2024-04-24T23:10:21.458758+0000","last_fullsized":"2024-04-24T23:10:21.458758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T22:59:44.492153+0000","last_clean_scrub_stamp":"2024-04-24T22:59:44.492153+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:41:52.707511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:32.520 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T22:59:44.492153+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=22, tm_min=59, tm_sec=44, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=10, tm_sec=25, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:10:32.520 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T23:10:47.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:47.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:52.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:10:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.728+0000 7f920b200640 1 Processor -- start 2024-04-24T23:10:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.728+0000 7f920b200640 1 -- start start 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f920b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 0x7f920c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f920b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c070f90 con 0x7f920c1561c0 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f920b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c071270 con 0x7f920c0709d0 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f920b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0b4310 con 0x7f920c0d0240 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f9209e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f920c1561c0 0x7f920c0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34890/0 (socket says 172.21.15.146:34890) 2024-04-24T23:10:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f9209e00640 1 -- 172.21.15.146:0/989604953 learned_addr learned my addr 172.21.15.146:0/989604953 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.730+0000 7f9201400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 0x7f920c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886488528 0 0) 0x7f920c070f90 con 0x7f920c1561c0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f0003520 con 0x7f920c1561c0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352255570 0 0) 0x7f91f0003520 con 0x7f920c1561c0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 msgr2=0x7f920c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 0x7f920c0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 >> v1:172.21.15.203:6789/0 conn(0x7f920c0709d0 legacy=0x7f920c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c071550 con 0x7f920c1561c0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3936748208 0 0) 0x7f91fc0019f0 con 0x7f920c1561c0 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 >> v1:172.21.15.146:6789/0 conn(0x7f920c1561c0 legacy=0x7f920c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f00039e0 0x7f91f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f91f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 0x7f91f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0b4310 con 0x7f91f0004800 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91f0005520 con 0x7f91f00039e0 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.731+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91f000bf00 con 0x7f920c0d0240 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f91f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9209e00640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f00039e0 0x7f91f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 -- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 msgr2=0x7f91f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c0d0240 0x7f91f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 -- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f00039e0 msgr2=0x7f91f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f00039e0 0x7f91f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.732+0000 7f9201400640 1 -- 172.21.15.146:0/989604953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f0003520 con 0x7f91f0004800 2024-04-24T23:10:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.733+0000 7f9201400640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f91f0004c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009ac0 tx=0x7f91f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed75b377df0229b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.733+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4036070 con 0x7f91f0004800 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.733+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f4031400 con 0x7f91f0004800 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.733+0000 7f9209400640 1 -- 172.21.15.146:0/989604953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4009690 con 0x7f91f0004800 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 -- 172.21.15.146:0/989604953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 msgr2=0x7f91f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 --2- 172.21.15.146:0/989604953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f91f0004c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009ac0 tx=0x7f91f0005830 comp rx=0 tx=0).stop 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920a800640 1 -- 172.21.15.146:0/989604953 reap_dead start 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 -- 172.21.15.146:0/989604953 shutdown_connections 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 -- 172.21.15.146:0/989604953 >> 172.21.15.146:0/989604953 conn(0x7f920c06b320 msgr2=0x7f920c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 -- 172.21.15.146:0/989604953 shutdown_connections 2024-04-24T23:10:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.734+0000 7f920b200640 1 -- 172.21.15.146:0/989604953 wait complete. 2024-04-24T23:10:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.736+0000 7f920b200640 1 Processor -- start 2024-04-24T23:10:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.736+0000 7f920b200640 1 -- start start 2024-04-24T23:10:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f920c1508f0 0x7f920c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c15af10 0x7f920c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0cdbf0 con 0x7f91f0004800 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0cdd70 con 0x7f920c1508f0 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f920b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0cdef0 con 0x7f920c15af10 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f9209e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f9209e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60834/0 (socket says 172.21.15.146:60834) 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.737+0000 7f9209e00640 1 -- 172.21.15.146:0/3916438473 learned_addr learned my addr 172.21.15.146:0/3916438473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 -- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c15af10 msgr2=0x7f920c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c15af10 0x7f920c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9201400640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f920c1508f0 0x7f920c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 -- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f920c1508f0 msgr2=0x7f920c150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f920c1508f0 0x7f920c150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 -- 172.21.15.146:0/3916438473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1512b0 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9209e00640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f91fc007a10 tx=0x7f91fc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00ee50 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc018070 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc013640 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.738+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c159e70 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.739+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c15a430 con 0x7f91f0004800 2024-04-24T23:10:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.740+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c04f500 con 0x7f91f0004800 2024-04-24T23:10:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.741+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91fc0137e0 con 0x7f91f0004800 2024-04-24T23:10:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.741+0000 7f9202a00640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 0x7f91e806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.742+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f91fc08b3c0 con 0x7f91f0004800 2024-04-24T23:10:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.742+0000 7f9201400640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 0x7f91e806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.743+0000 7f9201400640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 0x7f91e806e490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f91f4033000 tx=0x7f91f4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.746+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f91fc059e40 con 0x7f91f0004800 2024-04-24T23:10:52.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.945+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 --> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f920c153df0 con 0x7f91e806bfd0 2024-04-24T23:10:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.947+0000 7f9202a00640 1 -- 172.21.15.146:0/3916438473 <== mgr.4103 v2:172.21.15.203:6832/2371625945 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13375 (secure 0 0 0) 0x7f920c153df0 con 0x7f91e806bfd0 2024-04-24T23:10:52.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.950+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 msgr2=0x7f91e806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.950+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 0x7f91e806e490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f91f4033000 tx=0x7f91f4008030 comp rx=0 tx=0).stop 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.950+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 msgr2=0x7f920c156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.950+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f91fc007a10 tx=0x7f91fc00e530 comp rx=0 tx=0).stop 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.950+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 shutdown_connections 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f91e806bfd0 0x7f91e806e490 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f920c15af10 0x7f920c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f920c1508f0 0x7f920c150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 --2- 172.21.15.146:0/3916438473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f0004800 0x7f920c156730 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 >> 172.21.15.146:0/3916438473 conn(0x7f920c06b320 msgr2=0x7f920c0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 shutdown_connections 2024-04-24T23:10:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:52.951+0000 7f920b200640 1 -- 172.21.15.146:0/3916438473 wait complete. 2024-04-24T23:10:52.972 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-04-24T23:10:51.832990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260044,"kb_used_data":10600,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714676,"statfs":{"total":773094113280,"available":772827828224,"internally_reserved":0,"allocated":10854400,"data_stored":5627856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003368"},"pg_stats":[{"pgid":"1.0","version":"98'119","reported_seq":327,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-24T23:10:28.740501+0000","last_change":"2024-04-24T23:10:28.740570+0000","last_active":"2024-04-24T23:10:28.740501+0000","last_peered":"2024-04-24T23:10:28.740501+0000","last_clean":"2024-04-24T23:10:28.740501+0000","last_became_active":"2024-04-24T22:59:45.570603+0000","last_became_peered":"2024-04-24T22:59:45.570603+0000","last_unstale":"2024-04-24T23:10:28.740501+0000","last_undegraded":"2024-04-24T23:10:28.740501+0000","last_fullsized":"2024-04-24T23:10:28.740501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'119","last_scrub_stamp":"2024-04-24T23:10:28.740319+0000","last_deep_scrub":"98'119","last_deep_scrub_stamp":"2024-04-24T23:10:28.740319+0000","last_clean_scrub_stamp":"2024-04-24T23:10:28.740319+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:29.878882+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509576,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509577,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":555890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1802240,"data_stored":1146258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:10:52.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T23:10:53.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.169+0000 7f3cd7200640 1 Processor -- start 2024-04-24T23:10:53.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.170+0000 7f3cd7200640 1 -- start start 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.171+0000 7f3cd7200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cd815bcd0 0x7f3cd80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.171+0000 7f3cd7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.171+0000 7f3cd7200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd80b4df0 con 0x7f3cd815cd60 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd7200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd815c8d0 con 0x7f3cd815bcd0 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd80b4b10 con 0x7f3cd80d03d0 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cd815bcd0 0x7f3cd80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3cd815cd60 0x7f3cd80cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34894/0 (socket says 172.21.15.146:34894) 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cd815bcd0 0x7f3cd80cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60838/0 (socket says 172.21.15.146:60838) 2024-04-24T23:10:53.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5400640 1 -- 172.21.15.146:0/2653798203 learned_addr learned my addr 172.21.15.146:0/2653798203 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-04-24T23:10:53.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd6800640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 -- 172.21.15.146:0/2653798203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 msgr2=0x7f3cd815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 -- 172.21.15.146:0/2653798203 >> v1:172.21.15.146:6789/0 conn(0x7f3cd815cd60 legacy=0x7f3cd80cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd5e00640 1 -- 172.21.15.146:0/2653798203 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd815c280 con 0x7f3cd815bcd0 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd4a00640 1 -- 172.21.15.146:0/2653798203 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734237528 0 0) 0x7f3cd80b4df0 con 0x7f3cd815cd60 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.172+0000 7f3cd6800640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.173+0000 7f3cd5e00640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80cc230 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80097a0 tx=0x7f3cc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b514774dd16c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd4a00640 1 -- 172.21.15.146:0/2653798203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8037070 con 0x7f3cd815bcd0 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd4a00640 1 -- 172.21.15.146:0/2653798203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8032440 con 0x7f3cd815bcd0 2024-04-24T23:10:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd4a00640 1 -- 172.21.15.146:0/2653798203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8032810 con 0x7f3cd815bcd0 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 -- 172.21.15.146:0/2653798203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815bcd0 msgr2=0x7f3cd80cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80cc230 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80097a0 tx=0x7f3cc802a180 comp rx=0 tx=0).stop 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 -- 172.21.15.146:0/2653798203 shutdown_connections 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 --2- 172.21.15.146:0/2653798203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80cc230 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 -- 172.21.15.146:0/2653798203 >> 172.21.15.146:0/2653798203 conn(0x7f3cd806b560 msgr2=0x7f3cd806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 -- 172.21.15.146:0/2653798203 shutdown_connections 2024-04-24T23:10:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.174+0000 7f3cd7200640 1 -- 172.21.15.146:0/2653798203 wait complete. 2024-04-24T23:10:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.176+0000 7f3cd7200640 1 Processor -- start 2024-04-24T23:10:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.176+0000 7f3cd7200640 1 -- start start 2024-04-24T23:10:53.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd8154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd806e590 con 0x7f3cd815cd60 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80cc770 con 0x7f3cd815bcd0 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.177+0000 7f3cd7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd80b4790 con 0x7f3cd80d03d0 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60850/0 (socket says 172.21.15.146:60850) 2024-04-24T23:10:53.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 -- 172.21.15.146:0/1374262166 learned_addr learned my addr 172.21.15.146:0/1374262166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 -- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 msgr2=0x7f3cd8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 -- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cd815bcd0 msgr2=0x7f3cd80ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 -- 172.21.15.146:0/1374262166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8072930 con 0x7f3cd815cd60 2024-04-24T23:10:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cd6800640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cea0 tx=0x7f3cd000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.178+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0003b90 con 0x7f3cd815cd60 2024-04-24T23:10:53.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.179+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd0003d50 con 0x7f3cd815cd60 2024-04-24T23:10:53.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.179+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0004260 con 0x7f3cd815cd60 2024-04-24T23:10:53.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.179+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd8071890 con 0x7f3cd815cd60 2024-04-24T23:10:53.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.179+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd8071e50 con 0x7f3cd815cd60 2024-04-24T23:10:53.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.180+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd804f500 con 0x7f3cd815cd60 2024-04-24T23:10:53.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.181+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cd0004400 con 0x7f3cd815cd60 2024-04-24T23:10:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.182+0000 7f3cce000640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 0x7f3cb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.182+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f3cd008b5f0 con 0x7f3cd815cd60 2024-04-24T23:10:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.182+0000 7f3cd5e00640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 0x7f3cb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.184+0000 7f3cd5e00640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 0x7f3cb406e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8034000 tx=0x7f3cc802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.187+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3cd005a1a0 con 0x7f3cd815cd60 2024-04-24T23:10:53.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.385+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3cd80cc010 con 0x7f3cd815cd60 2024-04-24T23:10:53.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.391+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7f3cd0059aa0 con 0x7f3cd815cd60 2024-04-24T23:10:53.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.392+0000 7f3cce000640 1 -- 172.21.15.146:0/1374262166 <== mon.0 v2:172.21.15.146:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3cd005de50 con 0x7f3cd815cd60 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.394+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 msgr2=0x7f3cb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.394+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 0x7f3cb406e320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8034000 tx=0x7f3cc802c000 comp rx=0 tx=0).stop 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.394+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 msgr2=0x7f3cd80ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.394+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cea0 tx=0x7f3cd000cf90 comp rx=0 tx=0).stop 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 shutdown_connections 2024-04-24T23:10:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd815cd60 0x7f3cd80ade00 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cd815bcd0 0x7f3cd80ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f3cb406be60 0x7f3cb406e320 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 --2- 172.21.15.146:0/1374262166 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cd80d03d0 0x7f3cd8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 >> 172.21.15.146:0/1374262166 conn(0x7f3cd806b560 msgr2=0x7f3cd806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 shutdown_connections 2024-04-24T23:10:53.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.395+0000 7f3cd7200640 1 -- 172.21.15.146:0/1374262166 wait complete. 2024-04-24T23:10:53.415 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:10:53.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:10:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.604+0000 7f2d18c00640 1 Processor -- start 2024-04-24T23:10:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.604+0000 7f2d18c00640 1 -- start start 2024-04-24T23:10:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d18c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d1406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d18c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140d0240 0x7f2d140ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d18c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140ccb10 con 0x7f2d14071dd0 2024-04-24T23:10:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d18c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2d14072230 con 0x7f2d140d0240 2024-04-24T23:10:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d18c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140aede0 con 0x7f2d1415a980 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140d0240 0x7f2d140ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d13e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140d0240 0x7f2d140ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60856/0 (socket says 172.21.15.146:60856) 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.606+0000 7f2d13e00640 1 -- 172.21.15.146:0/1435485254 learned_addr learned my addr 172.21.15.146:0/1435485254 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13400640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d1406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13e00640 1 -- 172.21.15.146:0/1435485254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 msgr2=0x7f2d1406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:10:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13e00640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d1406d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13e00640 1 -- 172.21.15.146:0/1435485254 >> v1:172.21.15.146:6789/0 conn(0x7f2d14071dd0 legacy=0x7f2d140cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13e00640 1 -- 172.21.15.146:0/1435485254 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1406ddc0 con 0x7f2d140d0240 2024-04-24T23:10:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.607+0000 7f2d13400640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d1406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:10:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.608+0000 7f2d13e00640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140ccfd0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009e50 tx=0x7f2d0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9a1c6b1f17ac0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.608+0000 7f2d12a00640 1 -- 172.21.15.146:0/1435485254 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c036070 con 0x7f2d140d0240 2024-04-24T23:10:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.608+0000 7f2d12a00640 1 -- 172.21.15.146:0/1435485254 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2d0c031600 con 0x7f2d140d0240 2024-04-24T23:10:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.608+0000 7f2d12a00640 1 -- 172.21.15.146:0/1435485254 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0319f0 con 0x7f2d140d0240 2024-04-24T23:10:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 -- 172.21.15.146:0/1435485254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 msgr2=0x7f2d140ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140ccfd0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009e50 tx=0x7f2d0c02a6a0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 -- 172.21.15.146:0/1435485254 shutdown_connections 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140ccfd0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 --2- 172.21.15.146:0/1435485254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d1406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 -- 172.21.15.146:0/1435485254 >> 172.21.15.146:0/1435485254 conn(0x7f2d1406b320 msgr2=0x7f2d1406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 -- 172.21.15.146:0/1435485254 shutdown_connections 2024-04-24T23:10:53.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.609+0000 7f2d18c00640 1 -- 172.21.15.146:0/1435485254 wait complete. 2024-04-24T23:10:53.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.611+0000 7f2d18c00640 1 Processor -- start 2024-04-24T23:10:53.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.611+0000 7f2d18c00640 1 -- start start 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d14071dd0 0x7f2d141458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d141e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406e660 con 0x7f2d140d0240 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406e380 con 0x7f2d14071dd0 2024-04-24T23:10:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d18c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1415ad60 con 0x7f2d1415a980 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60866/0 (socket says 172.21.15.146:60866) 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d0aa00640 1 -- 172.21.15.146:0/3566422119 learned_addr learned my addr 172.21.15.146:0/3566422119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d13400640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d14071dd0 0x7f2d141458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.612+0000 7f2d13e00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d141e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 -- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 msgr2=0x7f2d141e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d141e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 -- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d14071dd0 msgr2=0x7f2d141458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d14071dd0 0x7f2d141458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 -- 172.21.15.146:0/3566422119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d14145e00 con 0x7f2d140d0240 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0aa00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c400 tx=0x7f2cfc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0052d0 con 0x7f2d140d0240 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2cfc005490 con 0x7f2d140d0240 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d14148210 con 0x7f2d140d0240 2024-04-24T23:10:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc007280 con 0x7f2d140d0240 2024-04-24T23:10:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.613+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d14148790 con 0x7f2d140d0240 2024-04-24T23:10:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.615+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1404f500 con 0x7f2d140d0240 2024-04-24T23:10:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.615+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cfc007420 con 0x7f2d140d0240 2024-04-24T23:10:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.616+0000 7f2d0be00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:10:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.616+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5335+0+0 (secure 0 0 0) 0x7f2cfc08a310 con 0x7f2d140d0240 2024-04-24T23:10:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.617+0000 7f2d13400640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:10:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.618+0000 7f2d13400640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 0x7f2cf006e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400a950 tx=0x7f2d04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:10:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.621+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d14145e00 con 0x7f2d140d0240 2024-04-24T23:10:53.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.858+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d140b2110 con 0x7f2d140d0240 2024-04-24T23:10:53.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.859+0000 7f2d0be00640 1 -- 172.21.15.146:0/3566422119 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+3881 (secure 0 0 0) 0x7f2d140ccb10 con 0x7f2d140d0240 2024-04-24T23:10:53.862 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-24T23:10:53.862 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/2485603433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":2485603433},{"type":"v1","addr":"172.21.15.203:6837","nonce":2485603433}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7938,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1688767501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1688767501},{"type":"v1","addr":"172.21.15.146:6834","nonce":1688767501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2769673963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2769673963},{"type":"v1","addr":"172.21.15.146:6835","nonce":2769673963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7953,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/1231738912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":1231738912},{"type":"v1","addr":"172.21.15.203:6836","nonce":1231738912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-04-24T23:10:53.862 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 msgr2=0x7f2cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 0x7f2cf006e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400a950 tx=0x7f2d04008040 comp rx=0 tx=0).stop 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 msgr2=0x7f2d140adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c400 tx=0x7f2cfc00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 shutdown_connections 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:6832/2371625945,v1:172.21.15.203:6833/2371625945] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1415a980 0x7f2d141e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140d0240 0x7f2d140adb30 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 --2- 172.21.15.146:0/3566422119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d14071dd0 0x7f2d141458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:10:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 >> 172.21.15.146:0/3566422119 conn(0x7f2d1406b320 msgr2=0x7f2d140b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:10:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 shutdown_connections 2024-04-24T23:10:53.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-24T23:10:53.862+0000 7f2d18c00640 1 -- 172.21.15.146:0/3566422119 wait complete. 2024-04-24T23:10:53.882 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-24T23:10:53.883 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T23:10:53.883 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:10:53.883 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:53.899 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:10:53.899 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:10:53.899 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:53.966 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:10:53.966 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:10:53.966 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:53.986 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:10:53.986 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-24T23:10:53.986 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.048 INFO:tasks.ceph.mds.d:Stopped 2024-04-24T23:10:54.049 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T23:10:54.049 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T23:10:54.049 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.124 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T23:10:54.125 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T23:10:54.125 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.190 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T23:10:54.191 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T23:10:54.191 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.268 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T23:10:54.268 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T23:10:54.268 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.348 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T23:10:54.349 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-24T23:10:54.349 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.446 INFO:tasks.ceph.osd.4:Stopped 2024-04-24T23:10:54.446 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-24T23:10:54.446 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.530 INFO:tasks.ceph.osd.5:Stopped 2024-04-24T23:10:54.531 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-24T23:10:54.531 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.613 INFO:tasks.ceph.osd.6:Stopped 2024-04-24T23:10:54.613 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-24T23:10:54.613 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.688 INFO:tasks.ceph.osd.7:Stopped 2024-04-24T23:10:54.688 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T23:10:54.688 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-24T23:10:54.688 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.788 INFO:tasks.ceph.mgr.y:Stopped 2024-04-24T23:10:54.788 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T23:10:54.788 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.861 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T23:10:54.861 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T23:10:54.862 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T23:10:54.862 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.917 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T23:10:54.917 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-24T23:10:54.917 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:54.949 INFO:tasks.ceph.mon.b:Stopped 2024-04-24T23:10:54.950 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-24T23:10:54.950 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:10:55.016 INFO:tasks.ceph.mon.c:Stopped 2024-04-24T23:10:55.016 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T23:10:55.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'bad backtrace on directory inode' | egrep -v 'error reading table object' | egrep -v 'Metadata damage detected' | egrep -v 'slow requests are blocked' | egrep -v 'Behind on trimming' | egrep -v 'error reading sessionmap' | head -n 1 2024-04-24T23:10:55.125 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:10:55.125 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T23:10:55.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:10:55.351 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T23:10:55.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:10:55.497 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T23:10:55.699 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:10:55.699 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T23:10:55.834 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:10:55.834 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-24T23:10:56.115 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:10:56.116 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-24T23:10:56.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:10:56.269 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-24T23:10:56.401 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:10:56.401 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-24T23:10:56.539 INFO:tasks.ceph:Archiving mon data... 2024-04-24T23:10:56.541 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/data/mon.a.tgz 2024-04-24T23:10:56.541 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-04-24T23:10:56.597 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.EHzpPpVus7 2024-04-24T23:10:56.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EHzpPpVus7 2024-04-24T23:10:56.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.EHzpPpVus7 2024-04-24T23:10:56.926 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.EHzpPpVus7 is 405KB 2024-04-24T23:10:57.033 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.EHzpPpVus7 2024-04-24T23:10:57.089 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/data/mon.b.tgz 2024-04-24T23:10:57.089 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-24T23:10:57.146 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.1Uqr6FohPJ 2024-04-24T23:10:57.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.1Uqr6FohPJ 2024-04-24T23:10:57.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.1Uqr6FohPJ 2024-04-24T23:10:57.482 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.1Uqr6FohPJ is 428KB 2024-04-24T23:10:57.586 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.1Uqr6FohPJ 2024-04-24T23:10:57.643 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/data/mon.c.tgz 2024-04-24T23:10:57.643 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-24T23:10:57.692 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.rWNqgW395V 2024-04-24T23:10:57.693 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rWNqgW395V 2024-04-24T23:10:57.871 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.rWNqgW395V 2024-04-24T23:10:58.000 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.rWNqgW395V is 428KB 2024-04-24T23:10:58.105 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.rWNqgW395V 2024-04-24T23:10:58.161 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T23:10:58.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:10:58.169 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:10:58.308 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:10:58.365 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:10:58.365 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T23:10:58.367 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi146/crash 2024-04-24T23:10:58.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:10:58.457 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi203/crash 2024-04-24T23:10:58.458 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:10:58.544 INFO:tasks.ceph:Shutting down logrotate 2024-04-24T23:10:58.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:58.551 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:58.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:58.790 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:10:58.881 INFO:tasks.ceph:Compressing logs... 2024-04-24T23:10:58.881 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:10:58.889 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:10:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56182.log 2024-04-24T23:10:58.962 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66655.log 2024-04-24T23:10:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56182.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56182.log.gz 2024-04-24T23:10:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63313.log 2024-04-24T23:10:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65879.log 2024-04-24T23:10:58.965 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66655.log.gz 2024-04-24T23:10:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63847.log 2024-04-24T23:10:58.966 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63313.log.gz 2024-04-24T23:10:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-04-24T23:10:58.967 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65879.log.gz 2024-04-24T23:10:58.968 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-04-24T23:10:58.968 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63847.log.gz 2024-04-24T23:10:58.969 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:10:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54857.log 2024-04-24T23:10:58.969 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-04-24T23:10:58.970 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47302.log 2024-04-24T23:10:58.973 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33190.log 2024-04-24T23:10:58.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33441.log 2024-04-24T23:10:58.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33190.log.gz 2024-04-24T23:10:58.973 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-04-24T23:10:58.974 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61817.log 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54857.log.gz 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47344.log 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47302.log.gz 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61817.log.gz 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57723.log 2024-04-24T23:10:58.975 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47344.log.gz 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33441.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33441.log.gz 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33401.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-24T23:10:58.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.39215.log 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.3.39215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.39215.log.gz 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33481.log 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33481.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33481.log.gz 2024-04-24T23:10:58.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi203.stderr:gzip/var/log/ceph/ceph-mgr.x.log: -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33361.log 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62020.log 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40330.log 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57723.log.gz 2024-04-24T23:10:58.988 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66526.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62020.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40330.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62328.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66526.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60037.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38435.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62328.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54716.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60037.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50480.log 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38435.log.gz 2024-04-24T23:10:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54716.log.gz 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.50480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39124.log 0.0% 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.50480.log.gz 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.53610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39124.log.gz 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-04-24T23:10:58.990 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2024-04-24T23:10:58.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.33361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38800.log 2024-04-24T23:10:58.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.38800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33361.log.gz 2024-04-24T23:10:58.994 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33230.log 2024-04-24T23:10:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40372.log 2024-04-24T23:10:58.995 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-04-24T23:10:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-04-24T23:10:58.995 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-04-24T23:10:58.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52732.log 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40372.log.gz 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42652.log 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52732.log.gz 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40230.log 2024-04-24T23:10:58.996 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42652.log.gz 2024-04-24T23:10:58.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33321.log 2024-04-24T23:10:58.999 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38800.log.gz 2024-04-24T23:10:58.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33279.log 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68134.log 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51870.log 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40230.log.gz 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66613.log 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68134.log.gz 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51870.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51870.log.gz 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39292.log 2024-04-24T23:10:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63931.log 2024-04-24T23:10:59.001 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66613.log.gz 2024-04-24T23:10:59.002 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-24T23:10:59.002 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39292.log.gz 2024-04-24T23:10:59.004 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.33321.log: 88.4% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33230.log.gz 2024-04-24T23:10:59.004 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33279.log: -- /var/log/ceph/ceph-mds.d.log 2024-04-24T23:10:59.004 INFO:teuthology.orchestra.run.smithi203.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33279.log.gz 2024-04-24T23:10:59.004 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49026.log 2024-04-24T23:10:59.004 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63931.log.gz 2024-04-24T23:10:59.005 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-04-24T23:10:59.005 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-24T23:10:59.005 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65077.log 2024-04-24T23:10:59.005 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49026.log.gz 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph-client.admin.33321.log.gz 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65077.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65077.log.gz 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-04-24T23:10:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67355.log 2024-04-24T23:10:59.008 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44344.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2024-04-24T23:10:59.008 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52087.log 2024-04-24T23:10:59.008 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-04-24T23:10:59.009 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53736.log 2024-04-24T23:10:59.009 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67355.log.gz 2024-04-24T23:10:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59585.log 2024-04-24T23:10:59.010 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52087.log.gz 2024-04-24T23:10:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.53736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57385.log 2024-04-24T23:10:59.011 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53736.log.gz 2024-04-24T23:10:59.012 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61536.log 2024-04-24T23:10:59.012 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.59585.log.gz 2024-04-24T23:10:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65963.log 2024-04-24T23:10:59.013 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57385.log.gz 2024-04-24T23:10:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57975.log 2024-04-24T23:10:59.014 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61536.log.gz 2024-04-24T23:10:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63523.log 2024-04-24T23:10:59.015 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65963.log.gz 2024-04-24T23:10:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64818.log 2024-04-24T23:10:59.016 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57975.log.gz 2024-04-24T23:10:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-04-24T23:10:59.018 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.63523.log.gz 2024-04-24T23:10:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68612.log 2024-04-24T23:10:59.018 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64818.log.gz 2024-04-24T23:10:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41845.log 2024-04-24T23:10:59.020 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2024-04-24T23:10:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64487.log 2024-04-24T23:10:59.020 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68612.log.gz 2024-04-24T23:10:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57011.log 2024-04-24T23:10:59.021 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41845.log.gz 2024-04-24T23:10:59.022 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-04-24T23:10:59.022 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64487.log.gz 2024-04-24T23:10:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64445.log 2024-04-24T23:10:59.023 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57011.log.gz 2024-04-24T23:10:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2024-04-24T23:10:59.024 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz 2024-04-24T23:10:59.025 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42568.log 2024-04-24T23:10:59.025 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64445.log.gz 2024-04-24T23:10:59.026 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63889.log 2024-04-24T23:10:59.026 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2024-04-24T23:10:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2024-04-24T23:10:59.027 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2024-04-24T23:10:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-04-24T23:10:59.028 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63889.log.gz 2024-04-24T23:10:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-04-24T23:10:59.029 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2024-04-24T23:10:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2024-04-24T23:10:59.030 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-04-24T23:10:59.031 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-24T23:10:59.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-04-24T23:10:59.032 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-04-24T23:10:59.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65327.log 2024-04-24T23:10:59.033 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2024-04-24T23:10:59.034 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49169.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz 2024-04-24T23:10:59.034 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-04-24T23:10:59.035 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66917.log 2024-04-24T23:10:59.035 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65327.log.gz 2024-04-24T23:10:59.036 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-04-24T23:10:59.036 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-04-24T23:10:59.037 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2024-04-24T23:10:59.037 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66917.log.gz 2024-04-24T23:10:59.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-04-24T23:10:59.038 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-04-24T23:10:59.039 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64361.log 2024-04-24T23:10:59.039 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2024-04-24T23:10:59.040 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61139.log 2024-04-24T23:10:59.040 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-04-24T23:10:59.040 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67127.log 2024-04-24T23:10:59.041 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64361.log.gz 2024-04-24T23:10:59.042 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51203.log 2024-04-24T23:10:59.042 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61139.log.gz 2024-04-24T23:10:59.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54434.log 2024-04-24T23:10:59.043 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67127.log.gz 2024-04-24T23:10:59.044 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51203.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51203.log.gz 2024-04-24T23:10:59.044 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:10:59.045 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40498.log 2024-04-24T23:10:59.045 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54434.log.gz 2024-04-24T23:10:59.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-04-24T23:10:59.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67001.log 2024-04-24T23:10:59.047 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40498.log.gz 2024-04-24T23:10:59.048 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44596.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:10:59.048 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2024-04-24T23:10:59.048 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-04-24T23:10:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67001.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67001.log.gz 2024-04-24T23:10:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2024-04-24T23:10:59.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2024-04-24T23:10:59.050 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2024-04-24T23:10:59.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60476.log 2024-04-24T23:10:59.051 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2024-04-24T23:10:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63439.log 2024-04-24T23:10:59.052 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2024-04-24T23:10:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.60476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60476.log.gz 2024-04-24T23:10:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-04-24T23:10:59.054 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51786.log 2024-04-24T23:10:59.054 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63439.log.gz 2024-04-24T23:10:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62458.log 2024-04-24T23:10:59.055 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-04-24T23:10:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2024-04-24T23:10:59.056 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51786.log.gz 2024-04-24T23:10:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62458.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62458.log.gz 2024-04-24T23:10:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39208.log 2024-04-24T23:10:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65837.log 2024-04-24T23:10:59.058 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2024-04-24T23:10:59.059 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40062.log 2024-04-24T23:10:59.059 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39208.log.gz 2024-04-24T23:10:59.060 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63565.log 2024-04-24T23:10:59.060 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65837.log.gz 2024-04-24T23:10:59.060 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55158.log 2024-04-24T23:10:59.061 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40062.log.gz 2024-04-24T23:10:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67271.log 2024-04-24T23:10:59.062 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.63565.log.gz 2024-04-24T23:10:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60793.log 2024-04-24T23:10:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67271.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55158.log.gz 2024-04-24T23:10:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62500.log 2024-04-24T23:10:59.064 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67271.log.gz 2024-04-24T23:10:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2024-04-24T23:10:59.065 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60793.log.gz 2024-04-24T23:10:59.066 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60751.log 2024-04-24T23:10:59.066 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62500.log.gz 2024-04-24T23:10:59.066 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49919.log 2024-04-24T23:10:59.067 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2024-04-24T23:10:59.067 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 88.8% 2024-04-24T23:10:59.068 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60751.log.gz 2024-04-24T23:10:59.069 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.49919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-04-24T23:10:59.069 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49919.log.gz 2024-04-24T23:10:59.070 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-04-24T23:10:59.070 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T23:10:59.071 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56916.log 2024-04-24T23:10:59.071 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-04-24T23:10:59.071 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-04-24T23:10:59.072 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68050.log 2024-04-24T23:10:59.073 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56916.log.gz 2024-04-24T23:10:59.073 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52211.log 2024-04-24T23:10:59.074 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68050.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.68050.log.gz 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.63973.log 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52211.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.54662.log 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52211.log.gz 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55412.log 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63973.log.gz 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59907.log 2024-04-24T23:10:59.079 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54662.log.gz 2024-04-24T23:10:59.080 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.55412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2024-04-24T23:10:59.080 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55412.log.gz 2024-04-24T23:10:59.080 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-04-24T23:10:59.081 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.59907.log.gz 2024-04-24T23:10:59.081 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61097.log 2024-04-24T23:10:59.081 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2024-04-24T23:10:59.082 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53568.log 2024-04-24T23:10:59.083 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-04-24T23:10:59.084 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61097.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61097.log.gz 2024-04-24T23:10:59.084 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57429.log 2024-04-24T23:10:59.084 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.53568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61494.log 2024-04-24T23:10:59.085 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53568.log.gz 2024-04-24T23:10:59.085 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2024-04-24T23:10:59.086 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57429.log.gz 2024-04-24T23:10:59.086 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63649.log 2024-04-24T23:10:59.087 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61494.log.gz 2024-04-24T23:10:59.088 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51455.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2024-04-24T23:10:59.088 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-04-24T23:10:59.088 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63271.log 2024-04-24T23:10:59.089 INFO:teuthology.orchestra.run.smithi146.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.63649.log.gz 2024-04-24T23:10:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57513.log 2024-04-24T23:10:59.090 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-04-24T23:10:59.091 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56435.log 2024-04-24T23:10:59.091 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57513.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63271.log.gz 2024-04-24T23:10:59.092 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57513.log.gz 2024-04-24T23:10:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40930.log 2024-04-24T23:10:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38953.log 2024-04-24T23:10:59.093 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56435.log.gz 2024-04-24T23:10:59.094 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62584.log 2024-04-24T23:10:59.094 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40930.log.gz 2024-04-24T23:10:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-04-24T23:10:59.096 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38953.log.gz 2024-04-24T23:10:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62584.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62584.log.gz 2024-04-24T23:10:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2024-04-24T23:10:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68218.log 2024-04-24T23:10:59.097 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-04-24T23:10:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61055.log 2024-04-24T23:10:59.099 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2024-04-24T23:10:59.099 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65457.log 2024-04-24T23:10:59.100 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68218.log.gz 2024-04-24T23:10:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61055.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61055.log.gz 2024-04-24T23:10:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42400.log 2024-04-24T23:10:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68302.log 2024-04-24T23:10:59.101 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65457.log.gz 2024-04-24T23:10:59.102 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57639.log 2024-04-24T23:10:59.102 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42400.log.gz 2024-04-24T23:10:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-04-24T23:10:59.104 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68302.log.gz 2024-04-24T23:10:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57639.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:10:59.105 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57639.log.gz 2024-04-24T23:10:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66697.log 2024-04-24T23:10:59.106 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-04-24T23:10:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65415.log 2024-04-24T23:10:59.107 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47386.log 2024-04-24T23:10:59.108 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66697.log.gz 2024-04-24T23:10:59.109 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65415.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65415.log.gz 2024-04-24T23:10:59.109 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:10:59.109 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61897.log 2024-04-24T23:10:59.110 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65499.log 2024-04-24T23:10:59.110 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47386.log.gz 2024-04-24T23:10:59.111 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61897.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61897.log.gz 2024-04-24T23:10:59.111 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-04-24T23:10:59.112 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58163.log 2024-04-24T23:10:59.112 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65499.log.gz 2024-04-24T23:10:59.113 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log 2024-04-24T23:10:59.113 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-04-24T23:10:59.114 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.58163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58163.log.gz 2024-04-24T23:10:59.114 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46258.log 2024-04-24T23:10:59.115 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-04-24T23:10:59.116 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2024-04-24T23:10:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54167.log 2024-04-24T23:10:59.116 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46258.log.gz 2024-04-24T23:10:59.118 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47512.log 2024-04-24T23:10:59.118 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-04-24T23:10:59.118 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-04-24T23:10:59.119 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54167.log.gz 2024-04-24T23:10:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68470.log 2024-04-24T23:10:59.120 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47512.log.gz 2024-04-24T23:10:59.121 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42610.log 2024-04-24T23:10:59.121 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-04-24T23:10:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52253.log 2024-04-24T23:10:59.122 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68470.log.gz 2024-04-24T23:10:59.123 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55920.log 2024-04-24T23:10:59.123 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42610.log.gz 2024-04-24T23:10:59.124 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44008.log 2024-04-24T23:10:59.124 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52253.log.gz 2024-04-24T23:10:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54341.log 2024-04-24T23:10:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44008.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55920.log.gz 2024-04-24T23:10:59.126 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44008.log.gz 2024-04-24T23:10:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62964.log 2024-04-24T23:10:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57681.log 2024-04-24T23:10:59.127 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2024-04-24T23:10:59.128 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.62964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62964.log.gz 2024-04-24T23:10:59.128 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38612.log 2024-04-24T23:10:59.129 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64067.log 2024-04-24T23:10:59.130 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57681.log.gz 2024-04-24T23:10:59.130 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38612.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38612.log.gz 2024-04-24T23:10:59.130 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65669.log 2024-04-24T23:10:59.131 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2024-04-24T23:10:59.131 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64067.log.gz 2024-04-24T23:10:59.132 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-04-24T23:10:59.132 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65669.log.gz 2024-04-24T23:10:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51828.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz -5 2024-04-24T23:10:59.133 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60132.log 2024-04-24T23:10:59.134 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65583.log 2024-04-24T23:10:59.134 INFO:teuthology.orchestra.run.smithi146.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-04-24T23:10:59.135 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57091.log 2024-04-24T23:10:59.135 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60132.log.gz 2024-04-24T23:10:59.136 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-04-24T23:10:59.136 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65583.log.gz 2024-04-24T23:10:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-04-24T23:10:59.137 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57091.log.gz 2024-04-24T23:10:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51912.log 2024-04-24T23:10:59.138 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-04-24T23:10:59.139 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61978.log 2024-04-24T23:10:59.139 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-04-24T23:10:59.140 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2024-04-24T23:10:59.140 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51912.log.gz 2024-04-24T23:10:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2024-04-24T23:10:59.141 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61978.log.gz 2024-04-24T23:10:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47094.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2024-04-24T23:10:59.142 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41230.log 2024-04-24T23:10:59.142 INFO:teuthology.orchestra.run.smithi203.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T23:10:59.143 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67043.log 2024-04-24T23:10:59.143 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2024-04-24T23:10:59.144 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55836.log 2024-04-24T23:10:59.144 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41230.log.gz 2024-04-24T23:10:59.145 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40146.log 2024-04-24T23:10:59.146 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67043.log.gz 2024-04-24T23:10:59.146 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 88.9% 2024-04-24T23:10:59.146 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55836.log.gz 2024-04-24T23:10:59.147 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47684.log 2024-04-24T23:10:59.147 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40146.log.gz 2024-04-24T23:10:59.148 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-04-24T23:10:59.148 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2024-04-24T23:10:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47684.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T23:10:59.149 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47684.log.gz 2024-04-24T23:10:59.150 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56098.log 2024-04-24T23:10:59.150 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-04-24T23:10:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53154.log 2024-04-24T23:10:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64235.log 2024-04-24T23:10:59.153 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56098.log.gz 2024-04-24T23:10:59.153 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.53154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53154.log.gz 2024-04-24T23:10:59.153 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40188.log 2024-04-24T23:10:59.155 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50857.log 2024-04-24T23:10:59.155 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64235.log.gz 2024-04-24T23:10:59.156 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40188.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40188.log.gz 2024-04-24T23:10:59.156 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-04-24T23:10:59.157 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2024-04-24T23:10:59.157 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50857.log.gz 2024-04-24T23:10:59.158 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46132.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-04-24T23:10:59.158 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66113.log 2024-04-24T23:10:59.159 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57257.log 2024-04-24T23:10:59.160 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2024-04-24T23:10:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66113.log.gz 2024-04-24T23:10:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56004.log 2024-04-24T23:10:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51287.log 2024-04-24T23:10:59.162 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57257.log.gz 2024-04-24T23:10:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56004.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56004.log.gz 2024-04-24T23:10:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50899.log 2024-04-24T23:10:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51702.log 2024-04-24T23:10:59.164 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51287.log.gz 2024-04-24T23:10:59.165 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50899.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50899.log.gz 2024-04-24T23:10:59.165 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2024-04-24T23:10:59.166 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-04-24T23:10:59.167 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51702.log.gz 2024-04-24T23:10:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42274.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2024-04-24T23:10:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40720.log 2024-04-24T23:10:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64547.log 2024-04-24T23:10:59.170 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40720.log.gz 2024-04-24T23:10:59.170 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66362.log 2024-04-24T23:10:59.170 INFO:teuthology.orchestra.run.smithi146.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-04-24T23:10:59.171 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2024-04-24T23:10:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66362.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64547.log.gz 2024-04-24T23:10:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57341.log 2024-04-24T23:10:59.172 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66362.log.gz 2024-04-24T23:10:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52560.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2024-04-24T23:10:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64109.log 2024-04-24T23:10:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64860.log 2024-04-24T23:10:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57341.log: /var/log/ceph/ceph-client.admin.64109.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57341.log.gz 2024-04-24T23:10:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60709.log 2024-04-24T23:10:59.176 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64109.log.gz 2024-04-24T23:10:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68428.log 2024-04-24T23:10:59.176 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64860.log.gz 2024-04-24T23:10:59.178 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60709.log.gz 2024-04-24T23:10:59.178 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33251.log 2024-04-24T23:10:59.179 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42148.log 2024-04-24T23:10:59.179 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68428.log.gz 2024-04-24T23:10:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.33251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2024-04-24T23:10:59.180 INFO:teuthology.orchestra.run.smithi146.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.33251.log.gz 2024-04-24T23:10:59.181 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54521.log 2024-04-24T23:10:59.181 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42148.log.gz 2024-04-24T23:10:59.182 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58293.log 2024-04-24T23:10:59.182 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2024-04-24T23:10:59.183 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55962.log 2024-04-24T23:10:59.183 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54521.log.gz 2024-04-24T23:10:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60625.log 2024-04-24T23:10:59.184 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58293.log.gz 2024-04-24T23:10:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57765.log 2024-04-24T23:10:59.185 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55962.log.gz 2024-04-24T23:10:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2024-04-24T23:10:59.186 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60625.log.gz 2024-04-24T23:10:59.187 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57765.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-24T23:10:59.187 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57765.log.gz 2024-04-24T23:10:59.188 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52007.log 2024-04-24T23:10:59.188 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-04-24T23:10:59.189 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42778.log 2024-04-24T23:10:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52007.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52007.log.gz 2024-04-24T23:10:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54824.log 2024-04-24T23:10:59.191 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-04-24T23:10:59.192 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42778.log.gz 2024-04-24T23:10:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42484.log 2024-04-24T23:10:59.193 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54824.log.gz 2024-04-24T23:10:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-04-24T23:10:59.194 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-04-24T23:10:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64997.log 2024-04-24T23:10:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49665.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42484.log.gz 2024-04-24T23:10:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62416.log 2024-04-24T23:10:59.196 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-04-24T23:10:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-04-24T23:10:59.197 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64997.log.gz 2024-04-24T23:10:59.198 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-04-24T23:10:59.199 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45001.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62416.log.gz 2024-04-24T23:10:59.199 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2024-04-24T23:10:59.200 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-04-24T23:10:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47554.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-04-24T23:10:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57597.log 2024-04-24T23:10:59.202 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-04-24T23:10:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57597.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2024-04-24T23:10:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-04-24T23:10:59.203 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57597.log.gz 2024-04-24T23:10:59.204 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41859.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-04-24T23:10:59.204 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-04-24T23:10:59.205 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44050.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T23:10:59.206 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47949.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-04-24T23:10:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:10:59.207 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-04-24T23:10:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52648.log 2024-04-24T23:10:59.209 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62105.log 2024-04-24T23:10:59.211 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61620.log 2024-04-24T23:10:59.211 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52648.log.gz 2024-04-24T23:10:59.212 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41238.log 2024-04-24T23:10:59.212 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62105.log.gz 2024-04-24T23:10:59.213 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59175.log 2024-04-24T23:10:59.214 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61620.log.gz 2024-04-24T23:10:59.215 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41238.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41238.log.gz 2024-04-24T23:10:59.215 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60287.log 2024-04-24T23:10:59.216 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59175.log.gz 2024-04-24T23:10:59.216 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56393.log 2024-04-24T23:10:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54689.log 2024-04-24T23:10:59.218 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60287.log.gz 2024-04-24T23:10:59.220 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56393.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56393.log.gz 2024-04-24T23:10:59.220 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61452.log 2024-04-24T23:10:59.221 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54689.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-24T23:10:59.221 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2024-04-24T23:10:59.221 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.54689.log.gz 2024-04-24T23:10:59.222 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63607.log 2024-04-24T23:10:59.222 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61452.log.gz 2024-04-24T23:10:59.223 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-04-24T23:10:59.224 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz 2024-04-24T23:10:59.224 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54602.log 2024-04-24T23:10:59.226 INFO:teuthology.orchestra.run.smithi146.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.63607.log.gz 2024-04-24T23:10:59.226 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65921.log 2024-04-24T23:10:59.226 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-04-24T23:10:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57299.log 2024-04-24T23:10:59.228 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54602.log.gz 2024-04-24T23:10:59.228 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65921.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T23:10:59.229 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65921.log.gz 2024-04-24T23:10:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52774.log 2024-04-24T23:10:59.230 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57299.log.gz 2024-04-24T23:10:59.231 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52425.log 2024-04-24T23:10:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49378.log 2024-04-24T23:10:59.233 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52774.log.gz 2024-04-24T23:10:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52425.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52425.log.gz 2024-04-24T23:10:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59091.log 2024-04-24T23:10:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57471.log 2024-04-24T23:10:59.236 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49378.log.gz 2024-04-24T23:10:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40762.log 2024-04-24T23:10:59.237 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59091.log.gz 2024-04-24T23:10:59.238 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-04-24T23:10:59.238 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57471.log.gz 2024-04-24T23:10:59.239 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57172.log 2024-04-24T23:10:59.239 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40762.log.gz 2024-04-24T23:10:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67840.log 2024-04-24T23:10:59.241 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-04-24T23:10:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54975.log 2024-04-24T23:10:59.242 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57172.log.gz 2024-04-24T23:10:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2024-04-24T23:10:59.243 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67840.log.gz 2024-04-24T23:10:59.245 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54975.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54975.log.gz 2024-04-24T23:10:59.245 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.41563.log 2024-04-24T23:10:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51497.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-04-24T23:10:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41573.log 2024-04-24T23:10:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59759.log 2024-04-24T23:10:59.248 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41563.log.gz 2024-04-24T23:10:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41573.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41573.log.gz 2024-04-24T23:10:59.249 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.65626.log 2024-04-24T23:10:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60887.log 2024-04-24T23:10:59.251 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.59759.log.gz 2024-04-24T23:10:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65158.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65626.log.gz 2024-04-24T23:10:59.252 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:10:59.253 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60887.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60887.log.gz 2024-04-24T23:10:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62147.log 2024-04-24T23:10:59.255 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2024-04-24T23:10:59.255 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65158.log.gz 2024-04-24T23:10:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62147.log.gz 2024-04-24T23:10:59.256 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:10:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45043.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz -5 2024-04-24T23:10:59.258 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67966.log 2024-04-24T23:10:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44810.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26136.log 2024-04-24T23:10:59.259 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2024-04-24T23:10:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-04-24T23:10:59.261 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67966.log.gz 2024-04-24T23:10:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.tmp-client.admin.26136.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26136.log.gz 2024-04-24T23:10:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40888.log 2024-04-24T23:10:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-04-24T23:10:59.264 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-04-24T23:10:59.265 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40888.log.gz 2024-04-24T23:10:59.265 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:10:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46720.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-04-24T23:10:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2024-04-24T23:10:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2024-04-24T23:10:59.268 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2024-04-24T23:10:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59562.log 2024-04-24T23:10:59.270 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46426.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2024-04-24T23:10:59.271 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-04-24T23:10:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2024-04-24T23:10:59.272 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59562.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-04-24T23:10:59.273 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59562.log.gz 2024-04-24T23:10:59.274 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66959.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2024-04-24T23:10:59.274 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61410.log 2024-04-24T23:10:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42736.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-04-24T23:10:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47596.log 2024-04-24T23:10:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52900.log 2024-04-24T23:10:59.277 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61410.log.gz 2024-04-24T23:10:59.278 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2024-04-24T23:10:59.281 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47596.log.gz 2024-04-24T23:10:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52900.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52900.log.gz 2024-04-24T23:10:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.63103.log: /var/log/ceph/ceph-client.admin.59133.log 2024-04-24T23:10:59.282 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2024-04-24T23:10:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2024-04-24T23:10:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52690.log 2024-04-24T23:10:59.283 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59133.log.gz 2024-04-24T23:10:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51413.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-04-24T23:10:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41905.log 2024-04-24T23:10:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52690.log.gz 2024-04-24T23:10:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45322.log 2024-04-24T23:10:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52518.log 2024-04-24T23:10:59.287 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41905.log.gz 2024-04-24T23:10:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45322.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45322.log.gz 2024-04-24T23:10:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.52518.log: --verbose -- /var/log/ceph/ceph-client.admin.55224.log 2024-04-24T23:10:59.290 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52518.log.gz 2024-04-24T23:10:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67756.log 2024-04-24T23:10:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2024-04-24T23:10:59.292 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55224.log.gz 2024-04-24T23:10:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67756.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67756.log.gz 2024-04-24T23:10:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51077.log 2024-04-24T23:10:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52381.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2024-04-24T23:10:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65541.log 2024-04-24T23:10:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54770.log 2024-04-24T23:10:59.297 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51077.log.gz 2024-04-24T23:10:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65541.log.gz 2024-04-24T23:10:59.299 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39400.log 2024-04-24T23:10:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66570.log 2024-04-24T23:10:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39400.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.54770.log.gz 2024-04-24T23:10:59.302 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39400.log.gz 2024-04-24T23:10:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.66570.log: -- /var/log/ceph/ceph-client.admin.62542.log 2024-04-24T23:10:59.302 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66570.log.gz 2024-04-24T23:10:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68344.log 2024-04-24T23:10:59.305 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50173.log 2024-04-24T23:10:59.305 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62542.log.gz 2024-04-24T23:10:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68344.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68344.log.gz 2024-04-24T23:10:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58777.log 2024-04-24T23:10:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50173.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50173.log.gz 2024-04-24T23:10:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T23:10:59.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-04-24T23:10:59.309 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58777.log.gz 2024-04-24T23:10:59.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.54629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51161.log 2024-04-24T23:10:59.313 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-04-24T23:10:59.313 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-04-24T23:10:59.314 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51161.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2024-04-24T23:10:59.315 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63060.log 2024-04-24T23:10:59.316 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47217.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-04-24T23:10:59.317 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54401.log 2024-04-24T23:10:59.318 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63060.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63060.log.gz 2024-04-24T23:10:59.319 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59627.log 2024-04-24T23:10:59.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2024-04-24T23:10:59.321 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.54401.log.gz 2024-04-24T23:10:59.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59627.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58338.log 2024-04-24T23:10:59.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52966.log: -- replaced with /var/log/ceph/ceph-client.admin.59627.log.gz 2024-04-24T23:10:59.324 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2024-04-24T23:10:59.325 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2024-04-24T23:10:59.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58338.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58338.log.gz 2024-04-24T23:10:59.327 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64277.log 2024-04-24T23:10:59.330 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49261.log: /var/log/ceph/ceph-client.admin.64277.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64277.log.gz 2024-04-24T23:10:59.331 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2024-04-24T23:10:59.332 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2024-04-24T23:10:59.333 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39250.log 2024-04-24T23:10:59.334 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2024-04-24T23:10:59.335 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2024-04-24T23:10:59.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39250.log.gz 2024-04-24T23:10:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54548.log/var/log/ceph/ceph-client.admin.46174.log: 2024-04-24T23:10:59.337 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2024-04-24T23:10:59.338 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60929.log 2024-04-24T23:10:59.339 INFO:teuthology.orchestra.run.smithi203.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-24T23:10:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54548.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54548.log.gz 2024-04-24T23:10:59.341 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-04-24T23:10:59.342 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60929.log.gz 2024-04-24T23:10:59.342 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38995.log 2024-04-24T23:10:59.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-04-24T23:10:59.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52606.log 2024-04-24T23:10:59.345 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38995.log.gz 2024-04-24T23:10:59.346 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58929.log 2024-04-24T23:10:59.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52606.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52606.log.gz 2024-04-24T23:10:59.348 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66301.log 2024-04-24T23:10:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58929.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58929.log.gz 2024-04-24T23:10:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51245.log 2024-04-24T23:10:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.66301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66301.log.gz 2024-04-24T23:10:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2024-04-24T23:10:59.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51245.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51245.log.gz 2024-04-24T23:10:59.354 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59870.log 2024-04-24T23:10:59.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.53847.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-04-24T23:10:59.356 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60221.log 2024-04-24T23:10:59.357 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59870.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.59870.log.gz 2024-04-24T23:10:59.358 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.60221.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64319.log 2024-04-24T23:10:59.359 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60221.log.gz 2024-04-24T23:10:59.360 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58242.log 2024-04-24T23:10:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64319.log.gz 2024-04-24T23:10:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47470.log 2024-04-24T23:10:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58242.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58242.log.gz 2024-04-24T23:10:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64716.log 2024-04-24T23:10:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47470.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47470.log.gz 2024-04-24T23:10:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59944.log 2024-04-24T23:10:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64716.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64716.log.gz 2024-04-24T23:10:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-04-24T23:10:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59944.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59944.log.gz 2024-04-24T23:10:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64776.log 2024-04-24T23:10:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38654.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-04-24T23:10:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64776.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64776.log.gz 2024-04-24T23:10:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67313.log 2024-04-24T23:10:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62235.log 2024-04-24T23:10:59.375 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67313.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67313.log.gz 2024-04-24T23:10:59.376 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62286.log 2024-04-24T23:10:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62235.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62235.log.gz 2024-04-24T23:10:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41056.log 2024-04-24T23:10:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62286.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62286.log.gz 2024-04-24T23:10:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58380.log 2024-04-24T23:10:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41056.log.gz 2024-04-24T23:10:59.382 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.58380.log: /var/log/ceph/ceph-client.admin.67924.log 2024-04-24T23:10:59.382 INFO:teuthology.orchestra.run.smithi203.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-24T23:10:59.383 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58380.log.gz 2024-04-24T23:10:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-04-24T23:10:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67924.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67924.log.gz 2024-04-24T23:10:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-04-24T23:10:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46300.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2024-04-24T23:10:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-04-24T23:10:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44680.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-04-24T23:10:59.389 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41233.log 2024-04-24T23:10:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49415.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz/var/log/ceph/ceph-client.admin.41233.log: 2024-04-24T23:10:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41233.log.gz 2024-04-24T23:10:59.392 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.42984.log 2024-04-24T23:10:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59407.log 2024-04-24T23:10:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42984.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2024-04-24T23:10:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-04-24T23:10:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-04-24T23:10:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-04-24T23:10:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44176.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-04-24T23:10:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.44092.log: --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-04-24T23:10:59.400 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-04-24T23:10:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50215.log 2024-04-24T23:10:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48117.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-04-24T23:10:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-04-24T23:10:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50215.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50215.log.gz 2024-04-24T23:10:59.405 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58715.log 2024-04-24T23:10:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44218.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-04-24T23:10:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-04-24T23:10:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58715.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58715.log.gz 2024-04-24T23:10:59.409 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-04-24T23:10:59.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51642.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-04-24T23:10:59.411 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54797.log 2024-04-24T23:10:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54368.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-04-24T23:10:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54797.log: -- /var/log/ceph/ceph-client.admin.67439.log 2024-04-24T23:10:59.414 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.54797.log.gz 2024-04-24T23:10:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-04-24T23:10:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67439.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2024-04-24T23:10:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59796.log 2024-04-24T23:10:59.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-04-24T23:10:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63145.log 2024-04-24T23:10:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59796.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.59796.log.gz 2024-04-24T23:10:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44857.log 2024-04-24T23:10:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63145.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.63145.log.gz 2024-04-24T23:10:59.423 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49623.log 2024-04-24T23:10:59.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44857.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44857.log.gz 2024-04-24T23:10:59.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52337.log 2024-04-24T23:10:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49623.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49623.log.gz 2024-04-24T23:10:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56832.log 2024-04-24T23:10:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52337.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52337.log.gz 2024-04-24T23:10:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56308.log 2024-04-24T23:10:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56832.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56832.log.gz 2024-04-24T23:10:59.431 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56308.log: /var/log/ceph/ceph-client.admin.58892.log 2024-04-24T23:10:59.431 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56308.log.gz 2024-04-24T23:10:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56140.log 2024-04-24T23:10:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58892.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.58892.log.gz 2024-04-24T23:10:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68570.log 2024-04-24T23:10:59.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56140.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56140.log.gz 2024-04-24T23:10:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68570.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68570.log.gz 2024-04-24T23:10:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41235.log 2024-04-24T23:10:59.439 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61722.log 2024-04-24T23:10:59.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41235.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41235.log.gz 2024-04-24T23:10:59.441 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54461.log 2024-04-24T23:10:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61722.log.gz 2024-04-24T23:10:59.443 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63805.log 2024-04-24T23:10:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54461.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54461.log.gz 2024-04-24T23:10:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64403.log 2024-04-24T23:10:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63805.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63805.log.gz 2024-04-24T23:10:59.447 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40414.log 2024-04-24T23:10:59.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64403.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64403.log.gz 2024-04-24T23:10:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47260.log 2024-04-24T23:10:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40414.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40414.log.gz 2024-04-24T23:10:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65795.log 2024-04-24T23:10:59.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47260.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47260.log.gz 2024-04-24T23:10:59.452 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63355.log 2024-04-24T23:10:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65795.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65795.log.gz 2024-04-24T23:10:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2024-04-24T23:10:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63355.log: /var/log/ceph/ceph-client.admin.45568.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.63355.log.gz 2024-04-24T23:10:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56664.log 2024-04-24T23:10:59.457 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz 2024-04-24T23:10:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61662.log 2024-04-24T23:10:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56664.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56664.log.gz 2024-04-24T23:10:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61662.log: /var/log/ceph/ceph-client.admin.66047.log 2024-04-24T23:10:59.461 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61662.log.gz 2024-04-24T23:10:59.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65711.log 2024-04-24T23:10:59.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66047.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66047.log.gz 2024-04-24T23:10:59.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40804.log 2024-04-24T23:10:59.464 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65711.log.gz 2024-04-24T23:10:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39039.log 2024-04-24T23:10:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40804.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40804.log.gz 2024-04-24T23:10:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42820.log 2024-04-24T23:10:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39039.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39039.log.gz 2024-04-24T23:10:59.469 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51119.log 2024-04-24T23:10:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42820.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.42820.log.gz 2024-04-24T23:10:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57807.log 2024-04-24T23:10:59.472 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51119.log.gz 2024-04-24T23:10:59.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2024-04-24T23:10:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57807.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57807.log.gz 2024-04-24T23:10:59.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.42106.log: --verbose -- /var/log/ceph/ceph-client.admin.60667.log 2024-04-24T23:10:59.476 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2024-04-24T23:10:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61578.log 2024-04-24T23:10:59.479 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60667.log.gz 2024-04-24T23:10:59.480 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61578.log: /var/log/ceph/ceph-client.admin.40846.log 2024-04-24T23:10:59.480 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61578.log.gz 2024-04-24T23:10:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40846.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52295.log 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47823.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52295.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52295.log.gz 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.51329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56224.log 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-04-24T23:10:59.489 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56266.log 2024-04-24T23:10:59.491 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56224.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56224.log.gz 2024-04-24T23:10:59.491 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56266.log: /var/log/ceph/ceph-client.admin.48942.log 2024-04-24T23:10:59.491 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56266.log.gz 2024-04-24T23:10:59.492 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68530.log 2024-04-24T23:10:59.494 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48942.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48942.log.gz 2024-04-24T23:10:59.494 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2024-04-24T23:10:59.495 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68530.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68530.log.gz 2024-04-24T23:10:59.496 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2024-04-24T23:10:59.497 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49224.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2024-04-24T23:10:59.498 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49482.log: /var/log/ceph/ceph-client.admin.40104.log 2024-04-24T23:10:59.499 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2024-04-24T23:10:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56706.log 2024-04-24T23:10:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40104.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40104.log.gz 2024-04-24T23:10:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.56706.log: --verbose -- /var/log/ceph/ceph-client.admin.65753.log 2024-04-24T23:10:59.502 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56706.log.gz 2024-04-24T23:10:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-04-24T23:10:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65753.log.gz 2024-04-24T23:10:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47428.log 2024-04-24T23:10:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41557.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-04-24T23:10:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2024-04-24T23:10:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47428.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47428.log.gz 2024-04-24T23:10:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40678.log 2024-04-24T23:10:59.510 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44638.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2024-04-24T23:10:59.511 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68092.log 2024-04-24T23:10:59.512 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40678.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40678.log.gz 2024-04-24T23:10:59.513 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50941.log 2024-04-24T23:10:59.514 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68092.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68092.log.gz 2024-04-24T23:10:59.515 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2024-04-24T23:10:59.515 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50941.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50941.log.gz 2024-04-24T23:10:59.516 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62191.log 2024-04-24T23:10:59.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68008.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2024-04-24T23:10:59.518 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-04-24T23:10:59.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62191.log.gz 2024-04-24T23:10:59.520 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54194.log 2024-04-24T23:10:59.521 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38911.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-04-24T23:10:59.521 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41553.log 2024-04-24T23:10:59.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54194.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.54194.log.gz 2024-04-24T23:10:59.524 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2024-04-24T23:10:59.524 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41553.log.gz 2024-04-24T23:10:59.526 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-04-24T23:10:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46678.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2024-04-24T23:10:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55028.log/var/log/ceph/ceph-client.admin.56579.log: 2024-04-24T23:10:59.528 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-04-24T23:10:59.529 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41568.log 2024-04-24T23:10:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55028.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55028.log.gz 2024-04-24T23:10:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-04-24T23:10:59.532 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41568.log.gz 2024-04-24T23:10:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54140.log 2024-04-24T23:10:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-04-24T23:10:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2024-04-24T23:10:59.535 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54140.log.gz 2024-04-24T23:10:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54575.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2024-04-24T23:10:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42442.log 2024-04-24T23:10:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56477.log 2024-04-24T23:10:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42442.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42442.log.gz 2024-04-24T23:10:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67714.log 2024-04-24T23:10:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56477.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56477.log.gz 2024-04-24T23:10:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59669.log/var/log/ceph/ceph-client.admin.67714.log: 2024-04-24T23:10:59.544 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67714.log.gz 2024-04-24T23:10:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58446.log 2024-04-24T23:10:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59669.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59669.log.gz 2024-04-24T23:10:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66404.log 2024-04-24T23:10:59.548 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58446.log.gz 2024-04-24T23:10:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66404.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.66404.log.gz 2024-04-24T23:10:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58855.log 2024-04-24T23:10:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63691.log 2024-04-24T23:10:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58855.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58855.log.gz 2024-04-24T23:10:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64674.log 2024-04-24T23:10:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63691.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.63691.log.gz 2024-04-24T23:10:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51744.log 2024-04-24T23:10:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64674.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64674.log.gz 2024-04-24T23:10:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-04-24T23:10:59.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51744.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51744.log.gz 2024-04-24T23:10:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56874.log 2024-04-24T23:10:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-04-24T23:10:59.561 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43312.log 2024-04-24T23:10:59.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56874.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56874.log.gz 2024-04-24T23:10:59.563 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62370.log/var/log/ceph/ceph-client.0.43312.log: 2024-04-24T23:10:59.563 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43312.log.gz 2024-04-24T23:10:59.564 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2024-04-24T23:10:59.567 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62370.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62370.log.gz 2024-04-24T23:10:59.567 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41237.log: -- /var/log/ceph/ceph-client.admin.47739.log 2024-04-24T23:10:59.567 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2024-04-24T23:10:59.568 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64151.log 2024-04-24T23:10:59.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47739.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-04-24T23:10:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log/var/log/ceph/ceph-client.admin.64151.log: 2024-04-24T23:10:59.571 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64151.log.gz 2024-04-24T23:10:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-04-24T23:10:59.574 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47014.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-04-24T23:10:59.574 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46804.log: -- /var/log/ceph/ceph-client.admin.38531.log 2024-04-24T23:10:59.575 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-04-24T23:10:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38531.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38531.log.gz 2024-04-24T23:10:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-04-24T23:10:59.580 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66833.log 2024-04-24T23:10:59.580 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-04-24T23:10:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-04-24T23:10:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66833.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66833.log.gz 2024-04-24T23:10:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41570.log 2024-04-24T23:10:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49146.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-04-24T23:10:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61181.log 2024-04-24T23:10:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41570.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41570.log.gz 2024-04-24T23:10:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61181.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61181.log.gz 2024-04-24T23:10:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63187.log 2024-04-24T23:10:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38823.log 2024-04-24T23:10:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63187.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63187.log.gz 2024-04-24T23:10:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54287.log 2024-04-24T23:10:59.591 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38823.log.gz 2024-04-24T23:10:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42694.log 2024-04-24T23:10:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54287.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54287.log.gz 2024-04-24T23:10:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.42694.log: --verbose -- /var/log/ceph/ceph-client.admin.67798.log 2024-04-24T23:10:59.595 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42694.log.gz 2024-04-24T23:10:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53652.log 2024-04-24T23:10:59.597 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67798.log.gz 2024-04-24T23:10:59.599 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56519.log/var/log/ceph/ceph-client.admin.53652.log: 2024-04-24T23:10:59.599 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53652.log.gz 2024-04-24T23:10:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2024-04-24T23:10:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56519.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56519.log.gz 2024-04-24T23:10:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59259.log 2024-04-24T23:10:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.39166.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-04-24T23:10:59.603 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57214.log 2024-04-24T23:10:59.605 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59259.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59259.log.gz 2024-04-24T23:10:59.605 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61223.log 2024-04-24T23:10:59.606 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57214.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57214.log.gz 2024-04-24T23:10:59.607 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61223.log: /var/log/ceph/ceph-client.admin.62626.log 2024-04-24T23:10:59.608 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61223.log.gz 2024-04-24T23:10:59.609 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62063.log 2024-04-24T23:10:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62626.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62626.log.gz 2024-04-24T23:10:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67882.log 2024-04-24T23:10:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62063.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62063.log.gz 2024-04-24T23:10:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-04-24T23:10:59.613 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67882.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67882.log.gz 2024-04-24T23:10:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-04-24T23:10:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44765.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-04-24T23:10:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40636.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-04-24T23:10:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59981.log 2024-04-24T23:10:59.619 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-04-24T23:10:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59981.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.59981.log.gz 2024-04-24T23:10:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44916.log 2024-04-24T23:10:59.621 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-04-24T23:10:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50815.log 2024-04-24T23:10:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44916.log.gz 2024-04-24T23:10:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64590.log 2024-04-24T23:10:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50815.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50815.log.gz 2024-04-24T23:10:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66791.log 2024-04-24T23:10:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64590.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64590.log.gz 2024-04-24T23:10:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52816.log 2024-04-24T23:10:59.628 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66791.log.gz 2024-04-24T23:10:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-04-24T23:10:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52816.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52816.log.gz 2024-04-24T23:10:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63481.log 2024-04-24T23:10:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-04-24T23:10:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52169.log 2024-04-24T23:10:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63481.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.63481.log.gz 2024-04-24T23:10:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.52169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52169.log.gz 2024-04-24T23:10:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56790.log 2024-04-24T23:10:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2024-04-24T23:10:59.638 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56790.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56790.log.gz 2024-04-24T23:10:59.639 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65243.log 2024-04-24T23:10:59.640 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2024-04-24T23:10:59.641 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59711.log 2024-04-24T23:10:59.642 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65243.log.gz 2024-04-24T23:10:59.643 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43790.log 2024-04-24T23:10:59.645 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59711.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59711.log.gz 2024-04-24T23:10:59.645 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.2.43790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 0.0% -- replaced with /var/log/ceph/ceph-client.2.43790.log.gz 2024-04-24T23:10:59.645 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:10:59.647 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59217.log 2024-04-24T23:10:59.648 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-04-24T23:10:59.649 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.59217.log: --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-04-24T23:10:59.649 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59217.log.gz 2024-04-24T23:10:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57555.log 2024-04-24T23:10:59.652 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48225.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-04-24T23:10:59.652 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61013.log 2024-04-24T23:10:59.653 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57555.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57555.log.gz 2024-04-24T23:10:59.654 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-24T23:10:59.655 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61013.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61013.log.gz 2024-04-24T23:10:59.656 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log 2024-04-24T23:10:59.658 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.67169.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2024-04-24T23:10:59.659 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65200.log 2024-04-24T23:10:59.661 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40972.log 2024-04-24T23:10:59.663 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65200.log.gz 2024-04-24T23:10:59.664 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41844.log 2024-04-24T23:10:59.667 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40972.log: gzip/var/log/ceph/ceph-client.admin.41844.log: 89.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.65285.log 2024-04-24T23:10:59.667 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40972.log.gz 2024-04-24T23:10:59.668 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41844.log.gz 2024-04-24T23:10:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2024-04-24T23:10:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65285.log: /var/log/ceph/ceph-client.admin.63229.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65285.log.gz 2024-04-24T23:10:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56622.log 2024-04-24T23:10:59.676 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2024-04-24T23:10:59.677 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2024-04-24T23:10:59.682 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56622.log: 88.5%/var/log/ceph/ceph-client.admin.48984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45610.log 2024-04-24T23:10:59.682 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56622.log.gz 2024-04-24T23:10:59.683 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2024-04-24T23:10:59.685 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2024-04-24T23:10:59.688 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45610.log: /var/log/ceph/ceph-client.admin.44134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58673.log 2024-04-24T23:10:59.688 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45610.log.gz 2024-04-24T23:10:59.691 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58673.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2024-04-24T23:10:59.692 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-04-24T23:10:59.692 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58673.log.gz 2024-04-24T23:10:59.694 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-04-24T23:10:59.694 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59477.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-04-24T23:10:59.696 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60090.log 2024-04-24T23:10:59.697 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45406.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-04-24T23:10:59.699 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58800.log 2024-04-24T23:10:59.702 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60090.log.gz 2024-04-24T23:10:59.703 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58800.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.58800.log.gz 2024-04-24T23:10:59.704 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55070.log 2024-04-24T23:10:59.705 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2024-04-24T23:10:59.706 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67629.log 2024-04-24T23:10:59.708 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55070.log.gz 2024-04-24T23:10:59.709 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2024-04-24T23:10:59.709 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2024-04-24T23:10:59.712 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2024-04-24T23:10:59.712 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-24T23:10:59.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67629.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67629.log.gz 2024-04-24T23:10:59.717 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46552.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-04-24T23:10:59.717 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2024-04-24T23:10:59.720 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49731.log 2024-04-24T23:10:59.722 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66005.log 2024-04-24T23:10:59.722 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2024-04-24T23:10:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49731.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49731.log.gz 2024-04-24T23:10:59.725 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64193.log 2024-04-24T23:10:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67085.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66005.log.gz 2024-04-24T23:10:59.727 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:10:59.729 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2024-04-24T23:10:59.731 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3%/var/log/ceph/ceph-client.admin.67085.log: -- replaced with /var/log/ceph/ceph-client.admin.64193.log.gz 2024-04-24T23:10:59.731 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2024-04-24T23:10:59.732 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67085.log.gz 2024-04-24T23:10:59.733 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65371.log 2024-04-24T23:10:59.735 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61307.log 2024-04-24T23:10:59.737 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65371.log.gz 2024-04-24T23:10:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50292.log 2024-04-24T23:10:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61307.log: /var/log/ceph/ceph-client.admin.50292.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-04-24T23:10:59.743 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61307.log.gz 2024-04-24T23:10:59.744 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50292.log.gz 2024-04-24T23:10:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2024-04-24T23:10:59.750 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44470.log: /var/log/ceph/ceph-client.admin.49304.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54488.log 2024-04-24T23:10:59.750 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-04-24T23:10:59.751 INFO:teuthology.orchestra.run.smithi146.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2024-04-24T23:10:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60971.log 2024-04-24T23:10:59.757 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54488.log: /var/log/ceph/ceph-client.admin.60971.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58512.log 2024-04-24T23:10:59.758 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54488.log.gz 2024-04-24T23:10:59.759 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60971.log.gz 2024-04-24T23:10:59.759 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40456.log 2024-04-24T23:10:59.762 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49068.log 2024-04-24T23:10:59.764 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40456.log: /var/log/ceph/ceph-client.admin.49068.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2024-04-24T23:10:59.765 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58512.log.gz 2024-04-24T23:10:59.766 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40456.log.gz 2024-04-24T23:10:59.768 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42358.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2024-04-24T23:10:59.768 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64632.log 2024-04-24T23:10:59.768 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49068.log.gz 2024-04-24T23:10:59.770 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59833.log 2024-04-24T23:10:59.772 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64632.log.gz 2024-04-24T23:10:59.773 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39081.log 2024-04-24T23:10:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59833.log: /var/log/ceph/ceph-client.admin.39081.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40558.log 2024-04-24T23:10:59.779 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59833.log.gz 2024-04-24T23:10:59.779 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39081.log.gz 2024-04-24T23:10:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-04-24T23:10:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40558.log: /var/log/ceph/ceph-client.admin.42316.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2024-04-24T23:10:59.785 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40558.log.gz 2024-04-24T23:10:59.786 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-04-24T23:10:59.788 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57909.log 2024-04-24T23:10:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38697.log: /var/log/ceph/ceph-client.admin.57909.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 2024-04-24T23:10:59.793 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gz 2024-04-24T23:10:59.794 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57909.log.gz 2024-04-24T23:10:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67397.log 2024-04-24T23:10:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.38867.log: /var/log/ceph/ceph-client.admin.67397.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2024-04-24T23:10:59.800 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2024-04-24T23:10:59.801 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67397.log.gz 2024-04-24T23:10:59.803 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66875.log 2024-04-24T23:10:59.807 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44260.log: /var/log/ceph/ceph-client.admin.66875.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62710.log 2024-04-24T23:10:59.807 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-04-24T23:10:59.809 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66875.log.gz 2024-04-24T23:10:59.811 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2024-04-24T23:10:59.815 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41574.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55878.log 2024-04-24T23:10:59.815 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62710.log.gz 2024-04-24T23:10:59.816 INFO:teuthology.orchestra.run.smithi146.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-24T23:10:59.816 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2024-04-24T23:10:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42526.log 2024-04-24T23:10:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55878.log.gz 2024-04-24T23:10:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67229.log 2024-04-24T23:10:59.820 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42526.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42526.log.gz 2024-04-24T23:10:59.821 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-04-24T23:10:59.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67229.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67229.log.gz 2024-04-24T23:10:59.823 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68260.log 2024-04-24T23:10:59.823 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-04-24T23:10:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68260.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68260.log.gz 2024-04-24T23:10:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2024-04-24T23:10:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61357.log 2024-04-24T23:10:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44722.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2024-04-24T23:10:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40272.log 2024-04-24T23:10:59.831 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61357.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61357.log.gz 2024-04-24T23:10:59.831 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48413.log 2024-04-24T23:10:59.832 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.40272.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40272.log.gz 2024-04-24T23:10:59.833 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.48413.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-04-24T23:10:59.833 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.48413.log.gz 2024-04-24T23:10:59.835 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41219.log 2024-04-24T23:10:59.836 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44554.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-04-24T23:10:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68386.log 2024-04-24T23:10:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41219.log.gz 2024-04-24T23:10:59.838 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42190.log 2024-04-24T23:10:59.840 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68386.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68386.log.gz 2024-04-24T23:10:59.841 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42190.log: -- /var/log/ceph/ceph-client.admin.64902.log 2024-04-24T23:10:59.841 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42190.log.gz 2024-04-24T23:10:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-04-24T23:10:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64902.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64902.log.gz 2024-04-24T23:10:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45448.log: /var/log/ceph/ceph-client.admin.68176.log 2024-04-24T23:10:59.845 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-04-24T23:10:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67672.log 2024-04-24T23:10:59.847 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68176.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68176.log.gz 2024-04-24T23:10:59.848 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54260.log 2024-04-24T23:10:59.848 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67672.log.gz 2024-04-24T23:10:59.850 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62668.log 2024-04-24T23:10:59.851 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.54260.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54260.log.gz 2024-04-24T23:10:59.852 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62668.log: -- /var/log/ceph/ceph-client.admin.62776.log 2024-04-24T23:10:59.852 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62668.log.gz 2024-04-24T23:10:59.853 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-04-24T23:10:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62776.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62776.log.gz 2024-04-24T23:10:59.856 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45736.log: -- /var/log/ceph/ceph-client.admin.53694.log 2024-04-24T23:10:59.856 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2024-04-24T23:10:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-04-24T23:10:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.53694.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53694.log.gz 2024-04-24T23:10:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60175.log/var/log/ceph/ceph-client.admin.44302.log: 2024-04-24T23:10:59.861 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-04-24T23:10:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2024-04-24T23:10:59.862 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60175.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60175.log.gz 2024-04-24T23:10:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46888.log: /var/log/ceph/ceph-client.admin.33519.log 2024-04-24T23:10:59.864 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2024-04-24T23:10:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-04-24T23:10:59.866 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.33519.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-04-24T23:10:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61265.log 2024-04-24T23:10:59.867 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50131.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-04-24T23:10:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-04-24T23:10:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61265.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61265.log.gz 2024-04-24T23:10:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48075.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-04-24T23:11:00.095 INFO:teuthology.orchestra.run.smithi146.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T23:11:00.311 INFO:teuthology.orchestra.run.smithi203.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-24T23:11:00.433 INFO:teuthology.orchestra.run.smithi203.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-24T23:11:00.467 INFO:teuthology.orchestra.run.smithi203.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-24T23:11:00.580 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-24T23:11:00.660 INFO:teuthology.orchestra.run.smithi203.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-24T23:11:00.804 INFO:teuthology.orchestra.run.smithi146.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T23:11:00.871 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T23:11:00.920 INFO:teuthology.orchestra.run.smithi203.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-24T23:11:00.925 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-24T23:11:00.925 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m1.986s 2024-04-24T23:11:00.926 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m8.166s 2024-04-24T23:11:00.926 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m0.728s 2024-04-24T23:11:01.002 INFO:teuthology.orchestra.run.smithi146.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T23:11:01.050 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T23:11:01.054 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-24T23:11:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m2.120s 2024-04-24T23:11:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m8.978s 2024-04-24T23:11:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m2.141s 2024-04-24T23:11:01.055 INFO:tasks.ceph:Archiving logs... 2024-04-24T23:11:01.055 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi146/log 2024-04-24T23:11:01.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:11:02.727 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi203/log 2024-04-24T23:11:02.728 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:11:03.898 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T23:11:03.908 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T23:11:03.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:11:03.916 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:11:04.079 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T23:11:04.088 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T23:11:04.089 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:11:04.096 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:11:04.143 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:^- hv01.front.sepia.ceph.com 2 6 377 35 +1254us[+1254us] +/- 569ms 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +63us[ +63us] +/- 53ms 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv03.front.sepia.ceph.com 3 6 377 37 -74us[ -82us] +/- 60ms 2024-04-24T23:11:04.152 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:11:04.153 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-04-24T23:11:04.163 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T23:11:04.163 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-04-24T23:11:04.163 INFO:teuthology.orchestra.run.smithi203.stdout:^- hv01.front.sepia.ceph.com 2 6 377 33 +1257us[+1257us] +/- 569ms 2024-04-24T23:11:04.163 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 +58us[ +79us] +/- 53ms 2024-04-24T23:11:04.163 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv03.front.sepia.ceph.com 3 6 377 33 -43us[ -22us] +/- 61ms 2024-04-24T23:11:04.164 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T23:11:04.165 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T23:11:04.175 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T23:11:04.175 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T23:11:04.185 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T23:11:04.390 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T23:11:04.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T23:11:04.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:11:04.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T23:11:04.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:11:04.769 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T23:11:04.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T23:11:04.788 INFO:teuthology.task.internal:Duration was 1192.871332 seconds 2024-04-24T23:11:04.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T23:11:04.798 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T23:11:04.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:11:04.806 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:11:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T23:11:04.939 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T23:11:05.419 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T23:11:05.419 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-04-24T23:11:05.419 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:11:05.482 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-04-24T23:11:05.483 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:11:05.557 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T23:11:05.557 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:11:05.565 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:11:05.644 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T23:11:05.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:11:05.650 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:11:05.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T23:11:05.852 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T23:11:05.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:11:05.925 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:11:06.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T23:11:06.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:11:06.032 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:11:06.127 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-04-24T23:11:06.132 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-04-24T23:11:06.173 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:11:06.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:11:06.223 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:11:06.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:11:06.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T23:11:06.288 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T23:11:06.288 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi146 2024-04-24T23:11:06.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:11:06.382 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672163/remote/smithi203 2024-04-24T23:11:06.382 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:11:06.478 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T23:11:06.479 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:11:06.486 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:11:06.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T23:11:06.555 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T23:11:06.555 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T23:11:06.565 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T23:11:06.566 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:11:06.571 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:11:06.620 INFO:teuthology.orchestra.run.smithi146.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:11 /home/ubuntu/cephtest 2024-04-24T23:11:06.627 INFO:teuthology.orchestra.run.smithi203.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:11 /home/ubuntu/cephtest 2024-04-24T23:11:06.630 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T23:11:06.644 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T23:11:06.671 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair} duration: 1192.8713324069977 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T23:11:06.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T23:11:06.769 INFO:teuthology.run:pass